Nov 16 10:06:13 user nova-compute[85141]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=85141) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=85141) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=85141) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 16 10:06:13 user nova-compute[85141]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.018s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:06:13 user nova-compute[85141]: INFO nova.virt.driver [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] Loading compute driver 'libvirt.LibvirtDriver'
Nov 16 10:06:13 user nova-compute[85141]: INFO nova.compute.provider_config [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] Acquiring lock "singleton_lock" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] Acquired lock "singleton_lock" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] Releasing lock "singleton_lock" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] Full set of CONF: {{(pid=85141) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:362}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] ******************************************************************************** {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] Configuration options gathered from: {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] ================================================================================ {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] allow_resize_to_same_host      = True {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] arq_binding_timeout            = 300 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] backdoor_port                  = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] backdoor_socket                = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] block_device_allocate_retries  = 300 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] block_device_allocate_retries_interval = 5 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] cert                           = self.pem {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] compute_monitors               = [] {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] config_dir                     = [] {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] config_drive_format            = iso9660 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] config_source                  = [] {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] console_host                   = user {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] control_exchange               = nova {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] cpu_allocation_ratio           = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] daemon                         = False {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] debug                          = True {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] default_access_ip_network_name = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] default_availability_zone      = nova {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] default_ephemeral_format       = ext4 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] default_green_pool_size        = 1000 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] default_schedule_zone          = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] disk_allocation_ratio          = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] enable_new_services            = True {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] enabled_apis                   = ['osapi_compute'] {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] enabled_ssl_apis               = [] {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] flat_injected                  = False {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] force_config_drive             = False {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] force_raw_images               = True {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] graceful_shutdown_timeout      = 5 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] heal_instance_info_cache_interval = 60 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] host                           = user {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] initial_disk_allocation_ratio  = 1.0 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] initial_ram_allocation_ratio   = 1.0 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] instance_build_timeout         = 0 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] instance_delete_interval       = 300 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] instance_format                = [instance: %(uuid)s]  {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] instance_name_template         = instance-%08x {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] instance_usage_audit           = False {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] instance_usage_audit_period    = month {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] internal_service_availability_zone = internal {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] key                            = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] live_migration_retry_count     = 30 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] log_config_append              = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] log_dir                        = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] log_file                       = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] log_options                    = True {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] log_rotate_interval            = 1 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] log_rotate_interval_type       = days {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] log_rotation_type              = none {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] long_rpc_timeout               = 1800 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] max_concurrent_builds          = 10 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] max_concurrent_live_migrations = 1 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] max_concurrent_snapshots       = 5 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] max_local_block_devices        = 3 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] max_logfile_count              = 30 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] max_logfile_size_mb            = 200 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] maximum_instance_delete_attempts = 5 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] metadata_listen                = 0.0.0.0 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] metadata_listen_port           = 8775 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] metadata_workers               = 3 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] migrate_max_retries            = -1 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] mkisofs_cmd                    = genisoimage {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] my_block_storage_ip            = 10.0.0.210 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] my_ip                          = 10.0.0.210 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] network_allocate_retries       = 0 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] osapi_compute_listen           = 0.0.0.0 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] osapi_compute_listen_port      = 8774 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] osapi_compute_unique_server_name_scope =  {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] osapi_compute_workers          = 3 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] password_length                = 12 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] periodic_enable                = True {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] periodic_fuzzy_delay           = 60 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] pointer_model                  = ps2mouse {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] preallocate_images             = none {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] publish_errors                 = False {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] pybasedir                      = /opt/stack/nova {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] ram_allocation_ratio           = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] rate_limit_burst               = 0 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] rate_limit_except_level        = CRITICAL {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] rate_limit_interval            = 0 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] reboot_timeout                 = 0 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] reclaim_instance_interval      = 0 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] record                         = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] reimage_timeout_per_gb         = 60 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] report_interval                = 120 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] rescue_timeout                 = 0 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] reserved_host_cpus             = 0 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] reserved_host_disk_mb          = 0 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] reserved_host_memory_mb        = 512 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] reserved_huge_pages            = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] resize_confirm_window          = 0 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] resize_fs_using_block_device   = False {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] resume_guests_state_on_host_boot = False {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] rpc_response_timeout           = 60 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] run_external_periodic_tasks    = True {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] running_deleted_instance_action = reap {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] running_deleted_instance_poll_interval = 1800 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] running_deleted_instance_timeout = 0 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] scheduler_instance_sync_interval = 120 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] service_down_time              = 720 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] servicegroup_driver            = db {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] shelved_offload_time           = 0 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] shelved_poll_interval          = 3600 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] shutdown_timeout               = 0 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] source_is_ipv6                 = False {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] ssl_only                       = False {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] state_path                     = /opt/stack/data/nova {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] sync_power_state_interval      = 600 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] sync_power_state_pool_size     = 1000 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] syslog_log_facility            = LOG_USER {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] tempdir                        = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] timeout_nbd                    = 10 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] transport_url                  = **** {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] update_resources_interval      = 0 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] use_cow_images                 = True {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] use_eventlog                   = False {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] use_journal                    = False {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] use_json                       = False {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] use_rootwrap_daemon            = False {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] use_stderr                     = False {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] use_syslog                     = False {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] vcpu_pin_set                   = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] vif_plugging_is_fatal          = False {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] vif_plugging_timeout           = 0 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] virt_mkfs                      = [] {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] volume_usage_poll_interval     = 0 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] watch_log_file                 = False {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] web                            = /usr/share/spice-html5 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] oslo_concurrency.disable_process_locking = False {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] api.auth_strategy              = keystone {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] api.compute_link_prefix        = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] api.dhcp_domain                = novalocal {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] api.enable_instance_password   = True {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] api.glance_link_prefix         = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] api.instance_list_cells_batch_strategy = distributed {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] api.instance_list_per_project_cells = False {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] api.list_records_by_skipping_down_cells = True {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] api.local_metadata_per_cell    = False {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] api.max_limit                  = 1000 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] api.metadata_cache_expiration  = 15 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] api.neutron_default_tenant_id  = default {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] api.use_forwarded_for          = False {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] api.use_neutron_default_nets   = False {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] api.vendordata_dynamic_failure_fatal = False {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] api.vendordata_dynamic_targets = [] {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] api.vendordata_jsonfile_path   = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] cache.backend                  = dogpile.cache.memcached {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] cache.backend_argument         = **** {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] cache.config_prefix            = cache.oslo {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] cache.dead_timeout             = 60.0 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] cache.debug_cache_backend      = False {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] cache.enable_retry_client      = False {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] cache.enable_socket_keepalive  = False {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] cache.enabled                  = True {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] cache.expiration_time          = 600 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] cache.hashclient_retry_attempts = 2 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] cache.hashclient_retry_delay   = 1.0 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] cache.memcache_dead_retry      = 300 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] cache.memcache_password        =  {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] cache.memcache_pool_maxsize    = 10 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] cache.memcache_pool_unused_timeout = 60 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] cache.memcache_sasl_enabled    = False {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] cache.memcache_socket_timeout  = 1.0 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] cache.memcache_username        =  {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] cache.proxies                  = [] {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] cache.retry_attempts           = 2 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] cache.retry_delay              = 0.0 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] cache.socket_keepalive_count   = 1 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] cache.socket_keepalive_idle    = 1 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] cache.socket_keepalive_interval = 1 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] cache.tls_allowed_ciphers      = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] cache.tls_cafile               = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] cache.tls_certfile             = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] cache.tls_enabled              = False {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] cache.tls_keyfile              = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] cinder.auth_section            = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] cinder.auth_type               = password {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] cinder.cafile                  = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] cinder.catalog_info            = volumev3::publicURL {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] cinder.certfile                = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] cinder.collect_timing          = False {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] cinder.cross_az_attach         = True {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] cinder.debug                   = False {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] cinder.endpoint_template       = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] cinder.http_retries            = 3 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] cinder.insecure                = False {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] cinder.keyfile                 = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] cinder.os_region_name          = RegionOne {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] cinder.split_loggers           = False {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] cinder.timeout                 = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] compute.cpu_dedicated_set      = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] compute.cpu_shared_set         = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] compute.image_type_exclude_list = [] {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] compute.live_migration_wait_for_vif_plug = True {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] compute.max_concurrent_disk_ops = 0 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] compute.max_disk_devices_to_attach = -1 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] compute.resource_provider_association_refresh = 300 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] compute.shutdown_retry_interval = 10 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] conductor.workers              = 3 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] console.allowed_origins        = [] {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] console.ssl_ciphers            = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] console.ssl_minimum_version    = default {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] consoleauth.token_ttl          = 600 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] cyborg.cafile                  = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] cyborg.certfile                = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] cyborg.collect_timing          = False {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] cyborg.connect_retries         = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] cyborg.connect_retry_delay     = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] cyborg.endpoint_override       = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] cyborg.insecure                = False {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] cyborg.keyfile                 = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] cyborg.max_version             = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] cyborg.min_version             = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] cyborg.region_name             = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] cyborg.service_name            = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] cyborg.service_type            = accelerator {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] cyborg.split_loggers           = False {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] cyborg.status_code_retries     = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] cyborg.status_code_retry_delay = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] cyborg.timeout                 = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] cyborg.version                 = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] database.backend               = sqlalchemy {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] database.connection            = **** {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] database.connection_debug      = 0 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] database.connection_parameters =  {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] database.connection_recycle_time = 3600 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] database.connection_trace      = False {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] database.db_inc_retry_interval = True {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] database.db_max_retries        = 20 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] database.db_max_retry_interval = 10 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] database.db_retry_interval     = 1 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] database.max_overflow          = 50 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] database.max_pool_size         = 5 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] database.max_retries           = 10 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] database.mysql_wsrep_sync_wait = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] database.pool_timeout          = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] database.retry_interval        = 10 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] database.slave_connection      = **** {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] database.sqlite_synchronous    = True {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] api_database.backend           = sqlalchemy {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] api_database.connection        = **** {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] api_database.connection_debug  = 0 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] api_database.connection_parameters =  {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] api_database.connection_recycle_time = 3600 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] api_database.connection_trace  = False {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] api_database.db_inc_retry_interval = True {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] api_database.db_max_retries    = 20 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] api_database.db_max_retry_interval = 10 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] api_database.db_retry_interval = 1 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] api_database.max_overflow      = 50 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] api_database.max_pool_size     = 5 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] api_database.max_retries       = 10 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] api_database.mysql_wsrep_sync_wait = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] api_database.pool_timeout      = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] api_database.retry_interval    = 10 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] api_database.slave_connection  = **** {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] api_database.sqlite_synchronous = True {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] devices.enabled_mdev_types     = [] {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] ephemeral_storage_encryption.enabled = False {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] ephemeral_storage_encryption.key_size = 512 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] glance.api_servers             = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] glance.cafile                  = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] glance.certfile                = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] glance.collect_timing          = False {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] glance.connect_retries         = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] glance.connect_retry_delay     = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] glance.debug                   = False {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] glance.default_trusted_certificate_ids = [] {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] glance.enable_certificate_validation = False {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] glance.enable_rbd_download     = False {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] glance.endpoint_override       = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] glance.insecure                = False {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] glance.keyfile                 = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] glance.max_version             = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] glance.min_version             = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] glance.num_retries             = 3 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] glance.rbd_ceph_conf           =  {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] glance.rbd_connect_timeout     = 5 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] glance.rbd_pool                =  {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] glance.rbd_user                =  {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] glance.region_name             = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] glance.service_name            = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] glance.service_type            = image {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] glance.split_loggers           = False {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] glance.status_code_retries     = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] glance.status_code_retry_delay = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] glance.timeout                 = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] glance.verify_glance_signatures = False {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] glance.version                 = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] guestfs.debug                  = False {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] hyperv.config_drive_cdrom      = False {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] hyperv.config_drive_inject_password = False {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] hyperv.enable_instance_metrics_collection = False {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] hyperv.enable_remotefx         = False {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] hyperv.instances_path_share    =  {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] hyperv.iscsi_initiator_list    = [] {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] hyperv.limit_cpu_features      = False {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] hyperv.power_state_check_timeframe = 60 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] hyperv.power_state_event_polling_interval = 2 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] hyperv.use_multipath_io        = False {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] hyperv.volume_attach_retry_count = 10 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] hyperv.volume_attach_retry_interval = 5 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] hyperv.vswitch_name            = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] mks.enabled                    = False {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] image_cache.manager_interval   = 2400 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] image_cache.precache_concurrency = 1 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] image_cache.remove_unused_base_images = True {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] image_cache.subdirectory_name  = _base {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] ironic.api_max_retries         = 60 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] ironic.api_retry_interval      = 2 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] ironic.auth_section            = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] ironic.auth_type               = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] ironic.cafile                  = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] ironic.certfile                = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] ironic.collect_timing          = False {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] ironic.conductor_group         = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] ironic.connect_retries         = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] ironic.connect_retry_delay     = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] ironic.endpoint_override       = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] ironic.insecure                = False {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] ironic.keyfile                 = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] ironic.max_version             = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] ironic.min_version             = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] ironic.peer_list               = [] {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] ironic.region_name             = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] ironic.serial_console_state_timeout = 10 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] ironic.service_name            = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] ironic.service_type            = baremetal {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] ironic.split_loggers           = False {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] ironic.status_code_retries     = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] ironic.status_code_retry_delay = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] ironic.timeout                 = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] ironic.version                 = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] key_manager.fixed_key          = **** {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] barbican.barbican_api_version  = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] barbican.barbican_endpoint     = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] barbican.barbican_endpoint_type = public {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] barbican.barbican_region_name  = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] barbican.cafile                = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] barbican.certfile              = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] barbican.collect_timing        = False {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] barbican.insecure              = False {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] barbican.keyfile               = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] barbican.number_of_retries     = 60 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] barbican.retry_delay           = 1 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] barbican.send_service_user_token = False {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] barbican.split_loggers         = False {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] barbican.timeout               = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] barbican.verify_ssl            = True {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] barbican.verify_ssl_path       = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] barbican_service_user.auth_section = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] barbican_service_user.auth_type = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] barbican_service_user.cafile   = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] barbican_service_user.certfile = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] barbican_service_user.collect_timing = False {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] barbican_service_user.insecure = False {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] barbican_service_user.keyfile  = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] barbican_service_user.split_loggers = False {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] barbican_service_user.timeout  = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] vault.approle_role_id          = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] vault.approle_secret_id        = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] vault.cafile                   = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] vault.certfile                 = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] vault.collect_timing           = False {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] vault.insecure                 = False {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] vault.keyfile                  = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] vault.kv_mountpoint            = secret {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] vault.kv_path                  = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] vault.kv_version               = 2 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] vault.namespace                = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] vault.root_token_id            = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] vault.split_loggers            = False {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] vault.ssl_ca_crt_file          = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] vault.timeout                  = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] vault.use_ssl                  = False {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] keystone.auth_section          = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] keystone.auth_type             = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] keystone.cafile                = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] keystone.certfile              = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] keystone.collect_timing        = False {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] keystone.connect_retries       = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] keystone.connect_retry_delay   = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] keystone.endpoint_override     = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] keystone.insecure              = False {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] keystone.keyfile               = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] keystone.max_version           = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] keystone.min_version           = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] keystone.region_name           = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] keystone.service_name          = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] keystone.service_type          = identity {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] keystone.split_loggers         = False {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] keystone.status_code_retries   = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] keystone.status_code_retry_delay = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] keystone.timeout               = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] keystone.version               = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] libvirt.connection_uri         =  {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] libvirt.cpu_mode               = custom {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] libvirt.cpu_model_extra_flags  = [] {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: WARNING oslo_config.cfg [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] libvirt.cpu_power_governor_high = performance {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] libvirt.cpu_power_governor_low = powersave {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] libvirt.cpu_power_management   = False {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] libvirt.device_detach_attempts = 8 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] libvirt.device_detach_timeout  = 20 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] libvirt.disk_cachemodes        = [] {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] libvirt.disk_prefix            = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] libvirt.enabled_perf_events    = [] {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] libvirt.file_backed_memory     = 0 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] libvirt.gid_maps               = [] {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] libvirt.hw_disk_discard        = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] libvirt.hw_machine_type        = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] libvirt.images_rbd_ceph_conf   =  {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] libvirt.images_rbd_glance_store_name =  {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] libvirt.images_rbd_pool        = rbd {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] libvirt.images_type            = default {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] libvirt.images_volume_group    = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] libvirt.inject_key             = False {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] libvirt.inject_partition       = -2 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] libvirt.inject_password        = False {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] libvirt.iscsi_iface            = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] libvirt.iser_use_multipath     = False {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] libvirt.live_migration_bandwidth = 0 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] libvirt.live_migration_completion_timeout = 800 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] libvirt.live_migration_downtime = 500 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] libvirt.live_migration_downtime_delay = 75 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] libvirt.live_migration_downtime_steps = 10 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] libvirt.live_migration_inbound_addr = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] libvirt.live_migration_permit_auto_converge = False {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] libvirt.live_migration_permit_post_copy = False {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] libvirt.live_migration_scheme  = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] libvirt.live_migration_timeout_action = abort {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] libvirt.live_migration_tunnelled = False {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: WARNING oslo_config.cfg [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Nov 16 10:06:13 user nova-compute[85141]: live_migration_uri is deprecated for removal in favor of two other options that
Nov 16 10:06:13 user nova-compute[85141]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Nov 16 10:06:13 user nova-compute[85141]: and ``live_migration_inbound_addr`` respectively.
Nov 16 10:06:13 user nova-compute[85141]: ).  Its value may be silently ignored in the future.
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] libvirt.live_migration_with_native_tls = False {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] libvirt.max_queues             = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] libvirt.mem_stats_period_seconds = 10 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] libvirt.nfs_mount_options      = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] libvirt.num_aoe_discover_tries = 3 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] libvirt.num_iser_scan_tries    = 5 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] libvirt.num_memory_encrypted_guests = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] libvirt.num_nvme_discover_tries = 5 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] libvirt.num_pcie_ports         = 0 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] libvirt.num_volume_scan_tries  = 5 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] libvirt.pmem_namespaces        = [] {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] libvirt.quobyte_client_cfg     = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] libvirt.rbd_connect_timeout    = 5 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] libvirt.rbd_secret_uuid        = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] libvirt.rbd_user               = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] libvirt.realtime_scheduler_priority = 1 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] libvirt.remote_filesystem_transport = ssh {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] libvirt.rescue_image_id        = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] libvirt.rescue_kernel_id       = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] libvirt.rescue_ramdisk_id      = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] libvirt.rx_queue_size          = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] libvirt.smbfs_mount_options    =  {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] libvirt.snapshot_compression   = False {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] libvirt.snapshot_image_format  = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] libvirt.sparse_logical_volumes = False {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] libvirt.swtpm_enabled          = False {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] libvirt.swtpm_group            = tss {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] libvirt.swtpm_user             = tss {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] libvirt.sysinfo_serial         = unique {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] libvirt.tb_cache_size          = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] libvirt.tx_queue_size          = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] libvirt.uid_maps               = [] {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] libvirt.use_virtio_for_bridges = True {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] libvirt.virt_type              = kvm {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] libvirt.volume_clear           = zero {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] libvirt.volume_clear_size      = 0 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] libvirt.volume_use_multipath   = False {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] libvirt.vzstorage_cache_path   = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] libvirt.vzstorage_mount_group  = qemu {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] libvirt.vzstorage_mount_opts   = [] {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] libvirt.vzstorage_mount_user   = stack {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] neutron.auth_section           = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] neutron.auth_type              = password {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] neutron.cafile                 = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] neutron.certfile               = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] neutron.collect_timing         = False {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] neutron.connect_retries        = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] neutron.connect_retry_delay    = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] neutron.default_floating_pool  = public {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] neutron.endpoint_override      = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] neutron.extension_sync_interval = 600 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] neutron.http_retries           = 3 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] neutron.insecure               = False {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] neutron.keyfile                = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] neutron.max_version            = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] neutron.metadata_proxy_shared_secret = **** {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] neutron.min_version            = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] neutron.ovs_bridge             = br-int {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] neutron.physnets               = [] {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] neutron.region_name            = RegionOne {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] neutron.service_metadata_proxy = True {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] neutron.service_name           = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] neutron.service_type           = network {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] neutron.split_loggers          = False {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] neutron.status_code_retries    = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] neutron.status_code_retry_delay = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] neutron.timeout                = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] neutron.version                = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] notifications.bdms_in_notifications = False {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] notifications.default_level    = INFO {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] notifications.notification_format = unversioned {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] notifications.notify_on_state_change = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] pci.alias                      = [] {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] pci.device_spec                = [] {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] pci.report_in_placement        = False {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] placement.auth_section         = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] placement.auth_type            = password {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] placement.cafile               = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] placement.certfile             = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] placement.collect_timing       = False {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] placement.connect_retries      = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] placement.connect_retry_delay  = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] placement.default_domain_id    = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] placement.default_domain_name  = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] placement.domain_id            = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] placement.domain_name          = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] placement.endpoint_override    = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] placement.insecure             = False {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] placement.keyfile              = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] placement.max_version          = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] placement.min_version          = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] placement.password             = **** {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] placement.project_domain_id    = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] placement.project_domain_name  = Default {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] placement.project_id           = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] placement.project_name         = service {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] placement.region_name          = RegionOne {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] placement.service_name         = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] placement.service_type         = placement {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] placement.split_loggers        = False {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] placement.status_code_retries  = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] placement.status_code_retry_delay = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] placement.system_scope         = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] placement.timeout              = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] placement.trust_id             = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] placement.user_domain_id       = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] placement.user_domain_name     = Default {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] placement.user_id              = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] placement.username             = placement {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] placement.version              = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] quota.cores                    = 20 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] quota.count_usage_from_placement = False {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] quota.injected_file_content_bytes = 10240 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] quota.injected_file_path_length = 255 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] quota.injected_files           = 5 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] quota.instances                = 10 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] quota.key_pairs                = 100 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] quota.metadata_items           = 128 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] quota.ram                      = 51200 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] quota.recheck_quota            = True {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] quota.server_group_members     = 10 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] quota.server_groups            = 10 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] rdp.enabled                    = False {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] scheduler.image_metadata_prefilter = False {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] scheduler.max_attempts         = 3 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] scheduler.max_placement_results = 1000 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] scheduler.query_placement_for_image_type_support = False {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] scheduler.workers              = 3 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] filter_scheduler.host_subset_size = 1 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] filter_scheduler.image_properties_default_architecture = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] filter_scheduler.isolated_hosts = [] {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] filter_scheduler.isolated_images = [] {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] filter_scheduler.max_instances_per_host = 50 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] filter_scheduler.num_instances_weight_multiplier = 0.0 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] filter_scheduler.pci_in_placement = False {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] filter_scheduler.track_instance_changes = False {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] metrics.required               = True {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] metrics.weight_multiplier      = 1.0 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] metrics.weight_setting         = [] {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] serial_console.enabled         = False {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] serial_console.port_range      = 10000:20000 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] serial_console.serialproxy_port = 6083 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] service_user.auth_section      = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] service_user.auth_type         = password {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] service_user.cafile            = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] service_user.certfile          = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] service_user.collect_timing    = False {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] service_user.insecure          = False {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] service_user.keyfile           = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] service_user.send_service_user_token = True {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] service_user.split_loggers     = False {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] service_user.timeout           = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] spice.agent_enabled            = True {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] spice.enabled                  = False {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] spice.html5proxy_port          = 6082 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] spice.image_compression        = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] spice.jpeg_compression         = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] spice.playback_compression     = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] spice.server_listen            = 127.0.0.1 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] spice.streaming_mode           = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] spice.zlib_compression         = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] upgrade_levels.baseapi         = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] upgrade_levels.cert            = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] upgrade_levels.compute         = auto {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] upgrade_levels.conductor       = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] upgrade_levels.scheduler       = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] vendordata_dynamic_auth.auth_section = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] vendordata_dynamic_auth.auth_type = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] vendordata_dynamic_auth.cafile = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] vendordata_dynamic_auth.certfile = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] vendordata_dynamic_auth.collect_timing = False {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] vendordata_dynamic_auth.insecure = False {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] vendordata_dynamic_auth.keyfile = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] vendordata_dynamic_auth.split_loggers = False {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] vendordata_dynamic_auth.timeout = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] vmware.api_retry_count         = 10 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] vmware.ca_file                 = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] vmware.cache_prefix            = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] vmware.cluster_name            = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] vmware.connection_pool_size    = 10 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] vmware.console_delay_seconds   = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] vmware.datastore_regex         = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] vmware.host_ip                 = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] vmware.host_password           = **** {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] vmware.host_port               = 443 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] vmware.host_username           = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] vmware.insecure                = False {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] vmware.integration_bridge      = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] vmware.maximum_objects         = 100 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] vmware.pbm_default_policy      = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] vmware.pbm_enabled             = False {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] vmware.pbm_wsdl_location       = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] vmware.serial_port_proxy_uri   = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] vmware.serial_port_service_uri = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] vmware.task_poll_interval      = 0.5 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] vmware.use_linked_clone        = True {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] vmware.vnc_keymap              = en-us {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] vmware.vnc_port                = 5900 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] vmware.vnc_port_total          = 10000 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] vnc.auth_schemes               = ['none'] {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] vnc.enabled                    = True {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] vnc.novncproxy_port            = 6080 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] vnc.server_listen              = 0.0.0.0 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] vnc.vencrypt_ca_certs          = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] vnc.vencrypt_client_cert       = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] vnc.vencrypt_client_key        = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] workarounds.disable_fallback_pcpu_query = False {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] workarounds.disable_group_policy_check_upcall = True {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] workarounds.disable_rootwrap   = False {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] workarounds.enable_numa_live_migration = False {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] workarounds.handle_virt_lifecycle_events = True {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] workarounds.libvirt_disable_apic = False {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] workarounds.never_download_image_if_on_rbd = False {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] wsgi.client_socket_timeout     = 900 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] wsgi.default_pool_size         = 1000 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] wsgi.keep_alive                = True {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] wsgi.max_header_line           = 16384 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] wsgi.secure_proxy_ssl_header   = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] wsgi.ssl_ca_file               = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] wsgi.ssl_cert_file             = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] wsgi.ssl_key_file              = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] wsgi.tcp_keepidle              = 600 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] zvm.ca_file                    = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] zvm.cloud_connector_url        = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] zvm.reachable_timeout          = 300 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] oslo_policy.enforce_new_defaults = True {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] oslo_policy.enforce_scope      = True {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] oslo_policy.policy_default_rule = default {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] oslo_policy.policy_file        = policy.yaml {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] profiler.connection_string     = messaging:// {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] profiler.enabled               = False {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] profiler.es_doc_type           = notification {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] profiler.es_scroll_size        = 10000 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] profiler.es_scroll_time        = 2m {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] profiler.filter_error_trace    = False {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] profiler.hmac_keys             = **** {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] profiler.sentinel_service_name = mymaster {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] profiler.socket_timeout        = 0.1 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] profiler.trace_requests        = False {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] profiler.trace_sqlalchemy      = False {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] profiler_jaeger.process_tags   = {} {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] profiler_jaeger.service_name_prefix = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] profiler_otlp.service_name_prefix = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] remote_debug.host              = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] remote_debug.port              = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] oslo_messaging_rabbit.ssl      = False {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] oslo_messaging_rabbit.ssl_version =  {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] oslo_messaging_notifications.retry = -1 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] oslo_messaging_notifications.transport_url = **** {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] oslo_limit.auth_section        = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] oslo_limit.auth_type           = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] oslo_limit.cafile              = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] oslo_limit.certfile            = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] oslo_limit.collect_timing      = False {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] oslo_limit.connect_retries     = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] oslo_limit.connect_retry_delay = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] oslo_limit.endpoint_id         = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] oslo_limit.endpoint_override   = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] oslo_limit.insecure            = False {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] oslo_limit.keyfile             = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] oslo_limit.max_version         = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] oslo_limit.min_version         = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] oslo_limit.region_name         = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] oslo_limit.service_name        = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] oslo_limit.service_type        = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] oslo_limit.split_loggers       = False {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] oslo_limit.status_code_retries = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] oslo_limit.status_code_retry_delay = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] oslo_limit.timeout             = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] oslo_limit.valid_interfaces    = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] oslo_limit.version             = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] oslo_reports.file_event_handler = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] oslo_reports.file_event_handler_interval = 1 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] oslo_reports.log_dir           = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] vif_plug_linux_bridge_privileged.group = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] vif_plug_linux_bridge_privileged.user = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] vif_plug_ovs_privileged.group  = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] vif_plug_ovs_privileged.helper_command = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] vif_plug_ovs_privileged.user   = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] os_vif_linux_bridge.flat_interface = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] os_vif_linux_bridge.vlan_interface = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] os_vif_ovs.default_qos_type    = linux-noop {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] os_vif_ovs.isolate_vif         = False {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] os_vif_ovs.ovsdb_interface     = native {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] os_vif_ovs.per_port_bridge     = False {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] os_brick.lock_path             = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] privsep_osbrick.capabilities   = [21] {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] privsep_osbrick.group          = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] privsep_osbrick.helper_command = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] privsep_osbrick.thread_pool_size = 12 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] privsep_osbrick.user           = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] nova_sys_admin.group           = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] nova_sys_admin.helper_command  = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] nova_sys_admin.thread_pool_size = 12 {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] nova_sys_admin.user            = None {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG oslo_service.service [None req-8acac3c4-e41c-4404-b115-af2296aae2fa None None] ******************************************************************************** {{(pid=85141) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}}
Nov 16 10:06:13 user nova-compute[85141]: INFO nova.service [-] Starting compute node (version 0.0.0)
Nov 16 10:06:13 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-68e4d1b8-93eb-4f00-a57e-842b9d05649d None None] Connecting to libvirt: qemu:///system {{(pid=85141) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:506}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-68e4d1b8-93eb-4f00-a57e-842b9d05649d None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7f51a0b2a4a0> {{(pid=85141) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:512}}
Nov 16 10:06:13 user nova-compute[85141]: libvirt:  error : internal error: could not initialize domain event timer
Nov 16 10:06:13 user nova-compute[85141]: WARNING nova.virt.libvirt.host [None req-68e4d1b8-93eb-4f00-a57e-842b9d05649d None None] URI qemu:///system does not support events: internal error: could not initialize domain event timer: libvirt.libvirtError: internal error: could not initialize domain event timer
Nov 16 10:06:13 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-68e4d1b8-93eb-4f00-a57e-842b9d05649d None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7f51a0b2a4a0> {{(pid=85141) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:533}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-68e4d1b8-93eb-4f00-a57e-842b9d05649d None None] Starting native event thread {{(pid=85141) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-68e4d1b8-93eb-4f00-a57e-842b9d05649d None None] Starting green dispatch thread {{(pid=85141) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Nov 16 10:06:13 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-68e4d1b8-93eb-4f00-a57e-842b9d05649d None None] Starting connection event dispatch thread {{(pid=85141) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:501}}
Nov 16 10:06:13 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-68e4d1b8-93eb-4f00-a57e-842b9d05649d None None] Connection event '1' reason 'None'
Nov 16 10:06:13 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-68e4d1b8-93eb-4f00-a57e-842b9d05649d None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 16 10:06:13 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.mount [None req-68e4d1b8-93eb-4f00-a57e-842b9d05649d None None] Initialising _HostMountState generation 0 {{(pid=85141) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Nov 16 10:06:21 user nova-compute[85141]: INFO nova.virt.libvirt.host [None req-68e4d1b8-93eb-4f00-a57e-842b9d05649d None None] Libvirt host capabilities <capabilities>
Nov 16 10:06:21 user nova-compute[85141]:   <host>
Nov 16 10:06:21 user nova-compute[85141]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Nov 16 10:06:21 user nova-compute[85141]:     <cpu>
Nov 16 10:06:21 user nova-compute[85141]:       <arch>x86_64</arch>
Nov 16 10:06:21 user nova-compute[85141]:       <model>IvyBridge-IBRS</model>
Nov 16 10:06:21 user nova-compute[85141]:       <vendor>Intel</vendor>
Nov 16 10:06:21 user nova-compute[85141]:       <microcode version='1070'/>
Nov 16 10:06:21 user nova-compute[85141]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Nov 16 10:06:21 user nova-compute[85141]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Nov 16 10:06:21 user nova-compute[85141]:       <feature name='ss'/>
Nov 16 10:06:21 user nova-compute[85141]:       <feature name='vmx'/>
Nov 16 10:06:21 user nova-compute[85141]:       <feature name='pcid'/>
Nov 16 10:06:21 user nova-compute[85141]:       <feature name='osxsave'/>
Nov 16 10:06:21 user nova-compute[85141]:       <feature name='hypervisor'/>
Nov 16 10:06:21 user nova-compute[85141]:       <feature name='arat'/>
Nov 16 10:06:21 user nova-compute[85141]:       <feature name='tsc_adjust'/>
Nov 16 10:06:21 user nova-compute[85141]:       <feature name='md-clear'/>
Nov 16 10:06:21 user nova-compute[85141]:       <feature name='stibp'/>
Nov 16 10:06:21 user nova-compute[85141]:       <feature name='arch-capabilities'/>
Nov 16 10:06:21 user nova-compute[85141]:       <feature name='ssbd'/>
Nov 16 10:06:21 user nova-compute[85141]:       <feature name='invtsc'/>
Nov 16 10:06:21 user nova-compute[85141]:       <feature name='rsba'/>
Nov 16 10:06:21 user nova-compute[85141]:       <feature name='skip-l1dfl-vmentry'/>
Nov 16 10:06:21 user nova-compute[85141]:       <pages unit='KiB' size='4'/>
Nov 16 10:06:21 user nova-compute[85141]:       <pages unit='KiB' size='2048'/>
Nov 16 10:06:21 user nova-compute[85141]:     </cpu>
Nov 16 10:06:21 user nova-compute[85141]:     <power_management>
Nov 16 10:06:21 user nova-compute[85141]:       <suspend_mem/>
Nov 16 10:06:21 user nova-compute[85141]:       <suspend_disk/>
Nov 16 10:06:21 user nova-compute[85141]:       <suspend_hybrid/>
Nov 16 10:06:21 user nova-compute[85141]:     </power_management>
Nov 16 10:06:21 user nova-compute[85141]:     <iommu support='no'/>
Nov 16 10:06:21 user nova-compute[85141]:     <migration_features>
Nov 16 10:06:21 user nova-compute[85141]:       <live/>
Nov 16 10:06:21 user nova-compute[85141]:       <uri_transports>
Nov 16 10:06:21 user nova-compute[85141]:         <uri_transport>tcp</uri_transport>
Nov 16 10:06:21 user nova-compute[85141]:         <uri_transport>rdma</uri_transport>
Nov 16 10:06:21 user nova-compute[85141]:       </uri_transports>
Nov 16 10:06:21 user nova-compute[85141]:     </migration_features>
Nov 16 10:06:21 user nova-compute[85141]:     <topology>
Nov 16 10:06:21 user nova-compute[85141]:       <cells num='2'>
Nov 16 10:06:21 user nova-compute[85141]:         <cell id='0'>
Nov 16 10:06:21 user nova-compute[85141]:           <memory unit='KiB'>8140616</memory>
Nov 16 10:06:21 user nova-compute[85141]:           <pages unit='KiB' size='4'>2035154</pages>
Nov 16 10:06:21 user nova-compute[85141]:           <pages unit='KiB' size='2048'>0</pages>
Nov 16 10:06:21 user nova-compute[85141]:           <distances>
Nov 16 10:06:21 user nova-compute[85141]:             <sibling id='0' value='10'/>
Nov 16 10:06:21 user nova-compute[85141]:             <sibling id='1' value='20'/>
Nov 16 10:06:21 user nova-compute[85141]:           </distances>
Nov 16 10:06:21 user nova-compute[85141]:           <cpus num='6'>
Nov 16 10:06:21 user nova-compute[85141]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Nov 16 10:06:21 user nova-compute[85141]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Nov 16 10:06:21 user nova-compute[85141]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Nov 16 10:06:21 user nova-compute[85141]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Nov 16 10:06:21 user nova-compute[85141]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Nov 16 10:06:21 user nova-compute[85141]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Nov 16 10:06:21 user nova-compute[85141]:           </cpus>
Nov 16 10:06:21 user nova-compute[85141]:         </cell>
Nov 16 10:06:21 user nova-compute[85141]:         <cell id='1'>
Nov 16 10:06:21 user nova-compute[85141]:           <memory unit='KiB'>8255068</memory>
Nov 16 10:06:21 user nova-compute[85141]:           <pages unit='KiB' size='4'>2063767</pages>
Nov 16 10:06:21 user nova-compute[85141]:           <pages unit='KiB' size='2048'>0</pages>
Nov 16 10:06:21 user nova-compute[85141]:           <distances>
Nov 16 10:06:21 user nova-compute[85141]:             <sibling id='0' value='20'/>
Nov 16 10:06:21 user nova-compute[85141]:             <sibling id='1' value='10'/>
Nov 16 10:06:21 user nova-compute[85141]:           </distances>
Nov 16 10:06:21 user nova-compute[85141]:           <cpus num='6'>
Nov 16 10:06:21 user nova-compute[85141]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Nov 16 10:06:21 user nova-compute[85141]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Nov 16 10:06:21 user nova-compute[85141]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Nov 16 10:06:21 user nova-compute[85141]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Nov 16 10:06:21 user nova-compute[85141]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Nov 16 10:06:21 user nova-compute[85141]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Nov 16 10:06:21 user nova-compute[85141]:           </cpus>
Nov 16 10:06:21 user nova-compute[85141]:         </cell>
Nov 16 10:06:21 user nova-compute[85141]:       </cells>
Nov 16 10:06:21 user nova-compute[85141]:     </topology>
Nov 16 10:06:21 user nova-compute[85141]:     <cache>
Nov 16 10:06:21 user nova-compute[85141]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Nov 16 10:06:21 user nova-compute[85141]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Nov 16 10:06:21 user nova-compute[85141]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Nov 16 10:06:21 user nova-compute[85141]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Nov 16 10:06:21 user nova-compute[85141]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Nov 16 10:06:21 user nova-compute[85141]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Nov 16 10:06:21 user nova-compute[85141]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Nov 16 10:06:21 user nova-compute[85141]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Nov 16 10:06:21 user nova-compute[85141]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Nov 16 10:06:21 user nova-compute[85141]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Nov 16 10:06:21 user nova-compute[85141]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Nov 16 10:06:21 user nova-compute[85141]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Nov 16 10:06:21 user nova-compute[85141]:     </cache>
Nov 16 10:06:21 user nova-compute[85141]:     <secmodel>
Nov 16 10:06:21 user nova-compute[85141]:       <model>apparmor</model>
Nov 16 10:06:21 user nova-compute[85141]:       <doi>0</doi>
Nov 16 10:06:21 user nova-compute[85141]:     </secmodel>
Nov 16 10:06:21 user nova-compute[85141]:     <secmodel>
Nov 16 10:06:21 user nova-compute[85141]:       <model>dac</model>
Nov 16 10:06:21 user nova-compute[85141]:       <doi>0</doi>
Nov 16 10:06:21 user nova-compute[85141]:       <baselabel type='kvm'>+64055:+108</baselabel>
Nov 16 10:06:21 user nova-compute[85141]:       <baselabel type='qemu'>+64055:+108</baselabel>
Nov 16 10:06:21 user nova-compute[85141]:     </secmodel>
Nov 16 10:06:21 user nova-compute[85141]:   </host>
Nov 16 10:06:21 user nova-compute[85141]:   <guest>
Nov 16 10:06:21 user nova-compute[85141]:     <os_type>hvm</os_type>
Nov 16 10:06:21 user nova-compute[85141]:     <arch name='alpha'>
Nov 16 10:06:21 user nova-compute[85141]:       <wordsize>64</wordsize>
Nov 16 10:06:21 user nova-compute[85141]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='4'>clipper</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <domain type='qemu'/>
Nov 16 10:06:21 user nova-compute[85141]:     </arch>
Nov 16 10:06:21 user nova-compute[85141]:     <features>
Nov 16 10:06:21 user nova-compute[85141]:       <cpuselection/>
Nov 16 10:06:21 user nova-compute[85141]:       <deviceboot/>
Nov 16 10:06:21 user nova-compute[85141]:       <disksnapshot default='on' toggle='no'/>
Nov 16 10:06:21 user nova-compute[85141]:     </features>
Nov 16 10:06:21 user nova-compute[85141]:   </guest>
Nov 16 10:06:21 user nova-compute[85141]:   <guest>
Nov 16 10:06:21 user nova-compute[85141]:     <os_type>hvm</os_type>
Nov 16 10:06:21 user nova-compute[85141]:     <arch name='armv6l'>
Nov 16 10:06:21 user nova-compute[85141]:       <wordsize>32</wordsize>
Nov 16 10:06:21 user nova-compute[85141]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1'>integratorcp</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1'>borzoi</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1'>spitz</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='2'>nuri</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='2'>musca-b1</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1'>versatileab</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1'>kzm</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='2'>musca-a</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='2'>smdkc210</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1'>sx1</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1'>z2</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1'>tosa</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='4'>sabrelite</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1'>realview-eb</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1'>n810</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1'>n800</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1'>versatilepb</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1'>terrier</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1'>mainstone</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='4'>midway</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1'>musicpal</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1'>microbit</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1'>cubieboard</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1'>verdex</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1'>netduino2</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='4'>raspi2b</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1'>cheetah</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='4'>highbank</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1'>akita</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1'>connex</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1'>collie</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1'>raspi0</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <domain type='qemu'/>
Nov 16 10:06:21 user nova-compute[85141]:     </arch>
Nov 16 10:06:21 user nova-compute[85141]:     <features>
Nov 16 10:06:21 user nova-compute[85141]:       <cpuselection/>
Nov 16 10:06:21 user nova-compute[85141]:       <deviceboot/>
Nov 16 10:06:21 user nova-compute[85141]:       <disksnapshot default='on' toggle='no'/>
Nov 16 10:06:21 user nova-compute[85141]:     </features>
Nov 16 10:06:21 user nova-compute[85141]:   </guest>
Nov 16 10:06:21 user nova-compute[85141]:   <guest>
Nov 16 10:06:21 user nova-compute[85141]:     <os_type>hvm</os_type>
Nov 16 10:06:21 user nova-compute[85141]:     <arch name='armv7l'>
Nov 16 10:06:21 user nova-compute[85141]:       <wordsize>32</wordsize>
Nov 16 10:06:21 user nova-compute[85141]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1'>integratorcp</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1'>borzoi</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1'>spitz</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='2'>nuri</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='2'>musca-b1</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1'>versatileab</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1'>kzm</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='2'>musca-a</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='2'>smdkc210</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1'>sx1</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1'>z2</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1'>tosa</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='4'>sabrelite</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1'>realview-eb</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1'>n810</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1'>n800</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1'>versatilepb</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1'>terrier</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1'>mainstone</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='4'>midway</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1'>musicpal</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1'>microbit</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1'>cubieboard</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1'>verdex</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1'>netduino2</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='4'>raspi2b</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1'>cheetah</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='4'>highbank</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1'>akita</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1'>connex</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1'>collie</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1'>raspi0</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <domain type='qemu'/>
Nov 16 10:06:21 user nova-compute[85141]:     </arch>
Nov 16 10:06:21 user nova-compute[85141]:     <features>
Nov 16 10:06:21 user nova-compute[85141]:       <cpuselection/>
Nov 16 10:06:21 user nova-compute[85141]:       <deviceboot/>
Nov 16 10:06:21 user nova-compute[85141]:       <disksnapshot default='on' toggle='no'/>
Nov 16 10:06:21 user nova-compute[85141]:     </features>
Nov 16 10:06:21 user nova-compute[85141]:   </guest>
Nov 16 10:06:21 user nova-compute[85141]:   <guest>
Nov 16 10:06:21 user nova-compute[85141]:     <os_type>hvm</os_type>
Nov 16 10:06:21 user nova-compute[85141]:     <arch name='aarch64'>
Nov 16 10:06:21 user nova-compute[85141]:       <wordsize>64</wordsize>
Nov 16 10:06:21 user nova-compute[85141]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1'>integratorcp</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1'>borzoi</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1'>spitz</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='2'>nuri</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='2'>musca-b1</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1'>versatileab</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1'>kzm</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='2'>musca-a</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='2'>smdkc210</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1'>sx1</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1'>z2</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1'>tosa</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='4'>sabrelite</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1'>realview-eb</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='512'>sbsa-ref</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1'>n810</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1'>n800</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1'>versatilepb</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1'>terrier</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1'>mainstone</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='4'>midway</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1'>musicpal</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1'>microbit</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='4'>raspi3ap</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1'>cubieboard</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1'>verdex</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1'>netduino2</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='4'>raspi3b</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='4'>raspi2b</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1'>cheetah</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='4'>highbank</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1'>akita</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1'>connex</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1'>collie</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1'>raspi0</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <domain type='qemu'/>
Nov 16 10:06:21 user nova-compute[85141]:     </arch>
Nov 16 10:06:21 user nova-compute[85141]:     <features>
Nov 16 10:06:21 user nova-compute[85141]:       <acpi default='on' toggle='yes'/>
Nov 16 10:06:21 user nova-compute[85141]:       <cpuselection/>
Nov 16 10:06:21 user nova-compute[85141]:       <deviceboot/>
Nov 16 10:06:21 user nova-compute[85141]:       <disksnapshot default='on' toggle='no'/>
Nov 16 10:06:21 user nova-compute[85141]:     </features>
Nov 16 10:06:21 user nova-compute[85141]:   </guest>
Nov 16 10:06:21 user nova-compute[85141]:   <guest>
Nov 16 10:06:21 user nova-compute[85141]:     <os_type>hvm</os_type>
Nov 16 10:06:21 user nova-compute[85141]:     <arch name='cris'>
Nov 16 10:06:21 user nova-compute[85141]:       <wordsize>32</wordsize>
Nov 16 10:06:21 user nova-compute[85141]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1'>axis-dev88</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <domain type='qemu'/>
Nov 16 10:06:21 user nova-compute[85141]:     </arch>
Nov 16 10:06:21 user nova-compute[85141]:     <features>
Nov 16 10:06:21 user nova-compute[85141]:       <cpuselection/>
Nov 16 10:06:21 user nova-compute[85141]:       <deviceboot/>
Nov 16 10:06:21 user nova-compute[85141]:       <disksnapshot default='on' toggle='no'/>
Nov 16 10:06:21 user nova-compute[85141]:     </features>
Nov 16 10:06:21 user nova-compute[85141]:   </guest>
Nov 16 10:06:21 user nova-compute[85141]:   <guest>
Nov 16 10:06:21 user nova-compute[85141]:     <os_type>hvm</os_type>
Nov 16 10:06:21 user nova-compute[85141]:     <arch name='i686'>
Nov 16 10:06:21 user nova-compute[85141]:       <wordsize>32</wordsize>
Nov 16 10:06:21 user nova-compute[85141]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1'>x-remote</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1'>isapc</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='288'>microvm</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <domain type='qemu'/>
Nov 16 10:06:21 user nova-compute[85141]:       <domain type='kvm'/>
Nov 16 10:06:21 user nova-compute[85141]:     </arch>
Nov 16 10:06:21 user nova-compute[85141]:     <features>
Nov 16 10:06:21 user nova-compute[85141]:       <pae/>
Nov 16 10:06:21 user nova-compute[85141]:       <nonpae/>
Nov 16 10:06:21 user nova-compute[85141]:       <acpi default='on' toggle='yes'/>
Nov 16 10:06:21 user nova-compute[85141]:       <apic default='on' toggle='no'/>
Nov 16 10:06:21 user nova-compute[85141]:       <cpuselection/>
Nov 16 10:06:21 user nova-compute[85141]:       <deviceboot/>
Nov 16 10:06:21 user nova-compute[85141]:       <disksnapshot default='on' toggle='no'/>
Nov 16 10:06:21 user nova-compute[85141]:     </features>
Nov 16 10:06:21 user nova-compute[85141]:   </guest>
Nov 16 10:06:21 user nova-compute[85141]:   <guest>
Nov 16 10:06:21 user nova-compute[85141]:     <os_type>hvm</os_type>
Nov 16 10:06:21 user nova-compute[85141]:     <arch name='m68k'>
Nov 16 10:06:21 user nova-compute[85141]:       <wordsize>32</wordsize>
Nov 16 10:06:21 user nova-compute[85141]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1'>mcf5208evb</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1'>an5206</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1'>virt-6.0</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1'>q800</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1'>virt-6.2</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1'>next-cube</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1'>virt-6.1</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <domain type='qemu'/>
Nov 16 10:06:21 user nova-compute[85141]:     </arch>
Nov 16 10:06:21 user nova-compute[85141]:     <features>
Nov 16 10:06:21 user nova-compute[85141]:       <cpuselection/>
Nov 16 10:06:21 user nova-compute[85141]:       <deviceboot/>
Nov 16 10:06:21 user nova-compute[85141]:       <disksnapshot default='on' toggle='no'/>
Nov 16 10:06:21 user nova-compute[85141]:     </features>
Nov 16 10:06:21 user nova-compute[85141]:   </guest>
Nov 16 10:06:21 user nova-compute[85141]:   <guest>
Nov 16 10:06:21 user nova-compute[85141]:     <os_type>hvm</os_type>
Nov 16 10:06:21 user nova-compute[85141]:     <arch name='microblaze'>
Nov 16 10:06:21 user nova-compute[85141]:       <wordsize>32</wordsize>
Nov 16 10:06:21 user nova-compute[85141]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <domain type='qemu'/>
Nov 16 10:06:21 user nova-compute[85141]:     </arch>
Nov 16 10:06:21 user nova-compute[85141]:     <features>
Nov 16 10:06:21 user nova-compute[85141]:       <cpuselection/>
Nov 16 10:06:21 user nova-compute[85141]:       <deviceboot/>
Nov 16 10:06:21 user nova-compute[85141]:       <disksnapshot default='on' toggle='no'/>
Nov 16 10:06:21 user nova-compute[85141]:     </features>
Nov 16 10:06:21 user nova-compute[85141]:   </guest>
Nov 16 10:06:21 user nova-compute[85141]:   <guest>
Nov 16 10:06:21 user nova-compute[85141]:     <os_type>hvm</os_type>
Nov 16 10:06:21 user nova-compute[85141]:     <arch name='microblazeel'>
Nov 16 10:06:21 user nova-compute[85141]:       <wordsize>32</wordsize>
Nov 16 10:06:21 user nova-compute[85141]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <domain type='qemu'/>
Nov 16 10:06:21 user nova-compute[85141]:     </arch>
Nov 16 10:06:21 user nova-compute[85141]:     <features>
Nov 16 10:06:21 user nova-compute[85141]:       <cpuselection/>
Nov 16 10:06:21 user nova-compute[85141]:       <deviceboot/>
Nov 16 10:06:21 user nova-compute[85141]:       <disksnapshot default='on' toggle='no'/>
Nov 16 10:06:21 user nova-compute[85141]:     </features>
Nov 16 10:06:21 user nova-compute[85141]:   </guest>
Nov 16 10:06:21 user nova-compute[85141]:   <guest>
Nov 16 10:06:21 user nova-compute[85141]:     <os_type>hvm</os_type>
Nov 16 10:06:21 user nova-compute[85141]:     <arch name='mips'>
Nov 16 10:06:21 user nova-compute[85141]:       <wordsize>32</wordsize>
Nov 16 10:06:21 user nova-compute[85141]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='16'>malta</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1'>mipssim</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <domain type='qemu'/>
Nov 16 10:06:21 user nova-compute[85141]:     </arch>
Nov 16 10:06:21 user nova-compute[85141]:     <features>
Nov 16 10:06:21 user nova-compute[85141]:       <cpuselection/>
Nov 16 10:06:21 user nova-compute[85141]:       <deviceboot/>
Nov 16 10:06:21 user nova-compute[85141]:       <disksnapshot default='on' toggle='no'/>
Nov 16 10:06:21 user nova-compute[85141]:     </features>
Nov 16 10:06:21 user nova-compute[85141]:   </guest>
Nov 16 10:06:21 user nova-compute[85141]:   <guest>
Nov 16 10:06:21 user nova-compute[85141]:     <os_type>hvm</os_type>
Nov 16 10:06:21 user nova-compute[85141]:     <arch name='mipsel'>
Nov 16 10:06:21 user nova-compute[85141]:       <wordsize>32</wordsize>
Nov 16 10:06:21 user nova-compute[85141]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='16'>malta</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1'>mipssim</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <domain type='qemu'/>
Nov 16 10:06:21 user nova-compute[85141]:     </arch>
Nov 16 10:06:21 user nova-compute[85141]:     <features>
Nov 16 10:06:21 user nova-compute[85141]:       <cpuselection/>
Nov 16 10:06:21 user nova-compute[85141]:       <deviceboot/>
Nov 16 10:06:21 user nova-compute[85141]:       <disksnapshot default='on' toggle='no'/>
Nov 16 10:06:21 user nova-compute[85141]:     </features>
Nov 16 10:06:21 user nova-compute[85141]:   </guest>
Nov 16 10:06:21 user nova-compute[85141]:   <guest>
Nov 16 10:06:21 user nova-compute[85141]:     <os_type>hvm</os_type>
Nov 16 10:06:21 user nova-compute[85141]:     <arch name='mips64'>
Nov 16 10:06:21 user nova-compute[85141]:       <wordsize>64</wordsize>
Nov 16 10:06:21 user nova-compute[85141]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='16'>malta</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1'>mipssim</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1'>pica61</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1'>magnum</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <domain type='qemu'/>
Nov 16 10:06:21 user nova-compute[85141]:     </arch>
Nov 16 10:06:21 user nova-compute[85141]:     <features>
Nov 16 10:06:21 user nova-compute[85141]:       <cpuselection/>
Nov 16 10:06:21 user nova-compute[85141]:       <deviceboot/>
Nov 16 10:06:21 user nova-compute[85141]:       <disksnapshot default='on' toggle='no'/>
Nov 16 10:06:21 user nova-compute[85141]:     </features>
Nov 16 10:06:21 user nova-compute[85141]:   </guest>
Nov 16 10:06:21 user nova-compute[85141]:   <guest>
Nov 16 10:06:21 user nova-compute[85141]:     <os_type>hvm</os_type>
Nov 16 10:06:21 user nova-compute[85141]:     <arch name='mips64el'>
Nov 16 10:06:21 user nova-compute[85141]:       <wordsize>64</wordsize>
Nov 16 10:06:21 user nova-compute[85141]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='16'>malta</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='16'>loongson3-virt</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1'>mipssim</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1'>pica61</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1'>magnum</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='16'>boston</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1'>fuloong2e</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <domain type='qemu'/>
Nov 16 10:06:21 user nova-compute[85141]:     </arch>
Nov 16 10:06:21 user nova-compute[85141]:     <features>
Nov 16 10:06:21 user nova-compute[85141]:       <cpuselection/>
Nov 16 10:06:21 user nova-compute[85141]:       <deviceboot/>
Nov 16 10:06:21 user nova-compute[85141]:       <disksnapshot default='on' toggle='no'/>
Nov 16 10:06:21 user nova-compute[85141]:     </features>
Nov 16 10:06:21 user nova-compute[85141]:   </guest>
Nov 16 10:06:21 user nova-compute[85141]:   <guest>
Nov 16 10:06:21 user nova-compute[85141]:     <os_type>hvm</os_type>
Nov 16 10:06:21 user nova-compute[85141]:     <arch name='ppc'>
Nov 16 10:06:21 user nova-compute[85141]:       <wordsize>32</wordsize>
Nov 16 10:06:21 user nova-compute[85141]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1'>g3beige</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1'>mac99</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='32'>ppce500</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1'>pegasos2</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1'>sam460ex</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1'>bamboo</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1'>40p</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1'>ref405ep</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1'>taihu</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <domain type='qemu'/>
Nov 16 10:06:21 user nova-compute[85141]:     </arch>
Nov 16 10:06:21 user nova-compute[85141]:     <features>
Nov 16 10:06:21 user nova-compute[85141]:       <cpuselection/>
Nov 16 10:06:21 user nova-compute[85141]:       <deviceboot/>
Nov 16 10:06:21 user nova-compute[85141]:       <disksnapshot default='on' toggle='no'/>
Nov 16 10:06:21 user nova-compute[85141]:     </features>
Nov 16 10:06:21 user nova-compute[85141]:   </guest>
Nov 16 10:06:21 user nova-compute[85141]:   <guest>
Nov 16 10:06:21 user nova-compute[85141]:     <os_type>hvm</os_type>
Nov 16 10:06:21 user nova-compute[85141]:     <arch name='ppc64'>
Nov 16 10:06:21 user nova-compute[85141]:       <wordsize>64</wordsize>
Nov 16 10:06:21 user nova-compute[85141]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='2048'>powernv9</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1'>taihu</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='2048'>powernv10</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='32'>ppce500</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1'>40p</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1'>pegasos2</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1'>bamboo</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1'>g3beige</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1'>mac99</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1'>sam460ex</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1'>ref405ep</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='2048'>powernv8</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <domain type='qemu'/>
Nov 16 10:06:21 user nova-compute[85141]:     </arch>
Nov 16 10:06:21 user nova-compute[85141]:     <features>
Nov 16 10:06:21 user nova-compute[85141]:       <cpuselection/>
Nov 16 10:06:21 user nova-compute[85141]:       <deviceboot/>
Nov 16 10:06:21 user nova-compute[85141]:       <disksnapshot default='on' toggle='no'/>
Nov 16 10:06:21 user nova-compute[85141]:     </features>
Nov 16 10:06:21 user nova-compute[85141]:   </guest>
Nov 16 10:06:21 user nova-compute[85141]:   <guest>
Nov 16 10:06:21 user nova-compute[85141]:     <os_type>hvm</os_type>
Nov 16 10:06:21 user nova-compute[85141]:     <arch name='ppc64le'>
Nov 16 10:06:21 user nova-compute[85141]:       <wordsize>64</wordsize>
Nov 16 10:06:21 user nova-compute[85141]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='2048'>powernv9</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1'>taihu</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='2048'>powernv10</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='32'>ppce500</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1'>40p</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1'>pegasos2</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1'>bamboo</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1'>g3beige</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1'>mac99</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1'>sam460ex</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1'>ref405ep</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='2048'>powernv8</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <domain type='qemu'/>
Nov 16 10:06:21 user nova-compute[85141]:     </arch>
Nov 16 10:06:21 user nova-compute[85141]:     <features>
Nov 16 10:06:21 user nova-compute[85141]:       <cpuselection/>
Nov 16 10:06:21 user nova-compute[85141]:       <deviceboot/>
Nov 16 10:06:21 user nova-compute[85141]:       <disksnapshot default='on' toggle='no'/>
Nov 16 10:06:21 user nova-compute[85141]:     </features>
Nov 16 10:06:21 user nova-compute[85141]:   </guest>
Nov 16 10:06:21 user nova-compute[85141]:   <guest>
Nov 16 10:06:21 user nova-compute[85141]:     <os_type>hvm</os_type>
Nov 16 10:06:21 user nova-compute[85141]:     <arch name='riscv32'>
Nov 16 10:06:21 user nova-compute[85141]:       <wordsize>32</wordsize>
Nov 16 10:06:21 user nova-compute[85141]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='8'>spike</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1'>opentitan</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='5'>sifive_u</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1'>sifive_e</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='8'>virt</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <domain type='qemu'/>
Nov 16 10:06:21 user nova-compute[85141]:     </arch>
Nov 16 10:06:21 user nova-compute[85141]:     <features>
Nov 16 10:06:21 user nova-compute[85141]:       <cpuselection/>
Nov 16 10:06:21 user nova-compute[85141]:       <deviceboot/>
Nov 16 10:06:21 user nova-compute[85141]:       <disksnapshot default='on' toggle='no'/>
Nov 16 10:06:21 user nova-compute[85141]:     </features>
Nov 16 10:06:21 user nova-compute[85141]:   </guest>
Nov 16 10:06:21 user nova-compute[85141]:   <guest>
Nov 16 10:06:21 user nova-compute[85141]:     <os_type>hvm</os_type>
Nov 16 10:06:21 user nova-compute[85141]:     <arch name='riscv64'>
Nov 16 10:06:21 user nova-compute[85141]:       <wordsize>64</wordsize>
Nov 16 10:06:21 user nova-compute[85141]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='8'>spike</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='5'>sifive_u</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1'>shakti_c</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1'>sifive_e</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='8'>virt</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <domain type='qemu'/>
Nov 16 10:06:21 user nova-compute[85141]:     </arch>
Nov 16 10:06:21 user nova-compute[85141]:     <features>
Nov 16 10:06:21 user nova-compute[85141]:       <cpuselection/>
Nov 16 10:06:21 user nova-compute[85141]:       <deviceboot/>
Nov 16 10:06:21 user nova-compute[85141]:       <disksnapshot default='on' toggle='no'/>
Nov 16 10:06:21 user nova-compute[85141]:     </features>
Nov 16 10:06:21 user nova-compute[85141]:   </guest>
Nov 16 10:06:21 user nova-compute[85141]:   <guest>
Nov 16 10:06:21 user nova-compute[85141]:     <os_type>hvm</os_type>
Nov 16 10:06:21 user nova-compute[85141]:     <arch name='s390x'>
Nov 16 10:06:21 user nova-compute[85141]:       <wordsize>64</wordsize>
Nov 16 10:06:21 user nova-compute[85141]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <domain type='qemu'/>
Nov 16 10:06:21 user nova-compute[85141]:     </arch>
Nov 16 10:06:21 user nova-compute[85141]:     <features>
Nov 16 10:06:21 user nova-compute[85141]:       <cpuselection/>
Nov 16 10:06:21 user nova-compute[85141]:       <deviceboot/>
Nov 16 10:06:21 user nova-compute[85141]:       <disksnapshot default='on' toggle='no'/>
Nov 16 10:06:21 user nova-compute[85141]:     </features>
Nov 16 10:06:21 user nova-compute[85141]:   </guest>
Nov 16 10:06:21 user nova-compute[85141]:   <guest>
Nov 16 10:06:21 user nova-compute[85141]:     <os_type>hvm</os_type>
Nov 16 10:06:21 user nova-compute[85141]:     <arch name='sh4'>
Nov 16 10:06:21 user nova-compute[85141]:       <wordsize>32</wordsize>
Nov 16 10:06:21 user nova-compute[85141]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1'>shix</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1'>r2d</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <domain type='qemu'/>
Nov 16 10:06:21 user nova-compute[85141]:     </arch>
Nov 16 10:06:21 user nova-compute[85141]:     <features>
Nov 16 10:06:21 user nova-compute[85141]:       <cpuselection/>
Nov 16 10:06:21 user nova-compute[85141]:       <deviceboot/>
Nov 16 10:06:21 user nova-compute[85141]:       <disksnapshot default='on' toggle='no'/>
Nov 16 10:06:21 user nova-compute[85141]:     </features>
Nov 16 10:06:21 user nova-compute[85141]:   </guest>
Nov 16 10:06:21 user nova-compute[85141]:   <guest>
Nov 16 10:06:21 user nova-compute[85141]:     <os_type>hvm</os_type>
Nov 16 10:06:21 user nova-compute[85141]:     <arch name='sh4eb'>
Nov 16 10:06:21 user nova-compute[85141]:       <wordsize>64</wordsize>
Nov 16 10:06:21 user nova-compute[85141]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1'>shix</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1'>r2d</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <domain type='qemu'/>
Nov 16 10:06:21 user nova-compute[85141]:     </arch>
Nov 16 10:06:21 user nova-compute[85141]:     <features>
Nov 16 10:06:21 user nova-compute[85141]:       <cpuselection/>
Nov 16 10:06:21 user nova-compute[85141]:       <deviceboot/>
Nov 16 10:06:21 user nova-compute[85141]:       <disksnapshot default='on' toggle='no'/>
Nov 16 10:06:21 user nova-compute[85141]:     </features>
Nov 16 10:06:21 user nova-compute[85141]:   </guest>
Nov 16 10:06:21 user nova-compute[85141]:   <guest>
Nov 16 10:06:21 user nova-compute[85141]:     <os_type>hvm</os_type>
Nov 16 10:06:21 user nova-compute[85141]:     <arch name='sparc'>
Nov 16 10:06:21 user nova-compute[85141]:       <wordsize>32</wordsize>
Nov 16 10:06:21 user nova-compute[85141]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1'>SS-5</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='4'>SS-20</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1'>LX</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1'>SPARCClassic</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1'>leon3_generic</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1'>SPARCbook</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1'>SS-4</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='4'>SS-600MP</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='4'>SS-10</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1'>Voyager</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <domain type='qemu'/>
Nov 16 10:06:21 user nova-compute[85141]:     </arch>
Nov 16 10:06:21 user nova-compute[85141]:     <features>
Nov 16 10:06:21 user nova-compute[85141]:       <cpuselection/>
Nov 16 10:06:21 user nova-compute[85141]:       <deviceboot/>
Nov 16 10:06:21 user nova-compute[85141]:       <disksnapshot default='on' toggle='no'/>
Nov 16 10:06:21 user nova-compute[85141]:     </features>
Nov 16 10:06:21 user nova-compute[85141]:   </guest>
Nov 16 10:06:21 user nova-compute[85141]:   <guest>
Nov 16 10:06:21 user nova-compute[85141]:     <os_type>hvm</os_type>
Nov 16 10:06:21 user nova-compute[85141]:     <arch name='sparc64'>
Nov 16 10:06:21 user nova-compute[85141]:       <wordsize>64</wordsize>
Nov 16 10:06:21 user nova-compute[85141]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1'>sun4u</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1'>niagara</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1'>sun4v</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <domain type='qemu'/>
Nov 16 10:06:21 user nova-compute[85141]:     </arch>
Nov 16 10:06:21 user nova-compute[85141]:     <features>
Nov 16 10:06:21 user nova-compute[85141]:       <cpuselection/>
Nov 16 10:06:21 user nova-compute[85141]:       <deviceboot/>
Nov 16 10:06:21 user nova-compute[85141]:       <disksnapshot default='on' toggle='no'/>
Nov 16 10:06:21 user nova-compute[85141]:     </features>
Nov 16 10:06:21 user nova-compute[85141]:   </guest>
Nov 16 10:06:21 user nova-compute[85141]:   <guest>
Nov 16 10:06:21 user nova-compute[85141]:     <os_type>hvm</os_type>
Nov 16 10:06:21 user nova-compute[85141]:     <arch name='x86_64'>
Nov 16 10:06:21 user nova-compute[85141]:       <wordsize>64</wordsize>
Nov 16 10:06:21 user nova-compute[85141]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1'>x-remote</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='1'>isapc</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='288'>microvm</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <domain type='qemu'/>
Nov 16 10:06:21 user nova-compute[85141]:       <domain type='kvm'/>
Nov 16 10:06:21 user nova-compute[85141]:     </arch>
Nov 16 10:06:21 user nova-compute[85141]:     <features>
Nov 16 10:06:21 user nova-compute[85141]:       <acpi default='on' toggle='yes'/>
Nov 16 10:06:21 user nova-compute[85141]:       <apic default='on' toggle='no'/>
Nov 16 10:06:21 user nova-compute[85141]:       <cpuselection/>
Nov 16 10:06:21 user nova-compute[85141]:       <deviceboot/>
Nov 16 10:06:21 user nova-compute[85141]:       <disksnapshot default='on' toggle='no'/>
Nov 16 10:06:21 user nova-compute[85141]:     </features>
Nov 16 10:06:21 user nova-compute[85141]:   </guest>
Nov 16 10:06:21 user nova-compute[85141]:   <guest>
Nov 16 10:06:21 user nova-compute[85141]:     <os_type>hvm</os_type>
Nov 16 10:06:21 user nova-compute[85141]:     <arch name='xtensa'>
Nov 16 10:06:21 user nova-compute[85141]:       <wordsize>32</wordsize>
Nov 16 10:06:21 user nova-compute[85141]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='4'>sim</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='32'>kc705</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='32'>ml605</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='32'>virt</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='32'>lx200</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='32'>lx60</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <domain type='qemu'/>
Nov 16 10:06:21 user nova-compute[85141]:     </arch>
Nov 16 10:06:21 user nova-compute[85141]:     <features>
Nov 16 10:06:21 user nova-compute[85141]:       <cpuselection/>
Nov 16 10:06:21 user nova-compute[85141]:       <deviceboot/>
Nov 16 10:06:21 user nova-compute[85141]:       <disksnapshot default='on' toggle='no'/>
Nov 16 10:06:21 user nova-compute[85141]:     </features>
Nov 16 10:06:21 user nova-compute[85141]:   </guest>
Nov 16 10:06:21 user nova-compute[85141]:   <guest>
Nov 16 10:06:21 user nova-compute[85141]:     <os_type>hvm</os_type>
Nov 16 10:06:21 user nova-compute[85141]:     <arch name='xtensaeb'>
Nov 16 10:06:21 user nova-compute[85141]:       <wordsize>32</wordsize>
Nov 16 10:06:21 user nova-compute[85141]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='4'>sim</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='32'>kc705</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='32'>ml605</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='32'>virt</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='32'>lx200</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='32'>lx60</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 16 10:06:21 user nova-compute[85141]:       <domain type='qemu'/>
Nov 16 10:06:21 user nova-compute[85141]:     </arch>
Nov 16 10:06:21 user nova-compute[85141]:     <features>
Nov 16 10:06:21 user nova-compute[85141]:       <cpuselection/>
Nov 16 10:06:21 user nova-compute[85141]:       <deviceboot/>
Nov 16 10:06:21 user nova-compute[85141]:       <disksnapshot default='on' toggle='no'/>
Nov 16 10:06:21 user nova-compute[85141]:     </features>
Nov 16 10:06:21 user nova-compute[85141]:   </guest>
Nov 16 10:06:21 user nova-compute[85141]: </capabilities>
Nov 16 10:06:21 user nova-compute[85141]: 
Nov 16 10:06:21 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-68e4d1b8-93eb-4f00-a57e-842b9d05649d None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=85141) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 16 10:06:21 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-68e4d1b8-93eb-4f00-a57e-842b9d05649d None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=85141) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 10:06:21 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-68e4d1b8-93eb-4f00-a57e-842b9d05649d None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=85141) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 16 10:06:21 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-68e4d1b8-93eb-4f00-a57e-842b9d05649d None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=85141) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 10:06:21 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-68e4d1b8-93eb-4f00-a57e-842b9d05649d None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=85141) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 10:06:21 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-68e4d1b8-93eb-4f00-a57e-842b9d05649d None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=85141) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 16 10:06:21 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-68e4d1b8-93eb-4f00-a57e-842b9d05649d None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=85141) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 10:06:21 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-68e4d1b8-93eb-4f00-a57e-842b9d05649d None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=85141) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 16 10:06:21 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-68e4d1b8-93eb-4f00-a57e-842b9d05649d None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=85141) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 10:06:21 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-68e4d1b8-93eb-4f00-a57e-842b9d05649d None None] Getting domain capabilities for cris via machine types: {None} {{(pid=85141) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 16 10:06:21 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-68e4d1b8-93eb-4f00-a57e-842b9d05649d None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=85141) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 10:06:21 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-68e4d1b8-93eb-4f00-a57e-842b9d05649d None None] Getting domain capabilities for i686 via machine types: {'ubuntu-q35', 'pc', 'q35', 'ubuntu'} {{(pid=85141) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 16 10:06:21 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-68e4d1b8-93eb-4f00-a57e-842b9d05649d None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Nov 16 10:06:21 user nova-compute[85141]: <domainCapabilities>
Nov 16 10:06:21 user nova-compute[85141]:   <path>/usr/bin/qemu-system-i386</path>
Nov 16 10:06:21 user nova-compute[85141]:   <domain>kvm</domain>
Nov 16 10:06:21 user nova-compute[85141]:   <machine>pc-q35-jammy</machine>
Nov 16 10:06:21 user nova-compute[85141]:   <arch>i686</arch>
Nov 16 10:06:21 user nova-compute[85141]:   <vcpu max='288'/>
Nov 16 10:06:21 user nova-compute[85141]:   <iothreads supported='yes'/>
Nov 16 10:06:21 user nova-compute[85141]:   <os supported='yes'>
Nov 16 10:06:21 user nova-compute[85141]:     <enum name='firmware'/>
Nov 16 10:06:21 user nova-compute[85141]:     <loader supported='yes'>
Nov 16 10:06:21 user nova-compute[85141]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 16 10:06:21 user nova-compute[85141]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 16 10:06:21 user nova-compute[85141]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 16 10:06:21 user nova-compute[85141]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 16 10:06:21 user nova-compute[85141]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 16 10:06:21 user nova-compute[85141]:       <enum name='type'>
Nov 16 10:06:21 user nova-compute[85141]:         <value>rom</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>pflash</value>
Nov 16 10:06:21 user nova-compute[85141]:       </enum>
Nov 16 10:06:21 user nova-compute[85141]:       <enum name='readonly'>
Nov 16 10:06:21 user nova-compute[85141]:         <value>yes</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>no</value>
Nov 16 10:06:21 user nova-compute[85141]:       </enum>
Nov 16 10:06:21 user nova-compute[85141]:       <enum name='secure'>
Nov 16 10:06:21 user nova-compute[85141]:         <value>no</value>
Nov 16 10:06:21 user nova-compute[85141]:       </enum>
Nov 16 10:06:21 user nova-compute[85141]:     </loader>
Nov 16 10:06:21 user nova-compute[85141]:   </os>
Nov 16 10:06:21 user nova-compute[85141]:   <cpu>
Nov 16 10:06:21 user nova-compute[85141]:     <mode name='host-passthrough' supported='yes'>
Nov 16 10:06:21 user nova-compute[85141]:       <enum name='hostPassthroughMigratable'>
Nov 16 10:06:21 user nova-compute[85141]:         <value>off</value>
Nov 16 10:06:21 user nova-compute[85141]:       </enum>
Nov 16 10:06:21 user nova-compute[85141]:     </mode>
Nov 16 10:06:21 user nova-compute[85141]:     <mode name='maximum' supported='yes'>
Nov 16 10:06:21 user nova-compute[85141]:       <enum name='maximumMigratable'>
Nov 16 10:06:21 user nova-compute[85141]:         <value>on</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>off</value>
Nov 16 10:06:21 user nova-compute[85141]:       </enum>
Nov 16 10:06:21 user nova-compute[85141]:     </mode>
Nov 16 10:06:21 user nova-compute[85141]:     <mode name='host-model' supported='yes'>
Nov 16 10:06:21 user nova-compute[85141]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 16 10:06:21 user nova-compute[85141]:       <vendor>Intel</vendor>
Nov 16 10:06:21 user nova-compute[85141]:       <feature policy='require' name='ss'/>
Nov 16 10:06:21 user nova-compute[85141]:       <feature policy='require' name='vmx'/>
Nov 16 10:06:21 user nova-compute[85141]:       <feature policy='require' name='pcid'/>
Nov 16 10:06:21 user nova-compute[85141]:       <feature policy='require' name='hypervisor'/>
Nov 16 10:06:21 user nova-compute[85141]:       <feature policy='require' name='arat'/>
Nov 16 10:06:21 user nova-compute[85141]:       <feature policy='require' name='tsc_adjust'/>
Nov 16 10:06:21 user nova-compute[85141]:       <feature policy='require' name='umip'/>
Nov 16 10:06:21 user nova-compute[85141]:       <feature policy='require' name='md-clear'/>
Nov 16 10:06:21 user nova-compute[85141]:       <feature policy='require' name='stibp'/>
Nov 16 10:06:21 user nova-compute[85141]:       <feature policy='require' name='arch-capabilities'/>
Nov 16 10:06:21 user nova-compute[85141]:       <feature policy='require' name='ssbd'/>
Nov 16 10:06:21 user nova-compute[85141]:       <feature policy='require' name='ibpb'/>
Nov 16 10:06:21 user nova-compute[85141]:       <feature policy='require' name='ibrs'/>
Nov 16 10:06:21 user nova-compute[85141]:       <feature policy='require' name='amd-stibp'/>
Nov 16 10:06:21 user nova-compute[85141]:       <feature policy='require' name='amd-ssbd'/>
Nov 16 10:06:21 user nova-compute[85141]:       <feature policy='disable' name='erms'/>
Nov 16 10:06:21 user nova-compute[85141]:       <feature policy='disable' name='xsaveopt'/>
Nov 16 10:06:21 user nova-compute[85141]:       <feature policy='disable' name='lm'/>
Nov 16 10:06:21 user nova-compute[85141]:     </mode>
Nov 16 10:06:21 user nova-compute[85141]:     <mode name='custom' supported='yes'>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>qemu64</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='yes'>qemu32</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>phenom</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='yes'>pentium3</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='yes'>pentium2</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='yes'>pentium</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>n270</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>kvm64</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='yes'>kvm32</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='yes'>coreduo</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>core2duo</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>athlon</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Westmere-IBRS</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Westmere</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Snowridge</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Skylake-Server</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Skylake-Client</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>SandyBridge</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Penryn</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Opteron_G5</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Opteron_G4</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Opteron_G3</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Opteron_G2</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Opteron_G1</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Nehalem-IBRS</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Nehalem</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>IvyBridge</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Icelake-Server</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Haswell-noTSX</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Haswell-IBRS</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Haswell</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>EPYC-Rome</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>EPYC-Milan</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>EPYC-IBPB</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>EPYC</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Dhyana</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Cooperlake</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Conroe</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Cascadelake-Server</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Broadwell-noTSX</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Broadwell-IBRS</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Broadwell</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='yes'>486</model>
Nov 16 10:06:21 user nova-compute[85141]:     </mode>
Nov 16 10:06:21 user nova-compute[85141]:   </cpu>
Nov 16 10:06:21 user nova-compute[85141]:   <memoryBacking supported='yes'>
Nov 16 10:06:21 user nova-compute[85141]:     <enum name='sourceType'>
Nov 16 10:06:21 user nova-compute[85141]:       <value>file</value>
Nov 16 10:06:21 user nova-compute[85141]:       <value>anonymous</value>
Nov 16 10:06:21 user nova-compute[85141]:       <value>memfd</value>
Nov 16 10:06:21 user nova-compute[85141]:     </enum>
Nov 16 10:06:21 user nova-compute[85141]:   </memoryBacking>
Nov 16 10:06:21 user nova-compute[85141]:   <devices>
Nov 16 10:06:21 user nova-compute[85141]:     <disk supported='yes'>
Nov 16 10:06:21 user nova-compute[85141]:       <enum name='diskDevice'>
Nov 16 10:06:21 user nova-compute[85141]:         <value>disk</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>cdrom</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>floppy</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>lun</value>
Nov 16 10:06:21 user nova-compute[85141]:       </enum>
Nov 16 10:06:21 user nova-compute[85141]:       <enum name='bus'>
Nov 16 10:06:21 user nova-compute[85141]:         <value>fdc</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>scsi</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>virtio</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>usb</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>sata</value>
Nov 16 10:06:21 user nova-compute[85141]:       </enum>
Nov 16 10:06:21 user nova-compute[85141]:       <enum name='model'>
Nov 16 10:06:21 user nova-compute[85141]:         <value>virtio</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>virtio-transitional</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>virtio-non-transitional</value>
Nov 16 10:06:21 user nova-compute[85141]:       </enum>
Nov 16 10:06:21 user nova-compute[85141]:     </disk>
Nov 16 10:06:21 user nova-compute[85141]:     <graphics supported='yes'>
Nov 16 10:06:21 user nova-compute[85141]:       <enum name='type'>
Nov 16 10:06:21 user nova-compute[85141]:         <value>sdl</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>vnc</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>spice</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>egl-headless</value>
Nov 16 10:06:21 user nova-compute[85141]:       </enum>
Nov 16 10:06:21 user nova-compute[85141]:     </graphics>
Nov 16 10:06:21 user nova-compute[85141]:     <video supported='yes'>
Nov 16 10:06:21 user nova-compute[85141]:       <enum name='modelType'>
Nov 16 10:06:21 user nova-compute[85141]:         <value>vga</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>cirrus</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>vmvga</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>qxl</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>virtio</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>none</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>bochs</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>ramfb</value>
Nov 16 10:06:21 user nova-compute[85141]:       </enum>
Nov 16 10:06:21 user nova-compute[85141]:     </video>
Nov 16 10:06:21 user nova-compute[85141]:     <hostdev supported='yes'>
Nov 16 10:06:21 user nova-compute[85141]:       <enum name='mode'>
Nov 16 10:06:21 user nova-compute[85141]:         <value>subsystem</value>
Nov 16 10:06:21 user nova-compute[85141]:       </enum>
Nov 16 10:06:21 user nova-compute[85141]:       <enum name='startupPolicy'>
Nov 16 10:06:21 user nova-compute[85141]:         <value>default</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>mandatory</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>requisite</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>optional</value>
Nov 16 10:06:21 user nova-compute[85141]:       </enum>
Nov 16 10:06:21 user nova-compute[85141]:       <enum name='subsysType'>
Nov 16 10:06:21 user nova-compute[85141]:         <value>usb</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>pci</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>scsi</value>
Nov 16 10:06:21 user nova-compute[85141]:       </enum>
Nov 16 10:06:21 user nova-compute[85141]:       <enum name='capsType'/>
Nov 16 10:06:21 user nova-compute[85141]:       <enum name='pciBackend'/>
Nov 16 10:06:21 user nova-compute[85141]:     </hostdev>
Nov 16 10:06:21 user nova-compute[85141]:     <rng supported='yes'>
Nov 16 10:06:21 user nova-compute[85141]:       <enum name='model'>
Nov 16 10:06:21 user nova-compute[85141]:         <value>virtio</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>virtio-transitional</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>virtio-non-transitional</value>
Nov 16 10:06:21 user nova-compute[85141]:       </enum>
Nov 16 10:06:21 user nova-compute[85141]:       <enum name='backendModel'>
Nov 16 10:06:21 user nova-compute[85141]:         <value>random</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>egd</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>builtin</value>
Nov 16 10:06:21 user nova-compute[85141]:       </enum>
Nov 16 10:06:21 user nova-compute[85141]:     </rng>
Nov 16 10:06:21 user nova-compute[85141]:     <filesystem supported='yes'>
Nov 16 10:06:21 user nova-compute[85141]:       <enum name='driverType'>
Nov 16 10:06:21 user nova-compute[85141]:         <value>path</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>handle</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>virtiofs</value>
Nov 16 10:06:21 user nova-compute[85141]:       </enum>
Nov 16 10:06:21 user nova-compute[85141]:     </filesystem>
Nov 16 10:06:21 user nova-compute[85141]:     <tpm supported='yes'>
Nov 16 10:06:21 user nova-compute[85141]:       <enum name='model'>
Nov 16 10:06:21 user nova-compute[85141]:         <value>tpm-tis</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>tpm-crb</value>
Nov 16 10:06:21 user nova-compute[85141]:       </enum>
Nov 16 10:06:21 user nova-compute[85141]:       <enum name='backendModel'>
Nov 16 10:06:21 user nova-compute[85141]:         <value>passthrough</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>emulator</value>
Nov 16 10:06:21 user nova-compute[85141]:       </enum>
Nov 16 10:06:21 user nova-compute[85141]:     </tpm>
Nov 16 10:06:21 user nova-compute[85141]:   </devices>
Nov 16 10:06:21 user nova-compute[85141]:   <features>
Nov 16 10:06:21 user nova-compute[85141]:     <gic supported='no'/>
Nov 16 10:06:21 user nova-compute[85141]:     <vmcoreinfo supported='yes'/>
Nov 16 10:06:21 user nova-compute[85141]:     <genid supported='yes'/>
Nov 16 10:06:21 user nova-compute[85141]:     <backingStoreInput supported='yes'/>
Nov 16 10:06:21 user nova-compute[85141]:     <backup supported='yes'/>
Nov 16 10:06:21 user nova-compute[85141]:     <sev supported='no'/>
Nov 16 10:06:21 user nova-compute[85141]:   </features>
Nov 16 10:06:21 user nova-compute[85141]: </domainCapabilities>
Nov 16 10:06:21 user nova-compute[85141]:  {{(pid=85141) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 16 10:06:21 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-68e4d1b8-93eb-4f00-a57e-842b9d05649d None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Nov 16 10:06:21 user nova-compute[85141]: <domainCapabilities>
Nov 16 10:06:21 user nova-compute[85141]:   <path>/usr/bin/qemu-system-i386</path>
Nov 16 10:06:21 user nova-compute[85141]:   <domain>kvm</domain>
Nov 16 10:06:21 user nova-compute[85141]:   <machine>pc-i440fx-6.2</machine>
Nov 16 10:06:21 user nova-compute[85141]:   <arch>i686</arch>
Nov 16 10:06:21 user nova-compute[85141]:   <vcpu max='255'/>
Nov 16 10:06:21 user nova-compute[85141]:   <iothreads supported='yes'/>
Nov 16 10:06:21 user nova-compute[85141]:   <os supported='yes'>
Nov 16 10:06:21 user nova-compute[85141]:     <enum name='firmware'/>
Nov 16 10:06:21 user nova-compute[85141]:     <loader supported='yes'>
Nov 16 10:06:21 user nova-compute[85141]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 16 10:06:21 user nova-compute[85141]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 16 10:06:21 user nova-compute[85141]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 16 10:06:21 user nova-compute[85141]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 16 10:06:21 user nova-compute[85141]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 16 10:06:21 user nova-compute[85141]:       <enum name='type'>
Nov 16 10:06:21 user nova-compute[85141]:         <value>rom</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>pflash</value>
Nov 16 10:06:21 user nova-compute[85141]:       </enum>
Nov 16 10:06:21 user nova-compute[85141]:       <enum name='readonly'>
Nov 16 10:06:21 user nova-compute[85141]:         <value>yes</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>no</value>
Nov 16 10:06:21 user nova-compute[85141]:       </enum>
Nov 16 10:06:21 user nova-compute[85141]:       <enum name='secure'>
Nov 16 10:06:21 user nova-compute[85141]:         <value>no</value>
Nov 16 10:06:21 user nova-compute[85141]:       </enum>
Nov 16 10:06:21 user nova-compute[85141]:     </loader>
Nov 16 10:06:21 user nova-compute[85141]:   </os>
Nov 16 10:06:21 user nova-compute[85141]:   <cpu>
Nov 16 10:06:21 user nova-compute[85141]:     <mode name='host-passthrough' supported='yes'>
Nov 16 10:06:21 user nova-compute[85141]:       <enum name='hostPassthroughMigratable'>
Nov 16 10:06:21 user nova-compute[85141]:         <value>off</value>
Nov 16 10:06:21 user nova-compute[85141]:       </enum>
Nov 16 10:06:21 user nova-compute[85141]:     </mode>
Nov 16 10:06:21 user nova-compute[85141]:     <mode name='maximum' supported='yes'>
Nov 16 10:06:21 user nova-compute[85141]:       <enum name='maximumMigratable'>
Nov 16 10:06:21 user nova-compute[85141]:         <value>on</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>off</value>
Nov 16 10:06:21 user nova-compute[85141]:       </enum>
Nov 16 10:06:21 user nova-compute[85141]:     </mode>
Nov 16 10:06:21 user nova-compute[85141]:     <mode name='host-model' supported='yes'>
Nov 16 10:06:21 user nova-compute[85141]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 16 10:06:21 user nova-compute[85141]:       <vendor>Intel</vendor>
Nov 16 10:06:21 user nova-compute[85141]:       <feature policy='require' name='ss'/>
Nov 16 10:06:21 user nova-compute[85141]:       <feature policy='require' name='vmx'/>
Nov 16 10:06:21 user nova-compute[85141]:       <feature policy='require' name='pcid'/>
Nov 16 10:06:21 user nova-compute[85141]:       <feature policy='require' name='hypervisor'/>
Nov 16 10:06:21 user nova-compute[85141]:       <feature policy='require' name='arat'/>
Nov 16 10:06:21 user nova-compute[85141]:       <feature policy='require' name='tsc_adjust'/>
Nov 16 10:06:21 user nova-compute[85141]:       <feature policy='require' name='umip'/>
Nov 16 10:06:21 user nova-compute[85141]:       <feature policy='require' name='md-clear'/>
Nov 16 10:06:21 user nova-compute[85141]:       <feature policy='require' name='stibp'/>
Nov 16 10:06:21 user nova-compute[85141]:       <feature policy='require' name='arch-capabilities'/>
Nov 16 10:06:21 user nova-compute[85141]:       <feature policy='require' name='ssbd'/>
Nov 16 10:06:21 user nova-compute[85141]:       <feature policy='require' name='ibpb'/>
Nov 16 10:06:21 user nova-compute[85141]:       <feature policy='require' name='ibrs'/>
Nov 16 10:06:21 user nova-compute[85141]:       <feature policy='require' name='amd-stibp'/>
Nov 16 10:06:21 user nova-compute[85141]:       <feature policy='require' name='amd-ssbd'/>
Nov 16 10:06:21 user nova-compute[85141]:       <feature policy='disable' name='erms'/>
Nov 16 10:06:21 user nova-compute[85141]:       <feature policy='disable' name='xsaveopt'/>
Nov 16 10:06:21 user nova-compute[85141]:       <feature policy='disable' name='lm'/>
Nov 16 10:06:21 user nova-compute[85141]:     </mode>
Nov 16 10:06:21 user nova-compute[85141]:     <mode name='custom' supported='yes'>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>qemu64</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='yes'>qemu32</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>phenom</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='yes'>pentium3</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='yes'>pentium2</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='yes'>pentium</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>n270</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>kvm64</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='yes'>kvm32</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='yes'>coreduo</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>core2duo</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>athlon</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Westmere-IBRS</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Westmere</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Snowridge</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Skylake-Server</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Skylake-Client</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>SandyBridge</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Penryn</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Opteron_G5</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Opteron_G4</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Opteron_G3</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Opteron_G2</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Opteron_G1</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Nehalem-IBRS</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Nehalem</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>IvyBridge</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Icelake-Server</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Haswell-noTSX</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Haswell-IBRS</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Haswell</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>EPYC-Rome</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>EPYC-Milan</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>EPYC-IBPB</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>EPYC</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Dhyana</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Cooperlake</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Conroe</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Cascadelake-Server</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Broadwell-noTSX</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Broadwell-IBRS</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Broadwell</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='yes'>486</model>
Nov 16 10:06:21 user nova-compute[85141]:     </mode>
Nov 16 10:06:21 user nova-compute[85141]:   </cpu>
Nov 16 10:06:21 user nova-compute[85141]:   <memoryBacking supported='yes'>
Nov 16 10:06:21 user nova-compute[85141]:     <enum name='sourceType'>
Nov 16 10:06:21 user nova-compute[85141]:       <value>file</value>
Nov 16 10:06:21 user nova-compute[85141]:       <value>anonymous</value>
Nov 16 10:06:21 user nova-compute[85141]:       <value>memfd</value>
Nov 16 10:06:21 user nova-compute[85141]:     </enum>
Nov 16 10:06:21 user nova-compute[85141]:   </memoryBacking>
Nov 16 10:06:21 user nova-compute[85141]:   <devices>
Nov 16 10:06:21 user nova-compute[85141]:     <disk supported='yes'>
Nov 16 10:06:21 user nova-compute[85141]:       <enum name='diskDevice'>
Nov 16 10:06:21 user nova-compute[85141]:         <value>disk</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>cdrom</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>floppy</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>lun</value>
Nov 16 10:06:21 user nova-compute[85141]:       </enum>
Nov 16 10:06:21 user nova-compute[85141]:       <enum name='bus'>
Nov 16 10:06:21 user nova-compute[85141]:         <value>ide</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>fdc</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>scsi</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>virtio</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>usb</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>sata</value>
Nov 16 10:06:21 user nova-compute[85141]:       </enum>
Nov 16 10:06:21 user nova-compute[85141]:       <enum name='model'>
Nov 16 10:06:21 user nova-compute[85141]:         <value>virtio</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>virtio-transitional</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>virtio-non-transitional</value>
Nov 16 10:06:21 user nova-compute[85141]:       </enum>
Nov 16 10:06:21 user nova-compute[85141]:     </disk>
Nov 16 10:06:21 user nova-compute[85141]:     <graphics supported='yes'>
Nov 16 10:06:21 user nova-compute[85141]:       <enum name='type'>
Nov 16 10:06:21 user nova-compute[85141]:         <value>sdl</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>vnc</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>spice</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>egl-headless</value>
Nov 16 10:06:21 user nova-compute[85141]:       </enum>
Nov 16 10:06:21 user nova-compute[85141]:     </graphics>
Nov 16 10:06:21 user nova-compute[85141]:     <video supported='yes'>
Nov 16 10:06:21 user nova-compute[85141]:       <enum name='modelType'>
Nov 16 10:06:21 user nova-compute[85141]:         <value>vga</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>cirrus</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>vmvga</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>qxl</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>virtio</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>none</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>bochs</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>ramfb</value>
Nov 16 10:06:21 user nova-compute[85141]:       </enum>
Nov 16 10:06:21 user nova-compute[85141]:     </video>
Nov 16 10:06:21 user nova-compute[85141]:     <hostdev supported='yes'>
Nov 16 10:06:21 user nova-compute[85141]:       <enum name='mode'>
Nov 16 10:06:21 user nova-compute[85141]:         <value>subsystem</value>
Nov 16 10:06:21 user nova-compute[85141]:       </enum>
Nov 16 10:06:21 user nova-compute[85141]:       <enum name='startupPolicy'>
Nov 16 10:06:21 user nova-compute[85141]:         <value>default</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>mandatory</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>requisite</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>optional</value>
Nov 16 10:06:21 user nova-compute[85141]:       </enum>
Nov 16 10:06:21 user nova-compute[85141]:       <enum name='subsysType'>
Nov 16 10:06:21 user nova-compute[85141]:         <value>usb</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>pci</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>scsi</value>
Nov 16 10:06:21 user nova-compute[85141]:       </enum>
Nov 16 10:06:21 user nova-compute[85141]:       <enum name='capsType'/>
Nov 16 10:06:21 user nova-compute[85141]:       <enum name='pciBackend'/>
Nov 16 10:06:21 user nova-compute[85141]:     </hostdev>
Nov 16 10:06:21 user nova-compute[85141]:     <rng supported='yes'>
Nov 16 10:06:21 user nova-compute[85141]:       <enum name='model'>
Nov 16 10:06:21 user nova-compute[85141]:         <value>virtio</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>virtio-transitional</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>virtio-non-transitional</value>
Nov 16 10:06:21 user nova-compute[85141]:       </enum>
Nov 16 10:06:21 user nova-compute[85141]:       <enum name='backendModel'>
Nov 16 10:06:21 user nova-compute[85141]:         <value>random</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>egd</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>builtin</value>
Nov 16 10:06:21 user nova-compute[85141]:       </enum>
Nov 16 10:06:21 user nova-compute[85141]:     </rng>
Nov 16 10:06:21 user nova-compute[85141]:     <filesystem supported='yes'>
Nov 16 10:06:21 user nova-compute[85141]:       <enum name='driverType'>
Nov 16 10:06:21 user nova-compute[85141]:         <value>path</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>handle</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>virtiofs</value>
Nov 16 10:06:21 user nova-compute[85141]:       </enum>
Nov 16 10:06:21 user nova-compute[85141]:     </filesystem>
Nov 16 10:06:21 user nova-compute[85141]:     <tpm supported='yes'>
Nov 16 10:06:21 user nova-compute[85141]:       <enum name='model'>
Nov 16 10:06:21 user nova-compute[85141]:         <value>tpm-tis</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>tpm-crb</value>
Nov 16 10:06:21 user nova-compute[85141]:       </enum>
Nov 16 10:06:21 user nova-compute[85141]:       <enum name='backendModel'>
Nov 16 10:06:21 user nova-compute[85141]:         <value>passthrough</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>emulator</value>
Nov 16 10:06:21 user nova-compute[85141]:       </enum>
Nov 16 10:06:21 user nova-compute[85141]:     </tpm>
Nov 16 10:06:21 user nova-compute[85141]:   </devices>
Nov 16 10:06:21 user nova-compute[85141]:   <features>
Nov 16 10:06:21 user nova-compute[85141]:     <gic supported='no'/>
Nov 16 10:06:21 user nova-compute[85141]:     <vmcoreinfo supported='yes'/>
Nov 16 10:06:21 user nova-compute[85141]:     <genid supported='yes'/>
Nov 16 10:06:21 user nova-compute[85141]:     <backingStoreInput supported='yes'/>
Nov 16 10:06:21 user nova-compute[85141]:     <backup supported='yes'/>
Nov 16 10:06:21 user nova-compute[85141]:     <sev supported='no'/>
Nov 16 10:06:21 user nova-compute[85141]:   </features>
Nov 16 10:06:21 user nova-compute[85141]: </domainCapabilities>
Nov 16 10:06:21 user nova-compute[85141]:  {{(pid=85141) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 16 10:06:21 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-68e4d1b8-93eb-4f00-a57e-842b9d05649d None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Nov 16 10:06:21 user nova-compute[85141]: <domainCapabilities>
Nov 16 10:06:21 user nova-compute[85141]:   <path>/usr/bin/qemu-system-i386</path>
Nov 16 10:06:21 user nova-compute[85141]:   <domain>kvm</domain>
Nov 16 10:06:21 user nova-compute[85141]:   <machine>pc-q35-6.2</machine>
Nov 16 10:06:21 user nova-compute[85141]:   <arch>i686</arch>
Nov 16 10:06:21 user nova-compute[85141]:   <vcpu max='288'/>
Nov 16 10:06:21 user nova-compute[85141]:   <iothreads supported='yes'/>
Nov 16 10:06:21 user nova-compute[85141]:   <os supported='yes'>
Nov 16 10:06:21 user nova-compute[85141]:     <enum name='firmware'/>
Nov 16 10:06:21 user nova-compute[85141]:     <loader supported='yes'>
Nov 16 10:06:21 user nova-compute[85141]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 16 10:06:21 user nova-compute[85141]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 16 10:06:21 user nova-compute[85141]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 16 10:06:21 user nova-compute[85141]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 16 10:06:21 user nova-compute[85141]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 16 10:06:21 user nova-compute[85141]:       <enum name='type'>
Nov 16 10:06:21 user nova-compute[85141]:         <value>rom</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>pflash</value>
Nov 16 10:06:21 user nova-compute[85141]:       </enum>
Nov 16 10:06:21 user nova-compute[85141]:       <enum name='readonly'>
Nov 16 10:06:21 user nova-compute[85141]:         <value>yes</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>no</value>
Nov 16 10:06:21 user nova-compute[85141]:       </enum>
Nov 16 10:06:21 user nova-compute[85141]:       <enum name='secure'>
Nov 16 10:06:21 user nova-compute[85141]:         <value>no</value>
Nov 16 10:06:21 user nova-compute[85141]:       </enum>
Nov 16 10:06:21 user nova-compute[85141]:     </loader>
Nov 16 10:06:21 user nova-compute[85141]:   </os>
Nov 16 10:06:21 user nova-compute[85141]:   <cpu>
Nov 16 10:06:21 user nova-compute[85141]:     <mode name='host-passthrough' supported='yes'>
Nov 16 10:06:21 user nova-compute[85141]:       <enum name='hostPassthroughMigratable'>
Nov 16 10:06:21 user nova-compute[85141]:         <value>off</value>
Nov 16 10:06:21 user nova-compute[85141]:       </enum>
Nov 16 10:06:21 user nova-compute[85141]:     </mode>
Nov 16 10:06:21 user nova-compute[85141]:     <mode name='maximum' supported='yes'>
Nov 16 10:06:21 user nova-compute[85141]:       <enum name='maximumMigratable'>
Nov 16 10:06:21 user nova-compute[85141]:         <value>on</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>off</value>
Nov 16 10:06:21 user nova-compute[85141]:       </enum>
Nov 16 10:06:21 user nova-compute[85141]:     </mode>
Nov 16 10:06:21 user nova-compute[85141]:     <mode name='host-model' supported='yes'>
Nov 16 10:06:21 user nova-compute[85141]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 16 10:06:21 user nova-compute[85141]:       <vendor>Intel</vendor>
Nov 16 10:06:21 user nova-compute[85141]:       <feature policy='require' name='ss'/>
Nov 16 10:06:21 user nova-compute[85141]:       <feature policy='require' name='vmx'/>
Nov 16 10:06:21 user nova-compute[85141]:       <feature policy='require' name='pcid'/>
Nov 16 10:06:21 user nova-compute[85141]:       <feature policy='require' name='hypervisor'/>
Nov 16 10:06:21 user nova-compute[85141]:       <feature policy='require' name='arat'/>
Nov 16 10:06:21 user nova-compute[85141]:       <feature policy='require' name='tsc_adjust'/>
Nov 16 10:06:21 user nova-compute[85141]:       <feature policy='require' name='umip'/>
Nov 16 10:06:21 user nova-compute[85141]:       <feature policy='require' name='md-clear'/>
Nov 16 10:06:21 user nova-compute[85141]:       <feature policy='require' name='stibp'/>
Nov 16 10:06:21 user nova-compute[85141]:       <feature policy='require' name='arch-capabilities'/>
Nov 16 10:06:21 user nova-compute[85141]:       <feature policy='require' name='ssbd'/>
Nov 16 10:06:21 user nova-compute[85141]:       <feature policy='require' name='ibpb'/>
Nov 16 10:06:21 user nova-compute[85141]:       <feature policy='require' name='ibrs'/>
Nov 16 10:06:21 user nova-compute[85141]:       <feature policy='require' name='amd-stibp'/>
Nov 16 10:06:21 user nova-compute[85141]:       <feature policy='require' name='amd-ssbd'/>
Nov 16 10:06:21 user nova-compute[85141]:       <feature policy='disable' name='erms'/>
Nov 16 10:06:21 user nova-compute[85141]:       <feature policy='disable' name='xsaveopt'/>
Nov 16 10:06:21 user nova-compute[85141]:       <feature policy='disable' name='lm'/>
Nov 16 10:06:21 user nova-compute[85141]:     </mode>
Nov 16 10:06:21 user nova-compute[85141]:     <mode name='custom' supported='yes'>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>qemu64</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='yes'>qemu32</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>phenom</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='yes'>pentium3</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='yes'>pentium2</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='yes'>pentium</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>n270</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>kvm64</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='yes'>kvm32</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='yes'>coreduo</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>core2duo</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>athlon</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Westmere-IBRS</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Westmere</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Snowridge</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Skylake-Server</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Skylake-Client</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>SandyBridge</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Penryn</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Opteron_G5</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Opteron_G4</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Opteron_G3</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Opteron_G2</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Opteron_G1</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Nehalem-IBRS</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Nehalem</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>IvyBridge</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Icelake-Server</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Haswell-noTSX</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Haswell-IBRS</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Haswell</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>EPYC-Rome</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>EPYC-Milan</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>EPYC-IBPB</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>EPYC</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Dhyana</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Cooperlake</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Conroe</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Cascadelake-Server</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Broadwell-noTSX</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Broadwell-IBRS</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Broadwell</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='yes'>486</model>
Nov 16 10:06:21 user nova-compute[85141]:     </mode>
Nov 16 10:06:21 user nova-compute[85141]:   </cpu>
Nov 16 10:06:21 user nova-compute[85141]:   <memoryBacking supported='yes'>
Nov 16 10:06:21 user nova-compute[85141]:     <enum name='sourceType'>
Nov 16 10:06:21 user nova-compute[85141]:       <value>file</value>
Nov 16 10:06:21 user nova-compute[85141]:       <value>anonymous</value>
Nov 16 10:06:21 user nova-compute[85141]:       <value>memfd</value>
Nov 16 10:06:21 user nova-compute[85141]:     </enum>
Nov 16 10:06:21 user nova-compute[85141]:   </memoryBacking>
Nov 16 10:06:21 user nova-compute[85141]:   <devices>
Nov 16 10:06:21 user nova-compute[85141]:     <disk supported='yes'>
Nov 16 10:06:21 user nova-compute[85141]:       <enum name='diskDevice'>
Nov 16 10:06:21 user nova-compute[85141]:         <value>disk</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>cdrom</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>floppy</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>lun</value>
Nov 16 10:06:21 user nova-compute[85141]:       </enum>
Nov 16 10:06:21 user nova-compute[85141]:       <enum name='bus'>
Nov 16 10:06:21 user nova-compute[85141]:         <value>fdc</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>scsi</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>virtio</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>usb</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>sata</value>
Nov 16 10:06:21 user nova-compute[85141]:       </enum>
Nov 16 10:06:21 user nova-compute[85141]:       <enum name='model'>
Nov 16 10:06:21 user nova-compute[85141]:         <value>virtio</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>virtio-transitional</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>virtio-non-transitional</value>
Nov 16 10:06:21 user nova-compute[85141]:       </enum>
Nov 16 10:06:21 user nova-compute[85141]:     </disk>
Nov 16 10:06:21 user nova-compute[85141]:     <graphics supported='yes'>
Nov 16 10:06:21 user nova-compute[85141]:       <enum name='type'>
Nov 16 10:06:21 user nova-compute[85141]:         <value>sdl</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>vnc</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>spice</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>egl-headless</value>
Nov 16 10:06:21 user nova-compute[85141]:       </enum>
Nov 16 10:06:21 user nova-compute[85141]:     </graphics>
Nov 16 10:06:21 user nova-compute[85141]:     <video supported='yes'>
Nov 16 10:06:21 user nova-compute[85141]:       <enum name='modelType'>
Nov 16 10:06:21 user nova-compute[85141]:         <value>vga</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>cirrus</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>vmvga</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>qxl</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>virtio</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>none</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>bochs</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>ramfb</value>
Nov 16 10:06:21 user nova-compute[85141]:       </enum>
Nov 16 10:06:21 user nova-compute[85141]:     </video>
Nov 16 10:06:21 user nova-compute[85141]:     <hostdev supported='yes'>
Nov 16 10:06:21 user nova-compute[85141]:       <enum name='mode'>
Nov 16 10:06:21 user nova-compute[85141]:         <value>subsystem</value>
Nov 16 10:06:21 user nova-compute[85141]:       </enum>
Nov 16 10:06:21 user nova-compute[85141]:       <enum name='startupPolicy'>
Nov 16 10:06:21 user nova-compute[85141]:         <value>default</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>mandatory</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>requisite</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>optional</value>
Nov 16 10:06:21 user nova-compute[85141]:       </enum>
Nov 16 10:06:21 user nova-compute[85141]:       <enum name='subsysType'>
Nov 16 10:06:21 user nova-compute[85141]:         <value>usb</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>pci</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>scsi</value>
Nov 16 10:06:21 user nova-compute[85141]:       </enum>
Nov 16 10:06:21 user nova-compute[85141]:       <enum name='capsType'/>
Nov 16 10:06:21 user nova-compute[85141]:       <enum name='pciBackend'/>
Nov 16 10:06:21 user nova-compute[85141]:     </hostdev>
Nov 16 10:06:21 user nova-compute[85141]:     <rng supported='yes'>
Nov 16 10:06:21 user nova-compute[85141]:       <enum name='model'>
Nov 16 10:06:21 user nova-compute[85141]:         <value>virtio</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>virtio-transitional</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>virtio-non-transitional</value>
Nov 16 10:06:21 user nova-compute[85141]:       </enum>
Nov 16 10:06:21 user nova-compute[85141]:       <enum name='backendModel'>
Nov 16 10:06:21 user nova-compute[85141]:         <value>random</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>egd</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>builtin</value>
Nov 16 10:06:21 user nova-compute[85141]:       </enum>
Nov 16 10:06:21 user nova-compute[85141]:     </rng>
Nov 16 10:06:21 user nova-compute[85141]:     <filesystem supported='yes'>
Nov 16 10:06:21 user nova-compute[85141]:       <enum name='driverType'>
Nov 16 10:06:21 user nova-compute[85141]:         <value>path</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>handle</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>virtiofs</value>
Nov 16 10:06:21 user nova-compute[85141]:       </enum>
Nov 16 10:06:21 user nova-compute[85141]:     </filesystem>
Nov 16 10:06:21 user nova-compute[85141]:     <tpm supported='yes'>
Nov 16 10:06:21 user nova-compute[85141]:       <enum name='model'>
Nov 16 10:06:21 user nova-compute[85141]:         <value>tpm-tis</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>tpm-crb</value>
Nov 16 10:06:21 user nova-compute[85141]:       </enum>
Nov 16 10:06:21 user nova-compute[85141]:       <enum name='backendModel'>
Nov 16 10:06:21 user nova-compute[85141]:         <value>passthrough</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>emulator</value>
Nov 16 10:06:21 user nova-compute[85141]:       </enum>
Nov 16 10:06:21 user nova-compute[85141]:     </tpm>
Nov 16 10:06:21 user nova-compute[85141]:   </devices>
Nov 16 10:06:21 user nova-compute[85141]:   <features>
Nov 16 10:06:21 user nova-compute[85141]:     <gic supported='no'/>
Nov 16 10:06:21 user nova-compute[85141]:     <vmcoreinfo supported='yes'/>
Nov 16 10:06:21 user nova-compute[85141]:     <genid supported='yes'/>
Nov 16 10:06:21 user nova-compute[85141]:     <backingStoreInput supported='yes'/>
Nov 16 10:06:21 user nova-compute[85141]:     <backup supported='yes'/>
Nov 16 10:06:21 user nova-compute[85141]:     <sev supported='no'/>
Nov 16 10:06:21 user nova-compute[85141]:   </features>
Nov 16 10:06:21 user nova-compute[85141]: </domainCapabilities>
Nov 16 10:06:21 user nova-compute[85141]:  {{(pid=85141) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 16 10:06:21 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-68e4d1b8-93eb-4f00-a57e-842b9d05649d None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Nov 16 10:06:21 user nova-compute[85141]: <domainCapabilities>
Nov 16 10:06:21 user nova-compute[85141]:   <path>/usr/bin/qemu-system-i386</path>
Nov 16 10:06:21 user nova-compute[85141]:   <domain>kvm</domain>
Nov 16 10:06:21 user nova-compute[85141]:   <machine>pc-i440fx-jammy</machine>
Nov 16 10:06:21 user nova-compute[85141]:   <arch>i686</arch>
Nov 16 10:06:21 user nova-compute[85141]:   <vcpu max='255'/>
Nov 16 10:06:21 user nova-compute[85141]:   <iothreads supported='yes'/>
Nov 16 10:06:21 user nova-compute[85141]:   <os supported='yes'>
Nov 16 10:06:21 user nova-compute[85141]:     <enum name='firmware'/>
Nov 16 10:06:21 user nova-compute[85141]:     <loader supported='yes'>
Nov 16 10:06:21 user nova-compute[85141]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 16 10:06:21 user nova-compute[85141]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 16 10:06:21 user nova-compute[85141]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 16 10:06:21 user nova-compute[85141]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 16 10:06:21 user nova-compute[85141]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 16 10:06:21 user nova-compute[85141]:       <enum name='type'>
Nov 16 10:06:21 user nova-compute[85141]:         <value>rom</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>pflash</value>
Nov 16 10:06:21 user nova-compute[85141]:       </enum>
Nov 16 10:06:21 user nova-compute[85141]:       <enum name='readonly'>
Nov 16 10:06:21 user nova-compute[85141]:         <value>yes</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>no</value>
Nov 16 10:06:21 user nova-compute[85141]:       </enum>
Nov 16 10:06:21 user nova-compute[85141]:       <enum name='secure'>
Nov 16 10:06:21 user nova-compute[85141]:         <value>no</value>
Nov 16 10:06:21 user nova-compute[85141]:       </enum>
Nov 16 10:06:21 user nova-compute[85141]:     </loader>
Nov 16 10:06:21 user nova-compute[85141]:   </os>
Nov 16 10:06:21 user nova-compute[85141]:   <cpu>
Nov 16 10:06:21 user nova-compute[85141]:     <mode name='host-passthrough' supported='yes'>
Nov 16 10:06:21 user nova-compute[85141]:       <enum name='hostPassthroughMigratable'>
Nov 16 10:06:21 user nova-compute[85141]:         <value>off</value>
Nov 16 10:06:21 user nova-compute[85141]:       </enum>
Nov 16 10:06:21 user nova-compute[85141]:     </mode>
Nov 16 10:06:21 user nova-compute[85141]:     <mode name='maximum' supported='yes'>
Nov 16 10:06:21 user nova-compute[85141]:       <enum name='maximumMigratable'>
Nov 16 10:06:21 user nova-compute[85141]:         <value>on</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>off</value>
Nov 16 10:06:21 user nova-compute[85141]:       </enum>
Nov 16 10:06:21 user nova-compute[85141]:     </mode>
Nov 16 10:06:21 user nova-compute[85141]:     <mode name='host-model' supported='yes'>
Nov 16 10:06:21 user nova-compute[85141]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 16 10:06:21 user nova-compute[85141]:       <vendor>Intel</vendor>
Nov 16 10:06:21 user nova-compute[85141]:       <feature policy='require' name='ss'/>
Nov 16 10:06:21 user nova-compute[85141]:       <feature policy='require' name='vmx'/>
Nov 16 10:06:21 user nova-compute[85141]:       <feature policy='require' name='pcid'/>
Nov 16 10:06:21 user nova-compute[85141]:       <feature policy='require' name='hypervisor'/>
Nov 16 10:06:21 user nova-compute[85141]:       <feature policy='require' name='arat'/>
Nov 16 10:06:21 user nova-compute[85141]:       <feature policy='require' name='tsc_adjust'/>
Nov 16 10:06:21 user nova-compute[85141]:       <feature policy='require' name='umip'/>
Nov 16 10:06:21 user nova-compute[85141]:       <feature policy='require' name='md-clear'/>
Nov 16 10:06:21 user nova-compute[85141]:       <feature policy='require' name='stibp'/>
Nov 16 10:06:21 user nova-compute[85141]:       <feature policy='require' name='arch-capabilities'/>
Nov 16 10:06:21 user nova-compute[85141]:       <feature policy='require' name='ssbd'/>
Nov 16 10:06:21 user nova-compute[85141]:       <feature policy='require' name='ibpb'/>
Nov 16 10:06:21 user nova-compute[85141]:       <feature policy='require' name='ibrs'/>
Nov 16 10:06:21 user nova-compute[85141]:       <feature policy='require' name='amd-stibp'/>
Nov 16 10:06:21 user nova-compute[85141]:       <feature policy='require' name='amd-ssbd'/>
Nov 16 10:06:21 user nova-compute[85141]:       <feature policy='disable' name='erms'/>
Nov 16 10:06:21 user nova-compute[85141]:       <feature policy='disable' name='xsaveopt'/>
Nov 16 10:06:21 user nova-compute[85141]:       <feature policy='disable' name='lm'/>
Nov 16 10:06:21 user nova-compute[85141]:     </mode>
Nov 16 10:06:21 user nova-compute[85141]:     <mode name='custom' supported='yes'>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>qemu64</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='yes'>qemu32</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>phenom</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='yes'>pentium3</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='yes'>pentium2</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='yes'>pentium</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>n270</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>kvm64</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='yes'>kvm32</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='yes'>coreduo</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>core2duo</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>athlon</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Westmere-IBRS</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Westmere</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Snowridge</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Skylake-Server</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Skylake-Client</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>SandyBridge</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Penryn</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Opteron_G5</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Opteron_G4</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Opteron_G3</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Opteron_G2</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Opteron_G1</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Nehalem-IBRS</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Nehalem</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>IvyBridge</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Icelake-Server</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Haswell-noTSX</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Haswell-IBRS</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Haswell</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>EPYC-Rome</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>EPYC-Milan</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>EPYC-IBPB</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>EPYC</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Dhyana</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Cooperlake</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Conroe</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Cascadelake-Server</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Broadwell-noTSX</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Broadwell-IBRS</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Broadwell</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='yes'>486</model>
Nov 16 10:06:21 user nova-compute[85141]:     </mode>
Nov 16 10:06:21 user nova-compute[85141]:   </cpu>
Nov 16 10:06:21 user nova-compute[85141]:   <memoryBacking supported='yes'>
Nov 16 10:06:21 user nova-compute[85141]:     <enum name='sourceType'>
Nov 16 10:06:21 user nova-compute[85141]:       <value>file</value>
Nov 16 10:06:21 user nova-compute[85141]:       <value>anonymous</value>
Nov 16 10:06:21 user nova-compute[85141]:       <value>memfd</value>
Nov 16 10:06:21 user nova-compute[85141]:     </enum>
Nov 16 10:06:21 user nova-compute[85141]:   </memoryBacking>
Nov 16 10:06:21 user nova-compute[85141]:   <devices>
Nov 16 10:06:21 user nova-compute[85141]:     <disk supported='yes'>
Nov 16 10:06:21 user nova-compute[85141]:       <enum name='diskDevice'>
Nov 16 10:06:21 user nova-compute[85141]:         <value>disk</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>cdrom</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>floppy</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>lun</value>
Nov 16 10:06:21 user nova-compute[85141]:       </enum>
Nov 16 10:06:21 user nova-compute[85141]:       <enum name='bus'>
Nov 16 10:06:21 user nova-compute[85141]:         <value>ide</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>fdc</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>scsi</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>virtio</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>usb</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>sata</value>
Nov 16 10:06:21 user nova-compute[85141]:       </enum>
Nov 16 10:06:21 user nova-compute[85141]:       <enum name='model'>
Nov 16 10:06:21 user nova-compute[85141]:         <value>virtio</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>virtio-transitional</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>virtio-non-transitional</value>
Nov 16 10:06:21 user nova-compute[85141]:       </enum>
Nov 16 10:06:21 user nova-compute[85141]:     </disk>
Nov 16 10:06:21 user nova-compute[85141]:     <graphics supported='yes'>
Nov 16 10:06:21 user nova-compute[85141]:       <enum name='type'>
Nov 16 10:06:21 user nova-compute[85141]:         <value>sdl</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>vnc</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>spice</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>egl-headless</value>
Nov 16 10:06:21 user nova-compute[85141]:       </enum>
Nov 16 10:06:21 user nova-compute[85141]:     </graphics>
Nov 16 10:06:21 user nova-compute[85141]:     <video supported='yes'>
Nov 16 10:06:21 user nova-compute[85141]:       <enum name='modelType'>
Nov 16 10:06:21 user nova-compute[85141]:         <value>vga</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>cirrus</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>vmvga</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>qxl</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>virtio</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>none</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>bochs</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>ramfb</value>
Nov 16 10:06:21 user nova-compute[85141]:       </enum>
Nov 16 10:06:21 user nova-compute[85141]:     </video>
Nov 16 10:06:21 user nova-compute[85141]:     <hostdev supported='yes'>
Nov 16 10:06:21 user nova-compute[85141]:       <enum name='mode'>
Nov 16 10:06:21 user nova-compute[85141]:         <value>subsystem</value>
Nov 16 10:06:21 user nova-compute[85141]:       </enum>
Nov 16 10:06:21 user nova-compute[85141]:       <enum name='startupPolicy'>
Nov 16 10:06:21 user nova-compute[85141]:         <value>default</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>mandatory</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>requisite</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>optional</value>
Nov 16 10:06:21 user nova-compute[85141]:       </enum>
Nov 16 10:06:21 user nova-compute[85141]:       <enum name='subsysType'>
Nov 16 10:06:21 user nova-compute[85141]:         <value>usb</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>pci</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>scsi</value>
Nov 16 10:06:21 user nova-compute[85141]:       </enum>
Nov 16 10:06:21 user nova-compute[85141]:       <enum name='capsType'/>
Nov 16 10:06:21 user nova-compute[85141]:       <enum name='pciBackend'/>
Nov 16 10:06:21 user nova-compute[85141]:     </hostdev>
Nov 16 10:06:21 user nova-compute[85141]:     <rng supported='yes'>
Nov 16 10:06:21 user nova-compute[85141]:       <enum name='model'>
Nov 16 10:06:21 user nova-compute[85141]:         <value>virtio</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>virtio-transitional</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>virtio-non-transitional</value>
Nov 16 10:06:21 user nova-compute[85141]:       </enum>
Nov 16 10:06:21 user nova-compute[85141]:       <enum name='backendModel'>
Nov 16 10:06:21 user nova-compute[85141]:         <value>random</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>egd</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>builtin</value>
Nov 16 10:06:21 user nova-compute[85141]:       </enum>
Nov 16 10:06:21 user nova-compute[85141]:     </rng>
Nov 16 10:06:21 user nova-compute[85141]:     <filesystem supported='yes'>
Nov 16 10:06:21 user nova-compute[85141]:       <enum name='driverType'>
Nov 16 10:06:21 user nova-compute[85141]:         <value>path</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>handle</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>virtiofs</value>
Nov 16 10:06:21 user nova-compute[85141]:       </enum>
Nov 16 10:06:21 user nova-compute[85141]:     </filesystem>
Nov 16 10:06:21 user nova-compute[85141]:     <tpm supported='yes'>
Nov 16 10:06:21 user nova-compute[85141]:       <enum name='model'>
Nov 16 10:06:21 user nova-compute[85141]:         <value>tpm-tis</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>tpm-crb</value>
Nov 16 10:06:21 user nova-compute[85141]:       </enum>
Nov 16 10:06:21 user nova-compute[85141]:       <enum name='backendModel'>
Nov 16 10:06:21 user nova-compute[85141]:         <value>passthrough</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>emulator</value>
Nov 16 10:06:21 user nova-compute[85141]:       </enum>
Nov 16 10:06:21 user nova-compute[85141]:     </tpm>
Nov 16 10:06:21 user nova-compute[85141]:   </devices>
Nov 16 10:06:21 user nova-compute[85141]:   <features>
Nov 16 10:06:21 user nova-compute[85141]:     <gic supported='no'/>
Nov 16 10:06:21 user nova-compute[85141]:     <vmcoreinfo supported='yes'/>
Nov 16 10:06:21 user nova-compute[85141]:     <genid supported='yes'/>
Nov 16 10:06:21 user nova-compute[85141]:     <backingStoreInput supported='yes'/>
Nov 16 10:06:21 user nova-compute[85141]:     <backup supported='yes'/>
Nov 16 10:06:21 user nova-compute[85141]:     <sev supported='no'/>
Nov 16 10:06:21 user nova-compute[85141]:   </features>
Nov 16 10:06:21 user nova-compute[85141]: </domainCapabilities>
Nov 16 10:06:21 user nova-compute[85141]:  {{(pid=85141) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 16 10:06:21 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-68e4d1b8-93eb-4f00-a57e-842b9d05649d None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=85141) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 16 10:06:21 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-68e4d1b8-93eb-4f00-a57e-842b9d05649d None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=85141) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 10:06:21 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-68e4d1b8-93eb-4f00-a57e-842b9d05649d None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=85141) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 10:06:21 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-68e4d1b8-93eb-4f00-a57e-842b9d05649d None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=85141) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 16 10:06:21 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-68e4d1b8-93eb-4f00-a57e-842b9d05649d None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=85141) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 10:06:21 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-68e4d1b8-93eb-4f00-a57e-842b9d05649d None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=85141) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 16 10:06:21 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-68e4d1b8-93eb-4f00-a57e-842b9d05649d None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=85141) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 10:06:21 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-68e4d1b8-93eb-4f00-a57e-842b9d05649d None None] Getting domain capabilities for mips via machine types: {None} {{(pid=85141) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 16 10:06:21 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-68e4d1b8-93eb-4f00-a57e-842b9d05649d None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=85141) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 10:06:21 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-68e4d1b8-93eb-4f00-a57e-842b9d05649d None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=85141) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 16 10:06:21 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-68e4d1b8-93eb-4f00-a57e-842b9d05649d None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=85141) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 10:06:21 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-68e4d1b8-93eb-4f00-a57e-842b9d05649d None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=85141) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 16 10:06:21 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-68e4d1b8-93eb-4f00-a57e-842b9d05649d None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=85141) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 10:06:21 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-68e4d1b8-93eb-4f00-a57e-842b9d05649d None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=85141) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 16 10:06:21 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-68e4d1b8-93eb-4f00-a57e-842b9d05649d None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=85141) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 10:06:21 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-68e4d1b8-93eb-4f00-a57e-842b9d05649d None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=85141) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 16 10:06:21 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-68e4d1b8-93eb-4f00-a57e-842b9d05649d None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=85141) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 10:06:21 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-68e4d1b8-93eb-4f00-a57e-842b9d05649d None None] Getting domain capabilities for ppc64 via machine types: {'powernv', 'pseries', None} {{(pid=85141) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 16 10:06:21 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-68e4d1b8-93eb-4f00-a57e-842b9d05649d None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=85141) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 10:06:21 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-68e4d1b8-93eb-4f00-a57e-842b9d05649d None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=85141) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 10:06:21 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-68e4d1b8-93eb-4f00-a57e-842b9d05649d None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=85141) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 10:06:21 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-68e4d1b8-93eb-4f00-a57e-842b9d05649d None None] Getting domain capabilities for ppc64le via machine types: {'pseries', 'powernv'} {{(pid=85141) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 16 10:06:21 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-68e4d1b8-93eb-4f00-a57e-842b9d05649d None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=85141) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 10:06:21 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-68e4d1b8-93eb-4f00-a57e-842b9d05649d None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=85141) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 10:06:21 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-68e4d1b8-93eb-4f00-a57e-842b9d05649d None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=85141) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 16 10:06:21 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-68e4d1b8-93eb-4f00-a57e-842b9d05649d None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=85141) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 10:06:21 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-68e4d1b8-93eb-4f00-a57e-842b9d05649d None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=85141) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 16 10:06:21 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-68e4d1b8-93eb-4f00-a57e-842b9d05649d None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=85141) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 10:06:21 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-68e4d1b8-93eb-4f00-a57e-842b9d05649d None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=85141) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 16 10:06:21 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-68e4d1b8-93eb-4f00-a57e-842b9d05649d None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=85141) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 10:06:21 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-68e4d1b8-93eb-4f00-a57e-842b9d05649d None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=85141) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 16 10:06:21 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-68e4d1b8-93eb-4f00-a57e-842b9d05649d None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=85141) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 10:06:21 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-68e4d1b8-93eb-4f00-a57e-842b9d05649d None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=85141) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 16 10:06:21 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-68e4d1b8-93eb-4f00-a57e-842b9d05649d None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=85141) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 10:06:21 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-68e4d1b8-93eb-4f00-a57e-842b9d05649d None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=85141) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 16 10:06:21 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-68e4d1b8-93eb-4f00-a57e-842b9d05649d None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=85141) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 10:06:21 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-68e4d1b8-93eb-4f00-a57e-842b9d05649d None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=85141) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 16 10:06:21 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-68e4d1b8-93eb-4f00-a57e-842b9d05649d None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=85141) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 10:06:21 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-68e4d1b8-93eb-4f00-a57e-842b9d05649d None None] Getting domain capabilities for x86_64 via machine types: {'ubuntu-q35', 'pc', 'q35', 'ubuntu'} {{(pid=85141) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 16 10:06:21 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-68e4d1b8-93eb-4f00-a57e-842b9d05649d None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Nov 16 10:06:21 user nova-compute[85141]: <domainCapabilities>
Nov 16 10:06:21 user nova-compute[85141]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 16 10:06:21 user nova-compute[85141]:   <domain>kvm</domain>
Nov 16 10:06:21 user nova-compute[85141]:   <machine>pc-q35-jammy</machine>
Nov 16 10:06:21 user nova-compute[85141]:   <arch>x86_64</arch>
Nov 16 10:06:21 user nova-compute[85141]:   <vcpu max='288'/>
Nov 16 10:06:21 user nova-compute[85141]:   <iothreads supported='yes'/>
Nov 16 10:06:21 user nova-compute[85141]:   <os supported='yes'>
Nov 16 10:06:21 user nova-compute[85141]:     <enum name='firmware'>
Nov 16 10:06:21 user nova-compute[85141]:       <value>efi</value>
Nov 16 10:06:21 user nova-compute[85141]:     </enum>
Nov 16 10:06:21 user nova-compute[85141]:     <loader supported='yes'>
Nov 16 10:06:21 user nova-compute[85141]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 16 10:06:21 user nova-compute[85141]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 16 10:06:21 user nova-compute[85141]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 16 10:06:21 user nova-compute[85141]:       <enum name='type'>
Nov 16 10:06:21 user nova-compute[85141]:         <value>rom</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>pflash</value>
Nov 16 10:06:21 user nova-compute[85141]:       </enum>
Nov 16 10:06:21 user nova-compute[85141]:       <enum name='readonly'>
Nov 16 10:06:21 user nova-compute[85141]:         <value>yes</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>no</value>
Nov 16 10:06:21 user nova-compute[85141]:       </enum>
Nov 16 10:06:21 user nova-compute[85141]:       <enum name='secure'>
Nov 16 10:06:21 user nova-compute[85141]:         <value>yes</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>no</value>
Nov 16 10:06:21 user nova-compute[85141]:       </enum>
Nov 16 10:06:21 user nova-compute[85141]:     </loader>
Nov 16 10:06:21 user nova-compute[85141]:   </os>
Nov 16 10:06:21 user nova-compute[85141]:   <cpu>
Nov 16 10:06:21 user nova-compute[85141]:     <mode name='host-passthrough' supported='yes'>
Nov 16 10:06:21 user nova-compute[85141]:       <enum name='hostPassthroughMigratable'>
Nov 16 10:06:21 user nova-compute[85141]:         <value>on</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>off</value>
Nov 16 10:06:21 user nova-compute[85141]:       </enum>
Nov 16 10:06:21 user nova-compute[85141]:     </mode>
Nov 16 10:06:21 user nova-compute[85141]:     <mode name='maximum' supported='yes'>
Nov 16 10:06:21 user nova-compute[85141]:       <enum name='maximumMigratable'>
Nov 16 10:06:21 user nova-compute[85141]:         <value>on</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>off</value>
Nov 16 10:06:21 user nova-compute[85141]:       </enum>
Nov 16 10:06:21 user nova-compute[85141]:     </mode>
Nov 16 10:06:21 user nova-compute[85141]:     <mode name='host-model' supported='yes'>
Nov 16 10:06:21 user nova-compute[85141]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 16 10:06:21 user nova-compute[85141]:       <vendor>Intel</vendor>
Nov 16 10:06:21 user nova-compute[85141]:       <feature policy='require' name='ss'/>
Nov 16 10:06:21 user nova-compute[85141]:       <feature policy='require' name='vmx'/>
Nov 16 10:06:21 user nova-compute[85141]:       <feature policy='require' name='pcid'/>
Nov 16 10:06:21 user nova-compute[85141]:       <feature policy='require' name='hypervisor'/>
Nov 16 10:06:21 user nova-compute[85141]:       <feature policy='require' name='arat'/>
Nov 16 10:06:21 user nova-compute[85141]:       <feature policy='require' name='tsc_adjust'/>
Nov 16 10:06:21 user nova-compute[85141]:       <feature policy='require' name='umip'/>
Nov 16 10:06:21 user nova-compute[85141]:       <feature policy='require' name='md-clear'/>
Nov 16 10:06:21 user nova-compute[85141]:       <feature policy='require' name='stibp'/>
Nov 16 10:06:21 user nova-compute[85141]:       <feature policy='require' name='arch-capabilities'/>
Nov 16 10:06:21 user nova-compute[85141]:       <feature policy='require' name='ssbd'/>
Nov 16 10:06:21 user nova-compute[85141]:       <feature policy='require' name='invtsc'/>
Nov 16 10:06:21 user nova-compute[85141]:       <feature policy='require' name='ibpb'/>
Nov 16 10:06:21 user nova-compute[85141]:       <feature policy='require' name='ibrs'/>
Nov 16 10:06:21 user nova-compute[85141]:       <feature policy='require' name='amd-stibp'/>
Nov 16 10:06:21 user nova-compute[85141]:       <feature policy='require' name='amd-ssbd'/>
Nov 16 10:06:21 user nova-compute[85141]:       <feature policy='require' name='rsba'/>
Nov 16 10:06:21 user nova-compute[85141]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 16 10:06:21 user nova-compute[85141]:       <feature policy='require' name='pschange-mc-no'/>
Nov 16 10:06:21 user nova-compute[85141]:       <feature policy='disable' name='erms'/>
Nov 16 10:06:21 user nova-compute[85141]:       <feature policy='disable' name='xsaveopt'/>
Nov 16 10:06:21 user nova-compute[85141]:     </mode>
Nov 16 10:06:21 user nova-compute[85141]:     <mode name='custom' supported='yes'>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>qemu64</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='yes'>qemu32</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>phenom</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='yes'>pentium3</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='yes'>pentium2</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='yes'>pentium</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>n270</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='yes'>kvm64</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='yes'>kvm32</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='yes'>coreduo</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='yes'>core2duo</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>athlon</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='yes'>Westmere-IBRS</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='yes'>Westmere</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Snowridge</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Skylake-Server</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Skylake-Client</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>SandyBridge</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='yes'>Penryn</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Opteron_G5</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Opteron_G4</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Opteron_G3</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Opteron_G2</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='yes'>Opteron_G1</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='yes'>Nehalem</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>IvyBridge</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Icelake-Server</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Haswell-noTSX</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Haswell-IBRS</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Haswell</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>EPYC-Rome</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>EPYC-Milan</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>EPYC-IBPB</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>EPYC</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Dhyana</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Cooperlake</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='yes'>Conroe</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Cascadelake-Server</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Broadwell-noTSX</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Broadwell-IBRS</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Broadwell</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='yes'>486</model>
Nov 16 10:06:21 user nova-compute[85141]:     </mode>
Nov 16 10:06:21 user nova-compute[85141]:   </cpu>
Nov 16 10:06:21 user nova-compute[85141]:   <memoryBacking supported='yes'>
Nov 16 10:06:21 user nova-compute[85141]:     <enum name='sourceType'>
Nov 16 10:06:21 user nova-compute[85141]:       <value>file</value>
Nov 16 10:06:21 user nova-compute[85141]:       <value>anonymous</value>
Nov 16 10:06:21 user nova-compute[85141]:       <value>memfd</value>
Nov 16 10:06:21 user nova-compute[85141]:     </enum>
Nov 16 10:06:21 user nova-compute[85141]:   </memoryBacking>
Nov 16 10:06:21 user nova-compute[85141]:   <devices>
Nov 16 10:06:21 user nova-compute[85141]:     <disk supported='yes'>
Nov 16 10:06:21 user nova-compute[85141]:       <enum name='diskDevice'>
Nov 16 10:06:21 user nova-compute[85141]:         <value>disk</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>cdrom</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>floppy</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>lun</value>
Nov 16 10:06:21 user nova-compute[85141]:       </enum>
Nov 16 10:06:21 user nova-compute[85141]:       <enum name='bus'>
Nov 16 10:06:21 user nova-compute[85141]:         <value>fdc</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>scsi</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>virtio</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>usb</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>sata</value>
Nov 16 10:06:21 user nova-compute[85141]:       </enum>
Nov 16 10:06:21 user nova-compute[85141]:       <enum name='model'>
Nov 16 10:06:21 user nova-compute[85141]:         <value>virtio</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>virtio-transitional</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>virtio-non-transitional</value>
Nov 16 10:06:21 user nova-compute[85141]:       </enum>
Nov 16 10:06:21 user nova-compute[85141]:     </disk>
Nov 16 10:06:21 user nova-compute[85141]:     <graphics supported='yes'>
Nov 16 10:06:21 user nova-compute[85141]:       <enum name='type'>
Nov 16 10:06:21 user nova-compute[85141]:         <value>sdl</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>vnc</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>spice</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>egl-headless</value>
Nov 16 10:06:21 user nova-compute[85141]:       </enum>
Nov 16 10:06:21 user nova-compute[85141]:     </graphics>
Nov 16 10:06:21 user nova-compute[85141]:     <video supported='yes'>
Nov 16 10:06:21 user nova-compute[85141]:       <enum name='modelType'>
Nov 16 10:06:21 user nova-compute[85141]:         <value>vga</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>cirrus</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>vmvga</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>qxl</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>virtio</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>none</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>bochs</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>ramfb</value>
Nov 16 10:06:21 user nova-compute[85141]:       </enum>
Nov 16 10:06:21 user nova-compute[85141]:     </video>
Nov 16 10:06:21 user nova-compute[85141]:     <hostdev supported='yes'>
Nov 16 10:06:21 user nova-compute[85141]:       <enum name='mode'>
Nov 16 10:06:21 user nova-compute[85141]:         <value>subsystem</value>
Nov 16 10:06:21 user nova-compute[85141]:       </enum>
Nov 16 10:06:21 user nova-compute[85141]:       <enum name='startupPolicy'>
Nov 16 10:06:21 user nova-compute[85141]:         <value>default</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>mandatory</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>requisite</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>optional</value>
Nov 16 10:06:21 user nova-compute[85141]:       </enum>
Nov 16 10:06:21 user nova-compute[85141]:       <enum name='subsysType'>
Nov 16 10:06:21 user nova-compute[85141]:         <value>usb</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>pci</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>scsi</value>
Nov 16 10:06:21 user nova-compute[85141]:       </enum>
Nov 16 10:06:21 user nova-compute[85141]:       <enum name='capsType'/>
Nov 16 10:06:21 user nova-compute[85141]:       <enum name='pciBackend'/>
Nov 16 10:06:21 user nova-compute[85141]:     </hostdev>
Nov 16 10:06:21 user nova-compute[85141]:     <rng supported='yes'>
Nov 16 10:06:21 user nova-compute[85141]:       <enum name='model'>
Nov 16 10:06:21 user nova-compute[85141]:         <value>virtio</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>virtio-transitional</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>virtio-non-transitional</value>
Nov 16 10:06:21 user nova-compute[85141]:       </enum>
Nov 16 10:06:21 user nova-compute[85141]:       <enum name='backendModel'>
Nov 16 10:06:21 user nova-compute[85141]:         <value>random</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>egd</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>builtin</value>
Nov 16 10:06:21 user nova-compute[85141]:       </enum>
Nov 16 10:06:21 user nova-compute[85141]:     </rng>
Nov 16 10:06:21 user nova-compute[85141]:     <filesystem supported='yes'>
Nov 16 10:06:21 user nova-compute[85141]:       <enum name='driverType'>
Nov 16 10:06:21 user nova-compute[85141]:         <value>path</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>handle</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>virtiofs</value>
Nov 16 10:06:21 user nova-compute[85141]:       </enum>
Nov 16 10:06:21 user nova-compute[85141]:     </filesystem>
Nov 16 10:06:21 user nova-compute[85141]:     <tpm supported='yes'>
Nov 16 10:06:21 user nova-compute[85141]:       <enum name='model'>
Nov 16 10:06:21 user nova-compute[85141]:         <value>tpm-tis</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>tpm-crb</value>
Nov 16 10:06:21 user nova-compute[85141]:       </enum>
Nov 16 10:06:21 user nova-compute[85141]:       <enum name='backendModel'>
Nov 16 10:06:21 user nova-compute[85141]:         <value>passthrough</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>emulator</value>
Nov 16 10:06:21 user nova-compute[85141]:       </enum>
Nov 16 10:06:21 user nova-compute[85141]:     </tpm>
Nov 16 10:06:21 user nova-compute[85141]:   </devices>
Nov 16 10:06:21 user nova-compute[85141]:   <features>
Nov 16 10:06:21 user nova-compute[85141]:     <gic supported='no'/>
Nov 16 10:06:21 user nova-compute[85141]:     <vmcoreinfo supported='yes'/>
Nov 16 10:06:21 user nova-compute[85141]:     <genid supported='yes'/>
Nov 16 10:06:21 user nova-compute[85141]:     <backingStoreInput supported='yes'/>
Nov 16 10:06:21 user nova-compute[85141]:     <backup supported='yes'/>
Nov 16 10:06:21 user nova-compute[85141]:     <sev supported='no'/>
Nov 16 10:06:21 user nova-compute[85141]:   </features>
Nov 16 10:06:21 user nova-compute[85141]: </domainCapabilities>
Nov 16 10:06:21 user nova-compute[85141]:  {{(pid=85141) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 16 10:06:21 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-68e4d1b8-93eb-4f00-a57e-842b9d05649d None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Nov 16 10:06:21 user nova-compute[85141]: <domainCapabilities>
Nov 16 10:06:21 user nova-compute[85141]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 16 10:06:21 user nova-compute[85141]:   <domain>kvm</domain>
Nov 16 10:06:21 user nova-compute[85141]:   <machine>pc-i440fx-6.2</machine>
Nov 16 10:06:21 user nova-compute[85141]:   <arch>x86_64</arch>
Nov 16 10:06:21 user nova-compute[85141]:   <vcpu max='255'/>
Nov 16 10:06:21 user nova-compute[85141]:   <iothreads supported='yes'/>
Nov 16 10:06:21 user nova-compute[85141]:   <os supported='yes'>
Nov 16 10:06:21 user nova-compute[85141]:     <enum name='firmware'>
Nov 16 10:06:21 user nova-compute[85141]:       <value>efi</value>
Nov 16 10:06:21 user nova-compute[85141]:     </enum>
Nov 16 10:06:21 user nova-compute[85141]:     <loader supported='yes'>
Nov 16 10:06:21 user nova-compute[85141]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 16 10:06:21 user nova-compute[85141]:       <enum name='type'>
Nov 16 10:06:21 user nova-compute[85141]:         <value>rom</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>pflash</value>
Nov 16 10:06:21 user nova-compute[85141]:       </enum>
Nov 16 10:06:21 user nova-compute[85141]:       <enum name='readonly'>
Nov 16 10:06:21 user nova-compute[85141]:         <value>yes</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>no</value>
Nov 16 10:06:21 user nova-compute[85141]:       </enum>
Nov 16 10:06:21 user nova-compute[85141]:       <enum name='secure'>
Nov 16 10:06:21 user nova-compute[85141]:         <value>no</value>
Nov 16 10:06:21 user nova-compute[85141]:       </enum>
Nov 16 10:06:21 user nova-compute[85141]:     </loader>
Nov 16 10:06:21 user nova-compute[85141]:   </os>
Nov 16 10:06:21 user nova-compute[85141]:   <cpu>
Nov 16 10:06:21 user nova-compute[85141]:     <mode name='host-passthrough' supported='yes'>
Nov 16 10:06:21 user nova-compute[85141]:       <enum name='hostPassthroughMigratable'>
Nov 16 10:06:21 user nova-compute[85141]:         <value>on</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>off</value>
Nov 16 10:06:21 user nova-compute[85141]:       </enum>
Nov 16 10:06:21 user nova-compute[85141]:     </mode>
Nov 16 10:06:21 user nova-compute[85141]:     <mode name='maximum' supported='yes'>
Nov 16 10:06:21 user nova-compute[85141]:       <enum name='maximumMigratable'>
Nov 16 10:06:21 user nova-compute[85141]:         <value>on</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>off</value>
Nov 16 10:06:21 user nova-compute[85141]:       </enum>
Nov 16 10:06:21 user nova-compute[85141]:     </mode>
Nov 16 10:06:21 user nova-compute[85141]:     <mode name='host-model' supported='yes'>
Nov 16 10:06:21 user nova-compute[85141]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 16 10:06:21 user nova-compute[85141]:       <vendor>Intel</vendor>
Nov 16 10:06:21 user nova-compute[85141]:       <feature policy='require' name='ss'/>
Nov 16 10:06:21 user nova-compute[85141]:       <feature policy='require' name='vmx'/>
Nov 16 10:06:21 user nova-compute[85141]:       <feature policy='require' name='pcid'/>
Nov 16 10:06:21 user nova-compute[85141]:       <feature policy='require' name='hypervisor'/>
Nov 16 10:06:21 user nova-compute[85141]:       <feature policy='require' name='arat'/>
Nov 16 10:06:21 user nova-compute[85141]:       <feature policy='require' name='tsc_adjust'/>
Nov 16 10:06:21 user nova-compute[85141]:       <feature policy='require' name='umip'/>
Nov 16 10:06:21 user nova-compute[85141]:       <feature policy='require' name='md-clear'/>
Nov 16 10:06:21 user nova-compute[85141]:       <feature policy='require' name='stibp'/>
Nov 16 10:06:21 user nova-compute[85141]:       <feature policy='require' name='arch-capabilities'/>
Nov 16 10:06:21 user nova-compute[85141]:       <feature policy='require' name='ssbd'/>
Nov 16 10:06:21 user nova-compute[85141]:       <feature policy='require' name='invtsc'/>
Nov 16 10:06:21 user nova-compute[85141]:       <feature policy='require' name='ibpb'/>
Nov 16 10:06:21 user nova-compute[85141]:       <feature policy='require' name='ibrs'/>
Nov 16 10:06:21 user nova-compute[85141]:       <feature policy='require' name='amd-stibp'/>
Nov 16 10:06:21 user nova-compute[85141]:       <feature policy='require' name='amd-ssbd'/>
Nov 16 10:06:21 user nova-compute[85141]:       <feature policy='require' name='rsba'/>
Nov 16 10:06:21 user nova-compute[85141]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 16 10:06:21 user nova-compute[85141]:       <feature policy='require' name='pschange-mc-no'/>
Nov 16 10:06:21 user nova-compute[85141]:       <feature policy='disable' name='erms'/>
Nov 16 10:06:21 user nova-compute[85141]:       <feature policy='disable' name='xsaveopt'/>
Nov 16 10:06:21 user nova-compute[85141]:     </mode>
Nov 16 10:06:21 user nova-compute[85141]:     <mode name='custom' supported='yes'>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>qemu64</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='yes'>qemu32</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>phenom</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='yes'>pentium3</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='yes'>pentium2</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='yes'>pentium</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>n270</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='yes'>kvm64</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='yes'>kvm32</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='yes'>coreduo</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='yes'>core2duo</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>athlon</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='yes'>Westmere-IBRS</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='yes'>Westmere</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Snowridge</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Skylake-Server</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Skylake-Client</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>SandyBridge</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='yes'>Penryn</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Opteron_G5</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Opteron_G4</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Opteron_G3</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Opteron_G2</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='yes'>Opteron_G1</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='yes'>Nehalem</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>IvyBridge</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Icelake-Server</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Haswell-noTSX</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Haswell-IBRS</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Haswell</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>EPYC-Rome</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>EPYC-Milan</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>EPYC-IBPB</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>EPYC</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Dhyana</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Cooperlake</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='yes'>Conroe</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Cascadelake-Server</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Broadwell-noTSX</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Broadwell-IBRS</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Broadwell</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='yes'>486</model>
Nov 16 10:06:21 user nova-compute[85141]:     </mode>
Nov 16 10:06:21 user nova-compute[85141]:   </cpu>
Nov 16 10:06:21 user nova-compute[85141]:   <memoryBacking supported='yes'>
Nov 16 10:06:21 user nova-compute[85141]:     <enum name='sourceType'>
Nov 16 10:06:21 user nova-compute[85141]:       <value>file</value>
Nov 16 10:06:21 user nova-compute[85141]:       <value>anonymous</value>
Nov 16 10:06:21 user nova-compute[85141]:       <value>memfd</value>
Nov 16 10:06:21 user nova-compute[85141]:     </enum>
Nov 16 10:06:21 user nova-compute[85141]:   </memoryBacking>
Nov 16 10:06:21 user nova-compute[85141]:   <devices>
Nov 16 10:06:21 user nova-compute[85141]:     <disk supported='yes'>
Nov 16 10:06:21 user nova-compute[85141]:       <enum name='diskDevice'>
Nov 16 10:06:21 user nova-compute[85141]:         <value>disk</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>cdrom</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>floppy</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>lun</value>
Nov 16 10:06:21 user nova-compute[85141]:       </enum>
Nov 16 10:06:21 user nova-compute[85141]:       <enum name='bus'>
Nov 16 10:06:21 user nova-compute[85141]:         <value>ide</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>fdc</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>scsi</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>virtio</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>usb</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>sata</value>
Nov 16 10:06:21 user nova-compute[85141]:       </enum>
Nov 16 10:06:21 user nova-compute[85141]:       <enum name='model'>
Nov 16 10:06:21 user nova-compute[85141]:         <value>virtio</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>virtio-transitional</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>virtio-non-transitional</value>
Nov 16 10:06:21 user nova-compute[85141]:       </enum>
Nov 16 10:06:21 user nova-compute[85141]:     </disk>
Nov 16 10:06:21 user nova-compute[85141]:     <graphics supported='yes'>
Nov 16 10:06:21 user nova-compute[85141]:       <enum name='type'>
Nov 16 10:06:21 user nova-compute[85141]:         <value>sdl</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>vnc</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>spice</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>egl-headless</value>
Nov 16 10:06:21 user nova-compute[85141]:       </enum>
Nov 16 10:06:21 user nova-compute[85141]:     </graphics>
Nov 16 10:06:21 user nova-compute[85141]:     <video supported='yes'>
Nov 16 10:06:21 user nova-compute[85141]:       <enum name='modelType'>
Nov 16 10:06:21 user nova-compute[85141]:         <value>vga</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>cirrus</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>vmvga</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>qxl</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>virtio</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>none</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>bochs</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>ramfb</value>
Nov 16 10:06:21 user nova-compute[85141]:       </enum>
Nov 16 10:06:21 user nova-compute[85141]:     </video>
Nov 16 10:06:21 user nova-compute[85141]:     <hostdev supported='yes'>
Nov 16 10:06:21 user nova-compute[85141]:       <enum name='mode'>
Nov 16 10:06:21 user nova-compute[85141]:         <value>subsystem</value>
Nov 16 10:06:21 user nova-compute[85141]:       </enum>
Nov 16 10:06:21 user nova-compute[85141]:       <enum name='startupPolicy'>
Nov 16 10:06:21 user nova-compute[85141]:         <value>default</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>mandatory</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>requisite</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>optional</value>
Nov 16 10:06:21 user nova-compute[85141]:       </enum>
Nov 16 10:06:21 user nova-compute[85141]:       <enum name='subsysType'>
Nov 16 10:06:21 user nova-compute[85141]:         <value>usb</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>pci</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>scsi</value>
Nov 16 10:06:21 user nova-compute[85141]:       </enum>
Nov 16 10:06:21 user nova-compute[85141]:       <enum name='capsType'/>
Nov 16 10:06:21 user nova-compute[85141]:       <enum name='pciBackend'/>
Nov 16 10:06:21 user nova-compute[85141]:     </hostdev>
Nov 16 10:06:21 user nova-compute[85141]:     <rng supported='yes'>
Nov 16 10:06:21 user nova-compute[85141]:       <enum name='model'>
Nov 16 10:06:21 user nova-compute[85141]:         <value>virtio</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>virtio-transitional</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>virtio-non-transitional</value>
Nov 16 10:06:21 user nova-compute[85141]:       </enum>
Nov 16 10:06:21 user nova-compute[85141]:       <enum name='backendModel'>
Nov 16 10:06:21 user nova-compute[85141]:         <value>random</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>egd</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>builtin</value>
Nov 16 10:06:21 user nova-compute[85141]:       </enum>
Nov 16 10:06:21 user nova-compute[85141]:     </rng>
Nov 16 10:06:21 user nova-compute[85141]:     <filesystem supported='yes'>
Nov 16 10:06:21 user nova-compute[85141]:       <enum name='driverType'>
Nov 16 10:06:21 user nova-compute[85141]:         <value>path</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>handle</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>virtiofs</value>
Nov 16 10:06:21 user nova-compute[85141]:       </enum>
Nov 16 10:06:21 user nova-compute[85141]:     </filesystem>
Nov 16 10:06:21 user nova-compute[85141]:     <tpm supported='yes'>
Nov 16 10:06:21 user nova-compute[85141]:       <enum name='model'>
Nov 16 10:06:21 user nova-compute[85141]:         <value>tpm-tis</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>tpm-crb</value>
Nov 16 10:06:21 user nova-compute[85141]:       </enum>
Nov 16 10:06:21 user nova-compute[85141]:       <enum name='backendModel'>
Nov 16 10:06:21 user nova-compute[85141]:         <value>passthrough</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>emulator</value>
Nov 16 10:06:21 user nova-compute[85141]:       </enum>
Nov 16 10:06:21 user nova-compute[85141]:     </tpm>
Nov 16 10:06:21 user nova-compute[85141]:   </devices>
Nov 16 10:06:21 user nova-compute[85141]:   <features>
Nov 16 10:06:21 user nova-compute[85141]:     <gic supported='no'/>
Nov 16 10:06:21 user nova-compute[85141]:     <vmcoreinfo supported='yes'/>
Nov 16 10:06:21 user nova-compute[85141]:     <genid supported='yes'/>
Nov 16 10:06:21 user nova-compute[85141]:     <backingStoreInput supported='yes'/>
Nov 16 10:06:21 user nova-compute[85141]:     <backup supported='yes'/>
Nov 16 10:06:21 user nova-compute[85141]:     <sev supported='no'/>
Nov 16 10:06:21 user nova-compute[85141]:   </features>
Nov 16 10:06:21 user nova-compute[85141]: </domainCapabilities>
Nov 16 10:06:21 user nova-compute[85141]:  {{(pid=85141) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 16 10:06:21 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-68e4d1b8-93eb-4f00-a57e-842b9d05649d None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Nov 16 10:06:21 user nova-compute[85141]: <domainCapabilities>
Nov 16 10:06:21 user nova-compute[85141]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 16 10:06:21 user nova-compute[85141]:   <domain>kvm</domain>
Nov 16 10:06:21 user nova-compute[85141]:   <machine>pc-q35-6.2</machine>
Nov 16 10:06:21 user nova-compute[85141]:   <arch>x86_64</arch>
Nov 16 10:06:21 user nova-compute[85141]:   <vcpu max='288'/>
Nov 16 10:06:21 user nova-compute[85141]:   <iothreads supported='yes'/>
Nov 16 10:06:21 user nova-compute[85141]:   <os supported='yes'>
Nov 16 10:06:21 user nova-compute[85141]:     <enum name='firmware'>
Nov 16 10:06:21 user nova-compute[85141]:       <value>efi</value>
Nov 16 10:06:21 user nova-compute[85141]:     </enum>
Nov 16 10:06:21 user nova-compute[85141]:     <loader supported='yes'>
Nov 16 10:06:21 user nova-compute[85141]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 16 10:06:21 user nova-compute[85141]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 16 10:06:21 user nova-compute[85141]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 16 10:06:21 user nova-compute[85141]:       <enum name='type'>
Nov 16 10:06:21 user nova-compute[85141]:         <value>rom</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>pflash</value>
Nov 16 10:06:21 user nova-compute[85141]:       </enum>
Nov 16 10:06:21 user nova-compute[85141]:       <enum name='readonly'>
Nov 16 10:06:21 user nova-compute[85141]:         <value>yes</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>no</value>
Nov 16 10:06:21 user nova-compute[85141]:       </enum>
Nov 16 10:06:21 user nova-compute[85141]:       <enum name='secure'>
Nov 16 10:06:21 user nova-compute[85141]:         <value>yes</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>no</value>
Nov 16 10:06:21 user nova-compute[85141]:       </enum>
Nov 16 10:06:21 user nova-compute[85141]:     </loader>
Nov 16 10:06:21 user nova-compute[85141]:   </os>
Nov 16 10:06:21 user nova-compute[85141]:   <cpu>
Nov 16 10:06:21 user nova-compute[85141]:     <mode name='host-passthrough' supported='yes'>
Nov 16 10:06:21 user nova-compute[85141]:       <enum name='hostPassthroughMigratable'>
Nov 16 10:06:21 user nova-compute[85141]:         <value>on</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>off</value>
Nov 16 10:06:21 user nova-compute[85141]:       </enum>
Nov 16 10:06:21 user nova-compute[85141]:     </mode>
Nov 16 10:06:21 user nova-compute[85141]:     <mode name='maximum' supported='yes'>
Nov 16 10:06:21 user nova-compute[85141]:       <enum name='maximumMigratable'>
Nov 16 10:06:21 user nova-compute[85141]:         <value>on</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>off</value>
Nov 16 10:06:21 user nova-compute[85141]:       </enum>
Nov 16 10:06:21 user nova-compute[85141]:     </mode>
Nov 16 10:06:21 user nova-compute[85141]:     <mode name='host-model' supported='yes'>
Nov 16 10:06:21 user nova-compute[85141]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 16 10:06:21 user nova-compute[85141]:       <vendor>Intel</vendor>
Nov 16 10:06:21 user nova-compute[85141]:       <feature policy='require' name='ss'/>
Nov 16 10:06:21 user nova-compute[85141]:       <feature policy='require' name='vmx'/>
Nov 16 10:06:21 user nova-compute[85141]:       <feature policy='require' name='pcid'/>
Nov 16 10:06:21 user nova-compute[85141]:       <feature policy='require' name='hypervisor'/>
Nov 16 10:06:21 user nova-compute[85141]:       <feature policy='require' name='arat'/>
Nov 16 10:06:21 user nova-compute[85141]:       <feature policy='require' name='tsc_adjust'/>
Nov 16 10:06:21 user nova-compute[85141]:       <feature policy='require' name='umip'/>
Nov 16 10:06:21 user nova-compute[85141]:       <feature policy='require' name='md-clear'/>
Nov 16 10:06:21 user nova-compute[85141]:       <feature policy='require' name='stibp'/>
Nov 16 10:06:21 user nova-compute[85141]:       <feature policy='require' name='arch-capabilities'/>
Nov 16 10:06:21 user nova-compute[85141]:       <feature policy='require' name='ssbd'/>
Nov 16 10:06:21 user nova-compute[85141]:       <feature policy='require' name='invtsc'/>
Nov 16 10:06:21 user nova-compute[85141]:       <feature policy='require' name='ibpb'/>
Nov 16 10:06:21 user nova-compute[85141]:       <feature policy='require' name='ibrs'/>
Nov 16 10:06:21 user nova-compute[85141]:       <feature policy='require' name='amd-stibp'/>
Nov 16 10:06:21 user nova-compute[85141]:       <feature policy='require' name='amd-ssbd'/>
Nov 16 10:06:21 user nova-compute[85141]:       <feature policy='require' name='rsba'/>
Nov 16 10:06:21 user nova-compute[85141]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 16 10:06:21 user nova-compute[85141]:       <feature policy='require' name='pschange-mc-no'/>
Nov 16 10:06:21 user nova-compute[85141]:       <feature policy='disable' name='erms'/>
Nov 16 10:06:21 user nova-compute[85141]:       <feature policy='disable' name='xsaveopt'/>
Nov 16 10:06:21 user nova-compute[85141]:     </mode>
Nov 16 10:06:21 user nova-compute[85141]:     <mode name='custom' supported='yes'>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>qemu64</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='yes'>qemu32</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>phenom</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='yes'>pentium3</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='yes'>pentium2</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='yes'>pentium</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>n270</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='yes'>kvm64</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='yes'>kvm32</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='yes'>coreduo</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='yes'>core2duo</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>athlon</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='yes'>Westmere-IBRS</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='yes'>Westmere</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Snowridge</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Skylake-Server</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Skylake-Client</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>SandyBridge</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='yes'>Penryn</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Opteron_G5</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Opteron_G4</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Opteron_G3</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Opteron_G2</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='yes'>Opteron_G1</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='yes'>Nehalem</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>IvyBridge</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Icelake-Server</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Haswell-noTSX</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Haswell-IBRS</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Haswell</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>EPYC-Rome</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>EPYC-Milan</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>EPYC-IBPB</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>EPYC</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Dhyana</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Cooperlake</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='yes'>Conroe</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Cascadelake-Server</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Broadwell-noTSX</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Broadwell-IBRS</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Broadwell</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='yes'>486</model>
Nov 16 10:06:21 user nova-compute[85141]:     </mode>
Nov 16 10:06:21 user nova-compute[85141]:   </cpu>
Nov 16 10:06:21 user nova-compute[85141]:   <memoryBacking supported='yes'>
Nov 16 10:06:21 user nova-compute[85141]:     <enum name='sourceType'>
Nov 16 10:06:21 user nova-compute[85141]:       <value>file</value>
Nov 16 10:06:21 user nova-compute[85141]:       <value>anonymous</value>
Nov 16 10:06:21 user nova-compute[85141]:       <value>memfd</value>
Nov 16 10:06:21 user nova-compute[85141]:     </enum>
Nov 16 10:06:21 user nova-compute[85141]:   </memoryBacking>
Nov 16 10:06:21 user nova-compute[85141]:   <devices>
Nov 16 10:06:21 user nova-compute[85141]:     <disk supported='yes'>
Nov 16 10:06:21 user nova-compute[85141]:       <enum name='diskDevice'>
Nov 16 10:06:21 user nova-compute[85141]:         <value>disk</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>cdrom</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>floppy</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>lun</value>
Nov 16 10:06:21 user nova-compute[85141]:       </enum>
Nov 16 10:06:21 user nova-compute[85141]:       <enum name='bus'>
Nov 16 10:06:21 user nova-compute[85141]:         <value>fdc</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>scsi</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>virtio</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>usb</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>sata</value>
Nov 16 10:06:21 user nova-compute[85141]:       </enum>
Nov 16 10:06:21 user nova-compute[85141]:       <enum name='model'>
Nov 16 10:06:21 user nova-compute[85141]:         <value>virtio</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>virtio-transitional</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>virtio-non-transitional</value>
Nov 16 10:06:21 user nova-compute[85141]:       </enum>
Nov 16 10:06:21 user nova-compute[85141]:     </disk>
Nov 16 10:06:21 user nova-compute[85141]:     <graphics supported='yes'>
Nov 16 10:06:21 user nova-compute[85141]:       <enum name='type'>
Nov 16 10:06:21 user nova-compute[85141]:         <value>sdl</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>vnc</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>spice</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>egl-headless</value>
Nov 16 10:06:21 user nova-compute[85141]:       </enum>
Nov 16 10:06:21 user nova-compute[85141]:     </graphics>
Nov 16 10:06:21 user nova-compute[85141]:     <video supported='yes'>
Nov 16 10:06:21 user nova-compute[85141]:       <enum name='modelType'>
Nov 16 10:06:21 user nova-compute[85141]:         <value>vga</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>cirrus</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>vmvga</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>qxl</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>virtio</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>none</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>bochs</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>ramfb</value>
Nov 16 10:06:21 user nova-compute[85141]:       </enum>
Nov 16 10:06:21 user nova-compute[85141]:     </video>
Nov 16 10:06:21 user nova-compute[85141]:     <hostdev supported='yes'>
Nov 16 10:06:21 user nova-compute[85141]:       <enum name='mode'>
Nov 16 10:06:21 user nova-compute[85141]:         <value>subsystem</value>
Nov 16 10:06:21 user nova-compute[85141]:       </enum>
Nov 16 10:06:21 user nova-compute[85141]:       <enum name='startupPolicy'>
Nov 16 10:06:21 user nova-compute[85141]:         <value>default</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>mandatory</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>requisite</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>optional</value>
Nov 16 10:06:21 user nova-compute[85141]:       </enum>
Nov 16 10:06:21 user nova-compute[85141]:       <enum name='subsysType'>
Nov 16 10:06:21 user nova-compute[85141]:         <value>usb</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>pci</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>scsi</value>
Nov 16 10:06:21 user nova-compute[85141]:       </enum>
Nov 16 10:06:21 user nova-compute[85141]:       <enum name='capsType'/>
Nov 16 10:06:21 user nova-compute[85141]:       <enum name='pciBackend'/>
Nov 16 10:06:21 user nova-compute[85141]:     </hostdev>
Nov 16 10:06:21 user nova-compute[85141]:     <rng supported='yes'>
Nov 16 10:06:21 user nova-compute[85141]:       <enum name='model'>
Nov 16 10:06:21 user nova-compute[85141]:         <value>virtio</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>virtio-transitional</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>virtio-non-transitional</value>
Nov 16 10:06:21 user nova-compute[85141]:       </enum>
Nov 16 10:06:21 user nova-compute[85141]:       <enum name='backendModel'>
Nov 16 10:06:21 user nova-compute[85141]:         <value>random</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>egd</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>builtin</value>
Nov 16 10:06:21 user nova-compute[85141]:       </enum>
Nov 16 10:06:21 user nova-compute[85141]:     </rng>
Nov 16 10:06:21 user nova-compute[85141]:     <filesystem supported='yes'>
Nov 16 10:06:21 user nova-compute[85141]:       <enum name='driverType'>
Nov 16 10:06:21 user nova-compute[85141]:         <value>path</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>handle</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>virtiofs</value>
Nov 16 10:06:21 user nova-compute[85141]:       </enum>
Nov 16 10:06:21 user nova-compute[85141]:     </filesystem>
Nov 16 10:06:21 user nova-compute[85141]:     <tpm supported='yes'>
Nov 16 10:06:21 user nova-compute[85141]:       <enum name='model'>
Nov 16 10:06:21 user nova-compute[85141]:         <value>tpm-tis</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>tpm-crb</value>
Nov 16 10:06:21 user nova-compute[85141]:       </enum>
Nov 16 10:06:21 user nova-compute[85141]:       <enum name='backendModel'>
Nov 16 10:06:21 user nova-compute[85141]:         <value>passthrough</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>emulator</value>
Nov 16 10:06:21 user nova-compute[85141]:       </enum>
Nov 16 10:06:21 user nova-compute[85141]:     </tpm>
Nov 16 10:06:21 user nova-compute[85141]:   </devices>
Nov 16 10:06:21 user nova-compute[85141]:   <features>
Nov 16 10:06:21 user nova-compute[85141]:     <gic supported='no'/>
Nov 16 10:06:21 user nova-compute[85141]:     <vmcoreinfo supported='yes'/>
Nov 16 10:06:21 user nova-compute[85141]:     <genid supported='yes'/>
Nov 16 10:06:21 user nova-compute[85141]:     <backingStoreInput supported='yes'/>
Nov 16 10:06:21 user nova-compute[85141]:     <backup supported='yes'/>
Nov 16 10:06:21 user nova-compute[85141]:     <sev supported='no'/>
Nov 16 10:06:21 user nova-compute[85141]:   </features>
Nov 16 10:06:21 user nova-compute[85141]: </domainCapabilities>
Nov 16 10:06:21 user nova-compute[85141]:  {{(pid=85141) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 16 10:06:21 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-68e4d1b8-93eb-4f00-a57e-842b9d05649d None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Nov 16 10:06:21 user nova-compute[85141]: <domainCapabilities>
Nov 16 10:06:21 user nova-compute[85141]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 16 10:06:21 user nova-compute[85141]:   <domain>kvm</domain>
Nov 16 10:06:21 user nova-compute[85141]:   <machine>pc-i440fx-jammy</machine>
Nov 16 10:06:21 user nova-compute[85141]:   <arch>x86_64</arch>
Nov 16 10:06:21 user nova-compute[85141]:   <vcpu max='255'/>
Nov 16 10:06:21 user nova-compute[85141]:   <iothreads supported='yes'/>
Nov 16 10:06:21 user nova-compute[85141]:   <os supported='yes'>
Nov 16 10:06:21 user nova-compute[85141]:     <enum name='firmware'>
Nov 16 10:06:21 user nova-compute[85141]:       <value>efi</value>
Nov 16 10:06:21 user nova-compute[85141]:     </enum>
Nov 16 10:06:21 user nova-compute[85141]:     <loader supported='yes'>
Nov 16 10:06:21 user nova-compute[85141]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 16 10:06:21 user nova-compute[85141]:       <enum name='type'>
Nov 16 10:06:21 user nova-compute[85141]:         <value>rom</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>pflash</value>
Nov 16 10:06:21 user nova-compute[85141]:       </enum>
Nov 16 10:06:21 user nova-compute[85141]:       <enum name='readonly'>
Nov 16 10:06:21 user nova-compute[85141]:         <value>yes</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>no</value>
Nov 16 10:06:21 user nova-compute[85141]:       </enum>
Nov 16 10:06:21 user nova-compute[85141]:       <enum name='secure'>
Nov 16 10:06:21 user nova-compute[85141]:         <value>no</value>
Nov 16 10:06:21 user nova-compute[85141]:       </enum>
Nov 16 10:06:21 user nova-compute[85141]:     </loader>
Nov 16 10:06:21 user nova-compute[85141]:   </os>
Nov 16 10:06:21 user nova-compute[85141]:   <cpu>
Nov 16 10:06:21 user nova-compute[85141]:     <mode name='host-passthrough' supported='yes'>
Nov 16 10:06:21 user nova-compute[85141]:       <enum name='hostPassthroughMigratable'>
Nov 16 10:06:21 user nova-compute[85141]:         <value>on</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>off</value>
Nov 16 10:06:21 user nova-compute[85141]:       </enum>
Nov 16 10:06:21 user nova-compute[85141]:     </mode>
Nov 16 10:06:21 user nova-compute[85141]:     <mode name='maximum' supported='yes'>
Nov 16 10:06:21 user nova-compute[85141]:       <enum name='maximumMigratable'>
Nov 16 10:06:21 user nova-compute[85141]:         <value>on</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>off</value>
Nov 16 10:06:21 user nova-compute[85141]:       </enum>
Nov 16 10:06:21 user nova-compute[85141]:     </mode>
Nov 16 10:06:21 user nova-compute[85141]:     <mode name='host-model' supported='yes'>
Nov 16 10:06:21 user nova-compute[85141]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 16 10:06:21 user nova-compute[85141]:       <vendor>Intel</vendor>
Nov 16 10:06:21 user nova-compute[85141]:       <feature policy='require' name='ss'/>
Nov 16 10:06:21 user nova-compute[85141]:       <feature policy='require' name='vmx'/>
Nov 16 10:06:21 user nova-compute[85141]:       <feature policy='require' name='pcid'/>
Nov 16 10:06:21 user nova-compute[85141]:       <feature policy='require' name='hypervisor'/>
Nov 16 10:06:21 user nova-compute[85141]:       <feature policy='require' name='arat'/>
Nov 16 10:06:21 user nova-compute[85141]:       <feature policy='require' name='tsc_adjust'/>
Nov 16 10:06:21 user nova-compute[85141]:       <feature policy='require' name='umip'/>
Nov 16 10:06:21 user nova-compute[85141]:       <feature policy='require' name='md-clear'/>
Nov 16 10:06:21 user nova-compute[85141]:       <feature policy='require' name='stibp'/>
Nov 16 10:06:21 user nova-compute[85141]:       <feature policy='require' name='arch-capabilities'/>
Nov 16 10:06:21 user nova-compute[85141]:       <feature policy='require' name='ssbd'/>
Nov 16 10:06:21 user nova-compute[85141]:       <feature policy='require' name='invtsc'/>
Nov 16 10:06:21 user nova-compute[85141]:       <feature policy='require' name='ibpb'/>
Nov 16 10:06:21 user nova-compute[85141]:       <feature policy='require' name='ibrs'/>
Nov 16 10:06:21 user nova-compute[85141]:       <feature policy='require' name='amd-stibp'/>
Nov 16 10:06:21 user nova-compute[85141]:       <feature policy='require' name='amd-ssbd'/>
Nov 16 10:06:21 user nova-compute[85141]:       <feature policy='require' name='rsba'/>
Nov 16 10:06:21 user nova-compute[85141]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 16 10:06:21 user nova-compute[85141]:       <feature policy='require' name='pschange-mc-no'/>
Nov 16 10:06:21 user nova-compute[85141]:       <feature policy='disable' name='erms'/>
Nov 16 10:06:21 user nova-compute[85141]:       <feature policy='disable' name='xsaveopt'/>
Nov 16 10:06:21 user nova-compute[85141]:     </mode>
Nov 16 10:06:21 user nova-compute[85141]:     <mode name='custom' supported='yes'>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>qemu64</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='yes'>qemu32</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>phenom</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='yes'>pentium3</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='yes'>pentium2</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='yes'>pentium</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>n270</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='yes'>kvm64</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='yes'>kvm32</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='yes'>coreduo</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='yes'>core2duo</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>athlon</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='yes'>Westmere-IBRS</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='yes'>Westmere</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Snowridge</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Skylake-Server</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Skylake-Client</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>SandyBridge</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='yes'>Penryn</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Opteron_G5</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Opteron_G4</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Opteron_G3</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Opteron_G2</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='yes'>Opteron_G1</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='yes'>Nehalem</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>IvyBridge</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Icelake-Server</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Haswell-noTSX</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Haswell-IBRS</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Haswell</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>EPYC-Rome</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>EPYC-Milan</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>EPYC-IBPB</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>EPYC</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Dhyana</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Cooperlake</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='yes'>Conroe</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Cascadelake-Server</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Broadwell-noTSX</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Broadwell-IBRS</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='no'>Broadwell</model>
Nov 16 10:06:21 user nova-compute[85141]:       <model usable='yes'>486</model>
Nov 16 10:06:21 user nova-compute[85141]:     </mode>
Nov 16 10:06:21 user nova-compute[85141]:   </cpu>
Nov 16 10:06:21 user nova-compute[85141]:   <memoryBacking supported='yes'>
Nov 16 10:06:21 user nova-compute[85141]:     <enum name='sourceType'>
Nov 16 10:06:21 user nova-compute[85141]:       <value>file</value>
Nov 16 10:06:21 user nova-compute[85141]:       <value>anonymous</value>
Nov 16 10:06:21 user nova-compute[85141]:       <value>memfd</value>
Nov 16 10:06:21 user nova-compute[85141]:     </enum>
Nov 16 10:06:21 user nova-compute[85141]:   </memoryBacking>
Nov 16 10:06:21 user nova-compute[85141]:   <devices>
Nov 16 10:06:21 user nova-compute[85141]:     <disk supported='yes'>
Nov 16 10:06:21 user nova-compute[85141]:       <enum name='diskDevice'>
Nov 16 10:06:21 user nova-compute[85141]:         <value>disk</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>cdrom</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>floppy</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>lun</value>
Nov 16 10:06:21 user nova-compute[85141]:       </enum>
Nov 16 10:06:21 user nova-compute[85141]:       <enum name='bus'>
Nov 16 10:06:21 user nova-compute[85141]:         <value>ide</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>fdc</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>scsi</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>virtio</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>usb</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>sata</value>
Nov 16 10:06:21 user nova-compute[85141]:       </enum>
Nov 16 10:06:21 user nova-compute[85141]:       <enum name='model'>
Nov 16 10:06:21 user nova-compute[85141]:         <value>virtio</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>virtio-transitional</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>virtio-non-transitional</value>
Nov 16 10:06:21 user nova-compute[85141]:       </enum>
Nov 16 10:06:21 user nova-compute[85141]:     </disk>
Nov 16 10:06:21 user nova-compute[85141]:     <graphics supported='yes'>
Nov 16 10:06:21 user nova-compute[85141]:       <enum name='type'>
Nov 16 10:06:21 user nova-compute[85141]:         <value>sdl</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>vnc</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>spice</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>egl-headless</value>
Nov 16 10:06:21 user nova-compute[85141]:       </enum>
Nov 16 10:06:21 user nova-compute[85141]:     </graphics>
Nov 16 10:06:21 user nova-compute[85141]:     <video supported='yes'>
Nov 16 10:06:21 user nova-compute[85141]:       <enum name='modelType'>
Nov 16 10:06:21 user nova-compute[85141]:         <value>vga</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>cirrus</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>vmvga</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>qxl</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>virtio</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>none</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>bochs</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>ramfb</value>
Nov 16 10:06:21 user nova-compute[85141]:       </enum>
Nov 16 10:06:21 user nova-compute[85141]:     </video>
Nov 16 10:06:21 user nova-compute[85141]:     <hostdev supported='yes'>
Nov 16 10:06:21 user nova-compute[85141]:       <enum name='mode'>
Nov 16 10:06:21 user nova-compute[85141]:         <value>subsystem</value>
Nov 16 10:06:21 user nova-compute[85141]:       </enum>
Nov 16 10:06:21 user nova-compute[85141]:       <enum name='startupPolicy'>
Nov 16 10:06:21 user nova-compute[85141]:         <value>default</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>mandatory</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>requisite</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>optional</value>
Nov 16 10:06:21 user nova-compute[85141]:       </enum>
Nov 16 10:06:21 user nova-compute[85141]:       <enum name='subsysType'>
Nov 16 10:06:21 user nova-compute[85141]:         <value>usb</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>pci</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>scsi</value>
Nov 16 10:06:21 user nova-compute[85141]:       </enum>
Nov 16 10:06:21 user nova-compute[85141]:       <enum name='capsType'/>
Nov 16 10:06:21 user nova-compute[85141]:       <enum name='pciBackend'/>
Nov 16 10:06:21 user nova-compute[85141]:     </hostdev>
Nov 16 10:06:21 user nova-compute[85141]:     <rng supported='yes'>
Nov 16 10:06:21 user nova-compute[85141]:       <enum name='model'>
Nov 16 10:06:21 user nova-compute[85141]:         <value>virtio</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>virtio-transitional</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>virtio-non-transitional</value>
Nov 16 10:06:21 user nova-compute[85141]:       </enum>
Nov 16 10:06:21 user nova-compute[85141]:       <enum name='backendModel'>
Nov 16 10:06:21 user nova-compute[85141]:         <value>random</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>egd</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>builtin</value>
Nov 16 10:06:21 user nova-compute[85141]:       </enum>
Nov 16 10:06:21 user nova-compute[85141]:     </rng>
Nov 16 10:06:21 user nova-compute[85141]:     <filesystem supported='yes'>
Nov 16 10:06:21 user nova-compute[85141]:       <enum name='driverType'>
Nov 16 10:06:21 user nova-compute[85141]:         <value>path</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>handle</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>virtiofs</value>
Nov 16 10:06:21 user nova-compute[85141]:       </enum>
Nov 16 10:06:21 user nova-compute[85141]:     </filesystem>
Nov 16 10:06:21 user nova-compute[85141]:     <tpm supported='yes'>
Nov 16 10:06:21 user nova-compute[85141]:       <enum name='model'>
Nov 16 10:06:21 user nova-compute[85141]:         <value>tpm-tis</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>tpm-crb</value>
Nov 16 10:06:21 user nova-compute[85141]:       </enum>
Nov 16 10:06:21 user nova-compute[85141]:       <enum name='backendModel'>
Nov 16 10:06:21 user nova-compute[85141]:         <value>passthrough</value>
Nov 16 10:06:21 user nova-compute[85141]:         <value>emulator</value>
Nov 16 10:06:21 user nova-compute[85141]:       </enum>
Nov 16 10:06:21 user nova-compute[85141]:     </tpm>
Nov 16 10:06:21 user nova-compute[85141]:   </devices>
Nov 16 10:06:21 user nova-compute[85141]:   <features>
Nov 16 10:06:21 user nova-compute[85141]:     <gic supported='no'/>
Nov 16 10:06:21 user nova-compute[85141]:     <vmcoreinfo supported='yes'/>
Nov 16 10:06:21 user nova-compute[85141]:     <genid supported='yes'/>
Nov 16 10:06:21 user nova-compute[85141]:     <backingStoreInput supported='yes'/>
Nov 16 10:06:21 user nova-compute[85141]:     <backup supported='yes'/>
Nov 16 10:06:21 user nova-compute[85141]:     <sev supported='no'/>
Nov 16 10:06:21 user nova-compute[85141]:   </features>
Nov 16 10:06:21 user nova-compute[85141]: </domainCapabilities>
Nov 16 10:06:21 user nova-compute[85141]:  {{(pid=85141) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 16 10:06:21 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-68e4d1b8-93eb-4f00-a57e-842b9d05649d None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=85141) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 16 10:06:21 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-68e4d1b8-93eb-4f00-a57e-842b9d05649d None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=85141) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 10:06:21 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-68e4d1b8-93eb-4f00-a57e-842b9d05649d None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=85141) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 16 10:06:21 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-68e4d1b8-93eb-4f00-a57e-842b9d05649d None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=85141) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 10:06:21 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-68e4d1b8-93eb-4f00-a57e-842b9d05649d None None] Checking secure boot support for host arch (x86_64) {{(pid=85141) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Nov 16 10:06:21 user nova-compute[85141]: INFO nova.virt.libvirt.host [None req-68e4d1b8-93eb-4f00-a57e-842b9d05649d None None] Secure Boot support detected
Nov 16 10:06:21 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-68e4d1b8-93eb-4f00-a57e-842b9d05649d None None] cpu compare xml: <cpu match="exact">
Nov 16 10:06:21 user nova-compute[85141]:   <model>Nehalem</model>
Nov 16 10:06:21 user nova-compute[85141]: </cpu>
Nov 16 10:06:21 user nova-compute[85141]:  {{(pid=85141) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10023}}
Nov 16 10:06:21 user nova-compute[85141]: INFO nova.virt.node [None req-68e4d1b8-93eb-4f00-a57e-842b9d05649d None None] Generated node identity bf8e0fa1-16b6-408f-9203-c4cd63916272
Nov 16 10:06:21 user nova-compute[85141]: INFO nova.virt.node [None req-68e4d1b8-93eb-4f00-a57e-842b9d05649d None None] Wrote node identity bf8e0fa1-16b6-408f-9203-c4cd63916272 to /opt/stack/data/nova/compute_id
Nov 16 10:06:21 user nova-compute[85141]: WARNING nova.compute.manager [None req-68e4d1b8-93eb-4f00-a57e-842b9d05649d None None] Compute nodes ['bf8e0fa1-16b6-408f-9203-c4cd63916272'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Nov 16 10:06:21 user nova-compute[85141]: INFO nova.compute.manager [None req-68e4d1b8-93eb-4f00-a57e-842b9d05649d None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Nov 16 10:06:21 user nova-compute[85141]: WARNING nova.compute.manager [None req-68e4d1b8-93eb-4f00-a57e-842b9d05649d None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 16 10:06:21 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-68e4d1b8-93eb-4f00-a57e-842b9d05649d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:06:21 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-68e4d1b8-93eb-4f00-a57e-842b9d05649d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:06:21 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-68e4d1b8-93eb-4f00-a57e-842b9d05649d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:06:21 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-68e4d1b8-93eb-4f00-a57e-842b9d05649d None None] Auditing locally available compute resources for user (node: user) {{(pid=85141) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 10:06:21 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-68e4d1b8-93eb-4f00-a57e-842b9d05649d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:06:21 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-68e4d1b8-93eb-4f00-a57e-842b9d05649d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:06:21 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-68e4d1b8-93eb-4f00-a57e-842b9d05649d None None] Hypervisor/Node resource view: name=user free_ram=10926MB free_disk=26.146812438964844GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=85141) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 10:06:21 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-68e4d1b8-93eb-4f00-a57e-842b9d05649d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:06:21 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-68e4d1b8-93eb-4f00-a57e-842b9d05649d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:06:21 user nova-compute[85141]: WARNING nova.compute.resource_tracker [None req-68e4d1b8-93eb-4f00-a57e-842b9d05649d None None] No compute node record for user:bf8e0fa1-16b6-408f-9203-c4cd63916272: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host bf8e0fa1-16b6-408f-9203-c4cd63916272 could not be found.
Nov 16 10:06:21 user nova-compute[85141]: INFO nova.compute.resource_tracker [None req-68e4d1b8-93eb-4f00-a57e-842b9d05649d None None] Compute node record created for user:user with uuid: bf8e0fa1-16b6-408f-9203-c4cd63916272
Nov 16 10:06:21 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-68e4d1b8-93eb-4f00-a57e-842b9d05649d None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=85141) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 10:06:21 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-68e4d1b8-93eb-4f00-a57e-842b9d05649d None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=85141) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 10:06:22 user nova-compute[85141]: INFO nova.scheduler.client.report [None req-68e4d1b8-93eb-4f00-a57e-842b9d05649d None None] [req-5aabac0d-b85a-4aee-9533-c28a53e295b0] Created resource provider record via placement API for resource provider with UUID bf8e0fa1-16b6-408f-9203-c4cd63916272 and name user.
Nov 16 10:06:22 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-68e4d1b8-93eb-4f00-a57e-842b9d05649d None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=85141) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1795}}
Nov 16 10:06:22 user nova-compute[85141]: INFO nova.virt.libvirt.host [None req-68e4d1b8-93eb-4f00-a57e-842b9d05649d None None] kernel doesn't support AMD SEV
Nov 16 10:06:22 user nova-compute[85141]: DEBUG nova.compute.provider_tree [None req-68e4d1b8-93eb-4f00-a57e-842b9d05649d None None] Updating inventory in ProviderTree for provider bf8e0fa1-16b6-408f-9203-c4cd63916272 with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=85141) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 16 10:06:22 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-68e4d1b8-93eb-4f00-a57e-842b9d05649d None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=85141) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 10:06:22 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-68e4d1b8-93eb-4f00-a57e-842b9d05649d None None] Libvirt baseline CPU <cpu>
Nov 16 10:06:22 user nova-compute[85141]:   <arch>x86_64</arch>
Nov 16 10:06:22 user nova-compute[85141]:   <model>Nehalem</model>
Nov 16 10:06:22 user nova-compute[85141]:   <vendor>Intel</vendor>
Nov 16 10:06:22 user nova-compute[85141]:   <topology sockets="6" cores="1" threads="1"/>
Nov 16 10:06:22 user nova-compute[85141]: </cpu>
Nov 16 10:06:22 user nova-compute[85141]:  {{(pid=85141) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12513}}
Nov 16 10:06:22 user nova-compute[85141]: DEBUG nova.scheduler.client.report [None req-68e4d1b8-93eb-4f00-a57e-842b9d05649d None None] Updated inventory for provider bf8e0fa1-16b6-408f-9203-c4cd63916272 with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=85141) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Nov 16 10:06:22 user nova-compute[85141]: DEBUG nova.compute.provider_tree [None req-68e4d1b8-93eb-4f00-a57e-842b9d05649d None None] Updating resource provider bf8e0fa1-16b6-408f-9203-c4cd63916272 generation from 0 to 1 during operation: update_inventory {{(pid=85141) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 16 10:06:22 user nova-compute[85141]: DEBUG nova.compute.provider_tree [None req-68e4d1b8-93eb-4f00-a57e-842b9d05649d None None] Updating inventory in ProviderTree for provider bf8e0fa1-16b6-408f-9203-c4cd63916272 with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=85141) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 16 10:06:22 user nova-compute[85141]: DEBUG nova.compute.provider_tree [None req-68e4d1b8-93eb-4f00-a57e-842b9d05649d None None] Updating resource provider bf8e0fa1-16b6-408f-9203-c4cd63916272 generation from 1 to 2 during operation: update_traits {{(pid=85141) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 16 10:06:22 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-68e4d1b8-93eb-4f00-a57e-842b9d05649d None None] Compute_service record updated for user:user {{(pid=85141) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 10:06:22 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-68e4d1b8-93eb-4f00-a57e-842b9d05649d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.603s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:06:22 user nova-compute[85141]: DEBUG nova.service [None req-68e4d1b8-93eb-4f00-a57e-842b9d05649d None None] Creating RPC server for service compute {{(pid=85141) start /opt/stack/nova/nova/service.py:182}}
Nov 16 10:06:22 user nova-compute[85141]: DEBUG nova.service [None req-68e4d1b8-93eb-4f00-a57e-842b9d05649d None None] Join ServiceGroup membership for this service compute {{(pid=85141) start /opt/stack/nova/nova/service.py:199}}
Nov 16 10:06:22 user nova-compute[85141]: DEBUG nova.servicegroup.drivers.db [None req-68e4d1b8-93eb-4f00-a57e-842b9d05649d None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=85141) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Nov 16 10:06:49 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._sync_power_states {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:06:49 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:07:13 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:07:13 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:07:13 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Starting heal instance info cache {{(pid=85141) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 10:07:13 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Rebuilding the list of instances to heal {{(pid=85141) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 10:07:13 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Didn't find any instances for network info cache update. {{(pid=85141) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 16 10:07:13 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:07:13 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:07:13 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:07:13 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:07:13 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:07:13 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:07:13 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=85141) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 10:07:13 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager.update_available_resource {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:07:13 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:07:13 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:07:13 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:07:13 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Auditing locally available compute resources for user (node: user) {{(pid=85141) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 10:07:13 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:07:13 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:07:13 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Hypervisor/Node resource view: name=user free_ram=10371MB free_disk=26.05838394165039GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=85141) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 10:07:13 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:07:13 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:07:13 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=85141) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 10:07:13 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=85141) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 10:07:13 user nova-compute[85141]: DEBUG nova.compute.provider_tree [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Inventory has not changed in ProviderTree for provider: bf8e0fa1-16b6-408f-9203-c4cd63916272 {{(pid=85141) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 10:07:13 user nova-compute[85141]: DEBUG nova.scheduler.client.report [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Inventory has not changed for provider bf8e0fa1-16b6-408f-9203-c4cd63916272 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=85141) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 10:07:13 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Compute_service record updated for user:user {{(pid=85141) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 10:07:13 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.181s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:08:13 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:08:13 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:08:13 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:08:13 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:08:14 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:08:14 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Starting heal instance info cache {{(pid=85141) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 10:08:14 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Rebuilding the list of instances to heal {{(pid=85141) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 10:08:14 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Didn't find any instances for network info cache update. {{(pid=85141) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 16 10:08:14 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager.update_available_resource {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:08:14 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:08:14 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:08:14 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:08:14 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Auditing locally available compute resources for user (node: user) {{(pid=85141) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 10:08:14 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:08:14 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:08:14 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Hypervisor/Node resource view: name=user free_ram=10311MB free_disk=26.122920989990234GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=85141) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 10:08:14 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:08:14 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:08:14 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=85141) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 10:08:14 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=85141) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 10:08:14 user nova-compute[85141]: DEBUG nova.compute.provider_tree [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Inventory has not changed in ProviderTree for provider: bf8e0fa1-16b6-408f-9203-c4cd63916272 {{(pid=85141) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 10:08:14 user nova-compute[85141]: DEBUG nova.scheduler.client.report [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Inventory has not changed for provider bf8e0fa1-16b6-408f-9203-c4cd63916272 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=85141) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 10:08:14 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Compute_service record updated for user:user {{(pid=85141) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 10:08:14 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.131s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:08:15 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:08:15 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:08:15 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:08:15 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:08:15 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=85141) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 10:09:14 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:09:15 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:09:15 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Starting heal instance info cache {{(pid=85141) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 10:09:15 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Rebuilding the list of instances to heal {{(pid=85141) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 10:09:15 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Didn't find any instances for network info cache update. {{(pid=85141) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 16 10:09:15 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:09:15 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:09:16 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:09:16 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager.update_available_resource {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:09:16 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:09:16 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:09:16 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:09:16 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Auditing locally available compute resources for user (node: user) {{(pid=85141) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 10:09:16 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:09:16 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:09:16 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Hypervisor/Node resource view: name=user free_ram=10323MB free_disk=25.875022888183594GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=85141) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 10:09:16 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:09:16 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:09:16 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=85141) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 10:09:16 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=85141) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 10:09:16 user nova-compute[85141]: DEBUG nova.compute.provider_tree [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Inventory has not changed in ProviderTree for provider: bf8e0fa1-16b6-408f-9203-c4cd63916272 {{(pid=85141) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 10:09:16 user nova-compute[85141]: DEBUG nova.scheduler.client.report [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Inventory has not changed for provider bf8e0fa1-16b6-408f-9203-c4cd63916272 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=85141) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 10:09:16 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Compute_service record updated for user:user {{(pid=85141) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 10:09:16 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.150s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:09:17 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:09:17 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:09:17 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:09:17 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=85141) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 10:10:14 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:10:16 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:10:16 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:10:16 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Starting heal instance info cache {{(pid=85141) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 10:10:16 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Rebuilding the list of instances to heal {{(pid=85141) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 10:10:16 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Didn't find any instances for network info cache update. {{(pid=85141) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 16 10:10:16 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:10:16 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:10:18 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:10:18 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:10:18 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=85141) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 10:10:18 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager.update_available_resource {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:10:18 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:10:18 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:10:18 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:10:18 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Auditing locally available compute resources for user (node: user) {{(pid=85141) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 10:10:18 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:10:18 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:10:18 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Hypervisor/Node resource view: name=user free_ram=9589MB free_disk=25.895336151123047GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=85141) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 10:10:18 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:10:18 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:10:18 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=85141) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 10:10:18 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=85141) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 10:10:18 user nova-compute[85141]: DEBUG nova.compute.provider_tree [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Inventory has not changed in ProviderTree for provider: bf8e0fa1-16b6-408f-9203-c4cd63916272 {{(pid=85141) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 10:10:18 user nova-compute[85141]: DEBUG nova.scheduler.client.report [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Inventory has not changed for provider bf8e0fa1-16b6-408f-9203-c4cd63916272 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=85141) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 10:10:18 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Compute_service record updated for user:user {{(pid=85141) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 10:10:18 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.173s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:10:19 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:10:19 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:10:25 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-ce0015fa-dfda-4a9e-958b-2122ace9edea tempest-DeleteServersTestJSON-1770650847 tempest-DeleteServersTestJSON-1770650847-project-member] Acquiring lock "a4cdcb5b-b2a6-4736-85c8-7e6cdab8c9b1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:10:25 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-ce0015fa-dfda-4a9e-958b-2122ace9edea tempest-DeleteServersTestJSON-1770650847 tempest-DeleteServersTestJSON-1770650847-project-member] Lock "a4cdcb5b-b2a6-4736-85c8-7e6cdab8c9b1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:10:25 user nova-compute[85141]: DEBUG nova.compute.manager [None req-ce0015fa-dfda-4a9e-958b-2122ace9edea tempest-DeleteServersTestJSON-1770650847 tempest-DeleteServersTestJSON-1770650847-project-member] [instance: a4cdcb5b-b2a6-4736-85c8-7e6cdab8c9b1] Starting instance... {{(pid=85141) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 10:10:25 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-ce0015fa-dfda-4a9e-958b-2122ace9edea tempest-DeleteServersTestJSON-1770650847 tempest-DeleteServersTestJSON-1770650847-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:10:25 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-ce0015fa-dfda-4a9e-958b-2122ace9edea tempest-DeleteServersTestJSON-1770650847 tempest-DeleteServersTestJSON-1770650847-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:10:25 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-ce0015fa-dfda-4a9e-958b-2122ace9edea tempest-DeleteServersTestJSON-1770650847 tempest-DeleteServersTestJSON-1770650847-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=85141) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 10:10:25 user nova-compute[85141]: INFO nova.compute.claims [None req-ce0015fa-dfda-4a9e-958b-2122ace9edea tempest-DeleteServersTestJSON-1770650847 tempest-DeleteServersTestJSON-1770650847-project-member] [instance: a4cdcb5b-b2a6-4736-85c8-7e6cdab8c9b1] Claim successful on node user
Nov 16 10:10:25 user nova-compute[85141]: DEBUG nova.compute.provider_tree [None req-ce0015fa-dfda-4a9e-958b-2122ace9edea tempest-DeleteServersTestJSON-1770650847 tempest-DeleteServersTestJSON-1770650847-project-member] Inventory has not changed in ProviderTree for provider: bf8e0fa1-16b6-408f-9203-c4cd63916272 {{(pid=85141) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 10:10:25 user nova-compute[85141]: DEBUG nova.scheduler.client.report [None req-ce0015fa-dfda-4a9e-958b-2122ace9edea tempest-DeleteServersTestJSON-1770650847 tempest-DeleteServersTestJSON-1770650847-project-member] Inventory has not changed for provider bf8e0fa1-16b6-408f-9203-c4cd63916272 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=85141) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 10:10:25 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-ce0015fa-dfda-4a9e-958b-2122ace9edea tempest-DeleteServersTestJSON-1770650847 tempest-DeleteServersTestJSON-1770650847-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.397s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:10:25 user nova-compute[85141]: DEBUG nova.compute.manager [None req-ce0015fa-dfda-4a9e-958b-2122ace9edea tempest-DeleteServersTestJSON-1770650847 tempest-DeleteServersTestJSON-1770650847-project-member] [instance: a4cdcb5b-b2a6-4736-85c8-7e6cdab8c9b1] Start building networks asynchronously for instance. {{(pid=85141) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 10:10:25 user nova-compute[85141]: DEBUG nova.compute.manager [None req-ce0015fa-dfda-4a9e-958b-2122ace9edea tempest-DeleteServersTestJSON-1770650847 tempest-DeleteServersTestJSON-1770650847-project-member] [instance: a4cdcb5b-b2a6-4736-85c8-7e6cdab8c9b1] Allocating IP information in the background. {{(pid=85141) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 10:10:25 user nova-compute[85141]: DEBUG nova.network.neutron [None req-ce0015fa-dfda-4a9e-958b-2122ace9edea tempest-DeleteServersTestJSON-1770650847 tempest-DeleteServersTestJSON-1770650847-project-member] [instance: a4cdcb5b-b2a6-4736-85c8-7e6cdab8c9b1] allocate_for_instance() {{(pid=85141) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 10:10:25 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-ce0015fa-dfda-4a9e-958b-2122ace9edea tempest-DeleteServersTestJSON-1770650847 tempest-DeleteServersTestJSON-1770650847-project-member] [instance: a4cdcb5b-b2a6-4736-85c8-7e6cdab8c9b1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 10:10:26 user nova-compute[85141]: DEBUG nova.compute.manager [None req-ce0015fa-dfda-4a9e-958b-2122ace9edea tempest-DeleteServersTestJSON-1770650847 tempest-DeleteServersTestJSON-1770650847-project-member] [instance: a4cdcb5b-b2a6-4736-85c8-7e6cdab8c9b1] Start building block device mappings for instance. {{(pid=85141) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 10:10:26 user nova-compute[85141]: DEBUG nova.compute.manager [None req-ce0015fa-dfda-4a9e-958b-2122ace9edea tempest-DeleteServersTestJSON-1770650847 tempest-DeleteServersTestJSON-1770650847-project-member] [instance: a4cdcb5b-b2a6-4736-85c8-7e6cdab8c9b1] Start spawning the instance on the hypervisor. {{(pid=85141) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 10:10:26 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-ce0015fa-dfda-4a9e-958b-2122ace9edea tempest-DeleteServersTestJSON-1770650847 tempest-DeleteServersTestJSON-1770650847-project-member] [instance: a4cdcb5b-b2a6-4736-85c8-7e6cdab8c9b1] Creating instance directory {{(pid=85141) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 10:10:26 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-ce0015fa-dfda-4a9e-958b-2122ace9edea tempest-DeleteServersTestJSON-1770650847 tempest-DeleteServersTestJSON-1770650847-project-member] [instance: a4cdcb5b-b2a6-4736-85c8-7e6cdab8c9b1] Creating image(s)
Nov 16 10:10:26 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-ce0015fa-dfda-4a9e-958b-2122ace9edea tempest-DeleteServersTestJSON-1770650847 tempest-DeleteServersTestJSON-1770650847-project-member] Acquiring lock "/opt/stack/data/nova/instances/a4cdcb5b-b2a6-4736-85c8-7e6cdab8c9b1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:10:26 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-ce0015fa-dfda-4a9e-958b-2122ace9edea tempest-DeleteServersTestJSON-1770650847 tempest-DeleteServersTestJSON-1770650847-project-member] Lock "/opt/stack/data/nova/instances/a4cdcb5b-b2a6-4736-85c8-7e6cdab8c9b1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:10:26 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-ce0015fa-dfda-4a9e-958b-2122ace9edea tempest-DeleteServersTestJSON-1770650847 tempest-DeleteServersTestJSON-1770650847-project-member] Lock "/opt/stack/data/nova/instances/a4cdcb5b-b2a6-4736-85c8-7e6cdab8c9b1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:10:26 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-ce0015fa-dfda-4a9e-958b-2122ace9edea tempest-DeleteServersTestJSON-1770650847 tempest-DeleteServersTestJSON-1770650847-project-member] Acquiring lock "60a78556fb399ed4a41bc3ca4bccf77c96d8e811" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:10:26 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-ce0015fa-dfda-4a9e-958b-2122ace9edea tempest-DeleteServersTestJSON-1770650847 tempest-DeleteServersTestJSON-1770650847-project-member] Lock "60a78556fb399ed4a41bc3ca4bccf77c96d8e811" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:10:26 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-ce0015fa-dfda-4a9e-958b-2122ace9edea tempest-DeleteServersTestJSON-1770650847 tempest-DeleteServersTestJSON-1770650847-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811.part --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:10:26 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-efd6cff3-9f97-4572-8f80-b6e15aa4b080 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Acquiring lock "9411843f-4e79-46c4-ae02-01f5e87b86eb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:10:26 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-efd6cff3-9f97-4572-8f80-b6e15aa4b080 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Lock "9411843f-4e79-46c4-ae02-01f5e87b86eb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:10:26 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-451f5472-7f7f-4464-b13c-dce06ae24a82 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Acquiring lock "d842f90e-663b-4c95-9d7c-d092d2bac41f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:10:26 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-451f5472-7f7f-4464-b13c-dce06ae24a82 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Lock "d842f90e-663b-4c95-9d7c-d092d2bac41f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.016s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:10:26 user nova-compute[85141]: DEBUG nova.policy [None req-ce0015fa-dfda-4a9e-958b-2122ace9edea tempest-DeleteServersTestJSON-1770650847 tempest-DeleteServersTestJSON-1770650847-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5fc967d7a8f44656877c2973399becbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f28c73b00ca42309f0b679aa6f3c462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85141) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 10:10:26 user nova-compute[85141]: DEBUG nova.compute.manager [None req-efd6cff3-9f97-4572-8f80-b6e15aa4b080 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] [instance: 9411843f-4e79-46c4-ae02-01f5e87b86eb] Starting instance... {{(pid=85141) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 10:10:26 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-ce0015fa-dfda-4a9e-958b-2122ace9edea tempest-DeleteServersTestJSON-1770650847 tempest-DeleteServersTestJSON-1770650847-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811.part --force-share --output=json" returned: 0 in 0.188s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:10:26 user nova-compute[85141]: DEBUG nova.virt.images [None req-ce0015fa-dfda-4a9e-958b-2122ace9edea tempest-DeleteServersTestJSON-1770650847 tempest-DeleteServersTestJSON-1770650847-project-member] bc4ca70f-a459-4d5c-a9e6-80f1948eb48b was qcow2, converting to raw {{(pid=85141) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 16 10:10:26 user nova-compute[85141]: DEBUG nova.privsep.utils [None req-ce0015fa-dfda-4a9e-958b-2122ace9edea tempest-DeleteServersTestJSON-1770650847 tempest-DeleteServersTestJSON-1770650847-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=85141) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 16 10:10:26 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-ce0015fa-dfda-4a9e-958b-2122ace9edea tempest-DeleteServersTestJSON-1770650847 tempest-DeleteServersTestJSON-1770650847-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811.part /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811.converted {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:10:26 user nova-compute[85141]: DEBUG nova.compute.manager [None req-451f5472-7f7f-4464-b13c-dce06ae24a82 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] [instance: d842f90e-663b-4c95-9d7c-d092d2bac41f] Starting instance... {{(pid=85141) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 10:10:26 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-efd6cff3-9f97-4572-8f80-b6e15aa4b080 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:10:26 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-efd6cff3-9f97-4572-8f80-b6e15aa4b080 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:10:27 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-efd6cff3-9f97-4572-8f80-b6e15aa4b080 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=85141) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 10:10:27 user nova-compute[85141]: INFO nova.compute.claims [None req-efd6cff3-9f97-4572-8f80-b6e15aa4b080 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] [instance: 9411843f-4e79-46c4-ae02-01f5e87b86eb] Claim successful on node user
Nov 16 10:10:27 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-451f5472-7f7f-4464-b13c-dce06ae24a82 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:10:27 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-ce0015fa-dfda-4a9e-958b-2122ace9edea tempest-DeleteServersTestJSON-1770650847 tempest-DeleteServersTestJSON-1770650847-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811.part /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811.converted" returned: 0 in 0.405s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:10:27 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-ce0015fa-dfda-4a9e-958b-2122ace9edea tempest-DeleteServersTestJSON-1770650847 tempest-DeleteServersTestJSON-1770650847-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811.converted --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:10:27 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-ce0015fa-dfda-4a9e-958b-2122ace9edea tempest-DeleteServersTestJSON-1770650847 tempest-DeleteServersTestJSON-1770650847-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811.converted --force-share --output=json" returned: 0 in 0.203s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:10:27 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-ce0015fa-dfda-4a9e-958b-2122ace9edea tempest-DeleteServersTestJSON-1770650847 tempest-DeleteServersTestJSON-1770650847-project-member] Lock "60a78556fb399ed4a41bc3ca4bccf77c96d8e811" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.288s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:10:27 user nova-compute[85141]: INFO oslo.privsep.daemon [None req-ce0015fa-dfda-4a9e-958b-2122ace9edea tempest-DeleteServersTestJSON-1770650847 tempest-DeleteServersTestJSON-1770650847-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpn5zzknnl/privsep.sock']
Nov 16 10:10:27 user sudo[94415]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpn5zzknnl/privsep.sock
Nov 16 10:10:27 user sudo[94415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 16 10:10:27 user nova-compute[85141]: DEBUG nova.compute.provider_tree [None req-efd6cff3-9f97-4572-8f80-b6e15aa4b080 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Inventory has not changed in ProviderTree for provider: bf8e0fa1-16b6-408f-9203-c4cd63916272 {{(pid=85141) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 10:10:27 user nova-compute[85141]: DEBUG nova.scheduler.client.report [None req-efd6cff3-9f97-4572-8f80-b6e15aa4b080 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Inventory has not changed for provider bf8e0fa1-16b6-408f-9203-c4cd63916272 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=85141) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 10:10:27 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-efd6cff3-9f97-4572-8f80-b6e15aa4b080 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.695s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:10:27 user nova-compute[85141]: DEBUG nova.compute.manager [None req-efd6cff3-9f97-4572-8f80-b6e15aa4b080 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] [instance: 9411843f-4e79-46c4-ae02-01f5e87b86eb] Start building networks asynchronously for instance. {{(pid=85141) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 10:10:27 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-451f5472-7f7f-4464-b13c-dce06ae24a82 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.418s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:10:27 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-451f5472-7f7f-4464-b13c-dce06ae24a82 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=85141) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 10:10:27 user nova-compute[85141]: INFO nova.compute.claims [None req-451f5472-7f7f-4464-b13c-dce06ae24a82 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] [instance: d842f90e-663b-4c95-9d7c-d092d2bac41f] Claim successful on node user
Nov 16 10:10:27 user nova-compute[85141]: DEBUG nova.compute.manager [None req-efd6cff3-9f97-4572-8f80-b6e15aa4b080 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] [instance: 9411843f-4e79-46c4-ae02-01f5e87b86eb] Allocating IP information in the background. {{(pid=85141) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 10:10:27 user nova-compute[85141]: DEBUG nova.network.neutron [None req-efd6cff3-9f97-4572-8f80-b6e15aa4b080 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] [instance: 9411843f-4e79-46c4-ae02-01f5e87b86eb] allocate_for_instance() {{(pid=85141) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 10:10:27 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-efd6cff3-9f97-4572-8f80-b6e15aa4b080 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] [instance: 9411843f-4e79-46c4-ae02-01f5e87b86eb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 10:10:27 user nova-compute[85141]: DEBUG nova.compute.manager [None req-efd6cff3-9f97-4572-8f80-b6e15aa4b080 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] [instance: 9411843f-4e79-46c4-ae02-01f5e87b86eb] Start building block device mappings for instance. {{(pid=85141) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 10:10:27 user nova-compute[85141]: DEBUG nova.policy [None req-efd6cff3-9f97-4572-8f80-b6e15aa4b080 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'baec48c887ae4a418e0ea7b32b05bc59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08ef12fb41a14ecd8abb84d4d69b7c27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85141) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 10:10:27 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-72b51cf3-8112-4a97-abff-d81405d395de tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Acquiring lock "e65ccf79-718d-4eeb-8914-f0db2e2c9ce2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:10:27 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-72b51cf3-8112-4a97-abff-d81405d395de tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Lock "e65ccf79-718d-4eeb-8914-f0db2e2c9ce2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:10:27 user nova-compute[85141]: DEBUG nova.compute.manager [None req-72b51cf3-8112-4a97-abff-d81405d395de tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] [instance: e65ccf79-718d-4eeb-8914-f0db2e2c9ce2] Starting instance... {{(pid=85141) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 10:10:27 user nova-compute[85141]: DEBUG nova.compute.provider_tree [None req-451f5472-7f7f-4464-b13c-dce06ae24a82 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Inventory has not changed in ProviderTree for provider: bf8e0fa1-16b6-408f-9203-c4cd63916272 {{(pid=85141) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 10:10:27 user nova-compute[85141]: DEBUG nova.scheduler.client.report [None req-451f5472-7f7f-4464-b13c-dce06ae24a82 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Inventory has not changed for provider bf8e0fa1-16b6-408f-9203-c4cd63916272 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=85141) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 10:10:28 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-451f5472-7f7f-4464-b13c-dce06ae24a82 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.368s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:10:28 user nova-compute[85141]: DEBUG nova.compute.manager [None req-451f5472-7f7f-4464-b13c-dce06ae24a82 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] [instance: d842f90e-663b-4c95-9d7c-d092d2bac41f] Start building networks asynchronously for instance. {{(pid=85141) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 10:10:28 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-72b51cf3-8112-4a97-abff-d81405d395de tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:10:28 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-72b51cf3-8112-4a97-abff-d81405d395de tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:10:28 user nova-compute[85141]: DEBUG nova.compute.manager [None req-efd6cff3-9f97-4572-8f80-b6e15aa4b080 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] [instance: 9411843f-4e79-46c4-ae02-01f5e87b86eb] Start spawning the instance on the hypervisor. {{(pid=85141) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 10:10:28 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-efd6cff3-9f97-4572-8f80-b6e15aa4b080 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] [instance: 9411843f-4e79-46c4-ae02-01f5e87b86eb] Creating instance directory {{(pid=85141) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 10:10:28 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-efd6cff3-9f97-4572-8f80-b6e15aa4b080 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] [instance: 9411843f-4e79-46c4-ae02-01f5e87b86eb] Creating image(s)
Nov 16 10:10:28 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-efd6cff3-9f97-4572-8f80-b6e15aa4b080 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Acquiring lock "/opt/stack/data/nova/instances/9411843f-4e79-46c4-ae02-01f5e87b86eb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:10:28 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-efd6cff3-9f97-4572-8f80-b6e15aa4b080 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Lock "/opt/stack/data/nova/instances/9411843f-4e79-46c4-ae02-01f5e87b86eb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:10:28 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-efd6cff3-9f97-4572-8f80-b6e15aa4b080 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Lock "/opt/stack/data/nova/instances/9411843f-4e79-46c4-ae02-01f5e87b86eb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:10:28 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-72b51cf3-8112-4a97-abff-d81405d395de tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=85141) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 10:10:28 user nova-compute[85141]: INFO nova.compute.claims [None req-72b51cf3-8112-4a97-abff-d81405d395de tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] [instance: e65ccf79-718d-4eeb-8914-f0db2e2c9ce2] Claim successful on node user
Nov 16 10:10:28 user nova-compute[85141]: DEBUG nova.compute.manager [None req-451f5472-7f7f-4464-b13c-dce06ae24a82 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] [instance: d842f90e-663b-4c95-9d7c-d092d2bac41f] Allocating IP information in the background. {{(pid=85141) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 10:10:28 user nova-compute[85141]: DEBUG nova.network.neutron [None req-451f5472-7f7f-4464-b13c-dce06ae24a82 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] [instance: d842f90e-663b-4c95-9d7c-d092d2bac41f] allocate_for_instance() {{(pid=85141) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 10:10:28 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-451f5472-7f7f-4464-b13c-dce06ae24a82 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] [instance: d842f90e-663b-4c95-9d7c-d092d2bac41f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 10:10:28 user nova-compute[85141]: DEBUG nova.compute.manager [None req-451f5472-7f7f-4464-b13c-dce06ae24a82 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] [instance: d842f90e-663b-4c95-9d7c-d092d2bac41f] Start building block device mappings for instance. {{(pid=85141) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 10:10:28 user nova-compute[85141]: DEBUG nova.compute.provider_tree [None req-72b51cf3-8112-4a97-abff-d81405d395de tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Inventory has not changed in ProviderTree for provider: bf8e0fa1-16b6-408f-9203-c4cd63916272 {{(pid=85141) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 10:10:28 user nova-compute[85141]: DEBUG nova.compute.manager [None req-451f5472-7f7f-4464-b13c-dce06ae24a82 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] [instance: d842f90e-663b-4c95-9d7c-d092d2bac41f] Start spawning the instance on the hypervisor. {{(pid=85141) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 10:10:28 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-451f5472-7f7f-4464-b13c-dce06ae24a82 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] [instance: d842f90e-663b-4c95-9d7c-d092d2bac41f] Creating instance directory {{(pid=85141) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 10:10:28 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-451f5472-7f7f-4464-b13c-dce06ae24a82 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] [instance: d842f90e-663b-4c95-9d7c-d092d2bac41f] Creating image(s)
Nov 16 10:10:28 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-451f5472-7f7f-4464-b13c-dce06ae24a82 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Acquiring lock "/opt/stack/data/nova/instances/d842f90e-663b-4c95-9d7c-d092d2bac41f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:10:28 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-451f5472-7f7f-4464-b13c-dce06ae24a82 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Lock "/opt/stack/data/nova/instances/d842f90e-663b-4c95-9d7c-d092d2bac41f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:10:28 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-451f5472-7f7f-4464-b13c-dce06ae24a82 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Lock "/opt/stack/data/nova/instances/d842f90e-663b-4c95-9d7c-d092d2bac41f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:10:28 user nova-compute[85141]: DEBUG nova.scheduler.client.report [None req-72b51cf3-8112-4a97-abff-d81405d395de tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Inventory has not changed for provider bf8e0fa1-16b6-408f-9203-c4cd63916272 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=85141) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 10:10:28 user nova-compute[85141]: DEBUG nova.policy [None req-451f5472-7f7f-4464-b13c-dce06ae24a82 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ffe6ceff3cc346b59b4fbf294b9fc1a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733b504d4dbe4f028963cf2c197f0064', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85141) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 10:10:28 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-72b51cf3-8112-4a97-abff-d81405d395de tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.380s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:10:28 user nova-compute[85141]: DEBUG nova.compute.manager [None req-72b51cf3-8112-4a97-abff-d81405d395de tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] [instance: e65ccf79-718d-4eeb-8914-f0db2e2c9ce2] Start building networks asynchronously for instance. {{(pid=85141) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 10:10:28 user nova-compute[85141]: DEBUG nova.compute.manager [None req-72b51cf3-8112-4a97-abff-d81405d395de tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] [instance: e65ccf79-718d-4eeb-8914-f0db2e2c9ce2] Allocating IP information in the background. {{(pid=85141) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 10:10:28 user nova-compute[85141]: DEBUG nova.network.neutron [None req-72b51cf3-8112-4a97-abff-d81405d395de tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] [instance: e65ccf79-718d-4eeb-8914-f0db2e2c9ce2] allocate_for_instance() {{(pid=85141) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 10:10:28 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-72b51cf3-8112-4a97-abff-d81405d395de tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] [instance: e65ccf79-718d-4eeb-8914-f0db2e2c9ce2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 10:10:28 user nova-compute[85141]: DEBUG nova.compute.manager [None req-72b51cf3-8112-4a97-abff-d81405d395de tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] [instance: e65ccf79-718d-4eeb-8914-f0db2e2c9ce2] Start building block device mappings for instance. {{(pid=85141) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 10:10:28 user nova-compute[85141]: DEBUG nova.policy [None req-72b51cf3-8112-4a97-abff-d81405d395de tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '776d4157be1a4e56a8821d50da998475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7044a386486d4426bcccfe0b7d225c80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85141) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 10:10:28 user nova-compute[85141]: DEBUG nova.compute.manager [None req-72b51cf3-8112-4a97-abff-d81405d395de tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] [instance: e65ccf79-718d-4eeb-8914-f0db2e2c9ce2] Start spawning the instance on the hypervisor. {{(pid=85141) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 10:10:28 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-72b51cf3-8112-4a97-abff-d81405d395de tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] [instance: e65ccf79-718d-4eeb-8914-f0db2e2c9ce2] Creating instance directory {{(pid=85141) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 10:10:28 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-72b51cf3-8112-4a97-abff-d81405d395de tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] [instance: e65ccf79-718d-4eeb-8914-f0db2e2c9ce2] Creating image(s)
Nov 16 10:10:28 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-72b51cf3-8112-4a97-abff-d81405d395de tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Acquiring lock "/opt/stack/data/nova/instances/e65ccf79-718d-4eeb-8914-f0db2e2c9ce2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:10:28 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-72b51cf3-8112-4a97-abff-d81405d395de tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Lock "/opt/stack/data/nova/instances/e65ccf79-718d-4eeb-8914-f0db2e2c9ce2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:10:28 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-72b51cf3-8112-4a97-abff-d81405d395de tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Lock "/opt/stack/data/nova/instances/e65ccf79-718d-4eeb-8914-f0db2e2c9ce2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:10:28 user sudo[94415]: pam_unix(sudo:session): session closed for user root
Nov 16 10:10:28 user nova-compute[85141]: INFO oslo.privsep.daemon [None req-ce0015fa-dfda-4a9e-958b-2122ace9edea tempest-DeleteServersTestJSON-1770650847 tempest-DeleteServersTestJSON-1770650847-project-member] Spawned new privsep daemon via rootwrap
Nov 16 10:10:28 user nova-compute[85141]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 16 10:10:28 user nova-compute[85141]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 16 10:10:28 user nova-compute[85141]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Nov 16 10:10:28 user nova-compute[85141]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 94424
Nov 16 10:10:28 user nova-compute[85141]: WARNING oslo_privsep.priv_context [None req-efd6cff3-9f97-4572-8f80-b6e15aa4b080 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] privsep daemon already running
Nov 16 10:10:28 user nova-compute[85141]: WARNING oslo_privsep.priv_context [None req-451f5472-7f7f-4464-b13c-dce06ae24a82 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] privsep daemon already running
Nov 16 10:10:28 user nova-compute[85141]: WARNING oslo_privsep.priv_context [None req-72b51cf3-8112-4a97-abff-d81405d395de tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] privsep daemon already running
Nov 16 10:10:29 user nova-compute[85141]: DEBUG nova.network.neutron [None req-ce0015fa-dfda-4a9e-958b-2122ace9edea tempest-DeleteServersTestJSON-1770650847 tempest-DeleteServersTestJSON-1770650847-project-member] [instance: a4cdcb5b-b2a6-4736-85c8-7e6cdab8c9b1] Successfully created port: 07d06a88-cd34-412f-9b4d-b9fa94247dd4 {{(pid=85141) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 10:10:29 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-ce0015fa-dfda-4a9e-958b-2122ace9edea tempest-DeleteServersTestJSON-1770650847 tempest-DeleteServersTestJSON-1770650847-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:10:29 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-451f5472-7f7f-4464-b13c-dce06ae24a82 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:10:29 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-efd6cff3-9f97-4572-8f80-b6e15aa4b080 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:10:29 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-72b51cf3-8112-4a97-abff-d81405d395de tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:10:29 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-ce0015fa-dfda-4a9e-958b-2122ace9edea tempest-DeleteServersTestJSON-1770650847 tempest-DeleteServersTestJSON-1770650847-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json" returned: 0 in 0.196s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:10:29 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-ce0015fa-dfda-4a9e-958b-2122ace9edea tempest-DeleteServersTestJSON-1770650847 tempest-DeleteServersTestJSON-1770650847-project-member] Acquiring lock "60a78556fb399ed4a41bc3ca4bccf77c96d8e811" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:10:29 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-ce0015fa-dfda-4a9e-958b-2122ace9edea tempest-DeleteServersTestJSON-1770650847 tempest-DeleteServersTestJSON-1770650847-project-member] Lock "60a78556fb399ed4a41bc3ca4bccf77c96d8e811" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:10:29 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-ce0015fa-dfda-4a9e-958b-2122ace9edea tempest-DeleteServersTestJSON-1770650847 tempest-DeleteServersTestJSON-1770650847-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:10:29 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-451f5472-7f7f-4464-b13c-dce06ae24a82 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json" returned: 0 in 0.206s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:10:29 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-451f5472-7f7f-4464-b13c-dce06ae24a82 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Acquiring lock "60a78556fb399ed4a41bc3ca4bccf77c96d8e811" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:10:29 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-efd6cff3-9f97-4572-8f80-b6e15aa4b080 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json" returned: 0 in 0.205s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:10:29 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-efd6cff3-9f97-4572-8f80-b6e15aa4b080 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Acquiring lock "60a78556fb399ed4a41bc3ca4bccf77c96d8e811" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:10:29 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-72b51cf3-8112-4a97-abff-d81405d395de tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json" returned: 0 in 0.192s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:10:29 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-72b51cf3-8112-4a97-abff-d81405d395de tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Acquiring lock "60a78556fb399ed4a41bc3ca4bccf77c96d8e811" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:10:29 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-ce0015fa-dfda-4a9e-958b-2122ace9edea tempest-DeleteServersTestJSON-1770650847 tempest-DeleteServersTestJSON-1770650847-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json" returned: 0 in 0.204s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:10:29 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-ce0015fa-dfda-4a9e-958b-2122ace9edea tempest-DeleteServersTestJSON-1770650847 tempest-DeleteServersTestJSON-1770650847-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811,backing_fmt=raw /opt/stack/data/nova/instances/a4cdcb5b-b2a6-4736-85c8-7e6cdab8c9b1/disk 1073741824 {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:10:29 user nova-compute[85141]: DEBUG nova.network.neutron [None req-efd6cff3-9f97-4572-8f80-b6e15aa4b080 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] [instance: 9411843f-4e79-46c4-ae02-01f5e87b86eb] Successfully created port: 1202aa6f-6442-4e95-bf51-66f977a23e01 {{(pid=85141) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 10:10:29 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-ce0015fa-dfda-4a9e-958b-2122ace9edea tempest-DeleteServersTestJSON-1770650847 tempest-DeleteServersTestJSON-1770650847-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811,backing_fmt=raw /opt/stack/data/nova/instances/a4cdcb5b-b2a6-4736-85c8-7e6cdab8c9b1/disk 1073741824" returned: 0 in 0.065s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:10:29 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-ce0015fa-dfda-4a9e-958b-2122ace9edea tempest-DeleteServersTestJSON-1770650847 tempest-DeleteServersTestJSON-1770650847-project-member] Lock "60a78556fb399ed4a41bc3ca4bccf77c96d8e811" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.273s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:10:29 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-ce0015fa-dfda-4a9e-958b-2122ace9edea tempest-DeleteServersTestJSON-1770650847 tempest-DeleteServersTestJSON-1770650847-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:10:29 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-451f5472-7f7f-4464-b13c-dce06ae24a82 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Lock "60a78556fb399ed4a41bc3ca4bccf77c96d8e811" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.272s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:10:29 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-451f5472-7f7f-4464-b13c-dce06ae24a82 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:10:29 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-ce0015fa-dfda-4a9e-958b-2122ace9edea tempest-DeleteServersTestJSON-1770650847 tempest-DeleteServersTestJSON-1770650847-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json" returned: 0 in 0.192s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:10:29 user nova-compute[85141]: DEBUG nova.virt.disk.api [None req-ce0015fa-dfda-4a9e-958b-2122ace9edea tempest-DeleteServersTestJSON-1770650847 tempest-DeleteServersTestJSON-1770650847-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a4cdcb5b-b2a6-4736-85c8-7e6cdab8c9b1/disk. size=1073741824 {{(pid=85141) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 10:10:29 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-ce0015fa-dfda-4a9e-958b-2122ace9edea tempest-DeleteServersTestJSON-1770650847 tempest-DeleteServersTestJSON-1770650847-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4cdcb5b-b2a6-4736-85c8-7e6cdab8c9b1/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:10:29 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-451f5472-7f7f-4464-b13c-dce06ae24a82 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json" returned: 0 in 0.198s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:10:29 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-451f5472-7f7f-4464-b13c-dce06ae24a82 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811,backing_fmt=raw /opt/stack/data/nova/instances/d842f90e-663b-4c95-9d7c-d092d2bac41f/disk 1073741824 {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:10:29 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-451f5472-7f7f-4464-b13c-dce06ae24a82 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811,backing_fmt=raw /opt/stack/data/nova/instances/d842f90e-663b-4c95-9d7c-d092d2bac41f/disk 1073741824" returned: 0 in 0.052s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:10:29 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-451f5472-7f7f-4464-b13c-dce06ae24a82 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Lock "60a78556fb399ed4a41bc3ca4bccf77c96d8e811" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.257s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:10:29 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-451f5472-7f7f-4464-b13c-dce06ae24a82 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:10:29 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-efd6cff3-9f97-4572-8f80-b6e15aa4b080 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Lock "60a78556fb399ed4a41bc3ca4bccf77c96d8e811" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.532s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:10:29 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-efd6cff3-9f97-4572-8f80-b6e15aa4b080 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:10:30 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-ce0015fa-dfda-4a9e-958b-2122ace9edea tempest-DeleteServersTestJSON-1770650847 tempest-DeleteServersTestJSON-1770650847-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4cdcb5b-b2a6-4736-85c8-7e6cdab8c9b1/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:10:30 user nova-compute[85141]: DEBUG nova.virt.disk.api [None req-ce0015fa-dfda-4a9e-958b-2122ace9edea tempest-DeleteServersTestJSON-1770650847 tempest-DeleteServersTestJSON-1770650847-project-member] Cannot resize image /opt/stack/data/nova/instances/a4cdcb5b-b2a6-4736-85c8-7e6cdab8c9b1/disk to a smaller size. {{(pid=85141) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 10:10:30 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-ce0015fa-dfda-4a9e-958b-2122ace9edea tempest-DeleteServersTestJSON-1770650847 tempest-DeleteServersTestJSON-1770650847-project-member] [instance: a4cdcb5b-b2a6-4736-85c8-7e6cdab8c9b1] Created local disks {{(pid=85141) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 10:10:30 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-ce0015fa-dfda-4a9e-958b-2122ace9edea tempest-DeleteServersTestJSON-1770650847 tempest-DeleteServersTestJSON-1770650847-project-member] [instance: a4cdcb5b-b2a6-4736-85c8-7e6cdab8c9b1] Ensure instance console log exists: /opt/stack/data/nova/instances/a4cdcb5b-b2a6-4736-85c8-7e6cdab8c9b1/console.log {{(pid=85141) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 10:10:30 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-ce0015fa-dfda-4a9e-958b-2122ace9edea tempest-DeleteServersTestJSON-1770650847 tempest-DeleteServersTestJSON-1770650847-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:10:30 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-ce0015fa-dfda-4a9e-958b-2122ace9edea tempest-DeleteServersTestJSON-1770650847 tempest-DeleteServersTestJSON-1770650847-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:10:30 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-ce0015fa-dfda-4a9e-958b-2122ace9edea tempest-DeleteServersTestJSON-1770650847 tempest-DeleteServersTestJSON-1770650847-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:10:30 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-451f5472-7f7f-4464-b13c-dce06ae24a82 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json" returned: 0 in 0.184s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:10:30 user nova-compute[85141]: DEBUG nova.virt.disk.api [None req-451f5472-7f7f-4464-b13c-dce06ae24a82 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d842f90e-663b-4c95-9d7c-d092d2bac41f/disk. size=1073741824 {{(pid=85141) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 10:10:30 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-451f5472-7f7f-4464-b13c-dce06ae24a82 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d842f90e-663b-4c95-9d7c-d092d2bac41f/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:10:30 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-efd6cff3-9f97-4572-8f80-b6e15aa4b080 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json" returned: 0 in 0.190s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:10:30 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-efd6cff3-9f97-4572-8f80-b6e15aa4b080 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811,backing_fmt=raw /opt/stack/data/nova/instances/9411843f-4e79-46c4-ae02-01f5e87b86eb/disk 1073741824 {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:10:30 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-efd6cff3-9f97-4572-8f80-b6e15aa4b080 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811,backing_fmt=raw /opt/stack/data/nova/instances/9411843f-4e79-46c4-ae02-01f5e87b86eb/disk 1073741824" returned: 0 in 0.044s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:10:30 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-efd6cff3-9f97-4572-8f80-b6e15aa4b080 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Lock "60a78556fb399ed4a41bc3ca4bccf77c96d8e811" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.242s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:10:30 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-efd6cff3-9f97-4572-8f80-b6e15aa4b080 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:10:30 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-72b51cf3-8112-4a97-abff-d81405d395de tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Lock "60a78556fb399ed4a41bc3ca4bccf77c96d8e811" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.770s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:10:30 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-72b51cf3-8112-4a97-abff-d81405d395de tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:10:30 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-451f5472-7f7f-4464-b13c-dce06ae24a82 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d842f90e-663b-4c95-9d7c-d092d2bac41f/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:10:30 user nova-compute[85141]: DEBUG nova.virt.disk.api [None req-451f5472-7f7f-4464-b13c-dce06ae24a82 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Cannot resize image /opt/stack/data/nova/instances/d842f90e-663b-4c95-9d7c-d092d2bac41f/disk to a smaller size. {{(pid=85141) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 10:10:30 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-451f5472-7f7f-4464-b13c-dce06ae24a82 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] [instance: d842f90e-663b-4c95-9d7c-d092d2bac41f] Created local disks {{(pid=85141) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 10:10:30 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-451f5472-7f7f-4464-b13c-dce06ae24a82 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] [instance: d842f90e-663b-4c95-9d7c-d092d2bac41f] Ensure instance console log exists: /opt/stack/data/nova/instances/d842f90e-663b-4c95-9d7c-d092d2bac41f/console.log {{(pid=85141) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 10:10:30 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-451f5472-7f7f-4464-b13c-dce06ae24a82 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:10:30 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-451f5472-7f7f-4464-b13c-dce06ae24a82 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:10:30 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-451f5472-7f7f-4464-b13c-dce06ae24a82 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:10:30 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-efd6cff3-9f97-4572-8f80-b6e15aa4b080 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json" returned: 0 in 0.184s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:10:30 user nova-compute[85141]: DEBUG nova.virt.disk.api [None req-efd6cff3-9f97-4572-8f80-b6e15aa4b080 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9411843f-4e79-46c4-ae02-01f5e87b86eb/disk. size=1073741824 {{(pid=85141) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 10:10:30 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-efd6cff3-9f97-4572-8f80-b6e15aa4b080 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9411843f-4e79-46c4-ae02-01f5e87b86eb/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:10:30 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-72b51cf3-8112-4a97-abff-d81405d395de tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json" returned: 0 in 0.182s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:10:30 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-72b51cf3-8112-4a97-abff-d81405d395de tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811,backing_fmt=raw /opt/stack/data/nova/instances/e65ccf79-718d-4eeb-8914-f0db2e2c9ce2/disk 1073741824 {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:10:30 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-efd6cff3-9f97-4572-8f80-b6e15aa4b080 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9411843f-4e79-46c4-ae02-01f5e87b86eb/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:10:30 user nova-compute[85141]: DEBUG nova.virt.disk.api [None req-efd6cff3-9f97-4572-8f80-b6e15aa4b080 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Cannot resize image /opt/stack/data/nova/instances/9411843f-4e79-46c4-ae02-01f5e87b86eb/disk to a smaller size. {{(pid=85141) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 10:10:30 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-efd6cff3-9f97-4572-8f80-b6e15aa4b080 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] [instance: 9411843f-4e79-46c4-ae02-01f5e87b86eb] Created local disks {{(pid=85141) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 10:10:30 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-efd6cff3-9f97-4572-8f80-b6e15aa4b080 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] [instance: 9411843f-4e79-46c4-ae02-01f5e87b86eb] Ensure instance console log exists: /opt/stack/data/nova/instances/9411843f-4e79-46c4-ae02-01f5e87b86eb/console.log {{(pid=85141) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 10:10:30 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-efd6cff3-9f97-4572-8f80-b6e15aa4b080 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:10:30 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-efd6cff3-9f97-4572-8f80-b6e15aa4b080 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:10:30 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-efd6cff3-9f97-4572-8f80-b6e15aa4b080 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:10:30 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-72b51cf3-8112-4a97-abff-d81405d395de tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811,backing_fmt=raw /opt/stack/data/nova/instances/e65ccf79-718d-4eeb-8914-f0db2e2c9ce2/disk 1073741824" returned: 0 in 0.164s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:10:30 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-72b51cf3-8112-4a97-abff-d81405d395de tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Lock "60a78556fb399ed4a41bc3ca4bccf77c96d8e811" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.351s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:10:30 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-72b51cf3-8112-4a97-abff-d81405d395de tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:10:30 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-72b51cf3-8112-4a97-abff-d81405d395de tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json" returned: 0 in 0.170s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:10:30 user nova-compute[85141]: DEBUG nova.virt.disk.api [None req-72b51cf3-8112-4a97-abff-d81405d395de tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e65ccf79-718d-4eeb-8914-f0db2e2c9ce2/disk. size=1073741824 {{(pid=85141) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 10:10:30 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-72b51cf3-8112-4a97-abff-d81405d395de tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e65ccf79-718d-4eeb-8914-f0db2e2c9ce2/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:10:30 user nova-compute[85141]: DEBUG nova.network.neutron [None req-72b51cf3-8112-4a97-abff-d81405d395de tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] [instance: e65ccf79-718d-4eeb-8914-f0db2e2c9ce2] Successfully created port: 9b681ac7-3246-4ff4-8691-f8e4f1d62061 {{(pid=85141) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 10:10:30 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-72b51cf3-8112-4a97-abff-d81405d395de tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e65ccf79-718d-4eeb-8914-f0db2e2c9ce2/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:10:30 user nova-compute[85141]: DEBUG nova.virt.disk.api [None req-72b51cf3-8112-4a97-abff-d81405d395de tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Cannot resize image /opt/stack/data/nova/instances/e65ccf79-718d-4eeb-8914-f0db2e2c9ce2/disk to a smaller size. {{(pid=85141) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 10:10:30 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-72b51cf3-8112-4a97-abff-d81405d395de tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] [instance: e65ccf79-718d-4eeb-8914-f0db2e2c9ce2] Created local disks {{(pid=85141) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 10:10:30 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-72b51cf3-8112-4a97-abff-d81405d395de tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] [instance: e65ccf79-718d-4eeb-8914-f0db2e2c9ce2] Ensure instance console log exists: /opt/stack/data/nova/instances/e65ccf79-718d-4eeb-8914-f0db2e2c9ce2/console.log {{(pid=85141) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 10:10:30 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-72b51cf3-8112-4a97-abff-d81405d395de tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:10:30 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-72b51cf3-8112-4a97-abff-d81405d395de tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:10:30 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-72b51cf3-8112-4a97-abff-d81405d395de tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.002s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:10:31 user nova-compute[85141]: DEBUG nova.network.neutron [None req-451f5472-7f7f-4464-b13c-dce06ae24a82 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] [instance: d842f90e-663b-4c95-9d7c-d092d2bac41f] Successfully created port: 6ce8849e-50a1-4b8a-bf75-1016ef3c2315 {{(pid=85141) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 10:10:32 user nova-compute[85141]: DEBUG nova.network.neutron [None req-efd6cff3-9f97-4572-8f80-b6e15aa4b080 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] [instance: 9411843f-4e79-46c4-ae02-01f5e87b86eb] Successfully updated port: 1202aa6f-6442-4e95-bf51-66f977a23e01 {{(pid=85141) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 10:10:32 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-efd6cff3-9f97-4572-8f80-b6e15aa4b080 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Acquiring lock "refresh_cache-9411843f-4e79-46c4-ae02-01f5e87b86eb" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:10:32 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-efd6cff3-9f97-4572-8f80-b6e15aa4b080 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Acquired lock "refresh_cache-9411843f-4e79-46c4-ae02-01f5e87b86eb" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:10:32 user nova-compute[85141]: DEBUG nova.network.neutron [None req-efd6cff3-9f97-4572-8f80-b6e15aa4b080 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] [instance: 9411843f-4e79-46c4-ae02-01f5e87b86eb] Building network info cache for instance {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 10:10:32 user nova-compute[85141]: DEBUG nova.network.neutron [None req-efd6cff3-9f97-4572-8f80-b6e15aa4b080 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] [instance: 9411843f-4e79-46c4-ae02-01f5e87b86eb] Instance cache missing network info. {{(pid=85141) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 10:10:32 user nova-compute[85141]: DEBUG nova.compute.manager [req-9adeb76b-a8c3-4be9-8cf8-bc193c7143fd req-fdd6834f-a2a8-4b97-9835-134982175a46 service nova] [instance: 9411843f-4e79-46c4-ae02-01f5e87b86eb] Received event network-changed-1202aa6f-6442-4e95-bf51-66f977a23e01 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:10:32 user nova-compute[85141]: DEBUG nova.compute.manager [req-9adeb76b-a8c3-4be9-8cf8-bc193c7143fd req-fdd6834f-a2a8-4b97-9835-134982175a46 service nova] [instance: 9411843f-4e79-46c4-ae02-01f5e87b86eb] Refreshing instance network info cache due to event network-changed-1202aa6f-6442-4e95-bf51-66f977a23e01. {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 10:10:32 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-9adeb76b-a8c3-4be9-8cf8-bc193c7143fd req-fdd6834f-a2a8-4b97-9835-134982175a46 service nova] Acquiring lock "refresh_cache-9411843f-4e79-46c4-ae02-01f5e87b86eb" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:10:33 user nova-compute[85141]: DEBUG nova.network.neutron [None req-ce0015fa-dfda-4a9e-958b-2122ace9edea tempest-DeleteServersTestJSON-1770650847 tempest-DeleteServersTestJSON-1770650847-project-member] [instance: a4cdcb5b-b2a6-4736-85c8-7e6cdab8c9b1] Successfully updated port: 07d06a88-cd34-412f-9b4d-b9fa94247dd4 {{(pid=85141) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 10:10:33 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-ce0015fa-dfda-4a9e-958b-2122ace9edea tempest-DeleteServersTestJSON-1770650847 tempest-DeleteServersTestJSON-1770650847-project-member] Acquiring lock "refresh_cache-a4cdcb5b-b2a6-4736-85c8-7e6cdab8c9b1" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:10:33 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-ce0015fa-dfda-4a9e-958b-2122ace9edea tempest-DeleteServersTestJSON-1770650847 tempest-DeleteServersTestJSON-1770650847-project-member] Acquired lock "refresh_cache-a4cdcb5b-b2a6-4736-85c8-7e6cdab8c9b1" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:10:33 user nova-compute[85141]: DEBUG nova.network.neutron [None req-ce0015fa-dfda-4a9e-958b-2122ace9edea tempest-DeleteServersTestJSON-1770650847 tempest-DeleteServersTestJSON-1770650847-project-member] [instance: a4cdcb5b-b2a6-4736-85c8-7e6cdab8c9b1] Building network info cache for instance {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 10:10:33 user nova-compute[85141]: DEBUG nova.network.neutron [None req-72b51cf3-8112-4a97-abff-d81405d395de tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] [instance: e65ccf79-718d-4eeb-8914-f0db2e2c9ce2] Successfully updated port: 9b681ac7-3246-4ff4-8691-f8e4f1d62061 {{(pid=85141) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 10:10:33 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-72b51cf3-8112-4a97-abff-d81405d395de tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Acquiring lock "refresh_cache-e65ccf79-718d-4eeb-8914-f0db2e2c9ce2" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:10:33 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-72b51cf3-8112-4a97-abff-d81405d395de tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Acquired lock "refresh_cache-e65ccf79-718d-4eeb-8914-f0db2e2c9ce2" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:10:33 user nova-compute[85141]: DEBUG nova.network.neutron [None req-72b51cf3-8112-4a97-abff-d81405d395de tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] [instance: e65ccf79-718d-4eeb-8914-f0db2e2c9ce2] Building network info cache for instance {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 10:10:33 user nova-compute[85141]: DEBUG nova.network.neutron [None req-efd6cff3-9f97-4572-8f80-b6e15aa4b080 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] [instance: 9411843f-4e79-46c4-ae02-01f5e87b86eb] Updating instance_info_cache with network_info: [{"id": "1202aa6f-6442-4e95-bf51-66f977a23e01", "address": "fa:16:3e:d8:53:c3", "network": {"id": "4fb7c85e-c966-481d-b6f2-856a17ac8f7c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-81570496-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08ef12fb41a14ecd8abb84d4d69b7c27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1202aa6f-64", "ovs_interfaceid": "1202aa6f-6442-4e95-bf51-66f977a23e01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:10:33 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-efd6cff3-9f97-4572-8f80-b6e15aa4b080 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Releasing lock "refresh_cache-9411843f-4e79-46c4-ae02-01f5e87b86eb" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:10:33 user nova-compute[85141]: DEBUG nova.compute.manager [None req-efd6cff3-9f97-4572-8f80-b6e15aa4b080 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] [instance: 9411843f-4e79-46c4-ae02-01f5e87b86eb] Instance network_info: |[{"id": "1202aa6f-6442-4e95-bf51-66f977a23e01", "address": "fa:16:3e:d8:53:c3", "network": {"id": "4fb7c85e-c966-481d-b6f2-856a17ac8f7c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-81570496-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08ef12fb41a14ecd8abb84d4d69b7c27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1202aa6f-64", "ovs_interfaceid": "1202aa6f-6442-4e95-bf51-66f977a23e01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=85141) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 10:10:33 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-9adeb76b-a8c3-4be9-8cf8-bc193c7143fd req-fdd6834f-a2a8-4b97-9835-134982175a46 service nova] Acquired lock "refresh_cache-9411843f-4e79-46c4-ae02-01f5e87b86eb" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:10:33 user nova-compute[85141]: DEBUG nova.network.neutron [req-9adeb76b-a8c3-4be9-8cf8-bc193c7143fd req-fdd6834f-a2a8-4b97-9835-134982175a46 service nova] [instance: 9411843f-4e79-46c4-ae02-01f5e87b86eb] Refreshing network info cache for port 1202aa6f-6442-4e95-bf51-66f977a23e01 {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 10:10:33 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-efd6cff3-9f97-4572-8f80-b6e15aa4b080 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] [instance: 9411843f-4e79-46c4-ae02-01f5e87b86eb] Start _get_guest_xml network_info=[{"id": "1202aa6f-6442-4e95-bf51-66f977a23e01", "address": "fa:16:3e:d8:53:c3", "network": {"id": "4fb7c85e-c966-481d-b6f2-856a17ac8f7c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-81570496-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08ef12fb41a14ecd8abb84d4d69b7c27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1202aa6f-64", "ovs_interfaceid": "1202aa6f-6442-4e95-bf51-66f977a23e01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T10:06:42Z,direct_url=<?>,disk_format='qcow2',id=bc4ca70f-a459-4d5c-a9e6-80f1948eb48b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1044631a5fe84ce8904864a7024049fa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T10:06:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_options': None, 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'image_id': 'bc4ca70f-a459-4d5c-a9e6-80f1948eb48b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=85141) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 10:10:33 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-efd6cff3-9f97-4572-8f80-b6e15aa4b080 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:10:33 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-efd6cff3-9f97-4572-8f80-b6e15aa4b080 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:10:33 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-efd6cff3-9f97-4572-8f80-b6e15aa4b080 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=85141) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 10:10:33 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-efd6cff3-9f97-4572-8f80-b6e15aa4b080 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] CPU controller missing on host. {{(pid=85141) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 10:10:33 user nova-compute[85141]: DEBUG nova.network.neutron [None req-ce0015fa-dfda-4a9e-958b-2122ace9edea tempest-DeleteServersTestJSON-1770650847 tempest-DeleteServersTestJSON-1770650847-project-member] [instance: a4cdcb5b-b2a6-4736-85c8-7e6cdab8c9b1] Instance cache missing network info. {{(pid=85141) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 10:10:33 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-efd6cff3-9f97-4572-8f80-b6e15aa4b080 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=85141) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 10:10:33 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-efd6cff3-9f97-4572-8f80-b6e15aa4b080 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] CPU controller found on host. {{(pid=85141) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 10:10:33 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-efd6cff3-9f97-4572-8f80-b6e15aa4b080 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=85141) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 10:10:33 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-efd6cff3-9f97-4572-8f80-b6e15aa4b080 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T10:06:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T10:06:42Z,direct_url=<?>,disk_format='qcow2',id=bc4ca70f-a459-4d5c-a9e6-80f1948eb48b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1044631a5fe84ce8904864a7024049fa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T10:06:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 10:10:33 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-efd6cff3-9f97-4572-8f80-b6e15aa4b080 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Flavor limits 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 10:10:33 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-efd6cff3-9f97-4572-8f80-b6e15aa4b080 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Image limits 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 10:10:33 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-efd6cff3-9f97-4572-8f80-b6e15aa4b080 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Flavor pref 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 10:10:33 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-efd6cff3-9f97-4572-8f80-b6e15aa4b080 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Image pref 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 10:10:33 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-efd6cff3-9f97-4572-8f80-b6e15aa4b080 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 10:10:33 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-efd6cff3-9f97-4572-8f80-b6e15aa4b080 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 10:10:33 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-efd6cff3-9f97-4572-8f80-b6e15aa4b080 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=85141) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 10:10:33 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-efd6cff3-9f97-4572-8f80-b6e15aa4b080 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Got 1 possible topologies {{(pid=85141) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 10:10:33 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-efd6cff3-9f97-4572-8f80-b6e15aa4b080 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 10:10:33 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-efd6cff3-9f97-4572-8f80-b6e15aa4b080 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 10:10:33 user nova-compute[85141]: DEBUG nova.privsep.utils [None req-efd6cff3-9f97-4572-8f80-b6e15aa4b080 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=85141) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 16 10:10:34 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-efd6cff3-9f97-4572-8f80-b6e15aa4b080 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T10:10:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1837935474',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1837935474',id=2,image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDZ6OQWFvlLe2wQphLZxkaPqNwOm4LuvszQn47QWt1pnsQT48lGZZPuN+vNqHjXg4YMzV5iYuL9EDBblOYEFH3rsRxMRAcwHPoeiCg27oMofk7nAiSjMmEYKp5XhsvlmDA==',key_name='tempest-keypair-1893617844',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='08ef12fb41a14ecd8abb84d4d69b7c27',ramdisk_id='',reservation_id='r-g9gqfs85',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-958501663',owner_user_name='tempest-AttachVolumeShelveTestJSON-958501663-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T10:10:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='baec48c887ae4a418e0ea7b32b05bc59',uuid=9411843f-4e79-46c4-ae02-01f5e87b86eb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1202aa6f-6442-4e95-bf51-66f977a23e01", "address": "fa:16:3e:d8:53:c3", "network": {"id": "4fb7c85e-c966-481d-b6f2-856a17ac8f7c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-81570496-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08ef12fb41a14ecd8abb84d4d69b7c27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1202aa6f-64", "ovs_interfaceid": "1202aa6f-6442-4e95-bf51-66f977a23e01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=85141) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 10:10:34 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-efd6cff3-9f97-4572-8f80-b6e15aa4b080 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Converting VIF {"id": "1202aa6f-6442-4e95-bf51-66f977a23e01", "address": "fa:16:3e:d8:53:c3", "network": {"id": "4fb7c85e-c966-481d-b6f2-856a17ac8f7c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-81570496-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08ef12fb41a14ecd8abb84d4d69b7c27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1202aa6f-64", "ovs_interfaceid": "1202aa6f-6442-4e95-bf51-66f977a23e01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:10:34 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-efd6cff3-9f97-4572-8f80-b6e15aa4b080 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d8:53:c3,bridge_name='br-int',has_traffic_filtering=True,id=1202aa6f-6442-4e95-bf51-66f977a23e01,network=Network(4fb7c85e-c966-481d-b6f2-856a17ac8f7c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1202aa6f-64') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:10:34 user nova-compute[85141]: DEBUG nova.objects.instance [None req-efd6cff3-9f97-4572-8f80-b6e15aa4b080 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Lazy-loading 'pci_devices' on Instance uuid 9411843f-4e79-46c4-ae02-01f5e87b86eb {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:10:34 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-efd6cff3-9f97-4572-8f80-b6e15aa4b080 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] [instance: 9411843f-4e79-46c4-ae02-01f5e87b86eb] End _get_guest_xml xml=<domain type="kvm">
Nov 16 10:10:34 user nova-compute[85141]:   <uuid>9411843f-4e79-46c4-ae02-01f5e87b86eb</uuid>
Nov 16 10:10:34 user nova-compute[85141]:   <name>instance-00000002</name>
Nov 16 10:10:34 user nova-compute[85141]:   <memory>524288</memory>
Nov 16 10:10:34 user nova-compute[85141]:   <vcpu>1</vcpu>
Nov 16 10:10:34 user nova-compute[85141]:   <metadata>
Nov 16 10:10:34 user nova-compute[85141]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 10:10:34 user nova-compute[85141]:       <nova:package version="0.0.0"/>
Nov 16 10:10:34 user nova-compute[85141]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1837935474</nova:name>
Nov 16 10:10:34 user nova-compute[85141]:       <nova:creationTime>2023-11-16 10:10:33</nova:creationTime>
Nov 16 10:10:34 user nova-compute[85141]:       <nova:flavor name="m1.tiny">
Nov 16 10:10:34 user nova-compute[85141]:         <nova:memory>512</nova:memory>
Nov 16 10:10:34 user nova-compute[85141]:         <nova:disk>1</nova:disk>
Nov 16 10:10:34 user nova-compute[85141]:         <nova:swap>0</nova:swap>
Nov 16 10:10:34 user nova-compute[85141]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 10:10:34 user nova-compute[85141]:         <nova:vcpus>1</nova:vcpus>
Nov 16 10:10:34 user nova-compute[85141]:       </nova:flavor>
Nov 16 10:10:34 user nova-compute[85141]:       <nova:owner>
Nov 16 10:10:34 user nova-compute[85141]:         <nova:user uuid="baec48c887ae4a418e0ea7b32b05bc59">tempest-AttachVolumeShelveTestJSON-958501663-project-member</nova:user>
Nov 16 10:10:34 user nova-compute[85141]:         <nova:project uuid="08ef12fb41a14ecd8abb84d4d69b7c27">tempest-AttachVolumeShelveTestJSON-958501663</nova:project>
Nov 16 10:10:34 user nova-compute[85141]:       </nova:owner>
Nov 16 10:10:34 user nova-compute[85141]:       <nova:root type="image" uuid="bc4ca70f-a459-4d5c-a9e6-80f1948eb48b"/>
Nov 16 10:10:34 user nova-compute[85141]:       <nova:ports>
Nov 16 10:10:34 user nova-compute[85141]:         <nova:port uuid="1202aa6f-6442-4e95-bf51-66f977a23e01">
Nov 16 10:10:34 user nova-compute[85141]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 16 10:10:34 user nova-compute[85141]:         </nova:port>
Nov 16 10:10:34 user nova-compute[85141]:       </nova:ports>
Nov 16 10:10:34 user nova-compute[85141]:     </nova:instance>
Nov 16 10:10:34 user nova-compute[85141]:   </metadata>
Nov 16 10:10:34 user nova-compute[85141]:   <sysinfo type="smbios">
Nov 16 10:10:34 user nova-compute[85141]:     <system>
Nov 16 10:10:34 user nova-compute[85141]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 10:10:34 user nova-compute[85141]:       <entry name="product">OpenStack Nova</entry>
Nov 16 10:10:34 user nova-compute[85141]:       <entry name="version">0.0.0</entry>
Nov 16 10:10:34 user nova-compute[85141]:       <entry name="serial">9411843f-4e79-46c4-ae02-01f5e87b86eb</entry>
Nov 16 10:10:34 user nova-compute[85141]:       <entry name="uuid">9411843f-4e79-46c4-ae02-01f5e87b86eb</entry>
Nov 16 10:10:34 user nova-compute[85141]:       <entry name="family">Virtual Machine</entry>
Nov 16 10:10:34 user nova-compute[85141]:     </system>
Nov 16 10:10:34 user nova-compute[85141]:   </sysinfo>
Nov 16 10:10:34 user nova-compute[85141]:   <os>
Nov 16 10:10:34 user nova-compute[85141]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 10:10:34 user nova-compute[85141]:     <boot dev="hd"/>
Nov 16 10:10:34 user nova-compute[85141]:     <smbios mode="sysinfo"/>
Nov 16 10:10:34 user nova-compute[85141]:   </os>
Nov 16 10:10:34 user nova-compute[85141]:   <features>
Nov 16 10:10:34 user nova-compute[85141]:     <acpi/>
Nov 16 10:10:34 user nova-compute[85141]:     <apic/>
Nov 16 10:10:34 user nova-compute[85141]:     <vmcoreinfo/>
Nov 16 10:10:34 user nova-compute[85141]:   </features>
Nov 16 10:10:34 user nova-compute[85141]:   <clock offset="utc">
Nov 16 10:10:34 user nova-compute[85141]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 10:10:34 user nova-compute[85141]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 10:10:34 user nova-compute[85141]:     <timer name="hpet" present="no"/>
Nov 16 10:10:34 user nova-compute[85141]:   </clock>
Nov 16 10:10:34 user nova-compute[85141]:   <cpu mode="custom" match="exact">
Nov 16 10:10:34 user nova-compute[85141]:     <model>Nehalem</model>
Nov 16 10:10:34 user nova-compute[85141]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 10:10:34 user nova-compute[85141]:   </cpu>
Nov 16 10:10:34 user nova-compute[85141]:   <devices>
Nov 16 10:10:34 user nova-compute[85141]:     <disk type="file" device="disk">
Nov 16 10:10:34 user nova-compute[85141]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 10:10:34 user nova-compute[85141]:       <source file="/opt/stack/data/nova/instances/9411843f-4e79-46c4-ae02-01f5e87b86eb/disk"/>
Nov 16 10:10:34 user nova-compute[85141]:       <target dev="vda" bus="virtio"/>
Nov 16 10:10:34 user nova-compute[85141]:     </disk>
Nov 16 10:10:34 user nova-compute[85141]:     <interface type="ethernet">
Nov 16 10:10:34 user nova-compute[85141]:       <mac address="fa:16:3e:d8:53:c3"/>
Nov 16 10:10:34 user nova-compute[85141]:       <model type="virtio"/>
Nov 16 10:10:34 user nova-compute[85141]:       <mtu size="1442"/>
Nov 16 10:10:34 user nova-compute[85141]:       <target dev="tap1202aa6f-64"/>
Nov 16 10:10:34 user nova-compute[85141]:     </interface>
Nov 16 10:10:34 user nova-compute[85141]:     <serial type="pty">
Nov 16 10:10:34 user nova-compute[85141]:       <log file="/opt/stack/data/nova/instances/9411843f-4e79-46c4-ae02-01f5e87b86eb/console.log" append="off"/>
Nov 16 10:10:34 user nova-compute[85141]:     </serial>
Nov 16 10:10:34 user nova-compute[85141]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 10:10:34 user nova-compute[85141]:     <video>
Nov 16 10:10:34 user nova-compute[85141]:       <model type="virtio"/>
Nov 16 10:10:34 user nova-compute[85141]:     </video>
Nov 16 10:10:34 user nova-compute[85141]:     <rng model="virtio">
Nov 16 10:10:34 user nova-compute[85141]:       <backend model="random">/dev/urandom</backend>
Nov 16 10:10:34 user nova-compute[85141]:     </rng>
Nov 16 10:10:34 user nova-compute[85141]:     <controller type="usb" index="0" model="none"/>
Nov 16 10:10:34 user nova-compute[85141]:     <memballoon model="virtio">
Nov 16 10:10:34 user nova-compute[85141]:       <stats period="10"/>
Nov 16 10:10:34 user nova-compute[85141]:     </memballoon>
Nov 16 10:10:34 user nova-compute[85141]:   </devices>
Nov 16 10:10:34 user nova-compute[85141]: </domain>
Nov 16 10:10:34 user nova-compute[85141]:  {{(pid=85141) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 10:10:34 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-efd6cff3-9f97-4572-8f80-b6e15aa4b080 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T10:10:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1837935474',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1837935474',id=2,image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDZ6OQWFvlLe2wQphLZxkaPqNwOm4LuvszQn47QWt1pnsQT48lGZZPuN+vNqHjXg4YMzV5iYuL9EDBblOYEFH3rsRxMRAcwHPoeiCg27oMofk7nAiSjMmEYKp5XhsvlmDA==',key_name='tempest-keypair-1893617844',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='08ef12fb41a14ecd8abb84d4d69b7c27',ramdisk_id='',reservation_id='r-g9gqfs85',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-958501663',owner_user_name='tempest-AttachVolumeShelveTestJSON-958501663-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T10:10:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='baec48c887ae4a418e0ea7b32b05bc59',uuid=9411843f-4e79-46c4-ae02-01f5e87b86eb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1202aa6f-6442-4e95-bf51-66f977a23e01", "address": "fa:16:3e:d8:53:c3", "network": {"id": "4fb7c85e-c966-481d-b6f2-856a17ac8f7c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-81570496-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08ef12fb41a14ecd8abb84d4d69b7c27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1202aa6f-64", "ovs_interfaceid": "1202aa6f-6442-4e95-bf51-66f977a23e01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 10:10:34 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-efd6cff3-9f97-4572-8f80-b6e15aa4b080 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Converting VIF {"id": "1202aa6f-6442-4e95-bf51-66f977a23e01", "address": "fa:16:3e:d8:53:c3", "network": {"id": "4fb7c85e-c966-481d-b6f2-856a17ac8f7c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-81570496-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08ef12fb41a14ecd8abb84d4d69b7c27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1202aa6f-64", "ovs_interfaceid": "1202aa6f-6442-4e95-bf51-66f977a23e01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:10:34 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-efd6cff3-9f97-4572-8f80-b6e15aa4b080 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d8:53:c3,bridge_name='br-int',has_traffic_filtering=True,id=1202aa6f-6442-4e95-bf51-66f977a23e01,network=Network(4fb7c85e-c966-481d-b6f2-856a17ac8f7c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1202aa6f-64') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:10:34 user nova-compute[85141]: DEBUG os_vif [None req-efd6cff3-9f97-4572-8f80-b6e15aa4b080 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:53:c3,bridge_name='br-int',has_traffic_filtering=True,id=1202aa6f-6442-4e95-bf51-66f977a23e01,network=Network(4fb7c85e-c966-481d-b6f2-856a17ac8f7c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1202aa6f-64') {{(pid=85141) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 10:10:34 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl [None req-efd6cff3-9f97-4572-8f80-b6e15aa4b080 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Created schema index Interface.name {{(pid=85141) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 16 10:10:34 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl [None req-efd6cff3-9f97-4572-8f80-b6e15aa4b080 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Created schema index Port.name {{(pid=85141) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 16 10:10:34 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl [None req-efd6cff3-9f97-4572-8f80-b6e15aa4b080 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Created schema index Bridge.name {{(pid=85141) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 16 10:10:34 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-efd6cff3-9f97-4572-8f80-b6e15aa4b080 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=85141) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 10:10:34 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-efd6cff3-9f97-4572-8f80-b6e15aa4b080 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] [POLLOUT] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:10:34 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-efd6cff3-9f97-4572-8f80-b6e15aa4b080 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=85141) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 10:10:34 user nova-compute[85141]: DEBUG nova.network.neutron [None req-72b51cf3-8112-4a97-abff-d81405d395de tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] [instance: e65ccf79-718d-4eeb-8914-f0db2e2c9ce2] Instance cache missing network info. {{(pid=85141) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 10:10:34 user nova-compute[85141]: DEBUG nova.compute.manager [req-f17964de-7db0-4d00-9b96-206a45f3a2dc req-c7846e71-2285-4a65-95d6-dd48d43a9fe5 service nova] [instance: a4cdcb5b-b2a6-4736-85c8-7e6cdab8c9b1] Received event network-changed-07d06a88-cd34-412f-9b4d-b9fa94247dd4 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:10:34 user nova-compute[85141]: DEBUG nova.compute.manager [req-f17964de-7db0-4d00-9b96-206a45f3a2dc req-c7846e71-2285-4a65-95d6-dd48d43a9fe5 service nova] [instance: a4cdcb5b-b2a6-4736-85c8-7e6cdab8c9b1] Refreshing instance network info cache due to event network-changed-07d06a88-cd34-412f-9b4d-b9fa94247dd4. {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 10:10:34 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-f17964de-7db0-4d00-9b96-206a45f3a2dc req-c7846e71-2285-4a65-95d6-dd48d43a9fe5 service nova] Acquiring lock "refresh_cache-a4cdcb5b-b2a6-4736-85c8-7e6cdab8c9b1" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:10:34 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-efd6cff3-9f97-4572-8f80-b6e15aa4b080 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:10:34 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-efd6cff3-9f97-4572-8f80-b6e15aa4b080 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:10:34 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-efd6cff3-9f97-4572-8f80-b6e15aa4b080 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:10:34 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:10:34 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:10:34 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 10:10:34 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:10:34 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c61d0807-e43a-5cd0-b4aa-bc68b1fd8bab', '_type': 'linux-noop'}}, row=False) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:10:34 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:10:34 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:10:34 user nova-compute[85141]: INFO oslo.privsep.daemon [None req-efd6cff3-9f97-4572-8f80-b6e15aa4b080 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmp_w16k31b/privsep.sock']
Nov 16 10:10:34 user sudo[94511]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmp_w16k31b/privsep.sock
Nov 16 10:10:34 user sudo[94511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 16 10:10:34 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:10:35 user nova-compute[85141]: DEBUG nova.compute.manager [req-8970defd-f289-4297-84da-9bb005e2a34e req-94ebb628-ff68-491a-b603-ca87eb5c7c0e service nova] [instance: e65ccf79-718d-4eeb-8914-f0db2e2c9ce2] Received event network-changed-9b681ac7-3246-4ff4-8691-f8e4f1d62061 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:10:35 user nova-compute[85141]: DEBUG nova.compute.manager [req-8970defd-f289-4297-84da-9bb005e2a34e req-94ebb628-ff68-491a-b603-ca87eb5c7c0e service nova] [instance: e65ccf79-718d-4eeb-8914-f0db2e2c9ce2] Refreshing instance network info cache due to event network-changed-9b681ac7-3246-4ff4-8691-f8e4f1d62061. {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 10:10:35 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-8970defd-f289-4297-84da-9bb005e2a34e req-94ebb628-ff68-491a-b603-ca87eb5c7c0e service nova] Acquiring lock "refresh_cache-e65ccf79-718d-4eeb-8914-f0db2e2c9ce2" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:10:35 user nova-compute[85141]: DEBUG nova.network.neutron [None req-ce0015fa-dfda-4a9e-958b-2122ace9edea tempest-DeleteServersTestJSON-1770650847 tempest-DeleteServersTestJSON-1770650847-project-member] [instance: a4cdcb5b-b2a6-4736-85c8-7e6cdab8c9b1] Updating instance_info_cache with network_info: [{"id": "07d06a88-cd34-412f-9b4d-b9fa94247dd4", "address": "fa:16:3e:72:f5:ea", "network": {"id": "880d7e11-048f-4333-95ad-bdd45e8dcdb4", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1972699698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f28c73b00ca42309f0b679aa6f3c462", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07d06a88-cd", "ovs_interfaceid": "07d06a88-cd34-412f-9b4d-b9fa94247dd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:10:35 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-ce0015fa-dfda-4a9e-958b-2122ace9edea tempest-DeleteServersTestJSON-1770650847 tempest-DeleteServersTestJSON-1770650847-project-member] Releasing lock "refresh_cache-a4cdcb5b-b2a6-4736-85c8-7e6cdab8c9b1" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:10:35 user nova-compute[85141]: DEBUG nova.compute.manager [None req-ce0015fa-dfda-4a9e-958b-2122ace9edea tempest-DeleteServersTestJSON-1770650847 tempest-DeleteServersTestJSON-1770650847-project-member] [instance: a4cdcb5b-b2a6-4736-85c8-7e6cdab8c9b1] Instance network_info: |[{"id": "07d06a88-cd34-412f-9b4d-b9fa94247dd4", "address": "fa:16:3e:72:f5:ea", "network": {"id": "880d7e11-048f-4333-95ad-bdd45e8dcdb4", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1972699698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f28c73b00ca42309f0b679aa6f3c462", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07d06a88-cd", "ovs_interfaceid": "07d06a88-cd34-412f-9b4d-b9fa94247dd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=85141) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 10:10:35 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-f17964de-7db0-4d00-9b96-206a45f3a2dc req-c7846e71-2285-4a65-95d6-dd48d43a9fe5 service nova] Acquired lock "refresh_cache-a4cdcb5b-b2a6-4736-85c8-7e6cdab8c9b1" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:10:35 user nova-compute[85141]: DEBUG nova.network.neutron [req-f17964de-7db0-4d00-9b96-206a45f3a2dc req-c7846e71-2285-4a65-95d6-dd48d43a9fe5 service nova] [instance: a4cdcb5b-b2a6-4736-85c8-7e6cdab8c9b1] Refreshing network info cache for port 07d06a88-cd34-412f-9b4d-b9fa94247dd4 {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 10:10:35 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-ce0015fa-dfda-4a9e-958b-2122ace9edea tempest-DeleteServersTestJSON-1770650847 tempest-DeleteServersTestJSON-1770650847-project-member] [instance: a4cdcb5b-b2a6-4736-85c8-7e6cdab8c9b1] Start _get_guest_xml network_info=[{"id": "07d06a88-cd34-412f-9b4d-b9fa94247dd4", "address": "fa:16:3e:72:f5:ea", "network": {"id": "880d7e11-048f-4333-95ad-bdd45e8dcdb4", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1972699698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f28c73b00ca42309f0b679aa6f3c462", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07d06a88-cd", "ovs_interfaceid": "07d06a88-cd34-412f-9b4d-b9fa94247dd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T10:06:42Z,direct_url=<?>,disk_format='qcow2',id=bc4ca70f-a459-4d5c-a9e6-80f1948eb48b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1044631a5fe84ce8904864a7024049fa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T10:06:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_options': None, 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'image_id': 'bc4ca70f-a459-4d5c-a9e6-80f1948eb48b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=85141) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 10:10:35 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-ce0015fa-dfda-4a9e-958b-2122ace9edea tempest-DeleteServersTestJSON-1770650847 tempest-DeleteServersTestJSON-1770650847-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:10:35 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-ce0015fa-dfda-4a9e-958b-2122ace9edea tempest-DeleteServersTestJSON-1770650847 tempest-DeleteServersTestJSON-1770650847-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:10:35 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-ce0015fa-dfda-4a9e-958b-2122ace9edea tempest-DeleteServersTestJSON-1770650847 tempest-DeleteServersTestJSON-1770650847-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=85141) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 10:10:35 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-ce0015fa-dfda-4a9e-958b-2122ace9edea tempest-DeleteServersTestJSON-1770650847 tempest-DeleteServersTestJSON-1770650847-project-member] CPU controller missing on host. {{(pid=85141) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 10:10:35 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-ce0015fa-dfda-4a9e-958b-2122ace9edea tempest-DeleteServersTestJSON-1770650847 tempest-DeleteServersTestJSON-1770650847-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=85141) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 10:10:35 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-ce0015fa-dfda-4a9e-958b-2122ace9edea tempest-DeleteServersTestJSON-1770650847 tempest-DeleteServersTestJSON-1770650847-project-member] CPU controller found on host. {{(pid=85141) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 10:10:35 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-ce0015fa-dfda-4a9e-958b-2122ace9edea tempest-DeleteServersTestJSON-1770650847 tempest-DeleteServersTestJSON-1770650847-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=85141) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 10:10:35 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-ce0015fa-dfda-4a9e-958b-2122ace9edea tempest-DeleteServersTestJSON-1770650847 tempest-DeleteServersTestJSON-1770650847-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T10:06:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T10:06:42Z,direct_url=<?>,disk_format='qcow2',id=bc4ca70f-a459-4d5c-a9e6-80f1948eb48b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1044631a5fe84ce8904864a7024049fa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T10:06:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 10:10:35 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-ce0015fa-dfda-4a9e-958b-2122ace9edea tempest-DeleteServersTestJSON-1770650847 tempest-DeleteServersTestJSON-1770650847-project-member] Flavor limits 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 10:10:35 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-ce0015fa-dfda-4a9e-958b-2122ace9edea tempest-DeleteServersTestJSON-1770650847 tempest-DeleteServersTestJSON-1770650847-project-member] Image limits 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 10:10:35 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-ce0015fa-dfda-4a9e-958b-2122ace9edea tempest-DeleteServersTestJSON-1770650847 tempest-DeleteServersTestJSON-1770650847-project-member] Flavor pref 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 10:10:35 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-ce0015fa-dfda-4a9e-958b-2122ace9edea tempest-DeleteServersTestJSON-1770650847 tempest-DeleteServersTestJSON-1770650847-project-member] Image pref 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 10:10:35 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-ce0015fa-dfda-4a9e-958b-2122ace9edea tempest-DeleteServersTestJSON-1770650847 tempest-DeleteServersTestJSON-1770650847-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 10:10:35 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-ce0015fa-dfda-4a9e-958b-2122ace9edea tempest-DeleteServersTestJSON-1770650847 tempest-DeleteServersTestJSON-1770650847-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 10:10:35 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-ce0015fa-dfda-4a9e-958b-2122ace9edea tempest-DeleteServersTestJSON-1770650847 tempest-DeleteServersTestJSON-1770650847-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=85141) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 10:10:35 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-ce0015fa-dfda-4a9e-958b-2122ace9edea tempest-DeleteServersTestJSON-1770650847 tempest-DeleteServersTestJSON-1770650847-project-member] Got 1 possible topologies {{(pid=85141) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 10:10:35 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-ce0015fa-dfda-4a9e-958b-2122ace9edea tempest-DeleteServersTestJSON-1770650847 tempest-DeleteServersTestJSON-1770650847-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 10:10:35 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-ce0015fa-dfda-4a9e-958b-2122ace9edea tempest-DeleteServersTestJSON-1770650847 tempest-DeleteServersTestJSON-1770650847-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 10:10:35 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-ce0015fa-dfda-4a9e-958b-2122ace9edea tempest-DeleteServersTestJSON-1770650847 tempest-DeleteServersTestJSON-1770650847-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T10:10:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1583048707',display_name='tempest-DeleteServersTestJSON-server-1583048707',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1583048707',id=1,image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3f28c73b00ca42309f0b679aa6f3c462',ramdisk_id='',reservation_id='r-f1oyexj3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1770650847',owner_user_name='tempest-DeleteServersTestJSON-1770650847-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T10:10:26Z,user_data=None,user_id='5fc967d7a8f44656877c2973399becbf',uuid=a4cdcb5b-b2a6-4736-85c8-7e6cdab8c9b1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "07d06a88-cd34-412f-9b4d-b9fa94247dd4", "address": "fa:16:3e:72:f5:ea", "network": {"id": "880d7e11-048f-4333-95ad-bdd45e8dcdb4", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1972699698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f28c73b00ca42309f0b679aa6f3c462", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07d06a88-cd", "ovs_interfaceid": "07d06a88-cd34-412f-9b4d-b9fa94247dd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=85141) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 10:10:35 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-ce0015fa-dfda-4a9e-958b-2122ace9edea tempest-DeleteServersTestJSON-1770650847 tempest-DeleteServersTestJSON-1770650847-project-member] Converting VIF {"id": "07d06a88-cd34-412f-9b4d-b9fa94247dd4", "address": "fa:16:3e:72:f5:ea", "network": {"id": "880d7e11-048f-4333-95ad-bdd45e8dcdb4", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1972699698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f28c73b00ca42309f0b679aa6f3c462", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07d06a88-cd", "ovs_interfaceid": "07d06a88-cd34-412f-9b4d-b9fa94247dd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:10:35 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-ce0015fa-dfda-4a9e-958b-2122ace9edea tempest-DeleteServersTestJSON-1770650847 tempest-DeleteServersTestJSON-1770650847-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:72:f5:ea,bridge_name='br-int',has_traffic_filtering=True,id=07d06a88-cd34-412f-9b4d-b9fa94247dd4,network=Network(880d7e11-048f-4333-95ad-bdd45e8dcdb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07d06a88-cd') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:10:35 user nova-compute[85141]: DEBUG nova.objects.instance [None req-ce0015fa-dfda-4a9e-958b-2122ace9edea tempest-DeleteServersTestJSON-1770650847 tempest-DeleteServersTestJSON-1770650847-project-member] Lazy-loading 'pci_devices' on Instance uuid a4cdcb5b-b2a6-4736-85c8-7e6cdab8c9b1 {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:10:35 user nova-compute[85141]: DEBUG nova.network.neutron [None req-72b51cf3-8112-4a97-abff-d81405d395de tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] [instance: e65ccf79-718d-4eeb-8914-f0db2e2c9ce2] Updating instance_info_cache with network_info: [{"id": "9b681ac7-3246-4ff4-8691-f8e4f1d62061", "address": "fa:16:3e:ce:f3:cd", "network": {"id": "ac11f3ed-4c14-4051-aff5-44d400d6368c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-679726958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7044a386486d4426bcccfe0b7d225c80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b681ac7-32", "ovs_interfaceid": "9b681ac7-3246-4ff4-8691-f8e4f1d62061", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:10:35 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-ce0015fa-dfda-4a9e-958b-2122ace9edea tempest-DeleteServersTestJSON-1770650847 tempest-DeleteServersTestJSON-1770650847-project-member] [instance: a4cdcb5b-b2a6-4736-85c8-7e6cdab8c9b1] End _get_guest_xml xml=<domain type="kvm">
Nov 16 10:10:35 user nova-compute[85141]:   <uuid>a4cdcb5b-b2a6-4736-85c8-7e6cdab8c9b1</uuid>
Nov 16 10:10:35 user nova-compute[85141]:   <name>instance-00000001</name>
Nov 16 10:10:35 user nova-compute[85141]:   <memory>524288</memory>
Nov 16 10:10:35 user nova-compute[85141]:   <vcpu>1</vcpu>
Nov 16 10:10:35 user nova-compute[85141]:   <metadata>
Nov 16 10:10:35 user nova-compute[85141]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 10:10:35 user nova-compute[85141]:       <nova:package version="0.0.0"/>
Nov 16 10:10:35 user nova-compute[85141]:       <nova:name>tempest-DeleteServersTestJSON-server-1583048707</nova:name>
Nov 16 10:10:35 user nova-compute[85141]:       <nova:creationTime>2023-11-16 10:10:35</nova:creationTime>
Nov 16 10:10:35 user nova-compute[85141]:       <nova:flavor name="m1.tiny">
Nov 16 10:10:35 user nova-compute[85141]:         <nova:memory>512</nova:memory>
Nov 16 10:10:35 user nova-compute[85141]:         <nova:disk>1</nova:disk>
Nov 16 10:10:35 user nova-compute[85141]:         <nova:swap>0</nova:swap>
Nov 16 10:10:35 user nova-compute[85141]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 10:10:35 user nova-compute[85141]:         <nova:vcpus>1</nova:vcpus>
Nov 16 10:10:35 user nova-compute[85141]:       </nova:flavor>
Nov 16 10:10:35 user nova-compute[85141]:       <nova:owner>
Nov 16 10:10:35 user nova-compute[85141]:         <nova:user uuid="5fc967d7a8f44656877c2973399becbf">tempest-DeleteServersTestJSON-1770650847-project-member</nova:user>
Nov 16 10:10:35 user nova-compute[85141]:         <nova:project uuid="3f28c73b00ca42309f0b679aa6f3c462">tempest-DeleteServersTestJSON-1770650847</nova:project>
Nov 16 10:10:35 user nova-compute[85141]:       </nova:owner>
Nov 16 10:10:35 user nova-compute[85141]:       <nova:root type="image" uuid="bc4ca70f-a459-4d5c-a9e6-80f1948eb48b"/>
Nov 16 10:10:35 user nova-compute[85141]:       <nova:ports>
Nov 16 10:10:35 user nova-compute[85141]:         <nova:port uuid="07d06a88-cd34-412f-9b4d-b9fa94247dd4">
Nov 16 10:10:35 user nova-compute[85141]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 16 10:10:35 user nova-compute[85141]:         </nova:port>
Nov 16 10:10:35 user nova-compute[85141]:       </nova:ports>
Nov 16 10:10:35 user nova-compute[85141]:     </nova:instance>
Nov 16 10:10:35 user nova-compute[85141]:   </metadata>
Nov 16 10:10:35 user nova-compute[85141]:   <sysinfo type="smbios">
Nov 16 10:10:35 user nova-compute[85141]:     <system>
Nov 16 10:10:35 user nova-compute[85141]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 10:10:35 user nova-compute[85141]:       <entry name="product">OpenStack Nova</entry>
Nov 16 10:10:35 user nova-compute[85141]:       <entry name="version">0.0.0</entry>
Nov 16 10:10:35 user nova-compute[85141]:       <entry name="serial">a4cdcb5b-b2a6-4736-85c8-7e6cdab8c9b1</entry>
Nov 16 10:10:35 user nova-compute[85141]:       <entry name="uuid">a4cdcb5b-b2a6-4736-85c8-7e6cdab8c9b1</entry>
Nov 16 10:10:35 user nova-compute[85141]:       <entry name="family">Virtual Machine</entry>
Nov 16 10:10:35 user nova-compute[85141]:     </system>
Nov 16 10:10:35 user nova-compute[85141]:   </sysinfo>
Nov 16 10:10:35 user nova-compute[85141]:   <os>
Nov 16 10:10:35 user nova-compute[85141]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 10:10:35 user nova-compute[85141]:     <boot dev="hd"/>
Nov 16 10:10:35 user nova-compute[85141]:     <smbios mode="sysinfo"/>
Nov 16 10:10:35 user nova-compute[85141]:   </os>
Nov 16 10:10:35 user nova-compute[85141]:   <features>
Nov 16 10:10:35 user nova-compute[85141]:     <acpi/>
Nov 16 10:10:35 user nova-compute[85141]:     <apic/>
Nov 16 10:10:35 user nova-compute[85141]:     <vmcoreinfo/>
Nov 16 10:10:35 user nova-compute[85141]:   </features>
Nov 16 10:10:35 user nova-compute[85141]:   <clock offset="utc">
Nov 16 10:10:35 user nova-compute[85141]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 10:10:35 user nova-compute[85141]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 10:10:35 user nova-compute[85141]:     <timer name="hpet" present="no"/>
Nov 16 10:10:35 user nova-compute[85141]:   </clock>
Nov 16 10:10:35 user nova-compute[85141]:   <cpu mode="custom" match="exact">
Nov 16 10:10:35 user nova-compute[85141]:     <model>Nehalem</model>
Nov 16 10:10:35 user nova-compute[85141]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 10:10:35 user nova-compute[85141]:   </cpu>
Nov 16 10:10:35 user nova-compute[85141]:   <devices>
Nov 16 10:10:35 user nova-compute[85141]:     <disk type="file" device="disk">
Nov 16 10:10:35 user nova-compute[85141]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 10:10:35 user nova-compute[85141]:       <source file="/opt/stack/data/nova/instances/a4cdcb5b-b2a6-4736-85c8-7e6cdab8c9b1/disk"/>
Nov 16 10:10:35 user nova-compute[85141]:       <target dev="vda" bus="virtio"/>
Nov 16 10:10:35 user nova-compute[85141]:     </disk>
Nov 16 10:10:35 user nova-compute[85141]:     <interface type="ethernet">
Nov 16 10:10:35 user nova-compute[85141]:       <mac address="fa:16:3e:72:f5:ea"/>
Nov 16 10:10:35 user nova-compute[85141]:       <model type="virtio"/>
Nov 16 10:10:35 user nova-compute[85141]:       <mtu size="1442"/>
Nov 16 10:10:35 user nova-compute[85141]:       <target dev="tap07d06a88-cd"/>
Nov 16 10:10:35 user nova-compute[85141]:     </interface>
Nov 16 10:10:35 user nova-compute[85141]:     <serial type="pty">
Nov 16 10:10:35 user nova-compute[85141]:       <log file="/opt/stack/data/nova/instances/a4cdcb5b-b2a6-4736-85c8-7e6cdab8c9b1/console.log" append="off"/>
Nov 16 10:10:35 user nova-compute[85141]:     </serial>
Nov 16 10:10:35 user nova-compute[85141]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 10:10:35 user nova-compute[85141]:     <video>
Nov 16 10:10:35 user nova-compute[85141]:       <model type="virtio"/>
Nov 16 10:10:35 user nova-compute[85141]:     </video>
Nov 16 10:10:35 user nova-compute[85141]:     <rng model="virtio">
Nov 16 10:10:35 user nova-compute[85141]:       <backend model="random">/dev/urandom</backend>
Nov 16 10:10:35 user nova-compute[85141]:     </rng>
Nov 16 10:10:35 user nova-compute[85141]:     <controller type="usb" index="0" model="none"/>
Nov 16 10:10:35 user nova-compute[85141]:     <memballoon model="virtio">
Nov 16 10:10:35 user nova-compute[85141]:       <stats period="10"/>
Nov 16 10:10:35 user nova-compute[85141]:     </memballoon>
Nov 16 10:10:35 user nova-compute[85141]:   </devices>
Nov 16 10:10:35 user nova-compute[85141]: </domain>
Nov 16 10:10:35 user nova-compute[85141]:  {{(pid=85141) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 10:10:35 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-ce0015fa-dfda-4a9e-958b-2122ace9edea tempest-DeleteServersTestJSON-1770650847 tempest-DeleteServersTestJSON-1770650847-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T10:10:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1583048707',display_name='tempest-DeleteServersTestJSON-server-1583048707',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1583048707',id=1,image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3f28c73b00ca42309f0b679aa6f3c462',ramdisk_id='',reservation_id='r-f1oyexj3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1770650847',owner_user_name='tempest-DeleteServersTestJSON-1770650847-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T10:10:26Z,user_data=None,user_id='5fc967d7a8f44656877c2973399becbf',uuid=a4cdcb5b-b2a6-4736-85c8-7e6cdab8c9b1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "07d06a88-cd34-412f-9b4d-b9fa94247dd4", "address": "fa:16:3e:72:f5:ea", "network": {"id": "880d7e11-048f-4333-95ad-bdd45e8dcdb4", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1972699698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f28c73b00ca42309f0b679aa6f3c462", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07d06a88-cd", "ovs_interfaceid": "07d06a88-cd34-412f-9b4d-b9fa94247dd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 10:10:35 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-ce0015fa-dfda-4a9e-958b-2122ace9edea tempest-DeleteServersTestJSON-1770650847 tempest-DeleteServersTestJSON-1770650847-project-member] Converting VIF {"id": "07d06a88-cd34-412f-9b4d-b9fa94247dd4", "address": "fa:16:3e:72:f5:ea", "network": {"id": "880d7e11-048f-4333-95ad-bdd45e8dcdb4", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1972699698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f28c73b00ca42309f0b679aa6f3c462", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07d06a88-cd", "ovs_interfaceid": "07d06a88-cd34-412f-9b4d-b9fa94247dd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:10:35 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-ce0015fa-dfda-4a9e-958b-2122ace9edea tempest-DeleteServersTestJSON-1770650847 tempest-DeleteServersTestJSON-1770650847-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:72:f5:ea,bridge_name='br-int',has_traffic_filtering=True,id=07d06a88-cd34-412f-9b4d-b9fa94247dd4,network=Network(880d7e11-048f-4333-95ad-bdd45e8dcdb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07d06a88-cd') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:10:35 user nova-compute[85141]: DEBUG os_vif [None req-ce0015fa-dfda-4a9e-958b-2122ace9edea tempest-DeleteServersTestJSON-1770650847 tempest-DeleteServersTestJSON-1770650847-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:f5:ea,bridge_name='br-int',has_traffic_filtering=True,id=07d06a88-cd34-412f-9b4d-b9fa94247dd4,network=Network(880d7e11-048f-4333-95ad-bdd45e8dcdb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07d06a88-cd') {{(pid=85141) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 10:10:35 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:10:35 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:10:35 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 10:10:35 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:10:35 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f623464e-f98c-5348-b548-89d717a14e1f', '_type': 'linux-noop'}}, row=False) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:10:35 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-72b51cf3-8112-4a97-abff-d81405d395de tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Releasing lock "refresh_cache-e65ccf79-718d-4eeb-8914-f0db2e2c9ce2" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:10:35 user nova-compute[85141]: DEBUG nova.compute.manager [None req-72b51cf3-8112-4a97-abff-d81405d395de tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] [instance: e65ccf79-718d-4eeb-8914-f0db2e2c9ce2] Instance network_info: |[{"id": "9b681ac7-3246-4ff4-8691-f8e4f1d62061", "address": "fa:16:3e:ce:f3:cd", "network": {"id": "ac11f3ed-4c14-4051-aff5-44d400d6368c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-679726958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7044a386486d4426bcccfe0b7d225c80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b681ac7-32", "ovs_interfaceid": "9b681ac7-3246-4ff4-8691-f8e4f1d62061", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=85141) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 10:10:35 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:10:35 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-8970defd-f289-4297-84da-9bb005e2a34e req-94ebb628-ff68-491a-b603-ca87eb5c7c0e service nova] Acquired lock "refresh_cache-e65ccf79-718d-4eeb-8914-f0db2e2c9ce2" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:10:35 user nova-compute[85141]: DEBUG nova.network.neutron [req-8970defd-f289-4297-84da-9bb005e2a34e req-94ebb628-ff68-491a-b603-ca87eb5c7c0e service nova] [instance: e65ccf79-718d-4eeb-8914-f0db2e2c9ce2] Refreshing network info cache for port 9b681ac7-3246-4ff4-8691-f8e4f1d62061 {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 10:10:35 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-72b51cf3-8112-4a97-abff-d81405d395de tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] [instance: e65ccf79-718d-4eeb-8914-f0db2e2c9ce2] Start _get_guest_xml network_info=[{"id": "9b681ac7-3246-4ff4-8691-f8e4f1d62061", "address": "fa:16:3e:ce:f3:cd", "network": {"id": "ac11f3ed-4c14-4051-aff5-44d400d6368c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-679726958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7044a386486d4426bcccfe0b7d225c80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b681ac7-32", "ovs_interfaceid": "9b681ac7-3246-4ff4-8691-f8e4f1d62061", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T10:06:42Z,direct_url=<?>,disk_format='qcow2',id=bc4ca70f-a459-4d5c-a9e6-80f1948eb48b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1044631a5fe84ce8904864a7024049fa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T10:06:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_options': None, 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'image_id': 'bc4ca70f-a459-4d5c-a9e6-80f1948eb48b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=85141) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 10:10:35 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:10:35 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-72b51cf3-8112-4a97-abff-d81405d395de tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:10:35 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-72b51cf3-8112-4a97-abff-d81405d395de tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:10:35 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-72b51cf3-8112-4a97-abff-d81405d395de tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=85141) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 10:10:35 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-72b51cf3-8112-4a97-abff-d81405d395de tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] CPU controller missing on host. {{(pid=85141) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 10:10:35 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-72b51cf3-8112-4a97-abff-d81405d395de tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=85141) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 10:10:35 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-72b51cf3-8112-4a97-abff-d81405d395de tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] CPU controller found on host. {{(pid=85141) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 10:10:35 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-72b51cf3-8112-4a97-abff-d81405d395de tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=85141) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 10:10:35 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-72b51cf3-8112-4a97-abff-d81405d395de tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T10:06:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T10:06:42Z,direct_url=<?>,disk_format='qcow2',id=bc4ca70f-a459-4d5c-a9e6-80f1948eb48b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1044631a5fe84ce8904864a7024049fa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T10:06:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 10:10:35 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-72b51cf3-8112-4a97-abff-d81405d395de tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Flavor limits 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 10:10:35 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-72b51cf3-8112-4a97-abff-d81405d395de tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Image limits 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 10:10:35 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-72b51cf3-8112-4a97-abff-d81405d395de tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Flavor pref 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 10:10:35 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-72b51cf3-8112-4a97-abff-d81405d395de tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Image pref 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 10:10:35 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-72b51cf3-8112-4a97-abff-d81405d395de tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 10:10:35 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-72b51cf3-8112-4a97-abff-d81405d395de tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 10:10:35 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-72b51cf3-8112-4a97-abff-d81405d395de tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=85141) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 10:10:35 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-72b51cf3-8112-4a97-abff-d81405d395de tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Got 1 possible topologies {{(pid=85141) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 10:10:35 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-72b51cf3-8112-4a97-abff-d81405d395de tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 10:10:35 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-72b51cf3-8112-4a97-abff-d81405d395de tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 10:10:35 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-72b51cf3-8112-4a97-abff-d81405d395de tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T10:10:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-2047998705',display_name='tempest-ServerActionsTestOtherB-server-2047998705',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-2047998705',id=4,image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHf5WUZHhTvllxOmAg72z1YtUbpT94pAZ2VioYM/1ZPcnLSsLgh6rPndkFT+8xfTCaDEevGxVERzODZXR4Exh9KNRXP3xfU1ZBhWrD+YWL3uQCHfG8ms6Vv5yEaXpnuCDg==',key_name='tempest-keypair-2137833999',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7044a386486d4426bcccfe0b7d225c80',ramdisk_id='',reservation_id='r-2q3wdtbp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-876168065',owner_user_name='tempest-ServerActionsTestOtherB-876168065-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T10:10:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='776d4157be1a4e56a8821d50da998475',uuid=e65ccf79-718d-4eeb-8914-f0db2e2c9ce2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9b681ac7-3246-4ff4-8691-f8e4f1d62061", "address": "fa:16:3e:ce:f3:cd", "network": {"id": "ac11f3ed-4c14-4051-aff5-44d400d6368c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-679726958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7044a386486d4426bcccfe0b7d225c80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b681ac7-32", "ovs_interfaceid": "9b681ac7-3246-4ff4-8691-f8e4f1d62061", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=85141) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 10:10:35 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-72b51cf3-8112-4a97-abff-d81405d395de tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Converting VIF {"id": "9b681ac7-3246-4ff4-8691-f8e4f1d62061", "address": "fa:16:3e:ce:f3:cd", "network": {"id": "ac11f3ed-4c14-4051-aff5-44d400d6368c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-679726958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7044a386486d4426bcccfe0b7d225c80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b681ac7-32", "ovs_interfaceid": "9b681ac7-3246-4ff4-8691-f8e4f1d62061", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:10:35 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-72b51cf3-8112-4a97-abff-d81405d395de tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ce:f3:cd,bridge_name='br-int',has_traffic_filtering=True,id=9b681ac7-3246-4ff4-8691-f8e4f1d62061,network=Network(ac11f3ed-4c14-4051-aff5-44d400d6368c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b681ac7-32') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:10:35 user nova-compute[85141]: DEBUG nova.objects.instance [None req-72b51cf3-8112-4a97-abff-d81405d395de tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Lazy-loading 'pci_devices' on Instance uuid e65ccf79-718d-4eeb-8914-f0db2e2c9ce2 {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:10:35 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-72b51cf3-8112-4a97-abff-d81405d395de tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] [instance: e65ccf79-718d-4eeb-8914-f0db2e2c9ce2] End _get_guest_xml xml=<domain type="kvm">
Nov 16 10:10:35 user nova-compute[85141]:   <uuid>e65ccf79-718d-4eeb-8914-f0db2e2c9ce2</uuid>
Nov 16 10:10:35 user nova-compute[85141]:   <name>instance-00000004</name>
Nov 16 10:10:35 user nova-compute[85141]:   <memory>524288</memory>
Nov 16 10:10:35 user nova-compute[85141]:   <vcpu>1</vcpu>
Nov 16 10:10:35 user nova-compute[85141]:   <metadata>
Nov 16 10:10:35 user nova-compute[85141]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 10:10:35 user nova-compute[85141]:       <nova:package version="0.0.0"/>
Nov 16 10:10:35 user nova-compute[85141]:       <nova:name>tempest-ServerActionsTestOtherB-server-2047998705</nova:name>
Nov 16 10:10:35 user nova-compute[85141]:       <nova:creationTime>2023-11-16 10:10:35</nova:creationTime>
Nov 16 10:10:35 user nova-compute[85141]:       <nova:flavor name="m1.tiny">
Nov 16 10:10:35 user nova-compute[85141]:         <nova:memory>512</nova:memory>
Nov 16 10:10:35 user nova-compute[85141]:         <nova:disk>1</nova:disk>
Nov 16 10:10:35 user nova-compute[85141]:         <nova:swap>0</nova:swap>
Nov 16 10:10:35 user nova-compute[85141]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 10:10:35 user nova-compute[85141]:         <nova:vcpus>1</nova:vcpus>
Nov 16 10:10:35 user nova-compute[85141]:       </nova:flavor>
Nov 16 10:10:35 user nova-compute[85141]:       <nova:owner>
Nov 16 10:10:35 user nova-compute[85141]:         <nova:user uuid="776d4157be1a4e56a8821d50da998475">tempest-ServerActionsTestOtherB-876168065-project-member</nova:user>
Nov 16 10:10:35 user nova-compute[85141]:         <nova:project uuid="7044a386486d4426bcccfe0b7d225c80">tempest-ServerActionsTestOtherB-876168065</nova:project>
Nov 16 10:10:35 user nova-compute[85141]:       </nova:owner>
Nov 16 10:10:35 user nova-compute[85141]:       <nova:root type="image" uuid="bc4ca70f-a459-4d5c-a9e6-80f1948eb48b"/>
Nov 16 10:10:35 user nova-compute[85141]:       <nova:ports>
Nov 16 10:10:35 user nova-compute[85141]:         <nova:port uuid="9b681ac7-3246-4ff4-8691-f8e4f1d62061">
Nov 16 10:10:35 user nova-compute[85141]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 16 10:10:35 user nova-compute[85141]:         </nova:port>
Nov 16 10:10:35 user nova-compute[85141]:       </nova:ports>
Nov 16 10:10:35 user nova-compute[85141]:     </nova:instance>
Nov 16 10:10:35 user nova-compute[85141]:   </metadata>
Nov 16 10:10:35 user nova-compute[85141]:   <sysinfo type="smbios">
Nov 16 10:10:35 user nova-compute[85141]:     <system>
Nov 16 10:10:35 user nova-compute[85141]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 10:10:35 user nova-compute[85141]:       <entry name="product">OpenStack Nova</entry>
Nov 16 10:10:35 user nova-compute[85141]:       <entry name="version">0.0.0</entry>
Nov 16 10:10:35 user nova-compute[85141]:       <entry name="serial">e65ccf79-718d-4eeb-8914-f0db2e2c9ce2</entry>
Nov 16 10:10:35 user nova-compute[85141]:       <entry name="uuid">e65ccf79-718d-4eeb-8914-f0db2e2c9ce2</entry>
Nov 16 10:10:35 user nova-compute[85141]:       <entry name="family">Virtual Machine</entry>
Nov 16 10:10:35 user nova-compute[85141]:     </system>
Nov 16 10:10:35 user nova-compute[85141]:   </sysinfo>
Nov 16 10:10:35 user nova-compute[85141]:   <os>
Nov 16 10:10:35 user nova-compute[85141]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 10:10:35 user nova-compute[85141]:     <boot dev="hd"/>
Nov 16 10:10:35 user nova-compute[85141]:     <smbios mode="sysinfo"/>
Nov 16 10:10:35 user nova-compute[85141]:   </os>
Nov 16 10:10:35 user nova-compute[85141]:   <features>
Nov 16 10:10:35 user nova-compute[85141]:     <acpi/>
Nov 16 10:10:35 user nova-compute[85141]:     <apic/>
Nov 16 10:10:35 user nova-compute[85141]:     <vmcoreinfo/>
Nov 16 10:10:35 user nova-compute[85141]:   </features>
Nov 16 10:10:35 user nova-compute[85141]:   <clock offset="utc">
Nov 16 10:10:35 user nova-compute[85141]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 10:10:35 user nova-compute[85141]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 10:10:35 user nova-compute[85141]:     <timer name="hpet" present="no"/>
Nov 16 10:10:35 user nova-compute[85141]:   </clock>
Nov 16 10:10:35 user nova-compute[85141]:   <cpu mode="custom" match="exact">
Nov 16 10:10:35 user nova-compute[85141]:     <model>Nehalem</model>
Nov 16 10:10:35 user nova-compute[85141]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 10:10:35 user nova-compute[85141]:   </cpu>
Nov 16 10:10:35 user nova-compute[85141]:   <devices>
Nov 16 10:10:35 user nova-compute[85141]:     <disk type="file" device="disk">
Nov 16 10:10:35 user nova-compute[85141]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 10:10:35 user nova-compute[85141]:       <source file="/opt/stack/data/nova/instances/e65ccf79-718d-4eeb-8914-f0db2e2c9ce2/disk"/>
Nov 16 10:10:35 user nova-compute[85141]:       <target dev="vda" bus="virtio"/>
Nov 16 10:10:35 user nova-compute[85141]:     </disk>
Nov 16 10:10:35 user nova-compute[85141]:     <interface type="ethernet">
Nov 16 10:10:35 user nova-compute[85141]:       <mac address="fa:16:3e:ce:f3:cd"/>
Nov 16 10:10:35 user nova-compute[85141]:       <model type="virtio"/>
Nov 16 10:10:35 user nova-compute[85141]:       <mtu size="1442"/>
Nov 16 10:10:35 user nova-compute[85141]:       <target dev="tap9b681ac7-32"/>
Nov 16 10:10:35 user nova-compute[85141]:     </interface>
Nov 16 10:10:35 user nova-compute[85141]:     <serial type="pty">
Nov 16 10:10:35 user nova-compute[85141]:       <log file="/opt/stack/data/nova/instances/e65ccf79-718d-4eeb-8914-f0db2e2c9ce2/console.log" append="off"/>
Nov 16 10:10:35 user nova-compute[85141]:     </serial>
Nov 16 10:10:35 user nova-compute[85141]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 10:10:35 user nova-compute[85141]:     <video>
Nov 16 10:10:35 user nova-compute[85141]:       <model type="virtio"/>
Nov 16 10:10:35 user nova-compute[85141]:     </video>
Nov 16 10:10:35 user nova-compute[85141]:     <rng model="virtio">
Nov 16 10:10:35 user nova-compute[85141]:       <backend model="random">/dev/urandom</backend>
Nov 16 10:10:35 user nova-compute[85141]:     </rng>
Nov 16 10:10:35 user nova-compute[85141]:     <controller type="usb" index="0" model="none"/>
Nov 16 10:10:35 user nova-compute[85141]:     <memballoon model="virtio">
Nov 16 10:10:35 user nova-compute[85141]:       <stats period="10"/>
Nov 16 10:10:35 user nova-compute[85141]:     </memballoon>
Nov 16 10:10:35 user nova-compute[85141]:   </devices>
Nov 16 10:10:35 user nova-compute[85141]: </domain>
Nov 16 10:10:35 user nova-compute[85141]:  {{(pid=85141) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 10:10:35 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-72b51cf3-8112-4a97-abff-d81405d395de tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T10:10:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-2047998705',display_name='tempest-ServerActionsTestOtherB-server-2047998705',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-2047998705',id=4,image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHf5WUZHhTvllxOmAg72z1YtUbpT94pAZ2VioYM/1ZPcnLSsLgh6rPndkFT+8xfTCaDEevGxVERzODZXR4Exh9KNRXP3xfU1ZBhWrD+YWL3uQCHfG8ms6Vv5yEaXpnuCDg==',key_name='tempest-keypair-2137833999',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7044a386486d4426bcccfe0b7d225c80',ramdisk_id='',reservation_id='r-2q3wdtbp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-876168065',owner_user_name='tempest-ServerActionsTestOtherB-876168065-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T10:10:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='776d4157be1a4e56a8821d50da998475',uuid=e65ccf79-718d-4eeb-8914-f0db2e2c9ce2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9b681ac7-3246-4ff4-8691-f8e4f1d62061", "address": "fa:16:3e:ce:f3:cd", "network": {"id": "ac11f3ed-4c14-4051-aff5-44d400d6368c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-679726958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7044a386486d4426bcccfe0b7d225c80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b681ac7-32", "ovs_interfaceid": "9b681ac7-3246-4ff4-8691-f8e4f1d62061", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 10:10:35 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-72b51cf3-8112-4a97-abff-d81405d395de tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Converting VIF {"id": "9b681ac7-3246-4ff4-8691-f8e4f1d62061", "address": "fa:16:3e:ce:f3:cd", "network": {"id": "ac11f3ed-4c14-4051-aff5-44d400d6368c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-679726958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7044a386486d4426bcccfe0b7d225c80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b681ac7-32", "ovs_interfaceid": "9b681ac7-3246-4ff4-8691-f8e4f1d62061", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:10:35 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-72b51cf3-8112-4a97-abff-d81405d395de tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ce:f3:cd,bridge_name='br-int',has_traffic_filtering=True,id=9b681ac7-3246-4ff4-8691-f8e4f1d62061,network=Network(ac11f3ed-4c14-4051-aff5-44d400d6368c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b681ac7-32') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:10:35 user nova-compute[85141]: DEBUG os_vif [None req-72b51cf3-8112-4a97-abff-d81405d395de tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:f3:cd,bridge_name='br-int',has_traffic_filtering=True,id=9b681ac7-3246-4ff4-8691-f8e4f1d62061,network=Network(ac11f3ed-4c14-4051-aff5-44d400d6368c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b681ac7-32') {{(pid=85141) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 10:10:35 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:10:35 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:10:35 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 10:10:35 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:10:35 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '35f4821b-45c4-5ae4-a8ad-c144be9ebb20', '_type': 'linux-noop'}}, row=False) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:10:35 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:10:35 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:10:35 user nova-compute[85141]: DEBUG nova.network.neutron [req-9adeb76b-a8c3-4be9-8cf8-bc193c7143fd req-fdd6834f-a2a8-4b97-9835-134982175a46 service nova] [instance: 9411843f-4e79-46c4-ae02-01f5e87b86eb] Updated VIF entry in instance network info cache for port 1202aa6f-6442-4e95-bf51-66f977a23e01. {{(pid=85141) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 10:10:35 user nova-compute[85141]: DEBUG nova.network.neutron [req-9adeb76b-a8c3-4be9-8cf8-bc193c7143fd req-fdd6834f-a2a8-4b97-9835-134982175a46 service nova] [instance: 9411843f-4e79-46c4-ae02-01f5e87b86eb] Updating instance_info_cache with network_info: [{"id": "1202aa6f-6442-4e95-bf51-66f977a23e01", "address": "fa:16:3e:d8:53:c3", "network": {"id": "4fb7c85e-c966-481d-b6f2-856a17ac8f7c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-81570496-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08ef12fb41a14ecd8abb84d4d69b7c27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1202aa6f-64", "ovs_interfaceid": "1202aa6f-6442-4e95-bf51-66f977a23e01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:10:35 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-9adeb76b-a8c3-4be9-8cf8-bc193c7143fd req-fdd6834f-a2a8-4b97-9835-134982175a46 service nova] Releasing lock "refresh_cache-9411843f-4e79-46c4-ae02-01f5e87b86eb" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:10:35 user sudo[94511]: pam_unix(sudo:session): session closed for user root
Nov 16 10:10:35 user nova-compute[85141]: INFO oslo.privsep.daemon [None req-efd6cff3-9f97-4572-8f80-b6e15aa4b080 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Spawned new privsep daemon via rootwrap
Nov 16 10:10:35 user nova-compute[85141]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 16 10:10:35 user nova-compute[85141]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 16 10:10:35 user nova-compute[85141]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Nov 16 10:10:35 user nova-compute[85141]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 94514
Nov 16 10:10:35 user nova-compute[85141]: WARNING oslo_privsep.priv_context [None req-ce0015fa-dfda-4a9e-958b-2122ace9edea tempest-DeleteServersTestJSON-1770650847 tempest-DeleteServersTestJSON-1770650847-project-member] privsep daemon already running
Nov 16 10:10:35 user nova-compute[85141]: WARNING oslo_privsep.priv_context [None req-72b51cf3-8112-4a97-abff-d81405d395de tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] privsep daemon already running
Nov 16 10:10:35 user nova-compute[85141]: DEBUG nova.network.neutron [None req-451f5472-7f7f-4464-b13c-dce06ae24a82 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] [instance: d842f90e-663b-4c95-9d7c-d092d2bac41f] Successfully updated port: 6ce8849e-50a1-4b8a-bf75-1016ef3c2315 {{(pid=85141) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 10:10:35 user nova-compute[85141]: DEBUG nova.network.neutron [req-f17964de-7db0-4d00-9b96-206a45f3a2dc req-c7846e71-2285-4a65-95d6-dd48d43a9fe5 service nova] [instance: a4cdcb5b-b2a6-4736-85c8-7e6cdab8c9b1] Updated VIF entry in instance network info cache for port 07d06a88-cd34-412f-9b4d-b9fa94247dd4. {{(pid=85141) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 10:10:35 user nova-compute[85141]: DEBUG nova.network.neutron [req-f17964de-7db0-4d00-9b96-206a45f3a2dc req-c7846e71-2285-4a65-95d6-dd48d43a9fe5 service nova] [instance: a4cdcb5b-b2a6-4736-85c8-7e6cdab8c9b1] Updating instance_info_cache with network_info: [{"id": "07d06a88-cd34-412f-9b4d-b9fa94247dd4", "address": "fa:16:3e:72:f5:ea", "network": {"id": "880d7e11-048f-4333-95ad-bdd45e8dcdb4", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1972699698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f28c73b00ca42309f0b679aa6f3c462", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07d06a88-cd", "ovs_interfaceid": "07d06a88-cd34-412f-9b4d-b9fa94247dd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:10:35 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-451f5472-7f7f-4464-b13c-dce06ae24a82 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Acquiring lock "refresh_cache-d842f90e-663b-4c95-9d7c-d092d2bac41f" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:10:35 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-451f5472-7f7f-4464-b13c-dce06ae24a82 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Acquired lock "refresh_cache-d842f90e-663b-4c95-9d7c-d092d2bac41f" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:10:35 user nova-compute[85141]: DEBUG nova.network.neutron [None req-451f5472-7f7f-4464-b13c-dce06ae24a82 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] [instance: d842f90e-663b-4c95-9d7c-d092d2bac41f] Building network info cache for instance {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 10:10:35 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-f17964de-7db0-4d00-9b96-206a45f3a2dc req-c7846e71-2285-4a65-95d6-dd48d43a9fe5 service nova] Releasing lock "refresh_cache-a4cdcb5b-b2a6-4736-85c8-7e6cdab8c9b1" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:10:35 user nova-compute[85141]: DEBUG nova.network.neutron [None req-451f5472-7f7f-4464-b13c-dce06ae24a82 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] [instance: d842f90e-663b-4c95-9d7c-d092d2bac41f] Instance cache missing network info. {{(pid=85141) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 10:10:36 user nova-compute[85141]: DEBUG nova.network.neutron [None req-451f5472-7f7f-4464-b13c-dce06ae24a82 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] [instance: d842f90e-663b-4c95-9d7c-d092d2bac41f] Updating instance_info_cache with network_info: [{"id": "6ce8849e-50a1-4b8a-bf75-1016ef3c2315", "address": "fa:16:3e:a2:a8:01", "network": {"id": "e40e4bd2-4277-40b1-9451-1c8365ffa488", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1333036447-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "733b504d4dbe4f028963cf2c197f0064", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ce8849e-50", "ovs_interfaceid": "6ce8849e-50a1-4b8a-bf75-1016ef3c2315", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:10:36 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:10:36 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1202aa6f-64, may_exist=True, interface_attrs={}) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:10:36 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1202aa6f-64, col_values=(('qos', UUID('52cddb0d-34c7-4533-9e6c-cfdb0140e3fd')),), if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:10:36 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1202aa6f-64, col_values=(('external_ids', {'iface-id': '1202aa6f-6442-4e95-bf51-66f977a23e01', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d8:53:c3', 'vm-uuid': '9411843f-4e79-46c4-ae02-01f5e87b86eb'}),), if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:10:36 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:10:36 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-451f5472-7f7f-4464-b13c-dce06ae24a82 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Releasing lock "refresh_cache-d842f90e-663b-4c95-9d7c-d092d2bac41f" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:10:36 user nova-compute[85141]: DEBUG nova.compute.manager [None req-451f5472-7f7f-4464-b13c-dce06ae24a82 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] [instance: d842f90e-663b-4c95-9d7c-d092d2bac41f] Instance network_info: |[{"id": "6ce8849e-50a1-4b8a-bf75-1016ef3c2315", "address": "fa:16:3e:a2:a8:01", "network": {"id": "e40e4bd2-4277-40b1-9451-1c8365ffa488", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1333036447-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "733b504d4dbe4f028963cf2c197f0064", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ce8849e-50", "ovs_interfaceid": "6ce8849e-50a1-4b8a-bf75-1016ef3c2315", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=85141) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 10:10:36 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-451f5472-7f7f-4464-b13c-dce06ae24a82 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] [instance: d842f90e-663b-4c95-9d7c-d092d2bac41f] Start _get_guest_xml network_info=[{"id": "6ce8849e-50a1-4b8a-bf75-1016ef3c2315", "address": "fa:16:3e:a2:a8:01", "network": {"id": "e40e4bd2-4277-40b1-9451-1c8365ffa488", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1333036447-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "733b504d4dbe4f028963cf2c197f0064", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ce8849e-50", "ovs_interfaceid": "6ce8849e-50a1-4b8a-bf75-1016ef3c2315", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T10:06:42Z,direct_url=<?>,disk_format='qcow2',id=bc4ca70f-a459-4d5c-a9e6-80f1948eb48b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1044631a5fe84ce8904864a7024049fa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T10:06:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_options': None, 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'image_id': 'bc4ca70f-a459-4d5c-a9e6-80f1948eb48b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=85141) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 10:10:36 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:10:36 user nova-compute[85141]: INFO os_vif [None req-efd6cff3-9f97-4572-8f80-b6e15aa4b080 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:53:c3,bridge_name='br-int',has_traffic_filtering=True,id=1202aa6f-6442-4e95-bf51-66f977a23e01,network=Network(4fb7c85e-c966-481d-b6f2-856a17ac8f7c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1202aa6f-64')
Nov 16 10:10:36 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:10:36 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9b681ac7-32, may_exist=True, interface_attrs={}) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:10:36 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9b681ac7-32, col_values=(('qos', UUID('d3db7c5d-b342-4634-a0b6-c25cfdbb0731')),), if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:10:36 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9b681ac7-32, col_values=(('external_ids', {'iface-id': '9b681ac7-3246-4ff4-8691-f8e4f1d62061', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ce:f3:cd', 'vm-uuid': 'e65ccf79-718d-4eeb-8914-f0db2e2c9ce2'}),), if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:10:36 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:10:36 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:10:36 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:10:36 user nova-compute[85141]: INFO os_vif [None req-72b51cf3-8112-4a97-abff-d81405d395de tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:f3:cd,bridge_name='br-int',has_traffic_filtering=True,id=9b681ac7-3246-4ff4-8691-f8e4f1d62061,network=Network(ac11f3ed-4c14-4051-aff5-44d400d6368c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b681ac7-32')
Nov 16 10:10:36 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:10:36 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap07d06a88-cd, may_exist=True, interface_attrs={}) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:10:36 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap07d06a88-cd, col_values=(('qos', UUID('1b42ece2-ab32-4512-bfc9-388f2c0a7a0f')),), if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:10:36 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap07d06a88-cd, col_values=(('external_ids', {'iface-id': '07d06a88-cd34-412f-9b4d-b9fa94247dd4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:72:f5:ea', 'vm-uuid': 'a4cdcb5b-b2a6-4736-85c8-7e6cdab8c9b1'}),), if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:10:36 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:10:36 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:10:36 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-451f5472-7f7f-4464-b13c-dce06ae24a82 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:10:36 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-451f5472-7f7f-4464-b13c-dce06ae24a82 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:10:36 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-451f5472-7f7f-4464-b13c-dce06ae24a82 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=85141) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 10:10:36 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-451f5472-7f7f-4464-b13c-dce06ae24a82 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] CPU controller missing on host. {{(pid=85141) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 10:10:36 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:10:36 user nova-compute[85141]: DEBUG nova.compute.manager [req-2dd4417b-9777-4e07-8ba1-f8f2ca850cac req-5dea9ecf-51cc-4f29-86c3-88ac3f942bdf service nova] [instance: d842f90e-663b-4c95-9d7c-d092d2bac41f] Received event network-changed-6ce8849e-50a1-4b8a-bf75-1016ef3c2315 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:10:36 user nova-compute[85141]: DEBUG nova.compute.manager [req-2dd4417b-9777-4e07-8ba1-f8f2ca850cac req-5dea9ecf-51cc-4f29-86c3-88ac3f942bdf service nova] [instance: d842f90e-663b-4c95-9d7c-d092d2bac41f] Refreshing instance network info cache due to event network-changed-6ce8849e-50a1-4b8a-bf75-1016ef3c2315. {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 10:10:36 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-2dd4417b-9777-4e07-8ba1-f8f2ca850cac req-5dea9ecf-51cc-4f29-86c3-88ac3f942bdf service nova] Acquiring lock "refresh_cache-d842f90e-663b-4c95-9d7c-d092d2bac41f" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:10:36 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-2dd4417b-9777-4e07-8ba1-f8f2ca850cac req-5dea9ecf-51cc-4f29-86c3-88ac3f942bdf service nova] Acquired lock "refresh_cache-d842f90e-663b-4c95-9d7c-d092d2bac41f" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:10:36 user nova-compute[85141]: DEBUG nova.network.neutron [req-2dd4417b-9777-4e07-8ba1-f8f2ca850cac req-5dea9ecf-51cc-4f29-86c3-88ac3f942bdf service nova] [instance: d842f90e-663b-4c95-9d7c-d092d2bac41f] Refreshing network info cache for port 6ce8849e-50a1-4b8a-bf75-1016ef3c2315 {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 10:10:36 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-451f5472-7f7f-4464-b13c-dce06ae24a82 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=85141) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 10:10:36 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-451f5472-7f7f-4464-b13c-dce06ae24a82 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] CPU controller found on host. {{(pid=85141) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 10:10:36 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-451f5472-7f7f-4464-b13c-dce06ae24a82 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=85141) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 10:10:36 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-451f5472-7f7f-4464-b13c-dce06ae24a82 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T10:06:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T10:06:42Z,direct_url=<?>,disk_format='qcow2',id=bc4ca70f-a459-4d5c-a9e6-80f1948eb48b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1044631a5fe84ce8904864a7024049fa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T10:06:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 10:10:36 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-451f5472-7f7f-4464-b13c-dce06ae24a82 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Flavor limits 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 10:10:36 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-451f5472-7f7f-4464-b13c-dce06ae24a82 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Image limits 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 10:10:36 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-451f5472-7f7f-4464-b13c-dce06ae24a82 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Flavor pref 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 10:10:36 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-451f5472-7f7f-4464-b13c-dce06ae24a82 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Image pref 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 10:10:36 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-451f5472-7f7f-4464-b13c-dce06ae24a82 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 10:10:36 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-451f5472-7f7f-4464-b13c-dce06ae24a82 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 10:10:36 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-451f5472-7f7f-4464-b13c-dce06ae24a82 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=85141) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 10:10:36 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-451f5472-7f7f-4464-b13c-dce06ae24a82 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Got 1 possible topologies {{(pid=85141) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 10:10:36 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-451f5472-7f7f-4464-b13c-dce06ae24a82 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 10:10:36 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-451f5472-7f7f-4464-b13c-dce06ae24a82 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 10:10:36 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-451f5472-7f7f-4464-b13c-dce06ae24a82 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T10:10:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-380941350',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-380941350',id=3,image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='733b504d4dbe4f028963cf2c197f0064',ramdisk_id='',reservation_id='r-gmnitpgy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-742384119',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T10:10:28Z,user_data=None,user_id='ffe6ceff3cc346b59b4fbf294b9fc1a3',uuid=d842f90e-663b-4c95-9d7c-d092d2bac41f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6ce8849e-50a1-4b8a-bf75-1016ef3c2315", "address": "fa:16:3e:a2:a8:01", "network": {"id": "e40e4bd2-4277-40b1-9451-1c8365ffa488", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1333036447-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "733b504d4dbe4f028963cf2c197f0064", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ce8849e-50", "ovs_interfaceid": "6ce8849e-50a1-4b8a-bf75-1016ef3c2315", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=85141) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 10:10:36 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-451f5472-7f7f-4464-b13c-dce06ae24a82 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Converting VIF {"id": "6ce8849e-50a1-4b8a-bf75-1016ef3c2315", "address": "fa:16:3e:a2:a8:01", "network": {"id": "e40e4bd2-4277-40b1-9451-1c8365ffa488", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1333036447-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "733b504d4dbe4f028963cf2c197f0064", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ce8849e-50", "ovs_interfaceid": "6ce8849e-50a1-4b8a-bf75-1016ef3c2315", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:10:36 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-451f5472-7f7f-4464-b13c-dce06ae24a82 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a2:a8:01,bridge_name='br-int',has_traffic_filtering=True,id=6ce8849e-50a1-4b8a-bf75-1016ef3c2315,network=Network(e40e4bd2-4277-40b1-9451-1c8365ffa488),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ce8849e-50') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:10:36 user nova-compute[85141]: DEBUG nova.objects.instance [None req-451f5472-7f7f-4464-b13c-dce06ae24a82 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Lazy-loading 'pci_devices' on Instance uuid d842f90e-663b-4c95-9d7c-d092d2bac41f {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:10:36 user nova-compute[85141]: INFO os_vif [None req-ce0015fa-dfda-4a9e-958b-2122ace9edea tempest-DeleteServersTestJSON-1770650847 tempest-DeleteServersTestJSON-1770650847-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:f5:ea,bridge_name='br-int',has_traffic_filtering=True,id=07d06a88-cd34-412f-9b4d-b9fa94247dd4,network=Network(880d7e11-048f-4333-95ad-bdd45e8dcdb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07d06a88-cd')
Nov 16 10:10:36 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-451f5472-7f7f-4464-b13c-dce06ae24a82 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] [instance: d842f90e-663b-4c95-9d7c-d092d2bac41f] End _get_guest_xml xml=<domain type="kvm">
Nov 16 10:10:36 user nova-compute[85141]:   <uuid>d842f90e-663b-4c95-9d7c-d092d2bac41f</uuid>
Nov 16 10:10:36 user nova-compute[85141]:   <name>instance-00000003</name>
Nov 16 10:10:36 user nova-compute[85141]:   <memory>524288</memory>
Nov 16 10:10:36 user nova-compute[85141]:   <vcpu>1</vcpu>
Nov 16 10:10:36 user nova-compute[85141]:   <metadata>
Nov 16 10:10:36 user nova-compute[85141]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 10:10:36 user nova-compute[85141]:       <nova:package version="0.0.0"/>
Nov 16 10:10:36 user nova-compute[85141]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-380941350</nova:name>
Nov 16 10:10:36 user nova-compute[85141]:       <nova:creationTime>2023-11-16 10:10:36</nova:creationTime>
Nov 16 10:10:36 user nova-compute[85141]:       <nova:flavor name="m1.tiny">
Nov 16 10:10:36 user nova-compute[85141]:         <nova:memory>512</nova:memory>
Nov 16 10:10:36 user nova-compute[85141]:         <nova:disk>1</nova:disk>
Nov 16 10:10:36 user nova-compute[85141]:         <nova:swap>0</nova:swap>
Nov 16 10:10:36 user nova-compute[85141]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 10:10:36 user nova-compute[85141]:         <nova:vcpus>1</nova:vcpus>
Nov 16 10:10:36 user nova-compute[85141]:       </nova:flavor>
Nov 16 10:10:36 user nova-compute[85141]:       <nova:owner>
Nov 16 10:10:36 user nova-compute[85141]:         <nova:user uuid="ffe6ceff3cc346b59b4fbf294b9fc1a3">tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member</nova:user>
Nov 16 10:10:36 user nova-compute[85141]:         <nova:project uuid="733b504d4dbe4f028963cf2c197f0064">tempest-ServerBootFromVolumeStableRescueTest-742384119</nova:project>
Nov 16 10:10:36 user nova-compute[85141]:       </nova:owner>
Nov 16 10:10:36 user nova-compute[85141]:       <nova:root type="image" uuid="bc4ca70f-a459-4d5c-a9e6-80f1948eb48b"/>
Nov 16 10:10:36 user nova-compute[85141]:       <nova:ports>
Nov 16 10:10:36 user nova-compute[85141]:         <nova:port uuid="6ce8849e-50a1-4b8a-bf75-1016ef3c2315">
Nov 16 10:10:36 user nova-compute[85141]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 16 10:10:36 user nova-compute[85141]:         </nova:port>
Nov 16 10:10:36 user nova-compute[85141]:       </nova:ports>
Nov 16 10:10:36 user nova-compute[85141]:     </nova:instance>
Nov 16 10:10:36 user nova-compute[85141]:   </metadata>
Nov 16 10:10:36 user nova-compute[85141]:   <sysinfo type="smbios">
Nov 16 10:10:36 user nova-compute[85141]:     <system>
Nov 16 10:10:36 user nova-compute[85141]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 10:10:36 user nova-compute[85141]:       <entry name="product">OpenStack Nova</entry>
Nov 16 10:10:36 user nova-compute[85141]:       <entry name="version">0.0.0</entry>
Nov 16 10:10:36 user nova-compute[85141]:       <entry name="serial">d842f90e-663b-4c95-9d7c-d092d2bac41f</entry>
Nov 16 10:10:36 user nova-compute[85141]:       <entry name="uuid">d842f90e-663b-4c95-9d7c-d092d2bac41f</entry>
Nov 16 10:10:36 user nova-compute[85141]:       <entry name="family">Virtual Machine</entry>
Nov 16 10:10:36 user nova-compute[85141]:     </system>
Nov 16 10:10:36 user nova-compute[85141]:   </sysinfo>
Nov 16 10:10:36 user nova-compute[85141]:   <os>
Nov 16 10:10:36 user nova-compute[85141]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 10:10:36 user nova-compute[85141]:     <boot dev="hd"/>
Nov 16 10:10:36 user nova-compute[85141]:     <smbios mode="sysinfo"/>
Nov 16 10:10:36 user nova-compute[85141]:   </os>
Nov 16 10:10:36 user nova-compute[85141]:   <features>
Nov 16 10:10:36 user nova-compute[85141]:     <acpi/>
Nov 16 10:10:36 user nova-compute[85141]:     <apic/>
Nov 16 10:10:36 user nova-compute[85141]:     <vmcoreinfo/>
Nov 16 10:10:36 user nova-compute[85141]:   </features>
Nov 16 10:10:36 user nova-compute[85141]:   <clock offset="utc">
Nov 16 10:10:36 user nova-compute[85141]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 10:10:36 user nova-compute[85141]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 10:10:36 user nova-compute[85141]:     <timer name="hpet" present="no"/>
Nov 16 10:10:36 user nova-compute[85141]:   </clock>
Nov 16 10:10:36 user nova-compute[85141]:   <cpu mode="custom" match="exact">
Nov 16 10:10:36 user nova-compute[85141]:     <model>Nehalem</model>
Nov 16 10:10:36 user nova-compute[85141]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 10:10:36 user nova-compute[85141]:   </cpu>
Nov 16 10:10:36 user nova-compute[85141]:   <devices>
Nov 16 10:10:36 user nova-compute[85141]:     <disk type="file" device="disk">
Nov 16 10:10:36 user nova-compute[85141]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 10:10:36 user nova-compute[85141]:       <source file="/opt/stack/data/nova/instances/d842f90e-663b-4c95-9d7c-d092d2bac41f/disk"/>
Nov 16 10:10:36 user nova-compute[85141]:       <target dev="vda" bus="virtio"/>
Nov 16 10:10:36 user nova-compute[85141]:     </disk>
Nov 16 10:10:36 user nova-compute[85141]:     <interface type="ethernet">
Nov 16 10:10:36 user nova-compute[85141]:       <mac address="fa:16:3e:a2:a8:01"/>
Nov 16 10:10:36 user nova-compute[85141]:       <model type="virtio"/>
Nov 16 10:10:36 user nova-compute[85141]:       <mtu size="1442"/>
Nov 16 10:10:36 user nova-compute[85141]:       <target dev="tap6ce8849e-50"/>
Nov 16 10:10:36 user nova-compute[85141]:     </interface>
Nov 16 10:10:36 user nova-compute[85141]:     <serial type="pty">
Nov 16 10:10:36 user nova-compute[85141]:       <log file="/opt/stack/data/nova/instances/d842f90e-663b-4c95-9d7c-d092d2bac41f/console.log" append="off"/>
Nov 16 10:10:36 user nova-compute[85141]:     </serial>
Nov 16 10:10:36 user nova-compute[85141]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 10:10:36 user nova-compute[85141]:     <video>
Nov 16 10:10:36 user nova-compute[85141]:       <model type="virtio"/>
Nov 16 10:10:36 user nova-compute[85141]:     </video>
Nov 16 10:10:36 user nova-compute[85141]:     <rng model="virtio">
Nov 16 10:10:36 user nova-compute[85141]:       <backend model="random">/dev/urandom</backend>
Nov 16 10:10:36 user nova-compute[85141]:     </rng>
Nov 16 10:10:36 user nova-compute[85141]:     <controller type="usb" index="0" model="none"/>
Nov 16 10:10:36 user nova-compute[85141]:     <memballoon model="virtio">
Nov 16 10:10:36 user nova-compute[85141]:       <stats period="10"/>
Nov 16 10:10:36 user nova-compute[85141]:     </memballoon>
Nov 16 10:10:36 user nova-compute[85141]:   </devices>
Nov 16 10:10:36 user nova-compute[85141]: </domain>
Nov 16 10:10:36 user nova-compute[85141]:  {{(pid=85141) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 10:10:36 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-451f5472-7f7f-4464-b13c-dce06ae24a82 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T10:10:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-380941350',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-380941350',id=3,image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='733b504d4dbe4f028963cf2c197f0064',ramdisk_id='',reservation_id='r-gmnitpgy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-742384119',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T10:10:28Z,user_data=None,user_id='ffe6ceff3cc346b59b4fbf294b9fc1a3',uuid=d842f90e-663b-4c95-9d7c-d092d2bac41f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6ce8849e-50a1-4b8a-bf75-1016ef3c2315", "address": "fa:16:3e:a2:a8:01", "network": {"id": "e40e4bd2-4277-40b1-9451-1c8365ffa488", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1333036447-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "733b504d4dbe4f028963cf2c197f0064", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ce8849e-50", "ovs_interfaceid": "6ce8849e-50a1-4b8a-bf75-1016ef3c2315", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 10:10:36 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-451f5472-7f7f-4464-b13c-dce06ae24a82 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Converting VIF {"id": "6ce8849e-50a1-4b8a-bf75-1016ef3c2315", "address": "fa:16:3e:a2:a8:01", "network": {"id": "e40e4bd2-4277-40b1-9451-1c8365ffa488", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1333036447-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "733b504d4dbe4f028963cf2c197f0064", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ce8849e-50", "ovs_interfaceid": "6ce8849e-50a1-4b8a-bf75-1016ef3c2315", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:10:36 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-451f5472-7f7f-4464-b13c-dce06ae24a82 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a2:a8:01,bridge_name='br-int',has_traffic_filtering=True,id=6ce8849e-50a1-4b8a-bf75-1016ef3c2315,network=Network(e40e4bd2-4277-40b1-9451-1c8365ffa488),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ce8849e-50') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:10:36 user nova-compute[85141]: DEBUG os_vif [None req-451f5472-7f7f-4464-b13c-dce06ae24a82 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:a8:01,bridge_name='br-int',has_traffic_filtering=True,id=6ce8849e-50a1-4b8a-bf75-1016ef3c2315,network=Network(e40e4bd2-4277-40b1-9451-1c8365ffa488),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ce8849e-50') {{(pid=85141) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 10:10:36 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:10:36 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:10:36 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 10:10:36 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:10:36 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:10:36 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '13ecdad9-c9d4-57f0-9f1f-88d326e7f1c7', '_type': 'linux-noop'}}, row=False) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:10:36 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:10:36 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-efd6cff3-9f97-4572-8f80-b6e15aa4b080 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] No BDM found with device name vda, not building metadata. {{(pid=85141) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 10:10:36 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-efd6cff3-9f97-4572-8f80-b6e15aa4b080 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] No VIF found with MAC fa:16:3e:d8:53:c3, not building metadata {{(pid=85141) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 10:10:36 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:10:36 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-72b51cf3-8112-4a97-abff-d81405d395de tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] No BDM found with device name vda, not building metadata. {{(pid=85141) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 10:10:36 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-72b51cf3-8112-4a97-abff-d81405d395de tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] No VIF found with MAC fa:16:3e:ce:f3:cd, not building metadata {{(pid=85141) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 10:10:36 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:10:36 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6ce8849e-50, may_exist=True, interface_attrs={}) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:10:36 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6ce8849e-50, col_values=(('qos', UUID('3def61c7-f25a-4f69-8e50-2675c6a32124')),), if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:10:36 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6ce8849e-50, col_values=(('external_ids', {'iface-id': '6ce8849e-50a1-4b8a-bf75-1016ef3c2315', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a2:a8:01', 'vm-uuid': 'd842f90e-663b-4c95-9d7c-d092d2bac41f'}),), if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:10:36 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:10:36 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:10:36 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-ce0015fa-dfda-4a9e-958b-2122ace9edea tempest-DeleteServersTestJSON-1770650847 tempest-DeleteServersTestJSON-1770650847-project-member] No BDM found with device name vda, not building metadata. {{(pid=85141) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 10:10:36 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-ce0015fa-dfda-4a9e-958b-2122ace9edea tempest-DeleteServersTestJSON-1770650847 tempest-DeleteServersTestJSON-1770650847-project-member] No VIF found with MAC fa:16:3e:72:f5:ea, not building metadata {{(pid=85141) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 10:10:36 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:10:36 user nova-compute[85141]: INFO os_vif [None req-451f5472-7f7f-4464-b13c-dce06ae24a82 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:a8:01,bridge_name='br-int',has_traffic_filtering=True,id=6ce8849e-50a1-4b8a-bf75-1016ef3c2315,network=Network(e40e4bd2-4277-40b1-9451-1c8365ffa488),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ce8849e-50')
Nov 16 10:10:36 user nova-compute[85141]: DEBUG nova.network.neutron [req-8970defd-f289-4297-84da-9bb005e2a34e req-94ebb628-ff68-491a-b603-ca87eb5c7c0e service nova] [instance: e65ccf79-718d-4eeb-8914-f0db2e2c9ce2] Updated VIF entry in instance network info cache for port 9b681ac7-3246-4ff4-8691-f8e4f1d62061. {{(pid=85141) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 10:10:36 user nova-compute[85141]: DEBUG nova.network.neutron [req-8970defd-f289-4297-84da-9bb005e2a34e req-94ebb628-ff68-491a-b603-ca87eb5c7c0e service nova] [instance: e65ccf79-718d-4eeb-8914-f0db2e2c9ce2] Updating instance_info_cache with network_info: [{"id": "9b681ac7-3246-4ff4-8691-f8e4f1d62061", "address": "fa:16:3e:ce:f3:cd", "network": {"id": "ac11f3ed-4c14-4051-aff5-44d400d6368c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-679726958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7044a386486d4426bcccfe0b7d225c80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b681ac7-32", "ovs_interfaceid": "9b681ac7-3246-4ff4-8691-f8e4f1d62061", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:10:36 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-8970defd-f289-4297-84da-9bb005e2a34e req-94ebb628-ff68-491a-b603-ca87eb5c7c0e service nova] Releasing lock "refresh_cache-e65ccf79-718d-4eeb-8914-f0db2e2c9ce2" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:10:36 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-451f5472-7f7f-4464-b13c-dce06ae24a82 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] No BDM found with device name vda, not building metadata. {{(pid=85141) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 10:10:36 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-451f5472-7f7f-4464-b13c-dce06ae24a82 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] No VIF found with MAC fa:16:3e:a2:a8:01, not building metadata {{(pid=85141) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 10:10:36 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:10:36 user nova-compute[85141]: DEBUG nova.network.neutron [req-2dd4417b-9777-4e07-8ba1-f8f2ca850cac req-5dea9ecf-51cc-4f29-86c3-88ac3f942bdf service nova] [instance: d842f90e-663b-4c95-9d7c-d092d2bac41f] Updated VIF entry in instance network info cache for port 6ce8849e-50a1-4b8a-bf75-1016ef3c2315. {{(pid=85141) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 10:10:36 user nova-compute[85141]: DEBUG nova.network.neutron [req-2dd4417b-9777-4e07-8ba1-f8f2ca850cac req-5dea9ecf-51cc-4f29-86c3-88ac3f942bdf service nova] [instance: d842f90e-663b-4c95-9d7c-d092d2bac41f] Updating instance_info_cache with network_info: [{"id": "6ce8849e-50a1-4b8a-bf75-1016ef3c2315", "address": "fa:16:3e:a2:a8:01", "network": {"id": "e40e4bd2-4277-40b1-9451-1c8365ffa488", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1333036447-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "733b504d4dbe4f028963cf2c197f0064", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ce8849e-50", "ovs_interfaceid": "6ce8849e-50a1-4b8a-bf75-1016ef3c2315", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:10:36 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-2dd4417b-9777-4e07-8ba1-f8f2ca850cac req-5dea9ecf-51cc-4f29-86c3-88ac3f942bdf service nova] Releasing lock "refresh_cache-d842f90e-663b-4c95-9d7c-d092d2bac41f" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:10:37 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:10:38 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:10:38 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:10:40 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:10:40 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:10:40 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:10:40 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:10:40 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:10:40 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:10:40 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:10:40 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:10:40 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:10:41 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:10:41 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:10:41 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:10:41 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:10:42 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:10:42 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:10:42 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-25f21eed-6c97-41f9-a9b9-a316d67a405c tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] Acquiring lock "361a2044-8fd0-4975-8a19-814bf7a6da41" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:10:42 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-25f21eed-6c97-41f9-a9b9-a316d67a405c tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] Lock "361a2044-8fd0-4975-8a19-814bf7a6da41" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:10:42 user nova-compute[85141]: DEBUG nova.compute.manager [None req-25f21eed-6c97-41f9-a9b9-a316d67a405c tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] [instance: 361a2044-8fd0-4975-8a19-814bf7a6da41] Starting instance... {{(pid=85141) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 10:10:42 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-25f21eed-6c97-41f9-a9b9-a316d67a405c tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:10:42 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-25f21eed-6c97-41f9-a9b9-a316d67a405c tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:10:42 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-25f21eed-6c97-41f9-a9b9-a316d67a405c tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=85141) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 10:10:42 user nova-compute[85141]: INFO nova.compute.claims [None req-25f21eed-6c97-41f9-a9b9-a316d67a405c tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] [instance: 361a2044-8fd0-4975-8a19-814bf7a6da41] Claim successful on node user
Nov 16 10:10:43 user nova-compute[85141]: DEBUG nova.compute.provider_tree [None req-25f21eed-6c97-41f9-a9b9-a316d67a405c tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] Inventory has not changed in ProviderTree for provider: bf8e0fa1-16b6-408f-9203-c4cd63916272 {{(pid=85141) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 10:10:43 user nova-compute[85141]: DEBUG nova.scheduler.client.report [None req-25f21eed-6c97-41f9-a9b9-a316d67a405c tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] Inventory has not changed for provider bf8e0fa1-16b6-408f-9203-c4cd63916272 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=85141) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 10:10:43 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-25f21eed-6c97-41f9-a9b9-a316d67a405c tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.454s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:10:43 user nova-compute[85141]: DEBUG nova.compute.manager [None req-25f21eed-6c97-41f9-a9b9-a316d67a405c tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] [instance: 361a2044-8fd0-4975-8a19-814bf7a6da41] Start building networks asynchronously for instance. {{(pid=85141) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 10:10:43 user nova-compute[85141]: DEBUG nova.compute.manager [None req-25f21eed-6c97-41f9-a9b9-a316d67a405c tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] [instance: 361a2044-8fd0-4975-8a19-814bf7a6da41] Allocating IP information in the background. {{(pid=85141) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 10:10:43 user nova-compute[85141]: DEBUG nova.network.neutron [None req-25f21eed-6c97-41f9-a9b9-a316d67a405c tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] [instance: 361a2044-8fd0-4975-8a19-814bf7a6da41] allocate_for_instance() {{(pid=85141) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 10:10:43 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-25f21eed-6c97-41f9-a9b9-a316d67a405c tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] [instance: 361a2044-8fd0-4975-8a19-814bf7a6da41] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 10:10:43 user nova-compute[85141]: DEBUG nova.compute.manager [None req-25f21eed-6c97-41f9-a9b9-a316d67a405c tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] [instance: 361a2044-8fd0-4975-8a19-814bf7a6da41] Start building block device mappings for instance. {{(pid=85141) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 10:10:43 user nova-compute[85141]: DEBUG nova.policy [None req-25f21eed-6c97-41f9-a9b9-a316d67a405c tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cb1fde08d82e4eedb97f1501eafa3bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b9e035160ba427c80e5668982136a49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85141) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 10:10:43 user nova-compute[85141]: DEBUG nova.compute.manager [None req-25f21eed-6c97-41f9-a9b9-a316d67a405c tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] [instance: 361a2044-8fd0-4975-8a19-814bf7a6da41] Start spawning the instance on the hypervisor. {{(pid=85141) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 10:10:43 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-25f21eed-6c97-41f9-a9b9-a316d67a405c tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] [instance: 361a2044-8fd0-4975-8a19-814bf7a6da41] Creating instance directory {{(pid=85141) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 10:10:43 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-25f21eed-6c97-41f9-a9b9-a316d67a405c tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] [instance: 361a2044-8fd0-4975-8a19-814bf7a6da41] Creating image(s)
Nov 16 10:10:43 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-25f21eed-6c97-41f9-a9b9-a316d67a405c tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] Acquiring lock "/opt/stack/data/nova/instances/361a2044-8fd0-4975-8a19-814bf7a6da41/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:10:43 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-25f21eed-6c97-41f9-a9b9-a316d67a405c tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] Lock "/opt/stack/data/nova/instances/361a2044-8fd0-4975-8a19-814bf7a6da41/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:10:43 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-25f21eed-6c97-41f9-a9b9-a316d67a405c tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] Lock "/opt/stack/data/nova/instances/361a2044-8fd0-4975-8a19-814bf7a6da41/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:10:43 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-25f21eed-6c97-41f9-a9b9-a316d67a405c tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:10:43 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-25f21eed-6c97-41f9-a9b9-a316d67a405c tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json" returned: 0 in 0.195s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:10:43 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-25f21eed-6c97-41f9-a9b9-a316d67a405c tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] Acquiring lock "60a78556fb399ed4a41bc3ca4bccf77c96d8e811" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:10:43 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-25f21eed-6c97-41f9-a9b9-a316d67a405c tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] Lock "60a78556fb399ed4a41bc3ca4bccf77c96d8e811" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:10:43 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-25f21eed-6c97-41f9-a9b9-a316d67a405c tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:10:44 user nova-compute[85141]: DEBUG nova.compute.manager [None req-efd6cff3-9f97-4572-8f80-b6e15aa4b080 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] [instance: 9411843f-4e79-46c4-ae02-01f5e87b86eb] Instance event wait completed in 0 seconds for  {{(pid=85141) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 10:10:44 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-efd6cff3-9f97-4572-8f80-b6e15aa4b080 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] [instance: 9411843f-4e79-46c4-ae02-01f5e87b86eb] Guest created on hypervisor {{(pid=85141) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 10:10:44 user nova-compute[85141]: DEBUG nova.compute.manager [None req-72b51cf3-8112-4a97-abff-d81405d395de tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] [instance: e65ccf79-718d-4eeb-8914-f0db2e2c9ce2] Instance event wait completed in 0 seconds for  {{(pid=85141) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 10:10:44 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-72b51cf3-8112-4a97-abff-d81405d395de tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] [instance: e65ccf79-718d-4eeb-8914-f0db2e2c9ce2] Guest created on hypervisor {{(pid=85141) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 10:10:44 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-25f21eed-6c97-41f9-a9b9-a316d67a405c tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json" returned: 0 in 0.201s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:10:44 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-25f21eed-6c97-41f9-a9b9-a316d67a405c tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811,backing_fmt=raw /opt/stack/data/nova/instances/361a2044-8fd0-4975-8a19-814bf7a6da41/disk 1073741824 {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:10:44 user nova-compute[85141]: INFO nova.virt.libvirt.driver [-] [instance: 9411843f-4e79-46c4-ae02-01f5e87b86eb] Instance spawned successfully.
Nov 16 10:10:44 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-efd6cff3-9f97-4572-8f80-b6e15aa4b080 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] [instance: 9411843f-4e79-46c4-ae02-01f5e87b86eb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 10:10:44 user nova-compute[85141]: DEBUG nova.compute.manager [None req-451f5472-7f7f-4464-b13c-dce06ae24a82 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] [instance: d842f90e-663b-4c95-9d7c-d092d2bac41f] Instance event wait completed in 0 seconds for  {{(pid=85141) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 10:10:44 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-451f5472-7f7f-4464-b13c-dce06ae24a82 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] [instance: d842f90e-663b-4c95-9d7c-d092d2bac41f] Guest created on hypervisor {{(pid=85141) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 10:10:44 user nova-compute[85141]: INFO nova.virt.libvirt.driver [-] [instance: e65ccf79-718d-4eeb-8914-f0db2e2c9ce2] Instance spawned successfully.
Nov 16 10:10:44 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-72b51cf3-8112-4a97-abff-d81405d395de tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] [instance: e65ccf79-718d-4eeb-8914-f0db2e2c9ce2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 10:10:44 user nova-compute[85141]: INFO nova.virt.libvirt.driver [-] [instance: d842f90e-663b-4c95-9d7c-d092d2bac41f] Instance spawned successfully.
Nov 16 10:10:44 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-451f5472-7f7f-4464-b13c-dce06ae24a82 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] [instance: d842f90e-663b-4c95-9d7c-d092d2bac41f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 10:10:44 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-25f21eed-6c97-41f9-a9b9-a316d67a405c tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811,backing_fmt=raw /opt/stack/data/nova/instances/361a2044-8fd0-4975-8a19-814bf7a6da41/disk 1073741824" returned: 0 in 0.095s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:10:44 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-25f21eed-6c97-41f9-a9b9-a316d67a405c tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] Lock "60a78556fb399ed4a41bc3ca4bccf77c96d8e811" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.299s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:10:44 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-25f21eed-6c97-41f9-a9b9-a316d67a405c tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:10:44 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-efd6cff3-9f97-4572-8f80-b6e15aa4b080 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] [instance: 9411843f-4e79-46c4-ae02-01f5e87b86eb] Found default for hw_cdrom_bus of ide {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:10:44 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-efd6cff3-9f97-4572-8f80-b6e15aa4b080 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] [instance: 9411843f-4e79-46c4-ae02-01f5e87b86eb] Found default for hw_disk_bus of virtio {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:10:44 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-efd6cff3-9f97-4572-8f80-b6e15aa4b080 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] [instance: 9411843f-4e79-46c4-ae02-01f5e87b86eb] Found default for hw_input_bus of None {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:10:44 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-efd6cff3-9f97-4572-8f80-b6e15aa4b080 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] [instance: 9411843f-4e79-46c4-ae02-01f5e87b86eb] Found default for hw_pointer_model of None {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:10:44 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-efd6cff3-9f97-4572-8f80-b6e15aa4b080 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] [instance: 9411843f-4e79-46c4-ae02-01f5e87b86eb] Found default for hw_video_model of virtio {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:10:44 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-efd6cff3-9f97-4572-8f80-b6e15aa4b080 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] [instance: 9411843f-4e79-46c4-ae02-01f5e87b86eb] Found default for hw_vif_model of virtio {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:10:44 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-72b51cf3-8112-4a97-abff-d81405d395de tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] [instance: e65ccf79-718d-4eeb-8914-f0db2e2c9ce2] Found default for hw_cdrom_bus of ide {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:10:44 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-72b51cf3-8112-4a97-abff-d81405d395de tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] [instance: e65ccf79-718d-4eeb-8914-f0db2e2c9ce2] Found default for hw_disk_bus of virtio {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:10:44 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-72b51cf3-8112-4a97-abff-d81405d395de tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] [instance: e65ccf79-718d-4eeb-8914-f0db2e2c9ce2] Found default for hw_input_bus of None {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:10:44 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-72b51cf3-8112-4a97-abff-d81405d395de tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] [instance: e65ccf79-718d-4eeb-8914-f0db2e2c9ce2] Found default for hw_pointer_model of None {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:10:44 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-72b51cf3-8112-4a97-abff-d81405d395de tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] [instance: e65ccf79-718d-4eeb-8914-f0db2e2c9ce2] Found default for hw_video_model of virtio {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:10:44 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-72b51cf3-8112-4a97-abff-d81405d395de tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] [instance: e65ccf79-718d-4eeb-8914-f0db2e2c9ce2] Found default for hw_vif_model of virtio {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:10:44 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-451f5472-7f7f-4464-b13c-dce06ae24a82 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] [instance: d842f90e-663b-4c95-9d7c-d092d2bac41f] Found default for hw_cdrom_bus of ide {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:10:44 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-451f5472-7f7f-4464-b13c-dce06ae24a82 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] [instance: d842f90e-663b-4c95-9d7c-d092d2bac41f] Found default for hw_disk_bus of virtio {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:10:44 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-451f5472-7f7f-4464-b13c-dce06ae24a82 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] [instance: d842f90e-663b-4c95-9d7c-d092d2bac41f] Found default for hw_input_bus of None {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:10:44 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-451f5472-7f7f-4464-b13c-dce06ae24a82 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] [instance: d842f90e-663b-4c95-9d7c-d092d2bac41f] Found default for hw_pointer_model of None {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:10:44 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-451f5472-7f7f-4464-b13c-dce06ae24a82 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] [instance: d842f90e-663b-4c95-9d7c-d092d2bac41f] Found default for hw_video_model of virtio {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:10:44 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-451f5472-7f7f-4464-b13c-dce06ae24a82 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] [instance: d842f90e-663b-4c95-9d7c-d092d2bac41f] Found default for hw_vif_model of virtio {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:10:44 user nova-compute[85141]: DEBUG nova.compute.manager [None req-ce0015fa-dfda-4a9e-958b-2122ace9edea tempest-DeleteServersTestJSON-1770650847 tempest-DeleteServersTestJSON-1770650847-project-member] [instance: a4cdcb5b-b2a6-4736-85c8-7e6cdab8c9b1] Instance event wait completed in 0 seconds for  {{(pid=85141) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 10:10:44 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-ce0015fa-dfda-4a9e-958b-2122ace9edea tempest-DeleteServersTestJSON-1770650847 tempest-DeleteServersTestJSON-1770650847-project-member] [instance: a4cdcb5b-b2a6-4736-85c8-7e6cdab8c9b1] Guest created on hypervisor {{(pid=85141) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 10:10:44 user nova-compute[85141]: INFO nova.virt.libvirt.driver [-] [instance: a4cdcb5b-b2a6-4736-85c8-7e6cdab8c9b1] Instance spawned successfully.
Nov 16 10:10:44 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-ce0015fa-dfda-4a9e-958b-2122ace9edea tempest-DeleteServersTestJSON-1770650847 tempest-DeleteServersTestJSON-1770650847-project-member] [instance: a4cdcb5b-b2a6-4736-85c8-7e6cdab8c9b1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 10:10:44 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-ce0015fa-dfda-4a9e-958b-2122ace9edea tempest-DeleteServersTestJSON-1770650847 tempest-DeleteServersTestJSON-1770650847-project-member] [instance: a4cdcb5b-b2a6-4736-85c8-7e6cdab8c9b1] Found default for hw_cdrom_bus of ide {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:10:44 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-ce0015fa-dfda-4a9e-958b-2122ace9edea tempest-DeleteServersTestJSON-1770650847 tempest-DeleteServersTestJSON-1770650847-project-member] [instance: a4cdcb5b-b2a6-4736-85c8-7e6cdab8c9b1] Found default for hw_disk_bus of virtio {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:10:44 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-ce0015fa-dfda-4a9e-958b-2122ace9edea tempest-DeleteServersTestJSON-1770650847 tempest-DeleteServersTestJSON-1770650847-project-member] [instance: a4cdcb5b-b2a6-4736-85c8-7e6cdab8c9b1] Found default for hw_input_bus of None {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:10:44 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-ce0015fa-dfda-4a9e-958b-2122ace9edea tempest-DeleteServersTestJSON-1770650847 tempest-DeleteServersTestJSON-1770650847-project-member] [instance: a4cdcb5b-b2a6-4736-85c8-7e6cdab8c9b1] Found default for hw_pointer_model of None {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:10:44 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-ce0015fa-dfda-4a9e-958b-2122ace9edea tempest-DeleteServersTestJSON-1770650847 tempest-DeleteServersTestJSON-1770650847-project-member] [instance: a4cdcb5b-b2a6-4736-85c8-7e6cdab8c9b1] Found default for hw_video_model of virtio {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:10:44 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-ce0015fa-dfda-4a9e-958b-2122ace9edea tempest-DeleteServersTestJSON-1770650847 tempest-DeleteServersTestJSON-1770650847-project-member] [instance: a4cdcb5b-b2a6-4736-85c8-7e6cdab8c9b1] Found default for hw_vif_model of virtio {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:10:44 user nova-compute[85141]: INFO nova.compute.manager [None req-72b51cf3-8112-4a97-abff-d81405d395de tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] [instance: e65ccf79-718d-4eeb-8914-f0db2e2c9ce2] Took 15.78 seconds to spawn the instance on the hypervisor.
Nov 16 10:10:44 user nova-compute[85141]: DEBUG nova.compute.manager [None req-72b51cf3-8112-4a97-abff-d81405d395de tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] [instance: e65ccf79-718d-4eeb-8914-f0db2e2c9ce2] Checking state {{(pid=85141) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 10:10:44 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-25f21eed-6c97-41f9-a9b9-a316d67a405c tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json" returned: 0 in 0.355s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:10:44 user nova-compute[85141]: DEBUG nova.virt.disk.api [None req-25f21eed-6c97-41f9-a9b9-a316d67a405c tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] Checking if we can resize image /opt/stack/data/nova/instances/361a2044-8fd0-4975-8a19-814bf7a6da41/disk. size=1073741824 {{(pid=85141) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 10:10:44 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-25f21eed-6c97-41f9-a9b9-a316d67a405c tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/361a2044-8fd0-4975-8a19-814bf7a6da41/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:10:44 user nova-compute[85141]: INFO nova.compute.manager [None req-451f5472-7f7f-4464-b13c-dce06ae24a82 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] [instance: d842f90e-663b-4c95-9d7c-d092d2bac41f] Took 16.41 seconds to spawn the instance on the hypervisor.
Nov 16 10:10:44 user nova-compute[85141]: DEBUG nova.compute.manager [None req-451f5472-7f7f-4464-b13c-dce06ae24a82 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] [instance: d842f90e-663b-4c95-9d7c-d092d2bac41f] Checking state {{(pid=85141) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 10:10:44 user nova-compute[85141]: INFO nova.compute.manager [None req-efd6cff3-9f97-4572-8f80-b6e15aa4b080 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] [instance: 9411843f-4e79-46c4-ae02-01f5e87b86eb] Took 16.72 seconds to spawn the instance on the hypervisor.
Nov 16 10:10:44 user nova-compute[85141]: DEBUG nova.compute.manager [None req-efd6cff3-9f97-4572-8f80-b6e15aa4b080 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] [instance: 9411843f-4e79-46c4-ae02-01f5e87b86eb] Checking state {{(pid=85141) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 10:10:44 user nova-compute[85141]: DEBUG nova.network.neutron [None req-25f21eed-6c97-41f9-a9b9-a316d67a405c tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] [instance: 361a2044-8fd0-4975-8a19-814bf7a6da41] Successfully created port: dd85b227-3f3d-4f02-a323-661af6a9dc92 {{(pid=85141) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 10:10:44 user nova-compute[85141]: INFO nova.compute.manager [None req-72b51cf3-8112-4a97-abff-d81405d395de tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] [instance: e65ccf79-718d-4eeb-8914-f0db2e2c9ce2] Took 16.89 seconds to build instance.
Nov 16 10:10:44 user nova-compute[85141]: INFO nova.compute.manager [None req-ce0015fa-dfda-4a9e-958b-2122ace9edea tempest-DeleteServersTestJSON-1770650847 tempest-DeleteServersTestJSON-1770650847-project-member] [instance: a4cdcb5b-b2a6-4736-85c8-7e6cdab8c9b1] Took 18.76 seconds to spawn the instance on the hypervisor.
Nov 16 10:10:44 user nova-compute[85141]: DEBUG nova.compute.manager [None req-ce0015fa-dfda-4a9e-958b-2122ace9edea tempest-DeleteServersTestJSON-1770650847 tempest-DeleteServersTestJSON-1770650847-project-member] [instance: a4cdcb5b-b2a6-4736-85c8-7e6cdab8c9b1] Checking state {{(pid=85141) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 10:10:44 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-72b51cf3-8112-4a97-abff-d81405d395de tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Lock "e65ccf79-718d-4eeb-8914-f0db2e2c9ce2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.116s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:10:45 user nova-compute[85141]: INFO nova.compute.manager [None req-451f5472-7f7f-4464-b13c-dce06ae24a82 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] [instance: d842f90e-663b-4c95-9d7c-d092d2bac41f] Took 17.82 seconds to build instance.
Nov 16 10:10:45 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-25f21eed-6c97-41f9-a9b9-a316d67a405c tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/361a2044-8fd0-4975-8a19-814bf7a6da41/disk --force-share --output=json" returned: 0 in 0.457s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:10:45 user nova-compute[85141]: DEBUG nova.virt.disk.api [None req-25f21eed-6c97-41f9-a9b9-a316d67a405c tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] Cannot resize image /opt/stack/data/nova/instances/361a2044-8fd0-4975-8a19-814bf7a6da41/disk to a smaller size. {{(pid=85141) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 10:10:45 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-25f21eed-6c97-41f9-a9b9-a316d67a405c tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] [instance: 361a2044-8fd0-4975-8a19-814bf7a6da41] Created local disks {{(pid=85141) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 10:10:45 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-25f21eed-6c97-41f9-a9b9-a316d67a405c tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] [instance: 361a2044-8fd0-4975-8a19-814bf7a6da41] Ensure instance console log exists: /opt/stack/data/nova/instances/361a2044-8fd0-4975-8a19-814bf7a6da41/console.log {{(pid=85141) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 10:10:45 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-25f21eed-6c97-41f9-a9b9-a316d67a405c tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:10:45 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-25f21eed-6c97-41f9-a9b9-a316d67a405c tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:10:45 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-25f21eed-6c97-41f9-a9b9-a316d67a405c tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:10:45 user nova-compute[85141]: INFO nova.compute.manager [None req-efd6cff3-9f97-4572-8f80-b6e15aa4b080 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] [instance: 9411843f-4e79-46c4-ae02-01f5e87b86eb] Took 18.20 seconds to build instance.
Nov 16 10:10:45 user nova-compute[85141]: INFO nova.compute.manager [None req-ce0015fa-dfda-4a9e-958b-2122ace9edea tempest-DeleteServersTestJSON-1770650847 tempest-DeleteServersTestJSON-1770650847-project-member] [instance: a4cdcb5b-b2a6-4736-85c8-7e6cdab8c9b1] Took 19.77 seconds to build instance.
Nov 16 10:10:45 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-efd6cff3-9f97-4572-8f80-b6e15aa4b080 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Lock "9411843f-4e79-46c4-ae02-01f5e87b86eb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.418s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:10:45 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-451f5472-7f7f-4464-b13c-dce06ae24a82 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Lock "d842f90e-663b-4c95-9d7c-d092d2bac41f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.420s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:10:45 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-ce0015fa-dfda-4a9e-958b-2122ace9edea tempest-DeleteServersTestJSON-1770650847 tempest-DeleteServersTestJSON-1770650847-project-member] Lock "a4cdcb5b-b2a6-4736-85c8-7e6cdab8c9b1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.137s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:10:46 user nova-compute[85141]: DEBUG nova.network.neutron [None req-25f21eed-6c97-41f9-a9b9-a316d67a405c tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] [instance: 361a2044-8fd0-4975-8a19-814bf7a6da41] Successfully updated port: dd85b227-3f3d-4f02-a323-661af6a9dc92 {{(pid=85141) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 10:10:46 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-25f21eed-6c97-41f9-a9b9-a316d67a405c tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] Acquiring lock "refresh_cache-361a2044-8fd0-4975-8a19-814bf7a6da41" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:10:46 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-25f21eed-6c97-41f9-a9b9-a316d67a405c tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] Acquired lock "refresh_cache-361a2044-8fd0-4975-8a19-814bf7a6da41" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:10:46 user nova-compute[85141]: DEBUG nova.network.neutron [None req-25f21eed-6c97-41f9-a9b9-a316d67a405c tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] [instance: 361a2044-8fd0-4975-8a19-814bf7a6da41] Building network info cache for instance {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 10:10:46 user nova-compute[85141]: DEBUG nova.compute.manager [req-e0abb251-c1f9-45bf-9541-04cf4423e43e req-8034d9c1-625a-47a7-a812-3a3eb66b8810 service nova] [instance: 361a2044-8fd0-4975-8a19-814bf7a6da41] Received event network-changed-dd85b227-3f3d-4f02-a323-661af6a9dc92 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:10:46 user nova-compute[85141]: DEBUG nova.compute.manager [req-e0abb251-c1f9-45bf-9541-04cf4423e43e req-8034d9c1-625a-47a7-a812-3a3eb66b8810 service nova] [instance: 361a2044-8fd0-4975-8a19-814bf7a6da41] Refreshing instance network info cache due to event network-changed-dd85b227-3f3d-4f02-a323-661af6a9dc92. {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 10:10:46 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-e0abb251-c1f9-45bf-9541-04cf4423e43e req-8034d9c1-625a-47a7-a812-3a3eb66b8810 service nova] Acquiring lock "refresh_cache-361a2044-8fd0-4975-8a19-814bf7a6da41" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:10:46 user nova-compute[85141]: DEBUG nova.network.neutron [None req-25f21eed-6c97-41f9-a9b9-a316d67a405c tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] [instance: 361a2044-8fd0-4975-8a19-814bf7a6da41] Instance cache missing network info. {{(pid=85141) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 10:10:46 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:10:46 user nova-compute[85141]: DEBUG nova.network.neutron [None req-25f21eed-6c97-41f9-a9b9-a316d67a405c tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] [instance: 361a2044-8fd0-4975-8a19-814bf7a6da41] Updating instance_info_cache with network_info: [{"id": "dd85b227-3f3d-4f02-a323-661af6a9dc92", "address": "fa:16:3e:b7:94:48", "network": {"id": "1d55ecdc-2f77-4c38-b487-0099d658e0ec", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1226034564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b9e035160ba427c80e5668982136a49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd85b227-3f", "ovs_interfaceid": "dd85b227-3f3d-4f02-a323-661af6a9dc92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:10:46 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-25f21eed-6c97-41f9-a9b9-a316d67a405c tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] Releasing lock "refresh_cache-361a2044-8fd0-4975-8a19-814bf7a6da41" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:10:46 user nova-compute[85141]: DEBUG nova.compute.manager [None req-25f21eed-6c97-41f9-a9b9-a316d67a405c tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] [instance: 361a2044-8fd0-4975-8a19-814bf7a6da41] Instance network_info: |[{"id": "dd85b227-3f3d-4f02-a323-661af6a9dc92", "address": "fa:16:3e:b7:94:48", "network": {"id": "1d55ecdc-2f77-4c38-b487-0099d658e0ec", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1226034564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b9e035160ba427c80e5668982136a49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd85b227-3f", "ovs_interfaceid": "dd85b227-3f3d-4f02-a323-661af6a9dc92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=85141) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 10:10:46 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-e0abb251-c1f9-45bf-9541-04cf4423e43e req-8034d9c1-625a-47a7-a812-3a3eb66b8810 service nova] Acquired lock "refresh_cache-361a2044-8fd0-4975-8a19-814bf7a6da41" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:10:46 user nova-compute[85141]: DEBUG nova.network.neutron [req-e0abb251-c1f9-45bf-9541-04cf4423e43e req-8034d9c1-625a-47a7-a812-3a3eb66b8810 service nova] [instance: 361a2044-8fd0-4975-8a19-814bf7a6da41] Refreshing network info cache for port dd85b227-3f3d-4f02-a323-661af6a9dc92 {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 10:10:46 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-25f21eed-6c97-41f9-a9b9-a316d67a405c tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] [instance: 361a2044-8fd0-4975-8a19-814bf7a6da41] Start _get_guest_xml network_info=[{"id": "dd85b227-3f3d-4f02-a323-661af6a9dc92", "address": "fa:16:3e:b7:94:48", "network": {"id": "1d55ecdc-2f77-4c38-b487-0099d658e0ec", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1226034564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b9e035160ba427c80e5668982136a49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd85b227-3f", "ovs_interfaceid": "dd85b227-3f3d-4f02-a323-661af6a9dc92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T10:06:42Z,direct_url=<?>,disk_format='qcow2',id=bc4ca70f-a459-4d5c-a9e6-80f1948eb48b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1044631a5fe84ce8904864a7024049fa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T10:06:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_options': None, 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'image_id': 'bc4ca70f-a459-4d5c-a9e6-80f1948eb48b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=85141) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 10:10:46 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:10:46 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-25f21eed-6c97-41f9-a9b9-a316d67a405c tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:10:46 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-25f21eed-6c97-41f9-a9b9-a316d67a405c tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:10:46 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-25f21eed-6c97-41f9-a9b9-a316d67a405c tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=85141) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 10:10:46 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-25f21eed-6c97-41f9-a9b9-a316d67a405c tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] CPU controller missing on host. {{(pid=85141) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 10:10:46 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-25f21eed-6c97-41f9-a9b9-a316d67a405c tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=85141) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 10:10:46 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-25f21eed-6c97-41f9-a9b9-a316d67a405c tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] CPU controller found on host. {{(pid=85141) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 10:10:46 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-25f21eed-6c97-41f9-a9b9-a316d67a405c tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=85141) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 10:10:46 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-25f21eed-6c97-41f9-a9b9-a316d67a405c tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T10:06:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T10:06:42Z,direct_url=<?>,disk_format='qcow2',id=bc4ca70f-a459-4d5c-a9e6-80f1948eb48b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1044631a5fe84ce8904864a7024049fa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T10:06:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 10:10:46 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-25f21eed-6c97-41f9-a9b9-a316d67a405c tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] Flavor limits 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 10:10:46 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-25f21eed-6c97-41f9-a9b9-a316d67a405c tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] Image limits 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 10:10:46 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-25f21eed-6c97-41f9-a9b9-a316d67a405c tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] Flavor pref 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 10:10:46 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-25f21eed-6c97-41f9-a9b9-a316d67a405c tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] Image pref 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 10:10:46 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-25f21eed-6c97-41f9-a9b9-a316d67a405c tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 10:10:46 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-25f21eed-6c97-41f9-a9b9-a316d67a405c tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 10:10:46 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-25f21eed-6c97-41f9-a9b9-a316d67a405c tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=85141) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 10:10:46 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-25f21eed-6c97-41f9-a9b9-a316d67a405c tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] Got 1 possible topologies {{(pid=85141) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 10:10:46 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-25f21eed-6c97-41f9-a9b9-a316d67a405c tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 10:10:46 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-25f21eed-6c97-41f9-a9b9-a316d67a405c tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 10:10:46 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-25f21eed-6c97-41f9-a9b9-a316d67a405c tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T10:10:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-2008440718',display_name='tempest-VolumesAdminNegativeTest-server-2008440718',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-2008440718',id=5,image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKJJyX4jvmRDtlOvUnLR1NGaW9kz6H4S0MtEXv2bCkSkZLqTx/3BW23lpqhAop1R16CP/RydfOXYjWmrpc/7xsJ7ZHMyJYpv3BQB7lPO/9bqDmD3KCEWvylt59wIgPjNFA==',key_name='tempest-keypair-2010714520',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5b9e035160ba427c80e5668982136a49',ramdisk_id='',reservation_id='r-7p7wsvva',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1984071326',owner_user_name='tempest-VolumesAdminNegativeTest-1984071326-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T10:10:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cb1fde08d82e4eedb97f1501eafa3bd0',uuid=361a2044-8fd0-4975-8a19-814bf7a6da41,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dd85b227-3f3d-4f02-a323-661af6a9dc92", "address": "fa:16:3e:b7:94:48", "network": {"id": "1d55ecdc-2f77-4c38-b487-0099d658e0ec", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1226034564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b9e035160ba427c80e5668982136a49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd85b227-3f", "ovs_interfaceid": "dd85b227-3f3d-4f02-a323-661af6a9dc92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=85141) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 10:10:46 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-25f21eed-6c97-41f9-a9b9-a316d67a405c tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] Converting VIF {"id": "dd85b227-3f3d-4f02-a323-661af6a9dc92", "address": "fa:16:3e:b7:94:48", "network": {"id": "1d55ecdc-2f77-4c38-b487-0099d658e0ec", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1226034564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b9e035160ba427c80e5668982136a49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd85b227-3f", "ovs_interfaceid": "dd85b227-3f3d-4f02-a323-661af6a9dc92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:10:46 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-25f21eed-6c97-41f9-a9b9-a316d67a405c tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:94:48,bridge_name='br-int',has_traffic_filtering=True,id=dd85b227-3f3d-4f02-a323-661af6a9dc92,network=Network(1d55ecdc-2f77-4c38-b487-0099d658e0ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd85b227-3f') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:10:46 user nova-compute[85141]: DEBUG nova.objects.instance [None req-25f21eed-6c97-41f9-a9b9-a316d67a405c tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] Lazy-loading 'pci_devices' on Instance uuid 361a2044-8fd0-4975-8a19-814bf7a6da41 {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:10:46 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-25f21eed-6c97-41f9-a9b9-a316d67a405c tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] [instance: 361a2044-8fd0-4975-8a19-814bf7a6da41] End _get_guest_xml xml=<domain type="kvm">
Nov 16 10:10:46 user nova-compute[85141]:   <uuid>361a2044-8fd0-4975-8a19-814bf7a6da41</uuid>
Nov 16 10:10:46 user nova-compute[85141]:   <name>instance-00000005</name>
Nov 16 10:10:46 user nova-compute[85141]:   <memory>524288</memory>
Nov 16 10:10:46 user nova-compute[85141]:   <vcpu>1</vcpu>
Nov 16 10:10:46 user nova-compute[85141]:   <metadata>
Nov 16 10:10:46 user nova-compute[85141]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 10:10:46 user nova-compute[85141]:       <nova:package version="0.0.0"/>
Nov 16 10:10:46 user nova-compute[85141]:       <nova:name>tempest-VolumesAdminNegativeTest-server-2008440718</nova:name>
Nov 16 10:10:46 user nova-compute[85141]:       <nova:creationTime>2023-11-16 10:10:46</nova:creationTime>
Nov 16 10:10:46 user nova-compute[85141]:       <nova:flavor name="m1.tiny">
Nov 16 10:10:46 user nova-compute[85141]:         <nova:memory>512</nova:memory>
Nov 16 10:10:46 user nova-compute[85141]:         <nova:disk>1</nova:disk>
Nov 16 10:10:46 user nova-compute[85141]:         <nova:swap>0</nova:swap>
Nov 16 10:10:46 user nova-compute[85141]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 10:10:46 user nova-compute[85141]:         <nova:vcpus>1</nova:vcpus>
Nov 16 10:10:46 user nova-compute[85141]:       </nova:flavor>
Nov 16 10:10:46 user nova-compute[85141]:       <nova:owner>
Nov 16 10:10:46 user nova-compute[85141]:         <nova:user uuid="cb1fde08d82e4eedb97f1501eafa3bd0">tempest-VolumesAdminNegativeTest-1984071326-project-member</nova:user>
Nov 16 10:10:46 user nova-compute[85141]:         <nova:project uuid="5b9e035160ba427c80e5668982136a49">tempest-VolumesAdminNegativeTest-1984071326</nova:project>
Nov 16 10:10:46 user nova-compute[85141]:       </nova:owner>
Nov 16 10:10:46 user nova-compute[85141]:       <nova:root type="image" uuid="bc4ca70f-a459-4d5c-a9e6-80f1948eb48b"/>
Nov 16 10:10:46 user nova-compute[85141]:       <nova:ports>
Nov 16 10:10:46 user nova-compute[85141]:         <nova:port uuid="dd85b227-3f3d-4f02-a323-661af6a9dc92">
Nov 16 10:10:46 user nova-compute[85141]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 16 10:10:46 user nova-compute[85141]:         </nova:port>
Nov 16 10:10:46 user nova-compute[85141]:       </nova:ports>
Nov 16 10:10:46 user nova-compute[85141]:     </nova:instance>
Nov 16 10:10:46 user nova-compute[85141]:   </metadata>
Nov 16 10:10:46 user nova-compute[85141]:   <sysinfo type="smbios">
Nov 16 10:10:46 user nova-compute[85141]:     <system>
Nov 16 10:10:46 user nova-compute[85141]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 10:10:46 user nova-compute[85141]:       <entry name="product">OpenStack Nova</entry>
Nov 16 10:10:46 user nova-compute[85141]:       <entry name="version">0.0.0</entry>
Nov 16 10:10:46 user nova-compute[85141]:       <entry name="serial">361a2044-8fd0-4975-8a19-814bf7a6da41</entry>
Nov 16 10:10:46 user nova-compute[85141]:       <entry name="uuid">361a2044-8fd0-4975-8a19-814bf7a6da41</entry>
Nov 16 10:10:46 user nova-compute[85141]:       <entry name="family">Virtual Machine</entry>
Nov 16 10:10:46 user nova-compute[85141]:     </system>
Nov 16 10:10:46 user nova-compute[85141]:   </sysinfo>
Nov 16 10:10:46 user nova-compute[85141]:   <os>
Nov 16 10:10:46 user nova-compute[85141]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 10:10:46 user nova-compute[85141]:     <boot dev="hd"/>
Nov 16 10:10:46 user nova-compute[85141]:     <smbios mode="sysinfo"/>
Nov 16 10:10:46 user nova-compute[85141]:   </os>
Nov 16 10:10:46 user nova-compute[85141]:   <features>
Nov 16 10:10:46 user nova-compute[85141]:     <acpi/>
Nov 16 10:10:46 user nova-compute[85141]:     <apic/>
Nov 16 10:10:46 user nova-compute[85141]:     <vmcoreinfo/>
Nov 16 10:10:46 user nova-compute[85141]:   </features>
Nov 16 10:10:46 user nova-compute[85141]:   <clock offset="utc">
Nov 16 10:10:46 user nova-compute[85141]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 10:10:46 user nova-compute[85141]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 10:10:46 user nova-compute[85141]:     <timer name="hpet" present="no"/>
Nov 16 10:10:46 user nova-compute[85141]:   </clock>
Nov 16 10:10:46 user nova-compute[85141]:   <cpu mode="custom" match="exact">
Nov 16 10:10:46 user nova-compute[85141]:     <model>Nehalem</model>
Nov 16 10:10:46 user nova-compute[85141]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 10:10:46 user nova-compute[85141]:   </cpu>
Nov 16 10:10:46 user nova-compute[85141]:   <devices>
Nov 16 10:10:46 user nova-compute[85141]:     <disk type="file" device="disk">
Nov 16 10:10:46 user nova-compute[85141]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 10:10:46 user nova-compute[85141]:       <source file="/opt/stack/data/nova/instances/361a2044-8fd0-4975-8a19-814bf7a6da41/disk"/>
Nov 16 10:10:46 user nova-compute[85141]:       <target dev="vda" bus="virtio"/>
Nov 16 10:10:46 user nova-compute[85141]:     </disk>
Nov 16 10:10:46 user nova-compute[85141]:     <interface type="ethernet">
Nov 16 10:10:46 user nova-compute[85141]:       <mac address="fa:16:3e:b7:94:48"/>
Nov 16 10:10:46 user nova-compute[85141]:       <model type="virtio"/>
Nov 16 10:10:46 user nova-compute[85141]:       <mtu size="1442"/>
Nov 16 10:10:46 user nova-compute[85141]:       <target dev="tapdd85b227-3f"/>
Nov 16 10:10:46 user nova-compute[85141]:     </interface>
Nov 16 10:10:46 user nova-compute[85141]:     <serial type="pty">
Nov 16 10:10:46 user nova-compute[85141]:       <log file="/opt/stack/data/nova/instances/361a2044-8fd0-4975-8a19-814bf7a6da41/console.log" append="off"/>
Nov 16 10:10:46 user nova-compute[85141]:     </serial>
Nov 16 10:10:46 user nova-compute[85141]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 10:10:46 user nova-compute[85141]:     <video>
Nov 16 10:10:46 user nova-compute[85141]:       <model type="virtio"/>
Nov 16 10:10:46 user nova-compute[85141]:     </video>
Nov 16 10:10:46 user nova-compute[85141]:     <rng model="virtio">
Nov 16 10:10:46 user nova-compute[85141]:       <backend model="random">/dev/urandom</backend>
Nov 16 10:10:46 user nova-compute[85141]:     </rng>
Nov 16 10:10:46 user nova-compute[85141]:     <controller type="usb" index="0" model="none"/>
Nov 16 10:10:46 user nova-compute[85141]:     <memballoon model="virtio">
Nov 16 10:10:46 user nova-compute[85141]:       <stats period="10"/>
Nov 16 10:10:46 user nova-compute[85141]:     </memballoon>
Nov 16 10:10:46 user nova-compute[85141]:   </devices>
Nov 16 10:10:46 user nova-compute[85141]: </domain>
Nov 16 10:10:46 user nova-compute[85141]:  {{(pid=85141) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 10:10:46 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-25f21eed-6c97-41f9-a9b9-a316d67a405c tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T10:10:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-2008440718',display_name='tempest-VolumesAdminNegativeTest-server-2008440718',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-2008440718',id=5,image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKJJyX4jvmRDtlOvUnLR1NGaW9kz6H4S0MtEXv2bCkSkZLqTx/3BW23lpqhAop1R16CP/RydfOXYjWmrpc/7xsJ7ZHMyJYpv3BQB7lPO/9bqDmD3KCEWvylt59wIgPjNFA==',key_name='tempest-keypair-2010714520',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5b9e035160ba427c80e5668982136a49',ramdisk_id='',reservation_id='r-7p7wsvva',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1984071326',owner_user_name='tempest-VolumesAdminNegativeTest-1984071326-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T10:10:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cb1fde08d82e4eedb97f1501eafa3bd0',uuid=361a2044-8fd0-4975-8a19-814bf7a6da41,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dd85b227-3f3d-4f02-a323-661af6a9dc92", "address": "fa:16:3e:b7:94:48", "network": {"id": "1d55ecdc-2f77-4c38-b487-0099d658e0ec", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1226034564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b9e035160ba427c80e5668982136a49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd85b227-3f", "ovs_interfaceid": "dd85b227-3f3d-4f02-a323-661af6a9dc92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 10:10:46 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-25f21eed-6c97-41f9-a9b9-a316d67a405c tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] Converting VIF {"id": "dd85b227-3f3d-4f02-a323-661af6a9dc92", "address": "fa:16:3e:b7:94:48", "network": {"id": "1d55ecdc-2f77-4c38-b487-0099d658e0ec", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1226034564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b9e035160ba427c80e5668982136a49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd85b227-3f", "ovs_interfaceid": "dd85b227-3f3d-4f02-a323-661af6a9dc92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:10:46 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-25f21eed-6c97-41f9-a9b9-a316d67a405c tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:94:48,bridge_name='br-int',has_traffic_filtering=True,id=dd85b227-3f3d-4f02-a323-661af6a9dc92,network=Network(1d55ecdc-2f77-4c38-b487-0099d658e0ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd85b227-3f') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:10:46 user nova-compute[85141]: DEBUG os_vif [None req-25f21eed-6c97-41f9-a9b9-a316d67a405c tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:94:48,bridge_name='br-int',has_traffic_filtering=True,id=dd85b227-3f3d-4f02-a323-661af6a9dc92,network=Network(1d55ecdc-2f77-4c38-b487-0099d658e0ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd85b227-3f') {{(pid=85141) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 10:10:46 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:10:46 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:10:46 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 10:10:46 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:10:46 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e9567e4d-1d71-54fc-b92f-e4e5bc0c16de', '_type': 'linux-noop'}}, row=False) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:10:46 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:10:46 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:10:46 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdd85b227-3f, may_exist=True, interface_attrs={}) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:10:46 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdd85b227-3f, col_values=(('qos', UUID('9dea2fd6-5ba2-4c2f-b5e2-1430ffe94699')),), if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:10:46 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdd85b227-3f, col_values=(('external_ids', {'iface-id': 'dd85b227-3f3d-4f02-a323-661af6a9dc92', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b7:94:48', 'vm-uuid': '361a2044-8fd0-4975-8a19-814bf7a6da41'}),), if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:10:46 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:10:46 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:10:46 user nova-compute[85141]: INFO os_vif [None req-25f21eed-6c97-41f9-a9b9-a316d67a405c tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:94:48,bridge_name='br-int',has_traffic_filtering=True,id=dd85b227-3f3d-4f02-a323-661af6a9dc92,network=Network(1d55ecdc-2f77-4c38-b487-0099d658e0ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd85b227-3f')
Nov 16 10:10:47 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-25f21eed-6c97-41f9-a9b9-a316d67a405c tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] No BDM found with device name vda, not building metadata. {{(pid=85141) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 10:10:47 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-25f21eed-6c97-41f9-a9b9-a316d67a405c tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] No VIF found with MAC fa:16:3e:b7:94:48, not building metadata {{(pid=85141) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 10:10:47 user nova-compute[85141]: DEBUG nova.network.neutron [req-e0abb251-c1f9-45bf-9541-04cf4423e43e req-8034d9c1-625a-47a7-a812-3a3eb66b8810 service nova] [instance: 361a2044-8fd0-4975-8a19-814bf7a6da41] Updated VIF entry in instance network info cache for port dd85b227-3f3d-4f02-a323-661af6a9dc92. {{(pid=85141) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 10:10:47 user nova-compute[85141]: DEBUG nova.network.neutron [req-e0abb251-c1f9-45bf-9541-04cf4423e43e req-8034d9c1-625a-47a7-a812-3a3eb66b8810 service nova] [instance: 361a2044-8fd0-4975-8a19-814bf7a6da41] Updating instance_info_cache with network_info: [{"id": "dd85b227-3f3d-4f02-a323-661af6a9dc92", "address": "fa:16:3e:b7:94:48", "network": {"id": "1d55ecdc-2f77-4c38-b487-0099d658e0ec", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1226034564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b9e035160ba427c80e5668982136a49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd85b227-3f", "ovs_interfaceid": "dd85b227-3f3d-4f02-a323-661af6a9dc92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:10:47 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-e0abb251-c1f9-45bf-9541-04cf4423e43e req-8034d9c1-625a-47a7-a812-3a3eb66b8810 service nova] Releasing lock "refresh_cache-361a2044-8fd0-4975-8a19-814bf7a6da41" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:10:48 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:10:48 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:10:48 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:10:48 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:10:48 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:10:48 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:10:48 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:10:48 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:10:48 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:10:50 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:10:50 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:10:50 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:10:50 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:10:50 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-423d5091-25e9-4945-86b6-f74cc45c840e tempest-TestVolumeSwap-1428287604 tempest-TestVolumeSwap-1428287604-project-member] Acquiring lock "ad1ace46-2e8e-42e1-a0f5-2384078fcf09" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:10:50 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-423d5091-25e9-4945-86b6-f74cc45c840e tempest-TestVolumeSwap-1428287604 tempest-TestVolumeSwap-1428287604-project-member] Lock "ad1ace46-2e8e-42e1-a0f5-2384078fcf09" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:10:50 user nova-compute[85141]: DEBUG nova.compute.manager [None req-423d5091-25e9-4945-86b6-f74cc45c840e tempest-TestVolumeSwap-1428287604 tempest-TestVolumeSwap-1428287604-project-member] [instance: ad1ace46-2e8e-42e1-a0f5-2384078fcf09] Starting instance... {{(pid=85141) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 10:10:51 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-423d5091-25e9-4945-86b6-f74cc45c840e tempest-TestVolumeSwap-1428287604 tempest-TestVolumeSwap-1428287604-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:10:51 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-423d5091-25e9-4945-86b6-f74cc45c840e tempest-TestVolumeSwap-1428287604 tempest-TestVolumeSwap-1428287604-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:10:51 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-423d5091-25e9-4945-86b6-f74cc45c840e tempest-TestVolumeSwap-1428287604 tempest-TestVolumeSwap-1428287604-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=85141) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 10:10:51 user nova-compute[85141]: INFO nova.compute.claims [None req-423d5091-25e9-4945-86b6-f74cc45c840e tempest-TestVolumeSwap-1428287604 tempest-TestVolumeSwap-1428287604-project-member] [instance: ad1ace46-2e8e-42e1-a0f5-2384078fcf09] Claim successful on node user
Nov 16 10:10:51 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbcf7f0-a47f-465d-b445-cd3b21c9cf8e tempest-AttachSCSIVolumeTestJSON-1774410022 tempest-AttachSCSIVolumeTestJSON-1774410022-project-member] Acquiring lock "ff964caf-b473-47bc-89d2-f7189264721c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:10:51 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbcf7f0-a47f-465d-b445-cd3b21c9cf8e tempest-AttachSCSIVolumeTestJSON-1774410022 tempest-AttachSCSIVolumeTestJSON-1774410022-project-member] Lock "ff964caf-b473-47bc-89d2-f7189264721c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:10:51 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbcf7f0-a47f-465d-b445-cd3b21c9cf8e tempest-AttachSCSIVolumeTestJSON-1774410022 tempest-AttachSCSIVolumeTestJSON-1774410022-project-member] [instance: ff964caf-b473-47bc-89d2-f7189264721c] Starting instance... {{(pid=85141) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 10:10:51 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:10:51 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:10:51 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:10:51 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:10:51 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbcf7f0-a47f-465d-b445-cd3b21c9cf8e tempest-AttachSCSIVolumeTestJSON-1774410022 tempest-AttachSCSIVolumeTestJSON-1774410022-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:10:51 user nova-compute[85141]: DEBUG nova.compute.provider_tree [None req-423d5091-25e9-4945-86b6-f74cc45c840e tempest-TestVolumeSwap-1428287604 tempest-TestVolumeSwap-1428287604-project-member] Inventory has not changed in ProviderTree for provider: bf8e0fa1-16b6-408f-9203-c4cd63916272 {{(pid=85141) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 10:10:51 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:10:51 user nova-compute[85141]: DEBUG nova.scheduler.client.report [None req-423d5091-25e9-4945-86b6-f74cc45c840e tempest-TestVolumeSwap-1428287604 tempest-TestVolumeSwap-1428287604-project-member] Inventory has not changed for provider bf8e0fa1-16b6-408f-9203-c4cd63916272 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=85141) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 10:10:51 user nova-compute[85141]: DEBUG nova.compute.manager [None req-25f21eed-6c97-41f9-a9b9-a316d67a405c tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] [instance: 361a2044-8fd0-4975-8a19-814bf7a6da41] Instance event wait completed in 0 seconds for  {{(pid=85141) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 10:10:51 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-25f21eed-6c97-41f9-a9b9-a316d67a405c tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] [instance: 361a2044-8fd0-4975-8a19-814bf7a6da41] Guest created on hypervisor {{(pid=85141) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 10:10:51 user nova-compute[85141]: INFO nova.virt.libvirt.driver [-] [instance: 361a2044-8fd0-4975-8a19-814bf7a6da41] Instance spawned successfully.
Nov 16 10:10:51 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-25f21eed-6c97-41f9-a9b9-a316d67a405c tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] [instance: 361a2044-8fd0-4975-8a19-814bf7a6da41] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 10:10:51 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-25f21eed-6c97-41f9-a9b9-a316d67a405c tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] [instance: 361a2044-8fd0-4975-8a19-814bf7a6da41] Found default for hw_cdrom_bus of ide {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:10:51 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-25f21eed-6c97-41f9-a9b9-a316d67a405c tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] [instance: 361a2044-8fd0-4975-8a19-814bf7a6da41] Found default for hw_disk_bus of virtio {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:10:51 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-25f21eed-6c97-41f9-a9b9-a316d67a405c tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] [instance: 361a2044-8fd0-4975-8a19-814bf7a6da41] Found default for hw_input_bus of None {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:10:51 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-25f21eed-6c97-41f9-a9b9-a316d67a405c tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] [instance: 361a2044-8fd0-4975-8a19-814bf7a6da41] Found default for hw_pointer_model of None {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:10:51 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-25f21eed-6c97-41f9-a9b9-a316d67a405c tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] [instance: 361a2044-8fd0-4975-8a19-814bf7a6da41] Found default for hw_video_model of virtio {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:10:51 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-25f21eed-6c97-41f9-a9b9-a316d67a405c tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] [instance: 361a2044-8fd0-4975-8a19-814bf7a6da41] Found default for hw_vif_model of virtio {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:10:51 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:10:52 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-423d5091-25e9-4945-86b6-f74cc45c840e tempest-TestVolumeSwap-1428287604 tempest-TestVolumeSwap-1428287604-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.973s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:10:52 user nova-compute[85141]: DEBUG nova.compute.manager [None req-423d5091-25e9-4945-86b6-f74cc45c840e tempest-TestVolumeSwap-1428287604 tempest-TestVolumeSwap-1428287604-project-member] [instance: ad1ace46-2e8e-42e1-a0f5-2384078fcf09] Start building networks asynchronously for instance. {{(pid=85141) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 10:10:52 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbcf7f0-a47f-465d-b445-cd3b21c9cf8e tempest-AttachSCSIVolumeTestJSON-1774410022 tempest-AttachSCSIVolumeTestJSON-1774410022-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.694s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:10:52 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-5fbcf7f0-a47f-465d-b445-cd3b21c9cf8e tempest-AttachSCSIVolumeTestJSON-1774410022 tempest-AttachSCSIVolumeTestJSON-1774410022-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=85141) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 10:10:52 user nova-compute[85141]: INFO nova.compute.claims [None req-5fbcf7f0-a47f-465d-b445-cd3b21c9cf8e tempest-AttachSCSIVolumeTestJSON-1774410022 tempest-AttachSCSIVolumeTestJSON-1774410022-project-member] [instance: ff964caf-b473-47bc-89d2-f7189264721c] Claim successful on node user
Nov 16 10:10:52 user nova-compute[85141]: DEBUG nova.compute.manager [None req-423d5091-25e9-4945-86b6-f74cc45c840e tempest-TestVolumeSwap-1428287604 tempest-TestVolumeSwap-1428287604-project-member] [instance: ad1ace46-2e8e-42e1-a0f5-2384078fcf09] Allocating IP information in the background. {{(pid=85141) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 10:10:52 user nova-compute[85141]: DEBUG nova.network.neutron [None req-423d5091-25e9-4945-86b6-f74cc45c840e tempest-TestVolumeSwap-1428287604 tempest-TestVolumeSwap-1428287604-project-member] [instance: ad1ace46-2e8e-42e1-a0f5-2384078fcf09] allocate_for_instance() {{(pid=85141) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 10:10:52 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-423d5091-25e9-4945-86b6-f74cc45c840e tempest-TestVolumeSwap-1428287604 tempest-TestVolumeSwap-1428287604-project-member] [instance: ad1ace46-2e8e-42e1-a0f5-2384078fcf09] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 10:10:52 user nova-compute[85141]: INFO nova.compute.manager [None req-25f21eed-6c97-41f9-a9b9-a316d67a405c tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] [instance: 361a2044-8fd0-4975-8a19-814bf7a6da41] Took 8.53 seconds to spawn the instance on the hypervisor.
Nov 16 10:10:52 user nova-compute[85141]: DEBUG nova.compute.manager [None req-25f21eed-6c97-41f9-a9b9-a316d67a405c tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] [instance: 361a2044-8fd0-4975-8a19-814bf7a6da41] Checking state {{(pid=85141) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 10:10:52 user nova-compute[85141]: DEBUG nova.compute.manager [None req-423d5091-25e9-4945-86b6-f74cc45c840e tempest-TestVolumeSwap-1428287604 tempest-TestVolumeSwap-1428287604-project-member] [instance: ad1ace46-2e8e-42e1-a0f5-2384078fcf09] Start building block device mappings for instance. {{(pid=85141) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 10:10:52 user nova-compute[85141]: DEBUG nova.policy [None req-423d5091-25e9-4945-86b6-f74cc45c840e tempest-TestVolumeSwap-1428287604 tempest-TestVolumeSwap-1428287604-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3b5ceb88a01f470ab7bd5c8bc6ac6c8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '466fcdf8030148ca8afbd0e8ffd24a11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85141) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 10:10:52 user nova-compute[85141]: INFO nova.compute.manager [None req-25f21eed-6c97-41f9-a9b9-a316d67a405c tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] [instance: 361a2044-8fd0-4975-8a19-814bf7a6da41] Took 9.71 seconds to build instance.
Nov 16 10:10:52 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-25f21eed-6c97-41f9-a9b9-a316d67a405c tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] Lock "361a2044-8fd0-4975-8a19-814bf7a6da41" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.064s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:10:52 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:10:52 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:10:52 user nova-compute[85141]: DEBUG nova.compute.manager [None req-423d5091-25e9-4945-86b6-f74cc45c840e tempest-TestVolumeSwap-1428287604 tempest-TestVolumeSwap-1428287604-project-member] [instance: ad1ace46-2e8e-42e1-a0f5-2384078fcf09] Start spawning the instance on the hypervisor. {{(pid=85141) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 10:10:52 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-423d5091-25e9-4945-86b6-f74cc45c840e tempest-TestVolumeSwap-1428287604 tempest-TestVolumeSwap-1428287604-project-member] [instance: ad1ace46-2e8e-42e1-a0f5-2384078fcf09] Creating instance directory {{(pid=85141) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 10:10:52 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-423d5091-25e9-4945-86b6-f74cc45c840e tempest-TestVolumeSwap-1428287604 tempest-TestVolumeSwap-1428287604-project-member] [instance: ad1ace46-2e8e-42e1-a0f5-2384078fcf09] Creating image(s)
Nov 16 10:10:52 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-423d5091-25e9-4945-86b6-f74cc45c840e tempest-TestVolumeSwap-1428287604 tempest-TestVolumeSwap-1428287604-project-member] Acquiring lock "/opt/stack/data/nova/instances/ad1ace46-2e8e-42e1-a0f5-2384078fcf09/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:10:52 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-423d5091-25e9-4945-86b6-f74cc45c840e tempest-TestVolumeSwap-1428287604 tempest-TestVolumeSwap-1428287604-project-member] Lock "/opt/stack/data/nova/instances/ad1ace46-2e8e-42e1-a0f5-2384078fcf09/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.003s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:10:52 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-423d5091-25e9-4945-86b6-f74cc45c840e tempest-TestVolumeSwap-1428287604 tempest-TestVolumeSwap-1428287604-project-member] Lock "/opt/stack/data/nova/instances/ad1ace46-2e8e-42e1-a0f5-2384078fcf09/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:10:52 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-423d5091-25e9-4945-86b6-f74cc45c840e tempest-TestVolumeSwap-1428287604 tempest-TestVolumeSwap-1428287604-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:10:52 user nova-compute[85141]: DEBUG nova.compute.provider_tree [None req-5fbcf7f0-a47f-465d-b445-cd3b21c9cf8e tempest-AttachSCSIVolumeTestJSON-1774410022 tempest-AttachSCSIVolumeTestJSON-1774410022-project-member] Inventory has not changed in ProviderTree for provider: bf8e0fa1-16b6-408f-9203-c4cd63916272 {{(pid=85141) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 10:10:52 user nova-compute[85141]: DEBUG nova.scheduler.client.report [None req-5fbcf7f0-a47f-465d-b445-cd3b21c9cf8e tempest-AttachSCSIVolumeTestJSON-1774410022 tempest-AttachSCSIVolumeTestJSON-1774410022-project-member] Inventory has not changed for provider bf8e0fa1-16b6-408f-9203-c4cd63916272 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=85141) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 10:10:52 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-77454959-aa5e-4ea4-a4b2-40594749ed82 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] Acquiring lock "0ca61bd2-268e-4c49-ba04-a5cb39143a9b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:10:52 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-77454959-aa5e-4ea4-a4b2-40594749ed82 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] Lock "0ca61bd2-268e-4c49-ba04-a5cb39143a9b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.004s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:10:52 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbcf7f0-a47f-465d-b445-cd3b21c9cf8e tempest-AttachSCSIVolumeTestJSON-1774410022 tempest-AttachSCSIVolumeTestJSON-1774410022-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.879s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:10:52 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbcf7f0-a47f-465d-b445-cd3b21c9cf8e tempest-AttachSCSIVolumeTestJSON-1774410022 tempest-AttachSCSIVolumeTestJSON-1774410022-project-member] [instance: ff964caf-b473-47bc-89d2-f7189264721c] Start building networks asynchronously for instance. {{(pid=85141) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 10:10:52 user nova-compute[85141]: DEBUG nova.compute.manager [None req-77454959-aa5e-4ea4-a4b2-40594749ed82 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] [instance: 0ca61bd2-268e-4c49-ba04-a5cb39143a9b] Starting instance... {{(pid=85141) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 10:10:53 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-423d5091-25e9-4945-86b6-f74cc45c840e tempest-TestVolumeSwap-1428287604 tempest-TestVolumeSwap-1428287604-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json" returned: 0 in 0.345s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:10:53 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-423d5091-25e9-4945-86b6-f74cc45c840e tempest-TestVolumeSwap-1428287604 tempest-TestVolumeSwap-1428287604-project-member] Acquiring lock "60a78556fb399ed4a41bc3ca4bccf77c96d8e811" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:10:53 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-423d5091-25e9-4945-86b6-f74cc45c840e tempest-TestVolumeSwap-1428287604 tempest-TestVolumeSwap-1428287604-project-member] Lock "60a78556fb399ed4a41bc3ca4bccf77c96d8e811" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:10:53 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-423d5091-25e9-4945-86b6-f74cc45c840e tempest-TestVolumeSwap-1428287604 tempest-TestVolumeSwap-1428287604-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:10:53 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbcf7f0-a47f-465d-b445-cd3b21c9cf8e tempest-AttachSCSIVolumeTestJSON-1774410022 tempest-AttachSCSIVolumeTestJSON-1774410022-project-member] [instance: ff964caf-b473-47bc-89d2-f7189264721c] Allocating IP information in the background. {{(pid=85141) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 10:10:53 user nova-compute[85141]: DEBUG nova.network.neutron [None req-5fbcf7f0-a47f-465d-b445-cd3b21c9cf8e tempest-AttachSCSIVolumeTestJSON-1774410022 tempest-AttachSCSIVolumeTestJSON-1774410022-project-member] [instance: ff964caf-b473-47bc-89d2-f7189264721c] allocate_for_instance() {{(pid=85141) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 10:10:53 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-5fbcf7f0-a47f-465d-b445-cd3b21c9cf8e tempest-AttachSCSIVolumeTestJSON-1774410022 tempest-AttachSCSIVolumeTestJSON-1774410022-project-member] [instance: ff964caf-b473-47bc-89d2-f7189264721c] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Nov 16 10:10:53 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbcf7f0-a47f-465d-b445-cd3b21c9cf8e tempest-AttachSCSIVolumeTestJSON-1774410022 tempest-AttachSCSIVolumeTestJSON-1774410022-project-member] [instance: ff964caf-b473-47bc-89d2-f7189264721c] Start building block device mappings for instance. {{(pid=85141) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 10:10:53 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-77454959-aa5e-4ea4-a4b2-40594749ed82 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:10:53 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-77454959-aa5e-4ea4-a4b2-40594749ed82 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:10:53 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-77454959-aa5e-4ea4-a4b2-40594749ed82 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=85141) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 10:10:53 user nova-compute[85141]: INFO nova.compute.claims [None req-77454959-aa5e-4ea4-a4b2-40594749ed82 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] [instance: 0ca61bd2-268e-4c49-ba04-a5cb39143a9b] Claim successful on node user
Nov 16 10:10:53 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-423d5091-25e9-4945-86b6-f74cc45c840e tempest-TestVolumeSwap-1428287604 tempest-TestVolumeSwap-1428287604-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json" returned: 0 in 0.518s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:10:53 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-423d5091-25e9-4945-86b6-f74cc45c840e tempest-TestVolumeSwap-1428287604 tempest-TestVolumeSwap-1428287604-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811,backing_fmt=raw /opt/stack/data/nova/instances/ad1ace46-2e8e-42e1-a0f5-2384078fcf09/disk 1073741824 {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:10:53 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-423d5091-25e9-4945-86b6-f74cc45c840e tempest-TestVolumeSwap-1428287604 tempest-TestVolumeSwap-1428287604-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811,backing_fmt=raw /opt/stack/data/nova/instances/ad1ace46-2e8e-42e1-a0f5-2384078fcf09/disk 1073741824" returned: 0 in 0.121s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:10:53 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-423d5091-25e9-4945-86b6-f74cc45c840e tempest-TestVolumeSwap-1428287604 tempest-TestVolumeSwap-1428287604-project-member] Lock "60a78556fb399ed4a41bc3ca4bccf77c96d8e811" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.662s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:10:53 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-423d5091-25e9-4945-86b6-f74cc45c840e tempest-TestVolumeSwap-1428287604 tempest-TestVolumeSwap-1428287604-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:10:53 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-d75ac365-ae12-46bf-bb9b-1ef1096b5aae tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] Acquiring lock "6caf3667-5613-4ef4-a597-1820e6c1c0ac" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:10:53 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-d75ac365-ae12-46bf-bb9b-1ef1096b5aae tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] Lock "6caf3667-5613-4ef4-a597-1820e6c1c0ac" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:10:53 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbcf7f0-a47f-465d-b445-cd3b21c9cf8e tempest-AttachSCSIVolumeTestJSON-1774410022 tempest-AttachSCSIVolumeTestJSON-1774410022-project-member] [instance: ff964caf-b473-47bc-89d2-f7189264721c] Start spawning the instance on the hypervisor. {{(pid=85141) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 10:10:53 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-5fbcf7f0-a47f-465d-b445-cd3b21c9cf8e tempest-AttachSCSIVolumeTestJSON-1774410022 tempest-AttachSCSIVolumeTestJSON-1774410022-project-member] [instance: ff964caf-b473-47bc-89d2-f7189264721c] Creating instance directory {{(pid=85141) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 10:10:53 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-5fbcf7f0-a47f-465d-b445-cd3b21c9cf8e tempest-AttachSCSIVolumeTestJSON-1774410022 tempest-AttachSCSIVolumeTestJSON-1774410022-project-member] [instance: ff964caf-b473-47bc-89d2-f7189264721c] Creating image(s)
Nov 16 10:10:53 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbcf7f0-a47f-465d-b445-cd3b21c9cf8e tempest-AttachSCSIVolumeTestJSON-1774410022 tempest-AttachSCSIVolumeTestJSON-1774410022-project-member] Acquiring lock "/opt/stack/data/nova/instances/ff964caf-b473-47bc-89d2-f7189264721c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:10:53 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbcf7f0-a47f-465d-b445-cd3b21c9cf8e tempest-AttachSCSIVolumeTestJSON-1774410022 tempest-AttachSCSIVolumeTestJSON-1774410022-project-member] Lock "/opt/stack/data/nova/instances/ff964caf-b473-47bc-89d2-f7189264721c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:10:53 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbcf7f0-a47f-465d-b445-cd3b21c9cf8e tempest-AttachSCSIVolumeTestJSON-1774410022 tempest-AttachSCSIVolumeTestJSON-1774410022-project-member] Lock "/opt/stack/data/nova/instances/ff964caf-b473-47bc-89d2-f7189264721c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:10:53 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbcf7f0-a47f-465d-b445-cd3b21c9cf8e tempest-AttachSCSIVolumeTestJSON-1774410022 tempest-AttachSCSIVolumeTestJSON-1774410022-project-member] Acquiring lock "55d6d40b0102aca79b96233adbd68dbdebe68921" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:10:53 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbcf7f0-a47f-465d-b445-cd3b21c9cf8e tempest-AttachSCSIVolumeTestJSON-1774410022 tempest-AttachSCSIVolumeTestJSON-1774410022-project-member] Lock "55d6d40b0102aca79b96233adbd68dbdebe68921" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:10:53 user nova-compute[85141]: DEBUG nova.network.neutron [None req-423d5091-25e9-4945-86b6-f74cc45c840e tempest-TestVolumeSwap-1428287604 tempest-TestVolumeSwap-1428287604-project-member] [instance: ad1ace46-2e8e-42e1-a0f5-2384078fcf09] Successfully created port: 2a895913-f200-44a4-b3bc-4a1c876e2714 {{(pid=85141) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 10:10:53 user nova-compute[85141]: DEBUG nova.compute.manager [None req-d75ac365-ae12-46bf-bb9b-1ef1096b5aae tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] [instance: 6caf3667-5613-4ef4-a597-1820e6c1c0ac] Starting instance... {{(pid=85141) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 10:10:53 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:10:54 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbcf7f0-a47f-465d-b445-cd3b21c9cf8e tempest-AttachSCSIVolumeTestJSON-1774410022 tempest-AttachSCSIVolumeTestJSON-1774410022-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/55d6d40b0102aca79b96233adbd68dbdebe68921.part --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:10:54 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:10:54 user nova-compute[85141]: DEBUG nova.policy [None req-5fbcf7f0-a47f-465d-b445-cd3b21c9cf8e tempest-AttachSCSIVolumeTestJSON-1774410022 tempest-AttachSCSIVolumeTestJSON-1774410022-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5604acaea0e24287869ede44b6df80e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4a953734f44d049877b7658cae923c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85141) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 10:10:54 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-423d5091-25e9-4945-86b6-f74cc45c840e tempest-TestVolumeSwap-1428287604 tempest-TestVolumeSwap-1428287604-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json" returned: 0 in 0.982s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:10:54 user nova-compute[85141]: DEBUG nova.virt.disk.api [None req-423d5091-25e9-4945-86b6-f74cc45c840e tempest-TestVolumeSwap-1428287604 tempest-TestVolumeSwap-1428287604-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ad1ace46-2e8e-42e1-a0f5-2384078fcf09/disk. size=1073741824 {{(pid=85141) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 10:10:54 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-423d5091-25e9-4945-86b6-f74cc45c840e tempest-TestVolumeSwap-1428287604 tempest-TestVolumeSwap-1428287604-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad1ace46-2e8e-42e1-a0f5-2384078fcf09/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:10:54 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-d75ac365-ae12-46bf-bb9b-1ef1096b5aae tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:10:54 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbcf7f0-a47f-465d-b445-cd3b21c9cf8e tempest-AttachSCSIVolumeTestJSON-1774410022 tempest-AttachSCSIVolumeTestJSON-1774410022-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/55d6d40b0102aca79b96233adbd68dbdebe68921.part --force-share --output=json" returned: 0 in 0.288s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:10:54 user nova-compute[85141]: DEBUG nova.virt.images [None req-5fbcf7f0-a47f-465d-b445-cd3b21c9cf8e tempest-AttachSCSIVolumeTestJSON-1774410022 tempest-AttachSCSIVolumeTestJSON-1774410022-project-member] 164bf389-5fc3-484a-8449-60bd5a23b06e was qcow2, converting to raw {{(pid=85141) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 16 10:10:54 user nova-compute[85141]: DEBUG nova.privsep.utils [None req-5fbcf7f0-a47f-465d-b445-cd3b21c9cf8e tempest-AttachSCSIVolumeTestJSON-1774410022 tempest-AttachSCSIVolumeTestJSON-1774410022-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=85141) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 16 10:10:54 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbcf7f0-a47f-465d-b445-cd3b21c9cf8e tempest-AttachSCSIVolumeTestJSON-1774410022 tempest-AttachSCSIVolumeTestJSON-1774410022-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/55d6d40b0102aca79b96233adbd68dbdebe68921.part /opt/stack/data/nova/instances/_base/55d6d40b0102aca79b96233adbd68dbdebe68921.converted {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:10:54 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-423d5091-25e9-4945-86b6-f74cc45c840e tempest-TestVolumeSwap-1428287604 tempest-TestVolumeSwap-1428287604-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad1ace46-2e8e-42e1-a0f5-2384078fcf09/disk --force-share --output=json" returned: 0 in 0.256s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:10:54 user nova-compute[85141]: DEBUG nova.virt.disk.api [None req-423d5091-25e9-4945-86b6-f74cc45c840e tempest-TestVolumeSwap-1428287604 tempest-TestVolumeSwap-1428287604-project-member] Cannot resize image /opt/stack/data/nova/instances/ad1ace46-2e8e-42e1-a0f5-2384078fcf09/disk to a smaller size. {{(pid=85141) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 10:10:54 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-423d5091-25e9-4945-86b6-f74cc45c840e tempest-TestVolumeSwap-1428287604 tempest-TestVolumeSwap-1428287604-project-member] [instance: ad1ace46-2e8e-42e1-a0f5-2384078fcf09] Created local disks {{(pid=85141) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 10:10:54 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-423d5091-25e9-4945-86b6-f74cc45c840e tempest-TestVolumeSwap-1428287604 tempest-TestVolumeSwap-1428287604-project-member] [instance: ad1ace46-2e8e-42e1-a0f5-2384078fcf09] Ensure instance console log exists: /opt/stack/data/nova/instances/ad1ace46-2e8e-42e1-a0f5-2384078fcf09/console.log {{(pid=85141) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 10:10:54 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-423d5091-25e9-4945-86b6-f74cc45c840e tempest-TestVolumeSwap-1428287604 tempest-TestVolumeSwap-1428287604-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:10:54 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-423d5091-25e9-4945-86b6-f74cc45c840e tempest-TestVolumeSwap-1428287604 tempest-TestVolumeSwap-1428287604-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:10:54 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-423d5091-25e9-4945-86b6-f74cc45c840e tempest-TestVolumeSwap-1428287604 tempest-TestVolumeSwap-1428287604-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:10:55 user nova-compute[85141]: DEBUG nova.compute.provider_tree [None req-77454959-aa5e-4ea4-a4b2-40594749ed82 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] Inventory has not changed in ProviderTree for provider: bf8e0fa1-16b6-408f-9203-c4cd63916272 {{(pid=85141) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 10:10:55 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbcf7f0-a47f-465d-b445-cd3b21c9cf8e tempest-AttachSCSIVolumeTestJSON-1774410022 tempest-AttachSCSIVolumeTestJSON-1774410022-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/55d6d40b0102aca79b96233adbd68dbdebe68921.part /opt/stack/data/nova/instances/_base/55d6d40b0102aca79b96233adbd68dbdebe68921.converted" returned: 0 in 0.241s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:10:55 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbcf7f0-a47f-465d-b445-cd3b21c9cf8e tempest-AttachSCSIVolumeTestJSON-1774410022 tempest-AttachSCSIVolumeTestJSON-1774410022-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/55d6d40b0102aca79b96233adbd68dbdebe68921.converted --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:10:55 user nova-compute[85141]: DEBUG nova.network.neutron [None req-423d5091-25e9-4945-86b6-f74cc45c840e tempest-TestVolumeSwap-1428287604 tempest-TestVolumeSwap-1428287604-project-member] [instance: ad1ace46-2e8e-42e1-a0f5-2384078fcf09] Successfully updated port: 2a895913-f200-44a4-b3bc-4a1c876e2714 {{(pid=85141) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 10:10:55 user nova-compute[85141]: DEBUG nova.scheduler.client.report [None req-77454959-aa5e-4ea4-a4b2-40594749ed82 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] Inventory has not changed for provider bf8e0fa1-16b6-408f-9203-c4cd63916272 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=85141) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 10:10:55 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-423d5091-25e9-4945-86b6-f74cc45c840e tempest-TestVolumeSwap-1428287604 tempest-TestVolumeSwap-1428287604-project-member] Acquiring lock "refresh_cache-ad1ace46-2e8e-42e1-a0f5-2384078fcf09" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:10:55 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-423d5091-25e9-4945-86b6-f74cc45c840e tempest-TestVolumeSwap-1428287604 tempest-TestVolumeSwap-1428287604-project-member] Acquired lock "refresh_cache-ad1ace46-2e8e-42e1-a0f5-2384078fcf09" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:10:55 user nova-compute[85141]: DEBUG nova.network.neutron [None req-423d5091-25e9-4945-86b6-f74cc45c840e tempest-TestVolumeSwap-1428287604 tempest-TestVolumeSwap-1428287604-project-member] [instance: ad1ace46-2e8e-42e1-a0f5-2384078fcf09] Building network info cache for instance {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 10:10:55 user nova-compute[85141]: DEBUG nova.compute.manager [req-28515807-18d2-4cc1-bf9f-2bf4a2e070bc req-398861e1-9dcc-48db-ad76-de4d1d041adc service nova] [instance: ad1ace46-2e8e-42e1-a0f5-2384078fcf09] Received event network-changed-2a895913-f200-44a4-b3bc-4a1c876e2714 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:10:55 user nova-compute[85141]: DEBUG nova.compute.manager [req-28515807-18d2-4cc1-bf9f-2bf4a2e070bc req-398861e1-9dcc-48db-ad76-de4d1d041adc service nova] [instance: ad1ace46-2e8e-42e1-a0f5-2384078fcf09] Refreshing instance network info cache due to event network-changed-2a895913-f200-44a4-b3bc-4a1c876e2714. {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 10:10:55 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-28515807-18d2-4cc1-bf9f-2bf4a2e070bc req-398861e1-9dcc-48db-ad76-de4d1d041adc service nova] Acquiring lock "refresh_cache-ad1ace46-2e8e-42e1-a0f5-2384078fcf09" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:10:55 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-77454959-aa5e-4ea4-a4b2-40594749ed82 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.855s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:10:55 user nova-compute[85141]: DEBUG nova.compute.manager [None req-77454959-aa5e-4ea4-a4b2-40594749ed82 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] [instance: 0ca61bd2-268e-4c49-ba04-a5cb39143a9b] Start building networks asynchronously for instance. {{(pid=85141) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 10:10:55 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-d75ac365-ae12-46bf-bb9b-1ef1096b5aae tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.450s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:10:55 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-d75ac365-ae12-46bf-bb9b-1ef1096b5aae tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=85141) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 10:10:55 user nova-compute[85141]: INFO nova.compute.claims [None req-d75ac365-ae12-46bf-bb9b-1ef1096b5aae tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] [instance: 6caf3667-5613-4ef4-a597-1820e6c1c0ac] Claim successful on node user
Nov 16 10:10:55 user nova-compute[85141]: DEBUG nova.network.neutron [None req-423d5091-25e9-4945-86b6-f74cc45c840e tempest-TestVolumeSwap-1428287604 tempest-TestVolumeSwap-1428287604-project-member] [instance: ad1ace46-2e8e-42e1-a0f5-2384078fcf09] Instance cache missing network info. {{(pid=85141) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 10:10:55 user nova-compute[85141]: DEBUG nova.compute.manager [None req-77454959-aa5e-4ea4-a4b2-40594749ed82 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] [instance: 0ca61bd2-268e-4c49-ba04-a5cb39143a9b] Allocating IP information in the background. {{(pid=85141) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 10:10:55 user nova-compute[85141]: DEBUG nova.network.neutron [None req-77454959-aa5e-4ea4-a4b2-40594749ed82 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] [instance: 0ca61bd2-268e-4c49-ba04-a5cb39143a9b] allocate_for_instance() {{(pid=85141) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 10:10:55 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbcf7f0-a47f-465d-b445-cd3b21c9cf8e tempest-AttachSCSIVolumeTestJSON-1774410022 tempest-AttachSCSIVolumeTestJSON-1774410022-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/55d6d40b0102aca79b96233adbd68dbdebe68921.converted --force-share --output=json" returned: 0 in 0.255s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:10:55 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbcf7f0-a47f-465d-b445-cd3b21c9cf8e tempest-AttachSCSIVolumeTestJSON-1774410022 tempest-AttachSCSIVolumeTestJSON-1774410022-project-member] Lock "55d6d40b0102aca79b96233adbd68dbdebe68921" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.579s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:10:55 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbcf7f0-a47f-465d-b445-cd3b21c9cf8e tempest-AttachSCSIVolumeTestJSON-1774410022 tempest-AttachSCSIVolumeTestJSON-1774410022-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/55d6d40b0102aca79b96233adbd68dbdebe68921 --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:10:55 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-77454959-aa5e-4ea4-a4b2-40594749ed82 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] [instance: 0ca61bd2-268e-4c49-ba04-a5cb39143a9b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 10:10:55 user nova-compute[85141]: DEBUG nova.compute.manager [None req-77454959-aa5e-4ea4-a4b2-40594749ed82 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] [instance: 0ca61bd2-268e-4c49-ba04-a5cb39143a9b] Start building block device mappings for instance. {{(pid=85141) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 10:10:55 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbcf7f0-a47f-465d-b445-cd3b21c9cf8e tempest-AttachSCSIVolumeTestJSON-1774410022 tempest-AttachSCSIVolumeTestJSON-1774410022-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/55d6d40b0102aca79b96233adbd68dbdebe68921 --force-share --output=json" returned: 0 in 0.264s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:10:55 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbcf7f0-a47f-465d-b445-cd3b21c9cf8e tempest-AttachSCSIVolumeTestJSON-1774410022 tempest-AttachSCSIVolumeTestJSON-1774410022-project-member] Acquiring lock "55d6d40b0102aca79b96233adbd68dbdebe68921" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:10:55 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbcf7f0-a47f-465d-b445-cd3b21c9cf8e tempest-AttachSCSIVolumeTestJSON-1774410022 tempest-AttachSCSIVolumeTestJSON-1774410022-project-member] Lock "55d6d40b0102aca79b96233adbd68dbdebe68921" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:10:55 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbcf7f0-a47f-465d-b445-cd3b21c9cf8e tempest-AttachSCSIVolumeTestJSON-1774410022 tempest-AttachSCSIVolumeTestJSON-1774410022-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/55d6d40b0102aca79b96233adbd68dbdebe68921 --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:10:55 user nova-compute[85141]: DEBUG nova.compute.manager [None req-77454959-aa5e-4ea4-a4b2-40594749ed82 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] [instance: 0ca61bd2-268e-4c49-ba04-a5cb39143a9b] Start spawning the instance on the hypervisor. {{(pid=85141) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 10:10:55 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-77454959-aa5e-4ea4-a4b2-40594749ed82 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] [instance: 0ca61bd2-268e-4c49-ba04-a5cb39143a9b] Creating instance directory {{(pid=85141) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 10:10:55 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-77454959-aa5e-4ea4-a4b2-40594749ed82 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] [instance: 0ca61bd2-268e-4c49-ba04-a5cb39143a9b] Creating image(s)
Nov 16 10:10:55 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-77454959-aa5e-4ea4-a4b2-40594749ed82 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] Acquiring lock "/opt/stack/data/nova/instances/0ca61bd2-268e-4c49-ba04-a5cb39143a9b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:10:55 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-77454959-aa5e-4ea4-a4b2-40594749ed82 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] Lock "/opt/stack/data/nova/instances/0ca61bd2-268e-4c49-ba04-a5cb39143a9b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:10:55 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-77454959-aa5e-4ea4-a4b2-40594749ed82 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] Lock "/opt/stack/data/nova/instances/0ca61bd2-268e-4c49-ba04-a5cb39143a9b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:10:55 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-77454959-aa5e-4ea4-a4b2-40594749ed82 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:10:55 user nova-compute[85141]: DEBUG nova.network.neutron [None req-423d5091-25e9-4945-86b6-f74cc45c840e tempest-TestVolumeSwap-1428287604 tempest-TestVolumeSwap-1428287604-project-member] [instance: ad1ace46-2e8e-42e1-a0f5-2384078fcf09] Updating instance_info_cache with network_info: [{"id": "2a895913-f200-44a4-b3bc-4a1c876e2714", "address": "fa:16:3e:dc:86:3e", "network": {"id": "cf5d3eb6-a02c-4169-8137-4f7b19a49a84", "bridge": "br-int", "label": "tempest-TestVolumeSwap-36902130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "466fcdf8030148ca8afbd0e8ffd24a11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a895913-f2", "ovs_interfaceid": "2a895913-f200-44a4-b3bc-4a1c876e2714", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:10:55 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-423d5091-25e9-4945-86b6-f74cc45c840e tempest-TestVolumeSwap-1428287604 tempest-TestVolumeSwap-1428287604-project-member] Releasing lock "refresh_cache-ad1ace46-2e8e-42e1-a0f5-2384078fcf09" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:10:55 user nova-compute[85141]: DEBUG nova.compute.manager [None req-423d5091-25e9-4945-86b6-f74cc45c840e tempest-TestVolumeSwap-1428287604 tempest-TestVolumeSwap-1428287604-project-member] [instance: ad1ace46-2e8e-42e1-a0f5-2384078fcf09] Instance network_info: |[{"id": "2a895913-f200-44a4-b3bc-4a1c876e2714", "address": "fa:16:3e:dc:86:3e", "network": {"id": "cf5d3eb6-a02c-4169-8137-4f7b19a49a84", "bridge": "br-int", "label": "tempest-TestVolumeSwap-36902130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "466fcdf8030148ca8afbd0e8ffd24a11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a895913-f2", "ovs_interfaceid": "2a895913-f200-44a4-b3bc-4a1c876e2714", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=85141) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 10:10:55 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-28515807-18d2-4cc1-bf9f-2bf4a2e070bc req-398861e1-9dcc-48db-ad76-de4d1d041adc service nova] Acquired lock "refresh_cache-ad1ace46-2e8e-42e1-a0f5-2384078fcf09" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:10:55 user nova-compute[85141]: DEBUG nova.network.neutron [req-28515807-18d2-4cc1-bf9f-2bf4a2e070bc req-398861e1-9dcc-48db-ad76-de4d1d041adc service nova] [instance: ad1ace46-2e8e-42e1-a0f5-2384078fcf09] Refreshing network info cache for port 2a895913-f200-44a4-b3bc-4a1c876e2714 {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 10:10:55 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-423d5091-25e9-4945-86b6-f74cc45c840e tempest-TestVolumeSwap-1428287604 tempest-TestVolumeSwap-1428287604-project-member] [instance: ad1ace46-2e8e-42e1-a0f5-2384078fcf09] Start _get_guest_xml network_info=[{"id": "2a895913-f200-44a4-b3bc-4a1c876e2714", "address": "fa:16:3e:dc:86:3e", "network": {"id": "cf5d3eb6-a02c-4169-8137-4f7b19a49a84", "bridge": "br-int", "label": "tempest-TestVolumeSwap-36902130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "466fcdf8030148ca8afbd0e8ffd24a11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a895913-f2", "ovs_interfaceid": "2a895913-f200-44a4-b3bc-4a1c876e2714", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T10:06:42Z,direct_url=<?>,disk_format='qcow2',id=bc4ca70f-a459-4d5c-a9e6-80f1948eb48b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1044631a5fe84ce8904864a7024049fa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T10:06:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_options': None, 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'image_id': 'bc4ca70f-a459-4d5c-a9e6-80f1948eb48b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=85141) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 10:10:55 user nova-compute[85141]: DEBUG nova.policy [None req-77454959-aa5e-4ea4-a4b2-40594749ed82 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8734a61ff9fb4e14b1b542b8ecdfdeec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9317f5645af406c899fcc5df61362bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85141) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 10:10:55 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-423d5091-25e9-4945-86b6-f74cc45c840e tempest-TestVolumeSwap-1428287604 tempest-TestVolumeSwap-1428287604-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:10:55 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-423d5091-25e9-4945-86b6-f74cc45c840e tempest-TestVolumeSwap-1428287604 tempest-TestVolumeSwap-1428287604-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:10:55 user nova-compute[85141]: DEBUG nova.compute.provider_tree [None req-d75ac365-ae12-46bf-bb9b-1ef1096b5aae tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] Inventory has not changed in ProviderTree for provider: bf8e0fa1-16b6-408f-9203-c4cd63916272 {{(pid=85141) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 10:10:55 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-423d5091-25e9-4945-86b6-f74cc45c840e tempest-TestVolumeSwap-1428287604 tempest-TestVolumeSwap-1428287604-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=85141) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 10:10:55 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-423d5091-25e9-4945-86b6-f74cc45c840e tempest-TestVolumeSwap-1428287604 tempest-TestVolumeSwap-1428287604-project-member] CPU controller missing on host. {{(pid=85141) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 10:10:55 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-423d5091-25e9-4945-86b6-f74cc45c840e tempest-TestVolumeSwap-1428287604 tempest-TestVolumeSwap-1428287604-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=85141) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 10:10:55 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-423d5091-25e9-4945-86b6-f74cc45c840e tempest-TestVolumeSwap-1428287604 tempest-TestVolumeSwap-1428287604-project-member] CPU controller found on host. {{(pid=85141) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 10:10:55 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-423d5091-25e9-4945-86b6-f74cc45c840e tempest-TestVolumeSwap-1428287604 tempest-TestVolumeSwap-1428287604-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=85141) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 10:10:55 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-423d5091-25e9-4945-86b6-f74cc45c840e tempest-TestVolumeSwap-1428287604 tempest-TestVolumeSwap-1428287604-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T10:06:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T10:06:42Z,direct_url=<?>,disk_format='qcow2',id=bc4ca70f-a459-4d5c-a9e6-80f1948eb48b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1044631a5fe84ce8904864a7024049fa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T10:06:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 10:10:55 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-423d5091-25e9-4945-86b6-f74cc45c840e tempest-TestVolumeSwap-1428287604 tempest-TestVolumeSwap-1428287604-project-member] Flavor limits 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 10:10:55 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-423d5091-25e9-4945-86b6-f74cc45c840e tempest-TestVolumeSwap-1428287604 tempest-TestVolumeSwap-1428287604-project-member] Image limits 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 10:10:55 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-423d5091-25e9-4945-86b6-f74cc45c840e tempest-TestVolumeSwap-1428287604 tempest-TestVolumeSwap-1428287604-project-member] Flavor pref 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 10:10:55 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-423d5091-25e9-4945-86b6-f74cc45c840e tempest-TestVolumeSwap-1428287604 tempest-TestVolumeSwap-1428287604-project-member] Image pref 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 10:10:55 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-423d5091-25e9-4945-86b6-f74cc45c840e tempest-TestVolumeSwap-1428287604 tempest-TestVolumeSwap-1428287604-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 10:10:55 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-423d5091-25e9-4945-86b6-f74cc45c840e tempest-TestVolumeSwap-1428287604 tempest-TestVolumeSwap-1428287604-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 10:10:55 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-423d5091-25e9-4945-86b6-f74cc45c840e tempest-TestVolumeSwap-1428287604 tempest-TestVolumeSwap-1428287604-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=85141) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 10:10:55 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-423d5091-25e9-4945-86b6-f74cc45c840e tempest-TestVolumeSwap-1428287604 tempest-TestVolumeSwap-1428287604-project-member] Got 1 possible topologies {{(pid=85141) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 10:10:55 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-423d5091-25e9-4945-86b6-f74cc45c840e tempest-TestVolumeSwap-1428287604 tempest-TestVolumeSwap-1428287604-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 10:10:55 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-423d5091-25e9-4945-86b6-f74cc45c840e tempest-TestVolumeSwap-1428287604 tempest-TestVolumeSwap-1428287604-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 10:10:55 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-423d5091-25e9-4945-86b6-f74cc45c840e tempest-TestVolumeSwap-1428287604 tempest-TestVolumeSwap-1428287604-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T10:10:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-917042974',display_name='tempest-TestVolumeSwap-server-917042974',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-917042974',id=6,image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCbOTuC8R0ay+56a2DZm6xoVifPSDvvnorlKE2TFT9WRtvik/dA/250cWRRzfN61nj1XMvFQ7VUGZ19CUPf5U5OqtC5l1xl0Gh43Tp9/rsw67JjTw7gwhRZXQvoVLRgvnw==',key_name='tempest-keypair-1476686046',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='466fcdf8030148ca8afbd0e8ffd24a11',ramdisk_id='',reservation_id='r-tpr6b5tw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1428287604',owner_user_name='tempest-TestVolumeSwap-1428287604-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T10:10:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3b5ceb88a01f470ab7bd5c8bc6ac6c8b',uuid=ad1ace46-2e8e-42e1-a0f5-2384078fcf09,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2a895913-f200-44a4-b3bc-4a1c876e2714", "address": "fa:16:3e:dc:86:3e", "network": {"id": "cf5d3eb6-a02c-4169-8137-4f7b19a49a84", "bridge": "br-int", "label": "tempest-TestVolumeSwap-36902130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "466fcdf8030148ca8afbd0e8ffd24a11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a895913-f2", "ovs_interfaceid": "2a895913-f200-44a4-b3bc-4a1c876e2714", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=85141) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 10:10:55 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-423d5091-25e9-4945-86b6-f74cc45c840e tempest-TestVolumeSwap-1428287604 tempest-TestVolumeSwap-1428287604-project-member] Converting VIF {"id": "2a895913-f200-44a4-b3bc-4a1c876e2714", "address": "fa:16:3e:dc:86:3e", "network": {"id": "cf5d3eb6-a02c-4169-8137-4f7b19a49a84", "bridge": "br-int", "label": "tempest-TestVolumeSwap-36902130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "466fcdf8030148ca8afbd0e8ffd24a11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a895913-f2", "ovs_interfaceid": "2a895913-f200-44a4-b3bc-4a1c876e2714", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:10:55 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-423d5091-25e9-4945-86b6-f74cc45c840e tempest-TestVolumeSwap-1428287604 tempest-TestVolumeSwap-1428287604-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dc:86:3e,bridge_name='br-int',has_traffic_filtering=True,id=2a895913-f200-44a4-b3bc-4a1c876e2714,network=Network(cf5d3eb6-a02c-4169-8137-4f7b19a49a84),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a895913-f2') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:10:55 user nova-compute[85141]: DEBUG nova.objects.instance [None req-423d5091-25e9-4945-86b6-f74cc45c840e tempest-TestVolumeSwap-1428287604 tempest-TestVolumeSwap-1428287604-project-member] Lazy-loading 'pci_devices' on Instance uuid ad1ace46-2e8e-42e1-a0f5-2384078fcf09 {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:10:55 user nova-compute[85141]: DEBUG nova.scheduler.client.report [None req-d75ac365-ae12-46bf-bb9b-1ef1096b5aae tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] Inventory has not changed for provider bf8e0fa1-16b6-408f-9203-c4cd63916272 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=85141) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 10:10:55 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbcf7f0-a47f-465d-b445-cd3b21c9cf8e tempest-AttachSCSIVolumeTestJSON-1774410022 tempest-AttachSCSIVolumeTestJSON-1774410022-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/55d6d40b0102aca79b96233adbd68dbdebe68921 --force-share --output=json" returned: 0 in 0.322s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:10:55 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbcf7f0-a47f-465d-b445-cd3b21c9cf8e tempest-AttachSCSIVolumeTestJSON-1774410022 tempest-AttachSCSIVolumeTestJSON-1774410022-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/55d6d40b0102aca79b96233adbd68dbdebe68921,backing_fmt=raw /opt/stack/data/nova/instances/ff964caf-b473-47bc-89d2-f7189264721c/disk 1073741824 {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:10:56 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-423d5091-25e9-4945-86b6-f74cc45c840e tempest-TestVolumeSwap-1428287604 tempest-TestVolumeSwap-1428287604-project-member] [instance: ad1ace46-2e8e-42e1-a0f5-2384078fcf09] End _get_guest_xml xml=<domain type="kvm">
Nov 16 10:10:56 user nova-compute[85141]:   <uuid>ad1ace46-2e8e-42e1-a0f5-2384078fcf09</uuid>
Nov 16 10:10:56 user nova-compute[85141]:   <name>instance-00000006</name>
Nov 16 10:10:56 user nova-compute[85141]:   <memory>524288</memory>
Nov 16 10:10:56 user nova-compute[85141]:   <vcpu>1</vcpu>
Nov 16 10:10:56 user nova-compute[85141]:   <metadata>
Nov 16 10:10:56 user nova-compute[85141]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 10:10:56 user nova-compute[85141]:       <nova:package version="0.0.0"/>
Nov 16 10:10:56 user nova-compute[85141]:       <nova:name>tempest-TestVolumeSwap-server-917042974</nova:name>
Nov 16 10:10:56 user nova-compute[85141]:       <nova:creationTime>2023-11-16 10:10:55</nova:creationTime>
Nov 16 10:10:56 user nova-compute[85141]:       <nova:flavor name="m1.tiny">
Nov 16 10:10:56 user nova-compute[85141]:         <nova:memory>512</nova:memory>
Nov 16 10:10:56 user nova-compute[85141]:         <nova:disk>1</nova:disk>
Nov 16 10:10:56 user nova-compute[85141]:         <nova:swap>0</nova:swap>
Nov 16 10:10:56 user nova-compute[85141]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 10:10:56 user nova-compute[85141]:         <nova:vcpus>1</nova:vcpus>
Nov 16 10:10:56 user nova-compute[85141]:       </nova:flavor>
Nov 16 10:10:56 user nova-compute[85141]:       <nova:owner>
Nov 16 10:10:56 user nova-compute[85141]:         <nova:user uuid="3b5ceb88a01f470ab7bd5c8bc6ac6c8b">tempest-TestVolumeSwap-1428287604-project-member</nova:user>
Nov 16 10:10:56 user nova-compute[85141]:         <nova:project uuid="466fcdf8030148ca8afbd0e8ffd24a11">tempest-TestVolumeSwap-1428287604</nova:project>
Nov 16 10:10:56 user nova-compute[85141]:       </nova:owner>
Nov 16 10:10:56 user nova-compute[85141]:       <nova:root type="image" uuid="bc4ca70f-a459-4d5c-a9e6-80f1948eb48b"/>
Nov 16 10:10:56 user nova-compute[85141]:       <nova:ports>
Nov 16 10:10:56 user nova-compute[85141]:         <nova:port uuid="2a895913-f200-44a4-b3bc-4a1c876e2714">
Nov 16 10:10:56 user nova-compute[85141]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 16 10:10:56 user nova-compute[85141]:         </nova:port>
Nov 16 10:10:56 user nova-compute[85141]:       </nova:ports>
Nov 16 10:10:56 user nova-compute[85141]:     </nova:instance>
Nov 16 10:10:56 user nova-compute[85141]:   </metadata>
Nov 16 10:10:56 user nova-compute[85141]:   <sysinfo type="smbios">
Nov 16 10:10:56 user nova-compute[85141]:     <system>
Nov 16 10:10:56 user nova-compute[85141]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 10:10:56 user nova-compute[85141]:       <entry name="product">OpenStack Nova</entry>
Nov 16 10:10:56 user nova-compute[85141]:       <entry name="version">0.0.0</entry>
Nov 16 10:10:56 user nova-compute[85141]:       <entry name="serial">ad1ace46-2e8e-42e1-a0f5-2384078fcf09</entry>
Nov 16 10:10:56 user nova-compute[85141]:       <entry name="uuid">ad1ace46-2e8e-42e1-a0f5-2384078fcf09</entry>
Nov 16 10:10:56 user nova-compute[85141]:       <entry name="family">Virtual Machine</entry>
Nov 16 10:10:56 user nova-compute[85141]:     </system>
Nov 16 10:10:56 user nova-compute[85141]:   </sysinfo>
Nov 16 10:10:56 user nova-compute[85141]:   <os>
Nov 16 10:10:56 user nova-compute[85141]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 10:10:56 user nova-compute[85141]:     <boot dev="hd"/>
Nov 16 10:10:56 user nova-compute[85141]:     <smbios mode="sysinfo"/>
Nov 16 10:10:56 user nova-compute[85141]:   </os>
Nov 16 10:10:56 user nova-compute[85141]:   <features>
Nov 16 10:10:56 user nova-compute[85141]:     <acpi/>
Nov 16 10:10:56 user nova-compute[85141]:     <apic/>
Nov 16 10:10:56 user nova-compute[85141]:     <vmcoreinfo/>
Nov 16 10:10:56 user nova-compute[85141]:   </features>
Nov 16 10:10:56 user nova-compute[85141]:   <clock offset="utc">
Nov 16 10:10:56 user nova-compute[85141]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 10:10:56 user nova-compute[85141]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 10:10:56 user nova-compute[85141]:     <timer name="hpet" present="no"/>
Nov 16 10:10:56 user nova-compute[85141]:   </clock>
Nov 16 10:10:56 user nova-compute[85141]:   <cpu mode="custom" match="exact">
Nov 16 10:10:56 user nova-compute[85141]:     <model>Nehalem</model>
Nov 16 10:10:56 user nova-compute[85141]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 10:10:56 user nova-compute[85141]:   </cpu>
Nov 16 10:10:56 user nova-compute[85141]:   <devices>
Nov 16 10:10:56 user nova-compute[85141]:     <disk type="file" device="disk">
Nov 16 10:10:56 user nova-compute[85141]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 10:10:56 user nova-compute[85141]:       <source file="/opt/stack/data/nova/instances/ad1ace46-2e8e-42e1-a0f5-2384078fcf09/disk"/>
Nov 16 10:10:56 user nova-compute[85141]:       <target dev="vda" bus="virtio"/>
Nov 16 10:10:56 user nova-compute[85141]:     </disk>
Nov 16 10:10:56 user nova-compute[85141]:     <interface type="ethernet">
Nov 16 10:10:56 user nova-compute[85141]:       <mac address="fa:16:3e:dc:86:3e"/>
Nov 16 10:10:56 user nova-compute[85141]:       <model type="virtio"/>
Nov 16 10:10:56 user nova-compute[85141]:       <mtu size="1442"/>
Nov 16 10:10:56 user nova-compute[85141]:       <target dev="tap2a895913-f2"/>
Nov 16 10:10:56 user nova-compute[85141]:     </interface>
Nov 16 10:10:56 user nova-compute[85141]:     <serial type="pty">
Nov 16 10:10:56 user nova-compute[85141]:       <log file="/opt/stack/data/nova/instances/ad1ace46-2e8e-42e1-a0f5-2384078fcf09/console.log" append="off"/>
Nov 16 10:10:56 user nova-compute[85141]:     </serial>
Nov 16 10:10:56 user nova-compute[85141]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 10:10:56 user nova-compute[85141]:     <video>
Nov 16 10:10:56 user nova-compute[85141]:       <model type="virtio"/>
Nov 16 10:10:56 user nova-compute[85141]:     </video>
Nov 16 10:10:56 user nova-compute[85141]:     <rng model="virtio">
Nov 16 10:10:56 user nova-compute[85141]:       <backend model="random">/dev/urandom</backend>
Nov 16 10:10:56 user nova-compute[85141]:     </rng>
Nov 16 10:10:56 user nova-compute[85141]:     <controller type="usb" index="0" model="none"/>
Nov 16 10:10:56 user nova-compute[85141]:     <memballoon model="virtio">
Nov 16 10:10:56 user nova-compute[85141]:       <stats period="10"/>
Nov 16 10:10:56 user nova-compute[85141]:     </memballoon>
Nov 16 10:10:56 user nova-compute[85141]:   </devices>
Nov 16 10:10:56 user nova-compute[85141]: </domain>
Nov 16 10:10:56 user nova-compute[85141]:  {{(pid=85141) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 10:10:56 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-423d5091-25e9-4945-86b6-f74cc45c840e tempest-TestVolumeSwap-1428287604 tempest-TestVolumeSwap-1428287604-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T10:10:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-917042974',display_name='tempest-TestVolumeSwap-server-917042974',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-917042974',id=6,image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCbOTuC8R0ay+56a2DZm6xoVifPSDvvnorlKE2TFT9WRtvik/dA/250cWRRzfN61nj1XMvFQ7VUGZ19CUPf5U5OqtC5l1xl0Gh43Tp9/rsw67JjTw7gwhRZXQvoVLRgvnw==',key_name='tempest-keypair-1476686046',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='466fcdf8030148ca8afbd0e8ffd24a11',ramdisk_id='',reservation_id='r-tpr6b5tw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1428287604',owner_user_name='tempest-TestVolumeSwap-1428287604-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T10:10:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3b5ceb88a01f470ab7bd5c8bc6ac6c8b',uuid=ad1ace46-2e8e-42e1-a0f5-2384078fcf09,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2a895913-f200-44a4-b3bc-4a1c876e2714", "address": "fa:16:3e:dc:86:3e", "network": {"id": "cf5d3eb6-a02c-4169-8137-4f7b19a49a84", "bridge": "br-int", "label": "tempest-TestVolumeSwap-36902130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "466fcdf8030148ca8afbd0e8ffd24a11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a895913-f2", "ovs_interfaceid": "2a895913-f200-44a4-b3bc-4a1c876e2714", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 10:10:56 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-423d5091-25e9-4945-86b6-f74cc45c840e tempest-TestVolumeSwap-1428287604 tempest-TestVolumeSwap-1428287604-project-member] Converting VIF {"id": "2a895913-f200-44a4-b3bc-4a1c876e2714", "address": "fa:16:3e:dc:86:3e", "network": {"id": "cf5d3eb6-a02c-4169-8137-4f7b19a49a84", "bridge": "br-int", "label": "tempest-TestVolumeSwap-36902130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "466fcdf8030148ca8afbd0e8ffd24a11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a895913-f2", "ovs_interfaceid": "2a895913-f200-44a4-b3bc-4a1c876e2714", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:10:56 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-423d5091-25e9-4945-86b6-f74cc45c840e tempest-TestVolumeSwap-1428287604 tempest-TestVolumeSwap-1428287604-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dc:86:3e,bridge_name='br-int',has_traffic_filtering=True,id=2a895913-f200-44a4-b3bc-4a1c876e2714,network=Network(cf5d3eb6-a02c-4169-8137-4f7b19a49a84),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a895913-f2') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:10:56 user nova-compute[85141]: DEBUG os_vif [None req-423d5091-25e9-4945-86b6-f74cc45c840e tempest-TestVolumeSwap-1428287604 tempest-TestVolumeSwap-1428287604-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:86:3e,bridge_name='br-int',has_traffic_filtering=True,id=2a895913-f200-44a4-b3bc-4a1c876e2714,network=Network(cf5d3eb6-a02c-4169-8137-4f7b19a49a84),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a895913-f2') {{(pid=85141) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 10:10:56 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:10:56 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:10:56 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 10:10:56 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-d75ac365-ae12-46bf-bb9b-1ef1096b5aae tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.818s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:10:56 user nova-compute[85141]: DEBUG nova.compute.manager [None req-d75ac365-ae12-46bf-bb9b-1ef1096b5aae tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] [instance: 6caf3667-5613-4ef4-a597-1820e6c1c0ac] Start building networks asynchronously for instance. {{(pid=85141) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 10:10:56 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:10:56 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c4c8bd93-a938-5a2c-a04a-677dc8dc6a39', '_type': 'linux-noop'}}, row=False) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:10:56 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-77454959-aa5e-4ea4-a4b2-40594749ed82 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json" returned: 0 in 0.330s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:10:56 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-77454959-aa5e-4ea4-a4b2-40594749ed82 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] Acquiring lock "60a78556fb399ed4a41bc3ca4bccf77c96d8e811" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:10:56 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-77454959-aa5e-4ea4-a4b2-40594749ed82 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] Lock "60a78556fb399ed4a41bc3ca4bccf77c96d8e811" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:10:56 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-77454959-aa5e-4ea4-a4b2-40594749ed82 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:10:56 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbcf7f0-a47f-465d-b445-cd3b21c9cf8e tempest-AttachSCSIVolumeTestJSON-1774410022 tempest-AttachSCSIVolumeTestJSON-1774410022-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/55d6d40b0102aca79b96233adbd68dbdebe68921,backing_fmt=raw /opt/stack/data/nova/instances/ff964caf-b473-47bc-89d2-f7189264721c/disk 1073741824" returned: 0 in 0.143s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:10:56 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:10:56 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbcf7f0-a47f-465d-b445-cd3b21c9cf8e tempest-AttachSCSIVolumeTestJSON-1774410022 tempest-AttachSCSIVolumeTestJSON-1774410022-project-member] Lock "55d6d40b0102aca79b96233adbd68dbdebe68921" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.477s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:10:56 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbcf7f0-a47f-465d-b445-cd3b21c9cf8e tempest-AttachSCSIVolumeTestJSON-1774410022 tempest-AttachSCSIVolumeTestJSON-1774410022-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/55d6d40b0102aca79b96233adbd68dbdebe68921 --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:10:56 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:10:56 user nova-compute[85141]: DEBUG nova.compute.manager [None req-d75ac365-ae12-46bf-bb9b-1ef1096b5aae tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] [instance: 6caf3667-5613-4ef4-a597-1820e6c1c0ac] Allocating IP information in the background. {{(pid=85141) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 10:10:56 user nova-compute[85141]: DEBUG nova.network.neutron [None req-d75ac365-ae12-46bf-bb9b-1ef1096b5aae tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] [instance: 6caf3667-5613-4ef4-a597-1820e6c1c0ac] allocate_for_instance() {{(pid=85141) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 10:10:56 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-d75ac365-ae12-46bf-bb9b-1ef1096b5aae tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] [instance: 6caf3667-5613-4ef4-a597-1820e6c1c0ac] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 10:10:56 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:10:56 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2a895913-f2, may_exist=True, interface_attrs={}) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:10:56 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2a895913-f2, col_values=(('qos', UUID('0cacfe1f-0fe2-49f4-94be-e397aa2008d2')),), if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:10:56 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2a895913-f2, col_values=(('external_ids', {'iface-id': '2a895913-f200-44a4-b3bc-4a1c876e2714', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:dc:86:3e', 'vm-uuid': 'ad1ace46-2e8e-42e1-a0f5-2384078fcf09'}),), if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:10:56 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:10:56 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:10:56 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:10:56 user nova-compute[85141]: INFO os_vif [None req-423d5091-25e9-4945-86b6-f74cc45c840e tempest-TestVolumeSwap-1428287604 tempest-TestVolumeSwap-1428287604-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:86:3e,bridge_name='br-int',has_traffic_filtering=True,id=2a895913-f200-44a4-b3bc-4a1c876e2714,network=Network(cf5d3eb6-a02c-4169-8137-4f7b19a49a84),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a895913-f2')
Nov 16 10:10:56 user nova-compute[85141]: DEBUG nova.compute.manager [None req-d75ac365-ae12-46bf-bb9b-1ef1096b5aae tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] [instance: 6caf3667-5613-4ef4-a597-1820e6c1c0ac] Start building block device mappings for instance. {{(pid=85141) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 10:10:56 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-77454959-aa5e-4ea4-a4b2-40594749ed82 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json" returned: 0 in 0.213s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:10:56 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-77454959-aa5e-4ea4-a4b2-40594749ed82 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811,backing_fmt=raw /opt/stack/data/nova/instances/0ca61bd2-268e-4c49-ba04-a5cb39143a9b/disk 1073741824 {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:10:56 user nova-compute[85141]: DEBUG nova.policy [None req-d75ac365-ae12-46bf-bb9b-1ef1096b5aae tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ae4bf3b050ed4cd7901541e9ce1c838f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e017c305665f4a98a75d1d77701b6527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85141) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 10:10:56 user nova-compute[85141]: INFO nova.virt.block_device [None req-d75ac365-ae12-46bf-bb9b-1ef1096b5aae tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] [instance: 6caf3667-5613-4ef4-a597-1820e6c1c0ac] Booting with volume 42c041ec-fa39-4035-b82b-867caf3565df at /dev/vda
Nov 16 10:10:56 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbcf7f0-a47f-465d-b445-cd3b21c9cf8e tempest-AttachSCSIVolumeTestJSON-1774410022 tempest-AttachSCSIVolumeTestJSON-1774410022-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/55d6d40b0102aca79b96233adbd68dbdebe68921 --force-share --output=json" returned: 0 in 0.302s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:10:56 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-77454959-aa5e-4ea4-a4b2-40594749ed82 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811,backing_fmt=raw /opt/stack/data/nova/instances/0ca61bd2-268e-4c49-ba04-a5cb39143a9b/disk 1073741824" returned: 0 in 0.148s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:10:56 user nova-compute[85141]: DEBUG nova.virt.disk.api [None req-5fbcf7f0-a47f-465d-b445-cd3b21c9cf8e tempest-AttachSCSIVolumeTestJSON-1774410022 tempest-AttachSCSIVolumeTestJSON-1774410022-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ff964caf-b473-47bc-89d2-f7189264721c/disk. size=1073741824 {{(pid=85141) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 10:10:56 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbcf7f0-a47f-465d-b445-cd3b21c9cf8e tempest-AttachSCSIVolumeTestJSON-1774410022 tempest-AttachSCSIVolumeTestJSON-1774410022-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff964caf-b473-47bc-89d2-f7189264721c/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:10:56 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-77454959-aa5e-4ea4-a4b2-40594749ed82 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] Lock "60a78556fb399ed4a41bc3ca4bccf77c96d8e811" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.416s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:10:56 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-77454959-aa5e-4ea4-a4b2-40594749ed82 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:10:56 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:10:56 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-423d5091-25e9-4945-86b6-f74cc45c840e tempest-TestVolumeSwap-1428287604 tempest-TestVolumeSwap-1428287604-project-member] No BDM found with device name vda, not building metadata. {{(pid=85141) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 10:10:56 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-423d5091-25e9-4945-86b6-f74cc45c840e tempest-TestVolumeSwap-1428287604 tempest-TestVolumeSwap-1428287604-project-member] No VIF found with MAC fa:16:3e:dc:86:3e, not building metadata {{(pid=85141) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 10:10:56 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbcf7f0-a47f-465d-b445-cd3b21c9cf8e tempest-AttachSCSIVolumeTestJSON-1774410022 tempest-AttachSCSIVolumeTestJSON-1774410022-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff964caf-b473-47bc-89d2-f7189264721c/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:10:56 user nova-compute[85141]: DEBUG nova.virt.disk.api [None req-5fbcf7f0-a47f-465d-b445-cd3b21c9cf8e tempest-AttachSCSIVolumeTestJSON-1774410022 tempest-AttachSCSIVolumeTestJSON-1774410022-project-member] Cannot resize image /opt/stack/data/nova/instances/ff964caf-b473-47bc-89d2-f7189264721c/disk to a smaller size. {{(pid=85141) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 10:10:56 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-5fbcf7f0-a47f-465d-b445-cd3b21c9cf8e tempest-AttachSCSIVolumeTestJSON-1774410022 tempest-AttachSCSIVolumeTestJSON-1774410022-project-member] [instance: ff964caf-b473-47bc-89d2-f7189264721c] Created local disks {{(pid=85141) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 10:10:56 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-5fbcf7f0-a47f-465d-b445-cd3b21c9cf8e tempest-AttachSCSIVolumeTestJSON-1774410022 tempest-AttachSCSIVolumeTestJSON-1774410022-project-member] [instance: ff964caf-b473-47bc-89d2-f7189264721c] Ensure instance console log exists: /opt/stack/data/nova/instances/ff964caf-b473-47bc-89d2-f7189264721c/console.log {{(pid=85141) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 10:10:56 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbcf7f0-a47f-465d-b445-cd3b21c9cf8e tempest-AttachSCSIVolumeTestJSON-1774410022 tempest-AttachSCSIVolumeTestJSON-1774410022-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:10:56 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbcf7f0-a47f-465d-b445-cd3b21c9cf8e tempest-AttachSCSIVolumeTestJSON-1774410022 tempest-AttachSCSIVolumeTestJSON-1774410022-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:10:56 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbcf7f0-a47f-465d-b445-cd3b21c9cf8e tempest-AttachSCSIVolumeTestJSON-1774410022 tempest-AttachSCSIVolumeTestJSON-1774410022-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.007s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:10:56 user nova-compute[85141]: DEBUG os_brick.utils [None req-d75ac365-ae12-46bf-bb9b-1ef1096b5aae tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 10:10:56 user nova-compute[85141]: INFO oslo.privsep.daemon [None req-d75ac365-ae12-46bf-bb9b-1ef1096b5aae tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmpepau6w94/privsep.sock']
Nov 16 10:10:56 user sudo[95272]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmpepau6w94/privsep.sock
Nov 16 10:10:56 user sudo[95272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 16 10:10:56 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-77454959-aa5e-4ea4-a4b2-40594749ed82 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json" returned: 0 in 0.300s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:10:56 user nova-compute[85141]: DEBUG nova.virt.disk.api [None req-77454959-aa5e-4ea4-a4b2-40594749ed82 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0ca61bd2-268e-4c49-ba04-a5cb39143a9b/disk. size=1073741824 {{(pid=85141) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 10:10:56 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-77454959-aa5e-4ea4-a4b2-40594749ed82 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ca61bd2-268e-4c49-ba04-a5cb39143a9b/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:10:56 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:10:57 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-77454959-aa5e-4ea4-a4b2-40594749ed82 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ca61bd2-268e-4c49-ba04-a5cb39143a9b/disk --force-share --output=json" returned: 0 in 0.394s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:10:57 user nova-compute[85141]: DEBUG nova.virt.disk.api [None req-77454959-aa5e-4ea4-a4b2-40594749ed82 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] Cannot resize image /opt/stack/data/nova/instances/0ca61bd2-268e-4c49-ba04-a5cb39143a9b/disk to a smaller size. {{(pid=85141) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 10:10:57 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-77454959-aa5e-4ea4-a4b2-40594749ed82 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] [instance: 0ca61bd2-268e-4c49-ba04-a5cb39143a9b] Created local disks {{(pid=85141) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 10:10:57 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-77454959-aa5e-4ea4-a4b2-40594749ed82 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] [instance: 0ca61bd2-268e-4c49-ba04-a5cb39143a9b] Ensure instance console log exists: /opt/stack/data/nova/instances/0ca61bd2-268e-4c49-ba04-a5cb39143a9b/console.log {{(pid=85141) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 10:10:57 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-77454959-aa5e-4ea4-a4b2-40594749ed82 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:10:57 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-77454959-aa5e-4ea4-a4b2-40594749ed82 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:10:57 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-77454959-aa5e-4ea4-a4b2-40594749ed82 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:10:57 user nova-compute[85141]: DEBUG nova.network.neutron [None req-5fbcf7f0-a47f-465d-b445-cd3b21c9cf8e tempest-AttachSCSIVolumeTestJSON-1774410022 tempest-AttachSCSIVolumeTestJSON-1774410022-project-member] [instance: ff964caf-b473-47bc-89d2-f7189264721c] Successfully created port: 75922f14-4d10-428a-baf5-bc27dfa373a6 {{(pid=85141) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 10:10:57 user nova-compute[85141]: DEBUG nova.network.neutron [req-28515807-18d2-4cc1-bf9f-2bf4a2e070bc req-398861e1-9dcc-48db-ad76-de4d1d041adc service nova] [instance: ad1ace46-2e8e-42e1-a0f5-2384078fcf09] Updated VIF entry in instance network info cache for port 2a895913-f200-44a4-b3bc-4a1c876e2714. {{(pid=85141) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 10:10:57 user nova-compute[85141]: DEBUG nova.network.neutron [req-28515807-18d2-4cc1-bf9f-2bf4a2e070bc req-398861e1-9dcc-48db-ad76-de4d1d041adc service nova] [instance: ad1ace46-2e8e-42e1-a0f5-2384078fcf09] Updating instance_info_cache with network_info: [{"id": "2a895913-f200-44a4-b3bc-4a1c876e2714", "address": "fa:16:3e:dc:86:3e", "network": {"id": "cf5d3eb6-a02c-4169-8137-4f7b19a49a84", "bridge": "br-int", "label": "tempest-TestVolumeSwap-36902130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "466fcdf8030148ca8afbd0e8ffd24a11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a895913-f2", "ovs_interfaceid": "2a895913-f200-44a4-b3bc-4a1c876e2714", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:10:57 user nova-compute[85141]: DEBUG nova.network.neutron [None req-d75ac365-ae12-46bf-bb9b-1ef1096b5aae tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] [instance: 6caf3667-5613-4ef4-a597-1820e6c1c0ac] Successfully created port: ad2b755f-6905-4256-be59-b64dae993293 {{(pid=85141) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 10:10:57 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-28515807-18d2-4cc1-bf9f-2bf4a2e070bc req-398861e1-9dcc-48db-ad76-de4d1d041adc service nova] Releasing lock "refresh_cache-ad1ace46-2e8e-42e1-a0f5-2384078fcf09" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:10:58 user nova-compute[85141]: DEBUG nova.network.neutron [None req-77454959-aa5e-4ea4-a4b2-40594749ed82 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] [instance: 0ca61bd2-268e-4c49-ba04-a5cb39143a9b] Successfully created port: 56375501-2a9c-4821-8446-31156fc0f231 {{(pid=85141) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 10:10:58 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:10:58 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:10:58 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:10:58 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:10:58 user nova-compute[85141]: DEBUG nova.network.neutron [None req-d75ac365-ae12-46bf-bb9b-1ef1096b5aae tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] [instance: 6caf3667-5613-4ef4-a597-1820e6c1c0ac] Successfully updated port: ad2b755f-6905-4256-be59-b64dae993293 {{(pid=85141) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 10:10:58 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-d75ac365-ae12-46bf-bb9b-1ef1096b5aae tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] Acquiring lock "refresh_cache-6caf3667-5613-4ef4-a597-1820e6c1c0ac" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:10:58 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-d75ac365-ae12-46bf-bb9b-1ef1096b5aae tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] Acquired lock "refresh_cache-6caf3667-5613-4ef4-a597-1820e6c1c0ac" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:10:58 user nova-compute[85141]: DEBUG nova.network.neutron [None req-d75ac365-ae12-46bf-bb9b-1ef1096b5aae tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] [instance: 6caf3667-5613-4ef4-a597-1820e6c1c0ac] Building network info cache for instance {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 10:10:58 user nova-compute[85141]: DEBUG nova.compute.manager [req-5f4f094d-4e7a-44fc-b5bd-f77a2fd367e1 req-7353ed3e-bcd2-4766-bfe8-e350676f6bc7 service nova] [instance: 6caf3667-5613-4ef4-a597-1820e6c1c0ac] Received event network-changed-ad2b755f-6905-4256-be59-b64dae993293 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:10:58 user nova-compute[85141]: DEBUG nova.compute.manager [req-5f4f094d-4e7a-44fc-b5bd-f77a2fd367e1 req-7353ed3e-bcd2-4766-bfe8-e350676f6bc7 service nova] [instance: 6caf3667-5613-4ef4-a597-1820e6c1c0ac] Refreshing instance network info cache due to event network-changed-ad2b755f-6905-4256-be59-b64dae993293. {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 10:10:58 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-5f4f094d-4e7a-44fc-b5bd-f77a2fd367e1 req-7353ed3e-bcd2-4766-bfe8-e350676f6bc7 service nova] Acquiring lock "refresh_cache-6caf3667-5613-4ef4-a597-1820e6c1c0ac" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:10:58 user nova-compute[85141]: DEBUG nova.network.neutron [None req-d75ac365-ae12-46bf-bb9b-1ef1096b5aae tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] [instance: 6caf3667-5613-4ef4-a597-1820e6c1c0ac] Instance cache missing network info. {{(pid=85141) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 10:10:58 user nova-compute[85141]: DEBUG nova.network.neutron [None req-d75ac365-ae12-46bf-bb9b-1ef1096b5aae tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] [instance: 6caf3667-5613-4ef4-a597-1820e6c1c0ac] Updating instance_info_cache with network_info: [{"id": "ad2b755f-6905-4256-be59-b64dae993293", "address": "fa:16:3e:fb:7c:00", "network": {"id": "9b5d58ef-109a-4ccb-90e4-a6b18c02f49c", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1619595955-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e017c305665f4a98a75d1d77701b6527", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad2b755f-69", "ovs_interfaceid": "ad2b755f-6905-4256-be59-b64dae993293", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:10:58 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-d75ac365-ae12-46bf-bb9b-1ef1096b5aae tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] Releasing lock "refresh_cache-6caf3667-5613-4ef4-a597-1820e6c1c0ac" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:10:58 user nova-compute[85141]: DEBUG nova.compute.manager [None req-d75ac365-ae12-46bf-bb9b-1ef1096b5aae tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] [instance: 6caf3667-5613-4ef4-a597-1820e6c1c0ac] Instance network_info: |[{"id": "ad2b755f-6905-4256-be59-b64dae993293", "address": "fa:16:3e:fb:7c:00", "network": {"id": "9b5d58ef-109a-4ccb-90e4-a6b18c02f49c", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1619595955-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e017c305665f4a98a75d1d77701b6527", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad2b755f-69", "ovs_interfaceid": "ad2b755f-6905-4256-be59-b64dae993293", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=85141) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 10:10:58 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-5f4f094d-4e7a-44fc-b5bd-f77a2fd367e1 req-7353ed3e-bcd2-4766-bfe8-e350676f6bc7 service nova] Acquired lock "refresh_cache-6caf3667-5613-4ef4-a597-1820e6c1c0ac" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:10:58 user nova-compute[85141]: DEBUG nova.network.neutron [req-5f4f094d-4e7a-44fc-b5bd-f77a2fd367e1 req-7353ed3e-bcd2-4766-bfe8-e350676f6bc7 service nova] [instance: 6caf3667-5613-4ef4-a597-1820e6c1c0ac] Refreshing network info cache for port ad2b755f-6905-4256-be59-b64dae993293 {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 10:10:59 user sudo[95272]: pam_unix(sudo:session): session closed for user root
Nov 16 10:10:59 user nova-compute[85141]: INFO oslo.privsep.daemon [None req-d75ac365-ae12-46bf-bb9b-1ef1096b5aae tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] Spawned new privsep daemon via rootwrap
Nov 16 10:10:59 user nova-compute[85141]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 16 10:10:59 user nova-compute[85141]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 16 10:10:59 user nova-compute[85141]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Nov 16 10:10:59 user nova-compute[85141]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 95342
Nov 16 10:10:59 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a23b884-f354-43fc-aa54-408cb74645a3]: (2,) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:10:59 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:10:59 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:10:59 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.023s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:10:59 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[0de65928-dca1-4065-bbf8-1a7233d00ae5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c7834de5c295\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:10:59 user nova-compute[85141]: WARNING os_brick.initiator.connectors.nvmeof [None req-d75ac365-ae12-46bf-bb9b-1ef1096b5aae tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Nov 16 10:10:59 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:10:59 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:10:59 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.051s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:10:59 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[d96500d0-a952-4e50-8968-fcce022d1d0c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:10:59 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:10:59 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:10:59 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[e713e901-bf10-4491-a2ef-714598abc392]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:10:59 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[80032542-4c34-46da-89ec-2fe018987375]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:10:59 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-d75ac365-ae12-46bf-bb9b-1ef1096b5aae tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] Running cmd (subprocess): nvme version {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:10:59 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-d75ac365-ae12-46bf-bb9b-1ef1096b5aae tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] 'nvme version' failed. Not Retrying. {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 10:10:59 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:10:59 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d75ac365-ae12-46bf-bb9b-1ef1096b5aae tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] nvme not present on system {{(pid=85141) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 10:10:59 user nova-compute[85141]: DEBUG nova.network.neutron [None req-5fbcf7f0-a47f-465d-b445-cd3b21c9cf8e tempest-AttachSCSIVolumeTestJSON-1774410022 tempest-AttachSCSIVolumeTestJSON-1774410022-project-member] [instance: ff964caf-b473-47bc-89d2-f7189264721c] Successfully updated port: 75922f14-4d10-428a-baf5-bc27dfa373a6 {{(pid=85141) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 10:10:59 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:10:59 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 10:10:59 user nova-compute[85141]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 10:10:59 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf96c335-95a3-4a29-9204-734bd225ac20]: (4, '') {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:10:59 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.lightos [None req-d75ac365-ae12-46bf-bb9b-1ef1096b5aae tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=85141) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 10:10:59 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.lightos [None req-d75ac365-ae12-46bf-bb9b-1ef1096b5aae tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=85141) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 10:10:59 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.lightos [None req-d75ac365-ae12-46bf-bb9b-1ef1096b5aae tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] LIGHTOS: no hostnqn found. {{(pid=85141) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 10:10:59 user nova-compute[85141]: DEBUG os_brick.utils [None req-d75ac365-ae12-46bf-bb9b-1ef1096b5aae tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] <== get_connector_properties: return (2983ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c7834de5c295', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 10:10:59 user nova-compute[85141]: DEBUG nova.virt.block_device [None req-d75ac365-ae12-46bf-bb9b-1ef1096b5aae tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] [instance: 6caf3667-5613-4ef4-a597-1820e6c1c0ac] Updating existing volume attachment record: cbe95117-8868-442d-8bf0-c76403a46a03 {{(pid=85141) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 10:10:59 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbcf7f0-a47f-465d-b445-cd3b21c9cf8e tempest-AttachSCSIVolumeTestJSON-1774410022 tempest-AttachSCSIVolumeTestJSON-1774410022-project-member] Acquiring lock "refresh_cache-ff964caf-b473-47bc-89d2-f7189264721c" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:10:59 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbcf7f0-a47f-465d-b445-cd3b21c9cf8e tempest-AttachSCSIVolumeTestJSON-1774410022 tempest-AttachSCSIVolumeTestJSON-1774410022-project-member] Acquired lock "refresh_cache-ff964caf-b473-47bc-89d2-f7189264721c" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:10:59 user nova-compute[85141]: DEBUG nova.network.neutron [None req-5fbcf7f0-a47f-465d-b445-cd3b21c9cf8e tempest-AttachSCSIVolumeTestJSON-1774410022 tempest-AttachSCSIVolumeTestJSON-1774410022-project-member] [instance: ff964caf-b473-47bc-89d2-f7189264721c] Building network info cache for instance {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 10:10:59 user nova-compute[85141]: DEBUG nova.compute.manager [req-fd258b2b-c7f4-44ae-8477-d979b4836ed4 req-2d6924ea-c3f1-4d4b-8f22-7d81b8ba32a1 service nova] [instance: ff964caf-b473-47bc-89d2-f7189264721c] Received event network-changed-75922f14-4d10-428a-baf5-bc27dfa373a6 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:10:59 user nova-compute[85141]: DEBUG nova.compute.manager [req-fd258b2b-c7f4-44ae-8477-d979b4836ed4 req-2d6924ea-c3f1-4d4b-8f22-7d81b8ba32a1 service nova] [instance: ff964caf-b473-47bc-89d2-f7189264721c] Refreshing instance network info cache due to event network-changed-75922f14-4d10-428a-baf5-bc27dfa373a6. {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 10:10:59 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-fd258b2b-c7f4-44ae-8477-d979b4836ed4 req-2d6924ea-c3f1-4d4b-8f22-7d81b8ba32a1 service nova] Acquiring lock "refresh_cache-ff964caf-b473-47bc-89d2-f7189264721c" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:10:59 user nova-compute[85141]: DEBUG nova.network.neutron [req-5f4f094d-4e7a-44fc-b5bd-f77a2fd367e1 req-7353ed3e-bcd2-4766-bfe8-e350676f6bc7 service nova] [instance: 6caf3667-5613-4ef4-a597-1820e6c1c0ac] Updated VIF entry in instance network info cache for port ad2b755f-6905-4256-be59-b64dae993293. {{(pid=85141) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 10:10:59 user nova-compute[85141]: DEBUG nova.network.neutron [req-5f4f094d-4e7a-44fc-b5bd-f77a2fd367e1 req-7353ed3e-bcd2-4766-bfe8-e350676f6bc7 service nova] [instance: 6caf3667-5613-4ef4-a597-1820e6c1c0ac] Updating instance_info_cache with network_info: [{"id": "ad2b755f-6905-4256-be59-b64dae993293", "address": "fa:16:3e:fb:7c:00", "network": {"id": "9b5d58ef-109a-4ccb-90e4-a6b18c02f49c", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1619595955-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e017c305665f4a98a75d1d77701b6527", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad2b755f-69", "ovs_interfaceid": "ad2b755f-6905-4256-be59-b64dae993293", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:10:59 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-5f4f094d-4e7a-44fc-b5bd-f77a2fd367e1 req-7353ed3e-bcd2-4766-bfe8-e350676f6bc7 service nova] Releasing lock "refresh_cache-6caf3667-5613-4ef4-a597-1820e6c1c0ac" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:10:59 user nova-compute[85141]: DEBUG nova.network.neutron [None req-5fbcf7f0-a47f-465d-b445-cd3b21c9cf8e tempest-AttachSCSIVolumeTestJSON-1774410022 tempest-AttachSCSIVolumeTestJSON-1774410022-project-member] [instance: ff964caf-b473-47bc-89d2-f7189264721c] Instance cache missing network info. {{(pid=85141) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 10:11:00 user nova-compute[85141]: DEBUG nova.network.neutron [None req-77454959-aa5e-4ea4-a4b2-40594749ed82 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] [instance: 0ca61bd2-268e-4c49-ba04-a5cb39143a9b] Successfully updated port: 56375501-2a9c-4821-8446-31156fc0f231 {{(pid=85141) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 10:11:00 user nova-compute[85141]: DEBUG nova.compute.manager [req-65a6ea1f-c129-440e-86ba-7b2a39d276eb req-1ed654a7-5c53-417e-916f-ff38a733c256 service nova] [instance: 9411843f-4e79-46c4-ae02-01f5e87b86eb] Received event network-vif-plugged-1202aa6f-6442-4e95-bf51-66f977a23e01 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:11:00 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-65a6ea1f-c129-440e-86ba-7b2a39d276eb req-1ed654a7-5c53-417e-916f-ff38a733c256 service nova] Acquiring lock "9411843f-4e79-46c4-ae02-01f5e87b86eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:11:00 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-65a6ea1f-c129-440e-86ba-7b2a39d276eb req-1ed654a7-5c53-417e-916f-ff38a733c256 service nova] Lock "9411843f-4e79-46c4-ae02-01f5e87b86eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:11:00 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-65a6ea1f-c129-440e-86ba-7b2a39d276eb req-1ed654a7-5c53-417e-916f-ff38a733c256 service nova] Lock "9411843f-4e79-46c4-ae02-01f5e87b86eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:11:00 user nova-compute[85141]: DEBUG nova.compute.manager [req-65a6ea1f-c129-440e-86ba-7b2a39d276eb req-1ed654a7-5c53-417e-916f-ff38a733c256 service nova] [instance: 9411843f-4e79-46c4-ae02-01f5e87b86eb] No waiting events found dispatching network-vif-plugged-1202aa6f-6442-4e95-bf51-66f977a23e01 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:11:00 user nova-compute[85141]: WARNING nova.compute.manager [req-65a6ea1f-c129-440e-86ba-7b2a39d276eb req-1ed654a7-5c53-417e-916f-ff38a733c256 service nova] [instance: 9411843f-4e79-46c4-ae02-01f5e87b86eb] Received unexpected event network-vif-plugged-1202aa6f-6442-4e95-bf51-66f977a23e01 for instance with vm_state active and task_state None.
Nov 16 10:11:00 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-77454959-aa5e-4ea4-a4b2-40594749ed82 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] Acquiring lock "refresh_cache-0ca61bd2-268e-4c49-ba04-a5cb39143a9b" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:11:00 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-77454959-aa5e-4ea4-a4b2-40594749ed82 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] Acquired lock "refresh_cache-0ca61bd2-268e-4c49-ba04-a5cb39143a9b" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:11:00 user nova-compute[85141]: DEBUG nova.network.neutron [None req-77454959-aa5e-4ea4-a4b2-40594749ed82 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] [instance: 0ca61bd2-268e-4c49-ba04-a5cb39143a9b] Building network info cache for instance {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 10:11:00 user nova-compute[85141]: DEBUG nova.network.neutron [None req-77454959-aa5e-4ea4-a4b2-40594749ed82 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] [instance: 0ca61bd2-268e-4c49-ba04-a5cb39143a9b] Instance cache missing network info. {{(pid=85141) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 10:11:00 user nova-compute[85141]: DEBUG nova.network.neutron [None req-77454959-aa5e-4ea4-a4b2-40594749ed82 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] [instance: 0ca61bd2-268e-4c49-ba04-a5cb39143a9b] Updating instance_info_cache with network_info: [{"id": "56375501-2a9c-4821-8446-31156fc0f231", "address": "fa:16:3e:12:0a:da", "network": {"id": "cd9a5383-79fc-4957-9a8e-30a18ac26969", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1797454995-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9317f5645af406c899fcc5df61362bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56375501-2a", "ovs_interfaceid": "56375501-2a9c-4821-8446-31156fc0f231", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:11:00 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-77454959-aa5e-4ea4-a4b2-40594749ed82 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] Releasing lock "refresh_cache-0ca61bd2-268e-4c49-ba04-a5cb39143a9b" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:11:00 user nova-compute[85141]: DEBUG nova.compute.manager [None req-77454959-aa5e-4ea4-a4b2-40594749ed82 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] [instance: 0ca61bd2-268e-4c49-ba04-a5cb39143a9b] Instance network_info: |[{"id": "56375501-2a9c-4821-8446-31156fc0f231", "address": "fa:16:3e:12:0a:da", "network": {"id": "cd9a5383-79fc-4957-9a8e-30a18ac26969", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1797454995-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9317f5645af406c899fcc5df61362bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56375501-2a", "ovs_interfaceid": "56375501-2a9c-4821-8446-31156fc0f231", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=85141) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 10:11:00 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-77454959-aa5e-4ea4-a4b2-40594749ed82 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] [instance: 0ca61bd2-268e-4c49-ba04-a5cb39143a9b] Start _get_guest_xml network_info=[{"id": "56375501-2a9c-4821-8446-31156fc0f231", "address": "fa:16:3e:12:0a:da", "network": {"id": "cd9a5383-79fc-4957-9a8e-30a18ac26969", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1797454995-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9317f5645af406c899fcc5df61362bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56375501-2a", "ovs_interfaceid": "56375501-2a9c-4821-8446-31156fc0f231", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T10:06:42Z,direct_url=<?>,disk_format='qcow2',id=bc4ca70f-a459-4d5c-a9e6-80f1948eb48b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1044631a5fe84ce8904864a7024049fa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T10:06:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_options': None, 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'image_id': 'bc4ca70f-a459-4d5c-a9e6-80f1948eb48b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=85141) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 10:11:00 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-77454959-aa5e-4ea4-a4b2-40594749ed82 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:11:00 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-77454959-aa5e-4ea4-a4b2-40594749ed82 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:11:00 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-77454959-aa5e-4ea4-a4b2-40594749ed82 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=85141) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 10:11:00 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-77454959-aa5e-4ea4-a4b2-40594749ed82 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] CPU controller missing on host. {{(pid=85141) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 10:11:00 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-77454959-aa5e-4ea4-a4b2-40594749ed82 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=85141) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 10:11:00 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-77454959-aa5e-4ea4-a4b2-40594749ed82 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] CPU controller found on host. {{(pid=85141) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 10:11:00 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-77454959-aa5e-4ea4-a4b2-40594749ed82 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=85141) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 10:11:00 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-77454959-aa5e-4ea4-a4b2-40594749ed82 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T10:06:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T10:06:42Z,direct_url=<?>,disk_format='qcow2',id=bc4ca70f-a459-4d5c-a9e6-80f1948eb48b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1044631a5fe84ce8904864a7024049fa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T10:06:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 10:11:00 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-77454959-aa5e-4ea4-a4b2-40594749ed82 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] Flavor limits 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 10:11:00 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-77454959-aa5e-4ea4-a4b2-40594749ed82 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] Image limits 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 10:11:00 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-77454959-aa5e-4ea4-a4b2-40594749ed82 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] Flavor pref 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 10:11:00 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-77454959-aa5e-4ea4-a4b2-40594749ed82 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] Image pref 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 10:11:00 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-77454959-aa5e-4ea4-a4b2-40594749ed82 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 10:11:00 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-77454959-aa5e-4ea4-a4b2-40594749ed82 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 10:11:00 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-77454959-aa5e-4ea4-a4b2-40594749ed82 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=85141) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 10:11:00 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-77454959-aa5e-4ea4-a4b2-40594749ed82 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] Got 1 possible topologies {{(pid=85141) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 10:11:00 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-77454959-aa5e-4ea4-a4b2-40594749ed82 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 10:11:00 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-77454959-aa5e-4ea4-a4b2-40594749ed82 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 10:11:00 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-77454959-aa5e-4ea4-a4b2-40594749ed82 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T10:10:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-716916570',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-716916570',id=8,image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLJjo671Ow+Mmgs0Sg26Qz/3lV+acwH0zhTjdI/jAzpHJeJFVSCAeG6lSBMe0VPCPV8jS6nF17VjHRJ+udtegobTbD+V4E/SBllDlIvaieW2o7QXUoKkfv8rtxZTi+1HzQ==',key_name='tempest-keypair-612763063',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b9317f5645af406c899fcc5df61362bb',ramdisk_id='',reservation_id='r-xpla73zu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1293058027',owner_user_name='tempest-TaggedAttachmentsTest-1293058027-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T10:10:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8734a61ff9fb4e14b1b542b8ecdfdeec',uuid=0ca61bd2-268e-4c49-ba04-a5cb39143a9b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "56375501-2a9c-4821-8446-31156fc0f231", "address": "fa:16:3e:12:0a:da", "network": {"id": "cd9a5383-79fc-4957-9a8e-30a18ac26969", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1797454995-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9317f5645af406c899fcc5df61362bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56375501-2a", "ovs_interfaceid": "56375501-2a9c-4821-8446-31156fc0f231", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=85141) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 10:11:00 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-77454959-aa5e-4ea4-a4b2-40594749ed82 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] Converting VIF {"id": "56375501-2a9c-4821-8446-31156fc0f231", "address": "fa:16:3e:12:0a:da", "network": {"id": "cd9a5383-79fc-4957-9a8e-30a18ac26969", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1797454995-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9317f5645af406c899fcc5df61362bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56375501-2a", "ovs_interfaceid": "56375501-2a9c-4821-8446-31156fc0f231", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:11:00 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-77454959-aa5e-4ea4-a4b2-40594749ed82 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:12:0a:da,bridge_name='br-int',has_traffic_filtering=True,id=56375501-2a9c-4821-8446-31156fc0f231,network=Network(cd9a5383-79fc-4957-9a8e-30a18ac26969),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56375501-2a') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:11:00 user nova-compute[85141]: DEBUG nova.objects.instance [None req-77454959-aa5e-4ea4-a4b2-40594749ed82 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] Lazy-loading 'pci_devices' on Instance uuid 0ca61bd2-268e-4c49-ba04-a5cb39143a9b {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:11:00 user nova-compute[85141]: DEBUG nova.network.neutron [None req-5fbcf7f0-a47f-465d-b445-cd3b21c9cf8e tempest-AttachSCSIVolumeTestJSON-1774410022 tempest-AttachSCSIVolumeTestJSON-1774410022-project-member] [instance: ff964caf-b473-47bc-89d2-f7189264721c] Updating instance_info_cache with network_info: [{"id": "75922f14-4d10-428a-baf5-bc27dfa373a6", "address": "fa:16:3e:3f:0d:5b", "network": {"id": "19e4c869-308d-4f73-99a4-653683c91209", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-208861710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb4a953734f44d049877b7658cae923c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75922f14-4d", "ovs_interfaceid": "75922f14-4d10-428a-baf5-bc27dfa373a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:11:00 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-77454959-aa5e-4ea4-a4b2-40594749ed82 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] [instance: 0ca61bd2-268e-4c49-ba04-a5cb39143a9b] End _get_guest_xml xml=<domain type="kvm">
Nov 16 10:11:00 user nova-compute[85141]:   <uuid>0ca61bd2-268e-4c49-ba04-a5cb39143a9b</uuid>
Nov 16 10:11:00 user nova-compute[85141]:   <name>instance-00000008</name>
Nov 16 10:11:00 user nova-compute[85141]:   <memory>524288</memory>
Nov 16 10:11:00 user nova-compute[85141]:   <vcpu>1</vcpu>
Nov 16 10:11:00 user nova-compute[85141]:   <metadata>
Nov 16 10:11:00 user nova-compute[85141]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 10:11:00 user nova-compute[85141]:       <nova:package version="0.0.0"/>
Nov 16 10:11:00 user nova-compute[85141]:       <nova:name>tempest-device-tagging-server-716916570</nova:name>
Nov 16 10:11:00 user nova-compute[85141]:       <nova:creationTime>2023-11-16 10:11:00</nova:creationTime>
Nov 16 10:11:00 user nova-compute[85141]:       <nova:flavor name="m1.tiny">
Nov 16 10:11:00 user nova-compute[85141]:         <nova:memory>512</nova:memory>
Nov 16 10:11:00 user nova-compute[85141]:         <nova:disk>1</nova:disk>
Nov 16 10:11:00 user nova-compute[85141]:         <nova:swap>0</nova:swap>
Nov 16 10:11:00 user nova-compute[85141]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 10:11:00 user nova-compute[85141]:         <nova:vcpus>1</nova:vcpus>
Nov 16 10:11:00 user nova-compute[85141]:       </nova:flavor>
Nov 16 10:11:00 user nova-compute[85141]:       <nova:owner>
Nov 16 10:11:00 user nova-compute[85141]:         <nova:user uuid="8734a61ff9fb4e14b1b542b8ecdfdeec">tempest-TaggedAttachmentsTest-1293058027-project-member</nova:user>
Nov 16 10:11:00 user nova-compute[85141]:         <nova:project uuid="b9317f5645af406c899fcc5df61362bb">tempest-TaggedAttachmentsTest-1293058027</nova:project>
Nov 16 10:11:00 user nova-compute[85141]:       </nova:owner>
Nov 16 10:11:00 user nova-compute[85141]:       <nova:root type="image" uuid="bc4ca70f-a459-4d5c-a9e6-80f1948eb48b"/>
Nov 16 10:11:00 user nova-compute[85141]:       <nova:ports>
Nov 16 10:11:00 user nova-compute[85141]:         <nova:port uuid="56375501-2a9c-4821-8446-31156fc0f231">
Nov 16 10:11:00 user nova-compute[85141]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 16 10:11:00 user nova-compute[85141]:         </nova:port>
Nov 16 10:11:00 user nova-compute[85141]:       </nova:ports>
Nov 16 10:11:00 user nova-compute[85141]:     </nova:instance>
Nov 16 10:11:00 user nova-compute[85141]:   </metadata>
Nov 16 10:11:00 user nova-compute[85141]:   <sysinfo type="smbios">
Nov 16 10:11:00 user nova-compute[85141]:     <system>
Nov 16 10:11:00 user nova-compute[85141]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 10:11:00 user nova-compute[85141]:       <entry name="product">OpenStack Nova</entry>
Nov 16 10:11:00 user nova-compute[85141]:       <entry name="version">0.0.0</entry>
Nov 16 10:11:00 user nova-compute[85141]:       <entry name="serial">0ca61bd2-268e-4c49-ba04-a5cb39143a9b</entry>
Nov 16 10:11:00 user nova-compute[85141]:       <entry name="uuid">0ca61bd2-268e-4c49-ba04-a5cb39143a9b</entry>
Nov 16 10:11:00 user nova-compute[85141]:       <entry name="family">Virtual Machine</entry>
Nov 16 10:11:00 user nova-compute[85141]:     </system>
Nov 16 10:11:00 user nova-compute[85141]:   </sysinfo>
Nov 16 10:11:00 user nova-compute[85141]:   <os>
Nov 16 10:11:00 user nova-compute[85141]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 10:11:00 user nova-compute[85141]:     <boot dev="hd"/>
Nov 16 10:11:00 user nova-compute[85141]:     <smbios mode="sysinfo"/>
Nov 16 10:11:00 user nova-compute[85141]:   </os>
Nov 16 10:11:00 user nova-compute[85141]:   <features>
Nov 16 10:11:00 user nova-compute[85141]:     <acpi/>
Nov 16 10:11:00 user nova-compute[85141]:     <apic/>
Nov 16 10:11:00 user nova-compute[85141]:     <vmcoreinfo/>
Nov 16 10:11:00 user nova-compute[85141]:   </features>
Nov 16 10:11:00 user nova-compute[85141]:   <clock offset="utc">
Nov 16 10:11:00 user nova-compute[85141]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 10:11:00 user nova-compute[85141]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 10:11:00 user nova-compute[85141]:     <timer name="hpet" present="no"/>
Nov 16 10:11:00 user nova-compute[85141]:   </clock>
Nov 16 10:11:00 user nova-compute[85141]:   <cpu mode="custom" match="exact">
Nov 16 10:11:00 user nova-compute[85141]:     <model>Nehalem</model>
Nov 16 10:11:00 user nova-compute[85141]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 10:11:00 user nova-compute[85141]:   </cpu>
Nov 16 10:11:00 user nova-compute[85141]:   <devices>
Nov 16 10:11:00 user nova-compute[85141]:     <disk type="file" device="disk">
Nov 16 10:11:00 user nova-compute[85141]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 10:11:00 user nova-compute[85141]:       <source file="/opt/stack/data/nova/instances/0ca61bd2-268e-4c49-ba04-a5cb39143a9b/disk"/>
Nov 16 10:11:00 user nova-compute[85141]:       <target dev="vda" bus="virtio"/>
Nov 16 10:11:00 user nova-compute[85141]:     </disk>
Nov 16 10:11:00 user nova-compute[85141]:     <disk type="file" device="cdrom">
Nov 16 10:11:00 user nova-compute[85141]:       <driver name="qemu" type="raw" cache="none"/>
Nov 16 10:11:00 user nova-compute[85141]:       <source file="/opt/stack/data/nova/instances/0ca61bd2-268e-4c49-ba04-a5cb39143a9b/disk.config"/>
Nov 16 10:11:00 user nova-compute[85141]:       <target dev="hda" bus="ide"/>
Nov 16 10:11:00 user nova-compute[85141]:     </disk>
Nov 16 10:11:00 user nova-compute[85141]:     <interface type="ethernet">
Nov 16 10:11:00 user nova-compute[85141]:       <mac address="fa:16:3e:12:0a:da"/>
Nov 16 10:11:00 user nova-compute[85141]:       <model type="virtio"/>
Nov 16 10:11:00 user nova-compute[85141]:       <mtu size="1442"/>
Nov 16 10:11:00 user nova-compute[85141]:       <target dev="tap56375501-2a"/>
Nov 16 10:11:00 user nova-compute[85141]:     </interface>
Nov 16 10:11:00 user nova-compute[85141]:     <serial type="pty">
Nov 16 10:11:00 user nova-compute[85141]:       <log file="/opt/stack/data/nova/instances/0ca61bd2-268e-4c49-ba04-a5cb39143a9b/console.log" append="off"/>
Nov 16 10:11:00 user nova-compute[85141]:     </serial>
Nov 16 10:11:00 user nova-compute[85141]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 10:11:00 user nova-compute[85141]:     <video>
Nov 16 10:11:00 user nova-compute[85141]:       <model type="virtio"/>
Nov 16 10:11:00 user nova-compute[85141]:     </video>
Nov 16 10:11:00 user nova-compute[85141]:     <rng model="virtio">
Nov 16 10:11:00 user nova-compute[85141]:       <backend model="random">/dev/urandom</backend>
Nov 16 10:11:00 user nova-compute[85141]:     </rng>
Nov 16 10:11:00 user nova-compute[85141]:     <controller type="usb" index="0" model="none"/>
Nov 16 10:11:00 user nova-compute[85141]:     <memballoon model="virtio">
Nov 16 10:11:00 user nova-compute[85141]:       <stats period="10"/>
Nov 16 10:11:00 user nova-compute[85141]:     </memballoon>
Nov 16 10:11:00 user nova-compute[85141]:   </devices>
Nov 16 10:11:00 user nova-compute[85141]: </domain>
Nov 16 10:11:00 user nova-compute[85141]:  {{(pid=85141) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 10:11:00 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-77454959-aa5e-4ea4-a4b2-40594749ed82 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T10:10:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-716916570',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-716916570',id=8,image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLJjo671Ow+Mmgs0Sg26Qz/3lV+acwH0zhTjdI/jAzpHJeJFVSCAeG6lSBMe0VPCPV8jS6nF17VjHRJ+udtegobTbD+V4E/SBllDlIvaieW2o7QXUoKkfv8rtxZTi+1HzQ==',key_name='tempest-keypair-612763063',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b9317f5645af406c899fcc5df61362bb',ramdisk_id='',reservation_id='r-xpla73zu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1293058027',owner_user_name='tempest-TaggedAttachmentsTest-1293058027-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T10:10:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8734a61ff9fb4e14b1b542b8ecdfdeec',uuid=0ca61bd2-268e-4c49-ba04-a5cb39143a9b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "56375501-2a9c-4821-8446-31156fc0f231", "address": "fa:16:3e:12:0a:da", "network": {"id": "cd9a5383-79fc-4957-9a8e-30a18ac26969", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1797454995-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9317f5645af406c899fcc5df61362bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56375501-2a", "ovs_interfaceid": "56375501-2a9c-4821-8446-31156fc0f231", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 10:11:00 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-77454959-aa5e-4ea4-a4b2-40594749ed82 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] Converting VIF {"id": "56375501-2a9c-4821-8446-31156fc0f231", "address": "fa:16:3e:12:0a:da", "network": {"id": "cd9a5383-79fc-4957-9a8e-30a18ac26969", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1797454995-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9317f5645af406c899fcc5df61362bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56375501-2a", "ovs_interfaceid": "56375501-2a9c-4821-8446-31156fc0f231", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:11:00 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-77454959-aa5e-4ea4-a4b2-40594749ed82 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:12:0a:da,bridge_name='br-int',has_traffic_filtering=True,id=56375501-2a9c-4821-8446-31156fc0f231,network=Network(cd9a5383-79fc-4957-9a8e-30a18ac26969),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56375501-2a') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:11:00 user nova-compute[85141]: DEBUG os_vif [None req-77454959-aa5e-4ea4-a4b2-40594749ed82 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:0a:da,bridge_name='br-int',has_traffic_filtering=True,id=56375501-2a9c-4821-8446-31156fc0f231,network=Network(cd9a5383-79fc-4957-9a8e-30a18ac26969),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56375501-2a') {{(pid=85141) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 10:11:00 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:11:00 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:11:00 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 10:11:00 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:11:00 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd6af27ab-a861-5fa4-9c7e-c9779b85dcb7', '_type': 'linux-noop'}}, row=False) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:11:00 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:11:00 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:11:00 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:11:00 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap56375501-2a, may_exist=True, interface_attrs={}) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:11:00 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap56375501-2a, col_values=(('qos', UUID('8596c49d-cb79-464d-86d6-2a0fcab7deba')),), if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:11:00 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap56375501-2a, col_values=(('external_ids', {'iface-id': '56375501-2a9c-4821-8446-31156fc0f231', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:12:0a:da', 'vm-uuid': '0ca61bd2-268e-4c49-ba04-a5cb39143a9b'}),), if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:11:00 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:11:00 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:11:00 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbcf7f0-a47f-465d-b445-cd3b21c9cf8e tempest-AttachSCSIVolumeTestJSON-1774410022 tempest-AttachSCSIVolumeTestJSON-1774410022-project-member] Releasing lock "refresh_cache-ff964caf-b473-47bc-89d2-f7189264721c" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:11:00 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbcf7f0-a47f-465d-b445-cd3b21c9cf8e tempest-AttachSCSIVolumeTestJSON-1774410022 tempest-AttachSCSIVolumeTestJSON-1774410022-project-member] [instance: ff964caf-b473-47bc-89d2-f7189264721c] Instance network_info: |[{"id": "75922f14-4d10-428a-baf5-bc27dfa373a6", "address": "fa:16:3e:3f:0d:5b", "network": {"id": "19e4c869-308d-4f73-99a4-653683c91209", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-208861710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb4a953734f44d049877b7658cae923c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75922f14-4d", "ovs_interfaceid": "75922f14-4d10-428a-baf5-bc27dfa373a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=85141) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 10:11:00 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:11:00 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-fd258b2b-c7f4-44ae-8477-d979b4836ed4 req-2d6924ea-c3f1-4d4b-8f22-7d81b8ba32a1 service nova] Acquired lock "refresh_cache-ff964caf-b473-47bc-89d2-f7189264721c" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:11:00 user nova-compute[85141]: DEBUG nova.network.neutron [req-fd258b2b-c7f4-44ae-8477-d979b4836ed4 req-2d6924ea-c3f1-4d4b-8f22-7d81b8ba32a1 service nova] [instance: ff964caf-b473-47bc-89d2-f7189264721c] Refreshing network info cache for port 75922f14-4d10-428a-baf5-bc27dfa373a6 {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 10:11:00 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-5fbcf7f0-a47f-465d-b445-cd3b21c9cf8e tempest-AttachSCSIVolumeTestJSON-1774410022 tempest-AttachSCSIVolumeTestJSON-1774410022-project-member] [instance: ff964caf-b473-47bc-89d2-f7189264721c] Start _get_guest_xml network_info=[{"id": "75922f14-4d10-428a-baf5-bc27dfa373a6", "address": "fa:16:3e:3f:0d:5b", "network": {"id": "19e4c869-308d-4f73-99a4-653683c91209", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-208861710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb4a953734f44d049877b7658cae923c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75922f14-4d", "ovs_interfaceid": "75922f14-4d10-428a-baf5-bc27dfa373a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T10:10:42Z,direct_url=<?>,disk_format='qcow2',id=164bf389-5fc3-484a-8449-60bd5a23b06e,min_disk=0,min_ram=0,name='',owner='9d8fd6611d5c45e18a7ed0c26ef580d6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T10:10:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'disk_bus': 'scsi', 'size': 0, 'encrypted': False, 'encryption_options': None, 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/sda', 'image_id': '164bf389-5fc3-484a-8449-60bd5a23b06e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=85141) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 10:11:00 user nova-compute[85141]: INFO os_vif [None req-77454959-aa5e-4ea4-a4b2-40594749ed82 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:0a:da,bridge_name='br-int',has_traffic_filtering=True,id=56375501-2a9c-4821-8446-31156fc0f231,network=Network(cd9a5383-79fc-4957-9a8e-30a18ac26969),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56375501-2a')
Nov 16 10:11:00 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-5fbcf7f0-a47f-465d-b445-cd3b21c9cf8e tempest-AttachSCSIVolumeTestJSON-1774410022 tempest-AttachSCSIVolumeTestJSON-1774410022-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:11:00 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-5fbcf7f0-a47f-465d-b445-cd3b21c9cf8e tempest-AttachSCSIVolumeTestJSON-1774410022 tempest-AttachSCSIVolumeTestJSON-1774410022-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:11:00 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-5fbcf7f0-a47f-465d-b445-cd3b21c9cf8e tempest-AttachSCSIVolumeTestJSON-1774410022 tempest-AttachSCSIVolumeTestJSON-1774410022-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=85141) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 10:11:00 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-5fbcf7f0-a47f-465d-b445-cd3b21c9cf8e tempest-AttachSCSIVolumeTestJSON-1774410022 tempest-AttachSCSIVolumeTestJSON-1774410022-project-member] CPU controller missing on host. {{(pid=85141) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 10:11:00 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-5fbcf7f0-a47f-465d-b445-cd3b21c9cf8e tempest-AttachSCSIVolumeTestJSON-1774410022 tempest-AttachSCSIVolumeTestJSON-1774410022-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=85141) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 10:11:00 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-5fbcf7f0-a47f-465d-b445-cd3b21c9cf8e tempest-AttachSCSIVolumeTestJSON-1774410022 tempest-AttachSCSIVolumeTestJSON-1774410022-project-member] CPU controller found on host. {{(pid=85141) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 10:11:00 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-5fbcf7f0-a47f-465d-b445-cd3b21c9cf8e tempest-AttachSCSIVolumeTestJSON-1774410022 tempest-AttachSCSIVolumeTestJSON-1774410022-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=85141) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 10:11:00 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-5fbcf7f0-a47f-465d-b445-cd3b21c9cf8e tempest-AttachSCSIVolumeTestJSON-1774410022 tempest-AttachSCSIVolumeTestJSON-1774410022-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T10:06:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T10:10:42Z,direct_url=<?>,disk_format='qcow2',id=164bf389-5fc3-484a-8449-60bd5a23b06e,min_disk=0,min_ram=0,name='',owner='9d8fd6611d5c45e18a7ed0c26ef580d6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T10:10:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 10:11:00 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-5fbcf7f0-a47f-465d-b445-cd3b21c9cf8e tempest-AttachSCSIVolumeTestJSON-1774410022 tempest-AttachSCSIVolumeTestJSON-1774410022-project-member] Flavor limits 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 10:11:00 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-5fbcf7f0-a47f-465d-b445-cd3b21c9cf8e tempest-AttachSCSIVolumeTestJSON-1774410022 tempest-AttachSCSIVolumeTestJSON-1774410022-project-member] Image limits 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 10:11:00 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-5fbcf7f0-a47f-465d-b445-cd3b21c9cf8e tempest-AttachSCSIVolumeTestJSON-1774410022 tempest-AttachSCSIVolumeTestJSON-1774410022-project-member] Flavor pref 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 10:11:00 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-5fbcf7f0-a47f-465d-b445-cd3b21c9cf8e tempest-AttachSCSIVolumeTestJSON-1774410022 tempest-AttachSCSIVolumeTestJSON-1774410022-project-member] Image pref 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 10:11:00 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-5fbcf7f0-a47f-465d-b445-cd3b21c9cf8e tempest-AttachSCSIVolumeTestJSON-1774410022 tempest-AttachSCSIVolumeTestJSON-1774410022-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 10:11:00 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-5fbcf7f0-a47f-465d-b445-cd3b21c9cf8e tempest-AttachSCSIVolumeTestJSON-1774410022 tempest-AttachSCSIVolumeTestJSON-1774410022-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 10:11:00 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-5fbcf7f0-a47f-465d-b445-cd3b21c9cf8e tempest-AttachSCSIVolumeTestJSON-1774410022 tempest-AttachSCSIVolumeTestJSON-1774410022-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=85141) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 10:11:00 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-5fbcf7f0-a47f-465d-b445-cd3b21c9cf8e tempest-AttachSCSIVolumeTestJSON-1774410022 tempest-AttachSCSIVolumeTestJSON-1774410022-project-member] Got 1 possible topologies {{(pid=85141) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 10:11:00 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-5fbcf7f0-a47f-465d-b445-cd3b21c9cf8e tempest-AttachSCSIVolumeTestJSON-1774410022 tempest-AttachSCSIVolumeTestJSON-1774410022-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 10:11:00 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-5fbcf7f0-a47f-465d-b445-cd3b21c9cf8e tempest-AttachSCSIVolumeTestJSON-1774410022 tempest-AttachSCSIVolumeTestJSON-1774410022-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 10:11:00 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-5fbcf7f0-a47f-465d-b445-cd3b21c9cf8e tempest-AttachSCSIVolumeTestJSON-1774410022 tempest-AttachSCSIVolumeTestJSON-1774410022-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T10:10:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1772339303',display_name='tempest-AttachSCSIVolumeTestJSON-server-1772339303',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1772339303',id=7,image_ref='164bf389-5fc3-484a-8449-60bd5a23b06e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDMln6WwOuenH5UifdUEyDzooJXlOJ/uEE/ZLrkfrx8/kYuR0jY8HjvZ8O1Pj9ApEpSzzaNVUsr/9g4vs2TFOuaJeS/8kk/H4NFEMB3BhmxqR9RQoVOLnyrk04Jh+7JdMA==',key_name='tempest-keypair-101610908',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eb4a953734f44d049877b7658cae923c',ramdisk_id='',reservation_id='r-q4qhnvrx',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='164bf389-5fc3-484a-8449-60bd5a23b06e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1774410022',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1774410022-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T10:10:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5604acaea0e24287869ede44b6df80e1',uuid=ff964caf-b473-47bc-89d2-f7189264721c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "75922f14-4d10-428a-baf5-bc27dfa373a6", "address": "fa:16:3e:3f:0d:5b", "network": {"id": "19e4c869-308d-4f73-99a4-653683c91209", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-208861710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb4a953734f44d049877b7658cae923c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75922f14-4d", "ovs_interfaceid": "75922f14-4d10-428a-baf5-bc27dfa373a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=85141) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 10:11:00 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-5fbcf7f0-a47f-465d-b445-cd3b21c9cf8e tempest-AttachSCSIVolumeTestJSON-1774410022 tempest-AttachSCSIVolumeTestJSON-1774410022-project-member] Converting VIF {"id": "75922f14-4d10-428a-baf5-bc27dfa373a6", "address": "fa:16:3e:3f:0d:5b", "network": {"id": "19e4c869-308d-4f73-99a4-653683c91209", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-208861710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb4a953734f44d049877b7658cae923c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75922f14-4d", "ovs_interfaceid": "75922f14-4d10-428a-baf5-bc27dfa373a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:11:00 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-5fbcf7f0-a47f-465d-b445-cd3b21c9cf8e tempest-AttachSCSIVolumeTestJSON-1774410022 tempest-AttachSCSIVolumeTestJSON-1774410022-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3f:0d:5b,bridge_name='br-int',has_traffic_filtering=True,id=75922f14-4d10-428a-baf5-bc27dfa373a6,network=Network(19e4c869-308d-4f73-99a4-653683c91209),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75922f14-4d') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:11:00 user nova-compute[85141]: DEBUG nova.objects.instance [None req-5fbcf7f0-a47f-465d-b445-cd3b21c9cf8e tempest-AttachSCSIVolumeTestJSON-1774410022 tempest-AttachSCSIVolumeTestJSON-1774410022-project-member] Lazy-loading 'pci_devices' on Instance uuid ff964caf-b473-47bc-89d2-f7189264721c {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:11:00 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-77454959-aa5e-4ea4-a4b2-40594749ed82 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] No BDM found with device name vda, not building metadata. {{(pid=85141) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 10:11:00 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-77454959-aa5e-4ea4-a4b2-40594749ed82 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] No BDM found with device name hda, not building metadata. {{(pid=85141) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 10:11:00 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-77454959-aa5e-4ea4-a4b2-40594749ed82 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] No VIF found with MAC fa:16:3e:12:0a:da, not building metadata {{(pid=85141) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 10:11:00 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-77454959-aa5e-4ea4-a4b2-40594749ed82 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] [instance: 0ca61bd2-268e-4c49-ba04-a5cb39143a9b] Using config drive
Nov 16 10:11:00 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-5fbcf7f0-a47f-465d-b445-cd3b21c9cf8e tempest-AttachSCSIVolumeTestJSON-1774410022 tempest-AttachSCSIVolumeTestJSON-1774410022-project-member] [instance: ff964caf-b473-47bc-89d2-f7189264721c] End _get_guest_xml xml=<domain type="kvm">
Nov 16 10:11:00 user nova-compute[85141]:   <uuid>ff964caf-b473-47bc-89d2-f7189264721c</uuid>
Nov 16 10:11:00 user nova-compute[85141]:   <name>instance-00000007</name>
Nov 16 10:11:00 user nova-compute[85141]:   <memory>524288</memory>
Nov 16 10:11:00 user nova-compute[85141]:   <vcpu>1</vcpu>
Nov 16 10:11:00 user nova-compute[85141]:   <metadata>
Nov 16 10:11:00 user nova-compute[85141]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 10:11:00 user nova-compute[85141]:       <nova:package version="0.0.0"/>
Nov 16 10:11:00 user nova-compute[85141]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-1772339303</nova:name>
Nov 16 10:11:00 user nova-compute[85141]:       <nova:creationTime>2023-11-16 10:11:00</nova:creationTime>
Nov 16 10:11:00 user nova-compute[85141]:       <nova:flavor name="m1.tiny">
Nov 16 10:11:00 user nova-compute[85141]:         <nova:memory>512</nova:memory>
Nov 16 10:11:00 user nova-compute[85141]:         <nova:disk>1</nova:disk>
Nov 16 10:11:00 user nova-compute[85141]:         <nova:swap>0</nova:swap>
Nov 16 10:11:00 user nova-compute[85141]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 10:11:00 user nova-compute[85141]:         <nova:vcpus>1</nova:vcpus>
Nov 16 10:11:00 user nova-compute[85141]:       </nova:flavor>
Nov 16 10:11:00 user nova-compute[85141]:       <nova:owner>
Nov 16 10:11:00 user nova-compute[85141]:         <nova:user uuid="5604acaea0e24287869ede44b6df80e1">tempest-AttachSCSIVolumeTestJSON-1774410022-project-member</nova:user>
Nov 16 10:11:00 user nova-compute[85141]:         <nova:project uuid="eb4a953734f44d049877b7658cae923c">tempest-AttachSCSIVolumeTestJSON-1774410022</nova:project>
Nov 16 10:11:00 user nova-compute[85141]:       </nova:owner>
Nov 16 10:11:00 user nova-compute[85141]:       <nova:root type="image" uuid="164bf389-5fc3-484a-8449-60bd5a23b06e"/>
Nov 16 10:11:00 user nova-compute[85141]:       <nova:ports>
Nov 16 10:11:00 user nova-compute[85141]:         <nova:port uuid="75922f14-4d10-428a-baf5-bc27dfa373a6">
Nov 16 10:11:00 user nova-compute[85141]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 16 10:11:00 user nova-compute[85141]:         </nova:port>
Nov 16 10:11:00 user nova-compute[85141]:       </nova:ports>
Nov 16 10:11:00 user nova-compute[85141]:     </nova:instance>
Nov 16 10:11:00 user nova-compute[85141]:   </metadata>
Nov 16 10:11:00 user nova-compute[85141]:   <sysinfo type="smbios">
Nov 16 10:11:00 user nova-compute[85141]:     <system>
Nov 16 10:11:00 user nova-compute[85141]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 10:11:00 user nova-compute[85141]:       <entry name="product">OpenStack Nova</entry>
Nov 16 10:11:00 user nova-compute[85141]:       <entry name="version">0.0.0</entry>
Nov 16 10:11:00 user nova-compute[85141]:       <entry name="serial">ff964caf-b473-47bc-89d2-f7189264721c</entry>
Nov 16 10:11:00 user nova-compute[85141]:       <entry name="uuid">ff964caf-b473-47bc-89d2-f7189264721c</entry>
Nov 16 10:11:00 user nova-compute[85141]:       <entry name="family">Virtual Machine</entry>
Nov 16 10:11:00 user nova-compute[85141]:     </system>
Nov 16 10:11:00 user nova-compute[85141]:   </sysinfo>
Nov 16 10:11:00 user nova-compute[85141]:   <os>
Nov 16 10:11:00 user nova-compute[85141]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 10:11:00 user nova-compute[85141]:     <boot dev="hd"/>
Nov 16 10:11:00 user nova-compute[85141]:     <smbios mode="sysinfo"/>
Nov 16 10:11:00 user nova-compute[85141]:   </os>
Nov 16 10:11:00 user nova-compute[85141]:   <features>
Nov 16 10:11:00 user nova-compute[85141]:     <acpi/>
Nov 16 10:11:00 user nova-compute[85141]:     <apic/>
Nov 16 10:11:00 user nova-compute[85141]:     <vmcoreinfo/>
Nov 16 10:11:00 user nova-compute[85141]:   </features>
Nov 16 10:11:00 user nova-compute[85141]:   <clock offset="utc">
Nov 16 10:11:00 user nova-compute[85141]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 10:11:00 user nova-compute[85141]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 10:11:00 user nova-compute[85141]:     <timer name="hpet" present="no"/>
Nov 16 10:11:00 user nova-compute[85141]:   </clock>
Nov 16 10:11:00 user nova-compute[85141]:   <cpu mode="custom" match="exact">
Nov 16 10:11:00 user nova-compute[85141]:     <model>Nehalem</model>
Nov 16 10:11:00 user nova-compute[85141]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 10:11:00 user nova-compute[85141]:   </cpu>
Nov 16 10:11:00 user nova-compute[85141]:   <devices>
Nov 16 10:11:00 user nova-compute[85141]:     <disk type="file" device="disk">
Nov 16 10:11:00 user nova-compute[85141]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 10:11:00 user nova-compute[85141]:       <source file="/opt/stack/data/nova/instances/ff964caf-b473-47bc-89d2-f7189264721c/disk"/>
Nov 16 10:11:00 user nova-compute[85141]:       <target dev="sda" bus="scsi"/>
Nov 16 10:11:00 user nova-compute[85141]:       <address type="drive" controller="0" unit="0"/>
Nov 16 10:11:00 user nova-compute[85141]:     </disk>
Nov 16 10:11:00 user nova-compute[85141]:     <disk type="file" device="cdrom">
Nov 16 10:11:00 user nova-compute[85141]:       <driver name="qemu" type="raw" cache="none"/>
Nov 16 10:11:00 user nova-compute[85141]:       <source file="/opt/stack/data/nova/instances/ff964caf-b473-47bc-89d2-f7189264721c/disk.config"/>
Nov 16 10:11:00 user nova-compute[85141]:       <target dev="sdb" bus="scsi"/>
Nov 16 10:11:00 user nova-compute[85141]:       <address type="drive" controller="0" unit="1"/>
Nov 16 10:11:00 user nova-compute[85141]:     </disk>
Nov 16 10:11:00 user nova-compute[85141]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Nov 16 10:11:00 user nova-compute[85141]:     <interface type="ethernet">
Nov 16 10:11:00 user nova-compute[85141]:       <mac address="fa:16:3e:3f:0d:5b"/>
Nov 16 10:11:00 user nova-compute[85141]:       <model type="virtio"/>
Nov 16 10:11:00 user nova-compute[85141]:       <mtu size="1442"/>
Nov 16 10:11:00 user nova-compute[85141]:       <target dev="tap75922f14-4d"/>
Nov 16 10:11:00 user nova-compute[85141]:     </interface>
Nov 16 10:11:00 user nova-compute[85141]:     <serial type="pty">
Nov 16 10:11:00 user nova-compute[85141]:       <log file="/opt/stack/data/nova/instances/ff964caf-b473-47bc-89d2-f7189264721c/console.log" append="off"/>
Nov 16 10:11:00 user nova-compute[85141]:     </serial>
Nov 16 10:11:00 user nova-compute[85141]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 10:11:00 user nova-compute[85141]:     <video>
Nov 16 10:11:00 user nova-compute[85141]:       <model type="virtio"/>
Nov 16 10:11:00 user nova-compute[85141]:     </video>
Nov 16 10:11:00 user nova-compute[85141]:     <rng model="virtio">
Nov 16 10:11:00 user nova-compute[85141]:       <backend model="random">/dev/urandom</backend>
Nov 16 10:11:00 user nova-compute[85141]:     </rng>
Nov 16 10:11:00 user nova-compute[85141]:     <controller type="usb" index="0" model="none"/>
Nov 16 10:11:00 user nova-compute[85141]:     <memballoon model="virtio">
Nov 16 10:11:00 user nova-compute[85141]:       <stats period="10"/>
Nov 16 10:11:00 user nova-compute[85141]:     </memballoon>
Nov 16 10:11:00 user nova-compute[85141]:   </devices>
Nov 16 10:11:00 user nova-compute[85141]: </domain>
Nov 16 10:11:00 user nova-compute[85141]:  {{(pid=85141) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 10:11:01 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-5fbcf7f0-a47f-465d-b445-cd3b21c9cf8e tempest-AttachSCSIVolumeTestJSON-1774410022 tempest-AttachSCSIVolumeTestJSON-1774410022-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T10:10:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1772339303',display_name='tempest-AttachSCSIVolumeTestJSON-server-1772339303',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1772339303',id=7,image_ref='164bf389-5fc3-484a-8449-60bd5a23b06e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDMln6WwOuenH5UifdUEyDzooJXlOJ/uEE/ZLrkfrx8/kYuR0jY8HjvZ8O1Pj9ApEpSzzaNVUsr/9g4vs2TFOuaJeS/8kk/H4NFEMB3BhmxqR9RQoVOLnyrk04Jh+7JdMA==',key_name='tempest-keypair-101610908',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eb4a953734f44d049877b7658cae923c',ramdisk_id='',reservation_id='r-q4qhnvrx',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='164bf389-5fc3-484a-8449-60bd5a23b06e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1774410022',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1774410022-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T10:10:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5604acaea0e24287869ede44b6df80e1',uuid=ff964caf-b473-47bc-89d2-f7189264721c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "75922f14-4d10-428a-baf5-bc27dfa373a6", "address": "fa:16:3e:3f:0d:5b", "network": {"id": "19e4c869-308d-4f73-99a4-653683c91209", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-208861710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb4a953734f44d049877b7658cae923c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75922f14-4d", "ovs_interfaceid": "75922f14-4d10-428a-baf5-bc27dfa373a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 10:11:01 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-5fbcf7f0-a47f-465d-b445-cd3b21c9cf8e tempest-AttachSCSIVolumeTestJSON-1774410022 tempest-AttachSCSIVolumeTestJSON-1774410022-project-member] Converting VIF {"id": "75922f14-4d10-428a-baf5-bc27dfa373a6", "address": "fa:16:3e:3f:0d:5b", "network": {"id": "19e4c869-308d-4f73-99a4-653683c91209", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-208861710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb4a953734f44d049877b7658cae923c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75922f14-4d", "ovs_interfaceid": "75922f14-4d10-428a-baf5-bc27dfa373a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:11:01 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-5fbcf7f0-a47f-465d-b445-cd3b21c9cf8e tempest-AttachSCSIVolumeTestJSON-1774410022 tempest-AttachSCSIVolumeTestJSON-1774410022-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3f:0d:5b,bridge_name='br-int',has_traffic_filtering=True,id=75922f14-4d10-428a-baf5-bc27dfa373a6,network=Network(19e4c869-308d-4f73-99a4-653683c91209),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75922f14-4d') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:11:01 user nova-compute[85141]: DEBUG os_vif [None req-5fbcf7f0-a47f-465d-b445-cd3b21c9cf8e tempest-AttachSCSIVolumeTestJSON-1774410022 tempest-AttachSCSIVolumeTestJSON-1774410022-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:0d:5b,bridge_name='br-int',has_traffic_filtering=True,id=75922f14-4d10-428a-baf5-bc27dfa373a6,network=Network(19e4c869-308d-4f73-99a4-653683c91209),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75922f14-4d') {{(pid=85141) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 10:11:01 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:11:01 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:11:01 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 10:11:01 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:11:01 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '10651467-45aa-5c0e-8823-6e4b57a94b72', '_type': 'linux-noop'}}, row=False) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:11:01 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:11:01 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:11:01 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:11:01 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:11:01 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap75922f14-4d, may_exist=True, interface_attrs={}) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:11:01 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap75922f14-4d, col_values=(('qos', UUID('ac795020-ccbf-46ab-a8e5-ce47f3a38649')),), if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:11:01 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap75922f14-4d, col_values=(('external_ids', {'iface-id': '75922f14-4d10-428a-baf5-bc27dfa373a6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3f:0d:5b', 'vm-uuid': 'ff964caf-b473-47bc-89d2-f7189264721c'}),), if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:11:01 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:11:01 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:11:01 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:11:01 user nova-compute[85141]: INFO os_vif [None req-5fbcf7f0-a47f-465d-b445-cd3b21c9cf8e tempest-AttachSCSIVolumeTestJSON-1774410022 tempest-AttachSCSIVolumeTestJSON-1774410022-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:0d:5b,bridge_name='br-int',has_traffic_filtering=True,id=75922f14-4d10-428a-baf5-bc27dfa373a6,network=Network(19e4c869-308d-4f73-99a4-653683c91209),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75922f14-4d')
Nov 16 10:11:01 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-5fbcf7f0-a47f-465d-b445-cd3b21c9cf8e tempest-AttachSCSIVolumeTestJSON-1774410022 tempest-AttachSCSIVolumeTestJSON-1774410022-project-member] No BDM found with device name sda, not building metadata. {{(pid=85141) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 10:11:01 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-5fbcf7f0-a47f-465d-b445-cd3b21c9cf8e tempest-AttachSCSIVolumeTestJSON-1774410022 tempest-AttachSCSIVolumeTestJSON-1774410022-project-member] No BDM found with device name sdb, not building metadata. {{(pid=85141) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 10:11:01 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-5fbcf7f0-a47f-465d-b445-cd3b21c9cf8e tempest-AttachSCSIVolumeTestJSON-1774410022 tempest-AttachSCSIVolumeTestJSON-1774410022-project-member] No VIF found with MAC fa:16:3e:3f:0d:5b, not building metadata {{(pid=85141) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 10:11:01 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-5fbcf7f0-a47f-465d-b445-cd3b21c9cf8e tempest-AttachSCSIVolumeTestJSON-1774410022 tempest-AttachSCSIVolumeTestJSON-1774410022-project-member] [instance: ff964caf-b473-47bc-89d2-f7189264721c] Using config drive
Nov 16 10:11:01 user nova-compute[85141]: DEBUG nova.compute.manager [None req-423d5091-25e9-4945-86b6-f74cc45c840e tempest-TestVolumeSwap-1428287604 tempest-TestVolumeSwap-1428287604-project-member] [instance: ad1ace46-2e8e-42e1-a0f5-2384078fcf09] Instance event wait completed in 0 seconds for  {{(pid=85141) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 10:11:01 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-423d5091-25e9-4945-86b6-f74cc45c840e tempest-TestVolumeSwap-1428287604 tempest-TestVolumeSwap-1428287604-project-member] [instance: ad1ace46-2e8e-42e1-a0f5-2384078fcf09] Guest created on hypervisor {{(pid=85141) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 10:11:01 user nova-compute[85141]: INFO nova.virt.libvirt.driver [-] [instance: ad1ace46-2e8e-42e1-a0f5-2384078fcf09] Instance spawned successfully.
Nov 16 10:11:01 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-423d5091-25e9-4945-86b6-f74cc45c840e tempest-TestVolumeSwap-1428287604 tempest-TestVolumeSwap-1428287604-project-member] [instance: ad1ace46-2e8e-42e1-a0f5-2384078fcf09] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 10:11:01 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-423d5091-25e9-4945-86b6-f74cc45c840e tempest-TestVolumeSwap-1428287604 tempest-TestVolumeSwap-1428287604-project-member] [instance: ad1ace46-2e8e-42e1-a0f5-2384078fcf09] Found default for hw_cdrom_bus of ide {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:11:01 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-423d5091-25e9-4945-86b6-f74cc45c840e tempest-TestVolumeSwap-1428287604 tempest-TestVolumeSwap-1428287604-project-member] [instance: ad1ace46-2e8e-42e1-a0f5-2384078fcf09] Found default for hw_disk_bus of virtio {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:11:01 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-423d5091-25e9-4945-86b6-f74cc45c840e tempest-TestVolumeSwap-1428287604 tempest-TestVolumeSwap-1428287604-project-member] [instance: ad1ace46-2e8e-42e1-a0f5-2384078fcf09] Found default for hw_input_bus of None {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:11:01 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-423d5091-25e9-4945-86b6-f74cc45c840e tempest-TestVolumeSwap-1428287604 tempest-TestVolumeSwap-1428287604-project-member] [instance: ad1ace46-2e8e-42e1-a0f5-2384078fcf09] Found default for hw_pointer_model of None {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:11:01 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-423d5091-25e9-4945-86b6-f74cc45c840e tempest-TestVolumeSwap-1428287604 tempest-TestVolumeSwap-1428287604-project-member] [instance: ad1ace46-2e8e-42e1-a0f5-2384078fcf09] Found default for hw_video_model of virtio {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:11:01 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-423d5091-25e9-4945-86b6-f74cc45c840e tempest-TestVolumeSwap-1428287604 tempest-TestVolumeSwap-1428287604-project-member] [instance: ad1ace46-2e8e-42e1-a0f5-2384078fcf09] Found default for hw_vif_model of virtio {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:11:01 user nova-compute[85141]: INFO nova.compute.manager [None req-423d5091-25e9-4945-86b6-f74cc45c840e tempest-TestVolumeSwap-1428287604 tempest-TestVolumeSwap-1428287604-project-member] [instance: ad1ace46-2e8e-42e1-a0f5-2384078fcf09] Took 8.78 seconds to spawn the instance on the hypervisor.
Nov 16 10:11:01 user nova-compute[85141]: DEBUG nova.compute.manager [None req-423d5091-25e9-4945-86b6-f74cc45c840e tempest-TestVolumeSwap-1428287604 tempest-TestVolumeSwap-1428287604-project-member] [instance: ad1ace46-2e8e-42e1-a0f5-2384078fcf09] Checking state {{(pid=85141) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 10:11:01 user nova-compute[85141]: INFO nova.compute.manager [None req-423d5091-25e9-4945-86b6-f74cc45c840e tempest-TestVolumeSwap-1428287604 tempest-TestVolumeSwap-1428287604-project-member] [instance: ad1ace46-2e8e-42e1-a0f5-2384078fcf09] Took 10.62 seconds to build instance.
Nov 16 10:11:01 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-423d5091-25e9-4945-86b6-f74cc45c840e tempest-TestVolumeSwap-1428287604 tempest-TestVolumeSwap-1428287604-project-member] Lock "ad1ace46-2e8e-42e1-a0f5-2384078fcf09" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.845s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:11:01 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:11:01 user nova-compute[85141]: DEBUG nova.compute.manager [req-136f49f8-7312-4430-a7fc-0e0b4cc0a000 req-0c65b6e6-a0a4-4e1b-910b-99d21b31eaf1 service nova] [instance: 0ca61bd2-268e-4c49-ba04-a5cb39143a9b] Received event network-changed-56375501-2a9c-4821-8446-31156fc0f231 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:11:01 user nova-compute[85141]: DEBUG nova.compute.manager [req-136f49f8-7312-4430-a7fc-0e0b4cc0a000 req-0c65b6e6-a0a4-4e1b-910b-99d21b31eaf1 service nova] [instance: 0ca61bd2-268e-4c49-ba04-a5cb39143a9b] Refreshing instance network info cache due to event network-changed-56375501-2a9c-4821-8446-31156fc0f231. {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 10:11:01 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-136f49f8-7312-4430-a7fc-0e0b4cc0a000 req-0c65b6e6-a0a4-4e1b-910b-99d21b31eaf1 service nova] Acquiring lock "refresh_cache-0ca61bd2-268e-4c49-ba04-a5cb39143a9b" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:11:01 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-136f49f8-7312-4430-a7fc-0e0b4cc0a000 req-0c65b6e6-a0a4-4e1b-910b-99d21b31eaf1 service nova] Acquired lock "refresh_cache-0ca61bd2-268e-4c49-ba04-a5cb39143a9b" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:11:01 user nova-compute[85141]: DEBUG nova.network.neutron [req-136f49f8-7312-4430-a7fc-0e0b4cc0a000 req-0c65b6e6-a0a4-4e1b-910b-99d21b31eaf1 service nova] [instance: 0ca61bd2-268e-4c49-ba04-a5cb39143a9b] Refreshing network info cache for port 56375501-2a9c-4821-8446-31156fc0f231 {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 10:11:02 user nova-compute[85141]: DEBUG nova.network.neutron [req-fd258b2b-c7f4-44ae-8477-d979b4836ed4 req-2d6924ea-c3f1-4d4b-8f22-7d81b8ba32a1 service nova] [instance: ff964caf-b473-47bc-89d2-f7189264721c] Updated VIF entry in instance network info cache for port 75922f14-4d10-428a-baf5-bc27dfa373a6. {{(pid=85141) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 10:11:02 user nova-compute[85141]: DEBUG nova.network.neutron [req-fd258b2b-c7f4-44ae-8477-d979b4836ed4 req-2d6924ea-c3f1-4d4b-8f22-7d81b8ba32a1 service nova] [instance: ff964caf-b473-47bc-89d2-f7189264721c] Updating instance_info_cache with network_info: [{"id": "75922f14-4d10-428a-baf5-bc27dfa373a6", "address": "fa:16:3e:3f:0d:5b", "network": {"id": "19e4c869-308d-4f73-99a4-653683c91209", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-208861710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb4a953734f44d049877b7658cae923c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75922f14-4d", "ovs_interfaceid": "75922f14-4d10-428a-baf5-bc27dfa373a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:11:02 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-77454959-aa5e-4ea4-a4b2-40594749ed82 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] [instance: 0ca61bd2-268e-4c49-ba04-a5cb39143a9b] Creating config drive at /opt/stack/data/nova/instances/0ca61bd2-268e-4c49-ba04-a5cb39143a9b/disk.config
Nov 16 10:11:02 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-77454959-aa5e-4ea4-a4b2-40594749ed82 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/0ca61bd2-268e-4c49-ba04-a5cb39143a9b/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp69j45n60 {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:11:02 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-fd258b2b-c7f4-44ae-8477-d979b4836ed4 req-2d6924ea-c3f1-4d4b-8f22-7d81b8ba32a1 service nova] Releasing lock "refresh_cache-ff964caf-b473-47bc-89d2-f7189264721c" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:11:02 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-77454959-aa5e-4ea4-a4b2-40594749ed82 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/0ca61bd2-268e-4c49-ba04-a5cb39143a9b/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp69j45n60" returned: 0 in 0.063s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:11:02 user nova-compute[85141]: DEBUG nova.compute.manager [req-6eb495ba-d2d0-4341-87fd-d57232e8a094 req-e7f3b4ef-3956-482c-af51-a61fa90867ae service nova] [instance: 9411843f-4e79-46c4-ae02-01f5e87b86eb] Received event network-vif-plugged-1202aa6f-6442-4e95-bf51-66f977a23e01 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:11:02 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-6eb495ba-d2d0-4341-87fd-d57232e8a094 req-e7f3b4ef-3956-482c-af51-a61fa90867ae service nova] Acquiring lock "9411843f-4e79-46c4-ae02-01f5e87b86eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:11:02 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-6eb495ba-d2d0-4341-87fd-d57232e8a094 req-e7f3b4ef-3956-482c-af51-a61fa90867ae service nova] Lock "9411843f-4e79-46c4-ae02-01f5e87b86eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:11:02 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-6eb495ba-d2d0-4341-87fd-d57232e8a094 req-e7f3b4ef-3956-482c-af51-a61fa90867ae service nova] Lock "9411843f-4e79-46c4-ae02-01f5e87b86eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:11:02 user nova-compute[85141]: DEBUG nova.compute.manager [req-6eb495ba-d2d0-4341-87fd-d57232e8a094 req-e7f3b4ef-3956-482c-af51-a61fa90867ae service nova] [instance: 9411843f-4e79-46c4-ae02-01f5e87b86eb] No waiting events found dispatching network-vif-plugged-1202aa6f-6442-4e95-bf51-66f977a23e01 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:11:02 user nova-compute[85141]: WARNING nova.compute.manager [req-6eb495ba-d2d0-4341-87fd-d57232e8a094 req-e7f3b4ef-3956-482c-af51-a61fa90867ae service nova] [instance: 9411843f-4e79-46c4-ae02-01f5e87b86eb] Received unexpected event network-vif-plugged-1202aa6f-6442-4e95-bf51-66f977a23e01 for instance with vm_state active and task_state None.
Nov 16 10:11:02 user nova-compute[85141]: DEBUG nova.compute.manager [req-6eb495ba-d2d0-4341-87fd-d57232e8a094 req-e7f3b4ef-3956-482c-af51-a61fa90867ae service nova] [instance: d842f90e-663b-4c95-9d7c-d092d2bac41f] Received event network-vif-plugged-6ce8849e-50a1-4b8a-bf75-1016ef3c2315 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:11:02 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-6eb495ba-d2d0-4341-87fd-d57232e8a094 req-e7f3b4ef-3956-482c-af51-a61fa90867ae service nova] Acquiring lock "d842f90e-663b-4c95-9d7c-d092d2bac41f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:11:02 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-6eb495ba-d2d0-4341-87fd-d57232e8a094 req-e7f3b4ef-3956-482c-af51-a61fa90867ae service nova] Lock "d842f90e-663b-4c95-9d7c-d092d2bac41f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:11:02 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-6eb495ba-d2d0-4341-87fd-d57232e8a094 req-e7f3b4ef-3956-482c-af51-a61fa90867ae service nova] Lock "d842f90e-663b-4c95-9d7c-d092d2bac41f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:11:02 user nova-compute[85141]: DEBUG nova.compute.manager [req-6eb495ba-d2d0-4341-87fd-d57232e8a094 req-e7f3b4ef-3956-482c-af51-a61fa90867ae service nova] [instance: d842f90e-663b-4c95-9d7c-d092d2bac41f] No waiting events found dispatching network-vif-plugged-6ce8849e-50a1-4b8a-bf75-1016ef3c2315 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:11:02 user nova-compute[85141]: WARNING nova.compute.manager [req-6eb495ba-d2d0-4341-87fd-d57232e8a094 req-e7f3b4ef-3956-482c-af51-a61fa90867ae service nova] [instance: d842f90e-663b-4c95-9d7c-d092d2bac41f] Received unexpected event network-vif-plugged-6ce8849e-50a1-4b8a-bf75-1016ef3c2315 for instance with vm_state active and task_state None.
Nov 16 10:11:02 user nova-compute[85141]: DEBUG nova.compute.manager [req-6eb495ba-d2d0-4341-87fd-d57232e8a094 req-e7f3b4ef-3956-482c-af51-a61fa90867ae service nova] [instance: d842f90e-663b-4c95-9d7c-d092d2bac41f] Received event network-vif-plugged-6ce8849e-50a1-4b8a-bf75-1016ef3c2315 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:11:02 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-6eb495ba-d2d0-4341-87fd-d57232e8a094 req-e7f3b4ef-3956-482c-af51-a61fa90867ae service nova] Acquiring lock "d842f90e-663b-4c95-9d7c-d092d2bac41f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:11:02 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-6eb495ba-d2d0-4341-87fd-d57232e8a094 req-e7f3b4ef-3956-482c-af51-a61fa90867ae service nova] Lock "d842f90e-663b-4c95-9d7c-d092d2bac41f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:11:02 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-6eb495ba-d2d0-4341-87fd-d57232e8a094 req-e7f3b4ef-3956-482c-af51-a61fa90867ae service nova] Lock "d842f90e-663b-4c95-9d7c-d092d2bac41f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:11:02 user nova-compute[85141]: DEBUG nova.compute.manager [req-6eb495ba-d2d0-4341-87fd-d57232e8a094 req-e7f3b4ef-3956-482c-af51-a61fa90867ae service nova] [instance: d842f90e-663b-4c95-9d7c-d092d2bac41f] No waiting events found dispatching network-vif-plugged-6ce8849e-50a1-4b8a-bf75-1016ef3c2315 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:11:02 user nova-compute[85141]: WARNING nova.compute.manager [req-6eb495ba-d2d0-4341-87fd-d57232e8a094 req-e7f3b4ef-3956-482c-af51-a61fa90867ae service nova] [instance: d842f90e-663b-4c95-9d7c-d092d2bac41f] Received unexpected event network-vif-plugged-6ce8849e-50a1-4b8a-bf75-1016ef3c2315 for instance with vm_state active and task_state None.
Nov 16 10:11:02 user nova-compute[85141]: DEBUG nova.compute.manager [req-6eb495ba-d2d0-4341-87fd-d57232e8a094 req-e7f3b4ef-3956-482c-af51-a61fa90867ae service nova] [instance: 361a2044-8fd0-4975-8a19-814bf7a6da41] Received event network-vif-plugged-dd85b227-3f3d-4f02-a323-661af6a9dc92 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:11:02 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-6eb495ba-d2d0-4341-87fd-d57232e8a094 req-e7f3b4ef-3956-482c-af51-a61fa90867ae service nova] Acquiring lock "361a2044-8fd0-4975-8a19-814bf7a6da41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:11:02 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-6eb495ba-d2d0-4341-87fd-d57232e8a094 req-e7f3b4ef-3956-482c-af51-a61fa90867ae service nova] Lock "361a2044-8fd0-4975-8a19-814bf7a6da41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:11:02 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-6eb495ba-d2d0-4341-87fd-d57232e8a094 req-e7f3b4ef-3956-482c-af51-a61fa90867ae service nova] Lock "361a2044-8fd0-4975-8a19-814bf7a6da41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:11:02 user nova-compute[85141]: DEBUG nova.compute.manager [req-6eb495ba-d2d0-4341-87fd-d57232e8a094 req-e7f3b4ef-3956-482c-af51-a61fa90867ae service nova] [instance: 361a2044-8fd0-4975-8a19-814bf7a6da41] No waiting events found dispatching network-vif-plugged-dd85b227-3f3d-4f02-a323-661af6a9dc92 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:11:02 user nova-compute[85141]: WARNING nova.compute.manager [req-6eb495ba-d2d0-4341-87fd-d57232e8a094 req-e7f3b4ef-3956-482c-af51-a61fa90867ae service nova] [instance: 361a2044-8fd0-4975-8a19-814bf7a6da41] Received unexpected event network-vif-plugged-dd85b227-3f3d-4f02-a323-661af6a9dc92 for instance with vm_state active and task_state None.
Nov 16 10:11:02 user nova-compute[85141]: DEBUG nova.compute.manager [req-6eb495ba-d2d0-4341-87fd-d57232e8a094 req-e7f3b4ef-3956-482c-af51-a61fa90867ae service nova] [instance: 361a2044-8fd0-4975-8a19-814bf7a6da41] Received event network-vif-plugged-dd85b227-3f3d-4f02-a323-661af6a9dc92 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:11:02 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-6eb495ba-d2d0-4341-87fd-d57232e8a094 req-e7f3b4ef-3956-482c-af51-a61fa90867ae service nova] Acquiring lock "361a2044-8fd0-4975-8a19-814bf7a6da41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:11:02 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-6eb495ba-d2d0-4341-87fd-d57232e8a094 req-e7f3b4ef-3956-482c-af51-a61fa90867ae service nova] Lock "361a2044-8fd0-4975-8a19-814bf7a6da41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:11:02 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-6eb495ba-d2d0-4341-87fd-d57232e8a094 req-e7f3b4ef-3956-482c-af51-a61fa90867ae service nova] Lock "361a2044-8fd0-4975-8a19-814bf7a6da41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:11:02 user nova-compute[85141]: DEBUG nova.compute.manager [req-6eb495ba-d2d0-4341-87fd-d57232e8a094 req-e7f3b4ef-3956-482c-af51-a61fa90867ae service nova] [instance: 361a2044-8fd0-4975-8a19-814bf7a6da41] No waiting events found dispatching network-vif-plugged-dd85b227-3f3d-4f02-a323-661af6a9dc92 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:11:02 user nova-compute[85141]: WARNING nova.compute.manager [req-6eb495ba-d2d0-4341-87fd-d57232e8a094 req-e7f3b4ef-3956-482c-af51-a61fa90867ae service nova] [instance: 361a2044-8fd0-4975-8a19-814bf7a6da41] Received unexpected event network-vif-plugged-dd85b227-3f3d-4f02-a323-661af6a9dc92 for instance with vm_state active and task_state None.
Nov 16 10:11:03 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-5fbcf7f0-a47f-465d-b445-cd3b21c9cf8e tempest-AttachSCSIVolumeTestJSON-1774410022 tempest-AttachSCSIVolumeTestJSON-1774410022-project-member] [instance: ff964caf-b473-47bc-89d2-f7189264721c] Creating config drive at /opt/stack/data/nova/instances/ff964caf-b473-47bc-89d2-f7189264721c/disk.config
Nov 16 10:11:03 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbcf7f0-a47f-465d-b445-cd3b21c9cf8e tempest-AttachSCSIVolumeTestJSON-1774410022 tempest-AttachSCSIVolumeTestJSON-1774410022-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/ff964caf-b473-47bc-89d2-f7189264721c/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpi2r5p7se {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:11:03 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbcf7f0-a47f-465d-b445-cd3b21c9cf8e tempest-AttachSCSIVolumeTestJSON-1774410022 tempest-AttachSCSIVolumeTestJSON-1774410022-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/ff964caf-b473-47bc-89d2-f7189264721c/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpi2r5p7se" returned: 0 in 0.070s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:11:03 user nova-compute[85141]: DEBUG nova.network.neutron [req-136f49f8-7312-4430-a7fc-0e0b4cc0a000 req-0c65b6e6-a0a4-4e1b-910b-99d21b31eaf1 service nova] [instance: 0ca61bd2-268e-4c49-ba04-a5cb39143a9b] Updated VIF entry in instance network info cache for port 56375501-2a9c-4821-8446-31156fc0f231. {{(pid=85141) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 10:11:03 user nova-compute[85141]: DEBUG nova.network.neutron [req-136f49f8-7312-4430-a7fc-0e0b4cc0a000 req-0c65b6e6-a0a4-4e1b-910b-99d21b31eaf1 service nova] [instance: 0ca61bd2-268e-4c49-ba04-a5cb39143a9b] Updating instance_info_cache with network_info: [{"id": "56375501-2a9c-4821-8446-31156fc0f231", "address": "fa:16:3e:12:0a:da", "network": {"id": "cd9a5383-79fc-4957-9a8e-30a18ac26969", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1797454995-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9317f5645af406c899fcc5df61362bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56375501-2a", "ovs_interfaceid": "56375501-2a9c-4821-8446-31156fc0f231", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:11:03 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-136f49f8-7312-4430-a7fc-0e0b4cc0a000 req-0c65b6e6-a0a4-4e1b-910b-99d21b31eaf1 service nova] Releasing lock "refresh_cache-0ca61bd2-268e-4c49-ba04-a5cb39143a9b" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:11:03 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:11:04 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:11:04 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:11:04 user nova-compute[85141]: DEBUG nova.compute.manager [req-a452ad1c-3466-47ae-8155-2ed2e54e2dd2 req-53ffa7d5-9e6f-483f-9452-bc2e02a25fb2 service nova] [instance: 0ca61bd2-268e-4c49-ba04-a5cb39143a9b] Received event network-vif-plugged-56375501-2a9c-4821-8446-31156fc0f231 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:11:04 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-a452ad1c-3466-47ae-8155-2ed2e54e2dd2 req-53ffa7d5-9e6f-483f-9452-bc2e02a25fb2 service nova] Acquiring lock "0ca61bd2-268e-4c49-ba04-a5cb39143a9b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:11:04 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-a452ad1c-3466-47ae-8155-2ed2e54e2dd2 req-53ffa7d5-9e6f-483f-9452-bc2e02a25fb2 service nova] Lock "0ca61bd2-268e-4c49-ba04-a5cb39143a9b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:11:04 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-a452ad1c-3466-47ae-8155-2ed2e54e2dd2 req-53ffa7d5-9e6f-483f-9452-bc2e02a25fb2 service nova] Lock "0ca61bd2-268e-4c49-ba04-a5cb39143a9b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:11:04 user nova-compute[85141]: DEBUG nova.compute.manager [req-a452ad1c-3466-47ae-8155-2ed2e54e2dd2 req-53ffa7d5-9e6f-483f-9452-bc2e02a25fb2 service nova] [instance: 0ca61bd2-268e-4c49-ba04-a5cb39143a9b] No waiting events found dispatching network-vif-plugged-56375501-2a9c-4821-8446-31156fc0f231 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:11:04 user nova-compute[85141]: WARNING nova.compute.manager [req-a452ad1c-3466-47ae-8155-2ed2e54e2dd2 req-53ffa7d5-9e6f-483f-9452-bc2e02a25fb2 service nova] [instance: 0ca61bd2-268e-4c49-ba04-a5cb39143a9b] Received unexpected event network-vif-plugged-56375501-2a9c-4821-8446-31156fc0f231 for instance with vm_state building and task_state spawning.
Nov 16 10:11:04 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:11:04 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:11:04 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:11:04 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:11:04 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:11:04 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:11:04 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:11:05 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-6acf2501-2e40-4328-bd23-587ad59bd8d1 tempest-VolumesAssistedSnapshotsTest-1194404756 tempest-VolumesAssistedSnapshotsTest-1194404756-project-member] Acquiring lock "7e2ae11f-161c-4d13-a1a5-37d0a8150e6b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:11:05 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-6acf2501-2e40-4328-bd23-587ad59bd8d1 tempest-VolumesAssistedSnapshotsTest-1194404756 tempest-VolumesAssistedSnapshotsTest-1194404756-project-member] Lock "7e2ae11f-161c-4d13-a1a5-37d0a8150e6b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:11:05 user nova-compute[85141]: DEBUG nova.compute.manager [None req-6acf2501-2e40-4328-bd23-587ad59bd8d1 tempest-VolumesAssistedSnapshotsTest-1194404756 tempest-VolumesAssistedSnapshotsTest-1194404756-project-member] [instance: 7e2ae11f-161c-4d13-a1a5-37d0a8150e6b] Starting instance... {{(pid=85141) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 10:11:05 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-6acf2501-2e40-4328-bd23-587ad59bd8d1 tempest-VolumesAssistedSnapshotsTest-1194404756 tempest-VolumesAssistedSnapshotsTest-1194404756-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:11:05 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-6acf2501-2e40-4328-bd23-587ad59bd8d1 tempest-VolumesAssistedSnapshotsTest-1194404756 tempest-VolumesAssistedSnapshotsTest-1194404756-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:11:05 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-6acf2501-2e40-4328-bd23-587ad59bd8d1 tempest-VolumesAssistedSnapshotsTest-1194404756 tempest-VolumesAssistedSnapshotsTest-1194404756-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=85141) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 10:11:05 user nova-compute[85141]: INFO nova.compute.claims [None req-6acf2501-2e40-4328-bd23-587ad59bd8d1 tempest-VolumesAssistedSnapshotsTest-1194404756 tempest-VolumesAssistedSnapshotsTest-1194404756-project-member] [instance: 7e2ae11f-161c-4d13-a1a5-37d0a8150e6b] Claim successful on node user
Nov 16 10:11:05 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:11:05 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:11:06 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:11:06 user nova-compute[85141]: DEBUG nova.compute.provider_tree [None req-6acf2501-2e40-4328-bd23-587ad59bd8d1 tempest-VolumesAssistedSnapshotsTest-1194404756 tempest-VolumesAssistedSnapshotsTest-1194404756-project-member] Inventory has not changed in ProviderTree for provider: bf8e0fa1-16b6-408f-9203-c4cd63916272 {{(pid=85141) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 10:11:06 user nova-compute[85141]: DEBUG nova.scheduler.client.report [None req-6acf2501-2e40-4328-bd23-587ad59bd8d1 tempest-VolumesAssistedSnapshotsTest-1194404756 tempest-VolumesAssistedSnapshotsTest-1194404756-project-member] Inventory has not changed for provider bf8e0fa1-16b6-408f-9203-c4cd63916272 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=85141) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 10:11:06 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:11:06 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:11:06 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:11:06 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-6acf2501-2e40-4328-bd23-587ad59bd8d1 tempest-VolumesAssistedSnapshotsTest-1194404756 tempest-VolumesAssistedSnapshotsTest-1194404756-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.197s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:11:06 user nova-compute[85141]: DEBUG nova.compute.manager [None req-6acf2501-2e40-4328-bd23-587ad59bd8d1 tempest-VolumesAssistedSnapshotsTest-1194404756 tempest-VolumesAssistedSnapshotsTest-1194404756-project-member] [instance: 7e2ae11f-161c-4d13-a1a5-37d0a8150e6b] Start building networks asynchronously for instance. {{(pid=85141) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 10:11:06 user nova-compute[85141]: DEBUG nova.compute.manager [req-22492cc1-190e-4712-812c-47567a6c8471 req-5b0006ed-071e-448a-a3b0-d3ec0fbf6d59 service nova] [instance: 0ca61bd2-268e-4c49-ba04-a5cb39143a9b] Received event network-vif-plugged-56375501-2a9c-4821-8446-31156fc0f231 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:11:06 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-22492cc1-190e-4712-812c-47567a6c8471 req-5b0006ed-071e-448a-a3b0-d3ec0fbf6d59 service nova] Acquiring lock "0ca61bd2-268e-4c49-ba04-a5cb39143a9b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:11:06 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-22492cc1-190e-4712-812c-47567a6c8471 req-5b0006ed-071e-448a-a3b0-d3ec0fbf6d59 service nova] Lock "0ca61bd2-268e-4c49-ba04-a5cb39143a9b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:11:06 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-22492cc1-190e-4712-812c-47567a6c8471 req-5b0006ed-071e-448a-a3b0-d3ec0fbf6d59 service nova] Lock "0ca61bd2-268e-4c49-ba04-a5cb39143a9b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:11:06 user nova-compute[85141]: DEBUG nova.compute.manager [req-22492cc1-190e-4712-812c-47567a6c8471 req-5b0006ed-071e-448a-a3b0-d3ec0fbf6d59 service nova] [instance: 0ca61bd2-268e-4c49-ba04-a5cb39143a9b] No waiting events found dispatching network-vif-plugged-56375501-2a9c-4821-8446-31156fc0f231 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:11:06 user nova-compute[85141]: WARNING nova.compute.manager [req-22492cc1-190e-4712-812c-47567a6c8471 req-5b0006ed-071e-448a-a3b0-d3ec0fbf6d59 service nova] [instance: 0ca61bd2-268e-4c49-ba04-a5cb39143a9b] Received unexpected event network-vif-plugged-56375501-2a9c-4821-8446-31156fc0f231 for instance with vm_state building and task_state spawning.
Nov 16 10:11:06 user nova-compute[85141]: DEBUG nova.compute.manager [None req-6acf2501-2e40-4328-bd23-587ad59bd8d1 tempest-VolumesAssistedSnapshotsTest-1194404756 tempest-VolumesAssistedSnapshotsTest-1194404756-project-member] [instance: 7e2ae11f-161c-4d13-a1a5-37d0a8150e6b] Allocating IP information in the background. {{(pid=85141) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 10:11:06 user nova-compute[85141]: DEBUG nova.network.neutron [None req-6acf2501-2e40-4328-bd23-587ad59bd8d1 tempest-VolumesAssistedSnapshotsTest-1194404756 tempest-VolumesAssistedSnapshotsTest-1194404756-project-member] [instance: 7e2ae11f-161c-4d13-a1a5-37d0a8150e6b] allocate_for_instance() {{(pid=85141) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 10:11:06 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-6acf2501-2e40-4328-bd23-587ad59bd8d1 tempest-VolumesAssistedSnapshotsTest-1194404756 tempest-VolumesAssistedSnapshotsTest-1194404756-project-member] [instance: 7e2ae11f-161c-4d13-a1a5-37d0a8150e6b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 10:11:06 user nova-compute[85141]: DEBUG nova.compute.manager [None req-6acf2501-2e40-4328-bd23-587ad59bd8d1 tempest-VolumesAssistedSnapshotsTest-1194404756 tempest-VolumesAssistedSnapshotsTest-1194404756-project-member] [instance: 7e2ae11f-161c-4d13-a1a5-37d0a8150e6b] Start building block device mappings for instance. {{(pid=85141) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 10:11:06 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:11:06 user nova-compute[85141]: DEBUG nova.policy [None req-6acf2501-2e40-4328-bd23-587ad59bd8d1 tempest-VolumesAssistedSnapshotsTest-1194404756 tempest-VolumesAssistedSnapshotsTest-1194404756-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'eae4e8c6a7e442cb907448b29c07befb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2177d3304c7741efb82eca1323f27f92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85141) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 10:11:06 user nova-compute[85141]: DEBUG nova.compute.manager [None req-6acf2501-2e40-4328-bd23-587ad59bd8d1 tempest-VolumesAssistedSnapshotsTest-1194404756 tempest-VolumesAssistedSnapshotsTest-1194404756-project-member] [instance: 7e2ae11f-161c-4d13-a1a5-37d0a8150e6b] Start spawning the instance on the hypervisor. {{(pid=85141) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 10:11:06 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-6acf2501-2e40-4328-bd23-587ad59bd8d1 tempest-VolumesAssistedSnapshotsTest-1194404756 tempest-VolumesAssistedSnapshotsTest-1194404756-project-member] [instance: 7e2ae11f-161c-4d13-a1a5-37d0a8150e6b] Creating instance directory {{(pid=85141) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 10:11:06 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-6acf2501-2e40-4328-bd23-587ad59bd8d1 tempest-VolumesAssistedSnapshotsTest-1194404756 tempest-VolumesAssistedSnapshotsTest-1194404756-project-member] [instance: 7e2ae11f-161c-4d13-a1a5-37d0a8150e6b] Creating image(s)
Nov 16 10:11:06 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-6acf2501-2e40-4328-bd23-587ad59bd8d1 tempest-VolumesAssistedSnapshotsTest-1194404756 tempest-VolumesAssistedSnapshotsTest-1194404756-project-member] Acquiring lock "/opt/stack/data/nova/instances/7e2ae11f-161c-4d13-a1a5-37d0a8150e6b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:11:06 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-6acf2501-2e40-4328-bd23-587ad59bd8d1 tempest-VolumesAssistedSnapshotsTest-1194404756 tempest-VolumesAssistedSnapshotsTest-1194404756-project-member] Lock "/opt/stack/data/nova/instances/7e2ae11f-161c-4d13-a1a5-37d0a8150e6b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:11:06 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-6acf2501-2e40-4328-bd23-587ad59bd8d1 tempest-VolumesAssistedSnapshotsTest-1194404756 tempest-VolumesAssistedSnapshotsTest-1194404756-project-member] Lock "/opt/stack/data/nova/instances/7e2ae11f-161c-4d13-a1a5-37d0a8150e6b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:11:06 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-6acf2501-2e40-4328-bd23-587ad59bd8d1 tempest-VolumesAssistedSnapshotsTest-1194404756 tempest-VolumesAssistedSnapshotsTest-1194404756-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:11:07 user nova-compute[85141]: DEBUG nova.compute.manager [None req-d75ac365-ae12-46bf-bb9b-1ef1096b5aae tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] [instance: 6caf3667-5613-4ef4-a597-1820e6c1c0ac] Start spawning the instance on the hypervisor. {{(pid=85141) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 10:11:07 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-d75ac365-ae12-46bf-bb9b-1ef1096b5aae tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] [instance: 6caf3667-5613-4ef4-a597-1820e6c1c0ac] Creating instance directory {{(pid=85141) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 10:11:07 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-d75ac365-ae12-46bf-bb9b-1ef1096b5aae tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] [instance: 6caf3667-5613-4ef4-a597-1820e6c1c0ac] Creating image(s)
Nov 16 10:11:07 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-d75ac365-ae12-46bf-bb9b-1ef1096b5aae tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] [instance: 6caf3667-5613-4ef4-a597-1820e6c1c0ac] Did not create local disks {{(pid=85141) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 16 10:11:07 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-d75ac365-ae12-46bf-bb9b-1ef1096b5aae tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] [instance: 6caf3667-5613-4ef4-a597-1820e6c1c0ac] Ensure instance console log exists: /opt/stack/data/nova/instances/6caf3667-5613-4ef4-a597-1820e6c1c0ac/console.log {{(pid=85141) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 10:11:07 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-d75ac365-ae12-46bf-bb9b-1ef1096b5aae tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:11:07 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-d75ac365-ae12-46bf-bb9b-1ef1096b5aae tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:11:07 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-d75ac365-ae12-46bf-bb9b-1ef1096b5aae tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:11:07 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-d75ac365-ae12-46bf-bb9b-1ef1096b5aae tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] [instance: 6caf3667-5613-4ef4-a597-1820e6c1c0ac] Start _get_guest_xml network_info=[{"id": "ad2b755f-6905-4256-be59-b64dae993293", "address": "fa:16:3e:fb:7c:00", "network": {"id": "9b5d58ef-109a-4ccb-90e4-a6b18c02f49c", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1619595955-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e017c305665f4a98a75d1d77701b6527", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad2b755f-69", "ovs_interfaceid": "ad2b755f-6905-4256-be59-b64dae993293", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:42c041ec-fa39-4035-b82b-867caf3565df', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CbSKnRJc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '6caf3667-5613-4ef4-a597-1820e6c1c0ac', 'attached_at': '', 'detached_at': '', 'volume_id': '42c041ec-fa39-4035-b82b-867caf3565df', 'serial': '42c041ec-fa39-4035-b82b-867caf3565df'}, 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'attachment_id': 'cbe95117-8868-442d-8bf0-c76403a46a03', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=85141) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 10:11:07 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-d75ac365-ae12-46bf-bb9b-1ef1096b5aae tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:11:07 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-d75ac365-ae12-46bf-bb9b-1ef1096b5aae tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:11:07 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-d75ac365-ae12-46bf-bb9b-1ef1096b5aae tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=85141) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 10:11:07 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-d75ac365-ae12-46bf-bb9b-1ef1096b5aae tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] CPU controller missing on host. {{(pid=85141) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 10:11:07 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-d75ac365-ae12-46bf-bb9b-1ef1096b5aae tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=85141) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 10:11:07 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-d75ac365-ae12-46bf-bb9b-1ef1096b5aae tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] CPU controller found on host. {{(pid=85141) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 10:11:07 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-d75ac365-ae12-46bf-bb9b-1ef1096b5aae tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=85141) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 10:11:07 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-d75ac365-ae12-46bf-bb9b-1ef1096b5aae tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T10:06:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 10:11:07 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-d75ac365-ae12-46bf-bb9b-1ef1096b5aae tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] Flavor limits 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 10:11:07 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-d75ac365-ae12-46bf-bb9b-1ef1096b5aae tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] Image limits 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 10:11:07 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-d75ac365-ae12-46bf-bb9b-1ef1096b5aae tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] Flavor pref 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 10:11:07 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-d75ac365-ae12-46bf-bb9b-1ef1096b5aae tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] Image pref 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 10:11:07 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-d75ac365-ae12-46bf-bb9b-1ef1096b5aae tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 10:11:07 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-d75ac365-ae12-46bf-bb9b-1ef1096b5aae tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 10:11:07 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-d75ac365-ae12-46bf-bb9b-1ef1096b5aae tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=85141) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 10:11:07 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-d75ac365-ae12-46bf-bb9b-1ef1096b5aae tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] Got 1 possible topologies {{(pid=85141) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 10:11:07 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-d75ac365-ae12-46bf-bb9b-1ef1096b5aae tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 10:11:07 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-d75ac365-ae12-46bf-bb9b-1ef1096b5aae tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 10:11:07 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-d75ac365-ae12-46bf-bb9b-1ef1096b5aae tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:11:07 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-d75ac365-ae12-46bf-bb9b-1ef1096b5aae tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:11:07 user nova-compute[85141]: DEBUG os_brick.initiator.connector [None req-d75ac365-ae12-46bf-bb9b-1ef1096b5aae tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] Factory for ISCSI on None {{(pid=85141) factory /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connector.py:281}}
Nov 16 10:11:07 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-d75ac365-ae12-46bf-bb9b-1ef1096b5aae tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.005s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:11:07 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d75ac365-ae12-46bf-bb9b-1ef1096b5aae tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] [instance: 6caf3667-5613-4ef4-a597-1820e6c1c0ac] Calling os-brick to attach iSCSI Volume {{(pid=85141) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 10:11:07 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-d75ac365-ae12-46bf-bb9b-1ef1096b5aae tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51806b6080>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:42c041ec-fa39-4035-b82b-867caf3565df', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CbSKnRJc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 10:11:07 user nova-compute[85141]: WARNING os_brick.initiator.connectors.base [None req-d75ac365-ae12-46bf-bb9b-1ef1096b5aae tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 10:11:07 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-d75ac365-ae12-46bf-bb9b-1ef1096b5aae tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 10:11:07 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-d75ac365-ae12-46bf-bb9b-1ef1096b5aae tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 10:11:07 user nova-compute[85141]: WARNING os_brick.initiator.connectors.base [None req-d75ac365-ae12-46bf-bb9b-1ef1096b5aae tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 10:11:07 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-d75ac365-ae12-46bf-bb9b-1ef1096b5aae tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:42c041ec-fa39-4035-b82b-867caf3565df" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 10:11:07 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-d75ac365-ae12-46bf-bb9b-1ef1096b5aae tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:42c041ec-fa39-4035-b82b-867caf3565df" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 10:11:07 user nova-compute[85141]: INFO os_brick.initiator.connectors.iscsi [None req-d75ac365-ae12-46bf-bb9b-1ef1096b5aae tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 10:11:07 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-6acf2501-2e40-4328-bd23-587ad59bd8d1 tempest-VolumesAssistedSnapshotsTest-1194404756 tempest-VolumesAssistedSnapshotsTest-1194404756-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json" returned: 0 in 0.274s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:11:07 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-6acf2501-2e40-4328-bd23-587ad59bd8d1 tempest-VolumesAssistedSnapshotsTest-1194404756 tempest-VolumesAssistedSnapshotsTest-1194404756-project-member] Acquiring lock "60a78556fb399ed4a41bc3ca4bccf77c96d8e811" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:11:07 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-6acf2501-2e40-4328-bd23-587ad59bd8d1 tempest-VolumesAssistedSnapshotsTest-1194404756 tempest-VolumesAssistedSnapshotsTest-1194404756-project-member] Lock "60a78556fb399ed4a41bc3ca4bccf77c96d8e811" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:11:07 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-6acf2501-2e40-4328-bd23-587ad59bd8d1 tempest-VolumesAssistedSnapshotsTest-1194404756 tempest-VolumesAssistedSnapshotsTest-1194404756-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:11:07 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42c041ec-fa39-4035-b82b-867caf3565df -p 172.16.0.220:3260 {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:11:07 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42c041ec-fa39-4035-b82b-867caf3565df -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:11:07 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[63977a0a-5523-4440-8739-1986b6408351]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:11:07 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-d75ac365-ae12-46bf-bb9b-1ef1096b5aae tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 10:11:07 user nova-compute[85141]:  {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:11:07 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42c041ec-fa39-4035-b82b-867caf3565df -p 172.16.0.220:3260 --interface default --op new {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:11:07 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42c041ec-fa39-4035-b82b-867caf3565df -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:11:07 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce41b680-50c7-44a4-88ae-6a66a796a7e7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:42c041ec-fa39-4035-b82b-867caf3565df] added\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:11:07 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-d75ac365-ae12-46bf-bb9b-1ef1096b5aae tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:42c041ec-fa39-4035-b82b-867caf3565df] added
Nov 16 10:11:07 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:11:07 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42c041ec-fa39-4035-b82b-867caf3565df -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:11:07 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42c041ec-fa39-4035-b82b-867caf3565df -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:11:07 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[715fc0fe-e65d-42cd-825f-b28b875401b6]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:11:07 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-d75ac365-ae12-46bf-bb9b-1ef1096b5aae tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:11:07 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42c041ec-fa39-4035-b82b-867caf3565df -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:11:07 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42c041ec-fa39-4035-b82b-867caf3565df -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:11:07 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd6e3c0c-28fc-4465-95a7-f8fdd9a614a4]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:11:07 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-d75ac365-ae12-46bf-bb9b-1ef1096b5aae tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:11:07 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42c041ec-fa39-4035-b82b-867caf3565df -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CbSKnRJc {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:11:07 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42c041ec-fa39-4035-b82b-867caf3565df -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CbSKnRJc" returned: 0 in 0.018s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:11:07 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[414a8009-f6c1-4a1f-83c0-ca49fbb611d4]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:11:07 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-d75ac365-ae12-46bf-bb9b-1ef1096b5aae tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CbSKnRJc'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:11:07 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42c041ec-fa39-4035-b82b-867caf3565df -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:11:07 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42c041ec-fa39-4035-b82b-867caf3565df -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:11:07 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd52c311-aa93-4cea-a6c8-8df4e2a005e4]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:11:07 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-d75ac365-ae12-46bf-bb9b-1ef1096b5aae tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:11:07 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:11:07 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:11:07 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[371272f4-46c0-4a41-8c4f-abe54e63c846]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:11:07 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-d75ac365-ae12-46bf-bb9b-1ef1096b5aae tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 16 10:11:07 user nova-compute[85141]:  {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:11:07 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-d75ac365-ae12-46bf-bb9b-1ef1096b5aae tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 16 10:11:07 user nova-compute[85141]:  {{(pid=85141) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 10:11:07 user nova-compute[85141]: WARNING os_brick.initiator.connectors.iscsi [None req-d75ac365-ae12-46bf-bb9b-1ef1096b5aae tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 16 10:11:07 user nova-compute[85141]: 
Nov 16 10:11:07 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42c041ec-fa39-4035-b82b-867caf3565df -p 172.16.0.220:3260 --login {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:11:07 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42c041ec-fa39-4035-b82b-867caf3565df -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:11:07 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbd33571-b927-4128-ade5-7a95924cd11e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:42c041ec-fa39-4035-b82b-867caf3565df, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:42c041ec-fa39-4035-b82b-867caf3565df, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:11:07 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-d75ac365-ae12-46bf-bb9b-1ef1096b5aae tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:42c041ec-fa39-4035-b82b-867caf3565df, portal: 172.16.0.220,3260]
Nov 16 10:11:07 user nova-compute[85141]: Login to [iface: default, target: iqn.2010-10.org.openstack:42c041ec-fa39-4035-b82b-867caf3565df, portal: 172.16.0.220,3260] successful.
Nov 16 10:11:07 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:11:07 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42c041ec-fa39-4035-b82b-867caf3565df -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:11:07 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-6acf2501-2e40-4328-bd23-587ad59bd8d1 tempest-VolumesAssistedSnapshotsTest-1194404756 tempest-VolumesAssistedSnapshotsTest-1194404756-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json" returned: 0 in 0.268s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:11:07 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-6acf2501-2e40-4328-bd23-587ad59bd8d1 tempest-VolumesAssistedSnapshotsTest-1194404756 tempest-VolumesAssistedSnapshotsTest-1194404756-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811,backing_fmt=raw /opt/stack/data/nova/instances/7e2ae11f-161c-4d13-a1a5-37d0a8150e6b/disk 1073741824 {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:11:07 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42c041ec-fa39-4035-b82b-867caf3565df -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:11:07 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b24b527-ab63-4fe3-932b-4dcb3604d8c0]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:11:07 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-d75ac365-ae12-46bf-bb9b-1ef1096b5aae tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:11:07 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:11:07 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:11:07 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[114d27cb-130f-4254-8a3d-114a013f6e06]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42c041ec-fa39-4035-b82b-867caf3565df (non-flash)\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:11:07 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-d75ac365-ae12-46bf-bb9b-1ef1096b5aae tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42c041ec-fa39-4035-b82b-867caf3565df (non-flash)
Nov 16 10:11:07 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:11:07 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-d75ac365-ae12-46bf-bb9b-1ef1096b5aae tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42c041ec-fa39-4035-b82b-867caf3565df (non-flash)
Nov 16 10:11:07 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 10:11:07 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-d75ac365-ae12-46bf-bb9b-1ef1096b5aae tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:42c041ec-fa39-4035-b82b-867caf3565df" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.363s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 10:11:07 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-d75ac365-ae12-46bf-bb9b-1ef1096b5aae tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] Connected to 172.16.0.220:3260 {{(pid=85141) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 10:11:07 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-d75ac365-ae12-46bf-bb9b-1ef1096b5aae tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=85141) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 10:11:07 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-d75ac365-ae12-46bf-bb9b-1ef1096b5aae tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=85141) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 10:11:07 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-6acf2501-2e40-4328-bd23-587ad59bd8d1 tempest-VolumesAssistedSnapshotsTest-1194404756 tempest-VolumesAssistedSnapshotsTest-1194404756-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811,backing_fmt=raw /opt/stack/data/nova/instances/7e2ae11f-161c-4d13-a1a5-37d0a8150e6b/disk 1073741824" returned: 0 in 0.095s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:11:07 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-6acf2501-2e40-4328-bd23-587ad59bd8d1 tempest-VolumesAssistedSnapshotsTest-1194404756 tempest-VolumesAssistedSnapshotsTest-1194404756-project-member] Lock "60a78556fb399ed4a41bc3ca4bccf77c96d8e811" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.366s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:11:07 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-6acf2501-2e40-4328-bd23-587ad59bd8d1 tempest-VolumesAssistedSnapshotsTest-1194404756 tempest-VolumesAssistedSnapshotsTest-1194404756-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:11:07 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:11:07 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.028s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:11:07 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6614d6d-ea20-488f-a111-caf4cb2c0d23]: (4, ('- - 0', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:11:07 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-d75ac365-ae12-46bf-bb9b-1ef1096b5aae tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=85141) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 10:11:07 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-d75ac365-ae12-46bf-bb9b-1ef1096b5aae tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:42c041ec-fa39-4035-b82b-867caf3565df', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CbSKnRJc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=85141) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 10:11:07 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-6acf2501-2e40-4328-bd23-587ad59bd8d1 tempest-VolumesAssistedSnapshotsTest-1194404756 tempest-VolumesAssistedSnapshotsTest-1194404756-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json" returned: 0 in 0.219s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:11:07 user nova-compute[85141]: DEBUG nova.virt.disk.api [None req-6acf2501-2e40-4328-bd23-587ad59bd8d1 tempest-VolumesAssistedSnapshotsTest-1194404756 tempest-VolumesAssistedSnapshotsTest-1194404756-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7e2ae11f-161c-4d13-a1a5-37d0a8150e6b/disk. size=1073741824 {{(pid=85141) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 10:11:07 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-6acf2501-2e40-4328-bd23-587ad59bd8d1 tempest-VolumesAssistedSnapshotsTest-1194404756 tempest-VolumesAssistedSnapshotsTest-1194404756-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e2ae11f-161c-4d13-a1a5-37d0a8150e6b/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:11:07 user nova-compute[85141]: DEBUG nova.network.neutron [None req-6acf2501-2e40-4328-bd23-587ad59bd8d1 tempest-VolumesAssistedSnapshotsTest-1194404756 tempest-VolumesAssistedSnapshotsTest-1194404756-project-member] [instance: 7e2ae11f-161c-4d13-a1a5-37d0a8150e6b] Successfully created port: f7b5e797-8f96-4f01-847a-4a5b4f208517 {{(pid=85141) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 10:11:08 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-6acf2501-2e40-4328-bd23-587ad59bd8d1 tempest-VolumesAssistedSnapshotsTest-1194404756 tempest-VolumesAssistedSnapshotsTest-1194404756-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e2ae11f-161c-4d13-a1a5-37d0a8150e6b/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:11:08 user nova-compute[85141]: DEBUG nova.virt.disk.api [None req-6acf2501-2e40-4328-bd23-587ad59bd8d1 tempest-VolumesAssistedSnapshotsTest-1194404756 tempest-VolumesAssistedSnapshotsTest-1194404756-project-member] Cannot resize image /opt/stack/data/nova/instances/7e2ae11f-161c-4d13-a1a5-37d0a8150e6b/disk to a smaller size. {{(pid=85141) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 10:11:08 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-6acf2501-2e40-4328-bd23-587ad59bd8d1 tempest-VolumesAssistedSnapshotsTest-1194404756 tempest-VolumesAssistedSnapshotsTest-1194404756-project-member] [instance: 7e2ae11f-161c-4d13-a1a5-37d0a8150e6b] Created local disks {{(pid=85141) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 10:11:08 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-6acf2501-2e40-4328-bd23-587ad59bd8d1 tempest-VolumesAssistedSnapshotsTest-1194404756 tempest-VolumesAssistedSnapshotsTest-1194404756-project-member] [instance: 7e2ae11f-161c-4d13-a1a5-37d0a8150e6b] Ensure instance console log exists: /opt/stack/data/nova/instances/7e2ae11f-161c-4d13-a1a5-37d0a8150e6b/console.log {{(pid=85141) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 10:11:08 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-6acf2501-2e40-4328-bd23-587ad59bd8d1 tempest-VolumesAssistedSnapshotsTest-1194404756 tempest-VolumesAssistedSnapshotsTest-1194404756-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:11:08 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-6acf2501-2e40-4328-bd23-587ad59bd8d1 tempest-VolumesAssistedSnapshotsTest-1194404756 tempest-VolumesAssistedSnapshotsTest-1194404756-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:11:08 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-6acf2501-2e40-4328-bd23-587ad59bd8d1 tempest-VolumesAssistedSnapshotsTest-1194404756 tempest-VolumesAssistedSnapshotsTest-1194404756-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:11:08 user nova-compute[85141]: DEBUG nova.compute.manager [None req-77454959-aa5e-4ea4-a4b2-40594749ed82 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] [instance: 0ca61bd2-268e-4c49-ba04-a5cb39143a9b] Instance event wait completed in 0 seconds for  {{(pid=85141) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 10:11:08 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-77454959-aa5e-4ea4-a4b2-40594749ed82 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] [instance: 0ca61bd2-268e-4c49-ba04-a5cb39143a9b] Guest created on hypervisor {{(pid=85141) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 10:11:08 user nova-compute[85141]: INFO nova.virt.libvirt.driver [-] [instance: 0ca61bd2-268e-4c49-ba04-a5cb39143a9b] Instance spawned successfully.
Nov 16 10:11:08 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-77454959-aa5e-4ea4-a4b2-40594749ed82 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] [instance: 0ca61bd2-268e-4c49-ba04-a5cb39143a9b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 10:11:08 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-77454959-aa5e-4ea4-a4b2-40594749ed82 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] [instance: 0ca61bd2-268e-4c49-ba04-a5cb39143a9b] Found default for hw_cdrom_bus of ide {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:11:08 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-77454959-aa5e-4ea4-a4b2-40594749ed82 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] [instance: 0ca61bd2-268e-4c49-ba04-a5cb39143a9b] Found default for hw_disk_bus of virtio {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:11:08 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-77454959-aa5e-4ea4-a4b2-40594749ed82 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] [instance: 0ca61bd2-268e-4c49-ba04-a5cb39143a9b] Found default for hw_input_bus of None {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:11:08 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-77454959-aa5e-4ea4-a4b2-40594749ed82 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] [instance: 0ca61bd2-268e-4c49-ba04-a5cb39143a9b] Found default for hw_pointer_model of None {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:11:08 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-77454959-aa5e-4ea4-a4b2-40594749ed82 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] [instance: 0ca61bd2-268e-4c49-ba04-a5cb39143a9b] Found default for hw_video_model of virtio {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:11:08 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-77454959-aa5e-4ea4-a4b2-40594749ed82 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] [instance: 0ca61bd2-268e-4c49-ba04-a5cb39143a9b] Found default for hw_vif_model of virtio {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:11:08 user nova-compute[85141]: INFO nova.compute.manager [None req-77454959-aa5e-4ea4-a4b2-40594749ed82 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] [instance: 0ca61bd2-268e-4c49-ba04-a5cb39143a9b] Took 12.90 seconds to spawn the instance on the hypervisor.
Nov 16 10:11:08 user nova-compute[85141]: DEBUG nova.compute.manager [None req-77454959-aa5e-4ea4-a4b2-40594749ed82 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] [instance: 0ca61bd2-268e-4c49-ba04-a5cb39143a9b] Checking state {{(pid=85141) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 10:11:08 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbcf7f0-a47f-465d-b445-cd3b21c9cf8e tempest-AttachSCSIVolumeTestJSON-1774410022 tempest-AttachSCSIVolumeTestJSON-1774410022-project-member] [instance: ff964caf-b473-47bc-89d2-f7189264721c] Instance event wait completed in 0 seconds for  {{(pid=85141) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 10:11:08 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-5fbcf7f0-a47f-465d-b445-cd3b21c9cf8e tempest-AttachSCSIVolumeTestJSON-1774410022 tempest-AttachSCSIVolumeTestJSON-1774410022-project-member] [instance: ff964caf-b473-47bc-89d2-f7189264721c] Guest created on hypervisor {{(pid=85141) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 10:11:08 user nova-compute[85141]: INFO nova.virt.libvirt.driver [-] [instance: ff964caf-b473-47bc-89d2-f7189264721c] Instance spawned successfully.
Nov 16 10:11:08 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-5fbcf7f0-a47f-465d-b445-cd3b21c9cf8e tempest-AttachSCSIVolumeTestJSON-1774410022 tempest-AttachSCSIVolumeTestJSON-1774410022-project-member] [instance: ff964caf-b473-47bc-89d2-f7189264721c] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 10:11:08 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-5fbcf7f0-a47f-465d-b445-cd3b21c9cf8e tempest-AttachSCSIVolumeTestJSON-1774410022 tempest-AttachSCSIVolumeTestJSON-1774410022-project-member] [instance: ff964caf-b473-47bc-89d2-f7189264721c] Found default for hw_input_bus of None {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:11:08 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-5fbcf7f0-a47f-465d-b445-cd3b21c9cf8e tempest-AttachSCSIVolumeTestJSON-1774410022 tempest-AttachSCSIVolumeTestJSON-1774410022-project-member] [instance: ff964caf-b473-47bc-89d2-f7189264721c] Found default for hw_pointer_model of None {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:11:08 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-5fbcf7f0-a47f-465d-b445-cd3b21c9cf8e tempest-AttachSCSIVolumeTestJSON-1774410022 tempest-AttachSCSIVolumeTestJSON-1774410022-project-member] [instance: ff964caf-b473-47bc-89d2-f7189264721c] Found default for hw_video_model of virtio {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:11:08 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-5fbcf7f0-a47f-465d-b445-cd3b21c9cf8e tempest-AttachSCSIVolumeTestJSON-1774410022 tempest-AttachSCSIVolumeTestJSON-1774410022-project-member] [instance: ff964caf-b473-47bc-89d2-f7189264721c] Found default for hw_vif_model of virtio {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:11:08 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-d75ac365-ae12-46bf-bb9b-1ef1096b5aae tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.440s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 10:11:08 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-d75ac365-ae12-46bf-bb9b-1ef1096b5aae tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] <== connect_volume: return (1442ms) {'type': 'block', 'scsi_wwn': '23334313731353566', 'path': '/dev/sdb'} {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 10:11:08 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d75ac365-ae12-46bf-bb9b-1ef1096b5aae tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] [instance: 6caf3667-5613-4ef4-a597-1820e6c1c0ac] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23334313731353566', 'path': '/dev/sdb'} {{(pid=85141) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 10:11:08 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-d75ac365-ae12-46bf-bb9b-1ef1096b5aae tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T10:10:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1086260035',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1086260035',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPTxuc2pFbo8Kj1fpySyu2hi+5RREMihAI4J3BcHJNw6/EhxEylOLh1w3NMl0ucAMBcFIFr2hryAmkgpSqOT6RfhW0NUWmUq9zKgRAUTsN4Epu8nh4W95o4JP2jn8aOc3w==',key_name='tempest-keypair-731314932',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e017c305665f4a98a75d1d77701b6527',ramdisk_id='',reservation_id='r-4eesetti',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1581977623',owner_user_name='tempest-ServerActionsV293TestJSON-1581977623-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T10:10:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ae4bf3b050ed4cd7901541e9ce1c838f',uuid=6caf3667-5613-4ef4-a597-1820e6c1c0ac,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ad2b755f-6905-4256-be59-b64dae993293", "address": "fa:16:3e:fb:7c:00", "network": {"id": "9b5d58ef-109a-4ccb-90e4-a6b18c02f49c", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1619595955-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e017c305665f4a98a75d1d77701b6527", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad2b755f-69", "ovs_interfaceid": "ad2b755f-6905-4256-be59-b64dae993293", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=85141) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 10:11:08 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-d75ac365-ae12-46bf-bb9b-1ef1096b5aae tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] Converting VIF {"id": "ad2b755f-6905-4256-be59-b64dae993293", "address": "fa:16:3e:fb:7c:00", "network": {"id": "9b5d58ef-109a-4ccb-90e4-a6b18c02f49c", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1619595955-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e017c305665f4a98a75d1d77701b6527", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad2b755f-69", "ovs_interfaceid": "ad2b755f-6905-4256-be59-b64dae993293", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:11:08 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-d75ac365-ae12-46bf-bb9b-1ef1096b5aae tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fb:7c:00,bridge_name='br-int',has_traffic_filtering=True,id=ad2b755f-6905-4256-be59-b64dae993293,network=Network(9b5d58ef-109a-4ccb-90e4-a6b18c02f49c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad2b755f-69') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:11:08 user nova-compute[85141]: DEBUG nova.objects.instance [None req-d75ac365-ae12-46bf-bb9b-1ef1096b5aae tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] Lazy-loading 'pci_devices' on Instance uuid 6caf3667-5613-4ef4-a597-1820e6c1c0ac {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:11:08 user nova-compute[85141]: INFO nova.compute.manager [None req-77454959-aa5e-4ea4-a4b2-40594749ed82 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] [instance: 0ca61bd2-268e-4c49-ba04-a5cb39143a9b] Took 15.55 seconds to build instance.
Nov 16 10:11:08 user nova-compute[85141]: INFO nova.compute.manager [None req-5fbcf7f0-a47f-465d-b445-cd3b21c9cf8e tempest-AttachSCSIVolumeTestJSON-1774410022 tempest-AttachSCSIVolumeTestJSON-1774410022-project-member] [instance: ff964caf-b473-47bc-89d2-f7189264721c] Took 14.99 seconds to spawn the instance on the hypervisor.
Nov 16 10:11:08 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbcf7f0-a47f-465d-b445-cd3b21c9cf8e tempest-AttachSCSIVolumeTestJSON-1774410022 tempest-AttachSCSIVolumeTestJSON-1774410022-project-member] [instance: ff964caf-b473-47bc-89d2-f7189264721c] Checking state {{(pid=85141) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 10:11:08 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-d75ac365-ae12-46bf-bb9b-1ef1096b5aae tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] [instance: 6caf3667-5613-4ef4-a597-1820e6c1c0ac] End _get_guest_xml xml=<domain type="kvm">
Nov 16 10:11:08 user nova-compute[85141]:   <uuid>6caf3667-5613-4ef4-a597-1820e6c1c0ac</uuid>
Nov 16 10:11:08 user nova-compute[85141]:   <name>instance-00000009</name>
Nov 16 10:11:08 user nova-compute[85141]:   <memory>524288</memory>
Nov 16 10:11:08 user nova-compute[85141]:   <vcpu>1</vcpu>
Nov 16 10:11:08 user nova-compute[85141]:   <metadata>
Nov 16 10:11:08 user nova-compute[85141]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 10:11:08 user nova-compute[85141]:       <nova:package version="0.0.0"/>
Nov 16 10:11:08 user nova-compute[85141]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1086260035</nova:name>
Nov 16 10:11:08 user nova-compute[85141]:       <nova:creationTime>2023-11-16 10:11:07</nova:creationTime>
Nov 16 10:11:08 user nova-compute[85141]:       <nova:flavor name="m1.tiny">
Nov 16 10:11:08 user nova-compute[85141]:         <nova:memory>512</nova:memory>
Nov 16 10:11:08 user nova-compute[85141]:         <nova:disk>1</nova:disk>
Nov 16 10:11:08 user nova-compute[85141]:         <nova:swap>0</nova:swap>
Nov 16 10:11:08 user nova-compute[85141]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 10:11:08 user nova-compute[85141]:         <nova:vcpus>1</nova:vcpus>
Nov 16 10:11:08 user nova-compute[85141]:       </nova:flavor>
Nov 16 10:11:08 user nova-compute[85141]:       <nova:owner>
Nov 16 10:11:08 user nova-compute[85141]:         <nova:user uuid="ae4bf3b050ed4cd7901541e9ce1c838f">tempest-ServerActionsV293TestJSON-1581977623-project-member</nova:user>
Nov 16 10:11:08 user nova-compute[85141]:         <nova:project uuid="e017c305665f4a98a75d1d77701b6527">tempest-ServerActionsV293TestJSON-1581977623</nova:project>
Nov 16 10:11:08 user nova-compute[85141]:       </nova:owner>
Nov 16 10:11:08 user nova-compute[85141]:       <nova:ports>
Nov 16 10:11:08 user nova-compute[85141]:         <nova:port uuid="ad2b755f-6905-4256-be59-b64dae993293">
Nov 16 10:11:08 user nova-compute[85141]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 16 10:11:08 user nova-compute[85141]:         </nova:port>
Nov 16 10:11:08 user nova-compute[85141]:       </nova:ports>
Nov 16 10:11:08 user nova-compute[85141]:     </nova:instance>
Nov 16 10:11:08 user nova-compute[85141]:   </metadata>
Nov 16 10:11:08 user nova-compute[85141]:   <sysinfo type="smbios">
Nov 16 10:11:08 user nova-compute[85141]:     <system>
Nov 16 10:11:08 user nova-compute[85141]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 10:11:08 user nova-compute[85141]:       <entry name="product">OpenStack Nova</entry>
Nov 16 10:11:08 user nova-compute[85141]:       <entry name="version">0.0.0</entry>
Nov 16 10:11:08 user nova-compute[85141]:       <entry name="serial">6caf3667-5613-4ef4-a597-1820e6c1c0ac</entry>
Nov 16 10:11:08 user nova-compute[85141]:       <entry name="uuid">6caf3667-5613-4ef4-a597-1820e6c1c0ac</entry>
Nov 16 10:11:08 user nova-compute[85141]:       <entry name="family">Virtual Machine</entry>
Nov 16 10:11:08 user nova-compute[85141]:     </system>
Nov 16 10:11:08 user nova-compute[85141]:   </sysinfo>
Nov 16 10:11:08 user nova-compute[85141]:   <os>
Nov 16 10:11:08 user nova-compute[85141]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 10:11:08 user nova-compute[85141]:     <boot dev="hd"/>
Nov 16 10:11:08 user nova-compute[85141]:     <smbios mode="sysinfo"/>
Nov 16 10:11:08 user nova-compute[85141]:   </os>
Nov 16 10:11:08 user nova-compute[85141]:   <features>
Nov 16 10:11:08 user nova-compute[85141]:     <acpi/>
Nov 16 10:11:08 user nova-compute[85141]:     <apic/>
Nov 16 10:11:08 user nova-compute[85141]:     <vmcoreinfo/>
Nov 16 10:11:08 user nova-compute[85141]:   </features>
Nov 16 10:11:08 user nova-compute[85141]:   <clock offset="utc">
Nov 16 10:11:08 user nova-compute[85141]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 10:11:08 user nova-compute[85141]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 10:11:08 user nova-compute[85141]:     <timer name="hpet" present="no"/>
Nov 16 10:11:08 user nova-compute[85141]:   </clock>
Nov 16 10:11:08 user nova-compute[85141]:   <cpu mode="custom" match="exact">
Nov 16 10:11:08 user nova-compute[85141]:     <model>Nehalem</model>
Nov 16 10:11:08 user nova-compute[85141]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 10:11:08 user nova-compute[85141]:   </cpu>
Nov 16 10:11:08 user nova-compute[85141]:   <devices>
Nov 16 10:11:08 user nova-compute[85141]:     <disk type="block" device="disk">
Nov 16 10:11:08 user nova-compute[85141]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 10:11:08 user nova-compute[85141]:       <source dev="/dev/sdb"/>
Nov 16 10:11:08 user nova-compute[85141]:       <target dev="vda" bus="virtio"/>
Nov 16 10:11:08 user nova-compute[85141]:       <serial>42c041ec-fa39-4035-b82b-867caf3565df</serial>
Nov 16 10:11:08 user nova-compute[85141]:     </disk>
Nov 16 10:11:08 user nova-compute[85141]:     <interface type="ethernet">
Nov 16 10:11:08 user nova-compute[85141]:       <mac address="fa:16:3e:fb:7c:00"/>
Nov 16 10:11:08 user nova-compute[85141]:       <model type="virtio"/>
Nov 16 10:11:08 user nova-compute[85141]:       <mtu size="1442"/>
Nov 16 10:11:08 user nova-compute[85141]:       <target dev="tapad2b755f-69"/>
Nov 16 10:11:08 user nova-compute[85141]:     </interface>
Nov 16 10:11:08 user nova-compute[85141]:     <serial type="pty">
Nov 16 10:11:08 user nova-compute[85141]:       <log file="/opt/stack/data/nova/instances/6caf3667-5613-4ef4-a597-1820e6c1c0ac/console.log" append="off"/>
Nov 16 10:11:08 user nova-compute[85141]:     </serial>
Nov 16 10:11:08 user nova-compute[85141]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 10:11:08 user nova-compute[85141]:     <video>
Nov 16 10:11:08 user nova-compute[85141]:       <model type="virtio"/>
Nov 16 10:11:08 user nova-compute[85141]:     </video>
Nov 16 10:11:08 user nova-compute[85141]:     <rng model="virtio">
Nov 16 10:11:08 user nova-compute[85141]:       <backend model="random">/dev/urandom</backend>
Nov 16 10:11:08 user nova-compute[85141]:     </rng>
Nov 16 10:11:08 user nova-compute[85141]:     <controller type="usb" index="0" model="none"/>
Nov 16 10:11:08 user nova-compute[85141]:     <memballoon model="virtio">
Nov 16 10:11:08 user nova-compute[85141]:       <stats period="10"/>
Nov 16 10:11:08 user nova-compute[85141]:     </memballoon>
Nov 16 10:11:08 user nova-compute[85141]:   </devices>
Nov 16 10:11:08 user nova-compute[85141]: </domain>
Nov 16 10:11:08 user nova-compute[85141]:  {{(pid=85141) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 10:11:08 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-d75ac365-ae12-46bf-bb9b-1ef1096b5aae tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T10:10:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1086260035',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1086260035',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPTxuc2pFbo8Kj1fpySyu2hi+5RREMihAI4J3BcHJNw6/EhxEylOLh1w3NMl0ucAMBcFIFr2hryAmkgpSqOT6RfhW0NUWmUq9zKgRAUTsN4Epu8nh4W95o4JP2jn8aOc3w==',key_name='tempest-keypair-731314932',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e017c305665f4a98a75d1d77701b6527',ramdisk_id='',reservation_id='r-4eesetti',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1581977623',owner_user_name='tempest-ServerActionsV293TestJSON-1581977623-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T10:10:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ae4bf3b050ed4cd7901541e9ce1c838f',uuid=6caf3667-5613-4ef4-a597-1820e6c1c0ac,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ad2b755f-6905-4256-be59-b64dae993293", "address": "fa:16:3e:fb:7c:00", "network": {"id": "9b5d58ef-109a-4ccb-90e4-a6b18c02f49c", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1619595955-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e017c305665f4a98a75d1d77701b6527", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad2b755f-69", "ovs_interfaceid": "ad2b755f-6905-4256-be59-b64dae993293", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 10:11:08 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-d75ac365-ae12-46bf-bb9b-1ef1096b5aae tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] Converting VIF {"id": "ad2b755f-6905-4256-be59-b64dae993293", "address": "fa:16:3e:fb:7c:00", "network": {"id": "9b5d58ef-109a-4ccb-90e4-a6b18c02f49c", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1619595955-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e017c305665f4a98a75d1d77701b6527", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad2b755f-69", "ovs_interfaceid": "ad2b755f-6905-4256-be59-b64dae993293", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:11:08 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-d75ac365-ae12-46bf-bb9b-1ef1096b5aae tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fb:7c:00,bridge_name='br-int',has_traffic_filtering=True,id=ad2b755f-6905-4256-be59-b64dae993293,network=Network(9b5d58ef-109a-4ccb-90e4-a6b18c02f49c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad2b755f-69') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:11:08 user nova-compute[85141]: DEBUG os_vif [None req-d75ac365-ae12-46bf-bb9b-1ef1096b5aae tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:7c:00,bridge_name='br-int',has_traffic_filtering=True,id=ad2b755f-6905-4256-be59-b64dae993293,network=Network(9b5d58ef-109a-4ccb-90e4-a6b18c02f49c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad2b755f-69') {{(pid=85141) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 10:11:08 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:11:08 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:11:08 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 10:11:08 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:11:08 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b313a02c-4340-5f9c-982c-acdea0346c62', '_type': 'linux-noop'}}, row=False) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:11:08 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:11:08 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:11:08 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-77454959-aa5e-4ea4-a4b2-40594749ed82 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] Lock "0ca61bd2-268e-4c49-ba04-a5cb39143a9b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.899s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:11:08 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:11:08 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapad2b755f-69, may_exist=True, interface_attrs={}) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:11:08 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapad2b755f-69, col_values=(('qos', UUID('b6d2a92a-36df-4d38-8e10-87a9a6f858ae')),), if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:11:08 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapad2b755f-69, col_values=(('external_ids', {'iface-id': 'ad2b755f-6905-4256-be59-b64dae993293', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fb:7c:00', 'vm-uuid': '6caf3667-5613-4ef4-a597-1820e6c1c0ac'}),), if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:11:08 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:11:08 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:11:08 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:11:08 user nova-compute[85141]: INFO os_vif [None req-d75ac365-ae12-46bf-bb9b-1ef1096b5aae tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:7c:00,bridge_name='br-int',has_traffic_filtering=True,id=ad2b755f-6905-4256-be59-b64dae993293,network=Network(9b5d58ef-109a-4ccb-90e4-a6b18c02f49c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad2b755f-69')
Nov 16 10:11:08 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-d75ac365-ae12-46bf-bb9b-1ef1096b5aae tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] No BDM found with device name vda, not building metadata. {{(pid=85141) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 10:11:08 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-d75ac365-ae12-46bf-bb9b-1ef1096b5aae tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] No VIF found with MAC fa:16:3e:fb:7c:00, not building metadata {{(pid=85141) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 10:11:08 user nova-compute[85141]: INFO nova.compute.manager [None req-5fbcf7f0-a47f-465d-b445-cd3b21c9cf8e tempest-AttachSCSIVolumeTestJSON-1774410022 tempest-AttachSCSIVolumeTestJSON-1774410022-project-member] [instance: ff964caf-b473-47bc-89d2-f7189264721c] Took 17.63 seconds to build instance.
Nov 16 10:11:08 user nova-compute[85141]: DEBUG nova.network.neutron [None req-6acf2501-2e40-4328-bd23-587ad59bd8d1 tempest-VolumesAssistedSnapshotsTest-1194404756 tempest-VolumesAssistedSnapshotsTest-1194404756-project-member] [instance: 7e2ae11f-161c-4d13-a1a5-37d0a8150e6b] Successfully updated port: f7b5e797-8f96-4f01-847a-4a5b4f208517 {{(pid=85141) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 10:11:08 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbcf7f0-a47f-465d-b445-cd3b21c9cf8e tempest-AttachSCSIVolumeTestJSON-1774410022 tempest-AttachSCSIVolumeTestJSON-1774410022-project-member] Lock "ff964caf-b473-47bc-89d2-f7189264721c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.842s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:11:09 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-6acf2501-2e40-4328-bd23-587ad59bd8d1 tempest-VolumesAssistedSnapshotsTest-1194404756 tempest-VolumesAssistedSnapshotsTest-1194404756-project-member] Acquiring lock "refresh_cache-7e2ae11f-161c-4d13-a1a5-37d0a8150e6b" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:11:09 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-6acf2501-2e40-4328-bd23-587ad59bd8d1 tempest-VolumesAssistedSnapshotsTest-1194404756 tempest-VolumesAssistedSnapshotsTest-1194404756-project-member] Acquired lock "refresh_cache-7e2ae11f-161c-4d13-a1a5-37d0a8150e6b" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:11:09 user nova-compute[85141]: DEBUG nova.network.neutron [None req-6acf2501-2e40-4328-bd23-587ad59bd8d1 tempest-VolumesAssistedSnapshotsTest-1194404756 tempest-VolumesAssistedSnapshotsTest-1194404756-project-member] [instance: 7e2ae11f-161c-4d13-a1a5-37d0a8150e6b] Building network info cache for instance {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 10:11:09 user nova-compute[85141]: DEBUG nova.compute.manager [req-a5e3eb91-c836-4d94-9df7-5ba0404f4109 req-a69c1d73-137a-4849-9730-6cb43441e649 service nova] [instance: 7e2ae11f-161c-4d13-a1a5-37d0a8150e6b] Received event network-changed-f7b5e797-8f96-4f01-847a-4a5b4f208517 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:11:09 user nova-compute[85141]: DEBUG nova.compute.manager [req-a5e3eb91-c836-4d94-9df7-5ba0404f4109 req-a69c1d73-137a-4849-9730-6cb43441e649 service nova] [instance: 7e2ae11f-161c-4d13-a1a5-37d0a8150e6b] Refreshing instance network info cache due to event network-changed-f7b5e797-8f96-4f01-847a-4a5b4f208517. {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 10:11:09 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-a5e3eb91-c836-4d94-9df7-5ba0404f4109 req-a69c1d73-137a-4849-9730-6cb43441e649 service nova] Acquiring lock "refresh_cache-7e2ae11f-161c-4d13-a1a5-37d0a8150e6b" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:11:09 user nova-compute[85141]: DEBUG nova.network.neutron [None req-6acf2501-2e40-4328-bd23-587ad59bd8d1 tempest-VolumesAssistedSnapshotsTest-1194404756 tempest-VolumesAssistedSnapshotsTest-1194404756-project-member] [instance: 7e2ae11f-161c-4d13-a1a5-37d0a8150e6b] Instance cache missing network info. {{(pid=85141) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 10:11:09 user nova-compute[85141]: DEBUG nova.network.neutron [None req-6acf2501-2e40-4328-bd23-587ad59bd8d1 tempest-VolumesAssistedSnapshotsTest-1194404756 tempest-VolumesAssistedSnapshotsTest-1194404756-project-member] [instance: 7e2ae11f-161c-4d13-a1a5-37d0a8150e6b] Updating instance_info_cache with network_info: [{"id": "f7b5e797-8f96-4f01-847a-4a5b4f208517", "address": "fa:16:3e:19:6f:78", "network": {"id": "11563c56-f3fc-41db-a612-aa4e06a845ec", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1298866398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2177d3304c7741efb82eca1323f27f92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7b5e797-8f", "ovs_interfaceid": "f7b5e797-8f96-4f01-847a-4a5b4f208517", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:11:09 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-6acf2501-2e40-4328-bd23-587ad59bd8d1 tempest-VolumesAssistedSnapshotsTest-1194404756 tempest-VolumesAssistedSnapshotsTest-1194404756-project-member] Releasing lock "refresh_cache-7e2ae11f-161c-4d13-a1a5-37d0a8150e6b" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:11:09 user nova-compute[85141]: DEBUG nova.compute.manager [None req-6acf2501-2e40-4328-bd23-587ad59bd8d1 tempest-VolumesAssistedSnapshotsTest-1194404756 tempest-VolumesAssistedSnapshotsTest-1194404756-project-member] [instance: 7e2ae11f-161c-4d13-a1a5-37d0a8150e6b] Instance network_info: |[{"id": "f7b5e797-8f96-4f01-847a-4a5b4f208517", "address": "fa:16:3e:19:6f:78", "network": {"id": "11563c56-f3fc-41db-a612-aa4e06a845ec", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1298866398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2177d3304c7741efb82eca1323f27f92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7b5e797-8f", "ovs_interfaceid": "f7b5e797-8f96-4f01-847a-4a5b4f208517", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=85141) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 10:11:09 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-a5e3eb91-c836-4d94-9df7-5ba0404f4109 req-a69c1d73-137a-4849-9730-6cb43441e649 service nova] Acquired lock "refresh_cache-7e2ae11f-161c-4d13-a1a5-37d0a8150e6b" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:11:09 user nova-compute[85141]: DEBUG nova.network.neutron [req-a5e3eb91-c836-4d94-9df7-5ba0404f4109 req-a69c1d73-137a-4849-9730-6cb43441e649 service nova] [instance: 7e2ae11f-161c-4d13-a1a5-37d0a8150e6b] Refreshing network info cache for port f7b5e797-8f96-4f01-847a-4a5b4f208517 {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 10:11:09 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-6acf2501-2e40-4328-bd23-587ad59bd8d1 tempest-VolumesAssistedSnapshotsTest-1194404756 tempest-VolumesAssistedSnapshotsTest-1194404756-project-member] [instance: 7e2ae11f-161c-4d13-a1a5-37d0a8150e6b] Start _get_guest_xml network_info=[{"id": "f7b5e797-8f96-4f01-847a-4a5b4f208517", "address": "fa:16:3e:19:6f:78", "network": {"id": "11563c56-f3fc-41db-a612-aa4e06a845ec", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1298866398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2177d3304c7741efb82eca1323f27f92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7b5e797-8f", "ovs_interfaceid": "f7b5e797-8f96-4f01-847a-4a5b4f208517", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T10:06:42Z,direct_url=<?>,disk_format='qcow2',id=bc4ca70f-a459-4d5c-a9e6-80f1948eb48b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1044631a5fe84ce8904864a7024049fa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T10:06:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_options': None, 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'image_id': 'bc4ca70f-a459-4d5c-a9e6-80f1948eb48b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=85141) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 10:11:09 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-6acf2501-2e40-4328-bd23-587ad59bd8d1 tempest-VolumesAssistedSnapshotsTest-1194404756 tempest-VolumesAssistedSnapshotsTest-1194404756-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:11:09 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-6acf2501-2e40-4328-bd23-587ad59bd8d1 tempest-VolumesAssistedSnapshotsTest-1194404756 tempest-VolumesAssistedSnapshotsTest-1194404756-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:11:09 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-6acf2501-2e40-4328-bd23-587ad59bd8d1 tempest-VolumesAssistedSnapshotsTest-1194404756 tempest-VolumesAssistedSnapshotsTest-1194404756-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=85141) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 10:11:09 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-6acf2501-2e40-4328-bd23-587ad59bd8d1 tempest-VolumesAssistedSnapshotsTest-1194404756 tempest-VolumesAssistedSnapshotsTest-1194404756-project-member] CPU controller missing on host. {{(pid=85141) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 10:11:09 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-6acf2501-2e40-4328-bd23-587ad59bd8d1 tempest-VolumesAssistedSnapshotsTest-1194404756 tempest-VolumesAssistedSnapshotsTest-1194404756-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=85141) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 10:11:09 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-6acf2501-2e40-4328-bd23-587ad59bd8d1 tempest-VolumesAssistedSnapshotsTest-1194404756 tempest-VolumesAssistedSnapshotsTest-1194404756-project-member] CPU controller found on host. {{(pid=85141) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 10:11:09 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-6acf2501-2e40-4328-bd23-587ad59bd8d1 tempest-VolumesAssistedSnapshotsTest-1194404756 tempest-VolumesAssistedSnapshotsTest-1194404756-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=85141) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 10:11:09 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-6acf2501-2e40-4328-bd23-587ad59bd8d1 tempest-VolumesAssistedSnapshotsTest-1194404756 tempest-VolumesAssistedSnapshotsTest-1194404756-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T10:06:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T10:06:42Z,direct_url=<?>,disk_format='qcow2',id=bc4ca70f-a459-4d5c-a9e6-80f1948eb48b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1044631a5fe84ce8904864a7024049fa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T10:06:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 10:11:09 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-6acf2501-2e40-4328-bd23-587ad59bd8d1 tempest-VolumesAssistedSnapshotsTest-1194404756 tempest-VolumesAssistedSnapshotsTest-1194404756-project-member] Flavor limits 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 10:11:09 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-6acf2501-2e40-4328-bd23-587ad59bd8d1 tempest-VolumesAssistedSnapshotsTest-1194404756 tempest-VolumesAssistedSnapshotsTest-1194404756-project-member] Image limits 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 10:11:09 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-6acf2501-2e40-4328-bd23-587ad59bd8d1 tempest-VolumesAssistedSnapshotsTest-1194404756 tempest-VolumesAssistedSnapshotsTest-1194404756-project-member] Flavor pref 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 10:11:09 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-6acf2501-2e40-4328-bd23-587ad59bd8d1 tempest-VolumesAssistedSnapshotsTest-1194404756 tempest-VolumesAssistedSnapshotsTest-1194404756-project-member] Image pref 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 10:11:09 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-6acf2501-2e40-4328-bd23-587ad59bd8d1 tempest-VolumesAssistedSnapshotsTest-1194404756 tempest-VolumesAssistedSnapshotsTest-1194404756-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 10:11:09 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-6acf2501-2e40-4328-bd23-587ad59bd8d1 tempest-VolumesAssistedSnapshotsTest-1194404756 tempest-VolumesAssistedSnapshotsTest-1194404756-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 10:11:09 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-6acf2501-2e40-4328-bd23-587ad59bd8d1 tempest-VolumesAssistedSnapshotsTest-1194404756 tempest-VolumesAssistedSnapshotsTest-1194404756-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=85141) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 10:11:09 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-6acf2501-2e40-4328-bd23-587ad59bd8d1 tempest-VolumesAssistedSnapshotsTest-1194404756 tempest-VolumesAssistedSnapshotsTest-1194404756-project-member] Got 1 possible topologies {{(pid=85141) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 10:11:09 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-6acf2501-2e40-4328-bd23-587ad59bd8d1 tempest-VolumesAssistedSnapshotsTest-1194404756 tempest-VolumesAssistedSnapshotsTest-1194404756-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 10:11:09 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-6acf2501-2e40-4328-bd23-587ad59bd8d1 tempest-VolumesAssistedSnapshotsTest-1194404756 tempest-VolumesAssistedSnapshotsTest-1194404756-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 10:11:09 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-6acf2501-2e40-4328-bd23-587ad59bd8d1 tempest-VolumesAssistedSnapshotsTest-1194404756 tempest-VolumesAssistedSnapshotsTest-1194404756-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T10:11:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1727033461',display_name='tempest-VolumesAssistedSnapshotsTest-server-1727033461',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1727033461',id=10,image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPJD5N2/p/YVuiEwS9IzLhhuaVrUAVb11B8xciFRiRrkU/71b5ORWId8A3/QMTsYQ3ond2lviwdEp8K1zjCYG9YkpItcxQIwIRhY1S69RYaXfYuOfCAaIotncX9ZJsmN5Q==',key_name='tempest-keypair-545798210',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2177d3304c7741efb82eca1323f27f92',ramdisk_id='',reservation_id='r-jkudhevx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1194404756',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1194404756-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T10:11:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eae4e8c6a7e442cb907448b29c07befb',uuid=7e2ae11f-161c-4d13-a1a5-37d0a8150e6b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f7b5e797-8f96-4f01-847a-4a5b4f208517", "address": "fa:16:3e:19:6f:78", "network": {"id": "11563c56-f3fc-41db-a612-aa4e06a845ec", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1298866398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2177d3304c7741efb82eca1323f27f92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7b5e797-8f", "ovs_interfaceid": "f7b5e797-8f96-4f01-847a-4a5b4f208517", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=85141) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 10:11:09 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-6acf2501-2e40-4328-bd23-587ad59bd8d1 tempest-VolumesAssistedSnapshotsTest-1194404756 tempest-VolumesAssistedSnapshotsTest-1194404756-project-member] Converting VIF {"id": "f7b5e797-8f96-4f01-847a-4a5b4f208517", "address": "fa:16:3e:19:6f:78", "network": {"id": "11563c56-f3fc-41db-a612-aa4e06a845ec", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1298866398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2177d3304c7741efb82eca1323f27f92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7b5e797-8f", "ovs_interfaceid": "f7b5e797-8f96-4f01-847a-4a5b4f208517", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:11:09 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-6acf2501-2e40-4328-bd23-587ad59bd8d1 tempest-VolumesAssistedSnapshotsTest-1194404756 tempest-VolumesAssistedSnapshotsTest-1194404756-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:19:6f:78,bridge_name='br-int',has_traffic_filtering=True,id=f7b5e797-8f96-4f01-847a-4a5b4f208517,network=Network(11563c56-f3fc-41db-a612-aa4e06a845ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7b5e797-8f') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:11:09 user nova-compute[85141]: DEBUG nova.objects.instance [None req-6acf2501-2e40-4328-bd23-587ad59bd8d1 tempest-VolumesAssistedSnapshotsTest-1194404756 tempest-VolumesAssistedSnapshotsTest-1194404756-project-member] Lazy-loading 'pci_devices' on Instance uuid 7e2ae11f-161c-4d13-a1a5-37d0a8150e6b {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:11:09 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-6acf2501-2e40-4328-bd23-587ad59bd8d1 tempest-VolumesAssistedSnapshotsTest-1194404756 tempest-VolumesAssistedSnapshotsTest-1194404756-project-member] [instance: 7e2ae11f-161c-4d13-a1a5-37d0a8150e6b] End _get_guest_xml xml=<domain type="kvm">
Nov 16 10:11:09 user nova-compute[85141]:   <uuid>7e2ae11f-161c-4d13-a1a5-37d0a8150e6b</uuid>
Nov 16 10:11:09 user nova-compute[85141]:   <name>instance-0000000a</name>
Nov 16 10:11:09 user nova-compute[85141]:   <memory>524288</memory>
Nov 16 10:11:09 user nova-compute[85141]:   <vcpu>1</vcpu>
Nov 16 10:11:09 user nova-compute[85141]:   <metadata>
Nov 16 10:11:09 user nova-compute[85141]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 10:11:09 user nova-compute[85141]:       <nova:package version="0.0.0"/>
Nov 16 10:11:09 user nova-compute[85141]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-1727033461</nova:name>
Nov 16 10:11:09 user nova-compute[85141]:       <nova:creationTime>2023-11-16 10:11:09</nova:creationTime>
Nov 16 10:11:09 user nova-compute[85141]:       <nova:flavor name="m1.tiny">
Nov 16 10:11:09 user nova-compute[85141]:         <nova:memory>512</nova:memory>
Nov 16 10:11:09 user nova-compute[85141]:         <nova:disk>1</nova:disk>
Nov 16 10:11:09 user nova-compute[85141]:         <nova:swap>0</nova:swap>
Nov 16 10:11:09 user nova-compute[85141]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 10:11:09 user nova-compute[85141]:         <nova:vcpus>1</nova:vcpus>
Nov 16 10:11:09 user nova-compute[85141]:       </nova:flavor>
Nov 16 10:11:09 user nova-compute[85141]:       <nova:owner>
Nov 16 10:11:09 user nova-compute[85141]:         <nova:user uuid="eae4e8c6a7e442cb907448b29c07befb">tempest-VolumesAssistedSnapshotsTest-1194404756-project-member</nova:user>
Nov 16 10:11:09 user nova-compute[85141]:         <nova:project uuid="2177d3304c7741efb82eca1323f27f92">tempest-VolumesAssistedSnapshotsTest-1194404756</nova:project>
Nov 16 10:11:09 user nova-compute[85141]:       </nova:owner>
Nov 16 10:11:09 user nova-compute[85141]:       <nova:root type="image" uuid="bc4ca70f-a459-4d5c-a9e6-80f1948eb48b"/>
Nov 16 10:11:09 user nova-compute[85141]:       <nova:ports>
Nov 16 10:11:09 user nova-compute[85141]:         <nova:port uuid="f7b5e797-8f96-4f01-847a-4a5b4f208517">
Nov 16 10:11:09 user nova-compute[85141]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 16 10:11:09 user nova-compute[85141]:         </nova:port>
Nov 16 10:11:09 user nova-compute[85141]:       </nova:ports>
Nov 16 10:11:09 user nova-compute[85141]:     </nova:instance>
Nov 16 10:11:09 user nova-compute[85141]:   </metadata>
Nov 16 10:11:09 user nova-compute[85141]:   <sysinfo type="smbios">
Nov 16 10:11:09 user nova-compute[85141]:     <system>
Nov 16 10:11:09 user nova-compute[85141]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 10:11:09 user nova-compute[85141]:       <entry name="product">OpenStack Nova</entry>
Nov 16 10:11:09 user nova-compute[85141]:       <entry name="version">0.0.0</entry>
Nov 16 10:11:09 user nova-compute[85141]:       <entry name="serial">7e2ae11f-161c-4d13-a1a5-37d0a8150e6b</entry>
Nov 16 10:11:09 user nova-compute[85141]:       <entry name="uuid">7e2ae11f-161c-4d13-a1a5-37d0a8150e6b</entry>
Nov 16 10:11:09 user nova-compute[85141]:       <entry name="family">Virtual Machine</entry>
Nov 16 10:11:09 user nova-compute[85141]:     </system>
Nov 16 10:11:09 user nova-compute[85141]:   </sysinfo>
Nov 16 10:11:09 user nova-compute[85141]:   <os>
Nov 16 10:11:09 user nova-compute[85141]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 10:11:09 user nova-compute[85141]:     <boot dev="hd"/>
Nov 16 10:11:09 user nova-compute[85141]:     <smbios mode="sysinfo"/>
Nov 16 10:11:09 user nova-compute[85141]:   </os>
Nov 16 10:11:09 user nova-compute[85141]:   <features>
Nov 16 10:11:09 user nova-compute[85141]:     <acpi/>
Nov 16 10:11:09 user nova-compute[85141]:     <apic/>
Nov 16 10:11:09 user nova-compute[85141]:     <vmcoreinfo/>
Nov 16 10:11:09 user nova-compute[85141]:   </features>
Nov 16 10:11:09 user nova-compute[85141]:   <clock offset="utc">
Nov 16 10:11:09 user nova-compute[85141]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 10:11:09 user nova-compute[85141]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 10:11:09 user nova-compute[85141]:     <timer name="hpet" present="no"/>
Nov 16 10:11:09 user nova-compute[85141]:   </clock>
Nov 16 10:11:09 user nova-compute[85141]:   <cpu mode="custom" match="exact">
Nov 16 10:11:09 user nova-compute[85141]:     <model>Nehalem</model>
Nov 16 10:11:09 user nova-compute[85141]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 10:11:09 user nova-compute[85141]:   </cpu>
Nov 16 10:11:09 user nova-compute[85141]:   <devices>
Nov 16 10:11:09 user nova-compute[85141]:     <disk type="file" device="disk">
Nov 16 10:11:09 user nova-compute[85141]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 10:11:09 user nova-compute[85141]:       <source file="/opt/stack/data/nova/instances/7e2ae11f-161c-4d13-a1a5-37d0a8150e6b/disk"/>
Nov 16 10:11:09 user nova-compute[85141]:       <target dev="vda" bus="virtio"/>
Nov 16 10:11:09 user nova-compute[85141]:     </disk>
Nov 16 10:11:09 user nova-compute[85141]:     <interface type="ethernet">
Nov 16 10:11:09 user nova-compute[85141]:       <mac address="fa:16:3e:19:6f:78"/>
Nov 16 10:11:09 user nova-compute[85141]:       <model type="virtio"/>
Nov 16 10:11:09 user nova-compute[85141]:       <mtu size="1442"/>
Nov 16 10:11:09 user nova-compute[85141]:       <target dev="tapf7b5e797-8f"/>
Nov 16 10:11:09 user nova-compute[85141]:     </interface>
Nov 16 10:11:09 user nova-compute[85141]:     <serial type="pty">
Nov 16 10:11:09 user nova-compute[85141]:       <log file="/opt/stack/data/nova/instances/7e2ae11f-161c-4d13-a1a5-37d0a8150e6b/console.log" append="off"/>
Nov 16 10:11:09 user nova-compute[85141]:     </serial>
Nov 16 10:11:09 user nova-compute[85141]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 10:11:09 user nova-compute[85141]:     <video>
Nov 16 10:11:09 user nova-compute[85141]:       <model type="virtio"/>
Nov 16 10:11:09 user nova-compute[85141]:     </video>
Nov 16 10:11:09 user nova-compute[85141]:     <rng model="virtio">
Nov 16 10:11:09 user nova-compute[85141]:       <backend model="random">/dev/urandom</backend>
Nov 16 10:11:09 user nova-compute[85141]:     </rng>
Nov 16 10:11:09 user nova-compute[85141]:     <controller type="usb" index="0" model="none"/>
Nov 16 10:11:09 user nova-compute[85141]:     <memballoon model="virtio">
Nov 16 10:11:09 user nova-compute[85141]:       <stats period="10"/>
Nov 16 10:11:09 user nova-compute[85141]:     </memballoon>
Nov 16 10:11:09 user nova-compute[85141]:   </devices>
Nov 16 10:11:09 user nova-compute[85141]: </domain>
Nov 16 10:11:09 user nova-compute[85141]:  {{(pid=85141) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 10:11:09 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-6acf2501-2e40-4328-bd23-587ad59bd8d1 tempest-VolumesAssistedSnapshotsTest-1194404756 tempest-VolumesAssistedSnapshotsTest-1194404756-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T10:11:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1727033461',display_name='tempest-VolumesAssistedSnapshotsTest-server-1727033461',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1727033461',id=10,image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPJD5N2/p/YVuiEwS9IzLhhuaVrUAVb11B8xciFRiRrkU/71b5ORWId8A3/QMTsYQ3ond2lviwdEp8K1zjCYG9YkpItcxQIwIRhY1S69RYaXfYuOfCAaIotncX9ZJsmN5Q==',key_name='tempest-keypair-545798210',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2177d3304c7741efb82eca1323f27f92',ramdisk_id='',reservation_id='r-jkudhevx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1194404756',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1194404756-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T10:11:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eae4e8c6a7e442cb907448b29c07befb',uuid=7e2ae11f-161c-4d13-a1a5-37d0a8150e6b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f7b5e797-8f96-4f01-847a-4a5b4f208517", "address": "fa:16:3e:19:6f:78", "network": {"id": "11563c56-f3fc-41db-a612-aa4e06a845ec", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1298866398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2177d3304c7741efb82eca1323f27f92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7b5e797-8f", "ovs_interfaceid": "f7b5e797-8f96-4f01-847a-4a5b4f208517", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 10:11:09 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-6acf2501-2e40-4328-bd23-587ad59bd8d1 tempest-VolumesAssistedSnapshotsTest-1194404756 tempest-VolumesAssistedSnapshotsTest-1194404756-project-member] Converting VIF {"id": "f7b5e797-8f96-4f01-847a-4a5b4f208517", "address": "fa:16:3e:19:6f:78", "network": {"id": "11563c56-f3fc-41db-a612-aa4e06a845ec", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1298866398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2177d3304c7741efb82eca1323f27f92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7b5e797-8f", "ovs_interfaceid": "f7b5e797-8f96-4f01-847a-4a5b4f208517", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:11:09 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-6acf2501-2e40-4328-bd23-587ad59bd8d1 tempest-VolumesAssistedSnapshotsTest-1194404756 tempest-VolumesAssistedSnapshotsTest-1194404756-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:19:6f:78,bridge_name='br-int',has_traffic_filtering=True,id=f7b5e797-8f96-4f01-847a-4a5b4f208517,network=Network(11563c56-f3fc-41db-a612-aa4e06a845ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7b5e797-8f') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:11:09 user nova-compute[85141]: DEBUG os_vif [None req-6acf2501-2e40-4328-bd23-587ad59bd8d1 tempest-VolumesAssistedSnapshotsTest-1194404756 tempest-VolumesAssistedSnapshotsTest-1194404756-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:19:6f:78,bridge_name='br-int',has_traffic_filtering=True,id=f7b5e797-8f96-4f01-847a-4a5b4f208517,network=Network(11563c56-f3fc-41db-a612-aa4e06a845ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7b5e797-8f') {{(pid=85141) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 10:11:09 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:11:09 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:11:09 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 10:11:09 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:11:09 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b48fda14-4a98-5af2-9aa6-609325e48be8', '_type': 'linux-noop'}}, row=False) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:11:09 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:11:09 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:11:09 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:11:09 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:11:09 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf7b5e797-8f, may_exist=True, interface_attrs={}) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:11:09 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf7b5e797-8f, col_values=(('qos', UUID('315d5f01-d8da-44d8-99ae-f77d35278d6a')),), if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:11:09 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf7b5e797-8f, col_values=(('external_ids', {'iface-id': 'f7b5e797-8f96-4f01-847a-4a5b4f208517', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:19:6f:78', 'vm-uuid': '7e2ae11f-161c-4d13-a1a5-37d0a8150e6b'}),), if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:11:09 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:11:09 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:11:09 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:11:09 user nova-compute[85141]: INFO os_vif [None req-6acf2501-2e40-4328-bd23-587ad59bd8d1 tempest-VolumesAssistedSnapshotsTest-1194404756 tempest-VolumesAssistedSnapshotsTest-1194404756-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:19:6f:78,bridge_name='br-int',has_traffic_filtering=True,id=f7b5e797-8f96-4f01-847a-4a5b4f208517,network=Network(11563c56-f3fc-41db-a612-aa4e06a845ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7b5e797-8f')
Nov 16 10:11:10 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-1faaad7c-400b-43c4-a32e-b69cf738d31d tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] Acquiring lock "8f872e56-0fdc-4d3c-ab3d-64497d036dc8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:11:10 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-1faaad7c-400b-43c4-a32e-b69cf738d31d tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] Lock "8f872e56-0fdc-4d3c-ab3d-64497d036dc8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:11:10 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-6acf2501-2e40-4328-bd23-587ad59bd8d1 tempest-VolumesAssistedSnapshotsTest-1194404756 tempest-VolumesAssistedSnapshotsTest-1194404756-project-member] No BDM found with device name vda, not building metadata. {{(pid=85141) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 10:11:10 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-6acf2501-2e40-4328-bd23-587ad59bd8d1 tempest-VolumesAssistedSnapshotsTest-1194404756 tempest-VolumesAssistedSnapshotsTest-1194404756-project-member] No VIF found with MAC fa:16:3e:19:6f:78, not building metadata {{(pid=85141) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 10:11:10 user nova-compute[85141]: DEBUG nova.compute.manager [None req-1faaad7c-400b-43c4-a32e-b69cf738d31d tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] [instance: 8f872e56-0fdc-4d3c-ab3d-64497d036dc8] Starting instance... {{(pid=85141) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 10:11:10 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-1faaad7c-400b-43c4-a32e-b69cf738d31d tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:11:10 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-1faaad7c-400b-43c4-a32e-b69cf738d31d tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:11:10 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-1faaad7c-400b-43c4-a32e-b69cf738d31d tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=85141) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 10:11:10 user nova-compute[85141]: INFO nova.compute.claims [None req-1faaad7c-400b-43c4-a32e-b69cf738d31d tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] [instance: 8f872e56-0fdc-4d3c-ab3d-64497d036dc8] Claim successful on node user
Nov 16 10:11:10 user nova-compute[85141]: DEBUG nova.network.neutron [req-a5e3eb91-c836-4d94-9df7-5ba0404f4109 req-a69c1d73-137a-4849-9730-6cb43441e649 service nova] [instance: 7e2ae11f-161c-4d13-a1a5-37d0a8150e6b] Updated VIF entry in instance network info cache for port f7b5e797-8f96-4f01-847a-4a5b4f208517. {{(pid=85141) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 10:11:10 user nova-compute[85141]: DEBUG nova.network.neutron [req-a5e3eb91-c836-4d94-9df7-5ba0404f4109 req-a69c1d73-137a-4849-9730-6cb43441e649 service nova] [instance: 7e2ae11f-161c-4d13-a1a5-37d0a8150e6b] Updating instance_info_cache with network_info: [{"id": "f7b5e797-8f96-4f01-847a-4a5b4f208517", "address": "fa:16:3e:19:6f:78", "network": {"id": "11563c56-f3fc-41db-a612-aa4e06a845ec", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1298866398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2177d3304c7741efb82eca1323f27f92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7b5e797-8f", "ovs_interfaceid": "f7b5e797-8f96-4f01-847a-4a5b4f208517", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:11:10 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-a5e3eb91-c836-4d94-9df7-5ba0404f4109 req-a69c1d73-137a-4849-9730-6cb43441e649 service nova] Releasing lock "refresh_cache-7e2ae11f-161c-4d13-a1a5-37d0a8150e6b" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:11:10 user nova-compute[85141]: DEBUG nova.compute.provider_tree [None req-1faaad7c-400b-43c4-a32e-b69cf738d31d tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] Inventory has not changed in ProviderTree for provider: bf8e0fa1-16b6-408f-9203-c4cd63916272 {{(pid=85141) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 10:11:10 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:11:10 user nova-compute[85141]: DEBUG nova.scheduler.client.report [None req-1faaad7c-400b-43c4-a32e-b69cf738d31d tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] Inventory has not changed for provider bf8e0fa1-16b6-408f-9203-c4cd63916272 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=85141) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 10:11:11 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:11:11 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:11:11 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-1faaad7c-400b-43c4-a32e-b69cf738d31d tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.842s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:11:11 user nova-compute[85141]: DEBUG nova.compute.manager [None req-1faaad7c-400b-43c4-a32e-b69cf738d31d tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] [instance: 8f872e56-0fdc-4d3c-ab3d-64497d036dc8] Start building networks asynchronously for instance. {{(pid=85141) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 10:11:11 user nova-compute[85141]: DEBUG nova.compute.manager [req-6c7f6b4a-4618-40ff-992c-a190bb9549a0 req-8c484ece-2788-4079-849d-1170be55f9eb service nova] [instance: ad1ace46-2e8e-42e1-a0f5-2384078fcf09] Received event network-vif-plugged-2a895913-f200-44a4-b3bc-4a1c876e2714 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:11:11 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-6c7f6b4a-4618-40ff-992c-a190bb9549a0 req-8c484ece-2788-4079-849d-1170be55f9eb service nova] Acquiring lock "ad1ace46-2e8e-42e1-a0f5-2384078fcf09-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:11:11 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-6c7f6b4a-4618-40ff-992c-a190bb9549a0 req-8c484ece-2788-4079-849d-1170be55f9eb service nova] Lock "ad1ace46-2e8e-42e1-a0f5-2384078fcf09-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:11:11 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-6c7f6b4a-4618-40ff-992c-a190bb9549a0 req-8c484ece-2788-4079-849d-1170be55f9eb service nova] Lock "ad1ace46-2e8e-42e1-a0f5-2384078fcf09-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:11:11 user nova-compute[85141]: DEBUG nova.compute.manager [req-6c7f6b4a-4618-40ff-992c-a190bb9549a0 req-8c484ece-2788-4079-849d-1170be55f9eb service nova] [instance: ad1ace46-2e8e-42e1-a0f5-2384078fcf09] No waiting events found dispatching network-vif-plugged-2a895913-f200-44a4-b3bc-4a1c876e2714 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:11:11 user nova-compute[85141]: WARNING nova.compute.manager [req-6c7f6b4a-4618-40ff-992c-a190bb9549a0 req-8c484ece-2788-4079-849d-1170be55f9eb service nova] [instance: ad1ace46-2e8e-42e1-a0f5-2384078fcf09] Received unexpected event network-vif-plugged-2a895913-f200-44a4-b3bc-4a1c876e2714 for instance with vm_state active and task_state None.
Nov 16 10:11:11 user nova-compute[85141]: DEBUG nova.compute.manager [req-6c7f6b4a-4618-40ff-992c-a190bb9549a0 req-8c484ece-2788-4079-849d-1170be55f9eb service nova] [instance: ad1ace46-2e8e-42e1-a0f5-2384078fcf09] Received event network-vif-plugged-2a895913-f200-44a4-b3bc-4a1c876e2714 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:11:11 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-6c7f6b4a-4618-40ff-992c-a190bb9549a0 req-8c484ece-2788-4079-849d-1170be55f9eb service nova] Acquiring lock "ad1ace46-2e8e-42e1-a0f5-2384078fcf09-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:11:11 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-6c7f6b4a-4618-40ff-992c-a190bb9549a0 req-8c484ece-2788-4079-849d-1170be55f9eb service nova] Lock "ad1ace46-2e8e-42e1-a0f5-2384078fcf09-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:11:11 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-6c7f6b4a-4618-40ff-992c-a190bb9549a0 req-8c484ece-2788-4079-849d-1170be55f9eb service nova] Lock "ad1ace46-2e8e-42e1-a0f5-2384078fcf09-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:11:11 user nova-compute[85141]: DEBUG nova.compute.manager [req-6c7f6b4a-4618-40ff-992c-a190bb9549a0 req-8c484ece-2788-4079-849d-1170be55f9eb service nova] [instance: ad1ace46-2e8e-42e1-a0f5-2384078fcf09] No waiting events found dispatching network-vif-plugged-2a895913-f200-44a4-b3bc-4a1c876e2714 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:11:11 user nova-compute[85141]: WARNING nova.compute.manager [req-6c7f6b4a-4618-40ff-992c-a190bb9549a0 req-8c484ece-2788-4079-849d-1170be55f9eb service nova] [instance: ad1ace46-2e8e-42e1-a0f5-2384078fcf09] Received unexpected event network-vif-plugged-2a895913-f200-44a4-b3bc-4a1c876e2714 for instance with vm_state active and task_state None.
Nov 16 10:11:11 user nova-compute[85141]: DEBUG nova.compute.manager [None req-1faaad7c-400b-43c4-a32e-b69cf738d31d tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] [instance: 8f872e56-0fdc-4d3c-ab3d-64497d036dc8] Allocating IP information in the background. {{(pid=85141) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 10:11:11 user nova-compute[85141]: DEBUG nova.network.neutron [None req-1faaad7c-400b-43c4-a32e-b69cf738d31d tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] [instance: 8f872e56-0fdc-4d3c-ab3d-64497d036dc8] allocate_for_instance() {{(pid=85141) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 10:11:11 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-1faaad7c-400b-43c4-a32e-b69cf738d31d tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] [instance: 8f872e56-0fdc-4d3c-ab3d-64497d036dc8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 10:11:11 user nova-compute[85141]: DEBUG nova.compute.manager [None req-1faaad7c-400b-43c4-a32e-b69cf738d31d tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] [instance: 8f872e56-0fdc-4d3c-ab3d-64497d036dc8] Start building block device mappings for instance. {{(pid=85141) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 10:11:11 user nova-compute[85141]: DEBUG nova.compute.manager [None req-1faaad7c-400b-43c4-a32e-b69cf738d31d tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] [instance: 8f872e56-0fdc-4d3c-ab3d-64497d036dc8] Start spawning the instance on the hypervisor. {{(pid=85141) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 10:11:11 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-1faaad7c-400b-43c4-a32e-b69cf738d31d tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] [instance: 8f872e56-0fdc-4d3c-ab3d-64497d036dc8] Creating instance directory {{(pid=85141) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 10:11:11 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-1faaad7c-400b-43c4-a32e-b69cf738d31d tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] [instance: 8f872e56-0fdc-4d3c-ab3d-64497d036dc8] Creating image(s)
Nov 16 10:11:11 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-1faaad7c-400b-43c4-a32e-b69cf738d31d tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] Acquiring lock "/opt/stack/data/nova/instances/8f872e56-0fdc-4d3c-ab3d-64497d036dc8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:11:11 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-1faaad7c-400b-43c4-a32e-b69cf738d31d tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] Lock "/opt/stack/data/nova/instances/8f872e56-0fdc-4d3c-ab3d-64497d036dc8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:11:11 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-1faaad7c-400b-43c4-a32e-b69cf738d31d tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] Lock "/opt/stack/data/nova/instances/8f872e56-0fdc-4d3c-ab3d-64497d036dc8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:11:11 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-1faaad7c-400b-43c4-a32e-b69cf738d31d tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:11:11 user nova-compute[85141]: DEBUG nova.policy [None req-1faaad7c-400b-43c4-a32e-b69cf738d31d tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3b83d10371214ba68a125f52df7e33ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35983b98d3c404d8cddce2894f97dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85141) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 10:11:11 user nova-compute[85141]: DEBUG nova.compute.manager [req-f05868f1-4e4c-4092-863f-bcb49270cae8 req-ed1de871-0def-4ad1-b0b9-f03cf24291a8 service nova] [instance: 6caf3667-5613-4ef4-a597-1820e6c1c0ac] Received event network-vif-plugged-ad2b755f-6905-4256-be59-b64dae993293 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:11:11 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-f05868f1-4e4c-4092-863f-bcb49270cae8 req-ed1de871-0def-4ad1-b0b9-f03cf24291a8 service nova] Acquiring lock "6caf3667-5613-4ef4-a597-1820e6c1c0ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:11:11 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-f05868f1-4e4c-4092-863f-bcb49270cae8 req-ed1de871-0def-4ad1-b0b9-f03cf24291a8 service nova] Lock "6caf3667-5613-4ef4-a597-1820e6c1c0ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:11:11 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-f05868f1-4e4c-4092-863f-bcb49270cae8 req-ed1de871-0def-4ad1-b0b9-f03cf24291a8 service nova] Lock "6caf3667-5613-4ef4-a597-1820e6c1c0ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:11:11 user nova-compute[85141]: DEBUG nova.compute.manager [req-f05868f1-4e4c-4092-863f-bcb49270cae8 req-ed1de871-0def-4ad1-b0b9-f03cf24291a8 service nova] [instance: 6caf3667-5613-4ef4-a597-1820e6c1c0ac] No waiting events found dispatching network-vif-plugged-ad2b755f-6905-4256-be59-b64dae993293 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:11:11 user nova-compute[85141]: WARNING nova.compute.manager [req-f05868f1-4e4c-4092-863f-bcb49270cae8 req-ed1de871-0def-4ad1-b0b9-f03cf24291a8 service nova] [instance: 6caf3667-5613-4ef4-a597-1820e6c1c0ac] Received unexpected event network-vif-plugged-ad2b755f-6905-4256-be59-b64dae993293 for instance with vm_state building and task_state spawning.
Nov 16 10:11:11 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:11:11 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-1faaad7c-400b-43c4-a32e-b69cf738d31d tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json" returned: 0 in 0.309s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:11:11 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-1faaad7c-400b-43c4-a32e-b69cf738d31d tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] Acquiring lock "60a78556fb399ed4a41bc3ca4bccf77c96d8e811" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:11:11 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-1faaad7c-400b-43c4-a32e-b69cf738d31d tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] Lock "60a78556fb399ed4a41bc3ca4bccf77c96d8e811" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:11:11 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-1faaad7c-400b-43c4-a32e-b69cf738d31d tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:11:12 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:11:12 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:11:12 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:11:12 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:11:12 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:11:12 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-1faaad7c-400b-43c4-a32e-b69cf738d31d tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json" returned: 0 in 0.315s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:11:12 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-1faaad7c-400b-43c4-a32e-b69cf738d31d tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811,backing_fmt=raw /opt/stack/data/nova/instances/8f872e56-0fdc-4d3c-ab3d-64497d036dc8/disk 1073741824 {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:11:12 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-1faaad7c-400b-43c4-a32e-b69cf738d31d tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811,backing_fmt=raw /opt/stack/data/nova/instances/8f872e56-0fdc-4d3c-ab3d-64497d036dc8/disk 1073741824" returned: 0 in 0.066s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:11:12 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-1faaad7c-400b-43c4-a32e-b69cf738d31d tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] Lock "60a78556fb399ed4a41bc3ca4bccf77c96d8e811" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.388s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:11:12 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-1faaad7c-400b-43c4-a32e-b69cf738d31d tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:11:12 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-1faaad7c-400b-43c4-a32e-b69cf738d31d tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json" returned: 0 in 0.244s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:11:12 user nova-compute[85141]: DEBUG nova.virt.disk.api [None req-1faaad7c-400b-43c4-a32e-b69cf738d31d tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8f872e56-0fdc-4d3c-ab3d-64497d036dc8/disk. size=1073741824 {{(pid=85141) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 10:11:12 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-1faaad7c-400b-43c4-a32e-b69cf738d31d tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f872e56-0fdc-4d3c-ab3d-64497d036dc8/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:11:12 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-1faaad7c-400b-43c4-a32e-b69cf738d31d tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f872e56-0fdc-4d3c-ab3d-64497d036dc8/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:11:12 user nova-compute[85141]: DEBUG nova.virt.disk.api [None req-1faaad7c-400b-43c4-a32e-b69cf738d31d tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] Cannot resize image /opt/stack/data/nova/instances/8f872e56-0fdc-4d3c-ab3d-64497d036dc8/disk to a smaller size. {{(pid=85141) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 10:11:12 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-1faaad7c-400b-43c4-a32e-b69cf738d31d tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] [instance: 8f872e56-0fdc-4d3c-ab3d-64497d036dc8] Created local disks {{(pid=85141) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 10:11:12 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-1faaad7c-400b-43c4-a32e-b69cf738d31d tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] [instance: 8f872e56-0fdc-4d3c-ab3d-64497d036dc8] Ensure instance console log exists: /opt/stack/data/nova/instances/8f872e56-0fdc-4d3c-ab3d-64497d036dc8/console.log {{(pid=85141) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 10:11:12 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-1faaad7c-400b-43c4-a32e-b69cf738d31d tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:11:12 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-1faaad7c-400b-43c4-a32e-b69cf738d31d tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:11:12 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-1faaad7c-400b-43c4-a32e-b69cf738d31d tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:11:12 user nova-compute[85141]: DEBUG nova.network.neutron [None req-1faaad7c-400b-43c4-a32e-b69cf738d31d tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] [instance: 8f872e56-0fdc-4d3c-ab3d-64497d036dc8] Successfully created port: d2be9459-4384-4c88-931b-098de7e2413d {{(pid=85141) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 10:11:12 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:11:12 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:11:12 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:11:13 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:11:13 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Cleaning up deleted instances {{(pid=85141) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 16 10:11:13 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] There are 0 instances to clean {{(pid=85141) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 16 10:11:13 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:11:13 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Cleaning up deleted instances with incomplete migration  {{(pid=85141) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 16 10:11:13 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:11:13 user nova-compute[85141]: DEBUG nova.compute.manager [req-3a900261-9683-4021-9728-8642fae79f53 req-ec94c80d-cc07-4f70-aea9-d396445302bb service nova] [instance: e65ccf79-718d-4eeb-8914-f0db2e2c9ce2] Received event network-vif-plugged-9b681ac7-3246-4ff4-8691-f8e4f1d62061 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:11:13 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-3a900261-9683-4021-9728-8642fae79f53 req-ec94c80d-cc07-4f70-aea9-d396445302bb service nova] Acquiring lock "e65ccf79-718d-4eeb-8914-f0db2e2c9ce2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:11:13 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-3a900261-9683-4021-9728-8642fae79f53 req-ec94c80d-cc07-4f70-aea9-d396445302bb service nova] Lock "e65ccf79-718d-4eeb-8914-f0db2e2c9ce2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:11:13 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-3a900261-9683-4021-9728-8642fae79f53 req-ec94c80d-cc07-4f70-aea9-d396445302bb service nova] Lock "e65ccf79-718d-4eeb-8914-f0db2e2c9ce2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:11:13 user nova-compute[85141]: DEBUG nova.compute.manager [req-3a900261-9683-4021-9728-8642fae79f53 req-ec94c80d-cc07-4f70-aea9-d396445302bb service nova] [instance: e65ccf79-718d-4eeb-8914-f0db2e2c9ce2] No waiting events found dispatching network-vif-plugged-9b681ac7-3246-4ff4-8691-f8e4f1d62061 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:11:13 user nova-compute[85141]: WARNING nova.compute.manager [req-3a900261-9683-4021-9728-8642fae79f53 req-ec94c80d-cc07-4f70-aea9-d396445302bb service nova] [instance: e65ccf79-718d-4eeb-8914-f0db2e2c9ce2] Received unexpected event network-vif-plugged-9b681ac7-3246-4ff4-8691-f8e4f1d62061 for instance with vm_state active and task_state None.
Nov 16 10:11:13 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:11:14 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:11:14 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:11:14 user nova-compute[85141]: DEBUG nova.compute.manager [req-698b7b6a-3cd1-4916-9728-676b7af07c39 req-a097a4eb-337f-453a-8e6b-bcee5921ff4b service nova] [instance: 6caf3667-5613-4ef4-a597-1820e6c1c0ac] Received event network-vif-plugged-ad2b755f-6905-4256-be59-b64dae993293 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:11:14 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-698b7b6a-3cd1-4916-9728-676b7af07c39 req-a097a4eb-337f-453a-8e6b-bcee5921ff4b service nova] Acquiring lock "6caf3667-5613-4ef4-a597-1820e6c1c0ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:11:14 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-698b7b6a-3cd1-4916-9728-676b7af07c39 req-a097a4eb-337f-453a-8e6b-bcee5921ff4b service nova] Lock "6caf3667-5613-4ef4-a597-1820e6c1c0ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:11:14 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-698b7b6a-3cd1-4916-9728-676b7af07c39 req-a097a4eb-337f-453a-8e6b-bcee5921ff4b service nova] Lock "6caf3667-5613-4ef4-a597-1820e6c1c0ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:11:14 user nova-compute[85141]: DEBUG nova.compute.manager [req-698b7b6a-3cd1-4916-9728-676b7af07c39 req-a097a4eb-337f-453a-8e6b-bcee5921ff4b service nova] [instance: 6caf3667-5613-4ef4-a597-1820e6c1c0ac] No waiting events found dispatching network-vif-plugged-ad2b755f-6905-4256-be59-b64dae993293 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:11:14 user nova-compute[85141]: WARNING nova.compute.manager [req-698b7b6a-3cd1-4916-9728-676b7af07c39 req-a097a4eb-337f-453a-8e6b-bcee5921ff4b service nova] [instance: 6caf3667-5613-4ef4-a597-1820e6c1c0ac] Received unexpected event network-vif-plugged-ad2b755f-6905-4256-be59-b64dae993293 for instance with vm_state building and task_state spawning.
Nov 16 10:11:14 user nova-compute[85141]: DEBUG nova.compute.manager [req-698b7b6a-3cd1-4916-9728-676b7af07c39 req-a097a4eb-337f-453a-8e6b-bcee5921ff4b service nova] [instance: 7e2ae11f-161c-4d13-a1a5-37d0a8150e6b] Received event network-vif-plugged-f7b5e797-8f96-4f01-847a-4a5b4f208517 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:11:14 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-698b7b6a-3cd1-4916-9728-676b7af07c39 req-a097a4eb-337f-453a-8e6b-bcee5921ff4b service nova] Acquiring lock "7e2ae11f-161c-4d13-a1a5-37d0a8150e6b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:11:14 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-698b7b6a-3cd1-4916-9728-676b7af07c39 req-a097a4eb-337f-453a-8e6b-bcee5921ff4b service nova] Lock "7e2ae11f-161c-4d13-a1a5-37d0a8150e6b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:11:14 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-698b7b6a-3cd1-4916-9728-676b7af07c39 req-a097a4eb-337f-453a-8e6b-bcee5921ff4b service nova] Lock "7e2ae11f-161c-4d13-a1a5-37d0a8150e6b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:11:14 user nova-compute[85141]: DEBUG nova.compute.manager [req-698b7b6a-3cd1-4916-9728-676b7af07c39 req-a097a4eb-337f-453a-8e6b-bcee5921ff4b service nova] [instance: 7e2ae11f-161c-4d13-a1a5-37d0a8150e6b] No waiting events found dispatching network-vif-plugged-f7b5e797-8f96-4f01-847a-4a5b4f208517 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:11:14 user nova-compute[85141]: WARNING nova.compute.manager [req-698b7b6a-3cd1-4916-9728-676b7af07c39 req-a097a4eb-337f-453a-8e6b-bcee5921ff4b service nova] [instance: 7e2ae11f-161c-4d13-a1a5-37d0a8150e6b] Received unexpected event network-vif-plugged-f7b5e797-8f96-4f01-847a-4a5b4f208517 for instance with vm_state building and task_state spawning.
Nov 16 10:11:14 user nova-compute[85141]: DEBUG nova.compute.manager [req-698b7b6a-3cd1-4916-9728-676b7af07c39 req-a097a4eb-337f-453a-8e6b-bcee5921ff4b service nova] [instance: 7e2ae11f-161c-4d13-a1a5-37d0a8150e6b] Received event network-vif-plugged-f7b5e797-8f96-4f01-847a-4a5b4f208517 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:11:14 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-698b7b6a-3cd1-4916-9728-676b7af07c39 req-a097a4eb-337f-453a-8e6b-bcee5921ff4b service nova] Acquiring lock "7e2ae11f-161c-4d13-a1a5-37d0a8150e6b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:11:14 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-698b7b6a-3cd1-4916-9728-676b7af07c39 req-a097a4eb-337f-453a-8e6b-bcee5921ff4b service nova] Lock "7e2ae11f-161c-4d13-a1a5-37d0a8150e6b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:11:14 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-698b7b6a-3cd1-4916-9728-676b7af07c39 req-a097a4eb-337f-453a-8e6b-bcee5921ff4b service nova] Lock "7e2ae11f-161c-4d13-a1a5-37d0a8150e6b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:11:14 user nova-compute[85141]: DEBUG nova.compute.manager [req-698b7b6a-3cd1-4916-9728-676b7af07c39 req-a097a4eb-337f-453a-8e6b-bcee5921ff4b service nova] [instance: 7e2ae11f-161c-4d13-a1a5-37d0a8150e6b] No waiting events found dispatching network-vif-plugged-f7b5e797-8f96-4f01-847a-4a5b4f208517 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:11:14 user nova-compute[85141]: WARNING nova.compute.manager [req-698b7b6a-3cd1-4916-9728-676b7af07c39 req-a097a4eb-337f-453a-8e6b-bcee5921ff4b service nova] [instance: 7e2ae11f-161c-4d13-a1a5-37d0a8150e6b] Received unexpected event network-vif-plugged-f7b5e797-8f96-4f01-847a-4a5b4f208517 for instance with vm_state building and task_state spawning.
Nov 16 10:11:14 user nova-compute[85141]: DEBUG nova.network.neutron [None req-1faaad7c-400b-43c4-a32e-b69cf738d31d tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] [instance: 8f872e56-0fdc-4d3c-ab3d-64497d036dc8] Successfully updated port: d2be9459-4384-4c88-931b-098de7e2413d {{(pid=85141) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 10:11:14 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-1faaad7c-400b-43c4-a32e-b69cf738d31d tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] Acquiring lock "refresh_cache-8f872e56-0fdc-4d3c-ab3d-64497d036dc8" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:11:14 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-1faaad7c-400b-43c4-a32e-b69cf738d31d tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] Acquired lock "refresh_cache-8f872e56-0fdc-4d3c-ab3d-64497d036dc8" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:11:14 user nova-compute[85141]: DEBUG nova.network.neutron [None req-1faaad7c-400b-43c4-a32e-b69cf738d31d tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] [instance: 8f872e56-0fdc-4d3c-ab3d-64497d036dc8] Building network info cache for instance {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 10:11:14 user nova-compute[85141]: DEBUG nova.compute.manager [req-f88d5be5-4110-4b0b-b0ea-af17007187e8 req-b680ea20-41d1-416a-9dd8-d666cb55fdbe service nova] [instance: 8f872e56-0fdc-4d3c-ab3d-64497d036dc8] Received event network-changed-d2be9459-4384-4c88-931b-098de7e2413d {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:11:14 user nova-compute[85141]: DEBUG nova.compute.manager [req-f88d5be5-4110-4b0b-b0ea-af17007187e8 req-b680ea20-41d1-416a-9dd8-d666cb55fdbe service nova] [instance: 8f872e56-0fdc-4d3c-ab3d-64497d036dc8] Refreshing instance network info cache due to event network-changed-d2be9459-4384-4c88-931b-098de7e2413d. {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 10:11:14 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-f88d5be5-4110-4b0b-b0ea-af17007187e8 req-b680ea20-41d1-416a-9dd8-d666cb55fdbe service nova] Acquiring lock "refresh_cache-8f872e56-0fdc-4d3c-ab3d-64497d036dc8" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:11:14 user nova-compute[85141]: DEBUG nova.network.neutron [None req-1faaad7c-400b-43c4-a32e-b69cf738d31d tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] [instance: 8f872e56-0fdc-4d3c-ab3d-64497d036dc8] Instance cache missing network info. {{(pid=85141) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 10:11:14 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:11:15 user nova-compute[85141]: DEBUG nova.network.neutron [None req-1faaad7c-400b-43c4-a32e-b69cf738d31d tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] [instance: 8f872e56-0fdc-4d3c-ab3d-64497d036dc8] Updating instance_info_cache with network_info: [{"id": "d2be9459-4384-4c88-931b-098de7e2413d", "address": "fa:16:3e:7d:fc:b3", "network": {"id": "20b79aa8-c67e-4ab4-aa9f-659587f8bcb2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1635312124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b35983b98d3c404d8cddce2894f97dba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2be9459-43", "ovs_interfaceid": "d2be9459-4384-4c88-931b-098de7e2413d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:11:15 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-1faaad7c-400b-43c4-a32e-b69cf738d31d tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] Releasing lock "refresh_cache-8f872e56-0fdc-4d3c-ab3d-64497d036dc8" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:11:15 user nova-compute[85141]: DEBUG nova.compute.manager [None req-1faaad7c-400b-43c4-a32e-b69cf738d31d tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] [instance: 8f872e56-0fdc-4d3c-ab3d-64497d036dc8] Instance network_info: |[{"id": "d2be9459-4384-4c88-931b-098de7e2413d", "address": "fa:16:3e:7d:fc:b3", "network": {"id": "20b79aa8-c67e-4ab4-aa9f-659587f8bcb2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1635312124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b35983b98d3c404d8cddce2894f97dba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2be9459-43", "ovs_interfaceid": "d2be9459-4384-4c88-931b-098de7e2413d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=85141) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 10:11:15 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-f88d5be5-4110-4b0b-b0ea-af17007187e8 req-b680ea20-41d1-416a-9dd8-d666cb55fdbe service nova] Acquired lock "refresh_cache-8f872e56-0fdc-4d3c-ab3d-64497d036dc8" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:11:15 user nova-compute[85141]: DEBUG nova.network.neutron [req-f88d5be5-4110-4b0b-b0ea-af17007187e8 req-b680ea20-41d1-416a-9dd8-d666cb55fdbe service nova] [instance: 8f872e56-0fdc-4d3c-ab3d-64497d036dc8] Refreshing network info cache for port d2be9459-4384-4c88-931b-098de7e2413d {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 10:11:15 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-1faaad7c-400b-43c4-a32e-b69cf738d31d tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] [instance: 8f872e56-0fdc-4d3c-ab3d-64497d036dc8] Start _get_guest_xml network_info=[{"id": "d2be9459-4384-4c88-931b-098de7e2413d", "address": "fa:16:3e:7d:fc:b3", "network": {"id": "20b79aa8-c67e-4ab4-aa9f-659587f8bcb2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1635312124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b35983b98d3c404d8cddce2894f97dba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2be9459-43", "ovs_interfaceid": "d2be9459-4384-4c88-931b-098de7e2413d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T10:06:42Z,direct_url=<?>,disk_format='qcow2',id=bc4ca70f-a459-4d5c-a9e6-80f1948eb48b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1044631a5fe84ce8904864a7024049fa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T10:06:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_options': None, 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'image_id': 'bc4ca70f-a459-4d5c-a9e6-80f1948eb48b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=85141) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 10:11:15 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-1faaad7c-400b-43c4-a32e-b69cf738d31d tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:11:15 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-1faaad7c-400b-43c4-a32e-b69cf738d31d tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:11:15 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-1faaad7c-400b-43c4-a32e-b69cf738d31d tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=85141) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 10:11:15 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-1faaad7c-400b-43c4-a32e-b69cf738d31d tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] CPU controller missing on host. {{(pid=85141) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 10:11:15 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-1faaad7c-400b-43c4-a32e-b69cf738d31d tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=85141) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 10:11:15 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-1faaad7c-400b-43c4-a32e-b69cf738d31d tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] CPU controller found on host. {{(pid=85141) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 10:11:15 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-1faaad7c-400b-43c4-a32e-b69cf738d31d tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=85141) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 10:11:15 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-1faaad7c-400b-43c4-a32e-b69cf738d31d tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T10:06:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T10:06:42Z,direct_url=<?>,disk_format='qcow2',id=bc4ca70f-a459-4d5c-a9e6-80f1948eb48b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1044631a5fe84ce8904864a7024049fa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T10:06:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 10:11:15 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-1faaad7c-400b-43c4-a32e-b69cf738d31d tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] Flavor limits 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 10:11:15 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-1faaad7c-400b-43c4-a32e-b69cf738d31d tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] Image limits 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 10:11:15 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-1faaad7c-400b-43c4-a32e-b69cf738d31d tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] Flavor pref 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 10:11:15 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-1faaad7c-400b-43c4-a32e-b69cf738d31d tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] Image pref 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 10:11:15 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-1faaad7c-400b-43c4-a32e-b69cf738d31d tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 10:11:15 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-1faaad7c-400b-43c4-a32e-b69cf738d31d tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 10:11:15 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-1faaad7c-400b-43c4-a32e-b69cf738d31d tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=85141) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 10:11:15 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-1faaad7c-400b-43c4-a32e-b69cf738d31d tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] Got 1 possible topologies {{(pid=85141) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 10:11:15 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-1faaad7c-400b-43c4-a32e-b69cf738d31d tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 10:11:15 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-1faaad7c-400b-43c4-a32e-b69cf738d31d tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 10:11:15 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-1faaad7c-400b-43c4-a32e-b69cf738d31d tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T10:11:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1670250104',display_name='tempest-VolumesActionsTest-instance-1670250104',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1670250104',id=11,image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b35983b98d3c404d8cddce2894f97dba',ramdisk_id='',reservation_id='r-jxybo979',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1337688058',owner_user_name='tempest-VolumesActionsTest-1337688058-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T10:11:11Z,user_data=None,user_id='3b83d10371214ba68a125f52df7e33ad',uuid=8f872e56-0fdc-4d3c-ab3d-64497d036dc8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d2be9459-4384-4c88-931b-098de7e2413d", "address": "fa:16:3e:7d:fc:b3", "network": {"id": "20b79aa8-c67e-4ab4-aa9f-659587f8bcb2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1635312124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b35983b98d3c404d8cddce2894f97dba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2be9459-43", "ovs_interfaceid": "d2be9459-4384-4c88-931b-098de7e2413d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=85141) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 10:11:15 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-1faaad7c-400b-43c4-a32e-b69cf738d31d tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] Converting VIF {"id": "d2be9459-4384-4c88-931b-098de7e2413d", "address": "fa:16:3e:7d:fc:b3", "network": {"id": "20b79aa8-c67e-4ab4-aa9f-659587f8bcb2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1635312124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b35983b98d3c404d8cddce2894f97dba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2be9459-43", "ovs_interfaceid": "d2be9459-4384-4c88-931b-098de7e2413d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:11:15 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-1faaad7c-400b-43c4-a32e-b69cf738d31d tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:fc:b3,bridge_name='br-int',has_traffic_filtering=True,id=d2be9459-4384-4c88-931b-098de7e2413d,network=Network(20b79aa8-c67e-4ab4-aa9f-659587f8bcb2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2be9459-43') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:11:15 user nova-compute[85141]: DEBUG nova.objects.instance [None req-1faaad7c-400b-43c4-a32e-b69cf738d31d tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] Lazy-loading 'pci_devices' on Instance uuid 8f872e56-0fdc-4d3c-ab3d-64497d036dc8 {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:11:15 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-1faaad7c-400b-43c4-a32e-b69cf738d31d tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] [instance: 8f872e56-0fdc-4d3c-ab3d-64497d036dc8] End _get_guest_xml xml=<domain type="kvm">
Nov 16 10:11:15 user nova-compute[85141]:   <uuid>8f872e56-0fdc-4d3c-ab3d-64497d036dc8</uuid>
Nov 16 10:11:15 user nova-compute[85141]:   <name>instance-0000000b</name>
Nov 16 10:11:15 user nova-compute[85141]:   <memory>524288</memory>
Nov 16 10:11:15 user nova-compute[85141]:   <vcpu>1</vcpu>
Nov 16 10:11:15 user nova-compute[85141]:   <metadata>
Nov 16 10:11:15 user nova-compute[85141]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 10:11:15 user nova-compute[85141]:       <nova:package version="0.0.0"/>
Nov 16 10:11:15 user nova-compute[85141]:       <nova:name>tempest-VolumesActionsTest-instance-1670250104</nova:name>
Nov 16 10:11:15 user nova-compute[85141]:       <nova:creationTime>2023-11-16 10:11:15</nova:creationTime>
Nov 16 10:11:15 user nova-compute[85141]:       <nova:flavor name="m1.tiny">
Nov 16 10:11:15 user nova-compute[85141]:         <nova:memory>512</nova:memory>
Nov 16 10:11:15 user nova-compute[85141]:         <nova:disk>1</nova:disk>
Nov 16 10:11:15 user nova-compute[85141]:         <nova:swap>0</nova:swap>
Nov 16 10:11:15 user nova-compute[85141]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 10:11:15 user nova-compute[85141]:         <nova:vcpus>1</nova:vcpus>
Nov 16 10:11:15 user nova-compute[85141]:       </nova:flavor>
Nov 16 10:11:15 user nova-compute[85141]:       <nova:owner>
Nov 16 10:11:15 user nova-compute[85141]:         <nova:user uuid="3b83d10371214ba68a125f52df7e33ad">tempest-VolumesActionsTest-1337688058-project-member</nova:user>
Nov 16 10:11:15 user nova-compute[85141]:         <nova:project uuid="b35983b98d3c404d8cddce2894f97dba">tempest-VolumesActionsTest-1337688058</nova:project>
Nov 16 10:11:15 user nova-compute[85141]:       </nova:owner>
Nov 16 10:11:15 user nova-compute[85141]:       <nova:root type="image" uuid="bc4ca70f-a459-4d5c-a9e6-80f1948eb48b"/>
Nov 16 10:11:15 user nova-compute[85141]:       <nova:ports>
Nov 16 10:11:15 user nova-compute[85141]:         <nova:port uuid="d2be9459-4384-4c88-931b-098de7e2413d">
Nov 16 10:11:15 user nova-compute[85141]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 16 10:11:15 user nova-compute[85141]:         </nova:port>
Nov 16 10:11:15 user nova-compute[85141]:       </nova:ports>
Nov 16 10:11:15 user nova-compute[85141]:     </nova:instance>
Nov 16 10:11:15 user nova-compute[85141]:   </metadata>
Nov 16 10:11:15 user nova-compute[85141]:   <sysinfo type="smbios">
Nov 16 10:11:15 user nova-compute[85141]:     <system>
Nov 16 10:11:15 user nova-compute[85141]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 10:11:15 user nova-compute[85141]:       <entry name="product">OpenStack Nova</entry>
Nov 16 10:11:15 user nova-compute[85141]:       <entry name="version">0.0.0</entry>
Nov 16 10:11:15 user nova-compute[85141]:       <entry name="serial">8f872e56-0fdc-4d3c-ab3d-64497d036dc8</entry>
Nov 16 10:11:15 user nova-compute[85141]:       <entry name="uuid">8f872e56-0fdc-4d3c-ab3d-64497d036dc8</entry>
Nov 16 10:11:15 user nova-compute[85141]:       <entry name="family">Virtual Machine</entry>
Nov 16 10:11:15 user nova-compute[85141]:     </system>
Nov 16 10:11:15 user nova-compute[85141]:   </sysinfo>
Nov 16 10:11:15 user nova-compute[85141]:   <os>
Nov 16 10:11:15 user nova-compute[85141]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 10:11:15 user nova-compute[85141]:     <boot dev="hd"/>
Nov 16 10:11:15 user nova-compute[85141]:     <smbios mode="sysinfo"/>
Nov 16 10:11:15 user nova-compute[85141]:   </os>
Nov 16 10:11:15 user nova-compute[85141]:   <features>
Nov 16 10:11:15 user nova-compute[85141]:     <acpi/>
Nov 16 10:11:15 user nova-compute[85141]:     <apic/>
Nov 16 10:11:15 user nova-compute[85141]:     <vmcoreinfo/>
Nov 16 10:11:15 user nova-compute[85141]:   </features>
Nov 16 10:11:15 user nova-compute[85141]:   <clock offset="utc">
Nov 16 10:11:15 user nova-compute[85141]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 10:11:15 user nova-compute[85141]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 10:11:15 user nova-compute[85141]:     <timer name="hpet" present="no"/>
Nov 16 10:11:15 user nova-compute[85141]:   </clock>
Nov 16 10:11:15 user nova-compute[85141]:   <cpu mode="custom" match="exact">
Nov 16 10:11:15 user nova-compute[85141]:     <model>Nehalem</model>
Nov 16 10:11:15 user nova-compute[85141]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 10:11:15 user nova-compute[85141]:   </cpu>
Nov 16 10:11:15 user nova-compute[85141]:   <devices>
Nov 16 10:11:15 user nova-compute[85141]:     <disk type="file" device="disk">
Nov 16 10:11:15 user nova-compute[85141]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 10:11:15 user nova-compute[85141]:       <source file="/opt/stack/data/nova/instances/8f872e56-0fdc-4d3c-ab3d-64497d036dc8/disk"/>
Nov 16 10:11:15 user nova-compute[85141]:       <target dev="vda" bus="virtio"/>
Nov 16 10:11:15 user nova-compute[85141]:     </disk>
Nov 16 10:11:15 user nova-compute[85141]:     <interface type="ethernet">
Nov 16 10:11:15 user nova-compute[85141]:       <mac address="fa:16:3e:7d:fc:b3"/>
Nov 16 10:11:15 user nova-compute[85141]:       <model type="virtio"/>
Nov 16 10:11:15 user nova-compute[85141]:       <mtu size="1442"/>
Nov 16 10:11:15 user nova-compute[85141]:       <target dev="tapd2be9459-43"/>
Nov 16 10:11:15 user nova-compute[85141]:     </interface>
Nov 16 10:11:15 user nova-compute[85141]:     <serial type="pty">
Nov 16 10:11:15 user nova-compute[85141]:       <log file="/opt/stack/data/nova/instances/8f872e56-0fdc-4d3c-ab3d-64497d036dc8/console.log" append="off"/>
Nov 16 10:11:15 user nova-compute[85141]:     </serial>
Nov 16 10:11:15 user nova-compute[85141]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 10:11:15 user nova-compute[85141]:     <video>
Nov 16 10:11:15 user nova-compute[85141]:       <model type="virtio"/>
Nov 16 10:11:15 user nova-compute[85141]:     </video>
Nov 16 10:11:15 user nova-compute[85141]:     <rng model="virtio">
Nov 16 10:11:15 user nova-compute[85141]:       <backend model="random">/dev/urandom</backend>
Nov 16 10:11:15 user nova-compute[85141]:     </rng>
Nov 16 10:11:15 user nova-compute[85141]:     <controller type="usb" index="0" model="none"/>
Nov 16 10:11:15 user nova-compute[85141]:     <memballoon model="virtio">
Nov 16 10:11:15 user nova-compute[85141]:       <stats period="10"/>
Nov 16 10:11:15 user nova-compute[85141]:     </memballoon>
Nov 16 10:11:15 user nova-compute[85141]:   </devices>
Nov 16 10:11:15 user nova-compute[85141]: </domain>
Nov 16 10:11:15 user nova-compute[85141]:  {{(pid=85141) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 10:11:15 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-1faaad7c-400b-43c4-a32e-b69cf738d31d tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T10:11:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1670250104',display_name='tempest-VolumesActionsTest-instance-1670250104',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1670250104',id=11,image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b35983b98d3c404d8cddce2894f97dba',ramdisk_id='',reservation_id='r-jxybo979',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1337688058',owner_user_name='tempest-VolumesActionsTest-1337688058-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T10:11:11Z,user_data=None,user_id='3b83d10371214ba68a125f52df7e33ad',uuid=8f872e56-0fdc-4d3c-ab3d-64497d036dc8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d2be9459-4384-4c88-931b-098de7e2413d", "address": "fa:16:3e:7d:fc:b3", "network": {"id": "20b79aa8-c67e-4ab4-aa9f-659587f8bcb2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1635312124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b35983b98d3c404d8cddce2894f97dba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2be9459-43", "ovs_interfaceid": "d2be9459-4384-4c88-931b-098de7e2413d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 10:11:15 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-1faaad7c-400b-43c4-a32e-b69cf738d31d tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] Converting VIF {"id": "d2be9459-4384-4c88-931b-098de7e2413d", "address": "fa:16:3e:7d:fc:b3", "network": {"id": "20b79aa8-c67e-4ab4-aa9f-659587f8bcb2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1635312124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b35983b98d3c404d8cddce2894f97dba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2be9459-43", "ovs_interfaceid": "d2be9459-4384-4c88-931b-098de7e2413d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:11:15 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-1faaad7c-400b-43c4-a32e-b69cf738d31d tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:fc:b3,bridge_name='br-int',has_traffic_filtering=True,id=d2be9459-4384-4c88-931b-098de7e2413d,network=Network(20b79aa8-c67e-4ab4-aa9f-659587f8bcb2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2be9459-43') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:11:15 user nova-compute[85141]: DEBUG os_vif [None req-1faaad7c-400b-43c4-a32e-b69cf738d31d tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:fc:b3,bridge_name='br-int',has_traffic_filtering=True,id=d2be9459-4384-4c88-931b-098de7e2413d,network=Network(20b79aa8-c67e-4ab4-aa9f-659587f8bcb2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2be9459-43') {{(pid=85141) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 10:11:15 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:11:15 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:11:15 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 10:11:15 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:11:15 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a80aed99-863e-56c1-b18c-d85bbfd471c1', '_type': 'linux-noop'}}, row=False) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:11:15 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:11:15 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:11:15 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:11:15 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd2be9459-43, may_exist=True, interface_attrs={}) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:11:15 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd2be9459-43, col_values=(('qos', UUID('629863bb-ac1a-47bf-b7e4-c3a6360bd8c3')),), if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:11:15 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd2be9459-43, col_values=(('external_ids', {'iface-id': 'd2be9459-4384-4c88-931b-098de7e2413d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7d:fc:b3', 'vm-uuid': '8f872e56-0fdc-4d3c-ab3d-64497d036dc8'}),), if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:11:15 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:11:15 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:11:15 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:11:15 user nova-compute[85141]: INFO os_vif [None req-1faaad7c-400b-43c4-a32e-b69cf738d31d tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:fc:b3,bridge_name='br-int',has_traffic_filtering=True,id=d2be9459-4384-4c88-931b-098de7e2413d,network=Network(20b79aa8-c67e-4ab4-aa9f-659587f8bcb2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2be9459-43')
Nov 16 10:11:15 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-1faaad7c-400b-43c4-a32e-b69cf738d31d tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] No BDM found with device name vda, not building metadata. {{(pid=85141) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 10:11:15 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-1faaad7c-400b-43c4-a32e-b69cf738d31d tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] No VIF found with MAC fa:16:3e:7d:fc:b3, not building metadata {{(pid=85141) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 10:11:15 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:11:15 user nova-compute[85141]: DEBUG nova.compute.manager [None req-d75ac365-ae12-46bf-bb9b-1ef1096b5aae tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] [instance: 6caf3667-5613-4ef4-a597-1820e6c1c0ac] Instance event wait completed in 0 seconds for  {{(pid=85141) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 10:11:15 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-d75ac365-ae12-46bf-bb9b-1ef1096b5aae tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] [instance: 6caf3667-5613-4ef4-a597-1820e6c1c0ac] Guest created on hypervisor {{(pid=85141) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 10:11:15 user nova-compute[85141]: INFO nova.virt.libvirt.driver [-] [instance: 6caf3667-5613-4ef4-a597-1820e6c1c0ac] Instance spawned successfully.
Nov 16 10:11:15 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-d75ac365-ae12-46bf-bb9b-1ef1096b5aae tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] [instance: 6caf3667-5613-4ef4-a597-1820e6c1c0ac] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 10:11:15 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-d75ac365-ae12-46bf-bb9b-1ef1096b5aae tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] [instance: 6caf3667-5613-4ef4-a597-1820e6c1c0ac] Found default for hw_cdrom_bus of ide {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:11:15 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-d75ac365-ae12-46bf-bb9b-1ef1096b5aae tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] [instance: 6caf3667-5613-4ef4-a597-1820e6c1c0ac] Found default for hw_disk_bus of virtio {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:11:15 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-d75ac365-ae12-46bf-bb9b-1ef1096b5aae tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] [instance: 6caf3667-5613-4ef4-a597-1820e6c1c0ac] Found default for hw_input_bus of None {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:11:15 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-d75ac365-ae12-46bf-bb9b-1ef1096b5aae tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] [instance: 6caf3667-5613-4ef4-a597-1820e6c1c0ac] Found default for hw_pointer_model of None {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:11:15 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-d75ac365-ae12-46bf-bb9b-1ef1096b5aae tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] [instance: 6caf3667-5613-4ef4-a597-1820e6c1c0ac] Found default for hw_video_model of virtio {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:11:15 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-d75ac365-ae12-46bf-bb9b-1ef1096b5aae tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] [instance: 6caf3667-5613-4ef4-a597-1820e6c1c0ac] Found default for hw_vif_model of virtio {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:11:15 user nova-compute[85141]: DEBUG nova.compute.manager [req-f5a603fa-28b6-48ac-b2a2-379ae4cae6db req-9dfdf74e-ba28-466c-8e95-115c7e7e30b0 service nova] [instance: e65ccf79-718d-4eeb-8914-f0db2e2c9ce2] Received event network-vif-plugged-9b681ac7-3246-4ff4-8691-f8e4f1d62061 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:11:15 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-f5a603fa-28b6-48ac-b2a2-379ae4cae6db req-9dfdf74e-ba28-466c-8e95-115c7e7e30b0 service nova] Acquiring lock "e65ccf79-718d-4eeb-8914-f0db2e2c9ce2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:11:15 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-f5a603fa-28b6-48ac-b2a2-379ae4cae6db req-9dfdf74e-ba28-466c-8e95-115c7e7e30b0 service nova] Lock "e65ccf79-718d-4eeb-8914-f0db2e2c9ce2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:11:15 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-f5a603fa-28b6-48ac-b2a2-379ae4cae6db req-9dfdf74e-ba28-466c-8e95-115c7e7e30b0 service nova] Lock "e65ccf79-718d-4eeb-8914-f0db2e2c9ce2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:11:15 user nova-compute[85141]: DEBUG nova.compute.manager [req-f5a603fa-28b6-48ac-b2a2-379ae4cae6db req-9dfdf74e-ba28-466c-8e95-115c7e7e30b0 service nova] [instance: e65ccf79-718d-4eeb-8914-f0db2e2c9ce2] No waiting events found dispatching network-vif-plugged-9b681ac7-3246-4ff4-8691-f8e4f1d62061 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:11:15 user nova-compute[85141]: WARNING nova.compute.manager [req-f5a603fa-28b6-48ac-b2a2-379ae4cae6db req-9dfdf74e-ba28-466c-8e95-115c7e7e30b0 service nova] [instance: e65ccf79-718d-4eeb-8914-f0db2e2c9ce2] Received unexpected event network-vif-plugged-9b681ac7-3246-4ff4-8691-f8e4f1d62061 for instance with vm_state active and task_state None.
Nov 16 10:11:15 user nova-compute[85141]: DEBUG nova.compute.manager [req-f5a603fa-28b6-48ac-b2a2-379ae4cae6db req-9dfdf74e-ba28-466c-8e95-115c7e7e30b0 service nova] [instance: a4cdcb5b-b2a6-4736-85c8-7e6cdab8c9b1] Received event network-vif-plugged-07d06a88-cd34-412f-9b4d-b9fa94247dd4 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:11:15 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-f5a603fa-28b6-48ac-b2a2-379ae4cae6db req-9dfdf74e-ba28-466c-8e95-115c7e7e30b0 service nova] Acquiring lock "a4cdcb5b-b2a6-4736-85c8-7e6cdab8c9b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:11:15 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-f5a603fa-28b6-48ac-b2a2-379ae4cae6db req-9dfdf74e-ba28-466c-8e95-115c7e7e30b0 service nova] Lock "a4cdcb5b-b2a6-4736-85c8-7e6cdab8c9b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:11:15 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-f5a603fa-28b6-48ac-b2a2-379ae4cae6db req-9dfdf74e-ba28-466c-8e95-115c7e7e30b0 service nova] Lock "a4cdcb5b-b2a6-4736-85c8-7e6cdab8c9b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:11:15 user nova-compute[85141]: DEBUG nova.compute.manager [req-f5a603fa-28b6-48ac-b2a2-379ae4cae6db req-9dfdf74e-ba28-466c-8e95-115c7e7e30b0 service nova] [instance: a4cdcb5b-b2a6-4736-85c8-7e6cdab8c9b1] No waiting events found dispatching network-vif-plugged-07d06a88-cd34-412f-9b4d-b9fa94247dd4 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:11:15 user nova-compute[85141]: WARNING nova.compute.manager [req-f5a603fa-28b6-48ac-b2a2-379ae4cae6db req-9dfdf74e-ba28-466c-8e95-115c7e7e30b0 service nova] [instance: a4cdcb5b-b2a6-4736-85c8-7e6cdab8c9b1] Received unexpected event network-vif-plugged-07d06a88-cd34-412f-9b4d-b9fa94247dd4 for instance with vm_state active and task_state None.
Nov 16 10:11:15 user nova-compute[85141]: DEBUG nova.compute.manager [req-f5a603fa-28b6-48ac-b2a2-379ae4cae6db req-9dfdf74e-ba28-466c-8e95-115c7e7e30b0 service nova] [instance: a4cdcb5b-b2a6-4736-85c8-7e6cdab8c9b1] Received event network-vif-plugged-07d06a88-cd34-412f-9b4d-b9fa94247dd4 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:11:15 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-f5a603fa-28b6-48ac-b2a2-379ae4cae6db req-9dfdf74e-ba28-466c-8e95-115c7e7e30b0 service nova] Acquiring lock "a4cdcb5b-b2a6-4736-85c8-7e6cdab8c9b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:11:15 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-f5a603fa-28b6-48ac-b2a2-379ae4cae6db req-9dfdf74e-ba28-466c-8e95-115c7e7e30b0 service nova] Lock "a4cdcb5b-b2a6-4736-85c8-7e6cdab8c9b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:11:15 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-f5a603fa-28b6-48ac-b2a2-379ae4cae6db req-9dfdf74e-ba28-466c-8e95-115c7e7e30b0 service nova] Lock "a4cdcb5b-b2a6-4736-85c8-7e6cdab8c9b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:11:15 user nova-compute[85141]: DEBUG nova.compute.manager [req-f5a603fa-28b6-48ac-b2a2-379ae4cae6db req-9dfdf74e-ba28-466c-8e95-115c7e7e30b0 service nova] [instance: a4cdcb5b-b2a6-4736-85c8-7e6cdab8c9b1] No waiting events found dispatching network-vif-plugged-07d06a88-cd34-412f-9b4d-b9fa94247dd4 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:11:15 user nova-compute[85141]: WARNING nova.compute.manager [req-f5a603fa-28b6-48ac-b2a2-379ae4cae6db req-9dfdf74e-ba28-466c-8e95-115c7e7e30b0 service nova] [instance: a4cdcb5b-b2a6-4736-85c8-7e6cdab8c9b1] Received unexpected event network-vif-plugged-07d06a88-cd34-412f-9b4d-b9fa94247dd4 for instance with vm_state active and task_state None.
Nov 16 10:11:15 user nova-compute[85141]: INFO nova.compute.manager [None req-d75ac365-ae12-46bf-bb9b-1ef1096b5aae tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] [instance: 6caf3667-5613-4ef4-a597-1820e6c1c0ac] Took 8.53 seconds to spawn the instance on the hypervisor.
Nov 16 10:11:15 user nova-compute[85141]: DEBUG nova.compute.manager [None req-d75ac365-ae12-46bf-bb9b-1ef1096b5aae tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] [instance: 6caf3667-5613-4ef4-a597-1820e6c1c0ac] Checking state {{(pid=85141) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 10:11:15 user nova-compute[85141]: DEBUG nova.network.neutron [req-f88d5be5-4110-4b0b-b0ea-af17007187e8 req-b680ea20-41d1-416a-9dd8-d666cb55fdbe service nova] [instance: 8f872e56-0fdc-4d3c-ab3d-64497d036dc8] Updated VIF entry in instance network info cache for port d2be9459-4384-4c88-931b-098de7e2413d. {{(pid=85141) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 10:11:15 user nova-compute[85141]: DEBUG nova.network.neutron [req-f88d5be5-4110-4b0b-b0ea-af17007187e8 req-b680ea20-41d1-416a-9dd8-d666cb55fdbe service nova] [instance: 8f872e56-0fdc-4d3c-ab3d-64497d036dc8] Updating instance_info_cache with network_info: [{"id": "d2be9459-4384-4c88-931b-098de7e2413d", "address": "fa:16:3e:7d:fc:b3", "network": {"id": "20b79aa8-c67e-4ab4-aa9f-659587f8bcb2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1635312124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b35983b98d3c404d8cddce2894f97dba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2be9459-43", "ovs_interfaceid": "d2be9459-4384-4c88-931b-098de7e2413d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:11:15 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-f88d5be5-4110-4b0b-b0ea-af17007187e8 req-b680ea20-41d1-416a-9dd8-d666cb55fdbe service nova] Releasing lock "refresh_cache-8f872e56-0fdc-4d3c-ab3d-64497d036dc8" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:11:15 user nova-compute[85141]: INFO nova.compute.manager [None req-d75ac365-ae12-46bf-bb9b-1ef1096b5aae tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] [instance: 6caf3667-5613-4ef4-a597-1820e6c1c0ac] Took 21.17 seconds to build instance.
Nov 16 10:11:15 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-d75ac365-ae12-46bf-bb9b-1ef1096b5aae tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] Lock "6caf3667-5613-4ef4-a597-1820e6c1c0ac" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 22.110s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:11:15 user nova-compute[85141]: DEBUG nova.compute.manager [None req-6acf2501-2e40-4328-bd23-587ad59bd8d1 tempest-VolumesAssistedSnapshotsTest-1194404756 tempest-VolumesAssistedSnapshotsTest-1194404756-project-member] [instance: 7e2ae11f-161c-4d13-a1a5-37d0a8150e6b] Instance event wait completed in 0 seconds for  {{(pid=85141) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 10:11:15 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-6acf2501-2e40-4328-bd23-587ad59bd8d1 tempest-VolumesAssistedSnapshotsTest-1194404756 tempest-VolumesAssistedSnapshotsTest-1194404756-project-member] [instance: 7e2ae11f-161c-4d13-a1a5-37d0a8150e6b] Guest created on hypervisor {{(pid=85141) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 10:11:15 user nova-compute[85141]: INFO nova.virt.libvirt.driver [-] [instance: 7e2ae11f-161c-4d13-a1a5-37d0a8150e6b] Instance spawned successfully.
Nov 16 10:11:15 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-6acf2501-2e40-4328-bd23-587ad59bd8d1 tempest-VolumesAssistedSnapshotsTest-1194404756 tempest-VolumesAssistedSnapshotsTest-1194404756-project-member] [instance: 7e2ae11f-161c-4d13-a1a5-37d0a8150e6b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 10:11:15 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-6acf2501-2e40-4328-bd23-587ad59bd8d1 tempest-VolumesAssistedSnapshotsTest-1194404756 tempest-VolumesAssistedSnapshotsTest-1194404756-project-member] [instance: 7e2ae11f-161c-4d13-a1a5-37d0a8150e6b] Found default for hw_cdrom_bus of ide {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:11:15 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-6acf2501-2e40-4328-bd23-587ad59bd8d1 tempest-VolumesAssistedSnapshotsTest-1194404756 tempest-VolumesAssistedSnapshotsTest-1194404756-project-member] [instance: 7e2ae11f-161c-4d13-a1a5-37d0a8150e6b] Found default for hw_disk_bus of virtio {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:11:15 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-6acf2501-2e40-4328-bd23-587ad59bd8d1 tempest-VolumesAssistedSnapshotsTest-1194404756 tempest-VolumesAssistedSnapshotsTest-1194404756-project-member] [instance: 7e2ae11f-161c-4d13-a1a5-37d0a8150e6b] Found default for hw_input_bus of None {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:11:15 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-6acf2501-2e40-4328-bd23-587ad59bd8d1 tempest-VolumesAssistedSnapshotsTest-1194404756 tempest-VolumesAssistedSnapshotsTest-1194404756-project-member] [instance: 7e2ae11f-161c-4d13-a1a5-37d0a8150e6b] Found default for hw_pointer_model of None {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:11:15 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-6acf2501-2e40-4328-bd23-587ad59bd8d1 tempest-VolumesAssistedSnapshotsTest-1194404756 tempest-VolumesAssistedSnapshotsTest-1194404756-project-member] [instance: 7e2ae11f-161c-4d13-a1a5-37d0a8150e6b] Found default for hw_video_model of virtio {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:11:15 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-6acf2501-2e40-4328-bd23-587ad59bd8d1 tempest-VolumesAssistedSnapshotsTest-1194404756 tempest-VolumesAssistedSnapshotsTest-1194404756-project-member] [instance: 7e2ae11f-161c-4d13-a1a5-37d0a8150e6b] Found default for hw_vif_model of virtio {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:11:16 user nova-compute[85141]: INFO nova.compute.manager [None req-6acf2501-2e40-4328-bd23-587ad59bd8d1 tempest-VolumesAssistedSnapshotsTest-1194404756 tempest-VolumesAssistedSnapshotsTest-1194404756-project-member] [instance: 7e2ae11f-161c-4d13-a1a5-37d0a8150e6b] Took 9.15 seconds to spawn the instance on the hypervisor.
Nov 16 10:11:16 user nova-compute[85141]: DEBUG nova.compute.manager [None req-6acf2501-2e40-4328-bd23-587ad59bd8d1 tempest-VolumesAssistedSnapshotsTest-1194404756 tempest-VolumesAssistedSnapshotsTest-1194404756-project-member] [instance: 7e2ae11f-161c-4d13-a1a5-37d0a8150e6b] Checking state {{(pid=85141) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 10:11:16 user nova-compute[85141]: INFO nova.compute.manager [None req-6acf2501-2e40-4328-bd23-587ad59bd8d1 tempest-VolumesAssistedSnapshotsTest-1194404756 tempest-VolumesAssistedSnapshotsTest-1194404756-project-member] [instance: 7e2ae11f-161c-4d13-a1a5-37d0a8150e6b] Took 10.96 seconds to build instance.
Nov 16 10:11:16 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-6acf2501-2e40-4328-bd23-587ad59bd8d1 tempest-VolumesAssistedSnapshotsTest-1194404756 tempest-VolumesAssistedSnapshotsTest-1194404756-project-member] Lock "7e2ae11f-161c-4d13-a1a5-37d0a8150e6b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.123s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:11:16 user nova-compute[85141]: DEBUG nova.compute.manager [req-0294f97d-f80b-45ce-b7a7-83cac8802da9 req-98feeab9-b621-47dd-9879-9740a03aeec9 service nova] [instance: ff964caf-b473-47bc-89d2-f7189264721c] Received event network-vif-plugged-75922f14-4d10-428a-baf5-bc27dfa373a6 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:11:16 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-0294f97d-f80b-45ce-b7a7-83cac8802da9 req-98feeab9-b621-47dd-9879-9740a03aeec9 service nova] Acquiring lock "ff964caf-b473-47bc-89d2-f7189264721c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:11:16 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-0294f97d-f80b-45ce-b7a7-83cac8802da9 req-98feeab9-b621-47dd-9879-9740a03aeec9 service nova] Lock "ff964caf-b473-47bc-89d2-f7189264721c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:11:16 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-0294f97d-f80b-45ce-b7a7-83cac8802da9 req-98feeab9-b621-47dd-9879-9740a03aeec9 service nova] Lock "ff964caf-b473-47bc-89d2-f7189264721c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:11:16 user nova-compute[85141]: DEBUG nova.compute.manager [req-0294f97d-f80b-45ce-b7a7-83cac8802da9 req-98feeab9-b621-47dd-9879-9740a03aeec9 service nova] [instance: ff964caf-b473-47bc-89d2-f7189264721c] No waiting events found dispatching network-vif-plugged-75922f14-4d10-428a-baf5-bc27dfa373a6 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:11:16 user nova-compute[85141]: WARNING nova.compute.manager [req-0294f97d-f80b-45ce-b7a7-83cac8802da9 req-98feeab9-b621-47dd-9879-9740a03aeec9 service nova] [instance: ff964caf-b473-47bc-89d2-f7189264721c] Received unexpected event network-vif-plugged-75922f14-4d10-428a-baf5-bc27dfa373a6 for instance with vm_state active and task_state None.
Nov 16 10:11:16 user nova-compute[85141]: DEBUG nova.compute.manager [req-0294f97d-f80b-45ce-b7a7-83cac8802da9 req-98feeab9-b621-47dd-9879-9740a03aeec9 service nova] [instance: ff964caf-b473-47bc-89d2-f7189264721c] Received event network-vif-plugged-75922f14-4d10-428a-baf5-bc27dfa373a6 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:11:16 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-0294f97d-f80b-45ce-b7a7-83cac8802da9 req-98feeab9-b621-47dd-9879-9740a03aeec9 service nova] Acquiring lock "ff964caf-b473-47bc-89d2-f7189264721c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:11:16 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-0294f97d-f80b-45ce-b7a7-83cac8802da9 req-98feeab9-b621-47dd-9879-9740a03aeec9 service nova] Lock "ff964caf-b473-47bc-89d2-f7189264721c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:11:16 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-0294f97d-f80b-45ce-b7a7-83cac8802da9 req-98feeab9-b621-47dd-9879-9740a03aeec9 service nova] Lock "ff964caf-b473-47bc-89d2-f7189264721c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:11:16 user nova-compute[85141]: DEBUG nova.compute.manager [req-0294f97d-f80b-45ce-b7a7-83cac8802da9 req-98feeab9-b621-47dd-9879-9740a03aeec9 service nova] [instance: ff964caf-b473-47bc-89d2-f7189264721c] No waiting events found dispatching network-vif-plugged-75922f14-4d10-428a-baf5-bc27dfa373a6 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:11:16 user nova-compute[85141]: WARNING nova.compute.manager [req-0294f97d-f80b-45ce-b7a7-83cac8802da9 req-98feeab9-b621-47dd-9879-9740a03aeec9 service nova] [instance: ff964caf-b473-47bc-89d2-f7189264721c] Received unexpected event network-vif-plugged-75922f14-4d10-428a-baf5-bc27dfa373a6 for instance with vm_state active and task_state None.
Nov 16 10:11:16 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:11:16 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:11:16 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:11:16 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:11:17 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:11:17 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Starting heal instance info cache {{(pid=85141) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 10:11:17 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Rebuilding the list of instances to heal {{(pid=85141) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 10:11:17 user nova-compute[85141]: DEBUG nova.compute.manager [req-b74a43c9-7c2a-437e-9ca0-aa54906f6280 req-a9741e5d-8e5f-4055-b3c4-7413a4a73ebd service nova] [instance: 8f872e56-0fdc-4d3c-ab3d-64497d036dc8] Received event network-vif-plugged-d2be9459-4384-4c88-931b-098de7e2413d {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:11:17 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-b74a43c9-7c2a-437e-9ca0-aa54906f6280 req-a9741e5d-8e5f-4055-b3c4-7413a4a73ebd service nova] Acquiring lock "8f872e56-0fdc-4d3c-ab3d-64497d036dc8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:11:17 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-b74a43c9-7c2a-437e-9ca0-aa54906f6280 req-a9741e5d-8e5f-4055-b3c4-7413a4a73ebd service nova] Lock "8f872e56-0fdc-4d3c-ab3d-64497d036dc8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:11:17 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-b74a43c9-7c2a-437e-9ca0-aa54906f6280 req-a9741e5d-8e5f-4055-b3c4-7413a4a73ebd service nova] Lock "8f872e56-0fdc-4d3c-ab3d-64497d036dc8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:11:17 user nova-compute[85141]: DEBUG nova.compute.manager [req-b74a43c9-7c2a-437e-9ca0-aa54906f6280 req-a9741e5d-8e5f-4055-b3c4-7413a4a73ebd service nova] [instance: 8f872e56-0fdc-4d3c-ab3d-64497d036dc8] No waiting events found dispatching network-vif-plugged-d2be9459-4384-4c88-931b-098de7e2413d {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:11:17 user nova-compute[85141]: WARNING nova.compute.manager [req-b74a43c9-7c2a-437e-9ca0-aa54906f6280 req-a9741e5d-8e5f-4055-b3c4-7413a4a73ebd service nova] [instance: 8f872e56-0fdc-4d3c-ab3d-64497d036dc8] Received unexpected event network-vif-plugged-d2be9459-4384-4c88-931b-098de7e2413d for instance with vm_state building and task_state spawning.
Nov 16 10:11:17 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] [instance: 8f872e56-0fdc-4d3c-ab3d-64497d036dc8] Skipping network cache update for instance because it is Building. {{(pid=85141) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 16 10:11:17 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Acquiring lock "refresh_cache-a4cdcb5b-b2a6-4736-85c8-7e6cdab8c9b1" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:11:17 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Acquired lock "refresh_cache-a4cdcb5b-b2a6-4736-85c8-7e6cdab8c9b1" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:11:17 user nova-compute[85141]: DEBUG nova.network.neutron [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] [instance: a4cdcb5b-b2a6-4736-85c8-7e6cdab8c9b1] Forcefully refreshing network info cache for instance {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 10:11:17 user nova-compute[85141]: DEBUG nova.objects.instance [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lazy-loading 'info_cache' on Instance uuid a4cdcb5b-b2a6-4736-85c8-7e6cdab8c9b1 {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:11:17 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:11:17 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:11:17 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:11:18 user nova-compute[85141]: DEBUG nova.network.neutron [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] [instance: a4cdcb5b-b2a6-4736-85c8-7e6cdab8c9b1] Updating instance_info_cache with network_info: [{"id": "07d06a88-cd34-412f-9b4d-b9fa94247dd4", "address": "fa:16:3e:72:f5:ea", "network": {"id": "880d7e11-048f-4333-95ad-bdd45e8dcdb4", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1972699698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f28c73b00ca42309f0b679aa6f3c462", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07d06a88-cd", "ovs_interfaceid": "07d06a88-cd34-412f-9b4d-b9fa94247dd4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:11:18 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Releasing lock "refresh_cache-a4cdcb5b-b2a6-4736-85c8-7e6cdab8c9b1" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:11:18 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] [instance: a4cdcb5b-b2a6-4736-85c8-7e6cdab8c9b1] Updated the network info_cache for instance {{(pid=85141) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 10:11:18 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:11:18 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:11:18 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:11:18 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=85141) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 10:11:18 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager.update_available_resource {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:11:18 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:11:18 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:11:18 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:11:18 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Auditing locally available compute resources for user (node: user) {{(pid=85141) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 10:11:18 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e65ccf79-718d-4eeb-8914-f0db2e2c9ce2/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:11:19 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e65ccf79-718d-4eeb-8914-f0db2e2c9ce2/disk --force-share --output=json" returned: 0 in 0.272s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:11:19 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e65ccf79-718d-4eeb-8914-f0db2e2c9ce2/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:11:19 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e65ccf79-718d-4eeb-8914-f0db2e2c9ce2/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:11:19 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/361a2044-8fd0-4975-8a19-814bf7a6da41/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:11:19 user nova-compute[85141]: DEBUG nova.compute.manager [req-fd916a8b-a9ad-4bf7-ab43-d77f5058b812 req-8b5cf285-65a9-4e63-8dbc-bf62969b20cf service nova] [instance: 8f872e56-0fdc-4d3c-ab3d-64497d036dc8] Received event network-vif-plugged-d2be9459-4384-4c88-931b-098de7e2413d {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:11:19 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-fd916a8b-a9ad-4bf7-ab43-d77f5058b812 req-8b5cf285-65a9-4e63-8dbc-bf62969b20cf service nova] Acquiring lock "8f872e56-0fdc-4d3c-ab3d-64497d036dc8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:11:19 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-fd916a8b-a9ad-4bf7-ab43-d77f5058b812 req-8b5cf285-65a9-4e63-8dbc-bf62969b20cf service nova] Lock "8f872e56-0fdc-4d3c-ab3d-64497d036dc8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:11:19 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-fd916a8b-a9ad-4bf7-ab43-d77f5058b812 req-8b5cf285-65a9-4e63-8dbc-bf62969b20cf service nova] Lock "8f872e56-0fdc-4d3c-ab3d-64497d036dc8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:11:19 user nova-compute[85141]: DEBUG nova.compute.manager [req-fd916a8b-a9ad-4bf7-ab43-d77f5058b812 req-8b5cf285-65a9-4e63-8dbc-bf62969b20cf service nova] [instance: 8f872e56-0fdc-4d3c-ab3d-64497d036dc8] No waiting events found dispatching network-vif-plugged-d2be9459-4384-4c88-931b-098de7e2413d {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:11:19 user nova-compute[85141]: WARNING nova.compute.manager [req-fd916a8b-a9ad-4bf7-ab43-d77f5058b812 req-8b5cf285-65a9-4e63-8dbc-bf62969b20cf service nova] [instance: 8f872e56-0fdc-4d3c-ab3d-64497d036dc8] Received unexpected event network-vif-plugged-d2be9459-4384-4c88-931b-098de7e2413d for instance with vm_state building and task_state spawning.
Nov 16 10:11:19 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/361a2044-8fd0-4975-8a19-814bf7a6da41/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:11:19 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/361a2044-8fd0-4975-8a19-814bf7a6da41/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:11:19 user nova-compute[85141]: DEBUG nova.compute.manager [None req-1faaad7c-400b-43c4-a32e-b69cf738d31d tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] [instance: 8f872e56-0fdc-4d3c-ab3d-64497d036dc8] Instance event wait completed in 0 seconds for  {{(pid=85141) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 10:11:19 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-1faaad7c-400b-43c4-a32e-b69cf738d31d tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] [instance: 8f872e56-0fdc-4d3c-ab3d-64497d036dc8] Guest created on hypervisor {{(pid=85141) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 10:11:19 user nova-compute[85141]: INFO nova.virt.libvirt.driver [-] [instance: 8f872e56-0fdc-4d3c-ab3d-64497d036dc8] Instance spawned successfully.
Nov 16 10:11:19 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-1faaad7c-400b-43c4-a32e-b69cf738d31d tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] [instance: 8f872e56-0fdc-4d3c-ab3d-64497d036dc8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 10:11:19 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/361a2044-8fd0-4975-8a19-814bf7a6da41/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:11:19 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ca61bd2-268e-4c49-ba04-a5cb39143a9b/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:11:19 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-1faaad7c-400b-43c4-a32e-b69cf738d31d tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] [instance: 8f872e56-0fdc-4d3c-ab3d-64497d036dc8] Found default for hw_cdrom_bus of ide {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:11:19 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-1faaad7c-400b-43c4-a32e-b69cf738d31d tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] [instance: 8f872e56-0fdc-4d3c-ab3d-64497d036dc8] Found default for hw_disk_bus of virtio {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:11:19 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-1faaad7c-400b-43c4-a32e-b69cf738d31d tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] [instance: 8f872e56-0fdc-4d3c-ab3d-64497d036dc8] Found default for hw_input_bus of None {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:11:19 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-1faaad7c-400b-43c4-a32e-b69cf738d31d tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] [instance: 8f872e56-0fdc-4d3c-ab3d-64497d036dc8] Found default for hw_pointer_model of None {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:11:19 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-1faaad7c-400b-43c4-a32e-b69cf738d31d tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] [instance: 8f872e56-0fdc-4d3c-ab3d-64497d036dc8] Found default for hw_video_model of virtio {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:11:19 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-1faaad7c-400b-43c4-a32e-b69cf738d31d tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] [instance: 8f872e56-0fdc-4d3c-ab3d-64497d036dc8] Found default for hw_vif_model of virtio {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:11:20 user nova-compute[85141]: INFO nova.compute.manager [None req-1faaad7c-400b-43c4-a32e-b69cf738d31d tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] [instance: 8f872e56-0fdc-4d3c-ab3d-64497d036dc8] Took 8.42 seconds to spawn the instance on the hypervisor.
Nov 16 10:11:20 user nova-compute[85141]: DEBUG nova.compute.manager [None req-1faaad7c-400b-43c4-a32e-b69cf738d31d tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] [instance: 8f872e56-0fdc-4d3c-ab3d-64497d036dc8] Checking state {{(pid=85141) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 10:11:20 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ca61bd2-268e-4c49-ba04-a5cb39143a9b/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:11:20 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ca61bd2-268e-4c49-ba04-a5cb39143a9b/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:11:20 user nova-compute[85141]: INFO nova.compute.manager [None req-1faaad7c-400b-43c4-a32e-b69cf738d31d tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] [instance: 8f872e56-0fdc-4d3c-ab3d-64497d036dc8] Took 9.92 seconds to build instance.
Nov 16 10:11:20 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-1faaad7c-400b-43c4-a32e-b69cf738d31d tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] Lock "8f872e56-0fdc-4d3c-ab3d-64497d036dc8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.097s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:11:20 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:11:20 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] Acquiring lock "eef3cc09-054b-4a17-b621-4f3737d5420e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:11:20 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] Lock "eef3cc09-054b-4a17-b621-4f3737d5420e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:11:20 user nova-compute[85141]: DEBUG nova.compute.manager [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] [instance: eef3cc09-054b-4a17-b621-4f3737d5420e] Starting instance... {{(pid=85141) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 10:11:20 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ca61bd2-268e-4c49-ba04-a5cb39143a9b/disk --force-share --output=json" returned: 0 in 0.257s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:11:20 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d842f90e-663b-4c95-9d7c-d092d2bac41f/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:11:20 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:11:20 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:11:20 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=85141) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 10:11:20 user nova-compute[85141]: INFO nova.compute.claims [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] [instance: eef3cc09-054b-4a17-b621-4f3737d5420e] Claim successful on node user
Nov 16 10:11:20 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d842f90e-663b-4c95-9d7c-d092d2bac41f/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:11:20 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d842f90e-663b-4c95-9d7c-d092d2bac41f/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:11:20 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d842f90e-663b-4c95-9d7c-d092d2bac41f/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:11:20 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9411843f-4e79-46c4-ae02-01f5e87b86eb/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:11:21 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9411843f-4e79-46c4-ae02-01f5e87b86eb/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:11:21 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9411843f-4e79-46c4-ae02-01f5e87b86eb/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:11:21 user nova-compute[85141]: DEBUG nova.compute.provider_tree [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] Inventory has not changed in ProviderTree for provider: bf8e0fa1-16b6-408f-9203-c4cd63916272 {{(pid=85141) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 10:11:21 user nova-compute[85141]: DEBUG nova.scheduler.client.report [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] Inventory has not changed for provider bf8e0fa1-16b6-408f-9203-c4cd63916272 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=85141) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 10:11:21 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.735s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:11:21 user nova-compute[85141]: DEBUG nova.compute.manager [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] [instance: eef3cc09-054b-4a17-b621-4f3737d5420e] Start building networks asynchronously for instance. {{(pid=85141) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 10:11:21 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9411843f-4e79-46c4-ae02-01f5e87b86eb/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:11:21 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff964caf-b473-47bc-89d2-f7189264721c/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:11:21 user nova-compute[85141]: DEBUG nova.compute.manager [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] [instance: eef3cc09-054b-4a17-b621-4f3737d5420e] Allocating IP information in the background. {{(pid=85141) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 10:11:21 user nova-compute[85141]: DEBUG nova.network.neutron [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] [instance: eef3cc09-054b-4a17-b621-4f3737d5420e] allocate_for_instance() {{(pid=85141) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 10:11:21 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] [instance: eef3cc09-054b-4a17-b621-4f3737d5420e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 10:11:21 user nova-compute[85141]: DEBUG nova.compute.manager [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] [instance: eef3cc09-054b-4a17-b621-4f3737d5420e] Start building block device mappings for instance. {{(pid=85141) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 10:11:21 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff964caf-b473-47bc-89d2-f7189264721c/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:11:21 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff964caf-b473-47bc-89d2-f7189264721c/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:11:21 user nova-compute[85141]: INFO nova.virt.block_device [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] [instance: eef3cc09-054b-4a17-b621-4f3737d5420e] Booting with volume b4df10d9-a60c-45ed-981d-96f704534fb8 at /dev/vda
Nov 16 10:11:21 user nova-compute[85141]: DEBUG nova.policy [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8b186b80e92e41878b8ab7e839181fca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eafaf607b5ff4b448aaaea253a321827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85141) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 10:11:21 user nova-compute[85141]: DEBUG os_brick.utils [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 10:11:21 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:11:21 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff964caf-b473-47bc-89d2-f7189264721c/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:11:21 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:11:21 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c72c593-1601-4874-a81d-47d7723fdfa5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c7834de5c295\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:11:21 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:11:21 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad1ace46-2e8e-42e1-a0f5-2384078fcf09/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:11:21 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:11:21 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[190f9dcd-975f-4736-a314-3413f395c2f8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:11:21 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:11:21 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:11:21 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cc36ad8-57ac-47b8-88ee-8fbd563b1512]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:11:21 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9119085-cb7a-4d5d-9ade-36d9d8192599]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:11:21 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] Running cmd (subprocess): nvme version {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:11:21 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] 'nvme version' failed. Not Retrying. {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 10:11:21 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.nvmeof [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] nvme not present on system {{(pid=85141) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 10:11:21 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:11:21 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 10:11:21 user nova-compute[85141]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 10:11:21 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b81bf55-d3c7-4ef3-8430-6b14a7a9bdec]: (4, '') {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:11:21 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.lightos [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=85141) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 10:11:21 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.lightos [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=85141) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 10:11:21 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.lightos [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] LIGHTOS: no hostnqn found. {{(pid=85141) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 10:11:21 user nova-compute[85141]: DEBUG os_brick.utils [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] <== get_connector_properties: return (160ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c7834de5c295', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 10:11:21 user nova-compute[85141]: DEBUG nova.virt.block_device [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] [instance: eef3cc09-054b-4a17-b621-4f3737d5420e] Updating existing volume attachment record: 57718aa2-7e17-4dee-a89b-d744d1cbbef6 {{(pid=85141) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 10:11:21 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad1ace46-2e8e-42e1-a0f5-2384078fcf09/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:11:21 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad1ace46-2e8e-42e1-a0f5-2384078fcf09/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:11:21 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:11:22 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad1ace46-2e8e-42e1-a0f5-2384078fcf09/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:11:22 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4cdcb5b-b2a6-4736-85c8-7e6cdab8c9b1/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:11:22 user nova-compute[85141]: DEBUG nova.network.neutron [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] [instance: eef3cc09-054b-4a17-b621-4f3737d5420e] Successfully created port: 277c1d3d-ed49-4b8c-82e3-902fa6c8a2f5 {{(pid=85141) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 10:11:22 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4cdcb5b-b2a6-4736-85c8-7e6cdab8c9b1/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:11:22 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4cdcb5b-b2a6-4736-85c8-7e6cdab8c9b1/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:11:22 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4cdcb5b-b2a6-4736-85c8-7e6cdab8c9b1/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:11:22 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=85141) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 10:11:22 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e2ae11f-161c-4d13-a1a5-37d0a8150e6b/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:11:22 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e2ae11f-161c-4d13-a1a5-37d0a8150e6b/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:11:22 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e2ae11f-161c-4d13-a1a5-37d0a8150e6b/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:11:23 user nova-compute[85141]: DEBUG nova.network.neutron [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] [instance: eef3cc09-054b-4a17-b621-4f3737d5420e] Successfully created port: d6b517e2-8788-4775-b327-11601713da4d {{(pid=85141) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 10:11:23 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e2ae11f-161c-4d13-a1a5-37d0a8150e6b/disk --force-share --output=json" returned: 0 in 0.265s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:11:23 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f872e56-0fdc-4d3c-ab3d-64497d036dc8/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:11:23 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f872e56-0fdc-4d3c-ab3d-64497d036dc8/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:11:23 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f872e56-0fdc-4d3c-ab3d-64497d036dc8/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:11:23 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f872e56-0fdc-4d3c-ab3d-64497d036dc8/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:11:24 user nova-compute[85141]: DEBUG nova.network.neutron [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] [instance: eef3cc09-054b-4a17-b621-4f3737d5420e] Successfully created port: 0c9cc79d-1ded-40cc-84fc-f6b70a9bb555 {{(pid=85141) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 10:11:24 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:11:24 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:11:24 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Hypervisor/Node resource view: name=user free_ram=7331MB free_disk=25.593246459960938GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=85141) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 10:11:24 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:11:24 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:11:24 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance a4cdcb5b-b2a6-4736-85c8-7e6cdab8c9b1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:11:24 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance 9411843f-4e79-46c4-ae02-01f5e87b86eb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:11:24 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance d842f90e-663b-4c95-9d7c-d092d2bac41f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:11:24 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance e65ccf79-718d-4eeb-8914-f0db2e2c9ce2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:11:24 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance 361a2044-8fd0-4975-8a19-814bf7a6da41 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:11:24 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance ad1ace46-2e8e-42e1-a0f5-2384078fcf09 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:11:24 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance ff964caf-b473-47bc-89d2-f7189264721c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:11:24 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance 0ca61bd2-268e-4c49-ba04-a5cb39143a9b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:11:24 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance 6caf3667-5613-4ef4-a597-1820e6c1c0ac actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:11:24 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance 7e2ae11f-161c-4d13-a1a5-37d0a8150e6b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:11:24 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance 8f872e56-0fdc-4d3c-ab3d-64497d036dc8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:11:24 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance eef3cc09-054b-4a17-b621-4f3737d5420e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:11:24 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=85141) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 10:11:24 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=85141) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 10:11:24 user nova-compute[85141]: DEBUG nova.scheduler.client.report [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Refreshing inventories for resource provider bf8e0fa1-16b6-408f-9203-c4cd63916272 {{(pid=85141) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 16 10:11:24 user nova-compute[85141]: DEBUG nova.scheduler.client.report [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Updating ProviderTree inventory for provider bf8e0fa1-16b6-408f-9203-c4cd63916272 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=85141) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 16 10:11:24 user nova-compute[85141]: DEBUG nova.compute.provider_tree [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Updating inventory in ProviderTree for provider bf8e0fa1-16b6-408f-9203-c4cd63916272 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=85141) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 16 10:11:24 user nova-compute[85141]: DEBUG nova.scheduler.client.report [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Refreshing aggregate associations for resource provider bf8e0fa1-16b6-408f-9203-c4cd63916272, aggregates: None {{(pid=85141) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 16 10:11:24 user nova-compute[85141]: DEBUG nova.network.neutron [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] [instance: eef3cc09-054b-4a17-b621-4f3737d5420e] Successfully created port: b0183e60-7f49-44a1-a24c-30db287f2453 {{(pid=85141) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 10:11:24 user nova-compute[85141]: DEBUG nova.scheduler.client.report [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Refreshing trait associations for resource provider bf8e0fa1-16b6-408f-9203-c4cd63916272, traits: COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE41,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_ACCELERATORS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_USB,COMPUTE_TRUSTED_CERTS,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_RESCUE_BFV,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VOLUME_ATTACH_WITH_TAG {{(pid=85141) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 16 10:11:25 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:11:25 user nova-compute[85141]: DEBUG nova.compute.provider_tree [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Inventory has not changed in ProviderTree for provider: bf8e0fa1-16b6-408f-9203-c4cd63916272 {{(pid=85141) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 10:11:25 user nova-compute[85141]: DEBUG nova.scheduler.client.report [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Inventory has not changed for provider bf8e0fa1-16b6-408f-9203-c4cd63916272 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=85141) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 10:11:25 user nova-compute[85141]: DEBUG nova.network.neutron [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] [instance: eef3cc09-054b-4a17-b621-4f3737d5420e] Successfully created port: 21180772-80b3-48e1-90e9-39590611ff08 {{(pid=85141) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 10:11:25 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Compute_service record updated for user:user {{(pid=85141) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 10:11:25 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.302s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:11:25 user nova-compute[85141]: DEBUG nova.network.neutron [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] [instance: eef3cc09-054b-4a17-b621-4f3737d5420e] Successfully updated port: 277c1d3d-ed49-4b8c-82e3-902fa6c8a2f5 {{(pid=85141) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 10:11:26 user nova-compute[85141]: DEBUG nova.compute.manager [req-91d90142-4163-4489-b538-2e9b461450f4 req-02970d15-82ce-4d81-a592-2f39463d5c6f service nova] [instance: eef3cc09-054b-4a17-b621-4f3737d5420e] Received event network-changed-277c1d3d-ed49-4b8c-82e3-902fa6c8a2f5 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:11:26 user nova-compute[85141]: DEBUG nova.compute.manager [req-91d90142-4163-4489-b538-2e9b461450f4 req-02970d15-82ce-4d81-a592-2f39463d5c6f service nova] [instance: eef3cc09-054b-4a17-b621-4f3737d5420e] Refreshing instance network info cache due to event network-changed-277c1d3d-ed49-4b8c-82e3-902fa6c8a2f5. {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 10:11:26 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-91d90142-4163-4489-b538-2e9b461450f4 req-02970d15-82ce-4d81-a592-2f39463d5c6f service nova] Acquiring lock "refresh_cache-eef3cc09-054b-4a17-b621-4f3737d5420e" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:11:26 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-91d90142-4163-4489-b538-2e9b461450f4 req-02970d15-82ce-4d81-a592-2f39463d5c6f service nova] Acquired lock "refresh_cache-eef3cc09-054b-4a17-b621-4f3737d5420e" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:11:26 user nova-compute[85141]: DEBUG nova.network.neutron [req-91d90142-4163-4489-b538-2e9b461450f4 req-02970d15-82ce-4d81-a592-2f39463d5c6f service nova] [instance: eef3cc09-054b-4a17-b621-4f3737d5420e] Refreshing network info cache for port 277c1d3d-ed49-4b8c-82e3-902fa6c8a2f5 {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 10:11:26 user nova-compute[85141]: DEBUG nova.network.neutron [req-91d90142-4163-4489-b538-2e9b461450f4 req-02970d15-82ce-4d81-a592-2f39463d5c6f service nova] [instance: eef3cc09-054b-4a17-b621-4f3737d5420e] Instance cache missing network info. {{(pid=85141) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 10:11:26 user nova-compute[85141]: DEBUG nova.network.neutron [req-91d90142-4163-4489-b538-2e9b461450f4 req-02970d15-82ce-4d81-a592-2f39463d5c6f service nova] [instance: eef3cc09-054b-4a17-b621-4f3737d5420e] Updating instance_info_cache with network_info: [] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:11:26 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-91d90142-4163-4489-b538-2e9b461450f4 req-02970d15-82ce-4d81-a592-2f39463d5c6f service nova] Releasing lock "refresh_cache-eef3cc09-054b-4a17-b621-4f3737d5420e" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:11:26 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:11:27 user nova-compute[85141]: DEBUG nova.network.neutron [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] [instance: eef3cc09-054b-4a17-b621-4f3737d5420e] Successfully updated port: f742ff18-5ea3-42a0-b229-27a32badce8a {{(pid=85141) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 10:11:27 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:11:27 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:11:27 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:11:27 user nova-compute[85141]: INFO nova.virt.block_device [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] [instance: eef3cc09-054b-4a17-b621-4f3737d5420e] Booting with volume 4973f768-f126-41d6-b534-458d6c49f9b3 at /dev/vdb
Nov 16 10:11:27 user nova-compute[85141]: DEBUG os_brick.utils [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 10:11:27 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:11:27 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.028s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:11:27 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffc31809-b284-41c4-afd6-600d9bd0e91e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c7834de5c295\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:11:27 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:11:27 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:11:27 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2633e19-7621-426b-8d29-3712e39f1e38]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:11:27 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:11:27 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:11:27 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[659bbe90-939d-47cb-a654-3bbf25fcf851]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:11:27 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1b407a2-642a-4aa0-bc46-7e9a1b9c117d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:11:27 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] Running cmd (subprocess): nvme version {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:11:27 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] 'nvme version' failed. Not Retrying. {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 10:11:27 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.nvmeof [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] nvme not present on system {{(pid=85141) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 10:11:27 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:11:27 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 10:11:27 user nova-compute[85141]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 10:11:27 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[addf2e06-5d9c-40a1-b9c9-51f12a7ea5c1]: (4, '') {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:11:27 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.lightos [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=85141) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 10:11:27 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.lightos [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=85141) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 10:11:27 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.lightos [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] LIGHTOS: no hostnqn found. {{(pid=85141) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 10:11:27 user nova-compute[85141]: DEBUG os_brick.utils [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] <== get_connector_properties: return (148ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c7834de5c295', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 10:11:27 user nova-compute[85141]: DEBUG nova.virt.block_device [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] [instance: eef3cc09-054b-4a17-b621-4f3737d5420e] Updating existing volume attachment record: 22866058-ad85-4a88-9d63-76f491ae9e2c {{(pid=85141) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 10:11:28 user nova-compute[85141]: DEBUG nova.compute.manager [req-d309d6ec-fdfe-4e77-a05e-1e414ff6f50f req-da7e7107-1a8d-44c5-b1c1-4636ce285dd3 service nova] [instance: eef3cc09-054b-4a17-b621-4f3737d5420e] Received event network-changed-f742ff18-5ea3-42a0-b229-27a32badce8a {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:11:28 user nova-compute[85141]: DEBUG nova.compute.manager [req-d309d6ec-fdfe-4e77-a05e-1e414ff6f50f req-da7e7107-1a8d-44c5-b1c1-4636ce285dd3 service nova] [instance: eef3cc09-054b-4a17-b621-4f3737d5420e] Refreshing instance network info cache due to event network-changed-f742ff18-5ea3-42a0-b229-27a32badce8a. {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 10:11:28 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-d309d6ec-fdfe-4e77-a05e-1e414ff6f50f req-da7e7107-1a8d-44c5-b1c1-4636ce285dd3 service nova] Acquiring lock "refresh_cache-eef3cc09-054b-4a17-b621-4f3737d5420e" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:11:28 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-d309d6ec-fdfe-4e77-a05e-1e414ff6f50f req-da7e7107-1a8d-44c5-b1c1-4636ce285dd3 service nova] Acquired lock "refresh_cache-eef3cc09-054b-4a17-b621-4f3737d5420e" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:11:28 user nova-compute[85141]: DEBUG nova.network.neutron [req-d309d6ec-fdfe-4e77-a05e-1e414ff6f50f req-da7e7107-1a8d-44c5-b1c1-4636ce285dd3 service nova] [instance: eef3cc09-054b-4a17-b621-4f3737d5420e] Refreshing network info cache for port f742ff18-5ea3-42a0-b229-27a32badce8a {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 10:11:28 user nova-compute[85141]: DEBUG nova.network.neutron [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] [instance: eef3cc09-054b-4a17-b621-4f3737d5420e] Successfully updated port: 0f7c87ad-4076-4aca-8d9b-1fae099dd325 {{(pid=85141) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 10:11:28 user nova-compute[85141]: DEBUG nova.network.neutron [req-d309d6ec-fdfe-4e77-a05e-1e414ff6f50f req-da7e7107-1a8d-44c5-b1c1-4636ce285dd3 service nova] [instance: eef3cc09-054b-4a17-b621-4f3737d5420e] Instance cache missing network info. {{(pid=85141) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 10:11:28 user nova-compute[85141]: DEBUG nova.network.neutron [req-d309d6ec-fdfe-4e77-a05e-1e414ff6f50f req-da7e7107-1a8d-44c5-b1c1-4636ce285dd3 service nova] [instance: eef3cc09-054b-4a17-b621-4f3737d5420e] Updating instance_info_cache with network_info: [] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:11:28 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-d309d6ec-fdfe-4e77-a05e-1e414ff6f50f req-da7e7107-1a8d-44c5-b1c1-4636ce285dd3 service nova] Releasing lock "refresh_cache-eef3cc09-054b-4a17-b621-4f3737d5420e" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:11:28 user nova-compute[85141]: DEBUG nova.network.neutron [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] [instance: eef3cc09-054b-4a17-b621-4f3737d5420e] Successfully updated port: d6b517e2-8788-4775-b327-11601713da4d {{(pid=85141) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 10:11:29 user nova-compute[85141]: DEBUG nova.network.neutron [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] [instance: eef3cc09-054b-4a17-b621-4f3737d5420e] Successfully updated port: 0c9cc79d-1ded-40cc-84fc-f6b70a9bb555 {{(pid=85141) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 10:11:30 user nova-compute[85141]: DEBUG nova.network.neutron [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] [instance: eef3cc09-054b-4a17-b621-4f3737d5420e] Successfully updated port: b0183e60-7f49-44a1-a24c-30db287f2453 {{(pid=85141) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 10:11:30 user nova-compute[85141]: DEBUG nova.compute.manager [req-b976580d-ff9e-4959-9996-5e95370f6eb1 req-5140170b-290c-4244-a603-063b9004ca02 service nova] [instance: eef3cc09-054b-4a17-b621-4f3737d5420e] Received event network-changed-0f7c87ad-4076-4aca-8d9b-1fae099dd325 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:11:30 user nova-compute[85141]: DEBUG nova.compute.manager [req-b976580d-ff9e-4959-9996-5e95370f6eb1 req-5140170b-290c-4244-a603-063b9004ca02 service nova] [instance: eef3cc09-054b-4a17-b621-4f3737d5420e] Refreshing instance network info cache due to event network-changed-0f7c87ad-4076-4aca-8d9b-1fae099dd325. {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 10:11:30 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-b976580d-ff9e-4959-9996-5e95370f6eb1 req-5140170b-290c-4244-a603-063b9004ca02 service nova] Acquiring lock "refresh_cache-eef3cc09-054b-4a17-b621-4f3737d5420e" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:11:30 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-b976580d-ff9e-4959-9996-5e95370f6eb1 req-5140170b-290c-4244-a603-063b9004ca02 service nova] Acquired lock "refresh_cache-eef3cc09-054b-4a17-b621-4f3737d5420e" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:11:30 user nova-compute[85141]: DEBUG nova.network.neutron [req-b976580d-ff9e-4959-9996-5e95370f6eb1 req-5140170b-290c-4244-a603-063b9004ca02 service nova] [instance: eef3cc09-054b-4a17-b621-4f3737d5420e] Refreshing network info cache for port 0f7c87ad-4076-4aca-8d9b-1fae099dd325 {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 10:11:30 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:11:30 user nova-compute[85141]: DEBUG nova.network.neutron [req-b976580d-ff9e-4959-9996-5e95370f6eb1 req-5140170b-290c-4244-a603-063b9004ca02 service nova] [instance: eef3cc09-054b-4a17-b621-4f3737d5420e] Instance cache missing network info. {{(pid=85141) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 10:11:30 user nova-compute[85141]: DEBUG nova.network.neutron [req-b976580d-ff9e-4959-9996-5e95370f6eb1 req-5140170b-290c-4244-a603-063b9004ca02 service nova] [instance: eef3cc09-054b-4a17-b621-4f3737d5420e] Updating instance_info_cache with network_info: [] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:11:30 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-b976580d-ff9e-4959-9996-5e95370f6eb1 req-5140170b-290c-4244-a603-063b9004ca02 service nova] Releasing lock "refresh_cache-eef3cc09-054b-4a17-b621-4f3737d5420e" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:11:30 user nova-compute[85141]: DEBUG nova.compute.manager [req-b976580d-ff9e-4959-9996-5e95370f6eb1 req-5140170b-290c-4244-a603-063b9004ca02 service nova] [instance: eef3cc09-054b-4a17-b621-4f3737d5420e] Received event network-changed-d6b517e2-8788-4775-b327-11601713da4d {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:11:30 user nova-compute[85141]: DEBUG nova.compute.manager [req-b976580d-ff9e-4959-9996-5e95370f6eb1 req-5140170b-290c-4244-a603-063b9004ca02 service nova] [instance: eef3cc09-054b-4a17-b621-4f3737d5420e] Refreshing instance network info cache due to event network-changed-d6b517e2-8788-4775-b327-11601713da4d. {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 10:11:30 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-b976580d-ff9e-4959-9996-5e95370f6eb1 req-5140170b-290c-4244-a603-063b9004ca02 service nova] Acquiring lock "refresh_cache-eef3cc09-054b-4a17-b621-4f3737d5420e" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:11:30 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-b976580d-ff9e-4959-9996-5e95370f6eb1 req-5140170b-290c-4244-a603-063b9004ca02 service nova] Acquired lock "refresh_cache-eef3cc09-054b-4a17-b621-4f3737d5420e" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:11:30 user nova-compute[85141]: DEBUG nova.network.neutron [req-b976580d-ff9e-4959-9996-5e95370f6eb1 req-5140170b-290c-4244-a603-063b9004ca02 service nova] [instance: eef3cc09-054b-4a17-b621-4f3737d5420e] Refreshing network info cache for port d6b517e2-8788-4775-b327-11601713da4d {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 10:11:30 user nova-compute[85141]: DEBUG nova.network.neutron [req-b976580d-ff9e-4959-9996-5e95370f6eb1 req-5140170b-290c-4244-a603-063b9004ca02 service nova] [instance: eef3cc09-054b-4a17-b621-4f3737d5420e] Instance cache missing network info. {{(pid=85141) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 10:11:30 user nova-compute[85141]: DEBUG nova.network.neutron [req-b976580d-ff9e-4959-9996-5e95370f6eb1 req-5140170b-290c-4244-a603-063b9004ca02 service nova] [instance: eef3cc09-054b-4a17-b621-4f3737d5420e] Updating instance_info_cache with network_info: [] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:11:30 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-b976580d-ff9e-4959-9996-5e95370f6eb1 req-5140170b-290c-4244-a603-063b9004ca02 service nova] Releasing lock "refresh_cache-eef3cc09-054b-4a17-b621-4f3737d5420e" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:11:30 user nova-compute[85141]: DEBUG nova.compute.manager [req-b976580d-ff9e-4959-9996-5e95370f6eb1 req-5140170b-290c-4244-a603-063b9004ca02 service nova] [instance: eef3cc09-054b-4a17-b621-4f3737d5420e] Received event network-changed-0c9cc79d-1ded-40cc-84fc-f6b70a9bb555 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:11:30 user nova-compute[85141]: DEBUG nova.compute.manager [req-b976580d-ff9e-4959-9996-5e95370f6eb1 req-5140170b-290c-4244-a603-063b9004ca02 service nova] [instance: eef3cc09-054b-4a17-b621-4f3737d5420e] Refreshing instance network info cache due to event network-changed-0c9cc79d-1ded-40cc-84fc-f6b70a9bb555. {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 10:11:30 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-b976580d-ff9e-4959-9996-5e95370f6eb1 req-5140170b-290c-4244-a603-063b9004ca02 service nova] Acquiring lock "refresh_cache-eef3cc09-054b-4a17-b621-4f3737d5420e" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:11:30 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-b976580d-ff9e-4959-9996-5e95370f6eb1 req-5140170b-290c-4244-a603-063b9004ca02 service nova] Acquired lock "refresh_cache-eef3cc09-054b-4a17-b621-4f3737d5420e" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:11:30 user nova-compute[85141]: DEBUG nova.network.neutron [req-b976580d-ff9e-4959-9996-5e95370f6eb1 req-5140170b-290c-4244-a603-063b9004ca02 service nova] [instance: eef3cc09-054b-4a17-b621-4f3737d5420e] Refreshing network info cache for port 0c9cc79d-1ded-40cc-84fc-f6b70a9bb555 {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 10:11:31 user nova-compute[85141]: DEBUG nova.network.neutron [req-b976580d-ff9e-4959-9996-5e95370f6eb1 req-5140170b-290c-4244-a603-063b9004ca02 service nova] [instance: eef3cc09-054b-4a17-b621-4f3737d5420e] Instance cache missing network info. {{(pid=85141) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 10:11:31 user nova-compute[85141]: DEBUG nova.network.neutron [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] [instance: eef3cc09-054b-4a17-b621-4f3737d5420e] Successfully updated port: 21180772-80b3-48e1-90e9-39590611ff08 {{(pid=85141) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 10:11:31 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] Acquiring lock "refresh_cache-eef3cc09-054b-4a17-b621-4f3737d5420e" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:11:31 user nova-compute[85141]: DEBUG nova.network.neutron [req-b976580d-ff9e-4959-9996-5e95370f6eb1 req-5140170b-290c-4244-a603-063b9004ca02 service nova] [instance: eef3cc09-054b-4a17-b621-4f3737d5420e] Updating instance_info_cache with network_info: [] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:11:31 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-b976580d-ff9e-4959-9996-5e95370f6eb1 req-5140170b-290c-4244-a603-063b9004ca02 service nova] Releasing lock "refresh_cache-eef3cc09-054b-4a17-b621-4f3737d5420e" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:11:31 user nova-compute[85141]: DEBUG nova.compute.manager [req-b976580d-ff9e-4959-9996-5e95370f6eb1 req-5140170b-290c-4244-a603-063b9004ca02 service nova] [instance: eef3cc09-054b-4a17-b621-4f3737d5420e] Received event network-changed-b0183e60-7f49-44a1-a24c-30db287f2453 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:11:31 user nova-compute[85141]: DEBUG nova.compute.manager [req-b976580d-ff9e-4959-9996-5e95370f6eb1 req-5140170b-290c-4244-a603-063b9004ca02 service nova] [instance: eef3cc09-054b-4a17-b621-4f3737d5420e] Refreshing instance network info cache due to event network-changed-b0183e60-7f49-44a1-a24c-30db287f2453. {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 10:11:31 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-b976580d-ff9e-4959-9996-5e95370f6eb1 req-5140170b-290c-4244-a603-063b9004ca02 service nova] Acquiring lock "refresh_cache-eef3cc09-054b-4a17-b621-4f3737d5420e" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:11:31 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-b976580d-ff9e-4959-9996-5e95370f6eb1 req-5140170b-290c-4244-a603-063b9004ca02 service nova] Acquired lock "refresh_cache-eef3cc09-054b-4a17-b621-4f3737d5420e" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:11:31 user nova-compute[85141]: DEBUG nova.network.neutron [req-b976580d-ff9e-4959-9996-5e95370f6eb1 req-5140170b-290c-4244-a603-063b9004ca02 service nova] [instance: eef3cc09-054b-4a17-b621-4f3737d5420e] Refreshing network info cache for port b0183e60-7f49-44a1-a24c-30db287f2453 {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 10:11:31 user nova-compute[85141]: DEBUG nova.network.neutron [req-b976580d-ff9e-4959-9996-5e95370f6eb1 req-5140170b-290c-4244-a603-063b9004ca02 service nova] [instance: eef3cc09-054b-4a17-b621-4f3737d5420e] Instance cache missing network info. {{(pid=85141) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 10:11:31 user nova-compute[85141]: DEBUG nova.network.neutron [req-b976580d-ff9e-4959-9996-5e95370f6eb1 req-5140170b-290c-4244-a603-063b9004ca02 service nova] [instance: eef3cc09-054b-4a17-b621-4f3737d5420e] Updating instance_info_cache with network_info: [] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:11:31 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-b976580d-ff9e-4959-9996-5e95370f6eb1 req-5140170b-290c-4244-a603-063b9004ca02 service nova] Releasing lock "refresh_cache-eef3cc09-054b-4a17-b621-4f3737d5420e" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:11:31 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] Acquired lock "refresh_cache-eef3cc09-054b-4a17-b621-4f3737d5420e" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:11:31 user nova-compute[85141]: DEBUG nova.network.neutron [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] [instance: eef3cc09-054b-4a17-b621-4f3737d5420e] Building network info cache for instance {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 10:11:31 user nova-compute[85141]: DEBUG nova.network.neutron [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] [instance: eef3cc09-054b-4a17-b621-4f3737d5420e] Instance cache missing network info. {{(pid=85141) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 10:11:31 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:11:32 user nova-compute[85141]: DEBUG nova.compute.manager [req-c1470989-8d9c-45a4-a6ee-5aef23fb22b1 req-20e5a513-3976-40f5-beaa-3699778a6134 service nova] [instance: eef3cc09-054b-4a17-b621-4f3737d5420e] Received event network-changed-21180772-80b3-48e1-90e9-39590611ff08 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:11:32 user nova-compute[85141]: DEBUG nova.compute.manager [req-c1470989-8d9c-45a4-a6ee-5aef23fb22b1 req-20e5a513-3976-40f5-beaa-3699778a6134 service nova] [instance: eef3cc09-054b-4a17-b621-4f3737d5420e] Refreshing instance network info cache due to event network-changed-21180772-80b3-48e1-90e9-39590611ff08. {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 10:11:32 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-c1470989-8d9c-45a4-a6ee-5aef23fb22b1 req-20e5a513-3976-40f5-beaa-3699778a6134 service nova] Acquiring lock "refresh_cache-eef3cc09-054b-4a17-b621-4f3737d5420e" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:11:33 user nova-compute[85141]: DEBUG nova.network.neutron [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] [instance: eef3cc09-054b-4a17-b621-4f3737d5420e] Updating instance_info_cache with network_info: [{"id": "277c1d3d-ed49-4b8c-82e3-902fa6c8a2f5", "address": "fa:16:3e:60:a2:e0", "network": {"id": "1f8e2c11-f9ae-480d-a6e3-1df589fdd7bc", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-976382911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eafaf607b5ff4b448aaaea253a321827", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap277c1d3d-ed", "ovs_interfaceid": "277c1d3d-ed49-4b8c-82e3-902fa6c8a2f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f742ff18-5ea3-42a0-b229-27a32badce8a", "address": "fa:16:3e:38:78:2d", "network": {"id": "85a74d82-5c98-4f2b-a38d-3e9ebe6a1e13", "bridge": "br-int", "label": "tempest-device-tagging-net1-178618229", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.216", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "eafaf607b5ff4b448aaaea253a321827", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf742ff18-5e", "ovs_interfaceid": "f742ff18-5ea3-42a0-b229-27a32badce8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0f7c87ad-4076-4aca-8d9b-1fae099dd325", "address": "fa:16:3e:7a:05:a4", "network": {"id": "85a74d82-5c98-4f2b-a38d-3e9ebe6a1e13", "bridge": "br-int", "label": "tempest-device-tagging-net1-178618229", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.102", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "eafaf607b5ff4b448aaaea253a321827", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f7c87ad-40", "ovs_interfaceid": "0f7c87ad-4076-4aca-8d9b-1fae099dd325", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d6b517e2-8788-4775-b327-11601713da4d", "address": "fa:16:3e:81:5a:0a", "network": {"id": "85a74d82-5c98-4f2b-a38d-3e9ebe6a1e13", "bridge": "br-int", "label": "tempest-device-tagging-net1-178618229", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.253", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "eafaf607b5ff4b448aaaea253a321827", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6b517e2-87", "ovs_interfaceid": "d6b517e2-8788-4775-b327-11601713da4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0c9cc79d-1ded-40cc-84fc-f6b70a9bb555", "address": "fa:16:3e:d4:13:c9", "network": {"id": "85a74d82-5c98-4f2b-a38d-3e9ebe6a1e13", "bridge": "br-int", "label": "tempest-device-tagging-net1-178618229", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.61", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "eafaf607b5ff4b448aaaea253a321827", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c9cc79d-1d", "ovs_interfaceid": "0c9cc79d-1ded-40cc-84fc-f6b70a9bb555", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b0183e60-7f49-44a1-a24c-30db287f2453", "address": "fa:16:3e:b2:23:6e", "network": {"id": "a9e0ac50-1fbb-4d94-a22f-6fcf40dd0194", "bridge": "br-int", "label": "tempest-device-tagging-net2-947660195", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "eafaf607b5ff4b448aaaea253a321827", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0183e60-7f", "ovs_interfaceid": "b0183e60-7f49-44a1-a24c-30db287f2453", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "21180772-80b3-48e1-90e9-39590611ff08", "address": "fa:16:3e:c1:ed:f9", "network": {"id": "a9e0ac50-1fbb-4d94-a22f-6fcf40dd0194", "bridge": "br-int", "label": "tempest-device-tagging-net2-947660195", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "eafaf607b5ff4b448aaaea253a321827", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21180772-80", "ovs_interfaceid": "21180772-80b3-48e1-90e9-39590611ff08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:11:33 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] Releasing lock "refresh_cache-eef3cc09-054b-4a17-b621-4f3737d5420e" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:11:33 user nova-compute[85141]: DEBUG nova.compute.manager [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] [instance: eef3cc09-054b-4a17-b621-4f3737d5420e] Instance network_info: |[{"id": "277c1d3d-ed49-4b8c-82e3-902fa6c8a2f5", "address": "fa:16:3e:60:a2:e0", "network": {"id": "1f8e2c11-f9ae-480d-a6e3-1df589fdd7bc", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-976382911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eafaf607b5ff4b448aaaea253a321827", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap277c1d3d-ed", "ovs_interfaceid": "277c1d3d-ed49-4b8c-82e3-902fa6c8a2f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f742ff18-5ea3-42a0-b229-27a32badce8a", "address": "fa:16:3e:38:78:2d", "network": {"id": "85a74d82-5c98-4f2b-a38d-3e9ebe6a1e13", "bridge": "br-int", "label": "tempest-device-tagging-net1-178618229", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.216", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "eafaf607b5ff4b448aaaea253a321827", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf742ff18-5e", "ovs_interfaceid": "f742ff18-5ea3-42a0-b229-27a32badce8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0f7c87ad-4076-4aca-8d9b-1fae099dd325", "address": "fa:16:3e:7a:05:a4", "network": {"id": "85a74d82-5c98-4f2b-a38d-3e9ebe6a1e13", "bridge": "br-int", "label": "tempest-device-tagging-net1-178618229", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.102", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "eafaf607b5ff4b448aaaea253a321827", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f7c87ad-40", "ovs_interfaceid": "0f7c87ad-4076-4aca-8d9b-1fae099dd325", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d6b517e2-8788-4775-b327-11601713da4d", "address": "fa:16:3e:81:5a:0a", "network": {"id": "85a74d82-5c98-4f2b-a38d-3e9ebe6a1e13", "bridge": "br-int", "label": "tempest-device-tagging-net1-178618229", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.253", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "eafaf607b5ff4b448aaaea253a321827", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6b517e2-87", "ovs_interfaceid": "d6b517e2-8788-4775-b327-11601713da4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0c9cc79d-1ded-40cc-84fc-f6b70a9bb555", "address": "fa:16:3e:d4:13:c9", "network": {"id": "85a74d82-5c98-4f2b-a38d-3e9ebe6a1e13", "bridge": "br-int", "label": "tempest-device-tagging-net1-178618229", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.61", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "eafaf607b5ff4b448aaaea253a321827", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c9cc79d-1d", "ovs_interfaceid": "0c9cc79d-1ded-40cc-84fc-f6b70a9bb555", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b0183e60-7f49-44a1-a24c-30db287f2453", "address": "fa:16:3e:b2:23:6e", "network": {"id": "a9e0ac50-1fbb-4d94-a22f-6fcf40dd0194", "bridge": "br-int", "label": "tempest-device-tagging-net2-947660195", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "eafaf607b5ff4b448aaaea253a321827", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0183e60-7f", "ovs_interfaceid": "b0183e60-7f49-44a1-a24c-30db287f2453", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "21180772-80b3-48e1-90e9-39590611ff08", "address": "fa:16:3e:c1:ed:f9", "network": {"id": "a9e0ac50-1fbb-4d94-a22f-6fcf40dd0194", "bridge": "br-int", "label": "tempest-device-tagging-net2-947660195", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "eafaf607b5ff4b448aaaea253a321827", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21180772-80", "ovs_interfaceid": "21180772-80b3-48e1-90e9-39590611ff08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=85141) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 10:11:33 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-c1470989-8d9c-45a4-a6ee-5aef23fb22b1 req-20e5a513-3976-40f5-beaa-3699778a6134 service nova] Acquired lock "refresh_cache-eef3cc09-054b-4a17-b621-4f3737d5420e" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:11:33 user nova-compute[85141]: DEBUG nova.network.neutron [req-c1470989-8d9c-45a4-a6ee-5aef23fb22b1 req-20e5a513-3976-40f5-beaa-3699778a6134 service nova] [instance: eef3cc09-054b-4a17-b621-4f3737d5420e] Refreshing network info cache for port 21180772-80b3-48e1-90e9-39590611ff08 {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 10:11:33 user nova-compute[85141]: INFO nova.virt.block_device [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] [instance: eef3cc09-054b-4a17-b621-4f3737d5420e] Booting with volume 27fcde20-e019-4cf0-ad90-6c8100f4a8d2 at /dev/vdc
Nov 16 10:11:33 user nova-compute[85141]: DEBUG os_brick.utils [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 10:11:33 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:11:34 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:11:34 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fe16000-e247-43ab-afa6-7a62220485e8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c7834de5c295\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:11:34 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:11:34 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:11:34 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[638d9ec1-054f-44f7-98d9-6a67391172d4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:11:34 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:11:34 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:11:34 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[764bb821-aa21-4d2d-87e8-4ca4c4ba0a04]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:11:34 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[2818a290-c6bc-4ccd-8657-0e98fe6afd42]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:11:34 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] Running cmd (subprocess): nvme version {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:11:34 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] 'nvme version' failed. Not Retrying. {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 10:11:34 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.nvmeof [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] nvme not present on system {{(pid=85141) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 10:11:34 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:11:34 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 10:11:34 user nova-compute[85141]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 10:11:34 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[75202364-8fa5-467d-b66b-f0dae2a67388]: (4, '') {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:11:34 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.lightos [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=85141) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 10:11:34 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.lightos [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=85141) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 10:11:34 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.lightos [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] LIGHTOS: no hostnqn found. {{(pid=85141) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 10:11:34 user nova-compute[85141]: DEBUG os_brick.utils [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c7834de5c295', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 10:11:34 user nova-compute[85141]: DEBUG nova.virt.block_device [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] [instance: eef3cc09-054b-4a17-b621-4f3737d5420e] Updating existing volume attachment record: f620c7f2-2953-4d2f-9669-e85cd258e13b {{(pid=85141) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 10:11:34 user nova-compute[85141]: DEBUG nova.network.neutron [req-c1470989-8d9c-45a4-a6ee-5aef23fb22b1 req-20e5a513-3976-40f5-beaa-3699778a6134 service nova] [instance: eef3cc09-054b-4a17-b621-4f3737d5420e] Updated VIF entry in instance network info cache for port 21180772-80b3-48e1-90e9-39590611ff08. {{(pid=85141) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 10:11:34 user nova-compute[85141]: DEBUG nova.network.neutron [req-c1470989-8d9c-45a4-a6ee-5aef23fb22b1 req-20e5a513-3976-40f5-beaa-3699778a6134 service nova] [instance: eef3cc09-054b-4a17-b621-4f3737d5420e] Updating instance_info_cache with network_info: [{"id": "277c1d3d-ed49-4b8c-82e3-902fa6c8a2f5", "address": "fa:16:3e:60:a2:e0", "network": {"id": "1f8e2c11-f9ae-480d-a6e3-1df589fdd7bc", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-976382911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eafaf607b5ff4b448aaaea253a321827", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap277c1d3d-ed", "ovs_interfaceid": "277c1d3d-ed49-4b8c-82e3-902fa6c8a2f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f742ff18-5ea3-42a0-b229-27a32badce8a", "address": "fa:16:3e:38:78:2d", "network": {"id": "85a74d82-5c98-4f2b-a38d-3e9ebe6a1e13", "bridge": "br-int", "label": "tempest-device-tagging-net1-178618229", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.216", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "eafaf607b5ff4b448aaaea253a321827", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf742ff18-5e", "ovs_interfaceid": "f742ff18-5ea3-42a0-b229-27a32badce8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0f7c87ad-4076-4aca-8d9b-1fae099dd325", "address": "fa:16:3e:7a:05:a4", "network": {"id": "85a74d82-5c98-4f2b-a38d-3e9ebe6a1e13", "bridge": "br-int", "label": "tempest-device-tagging-net1-178618229", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.102", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "eafaf607b5ff4b448aaaea253a321827", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f7c87ad-40", "ovs_interfaceid": "0f7c87ad-4076-4aca-8d9b-1fae099dd325", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d6b517e2-8788-4775-b327-11601713da4d", "address": "fa:16:3e:81:5a:0a", "network": {"id": "85a74d82-5c98-4f2b-a38d-3e9ebe6a1e13", "bridge": "br-int", "label": "tempest-device-tagging-net1-178618229", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.253", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "eafaf607b5ff4b448aaaea253a321827", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6b517e2-87", "ovs_interfaceid": "d6b517e2-8788-4775-b327-11601713da4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0c9cc79d-1ded-40cc-84fc-f6b70a9bb555", "address": "fa:16:3e:d4:13:c9", "network": {"id": "85a74d82-5c98-4f2b-a38d-3e9ebe6a1e13", "bridge": "br-int", "label": "tempest-device-tagging-net1-178618229", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.61", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "eafaf607b5ff4b448aaaea253a321827", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c9cc79d-1d", "ovs_interfaceid": "0c9cc79d-1ded-40cc-84fc-f6b70a9bb555", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b0183e60-7f49-44a1-a24c-30db287f2453", "address": "fa:16:3e:b2:23:6e", "network": {"id": "a9e0ac50-1fbb-4d94-a22f-6fcf40dd0194", "bridge": "br-int", "label": "tempest-device-tagging-net2-947660195", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "eafaf607b5ff4b448aaaea253a321827", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0183e60-7f", "ovs_interfaceid": "b0183e60-7f49-44a1-a24c-30db287f2453", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "21180772-80b3-48e1-90e9-39590611ff08", "address": "fa:16:3e:c1:ed:f9", "network": {"id": "a9e0ac50-1fbb-4d94-a22f-6fcf40dd0194", "bridge": "br-int", "label": "tempest-device-tagging-net2-947660195", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "eafaf607b5ff4b448aaaea253a321827", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21180772-80", "ovs_interfaceid": "21180772-80b3-48e1-90e9-39590611ff08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:11:34 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-c1470989-8d9c-45a4-a6ee-5aef23fb22b1 req-20e5a513-3976-40f5-beaa-3699778a6134 service nova] Releasing lock "refresh_cache-eef3cc09-054b-4a17-b621-4f3737d5420e" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:11:35 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:11:36 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:11:38 user nova-compute[85141]: DEBUG nova.compute.manager [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] [instance: eef3cc09-054b-4a17-b621-4f3737d5420e] Start spawning the instance on the hypervisor. {{(pid=85141) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 10:11:38 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] [instance: eef3cc09-054b-4a17-b621-4f3737d5420e] Creating instance directory {{(pid=85141) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 10:11:38 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] [instance: eef3cc09-054b-4a17-b621-4f3737d5420e] Creating image(s)
Nov 16 10:11:38 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] [instance: eef3cc09-054b-4a17-b621-4f3737d5420e] Did not create local disks {{(pid=85141) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 16 10:11:38 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] [instance: eef3cc09-054b-4a17-b621-4f3737d5420e] Ensure instance console log exists: /opt/stack/data/nova/instances/eef3cc09-054b-4a17-b621-4f3737d5420e/console.log {{(pid=85141) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 10:11:38 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:11:38 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:11:38 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:11:38 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] [instance: eef3cc09-054b-4a17-b621-4f3737d5420e] Start _get_guest_xml network_info=[{"id": "277c1d3d-ed49-4b8c-82e3-902fa6c8a2f5", "address": "fa:16:3e:60:a2:e0", "network": {"id": "1f8e2c11-f9ae-480d-a6e3-1df589fdd7bc", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-976382911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eafaf607b5ff4b448aaaea253a321827", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap277c1d3d-ed", "ovs_interfaceid": "277c1d3d-ed49-4b8c-82e3-902fa6c8a2f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f742ff18-5ea3-42a0-b229-27a32badce8a", "address": "fa:16:3e:38:78:2d", "network": {"id": "85a74d82-5c98-4f2b-a38d-3e9ebe6a1e13", "bridge": "br-int", "label": "tempest-device-tagging-net1-178618229", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.216", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "eafaf607b5ff4b448aaaea253a321827", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf742ff18-5e", "ovs_interfaceid": "f742ff18-5ea3-42a0-b229-27a32badce8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0f7c87ad-4076-4aca-8d9b-1fae099dd325", "address": "fa:16:3e:7a:05:a4", "network": {"id": "85a74d82-5c98-4f2b-a38d-3e9ebe6a1e13", "bridge": "br-int", "label": "tempest-device-tagging-net1-178618229", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.102", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "eafaf607b5ff4b448aaaea253a321827", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f7c87ad-40", "ovs_interfaceid": "0f7c87ad-4076-4aca-8d9b-1fae099dd325", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d6b517e2-8788-4775-b327-11601713da4d", "address": "fa:16:3e:81:5a:0a", "network": {"id": "85a74d82-5c98-4f2b-a38d-3e9ebe6a1e13", "bridge": "br-int", "label": "tempest-device-tagging-net1-178618229", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.253", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "eafaf607b5ff4b448aaaea253a321827", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6b517e2-87", "ovs_interfaceid": "d6b517e2-8788-4775-b327-11601713da4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0c9cc79d-1ded-40cc-84fc-f6b70a9bb555", "address": "fa:16:3e:d4:13:c9", "network": {"id": "85a74d82-5c98-4f2b-a38d-3e9ebe6a1e13", "bridge": "br-int", "label": "tempest-device-tagging-net1-178618229", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.61", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "eafaf607b5ff4b448aaaea253a321827", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c9cc79d-1d", "ovs_interfaceid": "0c9cc79d-1ded-40cc-84fc-f6b70a9bb555", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b0183e60-7f49-44a1-a24c-30db287f2453", "address": "fa:16:3e:b2:23:6e", "network": {"id": "a9e0ac50-1fbb-4d94-a22f-6fcf40dd0194", "bridge": "br-int", "label": "tempest-device-tagging-net2-947660195", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "eafaf607b5ff4b448aaaea253a321827", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0183e60-7f", "ovs_interfaceid": "b0183e60-7f49-44a1-a24c-30db287f2453", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "21180772-80b3-48e1-90e9-39590611ff08", "address": "fa:16:3e:c1:ed:f9", "network": {"id": "a9e0ac50-1fbb-4d94-a22f-6fcf40dd0194", "bridge": "br-int", "label": "tempest-device-tagging-net2-947660195", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "eafaf607b5ff4b448aaaea253a321827", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21180772-80", "ovs_interfaceid": "21180772-80b3-48e1-90e9-39590611ff08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T10:06:42Z,direct_url=<?>,disk_format='qcow2',id=bc4ca70f-a459-4d5c-a9e6-80f1948eb48b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1044631a5fe84ce8904864a7024049fa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T10:06:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b4df10d9-a60c-45ed-981d-96f704534fb8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fitzudYG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'eef3cc09-054b-4a17-b621-4f3737d5420e', 'attached_at': '', 'detached_at': '', 'volume_id': 'b4df10d9-a60c-45ed-981d-96f704534fb8', 'serial': 'b4df10d9-a60c-45ed-981d-96f704534fb8'}, 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'attachment_id': '57718aa2-7e17-4dee-a89b-d744d1cbbef6', 'mount_device': '/dev/vda', 'volume_type': None}, {'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:4973f768-f126-41d6-b534-458d6c49f9b3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JxPrVHFZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'eef3cc09-054b-4a17-b621-4f3737d5420e', 'attached_at': '', 'detached_at': '', 'volume_id': '4973f768-f126-41d6-b534-458d6c49f9b3', 'serial': '4973f768-f126-41d6-b534-458d6c49f9b3'}, 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'boot_index': 1, 'attachment_id': '22866058-ad85-4a88-9d63-76f491ae9e2c', 'mount_device': '/dev/vdb', 'volume_type': None}, {'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:27fcde20-e019-4cf0-ad90-6c8100f4a8d2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RQOFZdBu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'eef3cc09-054b-4a17-b621-4f3737d5420e', 'attached_at': '', 'detached_at': '', 'volume_id': '27fcde20-e019-4cf0-ad90-6c8100f4a8d2', 'serial': '27fcde20-e019-4cf0-ad90-6c8100f4a8d2'}, 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'boot_index': 2, 'attachment_id': 'f620c7f2-2953-4d2f-9669-e85cd258e13b', 'mount_device': '/dev/vdc', 'volume_type': None} {{(pid=85141) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 10:11:38 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:11:38 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:11:39 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=85141) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 10:11:39 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] CPU controller missing on host. {{(pid=85141) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 10:11:39 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=85141) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 10:11:39 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] CPU controller found on host. {{(pid=85141) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 10:11:39 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=85141) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 10:11:39 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T10:06:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T10:06:42Z,direct_url=<?>,disk_format='qcow2',id=bc4ca70f-a459-4d5c-a9e6-80f1948eb48b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1044631a5fe84ce8904864a7024049fa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T10:06:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 10:11:39 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] Flavor limits 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 10:11:39 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] Image limits 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 10:11:39 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] Flavor pref 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 10:11:39 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] Image pref 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 10:11:39 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 10:11:39 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 10:11:39 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=85141) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 10:11:39 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] Got 1 possible topologies {{(pid=85141) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 10:11:39 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 10:11:39 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 10:11:39 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] [instance: eef3cc09-054b-4a17-b621-4f3737d5420e] Calling os-brick to attach iSCSI Volume {{(pid=85141) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 10:11:39 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51806b6080>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b4df10d9-a60c-45ed-981d-96f704534fb8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fitzudYG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 10:11:39 user nova-compute[85141]: WARNING os_brick.initiator.connectors.base [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 10:11:39 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 10:11:39 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 10:11:39 user nova-compute[85141]: WARNING os_brick.initiator.connectors.base [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 10:11:39 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b4df10d9-a60c-45ed-981d-96f704534fb8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 10:11:39 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b4df10d9-a60c-45ed-981d-96f704534fb8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 10:11:39 user nova-compute[85141]: INFO os_brick.initiator.connectors.iscsi [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 10:11:39 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4df10d9-a60c-45ed-981d-96f704534fb8 -p 172.16.0.220:3260 {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:11:39 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4df10d9-a60c-45ed-981d-96f704534fb8 -p 172.16.0.220:3260" returned: 21 in 0.201s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:11:39 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6af6632-9ad0-48bf-b6b4-8aee5c27aae9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:11:39 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 10:11:39 user nova-compute[85141]:  {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:11:39 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4df10d9-a60c-45ed-981d-96f704534fb8 -p 172.16.0.220:3260 --interface default --op new {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:11:39 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4df10d9-a60c-45ed-981d-96f704534fb8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:11:39 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[576bfa69-f10e-4b54-a825-a452efee2f98]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b4df10d9-a60c-45ed-981d-96f704534fb8] added\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:11:39 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b4df10d9-a60c-45ed-981d-96f704534fb8] added
Nov 16 10:11:39 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:11:39 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4df10d9-a60c-45ed-981d-96f704534fb8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:11:39 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4df10d9-a60c-45ed-981d-96f704534fb8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:11:39 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[73670b9b-92f4-4fbc-95b8-593a47787f1d]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:11:39 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:11:39 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4df10d9-a60c-45ed-981d-96f704534fb8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:11:39 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4df10d9-a60c-45ed-981d-96f704534fb8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:11:39 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[630bd959-b9fb-4fef-9ec9-1f29480472ba]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:11:39 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:11:39 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4df10d9-a60c-45ed-981d-96f704534fb8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fitzudYG {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:11:39 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4df10d9-a60c-45ed-981d-96f704534fb8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fitzudYG" returned: 0 in 0.016s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:11:39 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2fc865b-d961-4f85-8ae9-2b1085d173b9]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:11:39 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fitzudYG'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:11:39 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4df10d9-a60c-45ed-981d-96f704534fb8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:11:39 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4df10d9-a60c-45ed-981d-96f704534fb8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.015s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:11:39 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[03cd7532-113b-4d7f-8d17-cc1bcd97ef98]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:11:39 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:11:39 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:11:39 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:11:39 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[07615a73-f2e8-4ca4-93d2-f548d1f01e9a]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42c041ec-fa39-4035-b82b-867caf3565df (non-flash)\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:11:39 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42c041ec-fa39-4035-b82b-867caf3565df (non-flash)
Nov 16 10:11:39 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:11:39 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42c041ec-fa39-4035-b82b-867caf3565df (non-flash)
Nov 16 10:11:39 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 10:11:39 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4df10d9-a60c-45ed-981d-96f704534fb8 -p 172.16.0.220:3260 --login {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:11:39 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4df10d9-a60c-45ed-981d-96f704534fb8 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:11:39 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[52b6a06e-c651-4203-8431-0295dcaa4d6b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b4df10d9-a60c-45ed-981d-96f704534fb8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b4df10d9-a60c-45ed-981d-96f704534fb8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:11:39 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b4df10d9-a60c-45ed-981d-96f704534fb8, portal: 172.16.0.220,3260]
Nov 16 10:11:39 user nova-compute[85141]: Login to [iface: default, target: iqn.2010-10.org.openstack:b4df10d9-a60c-45ed-981d-96f704534fb8, portal: 172.16.0.220,3260] successful.
Nov 16 10:11:39 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:11:39 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4df10d9-a60c-45ed-981d-96f704534fb8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:11:39 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4df10d9-a60c-45ed-981d-96f704534fb8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.016s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:11:39 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[8067e60a-80cc-4467-b845-dbc3afd53c36]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:11:39 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:11:39 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:11:39 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:11:39 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[3445cd73-e21e-4636-8471-2ba1c8a60089]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42c041ec-fa39-4035-b82b-867caf3565df (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4df10d9-a60c-45ed-981d-96f704534fb8 (non-flash)\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:11:39 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42c041ec-fa39-4035-b82b-867caf3565df (non-flash)
Nov 16 10:11:39 user nova-compute[85141]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4df10d9-a60c-45ed-981d-96f704534fb8 (non-flash)
Nov 16 10:11:39 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:11:39 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42c041ec-fa39-4035-b82b-867caf3565df (non-flash)
Nov 16 10:11:39 user nova-compute[85141]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4df10d9-a60c-45ed-981d-96f704534fb8 (non-flash)
Nov 16 10:11:39 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 10:11:39 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b4df10d9-a60c-45ed-981d-96f704534fb8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.457s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 10:11:39 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] Connected to 172.16.0.220:3260 {{(pid=85141) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 10:11:39 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=85141) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 10:11:39 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=85141) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 10:11:39 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:11:39 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:11:39 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[5819582a-fd6b-45d4-a56b-a9cfc0dde57f]: (4, ('- - 0', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:11:39 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=85141) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 10:11:39 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:b4df10d9-a60c-45ed-981d-96f704534fb8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fitzudYG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=85141) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 10:11:40 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:11:40 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.491s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 10:11:40 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] <== connect_volume: return (1492ms) {'type': 'block', 'scsi_wwn': '23938323730656664', 'path': '/dev/sdc'} {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 10:11:40 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] [instance: eef3cc09-054b-4a17-b621-4f3737d5420e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23938323730656664', 'path': '/dev/sdc'} {{(pid=85141) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 10:11:40 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] [instance: eef3cc09-054b-4a17-b621-4f3737d5420e] Calling os-brick to attach iSCSI Volume {{(pid=85141) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 10:11:40 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51806b6080>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4973f768-f126-41d6-b534-458d6c49f9b3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JxPrVHFZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 10:11:40 user nova-compute[85141]: WARNING os_brick.initiator.connectors.base [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 10:11:40 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 10:11:40 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 10:11:40 user nova-compute[85141]: WARNING os_brick.initiator.connectors.base [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 10:11:40 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4973f768-f126-41d6-b534-458d6c49f9b3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 10:11:40 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4973f768-f126-41d6-b534-458d6c49f9b3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 10:11:40 user nova-compute[85141]: INFO os_brick.initiator.connectors.iscsi [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 10:11:40 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4973f768-f126-41d6-b534-458d6c49f9b3 -p 172.16.0.220:3260 {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:11:40 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4973f768-f126-41d6-b534-458d6c49f9b3 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:11:40 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[260eed17-1c79-476b-bb12-ee09fdbd7f45]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:11:40 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 10:11:40 user nova-compute[85141]:  {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:11:40 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4973f768-f126-41d6-b534-458d6c49f9b3 -p 172.16.0.220:3260 --interface default --op new {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:11:40 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4973f768-f126-41d6-b534-458d6c49f9b3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:11:40 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[406cc80f-5eac-476b-9c16-f3311ad28730]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4973f768-f126-41d6-b534-458d6c49f9b3] added\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:11:40 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4973f768-f126-41d6-b534-458d6c49f9b3] added
Nov 16 10:11:40 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:11:40 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4973f768-f126-41d6-b534-458d6c49f9b3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:11:40 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4973f768-f126-41d6-b534-458d6c49f9b3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:11:40 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[51855346-dfde-45ef-81c2-a67363417d5c]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:11:40 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:11:40 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4973f768-f126-41d6-b534-458d6c49f9b3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:11:40 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4973f768-f126-41d6-b534-458d6c49f9b3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:11:40 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[2df6b412-6a96-4584-bb86-1f2526b134b2]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:11:40 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:11:40 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4973f768-f126-41d6-b534-458d6c49f9b3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JxPrVHFZ {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:11:40 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4973f768-f126-41d6-b534-458d6c49f9b3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JxPrVHFZ" returned: 0 in 0.019s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:11:40 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[46a4455c-fdfd-4ae9-84f6-c30649f428b1]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:11:40 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JxPrVHFZ'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:11:40 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4973f768-f126-41d6-b534-458d6c49f9b3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:11:40 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4973f768-f126-41d6-b534-458d6c49f9b3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:11:40 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[22bee1f5-33ba-4d2b-9dc2-a0592b43b30f]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:11:40 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:11:40 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:11:40 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:11:40 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed79490f-2adf-49b2-ae14-244fde4bc47d]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42c041ec-fa39-4035-b82b-867caf3565df (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4df10d9-a60c-45ed-981d-96f704534fb8 (non-flash)\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:11:40 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42c041ec-fa39-4035-b82b-867caf3565df (non-flash)
Nov 16 10:11:40 user nova-compute[85141]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4df10d9-a60c-45ed-981d-96f704534fb8 (non-flash)
Nov 16 10:11:40 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:11:40 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42c041ec-fa39-4035-b82b-867caf3565df (non-flash)
Nov 16 10:11:40 user nova-compute[85141]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4df10d9-a60c-45ed-981d-96f704534fb8 (non-flash)
Nov 16 10:11:40 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 10:11:40 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4973f768-f126-41d6-b534-458d6c49f9b3 -p 172.16.0.220:3260 --login {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:11:40 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4973f768-f126-41d6-b534-458d6c49f9b3 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:11:40 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f2f6568-c954-41ef-a1e3-e75eed2b090d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4973f768-f126-41d6-b534-458d6c49f9b3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4973f768-f126-41d6-b534-458d6c49f9b3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:11:40 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4973f768-f126-41d6-b534-458d6c49f9b3, portal: 172.16.0.220,3260]
Nov 16 10:11:40 user nova-compute[85141]: Login to [iface: default, target: iqn.2010-10.org.openstack:4973f768-f126-41d6-b534-458d6c49f9b3, portal: 172.16.0.220,3260] successful.
Nov 16 10:11:40 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:11:40 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4973f768-f126-41d6-b534-458d6c49f9b3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:11:40 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4973f768-f126-41d6-b534-458d6c49f9b3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:11:40 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[37749e1d-3456-48e3-b515-62c3ff9d26c1]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:11:40 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:11:40 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:11:40 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:11:40 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[626de66e-410d-43e2-8a63-4b241aaf55c6]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42c041ec-fa39-4035-b82b-867caf3565df (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4df10d9-a60c-45ed-981d-96f704534fb8 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4973f768-f126-41d6-b534-458d6c49f9b3 (non-flash)\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:11:40 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42c041ec-fa39-4035-b82b-867caf3565df (non-flash)
Nov 16 10:11:40 user nova-compute[85141]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4df10d9-a60c-45ed-981d-96f704534fb8 (non-flash)
Nov 16 10:11:40 user nova-compute[85141]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4973f768-f126-41d6-b534-458d6c49f9b3 (non-flash)
Nov 16 10:11:40 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:11:40 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42c041ec-fa39-4035-b82b-867caf3565df (non-flash)
Nov 16 10:11:40 user nova-compute[85141]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4df10d9-a60c-45ed-981d-96f704534fb8 (non-flash)
Nov 16 10:11:40 user nova-compute[85141]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4973f768-f126-41d6-b534-458d6c49f9b3 (non-flash)
Nov 16 10:11:40 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 10:11:40 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4973f768-f126-41d6-b534-458d6c49f9b3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.266s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 10:11:40 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] Connected to 172.16.0.220:3260 {{(pid=85141) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 10:11:40 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] HCTL ('35', '-', '-', 0) found on session 4 with lun 0 {{(pid=85141) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 10:11:40 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=85141) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 10:11:40 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:11:40 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:11:40 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[226e5232-4a5f-4cb3-8f05-3d8edd516178]: (4, ('- - 0', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:11:40 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=85141) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 10:11:40 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:4973f768-f126-41d6-b534-458d6c49f9b3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JxPrVHFZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=85141) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 10:11:41 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.302s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 10:11:41 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] <== connect_volume: return (1302ms) {'type': 'block', 'scsi_wwn': '23637623864313437', 'path': '/dev/sdd'} {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 10:11:41 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] [instance: eef3cc09-054b-4a17-b621-4f3737d5420e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23637623864313437', 'path': '/dev/sdd'} {{(pid=85141) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 10:11:41 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] [instance: eef3cc09-054b-4a17-b621-4f3737d5420e] Calling os-brick to attach iSCSI Volume {{(pid=85141) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 10:11:41 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51806b6080>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:27fcde20-e019-4cf0-ad90-6c8100f4a8d2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RQOFZdBu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 10:11:41 user nova-compute[85141]: WARNING os_brick.initiator.connectors.base [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 10:11:41 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 10:11:41 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 10:11:41 user nova-compute[85141]: WARNING os_brick.initiator.connectors.base [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 10:11:41 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:27fcde20-e019-4cf0-ad90-6c8100f4a8d2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 10:11:41 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:27fcde20-e019-4cf0-ad90-6c8100f4a8d2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 10:11:41 user nova-compute[85141]: INFO os_brick.initiator.connectors.iscsi [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 10:11:41 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27fcde20-e019-4cf0-ad90-6c8100f4a8d2 -p 172.16.0.220:3260 {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:11:41 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:11:41 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27fcde20-e019-4cf0-ad90-6c8100f4a8d2 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:11:41 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[599ef87d-b19e-4786-a490-87762970f3b8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:11:41 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 10:11:41 user nova-compute[85141]:  {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:11:41 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27fcde20-e019-4cf0-ad90-6c8100f4a8d2 -p 172.16.0.220:3260 --interface default --op new {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:11:41 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27fcde20-e019-4cf0-ad90-6c8100f4a8d2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:11:41 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[e07bfbad-7131-4578-815b-f7be0470e254]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:27fcde20-e019-4cf0-ad90-6c8100f4a8d2] added\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:11:41 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:27fcde20-e019-4cf0-ad90-6c8100f4a8d2] added
Nov 16 10:11:41 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:11:41 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27fcde20-e019-4cf0-ad90-6c8100f4a8d2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:11:41 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27fcde20-e019-4cf0-ad90-6c8100f4a8d2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:11:41 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecefb6b1-4d47-49b9-9617-90fdd243c1bb]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:11:41 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:11:41 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27fcde20-e019-4cf0-ad90-6c8100f4a8d2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:11:42 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27fcde20-e019-4cf0-ad90-6c8100f4a8d2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:11:42 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[34b872a6-fd8c-4ba7-b740-4fd6d524ad13]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:11:42 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:11:42 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27fcde20-e019-4cf0-ad90-6c8100f4a8d2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RQOFZdBu {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:11:42 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27fcde20-e019-4cf0-ad90-6c8100f4a8d2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RQOFZdBu" returned: 0 in 0.017s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:11:42 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[de2cdcd9-bf3e-4779-9845-5640f2cfff2c]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:11:42 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RQOFZdBu'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:11:42 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27fcde20-e019-4cf0-ad90-6c8100f4a8d2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:11:42 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27fcde20-e019-4cf0-ad90-6c8100f4a8d2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:11:42 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[361811b1-47e7-4448-b8e2-edc441cdb305]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:11:42 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:11:42 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:11:42 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:11:42 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8f9d8d0-d0b0-4fb2-a802-2d7e50eade4e]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42c041ec-fa39-4035-b82b-867caf3565df (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4df10d9-a60c-45ed-981d-96f704534fb8 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4973f768-f126-41d6-b534-458d6c49f9b3 (non-flash)\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:11:42 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42c041ec-fa39-4035-b82b-867caf3565df (non-flash)
Nov 16 10:11:42 user nova-compute[85141]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4df10d9-a60c-45ed-981d-96f704534fb8 (non-flash)
Nov 16 10:11:42 user nova-compute[85141]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4973f768-f126-41d6-b534-458d6c49f9b3 (non-flash)
Nov 16 10:11:42 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:11:42 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42c041ec-fa39-4035-b82b-867caf3565df (non-flash)
Nov 16 10:11:42 user nova-compute[85141]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4df10d9-a60c-45ed-981d-96f704534fb8 (non-flash)
Nov 16 10:11:42 user nova-compute[85141]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4973f768-f126-41d6-b534-458d6c49f9b3 (non-flash)
Nov 16 10:11:42 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 10:11:42 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27fcde20-e019-4cf0-ad90-6c8100f4a8d2 -p 172.16.0.220:3260 --login {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:11:42 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27fcde20-e019-4cf0-ad90-6c8100f4a8d2 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:11:42 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b05314c-fefc-47a3-8612-b45776e5c92c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:27fcde20-e019-4cf0-ad90-6c8100f4a8d2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:27fcde20-e019-4cf0-ad90-6c8100f4a8d2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:11:42 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:27fcde20-e019-4cf0-ad90-6c8100f4a8d2, portal: 172.16.0.220,3260]
Nov 16 10:11:42 user nova-compute[85141]: Login to [iface: default, target: iqn.2010-10.org.openstack:27fcde20-e019-4cf0-ad90-6c8100f4a8d2, portal: 172.16.0.220,3260] successful.
Nov 16 10:11:42 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:11:42 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27fcde20-e019-4cf0-ad90-6c8100f4a8d2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:11:42 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27fcde20-e019-4cf0-ad90-6c8100f4a8d2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:11:42 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[624c1152-e1ca-4c7c-87c2-51870a9d5c86]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:11:42 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:11:42 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:11:42 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:11:42 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f2ec697-8efe-41f8-954c-377402bdd7e5]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42c041ec-fa39-4035-b82b-867caf3565df (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4df10d9-a60c-45ed-981d-96f704534fb8 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4973f768-f126-41d6-b534-458d6c49f9b3 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fcde20-e019-4cf0-ad90-6c8100f4a8d2 (non-flash)\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:11:42 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42c041ec-fa39-4035-b82b-867caf3565df (non-flash)
Nov 16 10:11:42 user nova-compute[85141]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4df10d9-a60c-45ed-981d-96f704534fb8 (non-flash)
Nov 16 10:11:42 user nova-compute[85141]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4973f768-f126-41d6-b534-458d6c49f9b3 (non-flash)
Nov 16 10:11:42 user nova-compute[85141]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fcde20-e019-4cf0-ad90-6c8100f4a8d2 (non-flash)
Nov 16 10:11:42 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:11:42 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42c041ec-fa39-4035-b82b-867caf3565df (non-flash)
Nov 16 10:11:42 user nova-compute[85141]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4df10d9-a60c-45ed-981d-96f704534fb8 (non-flash)
Nov 16 10:11:42 user nova-compute[85141]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4973f768-f126-41d6-b534-458d6c49f9b3 (non-flash)
Nov 16 10:11:42 user nova-compute[85141]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fcde20-e019-4cf0-ad90-6c8100f4a8d2 (non-flash)
Nov 16 10:11:42 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 10:11:42 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:27fcde20-e019-4cf0-ad90-6c8100f4a8d2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.252s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 10:11:42 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] Connected to 172.16.0.220:3260 {{(pid=85141) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 10:11:42 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] HCTL ('36', '-', '-', 0) found on session 5 with lun 0 {{(pid=85141) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 10:11:42 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=85141) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 10:11:42 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:11:42 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:11:42 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[c03eac31-813c-4dd9-af22-b8c6842103ff]: (4, ('- - 0', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:11:42 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: sde {{(pid=85141) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 10:11:42 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:27fcde20-e019-4cf0-ad90-6c8100f4a8d2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RQOFZdBu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=85141) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 10:11:43 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.288s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 10:11:43 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] <== connect_volume: return (1289ms) {'type': 'block', 'scsi_wwn': '23936653261323730', 'path': '/dev/sde'} {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 10:11:43 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] [instance: eef3cc09-054b-4a17-b621-4f3737d5420e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23936653261323730', 'path': '/dev/sde'} {{(pid=85141) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 10:11:43 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T10:11:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-51502851',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-51502851',id=12,image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM5vBaIfg5DdeW2zM4rA9EPiY+/ZYvJ/N5o4qpg6svPMp2TYXZseykJJc31kLM1fey6shmBY6qpJdgABWdhRsE2tAeMaXqi2NUagwQmOeDuf7yyD8QSo96HgIsUX6lNTkQ==',key_name='tempest-keypair-876906675',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eafaf607b5ff4b448aaaea253a321827',ramdisk_id='',reservation_id='r-5mbq86rv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1883132768',owner_user_name='tempest-TaggedBootDevicesTest_v242-1883132768-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T10:11:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8b186b80e92e41878b8ab7e839181fca',uuid=eef3cc09-054b-4a17-b621-4f3737d5420e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "277c1d3d-ed49-4b8c-82e3-902fa6c8a2f5", "address": "fa:16:3e:60:a2:e0", "network": {"id": "1f8e2c11-f9ae-480d-a6e3-1df589fdd7bc", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-976382911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eafaf607b5ff4b448aaaea253a321827", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap277c1d3d-ed", "ovs_interfaceid": "277c1d3d-ed49-4b8c-82e3-902fa6c8a2f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=85141) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 10:11:43 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] Converting VIF {"id": "277c1d3d-ed49-4b8c-82e3-902fa6c8a2f5", "address": "fa:16:3e:60:a2:e0", "network": {"id": "1f8e2c11-f9ae-480d-a6e3-1df589fdd7bc", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-976382911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eafaf607b5ff4b448aaaea253a321827", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap277c1d3d-ed", "ovs_interfaceid": "277c1d3d-ed49-4b8c-82e3-902fa6c8a2f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:11:43 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:60:a2:e0,bridge_name='br-int',has_traffic_filtering=True,id=277c1d3d-ed49-4b8c-82e3-902fa6c8a2f5,network=Network(1f8e2c11-f9ae-480d-a6e3-1df589fdd7bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap277c1d3d-ed') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:11:43 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T10:11:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-51502851',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-51502851',id=12,image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM5vBaIfg5DdeW2zM4rA9EPiY+/ZYvJ/N5o4qpg6svPMp2TYXZseykJJc31kLM1fey6shmBY6qpJdgABWdhRsE2tAeMaXqi2NUagwQmOeDuf7yyD8QSo96HgIsUX6lNTkQ==',key_name='tempest-keypair-876906675',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eafaf607b5ff4b448aaaea253a321827',ramdisk_id='',reservation_id='r-5mbq86rv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1883132768',owner_user_name='tempest-TaggedBootDevicesTest_v242-1883132768-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T10:11:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8b186b80e92e41878b8ab7e839181fca',uuid=eef3cc09-054b-4a17-b621-4f3737d5420e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f742ff18-5ea3-42a0-b229-27a32badce8a", "address": "fa:16:3e:38:78:2d", "network": {"id": "85a74d82-5c98-4f2b-a38d-3e9ebe6a1e13", "bridge": "br-int", "label": "tempest-device-tagging-net1-178618229", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.216", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "eafaf607b5ff4b448aaaea253a321827", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf742ff18-5e", "ovs_interfaceid": "f742ff18-5ea3-42a0-b229-27a32badce8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=85141) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 10:11:43 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] Converting VIF {"id": "f742ff18-5ea3-42a0-b229-27a32badce8a", "address": "fa:16:3e:38:78:2d", "network": {"id": "85a74d82-5c98-4f2b-a38d-3e9ebe6a1e13", "bridge": "br-int", "label": "tempest-device-tagging-net1-178618229", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.216", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "eafaf607b5ff4b448aaaea253a321827", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf742ff18-5e", "ovs_interfaceid": "f742ff18-5ea3-42a0-b229-27a32badce8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:11:43 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:78:2d,bridge_name='br-int',has_traffic_filtering=True,id=f742ff18-5ea3-42a0-b229-27a32badce8a,network=Network(85a74d82-5c98-4f2b-a38d-3e9ebe6a1e13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf742ff18-5e') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:11:43 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T10:11:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-51502851',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-51502851',id=12,image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM5vBaIfg5DdeW2zM4rA9EPiY+/ZYvJ/N5o4qpg6svPMp2TYXZseykJJc31kLM1fey6shmBY6qpJdgABWdhRsE2tAeMaXqi2NUagwQmOeDuf7yyD8QSo96HgIsUX6lNTkQ==',key_name='tempest-keypair-876906675',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eafaf607b5ff4b448aaaea253a321827',ramdisk_id='',reservation_id='r-5mbq86rv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1883132768',owner_user_name='tempest-TaggedBootDevicesTest_v242-1883132768-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T10:11:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8b186b80e92e41878b8ab7e839181fca',uuid=eef3cc09-054b-4a17-b621-4f3737d5420e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0f7c87ad-4076-4aca-8d9b-1fae099dd325", "address": "fa:16:3e:7a:05:a4", "network": {"id": "85a74d82-5c98-4f2b-a38d-3e9ebe6a1e13", "bridge": "br-int", "label": "tempest-device-tagging-net1-178618229", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.102", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "eafaf607b5ff4b448aaaea253a321827", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f7c87ad-40", "ovs_interfaceid": "0f7c87ad-4076-4aca-8d9b-1fae099dd325", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=85141) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 10:11:43 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] Converting VIF {"id": "0f7c87ad-4076-4aca-8d9b-1fae099dd325", "address": "fa:16:3e:7a:05:a4", "network": {"id": "85a74d82-5c98-4f2b-a38d-3e9ebe6a1e13", "bridge": "br-int", "label": "tempest-device-tagging-net1-178618229", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.102", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "eafaf607b5ff4b448aaaea253a321827", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f7c87ad-40", "ovs_interfaceid": "0f7c87ad-4076-4aca-8d9b-1fae099dd325", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:11:43 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7a:05:a4,bridge_name='br-int',has_traffic_filtering=True,id=0f7c87ad-4076-4aca-8d9b-1fae099dd325,network=Network(85a74d82-5c98-4f2b-a38d-3e9ebe6a1e13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap0f7c87ad-40') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:11:43 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T10:11:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-51502851',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-51502851',id=12,image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM5vBaIfg5DdeW2zM4rA9EPiY+/ZYvJ/N5o4qpg6svPMp2TYXZseykJJc31kLM1fey6shmBY6qpJdgABWdhRsE2tAeMaXqi2NUagwQmOeDuf7yyD8QSo96HgIsUX6lNTkQ==',key_name='tempest-keypair-876906675',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eafaf607b5ff4b448aaaea253a321827',ramdisk_id='',reservation_id='r-5mbq86rv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1883132768',owner_user_name='tempest-TaggedBootDevicesTest_v242-1883132768-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T10:11:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8b186b80e92e41878b8ab7e839181fca',uuid=eef3cc09-054b-4a17-b621-4f3737d5420e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d6b517e2-8788-4775-b327-11601713da4d", "address": "fa:16:3e:81:5a:0a", "network": {"id": "85a74d82-5c98-4f2b-a38d-3e9ebe6a1e13", "bridge": "br-int", "label": "tempest-device-tagging-net1-178618229", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.253", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "eafaf607b5ff4b448aaaea253a321827", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6b517e2-87", "ovs_interfaceid": "d6b517e2-8788-4775-b327-11601713da4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=85141) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 10:11:43 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] Converting VIF {"id": "d6b517e2-8788-4775-b327-11601713da4d", "address": "fa:16:3e:81:5a:0a", "network": {"id": "85a74d82-5c98-4f2b-a38d-3e9ebe6a1e13", "bridge": "br-int", "label": "tempest-device-tagging-net1-178618229", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.253", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "eafaf607b5ff4b448aaaea253a321827", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6b517e2-87", "ovs_interfaceid": "d6b517e2-8788-4775-b327-11601713da4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:11:43 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:81:5a:0a,bridge_name='br-int',has_traffic_filtering=True,id=d6b517e2-8788-4775-b327-11601713da4d,network=Network(85a74d82-5c98-4f2b-a38d-3e9ebe6a1e13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6b517e2-87') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:11:43 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T10:11:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-51502851',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-51502851',id=12,image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM5vBaIfg5DdeW2zM4rA9EPiY+/ZYvJ/N5o4qpg6svPMp2TYXZseykJJc31kLM1fey6shmBY6qpJdgABWdhRsE2tAeMaXqi2NUagwQmOeDuf7yyD8QSo96HgIsUX6lNTkQ==',key_name='tempest-keypair-876906675',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eafaf607b5ff4b448aaaea253a321827',ramdisk_id='',reservation_id='r-5mbq86rv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1883132768',owner_user_name='tempest-TaggedBootDevicesTest_v242-1883132768-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T10:11:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8b186b80e92e41878b8ab7e839181fca',uuid=eef3cc09-054b-4a17-b621-4f3737d5420e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0c9cc79d-1ded-40cc-84fc-f6b70a9bb555", "address": "fa:16:3e:d4:13:c9", "network": {"id": "85a74d82-5c98-4f2b-a38d-3e9ebe6a1e13", "bridge": "br-int", "label": "tempest-device-tagging-net1-178618229", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.61", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "eafaf607b5ff4b448aaaea253a321827", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c9cc79d-1d", "ovs_interfaceid": "0c9cc79d-1ded-40cc-84fc-f6b70a9bb555", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=85141) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 10:11:43 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] Converting VIF {"id": "0c9cc79d-1ded-40cc-84fc-f6b70a9bb555", "address": "fa:16:3e:d4:13:c9", "network": {"id": "85a74d82-5c98-4f2b-a38d-3e9ebe6a1e13", "bridge": "br-int", "label": "tempest-device-tagging-net1-178618229", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.61", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "eafaf607b5ff4b448aaaea253a321827", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c9cc79d-1d", "ovs_interfaceid": "0c9cc79d-1ded-40cc-84fc-f6b70a9bb555", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:11:43 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:13:c9,bridge_name='br-int',has_traffic_filtering=True,id=0c9cc79d-1ded-40cc-84fc-f6b70a9bb555,network=Network(85a74d82-5c98-4f2b-a38d-3e9ebe6a1e13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c9cc79d-1d') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:11:43 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T10:11:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-51502851',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-51502851',id=12,image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM5vBaIfg5DdeW2zM4rA9EPiY+/ZYvJ/N5o4qpg6svPMp2TYXZseykJJc31kLM1fey6shmBY6qpJdgABWdhRsE2tAeMaXqi2NUagwQmOeDuf7yyD8QSo96HgIsUX6lNTkQ==',key_name='tempest-keypair-876906675',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eafaf607b5ff4b448aaaea253a321827',ramdisk_id='',reservation_id='r-5mbq86rv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1883132768',owner_user_name='tempest-TaggedBootDevicesTest_v242-1883132768-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T10:11:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8b186b80e92e41878b8ab7e839181fca',uuid=eef3cc09-054b-4a17-b621-4f3737d5420e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b0183e60-7f49-44a1-a24c-30db287f2453", "address": "fa:16:3e:b2:23:6e", "network": {"id": "a9e0ac50-1fbb-4d94-a22f-6fcf40dd0194", "bridge": "br-int", "label": "tempest-device-tagging-net2-947660195", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "eafaf607b5ff4b448aaaea253a321827", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0183e60-7f", "ovs_interfaceid": "b0183e60-7f49-44a1-a24c-30db287f2453", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=85141) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 10:11:43 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] Converting VIF {"id": "b0183e60-7f49-44a1-a24c-30db287f2453", "address": "fa:16:3e:b2:23:6e", "network": {"id": "a9e0ac50-1fbb-4d94-a22f-6fcf40dd0194", "bridge": "br-int", "label": "tempest-device-tagging-net2-947660195", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "eafaf607b5ff4b448aaaea253a321827", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0183e60-7f", "ovs_interfaceid": "b0183e60-7f49-44a1-a24c-30db287f2453", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:11:43 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:23:6e,bridge_name='br-int',has_traffic_filtering=True,id=b0183e60-7f49-44a1-a24c-30db287f2453,network=Network(a9e0ac50-1fbb-4d94-a22f-6fcf40dd0194),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0183e60-7f') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:11:43 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T10:11:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-51502851',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-51502851',id=12,image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM5vBaIfg5DdeW2zM4rA9EPiY+/ZYvJ/N5o4qpg6svPMp2TYXZseykJJc31kLM1fey6shmBY6qpJdgABWdhRsE2tAeMaXqi2NUagwQmOeDuf7yyD8QSo96HgIsUX6lNTkQ==',key_name='tempest-keypair-876906675',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eafaf607b5ff4b448aaaea253a321827',ramdisk_id='',reservation_id='r-5mbq86rv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1883132768',owner_user_name='tempest-TaggedBootDevicesTest_v242-1883132768-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T10:11:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8b186b80e92e41878b8ab7e839181fca',uuid=eef3cc09-054b-4a17-b621-4f3737d5420e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "21180772-80b3-48e1-90e9-39590611ff08", "address": "fa:16:3e:c1:ed:f9", "network": {"id": "a9e0ac50-1fbb-4d94-a22f-6fcf40dd0194", "bridge": "br-int", "label": "tempest-device-tagging-net2-947660195", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "eafaf607b5ff4b448aaaea253a321827", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21180772-80", "ovs_interfaceid": "21180772-80b3-48e1-90e9-39590611ff08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=85141) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 10:11:43 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] Converting VIF {"id": "21180772-80b3-48e1-90e9-39590611ff08", "address": "fa:16:3e:c1:ed:f9", "network": {"id": "a9e0ac50-1fbb-4d94-a22f-6fcf40dd0194", "bridge": "br-int", "label": "tempest-device-tagging-net2-947660195", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "eafaf607b5ff4b448aaaea253a321827", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21180772-80", "ovs_interfaceid": "21180772-80b3-48e1-90e9-39590611ff08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:11:43 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:ed:f9,bridge_name='br-int',has_traffic_filtering=True,id=21180772-80b3-48e1-90e9-39590611ff08,network=Network(a9e0ac50-1fbb-4d94-a22f-6fcf40dd0194),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21180772-80') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:11:43 user nova-compute[85141]: DEBUG nova.objects.instance [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] Lazy-loading 'pci_devices' on Instance uuid eef3cc09-054b-4a17-b621-4f3737d5420e {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:11:43 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] [instance: eef3cc09-054b-4a17-b621-4f3737d5420e] End _get_guest_xml xml=<domain type="kvm">
Nov 16 10:11:43 user nova-compute[85141]:   <uuid>eef3cc09-054b-4a17-b621-4f3737d5420e</uuid>
Nov 16 10:11:43 user nova-compute[85141]:   <name>instance-0000000c</name>
Nov 16 10:11:43 user nova-compute[85141]:   <memory>524288</memory>
Nov 16 10:11:43 user nova-compute[85141]:   <vcpu>1</vcpu>
Nov 16 10:11:43 user nova-compute[85141]:   <metadata>
Nov 16 10:11:43 user nova-compute[85141]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 10:11:43 user nova-compute[85141]:       <nova:package version="0.0.0"/>
Nov 16 10:11:43 user nova-compute[85141]:       <nova:name>tempest-device-tagging-server-51502851</nova:name>
Nov 16 10:11:43 user nova-compute[85141]:       <nova:creationTime>2023-11-16 10:11:38</nova:creationTime>
Nov 16 10:11:43 user nova-compute[85141]:       <nova:flavor name="m1.tiny">
Nov 16 10:11:43 user nova-compute[85141]:         <nova:memory>512</nova:memory>
Nov 16 10:11:43 user nova-compute[85141]:         <nova:disk>1</nova:disk>
Nov 16 10:11:43 user nova-compute[85141]:         <nova:swap>0</nova:swap>
Nov 16 10:11:43 user nova-compute[85141]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 10:11:43 user nova-compute[85141]:         <nova:vcpus>1</nova:vcpus>
Nov 16 10:11:43 user nova-compute[85141]:       </nova:flavor>
Nov 16 10:11:43 user nova-compute[85141]:       <nova:owner>
Nov 16 10:11:43 user nova-compute[85141]:         <nova:user uuid="8b186b80e92e41878b8ab7e839181fca">tempest-TaggedBootDevicesTest_v242-1883132768-project-member</nova:user>
Nov 16 10:11:43 user nova-compute[85141]:         <nova:project uuid="eafaf607b5ff4b448aaaea253a321827">tempest-TaggedBootDevicesTest_v242-1883132768</nova:project>
Nov 16 10:11:43 user nova-compute[85141]:       </nova:owner>
Nov 16 10:11:43 user nova-compute[85141]:       <nova:root type="image" uuid="bc4ca70f-a459-4d5c-a9e6-80f1948eb48b"/>
Nov 16 10:11:43 user nova-compute[85141]:       <nova:ports>
Nov 16 10:11:43 user nova-compute[85141]:         <nova:port uuid="277c1d3d-ed49-4b8c-82e3-902fa6c8a2f5">
Nov 16 10:11:43 user nova-compute[85141]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 16 10:11:43 user nova-compute[85141]:         </nova:port>
Nov 16 10:11:43 user nova-compute[85141]:         <nova:port uuid="f742ff18-5ea3-42a0-b229-27a32badce8a">
Nov 16 10:11:43 user nova-compute[85141]:           <nova:ip type="fixed" address="10.1.1.216" ipVersion="4"/>
Nov 16 10:11:43 user nova-compute[85141]:         </nova:port>
Nov 16 10:11:43 user nova-compute[85141]:         <nova:port uuid="0f7c87ad-4076-4aca-8d9b-1fae099dd325">
Nov 16 10:11:43 user nova-compute[85141]:           <nova:ip type="fixed" address="10.1.1.102" ipVersion="4"/>
Nov 16 10:11:43 user nova-compute[85141]:         </nova:port>
Nov 16 10:11:43 user nova-compute[85141]:         <nova:port uuid="d6b517e2-8788-4775-b327-11601713da4d">
Nov 16 10:11:43 user nova-compute[85141]:           <nova:ip type="fixed" address="10.1.1.253" ipVersion="4"/>
Nov 16 10:11:43 user nova-compute[85141]:         </nova:port>
Nov 16 10:11:43 user nova-compute[85141]:         <nova:port uuid="0c9cc79d-1ded-40cc-84fc-f6b70a9bb555">
Nov 16 10:11:43 user nova-compute[85141]:           <nova:ip type="fixed" address="10.1.1.61" ipVersion="4"/>
Nov 16 10:11:43 user nova-compute[85141]:         </nova:port>
Nov 16 10:11:43 user nova-compute[85141]:         <nova:port uuid="b0183e60-7f49-44a1-a24c-30db287f2453">
Nov 16 10:11:43 user nova-compute[85141]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Nov 16 10:11:43 user nova-compute[85141]:         </nova:port>
Nov 16 10:11:43 user nova-compute[85141]:         <nova:port uuid="21180772-80b3-48e1-90e9-39590611ff08">
Nov 16 10:11:43 user nova-compute[85141]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Nov 16 10:11:43 user nova-compute[85141]:         </nova:port>
Nov 16 10:11:43 user nova-compute[85141]:       </nova:ports>
Nov 16 10:11:43 user nova-compute[85141]:     </nova:instance>
Nov 16 10:11:43 user nova-compute[85141]:   </metadata>
Nov 16 10:11:43 user nova-compute[85141]:   <sysinfo type="smbios">
Nov 16 10:11:43 user nova-compute[85141]:     <system>
Nov 16 10:11:43 user nova-compute[85141]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 10:11:43 user nova-compute[85141]:       <entry name="product">OpenStack Nova</entry>
Nov 16 10:11:43 user nova-compute[85141]:       <entry name="version">0.0.0</entry>
Nov 16 10:11:43 user nova-compute[85141]:       <entry name="serial">eef3cc09-054b-4a17-b621-4f3737d5420e</entry>
Nov 16 10:11:43 user nova-compute[85141]:       <entry name="uuid">eef3cc09-054b-4a17-b621-4f3737d5420e</entry>
Nov 16 10:11:43 user nova-compute[85141]:       <entry name="family">Virtual Machine</entry>
Nov 16 10:11:43 user nova-compute[85141]:     </system>
Nov 16 10:11:43 user nova-compute[85141]:   </sysinfo>
Nov 16 10:11:43 user nova-compute[85141]:   <os>
Nov 16 10:11:43 user nova-compute[85141]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 10:11:43 user nova-compute[85141]:     <boot dev="hd"/>
Nov 16 10:11:43 user nova-compute[85141]:     <smbios mode="sysinfo"/>
Nov 16 10:11:43 user nova-compute[85141]:   </os>
Nov 16 10:11:43 user nova-compute[85141]:   <features>
Nov 16 10:11:43 user nova-compute[85141]:     <acpi/>
Nov 16 10:11:43 user nova-compute[85141]:     <apic/>
Nov 16 10:11:43 user nova-compute[85141]:     <vmcoreinfo/>
Nov 16 10:11:43 user nova-compute[85141]:   </features>
Nov 16 10:11:43 user nova-compute[85141]:   <clock offset="utc">
Nov 16 10:11:43 user nova-compute[85141]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 10:11:43 user nova-compute[85141]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 10:11:43 user nova-compute[85141]:     <timer name="hpet" present="no"/>
Nov 16 10:11:43 user nova-compute[85141]:   </clock>
Nov 16 10:11:43 user nova-compute[85141]:   <cpu mode="custom" match="exact">
Nov 16 10:11:43 user nova-compute[85141]:     <model>Nehalem</model>
Nov 16 10:11:43 user nova-compute[85141]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 10:11:43 user nova-compute[85141]:   </cpu>
Nov 16 10:11:43 user nova-compute[85141]:   <devices>
Nov 16 10:11:43 user nova-compute[85141]:     <disk type="file" device="cdrom">
Nov 16 10:11:43 user nova-compute[85141]:       <driver name="qemu" type="raw" cache="none"/>
Nov 16 10:11:43 user nova-compute[85141]:       <source file="/opt/stack/data/nova/instances/eef3cc09-054b-4a17-b621-4f3737d5420e/disk.config"/>
Nov 16 10:11:43 user nova-compute[85141]:       <target dev="hda" bus="ide"/>
Nov 16 10:11:43 user nova-compute[85141]:     </disk>
Nov 16 10:11:43 user nova-compute[85141]:     <disk type="block" device="disk">
Nov 16 10:11:43 user nova-compute[85141]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 10:11:43 user nova-compute[85141]:       <source dev="/dev/sdc"/>
Nov 16 10:11:43 user nova-compute[85141]:       <target dev="vda" bus="virtio"/>
Nov 16 10:11:43 user nova-compute[85141]:       <serial>b4df10d9-a60c-45ed-981d-96f704534fb8</serial>
Nov 16 10:11:43 user nova-compute[85141]:     </disk>
Nov 16 10:11:43 user nova-compute[85141]:     <disk type="block" device="disk">
Nov 16 10:11:43 user nova-compute[85141]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 10:11:43 user nova-compute[85141]:       <source dev="/dev/sdd"/>
Nov 16 10:11:43 user nova-compute[85141]:       <target dev="vdb" bus="virtio"/>
Nov 16 10:11:43 user nova-compute[85141]:       <serial>4973f768-f126-41d6-b534-458d6c49f9b3</serial>
Nov 16 10:11:43 user nova-compute[85141]:     </disk>
Nov 16 10:11:43 user nova-compute[85141]:     <disk type="block" device="disk">
Nov 16 10:11:43 user nova-compute[85141]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 10:11:43 user nova-compute[85141]:       <source dev="/dev/sde"/>
Nov 16 10:11:43 user nova-compute[85141]:       <target dev="vdc" bus="virtio"/>
Nov 16 10:11:43 user nova-compute[85141]:       <serial>27fcde20-e019-4cf0-ad90-6c8100f4a8d2</serial>
Nov 16 10:11:43 user nova-compute[85141]:     </disk>
Nov 16 10:11:43 user nova-compute[85141]:     <interface type="ethernet">
Nov 16 10:11:43 user nova-compute[85141]:       <mac address="fa:16:3e:60:a2:e0"/>
Nov 16 10:11:43 user nova-compute[85141]:       <model type="virtio"/>
Nov 16 10:11:43 user nova-compute[85141]:       <mtu size="1442"/>
Nov 16 10:11:43 user nova-compute[85141]:       <target dev="tap277c1d3d-ed"/>
Nov 16 10:11:43 user nova-compute[85141]:     </interface>
Nov 16 10:11:43 user nova-compute[85141]:     <interface type="ethernet">
Nov 16 10:11:43 user nova-compute[85141]:       <mac address="fa:16:3e:38:78:2d"/>
Nov 16 10:11:43 user nova-compute[85141]:       <model type="virtio"/>
Nov 16 10:11:43 user nova-compute[85141]:       <mtu size="1442"/>
Nov 16 10:11:43 user nova-compute[85141]:       <target dev="tapf742ff18-5e"/>
Nov 16 10:11:43 user nova-compute[85141]:     </interface>
Nov 16 10:11:43 user nova-compute[85141]:     <interface type="ethernet">
Nov 16 10:11:43 user nova-compute[85141]:       <mac address="fa:16:3e:7a:05:a4"/>
Nov 16 10:11:43 user nova-compute[85141]:       <model type="virtio"/>
Nov 16 10:11:43 user nova-compute[85141]:       <mtu size="1442"/>
Nov 16 10:11:43 user nova-compute[85141]:       <target dev="tap0f7c87ad-40"/>
Nov 16 10:11:43 user nova-compute[85141]:     </interface>
Nov 16 10:11:43 user nova-compute[85141]:     <interface type="ethernet">
Nov 16 10:11:43 user nova-compute[85141]:       <mac address="fa:16:3e:81:5a:0a"/>
Nov 16 10:11:43 user nova-compute[85141]:       <model type="virtio"/>
Nov 16 10:11:43 user nova-compute[85141]:       <mtu size="1442"/>
Nov 16 10:11:43 user nova-compute[85141]:       <target dev="tapd6b517e2-87"/>
Nov 16 10:11:43 user nova-compute[85141]:     </interface>
Nov 16 10:11:43 user nova-compute[85141]:     <interface type="ethernet">
Nov 16 10:11:43 user nova-compute[85141]:       <mac address="fa:16:3e:d4:13:c9"/>
Nov 16 10:11:43 user nova-compute[85141]:       <model type="virtio"/>
Nov 16 10:11:43 user nova-compute[85141]:       <mtu size="1442"/>
Nov 16 10:11:43 user nova-compute[85141]:       <target dev="tap0c9cc79d-1d"/>
Nov 16 10:11:43 user nova-compute[85141]:     </interface>
Nov 16 10:11:43 user nova-compute[85141]:     <interface type="ethernet">
Nov 16 10:11:43 user nova-compute[85141]:       <mac address="fa:16:3e:b2:23:6e"/>
Nov 16 10:11:43 user nova-compute[85141]:       <model type="virtio"/>
Nov 16 10:11:43 user nova-compute[85141]:       <mtu size="1442"/>
Nov 16 10:11:43 user nova-compute[85141]:       <target dev="tapb0183e60-7f"/>
Nov 16 10:11:43 user nova-compute[85141]:     </interface>
Nov 16 10:11:43 user nova-compute[85141]:     <interface type="ethernet">
Nov 16 10:11:43 user nova-compute[85141]:       <mac address="fa:16:3e:c1:ed:f9"/>
Nov 16 10:11:43 user nova-compute[85141]:       <model type="virtio"/>
Nov 16 10:11:43 user nova-compute[85141]:       <mtu size="1442"/>
Nov 16 10:11:43 user nova-compute[85141]:       <target dev="tap21180772-80"/>
Nov 16 10:11:43 user nova-compute[85141]:     </interface>
Nov 16 10:11:43 user nova-compute[85141]:     <serial type="pty">
Nov 16 10:11:43 user nova-compute[85141]:       <log file="/opt/stack/data/nova/instances/eef3cc09-054b-4a17-b621-4f3737d5420e/console.log" append="off"/>
Nov 16 10:11:43 user nova-compute[85141]:     </serial>
Nov 16 10:11:43 user nova-compute[85141]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 10:11:43 user nova-compute[85141]:     <video>
Nov 16 10:11:43 user nova-compute[85141]:       <model type="virtio"/>
Nov 16 10:11:43 user nova-compute[85141]:     </video>
Nov 16 10:11:43 user nova-compute[85141]:     <rng model="virtio">
Nov 16 10:11:43 user nova-compute[85141]:       <backend model="random">/dev/urandom</backend>
Nov 16 10:11:43 user nova-compute[85141]:     </rng>
Nov 16 10:11:43 user nova-compute[85141]:     <controller type="usb" index="0" model="none"/>
Nov 16 10:11:43 user nova-compute[85141]:     <memballoon model="virtio">
Nov 16 10:11:43 user nova-compute[85141]:       <stats period="10"/>
Nov 16 10:11:43 user nova-compute[85141]:     </memballoon>
Nov 16 10:11:43 user nova-compute[85141]:   </devices>
Nov 16 10:11:43 user nova-compute[85141]: </domain>
Nov 16 10:11:43 user nova-compute[85141]:  {{(pid=85141) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 10:11:43 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T10:11:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-51502851',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-51502851',id=12,image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM5vBaIfg5DdeW2zM4rA9EPiY+/ZYvJ/N5o4qpg6svPMp2TYXZseykJJc31kLM1fey6shmBY6qpJdgABWdhRsE2tAeMaXqi2NUagwQmOeDuf7yyD8QSo96HgIsUX6lNTkQ==',key_name='tempest-keypair-876906675',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eafaf607b5ff4b448aaaea253a321827',ramdisk_id='',reservation_id='r-5mbq86rv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1883132768',owner_user_name='tempest-TaggedBootDevicesTest_v242-1883132768-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T10:11:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8b186b80e92e41878b8ab7e839181fca',uuid=eef3cc09-054b-4a17-b621-4f3737d5420e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "277c1d3d-ed49-4b8c-82e3-902fa6c8a2f5", "address": "fa:16:3e:60:a2:e0", "network": {"id": "1f8e2c11-f9ae-480d-a6e3-1df589fdd7bc", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-976382911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eafaf607b5ff4b448aaaea253a321827", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap277c1d3d-ed", "ovs_interfaceid": "277c1d3d-ed49-4b8c-82e3-902fa6c8a2f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 10:11:43 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] Converting VIF {"id": "277c1d3d-ed49-4b8c-82e3-902fa6c8a2f5", "address": "fa:16:3e:60:a2:e0", "network": {"id": "1f8e2c11-f9ae-480d-a6e3-1df589fdd7bc", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-976382911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eafaf607b5ff4b448aaaea253a321827", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap277c1d3d-ed", "ovs_interfaceid": "277c1d3d-ed49-4b8c-82e3-902fa6c8a2f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:11:43 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:60:a2:e0,bridge_name='br-int',has_traffic_filtering=True,id=277c1d3d-ed49-4b8c-82e3-902fa6c8a2f5,network=Network(1f8e2c11-f9ae-480d-a6e3-1df589fdd7bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap277c1d3d-ed') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:11:43 user nova-compute[85141]: DEBUG os_vif [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:a2:e0,bridge_name='br-int',has_traffic_filtering=True,id=277c1d3d-ed49-4b8c-82e3-902fa6c8a2f5,network=Network(1f8e2c11-f9ae-480d-a6e3-1df589fdd7bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap277c1d3d-ed') {{(pid=85141) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 10:11:43 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:11:43 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:11:43 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 10:11:43 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:11:43 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0082fd07-1b0e-5cca-93de-7604a11cdf4b', '_type': 'linux-noop'}}, row=False) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:11:43 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:11:43 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:11:43 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:11:43 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap277c1d3d-ed, may_exist=True, interface_attrs={}) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:11:43 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap277c1d3d-ed, col_values=(('qos', UUID('42a7fcc2-1fef-4f84-ae9c-8d3261399093')),), if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:11:43 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap277c1d3d-ed, col_values=(('external_ids', {'iface-id': '277c1d3d-ed49-4b8c-82e3-902fa6c8a2f5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:60:a2:e0', 'vm-uuid': 'eef3cc09-054b-4a17-b621-4f3737d5420e'}),), if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:11:43 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:11:43 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:11:43 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:11:43 user nova-compute[85141]: INFO os_vif [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:a2:e0,bridge_name='br-int',has_traffic_filtering=True,id=277c1d3d-ed49-4b8c-82e3-902fa6c8a2f5,network=Network(1f8e2c11-f9ae-480d-a6e3-1df589fdd7bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap277c1d3d-ed')
Nov 16 10:11:43 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T10:11:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-51502851',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-51502851',id=12,image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM5vBaIfg5DdeW2zM4rA9EPiY+/ZYvJ/N5o4qpg6svPMp2TYXZseykJJc31kLM1fey6shmBY6qpJdgABWdhRsE2tAeMaXqi2NUagwQmOeDuf7yyD8QSo96HgIsUX6lNTkQ==',key_name='tempest-keypair-876906675',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eafaf607b5ff4b448aaaea253a321827',ramdisk_id='',reservation_id='r-5mbq86rv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1883132768',owner_user_name='tempest-TaggedBootDevicesTest_v242-1883132768-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T10:11:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8b186b80e92e41878b8ab7e839181fca',uuid=eef3cc09-054b-4a17-b621-4f3737d5420e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f742ff18-5ea3-42a0-b229-27a32badce8a", "address": "fa:16:3e:38:78:2d", "network": {"id": "85a74d82-5c98-4f2b-a38d-3e9ebe6a1e13", "bridge": "br-int", "label": "tempest-device-tagging-net1-178618229", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.216", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "eafaf607b5ff4b448aaaea253a321827", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf742ff18-5e", "ovs_interfaceid": "f742ff18-5ea3-42a0-b229-27a32badce8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=85141) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 10:11:43 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] Converting VIF {"id": "f742ff18-5ea3-42a0-b229-27a32badce8a", "address": "fa:16:3e:38:78:2d", "network": {"id": "85a74d82-5c98-4f2b-a38d-3e9ebe6a1e13", "bridge": "br-int", "label": "tempest-device-tagging-net1-178618229", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.216", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "eafaf607b5ff4b448aaaea253a321827", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf742ff18-5e", "ovs_interfaceid": "f742ff18-5ea3-42a0-b229-27a32badce8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:11:43 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:78:2d,bridge_name='br-int',has_traffic_filtering=True,id=f742ff18-5ea3-42a0-b229-27a32badce8a,network=Network(85a74d82-5c98-4f2b-a38d-3e9ebe6a1e13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf742ff18-5e') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:11:43 user nova-compute[85141]: DEBUG os_vif [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:78:2d,bridge_name='br-int',has_traffic_filtering=True,id=f742ff18-5ea3-42a0-b229-27a32badce8a,network=Network(85a74d82-5c98-4f2b-a38d-3e9ebe6a1e13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf742ff18-5e') {{(pid=85141) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 10:11:43 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:11:43 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:11:43 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 10:11:43 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:11:43 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8e18bbed-2af6-5fa5-ac2b-ebd393a85feb', '_type': 'linux-noop'}}, row=False) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:11:43 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:11:43 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:11:43 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:11:43 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:11:43 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf742ff18-5e, may_exist=True, interface_attrs={}) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:11:43 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf742ff18-5e, col_values=(('qos', UUID('f2ca5321-d8ac-481d-a5fe-f5c12d82c868')),), if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:11:43 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf742ff18-5e, col_values=(('external_ids', {'iface-id': 'f742ff18-5ea3-42a0-b229-27a32badce8a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:38:78:2d', 'vm-uuid': 'eef3cc09-054b-4a17-b621-4f3737d5420e'}),), if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:11:43 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:11:43 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:11:43 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:11:43 user nova-compute[85141]: INFO os_vif [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:78:2d,bridge_name='br-int',has_traffic_filtering=True,id=f742ff18-5ea3-42a0-b229-27a32badce8a,network=Network(85a74d82-5c98-4f2b-a38d-3e9ebe6a1e13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf742ff18-5e')
Nov 16 10:11:43 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T10:11:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-51502851',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-51502851',id=12,image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM5vBaIfg5DdeW2zM4rA9EPiY+/ZYvJ/N5o4qpg6svPMp2TYXZseykJJc31kLM1fey6shmBY6qpJdgABWdhRsE2tAeMaXqi2NUagwQmOeDuf7yyD8QSo96HgIsUX6lNTkQ==',key_name='tempest-keypair-876906675',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eafaf607b5ff4b448aaaea253a321827',ramdisk_id='',reservation_id='r-5mbq86rv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1883132768',owner_user_name='tempest-TaggedBootDevicesTest_v242-1883132768-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T10:11:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8b186b80e92e41878b8ab7e839181fca',uuid=eef3cc09-054b-4a17-b621-4f3737d5420e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0f7c87ad-4076-4aca-8d9b-1fae099dd325", "address": "fa:16:3e:7a:05:a4", "network": {"id": "85a74d82-5c98-4f2b-a38d-3e9ebe6a1e13", "bridge": "br-int", "label": "tempest-device-tagging-net1-178618229", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.102", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "eafaf607b5ff4b448aaaea253a321827", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f7c87ad-40", "ovs_interfaceid": "0f7c87ad-4076-4aca-8d9b-1fae099dd325", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=85141) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 10:11:43 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] Converting VIF {"id": "0f7c87ad-4076-4aca-8d9b-1fae099dd325", "address": "fa:16:3e:7a:05:a4", "network": {"id": "85a74d82-5c98-4f2b-a38d-3e9ebe6a1e13", "bridge": "br-int", "label": "tempest-device-tagging-net1-178618229", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.102", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "eafaf607b5ff4b448aaaea253a321827", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f7c87ad-40", "ovs_interfaceid": "0f7c87ad-4076-4aca-8d9b-1fae099dd325", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:11:43 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7a:05:a4,bridge_name='br-int',has_traffic_filtering=True,id=0f7c87ad-4076-4aca-8d9b-1fae099dd325,network=Network(85a74d82-5c98-4f2b-a38d-3e9ebe6a1e13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap0f7c87ad-40') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:11:43 user nova-compute[85141]: DEBUG os_vif [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:05:a4,bridge_name='br-int',has_traffic_filtering=True,id=0f7c87ad-4076-4aca-8d9b-1fae099dd325,network=Network(85a74d82-5c98-4f2b-a38d-3e9ebe6a1e13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap0f7c87ad-40') {{(pid=85141) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 10:11:43 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:11:43 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:11:43 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 10:11:43 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:11:43 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4ea4ab56-6757-5754-aedd-f9af4db2984b', '_type': 'linux-noop'}}, row=False) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:11:43 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:11:43 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:11:43 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:11:43 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:11:43 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0f7c87ad-40, may_exist=True, interface_attrs={}) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:11:43 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0f7c87ad-40, col_values=(('qos', UUID('292f6634-0b60-4320-92d7-ae9f8fe9a55c')),), if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:11:43 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0f7c87ad-40, col_values=(('external_ids', {'iface-id': '0f7c87ad-4076-4aca-8d9b-1fae099dd325', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7a:05:a4', 'vm-uuid': 'eef3cc09-054b-4a17-b621-4f3737d5420e'}),), if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:11:43 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:11:43 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:11:43 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:11:43 user nova-compute[85141]: INFO os_vif [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:05:a4,bridge_name='br-int',has_traffic_filtering=True,id=0f7c87ad-4076-4aca-8d9b-1fae099dd325,network=Network(85a74d82-5c98-4f2b-a38d-3e9ebe6a1e13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap0f7c87ad-40')
Nov 16 10:11:43 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T10:11:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-51502851',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-51502851',id=12,image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM5vBaIfg5DdeW2zM4rA9EPiY+/ZYvJ/N5o4qpg6svPMp2TYXZseykJJc31kLM1fey6shmBY6qpJdgABWdhRsE2tAeMaXqi2NUagwQmOeDuf7yyD8QSo96HgIsUX6lNTkQ==',key_name='tempest-keypair-876906675',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eafaf607b5ff4b448aaaea253a321827',ramdisk_id='',reservation_id='r-5mbq86rv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1883132768',owner_user_name='tempest-TaggedBootDevicesTest_v242-1883132768-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T10:11:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8b186b80e92e41878b8ab7e839181fca',uuid=eef3cc09-054b-4a17-b621-4f3737d5420e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d6b517e2-8788-4775-b327-11601713da4d", "address": "fa:16:3e:81:5a:0a", "network": {"id": "85a74d82-5c98-4f2b-a38d-3e9ebe6a1e13", "bridge": "br-int", "label": "tempest-device-tagging-net1-178618229", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.253", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "eafaf607b5ff4b448aaaea253a321827", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6b517e2-87", "ovs_interfaceid": "d6b517e2-8788-4775-b327-11601713da4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 10:11:43 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] Converting VIF {"id": "d6b517e2-8788-4775-b327-11601713da4d", "address": "fa:16:3e:81:5a:0a", "network": {"id": "85a74d82-5c98-4f2b-a38d-3e9ebe6a1e13", "bridge": "br-int", "label": "tempest-device-tagging-net1-178618229", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.253", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "eafaf607b5ff4b448aaaea253a321827", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6b517e2-87", "ovs_interfaceid": "d6b517e2-8788-4775-b327-11601713da4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:11:43 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:81:5a:0a,bridge_name='br-int',has_traffic_filtering=True,id=d6b517e2-8788-4775-b327-11601713da4d,network=Network(85a74d82-5c98-4f2b-a38d-3e9ebe6a1e13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6b517e2-87') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:11:43 user nova-compute[85141]: DEBUG os_vif [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:5a:0a,bridge_name='br-int',has_traffic_filtering=True,id=d6b517e2-8788-4775-b327-11601713da4d,network=Network(85a74d82-5c98-4f2b-a38d-3e9ebe6a1e13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6b517e2-87') {{(pid=85141) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 10:11:43 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:11:43 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:11:43 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 10:11:43 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:11:43 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6fbafb21-4d68-5b6d-aa09-797921d46fdd', '_type': 'linux-noop'}}, row=False) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:11:43 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:11:43 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:11:43 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:11:43 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:11:43 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd6b517e2-87, may_exist=True, interface_attrs={}) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:11:43 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd6b517e2-87, col_values=(('qos', UUID('2763e00f-349b-4cea-9c14-c5380a07dca1')),), if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:11:43 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd6b517e2-87, col_values=(('external_ids', {'iface-id': 'd6b517e2-8788-4775-b327-11601713da4d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:81:5a:0a', 'vm-uuid': 'eef3cc09-054b-4a17-b621-4f3737d5420e'}),), if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:11:43 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:11:43 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:11:43 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:11:43 user nova-compute[85141]: INFO os_vif [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:5a:0a,bridge_name='br-int',has_traffic_filtering=True,id=d6b517e2-8788-4775-b327-11601713da4d,network=Network(85a74d82-5c98-4f2b-a38d-3e9ebe6a1e13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6b517e2-87')
Nov 16 10:11:43 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T10:11:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-51502851',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-51502851',id=12,image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM5vBaIfg5DdeW2zM4rA9EPiY+/ZYvJ/N5o4qpg6svPMp2TYXZseykJJc31kLM1fey6shmBY6qpJdgABWdhRsE2tAeMaXqi2NUagwQmOeDuf7yyD8QSo96HgIsUX6lNTkQ==',key_name='tempest-keypair-876906675',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eafaf607b5ff4b448aaaea253a321827',ramdisk_id='',reservation_id='r-5mbq86rv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1883132768',owner_user_name='tempest-TaggedBootDevicesTest_v242-1883132768-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T10:11:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8b186b80e92e41878b8ab7e839181fca',uuid=eef3cc09-054b-4a17-b621-4f3737d5420e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0c9cc79d-1ded-40cc-84fc-f6b70a9bb555", "address": "fa:16:3e:d4:13:c9", "network": {"id": "85a74d82-5c98-4f2b-a38d-3e9ebe6a1e13", "bridge": "br-int", "label": "tempest-device-tagging-net1-178618229", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.61", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "eafaf607b5ff4b448aaaea253a321827", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c9cc79d-1d", "ovs_interfaceid": "0c9cc79d-1ded-40cc-84fc-f6b70a9bb555", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 10:11:43 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] Converting VIF {"id": "0c9cc79d-1ded-40cc-84fc-f6b70a9bb555", "address": "fa:16:3e:d4:13:c9", "network": {"id": "85a74d82-5c98-4f2b-a38d-3e9ebe6a1e13", "bridge": "br-int", "label": "tempest-device-tagging-net1-178618229", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.61", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "eafaf607b5ff4b448aaaea253a321827", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c9cc79d-1d", "ovs_interfaceid": "0c9cc79d-1ded-40cc-84fc-f6b70a9bb555", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:11:43 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:13:c9,bridge_name='br-int',has_traffic_filtering=True,id=0c9cc79d-1ded-40cc-84fc-f6b70a9bb555,network=Network(85a74d82-5c98-4f2b-a38d-3e9ebe6a1e13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c9cc79d-1d') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:11:43 user nova-compute[85141]: DEBUG os_vif [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:13:c9,bridge_name='br-int',has_traffic_filtering=True,id=0c9cc79d-1ded-40cc-84fc-f6b70a9bb555,network=Network(85a74d82-5c98-4f2b-a38d-3e9ebe6a1e13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c9cc79d-1d') {{(pid=85141) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 10:11:43 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:11:43 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:11:43 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 10:11:43 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:11:43 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '92b86149-fdf1-55d4-a63e-c5ba85bfb30d', '_type': 'linux-noop'}}, row=False) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:11:43 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:11:43 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:11:43 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:11:43 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:11:43 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0c9cc79d-1d, may_exist=True, interface_attrs={}) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:11:43 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0c9cc79d-1d, col_values=(('qos', UUID('2cb69807-7f5f-4e00-ae11-33295c3c81e7')),), if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:11:43 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0c9cc79d-1d, col_values=(('external_ids', {'iface-id': '0c9cc79d-1ded-40cc-84fc-f6b70a9bb555', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d4:13:c9', 'vm-uuid': 'eef3cc09-054b-4a17-b621-4f3737d5420e'}),), if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:11:43 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:11:43 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:11:43 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:11:43 user nova-compute[85141]: INFO os_vif [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:13:c9,bridge_name='br-int',has_traffic_filtering=True,id=0c9cc79d-1ded-40cc-84fc-f6b70a9bb555,network=Network(85a74d82-5c98-4f2b-a38d-3e9ebe6a1e13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c9cc79d-1d')
Nov 16 10:11:43 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T10:11:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-51502851',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-51502851',id=12,image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM5vBaIfg5DdeW2zM4rA9EPiY+/ZYvJ/N5o4qpg6svPMp2TYXZseykJJc31kLM1fey6shmBY6qpJdgABWdhRsE2tAeMaXqi2NUagwQmOeDuf7yyD8QSo96HgIsUX6lNTkQ==',key_name='tempest-keypair-876906675',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eafaf607b5ff4b448aaaea253a321827',ramdisk_id='',reservation_id='r-5mbq86rv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1883132768',owner_user_name='tempest-TaggedBootDevicesTest_v242-1883132768-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T10:11:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8b186b80e92e41878b8ab7e839181fca',uuid=eef3cc09-054b-4a17-b621-4f3737d5420e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b0183e60-7f49-44a1-a24c-30db287f2453", "address": "fa:16:3e:b2:23:6e", "network": {"id": "a9e0ac50-1fbb-4d94-a22f-6fcf40dd0194", "bridge": "br-int", "label": "tempest-device-tagging-net2-947660195", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "eafaf607b5ff4b448aaaea253a321827", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0183e60-7f", "ovs_interfaceid": "b0183e60-7f49-44a1-a24c-30db287f2453", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 10:11:43 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] Converting VIF {"id": "b0183e60-7f49-44a1-a24c-30db287f2453", "address": "fa:16:3e:b2:23:6e", "network": {"id": "a9e0ac50-1fbb-4d94-a22f-6fcf40dd0194", "bridge": "br-int", "label": "tempest-device-tagging-net2-947660195", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "eafaf607b5ff4b448aaaea253a321827", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0183e60-7f", "ovs_interfaceid": "b0183e60-7f49-44a1-a24c-30db287f2453", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:11:43 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:23:6e,bridge_name='br-int',has_traffic_filtering=True,id=b0183e60-7f49-44a1-a24c-30db287f2453,network=Network(a9e0ac50-1fbb-4d94-a22f-6fcf40dd0194),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0183e60-7f') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:11:43 user nova-compute[85141]: DEBUG os_vif [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:23:6e,bridge_name='br-int',has_traffic_filtering=True,id=b0183e60-7f49-44a1-a24c-30db287f2453,network=Network(a9e0ac50-1fbb-4d94-a22f-6fcf40dd0194),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0183e60-7f') {{(pid=85141) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 10:11:43 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:11:43 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:11:43 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 10:11:43 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:11:43 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '910e9a0c-95cc-5ffe-b193-24b9ec9b16e6', '_type': 'linux-noop'}}, row=False) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:11:43 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:11:43 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:11:43 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:11:43 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:11:43 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb0183e60-7f, may_exist=True, interface_attrs={}) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:11:43 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb0183e60-7f, col_values=(('qos', UUID('8572342b-75e5-4188-9e30-6143c1641790')),), if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:11:43 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb0183e60-7f, col_values=(('external_ids', {'iface-id': 'b0183e60-7f49-44a1-a24c-30db287f2453', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b2:23:6e', 'vm-uuid': 'eef3cc09-054b-4a17-b621-4f3737d5420e'}),), if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:11:43 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:11:43 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:11:43 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:11:43 user nova-compute[85141]: INFO os_vif [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:23:6e,bridge_name='br-int',has_traffic_filtering=True,id=b0183e60-7f49-44a1-a24c-30db287f2453,network=Network(a9e0ac50-1fbb-4d94-a22f-6fcf40dd0194),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0183e60-7f')
Nov 16 10:11:43 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T10:11:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-51502851',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-51502851',id=12,image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM5vBaIfg5DdeW2zM4rA9EPiY+/ZYvJ/N5o4qpg6svPMp2TYXZseykJJc31kLM1fey6shmBY6qpJdgABWdhRsE2tAeMaXqi2NUagwQmOeDuf7yyD8QSo96HgIsUX6lNTkQ==',key_name='tempest-keypair-876906675',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eafaf607b5ff4b448aaaea253a321827',ramdisk_id='',reservation_id='r-5mbq86rv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1883132768',owner_user_name='tempest-TaggedBootDevicesTest_v242-1883132768-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T10:11:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8b186b80e92e41878b8ab7e839181fca',uuid=eef3cc09-054b-4a17-b621-4f3737d5420e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "21180772-80b3-48e1-90e9-39590611ff08", "address": "fa:16:3e:c1:ed:f9", "network": {"id": "a9e0ac50-1fbb-4d94-a22f-6fcf40dd0194", "bridge": "br-int", "label": "tempest-device-tagging-net2-947660195", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "eafaf607b5ff4b448aaaea253a321827", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21180772-80", "ovs_interfaceid": "21180772-80b3-48e1-90e9-39590611ff08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 10:11:43 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] Converting VIF {"id": "21180772-80b3-48e1-90e9-39590611ff08", "address": "fa:16:3e:c1:ed:f9", "network": {"id": "a9e0ac50-1fbb-4d94-a22f-6fcf40dd0194", "bridge": "br-int", "label": "tempest-device-tagging-net2-947660195", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "eafaf607b5ff4b448aaaea253a321827", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21180772-80", "ovs_interfaceid": "21180772-80b3-48e1-90e9-39590611ff08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:11:43 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:ed:f9,bridge_name='br-int',has_traffic_filtering=True,id=21180772-80b3-48e1-90e9-39590611ff08,network=Network(a9e0ac50-1fbb-4d94-a22f-6fcf40dd0194),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21180772-80') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:11:43 user nova-compute[85141]: DEBUG os_vif [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:ed:f9,bridge_name='br-int',has_traffic_filtering=True,id=21180772-80b3-48e1-90e9-39590611ff08,network=Network(a9e0ac50-1fbb-4d94-a22f-6fcf40dd0194),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21180772-80') {{(pid=85141) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 10:11:43 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:11:43 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:11:43 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 10:11:43 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:11:43 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f70784e2-92b5-548c-b09a-efcdfaaca9c0', '_type': 'linux-noop'}}, row=False) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:11:43 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:11:43 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:11:44 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:11:44 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:11:44 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap21180772-80, may_exist=True, interface_attrs={}) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:11:44 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap21180772-80, col_values=(('qos', UUID('b2be448e-88ae-4bcc-a428-bbc39d405812')),), if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:11:44 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap21180772-80, col_values=(('external_ids', {'iface-id': '21180772-80b3-48e1-90e9-39590611ff08', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c1:ed:f9', 'vm-uuid': 'eef3cc09-054b-4a17-b621-4f3737d5420e'}),), if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:11:44 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:11:44 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:11:44 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:11:44 user nova-compute[85141]: INFO os_vif [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:ed:f9,bridge_name='br-int',has_traffic_filtering=True,id=21180772-80b3-48e1-90e9-39590611ff08,network=Network(a9e0ac50-1fbb-4d94-a22f-6fcf40dd0194),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21180772-80')
Nov 16 10:11:44 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] No BDM found with device name hda, not building metadata. {{(pid=85141) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 10:11:44 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] No BDM found with device name vdc, not building metadata. {{(pid=85141) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 10:11:44 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] No VIF found with MAC fa:16:3e:60:a2:e0, not building metadata {{(pid=85141) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 10:11:44 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] No VIF found with MAC fa:16:3e:d4:13:c9, not building metadata {{(pid=85141) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 10:11:44 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] [instance: eef3cc09-054b-4a17-b621-4f3737d5420e] Using config drive
Nov 16 10:11:44 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] [instance: eef3cc09-054b-4a17-b621-4f3737d5420e] Creating config drive at /opt/stack/data/nova/instances/eef3cc09-054b-4a17-b621-4f3737d5420e/disk.config
Nov 16 10:11:44 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/eef3cc09-054b-4a17-b621-4f3737d5420e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpjysv8mxb {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:11:44 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/eef3cc09-054b-4a17-b621-4f3737d5420e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpjysv8mxb" returned: 0 in 0.051s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:11:45 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:11:45 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:11:45 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:11:46 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:11:46 user nova-compute[85141]: DEBUG nova.compute.manager [req-b6960aff-c39b-46c9-a06b-fc7dfbc13281 req-6a1041dc-de4e-4a28-8605-883705dba6d6 service nova] [instance: eef3cc09-054b-4a17-b621-4f3737d5420e] Received event network-vif-plugged-277c1d3d-ed49-4b8c-82e3-902fa6c8a2f5 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:11:46 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-b6960aff-c39b-46c9-a06b-fc7dfbc13281 req-6a1041dc-de4e-4a28-8605-883705dba6d6 service nova] Acquiring lock "eef3cc09-054b-4a17-b621-4f3737d5420e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:11:46 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-b6960aff-c39b-46c9-a06b-fc7dfbc13281 req-6a1041dc-de4e-4a28-8605-883705dba6d6 service nova] Lock "eef3cc09-054b-4a17-b621-4f3737d5420e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:11:46 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-b6960aff-c39b-46c9-a06b-fc7dfbc13281 req-6a1041dc-de4e-4a28-8605-883705dba6d6 service nova] Lock "eef3cc09-054b-4a17-b621-4f3737d5420e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:11:46 user nova-compute[85141]: DEBUG nova.compute.manager [req-b6960aff-c39b-46c9-a06b-fc7dfbc13281 req-6a1041dc-de4e-4a28-8605-883705dba6d6 service nova] [instance: eef3cc09-054b-4a17-b621-4f3737d5420e] No waiting events found dispatching network-vif-plugged-277c1d3d-ed49-4b8c-82e3-902fa6c8a2f5 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:11:46 user nova-compute[85141]: WARNING nova.compute.manager [req-b6960aff-c39b-46c9-a06b-fc7dfbc13281 req-6a1041dc-de4e-4a28-8605-883705dba6d6 service nova] [instance: eef3cc09-054b-4a17-b621-4f3737d5420e] Received unexpected event network-vif-plugged-277c1d3d-ed49-4b8c-82e3-902fa6c8a2f5 for instance with vm_state building and task_state spawning.
Nov 16 10:11:46 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:11:46 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:11:46 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:11:46 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:11:46 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:11:46 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:11:46 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:11:46 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:11:46 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:11:46 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:11:46 user nova-compute[85141]: DEBUG nova.compute.manager [req-3374db70-c105-4838-9546-56b8e1de9bc3 req-8cd58b1e-c7ac-4c90-9c9a-196d7f259cc3 service nova] [instance: eef3cc09-054b-4a17-b621-4f3737d5420e] Received event network-vif-plugged-0f7c87ad-4076-4aca-8d9b-1fae099dd325 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:11:46 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-3374db70-c105-4838-9546-56b8e1de9bc3 req-8cd58b1e-c7ac-4c90-9c9a-196d7f259cc3 service nova] Acquiring lock "eef3cc09-054b-4a17-b621-4f3737d5420e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:11:46 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-3374db70-c105-4838-9546-56b8e1de9bc3 req-8cd58b1e-c7ac-4c90-9c9a-196d7f259cc3 service nova] Lock "eef3cc09-054b-4a17-b621-4f3737d5420e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:11:46 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-3374db70-c105-4838-9546-56b8e1de9bc3 req-8cd58b1e-c7ac-4c90-9c9a-196d7f259cc3 service nova] Lock "eef3cc09-054b-4a17-b621-4f3737d5420e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:11:46 user nova-compute[85141]: DEBUG nova.compute.manager [req-3374db70-c105-4838-9546-56b8e1de9bc3 req-8cd58b1e-c7ac-4c90-9c9a-196d7f259cc3 service nova] [instance: eef3cc09-054b-4a17-b621-4f3737d5420e] No waiting events found dispatching network-vif-plugged-0f7c87ad-4076-4aca-8d9b-1fae099dd325 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:11:46 user nova-compute[85141]: WARNING nova.compute.manager [req-3374db70-c105-4838-9546-56b8e1de9bc3 req-8cd58b1e-c7ac-4c90-9c9a-196d7f259cc3 service nova] [instance: eef3cc09-054b-4a17-b621-4f3737d5420e] Received unexpected event network-vif-plugged-0f7c87ad-4076-4aca-8d9b-1fae099dd325 for instance with vm_state building and task_state spawning.
Nov 16 10:11:46 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:11:46 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:11:46 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:11:47 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:11:47 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:11:47 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:11:47 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:11:47 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:11:47 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:11:47 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:11:47 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:11:47 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:11:47 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:11:47 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:11:47 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:11:47 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:11:47 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:11:47 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:11:47 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:11:47 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:11:48 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:11:48 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:11:48 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:11:48 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:11:48 user nova-compute[85141]: DEBUG nova.compute.manager [req-33c25c0c-da18-440c-9848-728412bc5e6e req-39a422b6-1eac-4d42-bd5e-f607c2349f0d service nova] [instance: eef3cc09-054b-4a17-b621-4f3737d5420e] Received event network-vif-plugged-277c1d3d-ed49-4b8c-82e3-902fa6c8a2f5 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:11:48 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-33c25c0c-da18-440c-9848-728412bc5e6e req-39a422b6-1eac-4d42-bd5e-f607c2349f0d service nova] Acquiring lock "eef3cc09-054b-4a17-b621-4f3737d5420e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:11:48 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-33c25c0c-da18-440c-9848-728412bc5e6e req-39a422b6-1eac-4d42-bd5e-f607c2349f0d service nova] Lock "eef3cc09-054b-4a17-b621-4f3737d5420e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:11:48 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-33c25c0c-da18-440c-9848-728412bc5e6e req-39a422b6-1eac-4d42-bd5e-f607c2349f0d service nova] Lock "eef3cc09-054b-4a17-b621-4f3737d5420e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:11:48 user nova-compute[85141]: DEBUG nova.compute.manager [req-33c25c0c-da18-440c-9848-728412bc5e6e req-39a422b6-1eac-4d42-bd5e-f607c2349f0d service nova] [instance: eef3cc09-054b-4a17-b621-4f3737d5420e] No waiting events found dispatching network-vif-plugged-277c1d3d-ed49-4b8c-82e3-902fa6c8a2f5 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:11:48 user nova-compute[85141]: WARNING nova.compute.manager [req-33c25c0c-da18-440c-9848-728412bc5e6e req-39a422b6-1eac-4d42-bd5e-f607c2349f0d service nova] [instance: eef3cc09-054b-4a17-b621-4f3737d5420e] Received unexpected event network-vif-plugged-277c1d3d-ed49-4b8c-82e3-902fa6c8a2f5 for instance with vm_state building and task_state spawning.
Nov 16 10:11:48 user nova-compute[85141]: DEBUG nova.compute.manager [req-33c25c0c-da18-440c-9848-728412bc5e6e req-39a422b6-1eac-4d42-bd5e-f607c2349f0d service nova] [instance: eef3cc09-054b-4a17-b621-4f3737d5420e] Received event network-vif-plugged-f742ff18-5ea3-42a0-b229-27a32badce8a {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:11:48 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-33c25c0c-da18-440c-9848-728412bc5e6e req-39a422b6-1eac-4d42-bd5e-f607c2349f0d service nova] Acquiring lock "eef3cc09-054b-4a17-b621-4f3737d5420e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:11:48 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-33c25c0c-da18-440c-9848-728412bc5e6e req-39a422b6-1eac-4d42-bd5e-f607c2349f0d service nova] Lock "eef3cc09-054b-4a17-b621-4f3737d5420e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:11:48 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-33c25c0c-da18-440c-9848-728412bc5e6e req-39a422b6-1eac-4d42-bd5e-f607c2349f0d service nova] Lock "eef3cc09-054b-4a17-b621-4f3737d5420e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:11:48 user nova-compute[85141]: DEBUG nova.compute.manager [req-33c25c0c-da18-440c-9848-728412bc5e6e req-39a422b6-1eac-4d42-bd5e-f607c2349f0d service nova] [instance: eef3cc09-054b-4a17-b621-4f3737d5420e] No waiting events found dispatching network-vif-plugged-f742ff18-5ea3-42a0-b229-27a32badce8a {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:11:48 user nova-compute[85141]: WARNING nova.compute.manager [req-33c25c0c-da18-440c-9848-728412bc5e6e req-39a422b6-1eac-4d42-bd5e-f607c2349f0d service nova] [instance: eef3cc09-054b-4a17-b621-4f3737d5420e] Received unexpected event network-vif-plugged-f742ff18-5ea3-42a0-b229-27a32badce8a for instance with vm_state building and task_state spawning.
Nov 16 10:11:48 user nova-compute[85141]: DEBUG nova.compute.manager [req-33c25c0c-da18-440c-9848-728412bc5e6e req-39a422b6-1eac-4d42-bd5e-f607c2349f0d service nova] [instance: eef3cc09-054b-4a17-b621-4f3737d5420e] Received event network-vif-plugged-f742ff18-5ea3-42a0-b229-27a32badce8a {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:11:48 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-33c25c0c-da18-440c-9848-728412bc5e6e req-39a422b6-1eac-4d42-bd5e-f607c2349f0d service nova] Acquiring lock "eef3cc09-054b-4a17-b621-4f3737d5420e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:11:48 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-33c25c0c-da18-440c-9848-728412bc5e6e req-39a422b6-1eac-4d42-bd5e-f607c2349f0d service nova] Lock "eef3cc09-054b-4a17-b621-4f3737d5420e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:11:48 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-33c25c0c-da18-440c-9848-728412bc5e6e req-39a422b6-1eac-4d42-bd5e-f607c2349f0d service nova] Lock "eef3cc09-054b-4a17-b621-4f3737d5420e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:11:48 user nova-compute[85141]: DEBUG nova.compute.manager [req-33c25c0c-da18-440c-9848-728412bc5e6e req-39a422b6-1eac-4d42-bd5e-f607c2349f0d service nova] [instance: eef3cc09-054b-4a17-b621-4f3737d5420e] No waiting events found dispatching network-vif-plugged-f742ff18-5ea3-42a0-b229-27a32badce8a {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:11:48 user nova-compute[85141]: WARNING nova.compute.manager [req-33c25c0c-da18-440c-9848-728412bc5e6e req-39a422b6-1eac-4d42-bd5e-f607c2349f0d service nova] [instance: eef3cc09-054b-4a17-b621-4f3737d5420e] Received unexpected event network-vif-plugged-f742ff18-5ea3-42a0-b229-27a32badce8a for instance with vm_state building and task_state spawning.
Nov 16 10:11:48 user nova-compute[85141]: DEBUG nova.compute.manager [req-33c25c0c-da18-440c-9848-728412bc5e6e req-39a422b6-1eac-4d42-bd5e-f607c2349f0d service nova] [instance: eef3cc09-054b-4a17-b621-4f3737d5420e] Received event network-vif-plugged-0c9cc79d-1ded-40cc-84fc-f6b70a9bb555 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:11:48 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-33c25c0c-da18-440c-9848-728412bc5e6e req-39a422b6-1eac-4d42-bd5e-f607c2349f0d service nova] Acquiring lock "eef3cc09-054b-4a17-b621-4f3737d5420e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:11:48 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-33c25c0c-da18-440c-9848-728412bc5e6e req-39a422b6-1eac-4d42-bd5e-f607c2349f0d service nova] Lock "eef3cc09-054b-4a17-b621-4f3737d5420e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:11:48 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-33c25c0c-da18-440c-9848-728412bc5e6e req-39a422b6-1eac-4d42-bd5e-f607c2349f0d service nova] Lock "eef3cc09-054b-4a17-b621-4f3737d5420e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:11:48 user nova-compute[85141]: DEBUG nova.compute.manager [req-33c25c0c-da18-440c-9848-728412bc5e6e req-39a422b6-1eac-4d42-bd5e-f607c2349f0d service nova] [instance: eef3cc09-054b-4a17-b621-4f3737d5420e] No waiting events found dispatching network-vif-plugged-0c9cc79d-1ded-40cc-84fc-f6b70a9bb555 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:11:48 user nova-compute[85141]: WARNING nova.compute.manager [req-33c25c0c-da18-440c-9848-728412bc5e6e req-39a422b6-1eac-4d42-bd5e-f607c2349f0d service nova] [instance: eef3cc09-054b-4a17-b621-4f3737d5420e] Received unexpected event network-vif-plugged-0c9cc79d-1ded-40cc-84fc-f6b70a9bb555 for instance with vm_state building and task_state spawning.
Nov 16 10:11:48 user nova-compute[85141]: DEBUG nova.compute.manager [req-33c25c0c-da18-440c-9848-728412bc5e6e req-39a422b6-1eac-4d42-bd5e-f607c2349f0d service nova] [instance: eef3cc09-054b-4a17-b621-4f3737d5420e] Received event network-vif-plugged-0c9cc79d-1ded-40cc-84fc-f6b70a9bb555 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:11:48 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-33c25c0c-da18-440c-9848-728412bc5e6e req-39a422b6-1eac-4d42-bd5e-f607c2349f0d service nova] Acquiring lock "eef3cc09-054b-4a17-b621-4f3737d5420e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:11:48 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-33c25c0c-da18-440c-9848-728412bc5e6e req-39a422b6-1eac-4d42-bd5e-f607c2349f0d service nova] Lock "eef3cc09-054b-4a17-b621-4f3737d5420e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:11:48 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-33c25c0c-da18-440c-9848-728412bc5e6e req-39a422b6-1eac-4d42-bd5e-f607c2349f0d service nova] Lock "eef3cc09-054b-4a17-b621-4f3737d5420e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:11:48 user nova-compute[85141]: DEBUG nova.compute.manager [req-33c25c0c-da18-440c-9848-728412bc5e6e req-39a422b6-1eac-4d42-bd5e-f607c2349f0d service nova] [instance: eef3cc09-054b-4a17-b621-4f3737d5420e] No waiting events found dispatching network-vif-plugged-0c9cc79d-1ded-40cc-84fc-f6b70a9bb555 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:11:48 user nova-compute[85141]: WARNING nova.compute.manager [req-33c25c0c-da18-440c-9848-728412bc5e6e req-39a422b6-1eac-4d42-bd5e-f607c2349f0d service nova] [instance: eef3cc09-054b-4a17-b621-4f3737d5420e] Received unexpected event network-vif-plugged-0c9cc79d-1ded-40cc-84fc-f6b70a9bb555 for instance with vm_state building and task_state spawning.
Nov 16 10:11:48 user nova-compute[85141]: DEBUG nova.compute.manager [req-33c25c0c-da18-440c-9848-728412bc5e6e req-39a422b6-1eac-4d42-bd5e-f607c2349f0d service nova] [instance: eef3cc09-054b-4a17-b621-4f3737d5420e] Received event network-vif-plugged-b0183e60-7f49-44a1-a24c-30db287f2453 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:11:48 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-33c25c0c-da18-440c-9848-728412bc5e6e req-39a422b6-1eac-4d42-bd5e-f607c2349f0d service nova] Acquiring lock "eef3cc09-054b-4a17-b621-4f3737d5420e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:11:48 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-33c25c0c-da18-440c-9848-728412bc5e6e req-39a422b6-1eac-4d42-bd5e-f607c2349f0d service nova] Lock "eef3cc09-054b-4a17-b621-4f3737d5420e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:11:48 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-33c25c0c-da18-440c-9848-728412bc5e6e req-39a422b6-1eac-4d42-bd5e-f607c2349f0d service nova] Lock "eef3cc09-054b-4a17-b621-4f3737d5420e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:11:48 user nova-compute[85141]: DEBUG nova.compute.manager [req-33c25c0c-da18-440c-9848-728412bc5e6e req-39a422b6-1eac-4d42-bd5e-f607c2349f0d service nova] [instance: eef3cc09-054b-4a17-b621-4f3737d5420e] No waiting events found dispatching network-vif-plugged-b0183e60-7f49-44a1-a24c-30db287f2453 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:11:48 user nova-compute[85141]: WARNING nova.compute.manager [req-33c25c0c-da18-440c-9848-728412bc5e6e req-39a422b6-1eac-4d42-bd5e-f607c2349f0d service nova] [instance: eef3cc09-054b-4a17-b621-4f3737d5420e] Received unexpected event network-vif-plugged-b0183e60-7f49-44a1-a24c-30db287f2453 for instance with vm_state building and task_state spawning.
Nov 16 10:11:48 user nova-compute[85141]: DEBUG nova.compute.manager [req-33c25c0c-da18-440c-9848-728412bc5e6e req-39a422b6-1eac-4d42-bd5e-f607c2349f0d service nova] [instance: eef3cc09-054b-4a17-b621-4f3737d5420e] Received event network-vif-plugged-b0183e60-7f49-44a1-a24c-30db287f2453 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:11:48 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-33c25c0c-da18-440c-9848-728412bc5e6e req-39a422b6-1eac-4d42-bd5e-f607c2349f0d service nova] Acquiring lock "eef3cc09-054b-4a17-b621-4f3737d5420e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:11:48 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-33c25c0c-da18-440c-9848-728412bc5e6e req-39a422b6-1eac-4d42-bd5e-f607c2349f0d service nova] Lock "eef3cc09-054b-4a17-b621-4f3737d5420e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:11:48 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-33c25c0c-da18-440c-9848-728412bc5e6e req-39a422b6-1eac-4d42-bd5e-f607c2349f0d service nova] Lock "eef3cc09-054b-4a17-b621-4f3737d5420e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:11:48 user nova-compute[85141]: DEBUG nova.compute.manager [req-33c25c0c-da18-440c-9848-728412bc5e6e req-39a422b6-1eac-4d42-bd5e-f607c2349f0d service nova] [instance: eef3cc09-054b-4a17-b621-4f3737d5420e] No waiting events found dispatching network-vif-plugged-b0183e60-7f49-44a1-a24c-30db287f2453 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:11:48 user nova-compute[85141]: WARNING nova.compute.manager [req-33c25c0c-da18-440c-9848-728412bc5e6e req-39a422b6-1eac-4d42-bd5e-f607c2349f0d service nova] [instance: eef3cc09-054b-4a17-b621-4f3737d5420e] Received unexpected event network-vif-plugged-b0183e60-7f49-44a1-a24c-30db287f2453 for instance with vm_state building and task_state spawning.
Nov 16 10:11:48 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:11:48 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:11:48 user nova-compute[85141]: DEBUG nova.compute.manager [req-46acaa32-6713-42bc-bad4-8c046337d9fa req-66ec6af0-d054-4c23-af4a-226f26170ef6 service nova] [instance: eef3cc09-054b-4a17-b621-4f3737d5420e] Received event network-vif-plugged-21180772-80b3-48e1-90e9-39590611ff08 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:11:48 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-46acaa32-6713-42bc-bad4-8c046337d9fa req-66ec6af0-d054-4c23-af4a-226f26170ef6 service nova] Acquiring lock "eef3cc09-054b-4a17-b621-4f3737d5420e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:11:48 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-46acaa32-6713-42bc-bad4-8c046337d9fa req-66ec6af0-d054-4c23-af4a-226f26170ef6 service nova] Lock "eef3cc09-054b-4a17-b621-4f3737d5420e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:11:48 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-46acaa32-6713-42bc-bad4-8c046337d9fa req-66ec6af0-d054-4c23-af4a-226f26170ef6 service nova] Lock "eef3cc09-054b-4a17-b621-4f3737d5420e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:11:48 user nova-compute[85141]: DEBUG nova.compute.manager [req-46acaa32-6713-42bc-bad4-8c046337d9fa req-66ec6af0-d054-4c23-af4a-226f26170ef6 service nova] [instance: eef3cc09-054b-4a17-b621-4f3737d5420e] No waiting events found dispatching network-vif-plugged-21180772-80b3-48e1-90e9-39590611ff08 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:11:48 user nova-compute[85141]: WARNING nova.compute.manager [req-46acaa32-6713-42bc-bad4-8c046337d9fa req-66ec6af0-d054-4c23-af4a-226f26170ef6 service nova] [instance: eef3cc09-054b-4a17-b621-4f3737d5420e] Received unexpected event network-vif-plugged-21180772-80b3-48e1-90e9-39590611ff08 for instance with vm_state building and task_state spawning.
Nov 16 10:11:48 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:11:48 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:11:48 user nova-compute[85141]: DEBUG nova.compute.manager [req-f1301e1c-afb1-43fb-80ec-528b0889afc8 req-f927744a-27fd-4fd9-a985-cec4435f7535 service nova] [instance: eef3cc09-054b-4a17-b621-4f3737d5420e] Received event network-vif-plugged-0f7c87ad-4076-4aca-8d9b-1fae099dd325 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:11:48 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-f1301e1c-afb1-43fb-80ec-528b0889afc8 req-f927744a-27fd-4fd9-a985-cec4435f7535 service nova] Acquiring lock "eef3cc09-054b-4a17-b621-4f3737d5420e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:11:48 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-f1301e1c-afb1-43fb-80ec-528b0889afc8 req-f927744a-27fd-4fd9-a985-cec4435f7535 service nova] Lock "eef3cc09-054b-4a17-b621-4f3737d5420e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:11:48 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-f1301e1c-afb1-43fb-80ec-528b0889afc8 req-f927744a-27fd-4fd9-a985-cec4435f7535 service nova] Lock "eef3cc09-054b-4a17-b621-4f3737d5420e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:11:48 user nova-compute[85141]: DEBUG nova.compute.manager [req-f1301e1c-afb1-43fb-80ec-528b0889afc8 req-f927744a-27fd-4fd9-a985-cec4435f7535 service nova] [instance: eef3cc09-054b-4a17-b621-4f3737d5420e] No waiting events found dispatching network-vif-plugged-0f7c87ad-4076-4aca-8d9b-1fae099dd325 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:11:48 user nova-compute[85141]: WARNING nova.compute.manager [req-f1301e1c-afb1-43fb-80ec-528b0889afc8 req-f927744a-27fd-4fd9-a985-cec4435f7535 service nova] [instance: eef3cc09-054b-4a17-b621-4f3737d5420e] Received unexpected event network-vif-plugged-0f7c87ad-4076-4aca-8d9b-1fae099dd325 for instance with vm_state building and task_state spawning.
Nov 16 10:11:48 user nova-compute[85141]: DEBUG nova.compute.manager [req-f1301e1c-afb1-43fb-80ec-528b0889afc8 req-f927744a-27fd-4fd9-a985-cec4435f7535 service nova] [instance: eef3cc09-054b-4a17-b621-4f3737d5420e] Received event network-vif-plugged-d6b517e2-8788-4775-b327-11601713da4d {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:11:48 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-f1301e1c-afb1-43fb-80ec-528b0889afc8 req-f927744a-27fd-4fd9-a985-cec4435f7535 service nova] Acquiring lock "eef3cc09-054b-4a17-b621-4f3737d5420e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:11:48 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-f1301e1c-afb1-43fb-80ec-528b0889afc8 req-f927744a-27fd-4fd9-a985-cec4435f7535 service nova] Lock "eef3cc09-054b-4a17-b621-4f3737d5420e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:11:48 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-f1301e1c-afb1-43fb-80ec-528b0889afc8 req-f927744a-27fd-4fd9-a985-cec4435f7535 service nova] Lock "eef3cc09-054b-4a17-b621-4f3737d5420e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:11:48 user nova-compute[85141]: DEBUG nova.compute.manager [req-f1301e1c-afb1-43fb-80ec-528b0889afc8 req-f927744a-27fd-4fd9-a985-cec4435f7535 service nova] [instance: eef3cc09-054b-4a17-b621-4f3737d5420e] No waiting events found dispatching network-vif-plugged-d6b517e2-8788-4775-b327-11601713da4d {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:11:48 user nova-compute[85141]: WARNING nova.compute.manager [req-f1301e1c-afb1-43fb-80ec-528b0889afc8 req-f927744a-27fd-4fd9-a985-cec4435f7535 service nova] [instance: eef3cc09-054b-4a17-b621-4f3737d5420e] Received unexpected event network-vif-plugged-d6b517e2-8788-4775-b327-11601713da4d for instance with vm_state building and task_state spawning.
Nov 16 10:11:48 user nova-compute[85141]: DEBUG nova.compute.manager [req-f1301e1c-afb1-43fb-80ec-528b0889afc8 req-f927744a-27fd-4fd9-a985-cec4435f7535 service nova] [instance: eef3cc09-054b-4a17-b621-4f3737d5420e] Received event network-vif-plugged-d6b517e2-8788-4775-b327-11601713da4d {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:11:48 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-f1301e1c-afb1-43fb-80ec-528b0889afc8 req-f927744a-27fd-4fd9-a985-cec4435f7535 service nova] Acquiring lock "eef3cc09-054b-4a17-b621-4f3737d5420e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:11:48 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-f1301e1c-afb1-43fb-80ec-528b0889afc8 req-f927744a-27fd-4fd9-a985-cec4435f7535 service nova] Lock "eef3cc09-054b-4a17-b621-4f3737d5420e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:11:48 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-f1301e1c-afb1-43fb-80ec-528b0889afc8 req-f927744a-27fd-4fd9-a985-cec4435f7535 service nova] Lock "eef3cc09-054b-4a17-b621-4f3737d5420e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:11:48 user nova-compute[85141]: DEBUG nova.compute.manager [req-f1301e1c-afb1-43fb-80ec-528b0889afc8 req-f927744a-27fd-4fd9-a985-cec4435f7535 service nova] [instance: eef3cc09-054b-4a17-b621-4f3737d5420e] No waiting events found dispatching network-vif-plugged-d6b517e2-8788-4775-b327-11601713da4d {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:11:48 user nova-compute[85141]: WARNING nova.compute.manager [req-f1301e1c-afb1-43fb-80ec-528b0889afc8 req-f927744a-27fd-4fd9-a985-cec4435f7535 service nova] [instance: eef3cc09-054b-4a17-b621-4f3737d5420e] Received unexpected event network-vif-plugged-d6b517e2-8788-4775-b327-11601713da4d for instance with vm_state building and task_state spawning.
Nov 16 10:11:49 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:11:49 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:11:49 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:11:49 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:11:49 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:11:49 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:11:49 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:11:50 user nova-compute[85141]: DEBUG nova.compute.manager [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] [instance: eef3cc09-054b-4a17-b621-4f3737d5420e] Instance event wait completed in 0 seconds for  {{(pid=85141) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 10:11:50 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] [instance: eef3cc09-054b-4a17-b621-4f3737d5420e] Guest created on hypervisor {{(pid=85141) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 10:11:50 user nova-compute[85141]: INFO nova.virt.libvirt.driver [-] [instance: eef3cc09-054b-4a17-b621-4f3737d5420e] Instance spawned successfully.
Nov 16 10:11:50 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] [instance: eef3cc09-054b-4a17-b621-4f3737d5420e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 10:11:50 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] [instance: eef3cc09-054b-4a17-b621-4f3737d5420e] Found default for hw_cdrom_bus of ide {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:11:50 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] [instance: eef3cc09-054b-4a17-b621-4f3737d5420e] Found default for hw_disk_bus of virtio {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:11:50 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] [instance: eef3cc09-054b-4a17-b621-4f3737d5420e] Found default for hw_input_bus of None {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:11:50 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] [instance: eef3cc09-054b-4a17-b621-4f3737d5420e] Found default for hw_pointer_model of None {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:11:50 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] [instance: eef3cc09-054b-4a17-b621-4f3737d5420e] Found default for hw_video_model of virtio {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:11:50 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] [instance: eef3cc09-054b-4a17-b621-4f3737d5420e] Found default for hw_vif_model of virtio {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:11:50 user nova-compute[85141]: DEBUG nova.compute.manager [req-6acc2344-dac8-4309-9579-95fc8a97241d req-82f02d5b-cd9b-4fff-ba4a-4867e386a9c6 service nova] [instance: eef3cc09-054b-4a17-b621-4f3737d5420e] Received event network-vif-plugged-21180772-80b3-48e1-90e9-39590611ff08 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:11:50 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-6acc2344-dac8-4309-9579-95fc8a97241d req-82f02d5b-cd9b-4fff-ba4a-4867e386a9c6 service nova] Acquiring lock "eef3cc09-054b-4a17-b621-4f3737d5420e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:11:50 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-6acc2344-dac8-4309-9579-95fc8a97241d req-82f02d5b-cd9b-4fff-ba4a-4867e386a9c6 service nova] Lock "eef3cc09-054b-4a17-b621-4f3737d5420e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:11:50 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-6acc2344-dac8-4309-9579-95fc8a97241d req-82f02d5b-cd9b-4fff-ba4a-4867e386a9c6 service nova] Lock "eef3cc09-054b-4a17-b621-4f3737d5420e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:11:50 user nova-compute[85141]: DEBUG nova.compute.manager [req-6acc2344-dac8-4309-9579-95fc8a97241d req-82f02d5b-cd9b-4fff-ba4a-4867e386a9c6 service nova] [instance: eef3cc09-054b-4a17-b621-4f3737d5420e] No waiting events found dispatching network-vif-plugged-21180772-80b3-48e1-90e9-39590611ff08 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:11:50 user nova-compute[85141]: WARNING nova.compute.manager [req-6acc2344-dac8-4309-9579-95fc8a97241d req-82f02d5b-cd9b-4fff-ba4a-4867e386a9c6 service nova] [instance: eef3cc09-054b-4a17-b621-4f3737d5420e] Received unexpected event network-vif-plugged-21180772-80b3-48e1-90e9-39590611ff08 for instance with vm_state building and task_state spawning.
Nov 16 10:11:50 user nova-compute[85141]: INFO nova.compute.manager [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] [instance: eef3cc09-054b-4a17-b621-4f3737d5420e] Took 11.40 seconds to spawn the instance on the hypervisor.
Nov 16 10:11:50 user nova-compute[85141]: DEBUG nova.compute.manager [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] [instance: eef3cc09-054b-4a17-b621-4f3737d5420e] Checking state {{(pid=85141) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 10:11:50 user nova-compute[85141]: INFO nova.compute.manager [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] [instance: eef3cc09-054b-4a17-b621-4f3737d5420e] Took 30.08 seconds to build instance.
Nov 16 10:11:50 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-946853ff-e53c-4d7e-957e-317d4c211cb7 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] Lock "eef3cc09-054b-4a17-b621-4f3737d5420e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 30.197s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:11:52 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:11:54 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:11:59 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:12:04 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:12:04 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:12:04 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=85141) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 10:12:04 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=85141) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 10:12:04 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=85141) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 10:12:04 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:12:09 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:12:12 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:12:14 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:12:16 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:12:17 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:12:17 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:12:17 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:12:17 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-0cdffa12-0df1-4d5b-8296-8df3b17aa6ec tempest-DeleteServersTestJSON-1770650847 tempest-DeleteServersTestJSON-1770650847-project-member] Acquiring lock "a4cdcb5b-b2a6-4736-85c8-7e6cdab8c9b1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:12:17 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-0cdffa12-0df1-4d5b-8296-8df3b17aa6ec tempest-DeleteServersTestJSON-1770650847 tempest-DeleteServersTestJSON-1770650847-project-member] Lock "a4cdcb5b-b2a6-4736-85c8-7e6cdab8c9b1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:12:17 user nova-compute[85141]: DEBUG nova.objects.instance [None req-0cdffa12-0df1-4d5b-8296-8df3b17aa6ec tempest-DeleteServersTestJSON-1770650847 tempest-DeleteServersTestJSON-1770650847-project-member] Lazy-loading 'flavor' on Instance uuid a4cdcb5b-b2a6-4736-85c8-7e6cdab8c9b1 {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:12:17 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-0cdffa12-0df1-4d5b-8296-8df3b17aa6ec tempest-DeleteServersTestJSON-1770650847 tempest-DeleteServersTestJSON-1770650847-project-member] Lock "a4cdcb5b-b2a6-4736-85c8-7e6cdab8c9b1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.116s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:12:17 user nova-compute[85141]: DEBUG nova.compute.manager [req-c88965a5-6e59-47d7-bfdb-447c0f331ebb req-7536930e-3cf3-4228-a7f3-20dff006b06a service nova] [instance: 9411843f-4e79-46c4-ae02-01f5e87b86eb] Received event network-changed-1202aa6f-6442-4e95-bf51-66f977a23e01 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:12:17 user nova-compute[85141]: DEBUG nova.compute.manager [req-c88965a5-6e59-47d7-bfdb-447c0f331ebb req-7536930e-3cf3-4228-a7f3-20dff006b06a service nova] [instance: 9411843f-4e79-46c4-ae02-01f5e87b86eb] Refreshing instance network info cache due to event network-changed-1202aa6f-6442-4e95-bf51-66f977a23e01. {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 10:12:17 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-c88965a5-6e59-47d7-bfdb-447c0f331ebb req-7536930e-3cf3-4228-a7f3-20dff006b06a service nova] Acquiring lock "refresh_cache-9411843f-4e79-46c4-ae02-01f5e87b86eb" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:12:17 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-c88965a5-6e59-47d7-bfdb-447c0f331ebb req-7536930e-3cf3-4228-a7f3-20dff006b06a service nova] Acquired lock "refresh_cache-9411843f-4e79-46c4-ae02-01f5e87b86eb" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:12:17 user nova-compute[85141]: DEBUG nova.network.neutron [req-c88965a5-6e59-47d7-bfdb-447c0f331ebb req-7536930e-3cf3-4228-a7f3-20dff006b06a service nova] [instance: 9411843f-4e79-46c4-ae02-01f5e87b86eb] Refreshing network info cache for port 1202aa6f-6442-4e95-bf51-66f977a23e01 {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 10:12:17 user nova-compute[85141]: DEBUG nova.compute.manager [None req-0018e71f-38ad-496f-93a7-cab7a6c5d2d8 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] [instance: d842f90e-663b-4c95-9d7c-d092d2bac41f] Checking state {{(pid=85141) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 10:12:17 user nova-compute[85141]: INFO nova.compute.manager [None req-0018e71f-38ad-496f-93a7-cab7a6c5d2d8 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] [instance: d842f90e-663b-4c95-9d7c-d092d2bac41f] instance snapshotting
Nov 16 10:12:17 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-0cdffa12-0df1-4d5b-8296-8df3b17aa6ec tempest-DeleteServersTestJSON-1770650847 tempest-DeleteServersTestJSON-1770650847-project-member] Acquiring lock "a4cdcb5b-b2a6-4736-85c8-7e6cdab8c9b1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:12:17 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-0cdffa12-0df1-4d5b-8296-8df3b17aa6ec tempest-DeleteServersTestJSON-1770650847 tempest-DeleteServersTestJSON-1770650847-project-member] Lock "a4cdcb5b-b2a6-4736-85c8-7e6cdab8c9b1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:12:17 user nova-compute[85141]: INFO nova.compute.manager [None req-0cdffa12-0df1-4d5b-8296-8df3b17aa6ec tempest-DeleteServersTestJSON-1770650847 tempest-DeleteServersTestJSON-1770650847-project-member] [instance: a4cdcb5b-b2a6-4736-85c8-7e6cdab8c9b1] Attaching volume 3011a7d3-0de6-4e2a-bb2b-6bf22d57c764 to /dev/vdb
Nov 16 10:12:17 user nova-compute[85141]: DEBUG os_brick.utils [None req-0cdffa12-0df1-4d5b-8296-8df3b17aa6ec tempest-DeleteServersTestJSON-1770650847 tempest-DeleteServersTestJSON-1770650847-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 10:12:17 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:12:17 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-0018e71f-38ad-496f-93a7-cab7a6c5d2d8 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] [instance: d842f90e-663b-4c95-9d7c-d092d2bac41f] Beginning live snapshot process
Nov 16 10:12:17 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:12:17 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3fdfab6-e252-4e48-9782-4f36ceace34d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c7834de5c295\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:12:17 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:12:17 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:12:17 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[8076f80a-f290-4479-a9ed-52504f830f26]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:12:17 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:12:17 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:12:17 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[1946ff9f-31ea-4148-b14f-529dc50f6486]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:12:17 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3a5b8b5-7674-4374-841d-f0eabb2611cf]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:12:17 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-0cdffa12-0df1-4d5b-8296-8df3b17aa6ec tempest-DeleteServersTestJSON-1770650847 tempest-DeleteServersTestJSON-1770650847-project-member] Running cmd (subprocess): nvme version {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:12:17 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-0cdffa12-0df1-4d5b-8296-8df3b17aa6ec tempest-DeleteServersTestJSON-1770650847 tempest-DeleteServersTestJSON-1770650847-project-member] 'nvme version' failed. Not Retrying. {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 10:12:17 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0cdffa12-0df1-4d5b-8296-8df3b17aa6ec tempest-DeleteServersTestJSON-1770650847 tempest-DeleteServersTestJSON-1770650847-project-member] nvme not present on system {{(pid=85141) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 10:12:17 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:12:17 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 10:12:17 user nova-compute[85141]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 10:12:17 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[92a60e40-7730-4d94-8619-bd0a8e92144e]: (4, '') {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:12:17 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.lightos [None req-0cdffa12-0df1-4d5b-8296-8df3b17aa6ec tempest-DeleteServersTestJSON-1770650847 tempest-DeleteServersTestJSON-1770650847-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=85141) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 10:12:17 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.lightos [None req-0cdffa12-0df1-4d5b-8296-8df3b17aa6ec tempest-DeleteServersTestJSON-1770650847 tempest-DeleteServersTestJSON-1770650847-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=85141) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 10:12:17 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.lightos [None req-0cdffa12-0df1-4d5b-8296-8df3b17aa6ec tempest-DeleteServersTestJSON-1770650847 tempest-DeleteServersTestJSON-1770650847-project-member] LIGHTOS: no hostnqn found. {{(pid=85141) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 10:12:17 user nova-compute[85141]: DEBUG os_brick.utils [None req-0cdffa12-0df1-4d5b-8296-8df3b17aa6ec tempest-DeleteServersTestJSON-1770650847 tempest-DeleteServersTestJSON-1770650847-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c7834de5c295', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 10:12:17 user nova-compute[85141]: DEBUG nova.virt.block_device [None req-0cdffa12-0df1-4d5b-8296-8df3b17aa6ec tempest-DeleteServersTestJSON-1770650847 tempest-DeleteServersTestJSON-1770650847-project-member] [instance: a4cdcb5b-b2a6-4736-85c8-7e6cdab8c9b1] Updating existing volume attachment record: 4f027579-860e-4760-9073-f7bc8b7e3b62 {{(pid=85141) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 10:12:17 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-0018e71f-38ad-496f-93a7-cab7a6c5d2d8 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d842f90e-663b-4c95-9d7c-d092d2bac41f/disk --force-share --output=json -f qcow2 {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:12:18 user nova-compute[85141]: DEBUG nova.network.neutron [req-c88965a5-6e59-47d7-bfdb-447c0f331ebb req-7536930e-3cf3-4228-a7f3-20dff006b06a service nova] [instance: 9411843f-4e79-46c4-ae02-01f5e87b86eb] Updated VIF entry in instance network info cache for port 1202aa6f-6442-4e95-bf51-66f977a23e01. {{(pid=85141) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 10:12:18 user nova-compute[85141]: DEBUG nova.network.neutron [req-c88965a5-6e59-47d7-bfdb-447c0f331ebb req-7536930e-3cf3-4228-a7f3-20dff006b06a service nova] [instance: 9411843f-4e79-46c4-ae02-01f5e87b86eb] Updating instance_info_cache with network_info: [{"id": "1202aa6f-6442-4e95-bf51-66f977a23e01", "address": "fa:16:3e:d8:53:c3", "network": {"id": "4fb7c85e-c966-481d-b6f2-856a17ac8f7c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-81570496-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08ef12fb41a14ecd8abb84d4d69b7c27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1202aa6f-64", "ovs_interfaceid": "1202aa6f-6442-4e95-bf51-66f977a23e01", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:12:18 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-c88965a5-6e59-47d7-bfdb-447c0f331ebb req-7536930e-3cf3-4228-a7f3-20dff006b06a service nova] Releasing lock "refresh_cache-9411843f-4e79-46c4-ae02-01f5e87b86eb" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:12:18 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-0018e71f-38ad-496f-93a7-cab7a6c5d2d8 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d842f90e-663b-4c95-9d7c-d092d2bac41f/disk --force-share --output=json -f qcow2" returned: 0 in 0.231s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:12:18 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-0018e71f-38ad-496f-93a7-cab7a6c5d2d8 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d842f90e-663b-4c95-9d7c-d092d2bac41f/disk --force-share --output=json -f qcow2 {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:12:18 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:12:18 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Starting heal instance info cache {{(pid=85141) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 10:12:18 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-0018e71f-38ad-496f-93a7-cab7a6c5d2d8 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d842f90e-663b-4c95-9d7c-d092d2bac41f/disk --force-share --output=json -f qcow2" returned: 0 in 0.180s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:12:18 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-0018e71f-38ad-496f-93a7-cab7a6c5d2d8 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:12:18 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Acquiring lock "refresh_cache-9411843f-4e79-46c4-ae02-01f5e87b86eb" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:12:18 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Acquired lock "refresh_cache-9411843f-4e79-46c4-ae02-01f5e87b86eb" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:12:18 user nova-compute[85141]: DEBUG nova.network.neutron [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] [instance: 9411843f-4e79-46c4-ae02-01f5e87b86eb] Forcefully refreshing network info cache for instance {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 10:12:18 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-0018e71f-38ad-496f-93a7-cab7a6c5d2d8 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json" returned: 0 in 0.183s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:12:18 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-0018e71f-38ad-496f-93a7-cab7a6c5d2d8 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp47o_b8nc/90f1221df47b487bb808a8220b25ac55.delta 1073741824 {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:12:18 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-0018e71f-38ad-496f-93a7-cab7a6c5d2d8 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp47o_b8nc/90f1221df47b487bb808a8220b25ac55.delta 1073741824" returned: 0 in 0.052s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:12:18 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-0018e71f-38ad-496f-93a7-cab7a6c5d2d8 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] [instance: d842f90e-663b-4c95-9d7c-d092d2bac41f] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 16 10:12:18 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-0018e71f-38ad-496f-93a7-cab7a6c5d2d8 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Checking UEFI support for host arch (x86_64) {{(pid=85141) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1751}}
Nov 16 10:12:18 user nova-compute[85141]: INFO nova.virt.libvirt.host [None req-0018e71f-38ad-496f-93a7-cab7a6c5d2d8 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] UEFI support detected
Nov 16 10:12:18 user nova-compute[85141]: DEBUG nova.network.neutron [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] [instance: 9411843f-4e79-46c4-ae02-01f5e87b86eb] Updating instance_info_cache with network_info: [{"id": "1202aa6f-6442-4e95-bf51-66f977a23e01", "address": "fa:16:3e:d8:53:c3", "network": {"id": "4fb7c85e-c966-481d-b6f2-856a17ac8f7c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-81570496-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08ef12fb41a14ecd8abb84d4d69b7c27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1202aa6f-64", "ovs_interfaceid": "1202aa6f-6442-4e95-bf51-66f977a23e01", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:12:18 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Releasing lock "refresh_cache-9411843f-4e79-46c4-ae02-01f5e87b86eb" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:12:18 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] [instance: 9411843f-4e79-46c4-ae02-01f5e87b86eb] Updated the network info_cache for instance {{(pid=85141) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 10:12:18 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:12:18 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=85141) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 10:12:19 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:12:19 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:12:19 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:12:19 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager.update_available_resource {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:12:19 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:12:19 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:12:19 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:12:19 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Auditing locally available compute resources for user (node: user) {{(pid=85141) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 10:12:19 user nova-compute[85141]: DEBUG nova.virt.libvirt.guest [None req-0018e71f-38ad-496f-93a7-cab7a6c5d2d8 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=85141) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 10:12:19 user nova-compute[85141]: DEBUG nova.compute.manager [req-30c18617-35d3-4f39-9a94-ad8e46e64ab1 req-83c2bf10-605a-4060-875f-148cdd6bb58f service nova] [instance: e65ccf79-718d-4eeb-8914-f0db2e2c9ce2] Received event network-changed-9b681ac7-3246-4ff4-8691-f8e4f1d62061 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:12:19 user nova-compute[85141]: DEBUG nova.compute.manager [req-30c18617-35d3-4f39-9a94-ad8e46e64ab1 req-83c2bf10-605a-4060-875f-148cdd6bb58f service nova] [instance: e65ccf79-718d-4eeb-8914-f0db2e2c9ce2] Refreshing instance network info cache due to event network-changed-9b681ac7-3246-4ff4-8691-f8e4f1d62061. {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 10:12:19 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-30c18617-35d3-4f39-9a94-ad8e46e64ab1 req-83c2bf10-605a-4060-875f-148cdd6bb58f service nova] Acquiring lock "refresh_cache-e65ccf79-718d-4eeb-8914-f0db2e2c9ce2" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:12:19 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-30c18617-35d3-4f39-9a94-ad8e46e64ab1 req-83c2bf10-605a-4060-875f-148cdd6bb58f service nova] Acquired lock "refresh_cache-e65ccf79-718d-4eeb-8914-f0db2e2c9ce2" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:12:19 user nova-compute[85141]: DEBUG nova.network.neutron [req-30c18617-35d3-4f39-9a94-ad8e46e64ab1 req-83c2bf10-605a-4060-875f-148cdd6bb58f service nova] [instance: e65ccf79-718d-4eeb-8914-f0db2e2c9ce2] Refreshing network info cache for port 9b681ac7-3246-4ff4-8691-f8e4f1d62061 {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 10:12:19 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e65ccf79-718d-4eeb-8914-f0db2e2c9ce2/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:12:20 user nova-compute[85141]: DEBUG nova.virt.libvirt.guest [None req-0018e71f-38ad-496f-93a7-cab7a6c5d2d8 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] COPY block job progress, current cursor: 16711680 final cursor: 75497472 {{(pid=85141) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 10:12:20 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e65ccf79-718d-4eeb-8914-f0db2e2c9ce2/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:12:20 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e65ccf79-718d-4eeb-8914-f0db2e2c9ce2/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:12:20 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e65ccf79-718d-4eeb-8914-f0db2e2c9ce2/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:12:20 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/361a2044-8fd0-4975-8a19-814bf7a6da41/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:12:20 user nova-compute[85141]: DEBUG nova.network.neutron [req-30c18617-35d3-4f39-9a94-ad8e46e64ab1 req-83c2bf10-605a-4060-875f-148cdd6bb58f service nova] [instance: e65ccf79-718d-4eeb-8914-f0db2e2c9ce2] Updated VIF entry in instance network info cache for port 9b681ac7-3246-4ff4-8691-f8e4f1d62061. {{(pid=85141) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 10:12:20 user nova-compute[85141]: DEBUG nova.network.neutron [req-30c18617-35d3-4f39-9a94-ad8e46e64ab1 req-83c2bf10-605a-4060-875f-148cdd6bb58f service nova] [instance: e65ccf79-718d-4eeb-8914-f0db2e2c9ce2] Updating instance_info_cache with network_info: [{"id": "9b681ac7-3246-4ff4-8691-f8e4f1d62061", "address": "fa:16:3e:ce:f3:cd", "network": {"id": "ac11f3ed-4c14-4051-aff5-44d400d6368c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-679726958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7044a386486d4426bcccfe0b7d225c80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b681ac7-32", "ovs_interfaceid": "9b681ac7-3246-4ff4-8691-f8e4f1d62061", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:12:20 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-30c18617-35d3-4f39-9a94-ad8e46e64ab1 req-83c2bf10-605a-4060-875f-148cdd6bb58f service nova] Releasing lock "refresh_cache-e65ccf79-718d-4eeb-8914-f0db2e2c9ce2" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:12:20 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/361a2044-8fd0-4975-8a19-814bf7a6da41/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:12:20 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/361a2044-8fd0-4975-8a19-814bf7a6da41/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:12:20 user nova-compute[85141]: DEBUG nova.virt.libvirt.guest [None req-0018e71f-38ad-496f-93a7-cab7a6c5d2d8 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=85141) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 10:12:20 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-0018e71f-38ad-496f-93a7-cab7a6c5d2d8 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] [instance: d842f90e-663b-4c95-9d7c-d092d2bac41f] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 16 10:12:20 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/361a2044-8fd0-4975-8a19-814bf7a6da41/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:12:20 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ca61bd2-268e-4c49-ba04-a5cb39143a9b/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:12:20 user nova-compute[85141]: DEBUG nova.privsep.utils [None req-0018e71f-38ad-496f-93a7-cab7a6c5d2d8 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=85141) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 16 10:12:20 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-0018e71f-38ad-496f-93a7-cab7a6c5d2d8 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp47o_b8nc/90f1221df47b487bb808a8220b25ac55.delta /opt/stack/data/nova/instances/snapshots/tmp47o_b8nc/90f1221df47b487bb808a8220b25ac55 {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:12:20 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ca61bd2-268e-4c49-ba04-a5cb39143a9b/disk --force-share --output=json" returned: 0 in 0.295s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:12:21 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ca61bd2-268e-4c49-ba04-a5cb39143a9b/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:12:21 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ca61bd2-268e-4c49-ba04-a5cb39143a9b/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:12:21 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d842f90e-663b-4c95-9d7c-d092d2bac41f/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:12:21 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d842f90e-663b-4c95-9d7c-d092d2bac41f/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:12:21 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d842f90e-663b-4c95-9d7c-d092d2bac41f/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:12:21 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-0018e71f-38ad-496f-93a7-cab7a6c5d2d8 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp47o_b8nc/90f1221df47b487bb808a8220b25ac55.delta /opt/stack/data/nova/instances/snapshots/tmp47o_b8nc/90f1221df47b487bb808a8220b25ac55" returned: 0 in 0.813s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:12:21 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-0018e71f-38ad-496f-93a7-cab7a6c5d2d8 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] [instance: d842f90e-663b-4c95-9d7c-d092d2bac41f] Snapshot extracted, beginning image upload
Nov 16 10:12:21 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-b2032e4d-de25-4c8f-9e5c-c274f46fd08a tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Acquiring lock "9411843f-4e79-46c4-ae02-01f5e87b86eb" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:12:21 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-b2032e4d-de25-4c8f-9e5c-c274f46fd08a tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Lock "9411843f-4e79-46c4-ae02-01f5e87b86eb" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.002s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:12:21 user nova-compute[85141]: INFO nova.compute.manager [None req-b2032e4d-de25-4c8f-9e5c-c274f46fd08a tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] [instance: 9411843f-4e79-46c4-ae02-01f5e87b86eb] Shelving
Nov 16 10:12:21 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d842f90e-663b-4c95-9d7c-d092d2bac41f/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:12:21 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9411843f-4e79-46c4-ae02-01f5e87b86eb/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:12:21 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:12:21 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9411843f-4e79-46c4-ae02-01f5e87b86eb/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:12:21 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9411843f-4e79-46c4-ae02-01f5e87b86eb/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:12:21 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:12:21 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:12:21 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:12:21 user nova-compute[85141]: DEBUG nova.compute.manager [req-5aad90dc-7df5-4bb4-b55b-4fbb03ebb520 req-82fd7345-a16a-44cf-bbde-8a1cd3b33027 service nova] [instance: 9411843f-4e79-46c4-ae02-01f5e87b86eb] Received event network-vif-unplugged-1202aa6f-6442-4e95-bf51-66f977a23e01 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:12:21 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-5aad90dc-7df5-4bb4-b55b-4fbb03ebb520 req-82fd7345-a16a-44cf-bbde-8a1cd3b33027 service nova] Acquiring lock "9411843f-4e79-46c4-ae02-01f5e87b86eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:12:21 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-5aad90dc-7df5-4bb4-b55b-4fbb03ebb520 req-82fd7345-a16a-44cf-bbde-8a1cd3b33027 service nova] Lock "9411843f-4e79-46c4-ae02-01f5e87b86eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:12:21 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-5aad90dc-7df5-4bb4-b55b-4fbb03ebb520 req-82fd7345-a16a-44cf-bbde-8a1cd3b33027 service nova] Lock "9411843f-4e79-46c4-ae02-01f5e87b86eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:12:21 user nova-compute[85141]: DEBUG nova.compute.manager [req-5aad90dc-7df5-4bb4-b55b-4fbb03ebb520 req-82fd7345-a16a-44cf-bbde-8a1cd3b33027 service nova] [instance: 9411843f-4e79-46c4-ae02-01f5e87b86eb] No waiting events found dispatching network-vif-unplugged-1202aa6f-6442-4e95-bf51-66f977a23e01 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:12:21 user nova-compute[85141]: WARNING nova.compute.manager [req-5aad90dc-7df5-4bb4-b55b-4fbb03ebb520 req-82fd7345-a16a-44cf-bbde-8a1cd3b33027 service nova] [instance: 9411843f-4e79-46c4-ae02-01f5e87b86eb] Received unexpected event network-vif-unplugged-1202aa6f-6442-4e95-bf51-66f977a23e01 for instance with vm_state active and task_state shelving.
Nov 16 10:12:21 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9411843f-4e79-46c4-ae02-01f5e87b86eb/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:12:21 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff964caf-b473-47bc-89d2-f7189264721c/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:12:22 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:12:22 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:12:22 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff964caf-b473-47bc-89d2-f7189264721c/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:12:22 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff964caf-b473-47bc-89d2-f7189264721c/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:12:22 user nova-compute[85141]: INFO nova.virt.libvirt.driver [-] [instance: 9411843f-4e79-46c4-ae02-01f5e87b86eb] Instance destroyed successfully.
Nov 16 10:12:22 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-b2032e4d-de25-4c8f-9e5c-c274f46fd08a tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] [instance: 9411843f-4e79-46c4-ae02-01f5e87b86eb] Beginning cold snapshot process
Nov 16 10:12:22 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff964caf-b473-47bc-89d2-f7189264721c/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:12:22 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad1ace46-2e8e-42e1-a0f5-2384078fcf09/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:12:22 user nova-compute[85141]: DEBUG nova.privsep.utils [None req-b2032e4d-de25-4c8f-9e5c-c274f46fd08a tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=85141) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 16 10:12:22 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-b2032e4d-de25-4c8f-9e5c-c274f46fd08a tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/9411843f-4e79-46c4-ae02-01f5e87b86eb/disk /opt/stack/data/nova/instances/snapshots/tmp17j4sciz/a570eb1da54f4c89a33de64a2ffd1d96 {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:12:22 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad1ace46-2e8e-42e1-a0f5-2384078fcf09/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:12:22 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad1ace46-2e8e-42e1-a0f5-2384078fcf09/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:12:22 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad1ace46-2e8e-42e1-a0f5-2384078fcf09/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:12:22 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4cdcb5b-b2a6-4736-85c8-7e6cdab8c9b1/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:12:22 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4cdcb5b-b2a6-4736-85c8-7e6cdab8c9b1/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:12:22 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4cdcb5b-b2a6-4736-85c8-7e6cdab8c9b1/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:12:23 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-b2032e4d-de25-4c8f-9e5c-c274f46fd08a tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/9411843f-4e79-46c4-ae02-01f5e87b86eb/disk /opt/stack/data/nova/instances/snapshots/tmp17j4sciz/a570eb1da54f4c89a33de64a2ffd1d96" returned: 0 in 0.512s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:12:23 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-b2032e4d-de25-4c8f-9e5c-c274f46fd08a tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] [instance: 9411843f-4e79-46c4-ae02-01f5e87b86eb] Snapshot extracted, beginning image upload
Nov 16 10:12:23 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4cdcb5b-b2a6-4736-85c8-7e6cdab8c9b1/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:12:23 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=85141) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 10:12:23 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e2ae11f-161c-4d13-a1a5-37d0a8150e6b/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:12:23 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0cdffa12-0df1-4d5b-8296-8df3b17aa6ec tempest-DeleteServersTestJSON-1770650847 tempest-DeleteServersTestJSON-1770650847-project-member] [instance: a4cdcb5b-b2a6-4736-85c8-7e6cdab8c9b1] Calling os-brick to attach iSCSI Volume {{(pid=85141) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 10:12:23 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cdffa12-0df1-4d5b-8296-8df3b17aa6ec tempest-DeleteServersTestJSON-1770650847 tempest-DeleteServersTestJSON-1770650847-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51806b6080>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3011a7d3-0de6-4e2a-bb2b-6bf22d57c764', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KBlahyVU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 10:12:23 user nova-compute[85141]: WARNING os_brick.initiator.connectors.base [None req-0cdffa12-0df1-4d5b-8296-8df3b17aa6ec tempest-DeleteServersTestJSON-1770650847 tempest-DeleteServersTestJSON-1770650847-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 10:12:23 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-0cdffa12-0df1-4d5b-8296-8df3b17aa6ec tempest-DeleteServersTestJSON-1770650847 tempest-DeleteServersTestJSON-1770650847-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 10:12:23 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-0cdffa12-0df1-4d5b-8296-8df3b17aa6ec tempest-DeleteServersTestJSON-1770650847 tempest-DeleteServersTestJSON-1770650847-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 10:12:23 user nova-compute[85141]: WARNING os_brick.initiator.connectors.base [None req-0cdffa12-0df1-4d5b-8296-8df3b17aa6ec tempest-DeleteServersTestJSON-1770650847 tempest-DeleteServersTestJSON-1770650847-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 10:12:23 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-0cdffa12-0df1-4d5b-8296-8df3b17aa6ec tempest-DeleteServersTestJSON-1770650847 tempest-DeleteServersTestJSON-1770650847-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3011a7d3-0de6-4e2a-bb2b-6bf22d57c764" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 10:12:23 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-0cdffa12-0df1-4d5b-8296-8df3b17aa6ec tempest-DeleteServersTestJSON-1770650847 tempest-DeleteServersTestJSON-1770650847-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3011a7d3-0de6-4e2a-bb2b-6bf22d57c764" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 10:12:23 user nova-compute[85141]: INFO os_brick.initiator.connectors.iscsi [None req-0cdffa12-0df1-4d5b-8296-8df3b17aa6ec tempest-DeleteServersTestJSON-1770650847 tempest-DeleteServersTestJSON-1770650847-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 10:12:23 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3011a7d3-0de6-4e2a-bb2b-6bf22d57c764 -p 172.16.0.220:3260 {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:12:23 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3011a7d3-0de6-4e2a-bb2b-6bf22d57c764 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:12:23 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ebad31a-a3c2-4b10-b55c-15027c5d7341]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:12:23 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cdffa12-0df1-4d5b-8296-8df3b17aa6ec tempest-DeleteServersTestJSON-1770650847 tempest-DeleteServersTestJSON-1770650847-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 10:12:23 user nova-compute[85141]:  {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:12:23 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3011a7d3-0de6-4e2a-bb2b-6bf22d57c764 -p 172.16.0.220:3260 --interface default --op new {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:12:23 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3011a7d3-0de6-4e2a-bb2b-6bf22d57c764 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:12:23 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f44f273-c413-4ec9-b70f-cd86072eac2b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3011a7d3-0de6-4e2a-bb2b-6bf22d57c764] added\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:12:23 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cdffa12-0df1-4d5b-8296-8df3b17aa6ec tempest-DeleteServersTestJSON-1770650847 tempest-DeleteServersTestJSON-1770650847-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3011a7d3-0de6-4e2a-bb2b-6bf22d57c764] added
Nov 16 10:12:23 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:12:23 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3011a7d3-0de6-4e2a-bb2b-6bf22d57c764 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:12:23 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3011a7d3-0de6-4e2a-bb2b-6bf22d57c764 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:12:23 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea459f2c-d395-4517-99cd-f44107934e8c]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:12:23 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cdffa12-0df1-4d5b-8296-8df3b17aa6ec tempest-DeleteServersTestJSON-1770650847 tempest-DeleteServersTestJSON-1770650847-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:12:23 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3011a7d3-0de6-4e2a-bb2b-6bf22d57c764 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:12:23 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e2ae11f-161c-4d13-a1a5-37d0a8150e6b/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:12:23 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e2ae11f-161c-4d13-a1a5-37d0a8150e6b/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:12:23 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3011a7d3-0de6-4e2a-bb2b-6bf22d57c764 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:12:23 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[8122ce99-2adc-4578-bf20-8402046d34d6]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:12:23 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cdffa12-0df1-4d5b-8296-8df3b17aa6ec tempest-DeleteServersTestJSON-1770650847 tempest-DeleteServersTestJSON-1770650847-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:12:23 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3011a7d3-0de6-4e2a-bb2b-6bf22d57c764 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KBlahyVU {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:12:23 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3011a7d3-0de6-4e2a-bb2b-6bf22d57c764 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KBlahyVU" returned: 0 in 0.017s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:12:23 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ec4d9ac-656e-4c20-81c2-7054c407c76e]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:12:23 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cdffa12-0df1-4d5b-8296-8df3b17aa6ec tempest-DeleteServersTestJSON-1770650847 tempest-DeleteServersTestJSON-1770650847-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KBlahyVU'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:12:23 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3011a7d3-0de6-4e2a-bb2b-6bf22d57c764 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:12:23 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3011a7d3-0de6-4e2a-bb2b-6bf22d57c764 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:12:23 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[a51af500-4e4b-4668-995c-88bedc74413b]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:12:23 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cdffa12-0df1-4d5b-8296-8df3b17aa6ec tempest-DeleteServersTestJSON-1770650847 tempest-DeleteServersTestJSON-1770650847-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:12:23 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:12:23 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:12:23 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0e37ce8-69fd-40af-b286-2013048a86ef]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42c041ec-fa39-4035-b82b-867caf3565df (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4df10d9-a60c-45ed-981d-96f704534fb8 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4973f768-f126-41d6-b534-458d6c49f9b3 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fcde20-e019-4cf0-ad90-6c8100f4a8d2 (non-flash)\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:12:23 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cdffa12-0df1-4d5b-8296-8df3b17aa6ec tempest-DeleteServersTestJSON-1770650847 tempest-DeleteServersTestJSON-1770650847-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42c041ec-fa39-4035-b82b-867caf3565df (non-flash)
Nov 16 10:12:23 user nova-compute[85141]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4df10d9-a60c-45ed-981d-96f704534fb8 (non-flash)
Nov 16 10:12:23 user nova-compute[85141]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4973f768-f126-41d6-b534-458d6c49f9b3 (non-flash)
Nov 16 10:12:23 user nova-compute[85141]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fcde20-e019-4cf0-ad90-6c8100f4a8d2 (non-flash)
Nov 16 10:12:23 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:12:23 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cdffa12-0df1-4d5b-8296-8df3b17aa6ec tempest-DeleteServersTestJSON-1770650847 tempest-DeleteServersTestJSON-1770650847-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42c041ec-fa39-4035-b82b-867caf3565df (non-flash)
Nov 16 10:12:23 user nova-compute[85141]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4df10d9-a60c-45ed-981d-96f704534fb8 (non-flash)
Nov 16 10:12:23 user nova-compute[85141]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4973f768-f126-41d6-b534-458d6c49f9b3 (non-flash)
Nov 16 10:12:23 user nova-compute[85141]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fcde20-e019-4cf0-ad90-6c8100f4a8d2 (non-flash)
Nov 16 10:12:23 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 10:12:23 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3011a7d3-0de6-4e2a-bb2b-6bf22d57c764 -p 172.16.0.220:3260 --login {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:12:23 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3011a7d3-0de6-4e2a-bb2b-6bf22d57c764 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:12:23 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9f94527-d3bb-4201-8819-ae75635641b1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3011a7d3-0de6-4e2a-bb2b-6bf22d57c764, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3011a7d3-0de6-4e2a-bb2b-6bf22d57c764, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:12:23 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cdffa12-0df1-4d5b-8296-8df3b17aa6ec tempest-DeleteServersTestJSON-1770650847 tempest-DeleteServersTestJSON-1770650847-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3011a7d3-0de6-4e2a-bb2b-6bf22d57c764, portal: 172.16.0.220,3260]
Nov 16 10:12:23 user nova-compute[85141]: Login to [iface: default, target: iqn.2010-10.org.openstack:3011a7d3-0de6-4e2a-bb2b-6bf22d57c764, portal: 172.16.0.220,3260] successful.
Nov 16 10:12:23 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:12:23 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3011a7d3-0de6-4e2a-bb2b-6bf22d57c764 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:12:23 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e2ae11f-161c-4d13-a1a5-37d0a8150e6b/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:12:23 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3011a7d3-0de6-4e2a-bb2b-6bf22d57c764 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:12:23 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[440a3082-5fd2-4e22-973a-e93f19589a1b]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:12:23 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cdffa12-0df1-4d5b-8296-8df3b17aa6ec tempest-DeleteServersTestJSON-1770650847 tempest-DeleteServersTestJSON-1770650847-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:12:23 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:12:23 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=85141) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 10:12:23 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=85141) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 10:12:23 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=85141) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 10:12:23 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f872e56-0fdc-4d3c-ab3d-64497d036dc8/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:12:23 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:12:23 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[b49e095e-fc73-47d0-a4f4-aacfaa61cfaf]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42c041ec-fa39-4035-b82b-867caf3565df (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4df10d9-a60c-45ed-981d-96f704534fb8 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4973f768-f126-41d6-b534-458d6c49f9b3 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fcde20-e019-4cf0-ad90-6c8100f4a8d2 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3011a7d3-0de6-4e2a-bb2b-6bf22d57c764 (non-flash)\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:12:23 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cdffa12-0df1-4d5b-8296-8df3b17aa6ec tempest-DeleteServersTestJSON-1770650847 tempest-DeleteServersTestJSON-1770650847-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42c041ec-fa39-4035-b82b-867caf3565df (non-flash)
Nov 16 10:12:23 user nova-compute[85141]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4df10d9-a60c-45ed-981d-96f704534fb8 (non-flash)
Nov 16 10:12:23 user nova-compute[85141]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4973f768-f126-41d6-b534-458d6c49f9b3 (non-flash)
Nov 16 10:12:23 user nova-compute[85141]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fcde20-e019-4cf0-ad90-6c8100f4a8d2 (non-flash)
Nov 16 10:12:23 user nova-compute[85141]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3011a7d3-0de6-4e2a-bb2b-6bf22d57c764 (non-flash)
Nov 16 10:12:23 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:12:23 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cdffa12-0df1-4d5b-8296-8df3b17aa6ec tempest-DeleteServersTestJSON-1770650847 tempest-DeleteServersTestJSON-1770650847-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42c041ec-fa39-4035-b82b-867caf3565df (non-flash)
Nov 16 10:12:23 user nova-compute[85141]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4df10d9-a60c-45ed-981d-96f704534fb8 (non-flash)
Nov 16 10:12:23 user nova-compute[85141]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4973f768-f126-41d6-b534-458d6c49f9b3 (non-flash)
Nov 16 10:12:23 user nova-compute[85141]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fcde20-e019-4cf0-ad90-6c8100f4a8d2 (non-flash)
Nov 16 10:12:23 user nova-compute[85141]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3011a7d3-0de6-4e2a-bb2b-6bf22d57c764 (non-flash)
Nov 16 10:12:23 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 10:12:23 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-0cdffa12-0df1-4d5b-8296-8df3b17aa6ec tempest-DeleteServersTestJSON-1770650847 tempest-DeleteServersTestJSON-1770650847-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3011a7d3-0de6-4e2a-bb2b-6bf22d57c764" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.336s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 10:12:23 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cdffa12-0df1-4d5b-8296-8df3b17aa6ec tempest-DeleteServersTestJSON-1770650847 tempest-DeleteServersTestJSON-1770650847-project-member] Connected to 172.16.0.220:3260 {{(pid=85141) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 10:12:23 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-0cdffa12-0df1-4d5b-8296-8df3b17aa6ec tempest-DeleteServersTestJSON-1770650847 tempest-DeleteServersTestJSON-1770650847-project-member] HCTL ('37', '-', '-', 0) found on session 6 with lun 0 {{(pid=85141) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 10:12:23 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-0cdffa12-0df1-4d5b-8296-8df3b17aa6ec tempest-DeleteServersTestJSON-1770650847 tempest-DeleteServersTestJSON-1770650847-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=85141) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 10:12:23 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:12:23 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:12:23 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[45daa8bf-58be-495b-b3a3-1ff92a30bce3]: (4, ('- - 0', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:12:23 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-0cdffa12-0df1-4d5b-8296-8df3b17aa6ec tempest-DeleteServersTestJSON-1770650847 tempest-DeleteServersTestJSON-1770650847-project-member] Searching for a device in session 6 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=85141) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 10:12:23 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cdffa12-0df1-4d5b-8296-8df3b17aa6ec tempest-DeleteServersTestJSON-1770650847 tempest-DeleteServersTestJSON-1770650847-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:3011a7d3-0de6-4e2a-bb2b-6bf22d57c764', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KBlahyVU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=85141) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 10:12:23 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f872e56-0fdc-4d3c-ab3d-64497d036dc8/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:12:23 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f872e56-0fdc-4d3c-ab3d-64497d036dc8/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:12:23 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f872e56-0fdc-4d3c-ab3d-64497d036dc8/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:12:24 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:12:24 user nova-compute[85141]: DEBUG nova.compute.manager [req-7728f90b-9100-47e7-917c-9162e10fe0b4 req-d9321035-9970-45b4-86ca-380ae46de5d4 service nova] [instance: 9411843f-4e79-46c4-ae02-01f5e87b86eb] Received event network-vif-plugged-1202aa6f-6442-4e95-bf51-66f977a23e01 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:12:24 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-7728f90b-9100-47e7-917c-9162e10fe0b4 req-d9321035-9970-45b4-86ca-380ae46de5d4 service nova] Acquiring lock "9411843f-4e79-46c4-ae02-01f5e87b86eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:12:24 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-7728f90b-9100-47e7-917c-9162e10fe0b4 req-d9321035-9970-45b4-86ca-380ae46de5d4 service nova] Lock "9411843f-4e79-46c4-ae02-01f5e87b86eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:12:24 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-7728f90b-9100-47e7-917c-9162e10fe0b4 req-d9321035-9970-45b4-86ca-380ae46de5d4 service nova] Lock "9411843f-4e79-46c4-ae02-01f5e87b86eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:12:24 user nova-compute[85141]: DEBUG nova.compute.manager [req-7728f90b-9100-47e7-917c-9162e10fe0b4 req-d9321035-9970-45b4-86ca-380ae46de5d4 service nova] [instance: 9411843f-4e79-46c4-ae02-01f5e87b86eb] No waiting events found dispatching network-vif-plugged-1202aa6f-6442-4e95-bf51-66f977a23e01 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:12:24 user nova-compute[85141]: WARNING nova.compute.manager [req-7728f90b-9100-47e7-917c-9162e10fe0b4 req-d9321035-9970-45b4-86ca-380ae46de5d4 service nova] [instance: 9411843f-4e79-46c4-ae02-01f5e87b86eb] Received unexpected event network-vif-plugged-1202aa6f-6442-4e95-bf51-66f977a23e01 for instance with vm_state active and task_state shelving_image_uploading.
Nov 16 10:12:24 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:12:24 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:12:24 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Hypervisor/Node resource view: name=user free_ram=6635MB free_disk=25.46615219116211GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=85141) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 10:12:24 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:12:24 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:12:24 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-0018e71f-38ad-496f-93a7-cab7a6c5d2d8 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] [instance: d842f90e-663b-4c95-9d7c-d092d2bac41f] Snapshot image upload complete
Nov 16 10:12:24 user nova-compute[85141]: INFO nova.compute.manager [None req-0018e71f-38ad-496f-93a7-cab7a6c5d2d8 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] [instance: d842f90e-663b-4c95-9d7c-d092d2bac41f] Took 6.82 seconds to snapshot the instance on the hypervisor.
Nov 16 10:12:24 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance a4cdcb5b-b2a6-4736-85c8-7e6cdab8c9b1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:12:24 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance 9411843f-4e79-46c4-ae02-01f5e87b86eb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:12:24 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance d842f90e-663b-4c95-9d7c-d092d2bac41f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:12:24 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance e65ccf79-718d-4eeb-8914-f0db2e2c9ce2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:12:24 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance 361a2044-8fd0-4975-8a19-814bf7a6da41 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:12:24 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance ad1ace46-2e8e-42e1-a0f5-2384078fcf09 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:12:24 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance ff964caf-b473-47bc-89d2-f7189264721c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:12:24 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance 0ca61bd2-268e-4c49-ba04-a5cb39143a9b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:12:24 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance 6caf3667-5613-4ef4-a597-1820e6c1c0ac actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:12:24 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance 7e2ae11f-161c-4d13-a1a5-37d0a8150e6b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:12:24 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance 8f872e56-0fdc-4d3c-ab3d-64497d036dc8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:12:24 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance eef3cc09-054b-4a17-b621-4f3737d5420e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:12:24 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=85141) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 10:12:24 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=85141) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 10:12:24 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-0cdffa12-0df1-4d5b-8296-8df3b17aa6ec tempest-DeleteServersTestJSON-1770650847 tempest-DeleteServersTestJSON-1770650847-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.617s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 10:12:24 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cdffa12-0df1-4d5b-8296-8df3b17aa6ec tempest-DeleteServersTestJSON-1770650847 tempest-DeleteServersTestJSON-1770650847-project-member] <== connect_volume: return (1618ms) {'type': 'block', 'scsi_wwn': '23565316632666634', 'path': '/dev/sdf'} {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 10:12:24 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0cdffa12-0df1-4d5b-8296-8df3b17aa6ec tempest-DeleteServersTestJSON-1770650847 tempest-DeleteServersTestJSON-1770650847-project-member] [instance: a4cdcb5b-b2a6-4736-85c8-7e6cdab8c9b1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23565316632666634', 'path': '/dev/sdf'} {{(pid=85141) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 10:12:24 user nova-compute[85141]: DEBUG nova.objects.instance [None req-0cdffa12-0df1-4d5b-8296-8df3b17aa6ec tempest-DeleteServersTestJSON-1770650847 tempest-DeleteServersTestJSON-1770650847-project-member] Lazy-loading 'flavor' on Instance uuid a4cdcb5b-b2a6-4736-85c8-7e6cdab8c9b1 {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:12:24 user nova-compute[85141]: DEBUG nova.virt.libvirt.guest [None req-0cdffa12-0df1-4d5b-8296-8df3b17aa6ec tempest-DeleteServersTestJSON-1770650847 tempest-DeleteServersTestJSON-1770650847-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 10:12:24 user nova-compute[85141]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 10:12:24 user nova-compute[85141]:   <source dev="/dev/sdf"/>
Nov 16 10:12:24 user nova-compute[85141]:   <target dev="vdb" bus="virtio"/>
Nov 16 10:12:24 user nova-compute[85141]:   <serial>3011a7d3-0de6-4e2a-bb2b-6bf22d57c764</serial>
Nov 16 10:12:24 user nova-compute[85141]: </disk>
Nov 16 10:12:24 user nova-compute[85141]:  {{(pid=85141) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 10:12:25 user nova-compute[85141]: DEBUG nova.compute.provider_tree [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Inventory has not changed in ProviderTree for provider: bf8e0fa1-16b6-408f-9203-c4cd63916272 {{(pid=85141) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 10:12:25 user nova-compute[85141]: DEBUG nova.scheduler.client.report [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Inventory has not changed for provider bf8e0fa1-16b6-408f-9203-c4cd63916272 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=85141) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 10:12:25 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Compute_service record updated for user:user {{(pid=85141) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 10:12:25 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.815s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:12:25 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-0cdffa12-0df1-4d5b-8296-8df3b17aa6ec tempest-DeleteServersTestJSON-1770650847 tempest-DeleteServersTestJSON-1770650847-project-member] No BDM found with device name vda, not building metadata. {{(pid=85141) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 10:12:25 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-0cdffa12-0df1-4d5b-8296-8df3b17aa6ec tempest-DeleteServersTestJSON-1770650847 tempest-DeleteServersTestJSON-1770650847-project-member] No BDM found with device name vdb, not building metadata. {{(pid=85141) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 10:12:25 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-0cdffa12-0df1-4d5b-8296-8df3b17aa6ec tempest-DeleteServersTestJSON-1770650847 tempest-DeleteServersTestJSON-1770650847-project-member] No VIF found with MAC fa:16:3e:72:f5:ea, not building metadata {{(pid=85141) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 10:12:26 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-b2032e4d-de25-4c8f-9e5c-c274f46fd08a tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] [instance: 9411843f-4e79-46c4-ae02-01f5e87b86eb] Snapshot image upload complete
Nov 16 10:12:26 user nova-compute[85141]: DEBUG nova.compute.manager [None req-b2032e4d-de25-4c8f-9e5c-c274f46fd08a tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] [instance: 9411843f-4e79-46c4-ae02-01f5e87b86eb] Checking state {{(pid=85141) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 10:12:26 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-0cdffa12-0df1-4d5b-8296-8df3b17aa6ec tempest-DeleteServersTestJSON-1770650847 tempest-DeleteServersTestJSON-1770650847-project-member] Lock "a4cdcb5b-b2a6-4736-85c8-7e6cdab8c9b1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.954s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:12:26 user nova-compute[85141]: INFO nova.compute.manager [None req-b2032e4d-de25-4c8f-9e5c-c274f46fd08a tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] [instance: 9411843f-4e79-46c4-ae02-01f5e87b86eb] Shelve offloading
Nov 16 10:12:26 user nova-compute[85141]: INFO nova.virt.libvirt.driver [-] [instance: 9411843f-4e79-46c4-ae02-01f5e87b86eb] Instance destroyed successfully.
Nov 16 10:12:26 user nova-compute[85141]: DEBUG nova.compute.manager [None req-b2032e4d-de25-4c8f-9e5c-c274f46fd08a tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] [instance: 9411843f-4e79-46c4-ae02-01f5e87b86eb] Checking state {{(pid=85141) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 10:12:26 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-b2032e4d-de25-4c8f-9e5c-c274f46fd08a tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Acquiring lock "refresh_cache-9411843f-4e79-46c4-ae02-01f5e87b86eb" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:12:26 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-b2032e4d-de25-4c8f-9e5c-c274f46fd08a tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Acquired lock "refresh_cache-9411843f-4e79-46c4-ae02-01f5e87b86eb" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:12:26 user nova-compute[85141]: DEBUG nova.network.neutron [None req-b2032e4d-de25-4c8f-9e5c-c274f46fd08a tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] [instance: 9411843f-4e79-46c4-ae02-01f5e87b86eb] Building network info cache for instance {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 10:12:27 user nova-compute[85141]: DEBUG nova.network.neutron [None req-b2032e4d-de25-4c8f-9e5c-c274f46fd08a tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] [instance: 9411843f-4e79-46c4-ae02-01f5e87b86eb] Updating instance_info_cache with network_info: [{"id": "1202aa6f-6442-4e95-bf51-66f977a23e01", "address": "fa:16:3e:d8:53:c3", "network": {"id": "4fb7c85e-c966-481d-b6f2-856a17ac8f7c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-81570496-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08ef12fb41a14ecd8abb84d4d69b7c27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1202aa6f-64", "ovs_interfaceid": "1202aa6f-6442-4e95-bf51-66f977a23e01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:12:27 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-b2032e4d-de25-4c8f-9e5c-c274f46fd08a tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Releasing lock "refresh_cache-9411843f-4e79-46c4-ae02-01f5e87b86eb" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:12:27 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:12:27 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:12:27 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:12:27 user nova-compute[85141]: INFO nova.virt.libvirt.driver [-] [instance: 9411843f-4e79-46c4-ae02-01f5e87b86eb] Instance destroyed successfully.
Nov 16 10:12:27 user nova-compute[85141]: DEBUG nova.objects.instance [None req-b2032e4d-de25-4c8f-9e5c-c274f46fd08a tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Lazy-loading 'resources' on Instance uuid 9411843f-4e79-46c4-ae02-01f5e87b86eb {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:12:27 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-b2032e4d-de25-4c8f-9e5c-c274f46fd08a tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T10:10:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1837935474',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1837935474',id=2,image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDZ6OQWFvlLe2wQphLZxkaPqNwOm4LuvszQn47QWt1pnsQT48lGZZPuN+vNqHjXg4YMzV5iYuL9EDBblOYEFH3rsRxMRAcwHPoeiCg27oMofk7nAiSjMmEYKp5XhsvlmDA==',key_name='tempest-keypair-1893617844',keypairs=<?>,launch_index=0,launched_at=2023-11-16T10:10:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='08ef12fb41a14ecd8abb84d4d69b7c27',ramdisk_id='',reservation_id='r-g9gqfs85',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-958501663',owner_user_name='tempest-AttachVolumeShelveTestJSON-958501663-project-member',shelved_at='2023-11-16T10:12:26.554640',shelved_host='user',shelved_image_id='eb1a1e14-2d41-493c-97e0-8c58cd709388'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T10:12:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='baec48c887ae4a418e0ea7b32b05bc59',uuid=9411843f-4e79-46c4-ae02-01f5e87b86eb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "1202aa6f-6442-4e95-bf51-66f977a23e01", "address": "fa:16:3e:d8:53:c3", "network": {"id": "4fb7c85e-c966-481d-b6f2-856a17ac8f7c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-81570496-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08ef12fb41a14ecd8abb84d4d69b7c27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1202aa6f-64", "ovs_interfaceid": "1202aa6f-6442-4e95-bf51-66f977a23e01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 10:12:27 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-b2032e4d-de25-4c8f-9e5c-c274f46fd08a tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Converting VIF {"id": "1202aa6f-6442-4e95-bf51-66f977a23e01", "address": "fa:16:3e:d8:53:c3", "network": {"id": "4fb7c85e-c966-481d-b6f2-856a17ac8f7c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-81570496-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08ef12fb41a14ecd8abb84d4d69b7c27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1202aa6f-64", "ovs_interfaceid": "1202aa6f-6442-4e95-bf51-66f977a23e01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:12:27 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-b2032e4d-de25-4c8f-9e5c-c274f46fd08a tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d8:53:c3,bridge_name='br-int',has_traffic_filtering=True,id=1202aa6f-6442-4e95-bf51-66f977a23e01,network=Network(4fb7c85e-c966-481d-b6f2-856a17ac8f7c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1202aa6f-64') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:12:27 user nova-compute[85141]: DEBUG os_vif [None req-b2032e4d-de25-4c8f-9e5c-c274f46fd08a tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:53:c3,bridge_name='br-int',has_traffic_filtering=True,id=1202aa6f-6442-4e95-bf51-66f977a23e01,network=Network(4fb7c85e-c966-481d-b6f2-856a17ac8f7c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1202aa6f-64') {{(pid=85141) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 10:12:27 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:12:27 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1202aa6f-64, bridge=br-int, if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:12:27 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:12:27 user nova-compute[85141]: DEBUG nova.compute.manager [req-a6ba6a36-fc2c-4cbb-9180-cd29cd187a19 req-72f5ba56-a356-43f4-bc6a-2f110583c51d service nova] [instance: 9411843f-4e79-46c4-ae02-01f5e87b86eb] Received event network-changed-1202aa6f-6442-4e95-bf51-66f977a23e01 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:12:27 user nova-compute[85141]: DEBUG nova.compute.manager [req-a6ba6a36-fc2c-4cbb-9180-cd29cd187a19 req-72f5ba56-a356-43f4-bc6a-2f110583c51d service nova] [instance: 9411843f-4e79-46c4-ae02-01f5e87b86eb] Refreshing instance network info cache due to event network-changed-1202aa6f-6442-4e95-bf51-66f977a23e01. {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 10:12:27 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-a6ba6a36-fc2c-4cbb-9180-cd29cd187a19 req-72f5ba56-a356-43f4-bc6a-2f110583c51d service nova] Acquiring lock "refresh_cache-9411843f-4e79-46c4-ae02-01f5e87b86eb" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:12:27 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-a6ba6a36-fc2c-4cbb-9180-cd29cd187a19 req-72f5ba56-a356-43f4-bc6a-2f110583c51d service nova] Acquired lock "refresh_cache-9411843f-4e79-46c4-ae02-01f5e87b86eb" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:12:27 user nova-compute[85141]: DEBUG nova.network.neutron [req-a6ba6a36-fc2c-4cbb-9180-cd29cd187a19 req-72f5ba56-a356-43f4-bc6a-2f110583c51d service nova] [instance: 9411843f-4e79-46c4-ae02-01f5e87b86eb] Refreshing network info cache for port 1202aa6f-6442-4e95-bf51-66f977a23e01 {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 10:12:27 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:12:27 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:12:27 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=52cddb0d-34c7-4533-9e6c-cfdb0140e3fd) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:12:27 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:12:27 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:12:27 user nova-compute[85141]: INFO os_vif [None req-b2032e4d-de25-4c8f-9e5c-c274f46fd08a tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:53:c3,bridge_name='br-int',has_traffic_filtering=True,id=1202aa6f-6442-4e95-bf51-66f977a23e01,network=Network(4fb7c85e-c966-481d-b6f2-856a17ac8f7c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1202aa6f-64')
Nov 16 10:12:27 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-b2032e4d-de25-4c8f-9e5c-c274f46fd08a tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] [instance: 9411843f-4e79-46c4-ae02-01f5e87b86eb] Deleting instance files /opt/stack/data/nova/instances/9411843f-4e79-46c4-ae02-01f5e87b86eb_del
Nov 16 10:12:27 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-b2032e4d-de25-4c8f-9e5c-c274f46fd08a tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] [instance: 9411843f-4e79-46c4-ae02-01f5e87b86eb] Deletion of /opt/stack/data/nova/instances/9411843f-4e79-46c4-ae02-01f5e87b86eb_del complete
Nov 16 10:12:27 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-25f3ec20-7819-4e59-9464-e77bfbb53c94 tempest-DeleteServersTestJSON-1770650847 tempest-DeleteServersTestJSON-1770650847-project-member] Acquiring lock "a4cdcb5b-b2a6-4736-85c8-7e6cdab8c9b1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:12:27 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-25f3ec20-7819-4e59-9464-e77bfbb53c94 tempest-DeleteServersTestJSON-1770650847 tempest-DeleteServersTestJSON-1770650847-project-member] Lock "a4cdcb5b-b2a6-4736-85c8-7e6cdab8c9b1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:12:27 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-25f3ec20-7819-4e59-9464-e77bfbb53c94 tempest-DeleteServersTestJSON-1770650847 tempest-DeleteServersTestJSON-1770650847-project-member] Acquiring lock "a4cdcb5b-b2a6-4736-85c8-7e6cdab8c9b1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:12:27 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-25f3ec20-7819-4e59-9464-e77bfbb53c94 tempest-DeleteServersTestJSON-1770650847 tempest-DeleteServersTestJSON-1770650847-project-member] Lock "a4cdcb5b-b2a6-4736-85c8-7e6cdab8c9b1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:12:27 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-25f3ec20-7819-4e59-9464-e77bfbb53c94 tempest-DeleteServersTestJSON-1770650847 tempest-DeleteServersTestJSON-1770650847-project-member] Lock "a4cdcb5b-b2a6-4736-85c8-7e6cdab8c9b1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:12:27 user nova-compute[85141]: INFO nova.compute.manager [None req-25f3ec20-7819-4e59-9464-e77bfbb53c94 tempest-DeleteServersTestJSON-1770650847 tempest-DeleteServersTestJSON-1770650847-project-member] [instance: a4cdcb5b-b2a6-4736-85c8-7e6cdab8c9b1] Terminating instance
Nov 16 10:12:27 user nova-compute[85141]: DEBUG nova.compute.manager [None req-25f3ec20-7819-4e59-9464-e77bfbb53c94 tempest-DeleteServersTestJSON-1770650847 tempest-DeleteServersTestJSON-1770650847-project-member] [instance: a4cdcb5b-b2a6-4736-85c8-7e6cdab8c9b1] Start destroying the instance on the hypervisor. {{(pid=85141) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 10:12:27 user nova-compute[85141]: INFO nova.scheduler.client.report [None req-b2032e4d-de25-4c8f-9e5c-c274f46fd08a tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Deleted allocations for instance 9411843f-4e79-46c4-ae02-01f5e87b86eb
Nov 16 10:12:27 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-b2032e4d-de25-4c8f-9e5c-c274f46fd08a tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:12:27 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-b2032e4d-de25-4c8f-9e5c-c274f46fd08a tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:12:27 user nova-compute[85141]: DEBUG nova.objects.instance [None req-b2032e4d-de25-4c8f-9e5c-c274f46fd08a tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Lazy-loading 'numa_topology' on Instance uuid 9411843f-4e79-46c4-ae02-01f5e87b86eb {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:12:27 user nova-compute[85141]: DEBUG nova.objects.base [None req-b2032e4d-de25-4c8f-9e5c-c274f46fd08a tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Object Instance<9411843f-4e79-46c4-ae02-01f5e87b86eb> lazy-loaded attributes: resources,numa_topology {{(pid=85141) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 10:12:27 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:12:27 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:12:27 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:12:27 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:12:28 user nova-compute[85141]: DEBUG nova.compute.manager [req-d283043f-2bf6-429a-9186-1fd6c758f1dc req-484a9153-0924-48cc-9303-af759d658350 service nova] [instance: a4cdcb5b-b2a6-4736-85c8-7e6cdab8c9b1] Received event network-vif-unplugged-07d06a88-cd34-412f-9b4d-b9fa94247dd4 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:12:28 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-d283043f-2bf6-429a-9186-1fd6c758f1dc req-484a9153-0924-48cc-9303-af759d658350 service nova] Acquiring lock "a4cdcb5b-b2a6-4736-85c8-7e6cdab8c9b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:12:28 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-d283043f-2bf6-429a-9186-1fd6c758f1dc req-484a9153-0924-48cc-9303-af759d658350 service nova] Lock "a4cdcb5b-b2a6-4736-85c8-7e6cdab8c9b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:12:28 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-d283043f-2bf6-429a-9186-1fd6c758f1dc req-484a9153-0924-48cc-9303-af759d658350 service nova] Lock "a4cdcb5b-b2a6-4736-85c8-7e6cdab8c9b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:12:28 user nova-compute[85141]: DEBUG nova.compute.manager [req-d283043f-2bf6-429a-9186-1fd6c758f1dc req-484a9153-0924-48cc-9303-af759d658350 service nova] [instance: a4cdcb5b-b2a6-4736-85c8-7e6cdab8c9b1] No waiting events found dispatching network-vif-unplugged-07d06a88-cd34-412f-9b4d-b9fa94247dd4 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:12:28 user nova-compute[85141]: DEBUG nova.compute.manager [req-d283043f-2bf6-429a-9186-1fd6c758f1dc req-484a9153-0924-48cc-9303-af759d658350 service nova] [instance: a4cdcb5b-b2a6-4736-85c8-7e6cdab8c9b1] Received event network-vif-unplugged-07d06a88-cd34-412f-9b4d-b9fa94247dd4 for instance with task_state deleting. {{(pid=85141) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 10:12:28 user nova-compute[85141]: DEBUG nova.compute.provider_tree [None req-b2032e4d-de25-4c8f-9e5c-c274f46fd08a tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Inventory has not changed in ProviderTree for provider: bf8e0fa1-16b6-408f-9203-c4cd63916272 {{(pid=85141) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 10:12:28 user nova-compute[85141]: DEBUG nova.scheduler.client.report [None req-b2032e4d-de25-4c8f-9e5c-c274f46fd08a tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Inventory has not changed for provider bf8e0fa1-16b6-408f-9203-c4cd63916272 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=85141) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 10:12:28 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-b2032e4d-de25-4c8f-9e5c-c274f46fd08a tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.384s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:12:28 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-b2032e4d-de25-4c8f-9e5c-c274f46fd08a tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Lock "9411843f-4e79-46c4-ae02-01f5e87b86eb" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 6.785s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:12:28 user nova-compute[85141]: INFO nova.virt.libvirt.driver [-] [instance: a4cdcb5b-b2a6-4736-85c8-7e6cdab8c9b1] Instance destroyed successfully.
Nov 16 10:12:28 user nova-compute[85141]: DEBUG nova.objects.instance [None req-25f3ec20-7819-4e59-9464-e77bfbb53c94 tempest-DeleteServersTestJSON-1770650847 tempest-DeleteServersTestJSON-1770650847-project-member] Lazy-loading 'resources' on Instance uuid a4cdcb5b-b2a6-4736-85c8-7e6cdab8c9b1 {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:12:28 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-25f3ec20-7819-4e59-9464-e77bfbb53c94 tempest-DeleteServersTestJSON-1770650847 tempest-DeleteServersTestJSON-1770650847-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T10:10:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1583048707',display_name='tempest-DeleteServersTestJSON-server-1583048707',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1583048707',id=1,image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-16T10:10:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3f28c73b00ca42309f0b679aa6f3c462',ramdisk_id='',reservation_id='r-f1oyexj3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-1770650847',owner_user_name='tempest-DeleteServersTestJSON-1770650847-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T10:10:45Z,user_data=None,user_id='5fc967d7a8f44656877c2973399becbf',uuid=a4cdcb5b-b2a6-4736-85c8-7e6cdab8c9b1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "07d06a88-cd34-412f-9b4d-b9fa94247dd4", "address": "fa:16:3e:72:f5:ea", "network": {"id": "880d7e11-048f-4333-95ad-bdd45e8dcdb4", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1972699698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f28c73b00ca42309f0b679aa6f3c462", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07d06a88-cd", "ovs_interfaceid": "07d06a88-cd34-412f-9b4d-b9fa94247dd4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 10:12:28 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-25f3ec20-7819-4e59-9464-e77bfbb53c94 tempest-DeleteServersTestJSON-1770650847 tempest-DeleteServersTestJSON-1770650847-project-member] Converting VIF {"id": "07d06a88-cd34-412f-9b4d-b9fa94247dd4", "address": "fa:16:3e:72:f5:ea", "network": {"id": "880d7e11-048f-4333-95ad-bdd45e8dcdb4", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1972699698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f28c73b00ca42309f0b679aa6f3c462", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07d06a88-cd", "ovs_interfaceid": "07d06a88-cd34-412f-9b4d-b9fa94247dd4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:12:28 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-25f3ec20-7819-4e59-9464-e77bfbb53c94 tempest-DeleteServersTestJSON-1770650847 tempest-DeleteServersTestJSON-1770650847-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:72:f5:ea,bridge_name='br-int',has_traffic_filtering=True,id=07d06a88-cd34-412f-9b4d-b9fa94247dd4,network=Network(880d7e11-048f-4333-95ad-bdd45e8dcdb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07d06a88-cd') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:12:28 user nova-compute[85141]: DEBUG os_vif [None req-25f3ec20-7819-4e59-9464-e77bfbb53c94 tempest-DeleteServersTestJSON-1770650847 tempest-DeleteServersTestJSON-1770650847-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:72:f5:ea,bridge_name='br-int',has_traffic_filtering=True,id=07d06a88-cd34-412f-9b4d-b9fa94247dd4,network=Network(880d7e11-048f-4333-95ad-bdd45e8dcdb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07d06a88-cd') {{(pid=85141) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 10:12:28 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:12:28 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap07d06a88-cd, bridge=br-int, if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:12:28 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:12:28 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:12:28 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:12:28 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1b42ece2-ab32-4512-bfc9-388f2c0a7a0f) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:12:28 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:12:28 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:12:28 user nova-compute[85141]: INFO os_vif [None req-25f3ec20-7819-4e59-9464-e77bfbb53c94 tempest-DeleteServersTestJSON-1770650847 tempest-DeleteServersTestJSON-1770650847-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:72:f5:ea,bridge_name='br-int',has_traffic_filtering=True,id=07d06a88-cd34-412f-9b4d-b9fa94247dd4,network=Network(880d7e11-048f-4333-95ad-bdd45e8dcdb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07d06a88-cd')
Nov 16 10:12:28 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-25f3ec20-7819-4e59-9464-e77bfbb53c94 tempest-DeleteServersTestJSON-1770650847 tempest-DeleteServersTestJSON-1770650847-project-member] [instance: a4cdcb5b-b2a6-4736-85c8-7e6cdab8c9b1] calling os-brick to detach iSCSI Volume {{(pid=85141) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 10:12:28 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-25f3ec20-7819-4e59-9464-e77bfbb53c94 tempest-DeleteServersTestJSON-1770650847 tempest-DeleteServersTestJSON-1770650847-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51806b6080>, {'target_iqn': 'iqn.2010-10.org.openstack:3011a7d3-0de6-4e2a-bb2b-6bf22d57c764', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KBlahyVU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 10:12:28 user nova-compute[85141]: WARNING os_brick.initiator.connectors.base [None req-25f3ec20-7819-4e59-9464-e77bfbb53c94 tempest-DeleteServersTestJSON-1770650847 tempest-DeleteServersTestJSON-1770650847-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 10:12:28 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-25f3ec20-7819-4e59-9464-e77bfbb53c94 tempest-DeleteServersTestJSON-1770650847 tempest-DeleteServersTestJSON-1770650847-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 10:12:28 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-25f3ec20-7819-4e59-9464-e77bfbb53c94 tempest-DeleteServersTestJSON-1770650847 tempest-DeleteServersTestJSON-1770650847-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 10:12:28 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:12:28 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:12:28 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[64e58308-4042-4d86-88e3-fa16b7e13876]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3011a7d3-0de6-4e2a-bb2b-6bf22d57c764\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4973f768-f126-41d6-b534-458d6c49f9b3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:27fcde20-e019-4cf0-ad90-6c8100f4a8d2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b4df10d9-a60c-45ed-981d-96f704534fb8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:42c041ec-fa39-4035-b82b-867caf3565df\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:12:28 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-25f3ec20-7819-4e59-9464-e77bfbb53c94 tempest-DeleteServersTestJSON-1770650847 tempest-DeleteServersTestJSON-1770650847-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 10:12:28 user nova-compute[85141]: No targets found.
Nov 16 10:12:28 user nova-compute[85141]: iSNS:
Nov 16 10:12:28 user nova-compute[85141]: No targets found.
Nov 16 10:12:28 user nova-compute[85141]: STATIC:
Nov 16 10:12:28 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:3011a7d3-0de6-4e2a-bb2b-6bf22d57c764
Nov 16 10:12:28 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:12:28 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:12:28 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:4973f768-f126-41d6-b534-458d6c49f9b3
Nov 16 10:12:28 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:12:28 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:12:28 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:27fcde20-e019-4cf0-ad90-6c8100f4a8d2
Nov 16 10:12:28 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:12:28 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:12:28 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:b4df10d9-a60c-45ed-981d-96f704534fb8
Nov 16 10:12:28 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:12:28 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:12:28 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:42c041ec-fa39-4035-b82b-867caf3565df
Nov 16 10:12:28 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:12:28 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:12:28 user nova-compute[85141]: FIRMWARE:
Nov 16 10:12:28 user nova-compute[85141]: No targets found.
Nov 16 10:12:28 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:12:28 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-25f3ec20-7819-4e59-9464-e77bfbb53c94 tempest-DeleteServersTestJSON-1770650847 tempest-DeleteServersTestJSON-1770650847-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 10:12:28 user nova-compute[85141]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 10:12:28 user nova-compute[85141]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=85141) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 10:12:28 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-25f3ec20-7819-4e59-9464-e77bfbb53c94 tempest-DeleteServersTestJSON-1770650847 tempest-DeleteServersTestJSON-1770650847-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3011a7d3-0de6-4e2a-bb2b-6bf22d57c764', 0)] {{(pid=85141) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 10:12:28 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:12:28 user nova-compute[85141]: DEBUG nova.network.neutron [req-a6ba6a36-fc2c-4cbb-9180-cd29cd187a19 req-72f5ba56-a356-43f4-bc6a-2f110583c51d service nova] [instance: 9411843f-4e79-46c4-ae02-01f5e87b86eb] Updated VIF entry in instance network info cache for port 1202aa6f-6442-4e95-bf51-66f977a23e01. {{(pid=85141) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 10:12:28 user nova-compute[85141]: DEBUG nova.network.neutron [req-a6ba6a36-fc2c-4cbb-9180-cd29cd187a19 req-72f5ba56-a356-43f4-bc6a-2f110583c51d service nova] [instance: 9411843f-4e79-46c4-ae02-01f5e87b86eb] Updating instance_info_cache with network_info: [{"id": "1202aa6f-6442-4e95-bf51-66f977a23e01", "address": "fa:16:3e:d8:53:c3", "network": {"id": "4fb7c85e-c966-481d-b6f2-856a17ac8f7c", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-81570496-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08ef12fb41a14ecd8abb84d4d69b7c27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap1202aa6f-64", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:12:28 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:12:28 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[009fd949-c2bd-48de-95bc-a342ba8f8741]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:27fcde20-e019-4cf0-ad90-6c8100f4a8d2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3011a7d3-0de6-4e2a-bb2b-6bf22d57c764\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:42c041ec-fa39-4035-b82b-867caf3565df\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4973f768-f126-41d6-b534-458d6c49f9b3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b4df10d9-a60c-45ed-981d-96f704534fb8\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:12:28 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:12:28 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-a6ba6a36-fc2c-4cbb-9180-cd29cd187a19 req-72f5ba56-a356-43f4-bc6a-2f110583c51d service nova] Releasing lock "refresh_cache-9411843f-4e79-46c4-ae02-01f5e87b86eb" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:12:28 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:12:28 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[4efa4c36-5be0-4b7e-9c24-aa4fd00695f0]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42c041ec-fa39-4035-b82b-867caf3565df (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4df10d9-a60c-45ed-981d-96f704534fb8 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4973f768-f126-41d6-b534-458d6c49f9b3 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fcde20-e019-4cf0-ad90-6c8100f4a8d2 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3011a7d3-0de6-4e2a-bb2b-6bf22d57c764 (non-flash)\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:12:28 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-25f3ec20-7819-4e59-9464-e77bfbb53c94 tempest-DeleteServersTestJSON-1770650847 tempest-DeleteServersTestJSON-1770650847-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42c041ec-fa39-4035-b82b-867caf3565df (non-flash)
Nov 16 10:12:28 user nova-compute[85141]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4df10d9-a60c-45ed-981d-96f704534fb8 (non-flash)
Nov 16 10:12:28 user nova-compute[85141]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4973f768-f126-41d6-b534-458d6c49f9b3 (non-flash)
Nov 16 10:12:28 user nova-compute[85141]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fcde20-e019-4cf0-ad90-6c8100f4a8d2 (non-flash)
Nov 16 10:12:28 user nova-compute[85141]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3011a7d3-0de6-4e2a-bb2b-6bf22d57c764 (non-flash)
Nov 16 10:12:28 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:12:28 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-25f3ec20-7819-4e59-9464-e77bfbb53c94 tempest-DeleteServersTestJSON-1770650847 tempest-DeleteServersTestJSON-1770650847-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42c041ec-fa39-4035-b82b-867caf3565df (non-flash)
Nov 16 10:12:28 user nova-compute[85141]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4df10d9-a60c-45ed-981d-96f704534fb8 (non-flash)
Nov 16 10:12:28 user nova-compute[85141]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4973f768-f126-41d6-b534-458d6c49f9b3 (non-flash)
Nov 16 10:12:28 user nova-compute[85141]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fcde20-e019-4cf0-ad90-6c8100f4a8d2 (non-flash)
Nov 16 10:12:28 user nova-compute[85141]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3011a7d3-0de6-4e2a-bb2b-6bf22d57c764 (non-flash)
Nov 16 10:12:28 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 10:12:28 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-25f3ec20-7819-4e59-9464-e77bfbb53c94 tempest-DeleteServersTestJSON-1770650847 tempest-DeleteServersTestJSON-1770650847-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5180673e20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3011a7d3-0de6-4e2a-bb2b-6bf22d57c764'): ({'sdf'}, set())}) {{(pid=85141) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 10:12:28 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-25f3ec20-7819-4e59-9464-e77bfbb53c94 tempest-DeleteServersTestJSON-1770650847 tempest-DeleteServersTestJSON-1770650847-project-member] Removing single pathed devices sdf {{(pid=85141) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 10:12:28 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:12:28 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:12:28 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c3a90d6-8e6f-43c2-9d28-98bf7abbe760]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:12:28 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:12:28 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.017s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:12:28 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a31f3a4-a23a-4653-8834-5eb0c49aec37]: (4, ('ok\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:12:28 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-25f3ec20-7819-4e59-9464-e77bfbb53c94 tempest-DeleteServersTestJSON-1770650847 tempest-DeleteServersTestJSON-1770650847-project-member] Flushing IO for device /dev/sdf {{(pid=85141) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 10:12:28 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:12:28 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.011s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:12:28 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[052feafb-3c7a-46ce-80fc-33b101326d83]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:12:28 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-25f3ec20-7819-4e59-9464-e77bfbb53c94 tempest-DeleteServersTestJSON-1770650847 tempest-DeleteServersTestJSON-1770650847-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=85141) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 10:12:28 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:12:28 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.038s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:12:28 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[b77388a9-c3a4-407f-ab7c-d2c8cfe60c74]: (4, ('1', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:12:28 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-25f3ec20-7819-4e59-9464-e77bfbb53c94 tempest-DeleteServersTestJSON-1770650847 tempest-DeleteServersTestJSON-1770650847-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=85141) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 10:12:28 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-25f3ec20-7819-4e59-9464-e77bfbb53c94 tempest-DeleteServersTestJSON-1770650847 tempest-DeleteServersTestJSON-1770650847-project-member] SCSI volumes sdf have been removed. {{(pid=85141) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 10:12:28 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-25f3ec20-7819-4e59-9464-e77bfbb53c94 tempest-DeleteServersTestJSON-1770650847 tempest-DeleteServersTestJSON-1770650847-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3011a7d3-0de6-4e2a-bb2b-6bf22d57c764')] {{(pid=85141) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 10:12:28 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3011a7d3-0de6-4e2a-bb2b-6bf22d57c764 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:12:28 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3011a7d3-0de6-4e2a-bb2b-6bf22d57c764 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:12:28 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[16f8fe3b-ad40-450b-b24c-acf9f3177e84]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:12:28 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-25f3ec20-7819-4e59-9464-e77bfbb53c94 tempest-DeleteServersTestJSON-1770650847 tempest-DeleteServersTestJSON-1770650847-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:12:28 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3011a7d3-0de6-4e2a-bb2b-6bf22d57c764 -p 172.16.0.220:3260 --logout {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:12:28 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3011a7d3-0de6-4e2a-bb2b-6bf22d57c764 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:12:28 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1e1862a-284d-494c-9c64-8267a0258458]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:3011a7d3-0de6-4e2a-bb2b-6bf22d57c764, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:3011a7d3-0de6-4e2a-bb2b-6bf22d57c764, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:12:28 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-25f3ec20-7819-4e59-9464-e77bfbb53c94 tempest-DeleteServersTestJSON-1770650847 tempest-DeleteServersTestJSON-1770650847-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:3011a7d3-0de6-4e2a-bb2b-6bf22d57c764, portal: 172.16.0.220,3260]
Nov 16 10:12:28 user nova-compute[85141]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:3011a7d3-0de6-4e2a-bb2b-6bf22d57c764, portal: 172.16.0.220,3260] successful.
Nov 16 10:12:28 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:12:28 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3011a7d3-0de6-4e2a-bb2b-6bf22d57c764 -p 172.16.0.220:3260 --op delete {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:12:28 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3011a7d3-0de6-4e2a-bb2b-6bf22d57c764 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:12:28 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a4686e4-bedb-4d28-9d4c-3e761cb053ff]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:12:28 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-25f3ec20-7819-4e59-9464-e77bfbb53c94 tempest-DeleteServersTestJSON-1770650847 tempest-DeleteServersTestJSON-1770650847-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:12:28 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-25f3ec20-7819-4e59-9464-e77bfbb53c94 tempest-DeleteServersTestJSON-1770650847 tempest-DeleteServersTestJSON-1770650847-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.296s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 10:12:28 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-25f3ec20-7819-4e59-9464-e77bfbb53c94 tempest-DeleteServersTestJSON-1770650847 tempest-DeleteServersTestJSON-1770650847-project-member] <== disconnect_volume: return (298ms) None {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 10:12:28 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-25f3ec20-7819-4e59-9464-e77bfbb53c94 tempest-DeleteServersTestJSON-1770650847 tempest-DeleteServersTestJSON-1770650847-project-member] [instance: a4cdcb5b-b2a6-4736-85c8-7e6cdab8c9b1] Disconnected iSCSI Volume {{(pid=85141) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 10:12:28 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-25f3ec20-7819-4e59-9464-e77bfbb53c94 tempest-DeleteServersTestJSON-1770650847 tempest-DeleteServersTestJSON-1770650847-project-member] [instance: a4cdcb5b-b2a6-4736-85c8-7e6cdab8c9b1] Deleting instance files /opt/stack/data/nova/instances/a4cdcb5b-b2a6-4736-85c8-7e6cdab8c9b1_del
Nov 16 10:12:28 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-25f3ec20-7819-4e59-9464-e77bfbb53c94 tempest-DeleteServersTestJSON-1770650847 tempest-DeleteServersTestJSON-1770650847-project-member] [instance: a4cdcb5b-b2a6-4736-85c8-7e6cdab8c9b1] Deletion of /opt/stack/data/nova/instances/a4cdcb5b-b2a6-4736-85c8-7e6cdab8c9b1_del complete
Nov 16 10:12:29 user nova-compute[85141]: INFO nova.compute.manager [None req-25f3ec20-7819-4e59-9464-e77bfbb53c94 tempest-DeleteServersTestJSON-1770650847 tempest-DeleteServersTestJSON-1770650847-project-member] [instance: a4cdcb5b-b2a6-4736-85c8-7e6cdab8c9b1] Took 1.20 seconds to destroy the instance on the hypervisor.
Nov 16 10:12:29 user nova-compute[85141]: DEBUG oslo.service.loopingcall [None req-25f3ec20-7819-4e59-9464-e77bfbb53c94 tempest-DeleteServersTestJSON-1770650847 tempest-DeleteServersTestJSON-1770650847-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=85141) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 10:12:29 user nova-compute[85141]: DEBUG nova.compute.manager [-] [instance: a4cdcb5b-b2a6-4736-85c8-7e6cdab8c9b1] Deallocating network for instance {{(pid=85141) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 10:12:29 user nova-compute[85141]: DEBUG nova.network.neutron [-] [instance: a4cdcb5b-b2a6-4736-85c8-7e6cdab8c9b1] deallocate_for_instance() {{(pid=85141) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 10:12:29 user nova-compute[85141]: DEBUG nova.network.neutron [-] [instance: a4cdcb5b-b2a6-4736-85c8-7e6cdab8c9b1] Updating instance_info_cache with network_info: [] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:12:29 user nova-compute[85141]: INFO nova.compute.manager [-] [instance: a4cdcb5b-b2a6-4736-85c8-7e6cdab8c9b1] Took 0.47 seconds to deallocate network for instance.
Nov 16 10:12:29 user nova-compute[85141]: DEBUG nova.compute.manager [req-b6c97f74-9705-4259-b3fb-2c309332b9ac req-116580cd-e0e9-4863-aff1-6bf537276d40 service nova] [instance: a4cdcb5b-b2a6-4736-85c8-7e6cdab8c9b1] Received event network-vif-deleted-07d06a88-cd34-412f-9b4d-b9fa94247dd4 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:12:30 user nova-compute[85141]: DEBUG nova.compute.manager [req-b5a7497d-c609-44b5-b6f6-759031697cbb req-313f9298-5921-47cb-b5d9-1f97e80e11d5 service nova] [instance: a4cdcb5b-b2a6-4736-85c8-7e6cdab8c9b1] Received event network-vif-plugged-07d06a88-cd34-412f-9b4d-b9fa94247dd4 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:12:30 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-b5a7497d-c609-44b5-b6f6-759031697cbb req-313f9298-5921-47cb-b5d9-1f97e80e11d5 service nova] Acquiring lock "a4cdcb5b-b2a6-4736-85c8-7e6cdab8c9b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:12:30 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-b5a7497d-c609-44b5-b6f6-759031697cbb req-313f9298-5921-47cb-b5d9-1f97e80e11d5 service nova] Lock "a4cdcb5b-b2a6-4736-85c8-7e6cdab8c9b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:12:30 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-b5a7497d-c609-44b5-b6f6-759031697cbb req-313f9298-5921-47cb-b5d9-1f97e80e11d5 service nova] Lock "a4cdcb5b-b2a6-4736-85c8-7e6cdab8c9b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:12:30 user nova-compute[85141]: DEBUG nova.compute.manager [req-b5a7497d-c609-44b5-b6f6-759031697cbb req-313f9298-5921-47cb-b5d9-1f97e80e11d5 service nova] [instance: a4cdcb5b-b2a6-4736-85c8-7e6cdab8c9b1] No waiting events found dispatching network-vif-plugged-07d06a88-cd34-412f-9b4d-b9fa94247dd4 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:12:30 user nova-compute[85141]: WARNING nova.compute.manager [req-b5a7497d-c609-44b5-b6f6-759031697cbb req-313f9298-5921-47cb-b5d9-1f97e80e11d5 service nova] [instance: a4cdcb5b-b2a6-4736-85c8-7e6cdab8c9b1] Received unexpected event network-vif-plugged-07d06a88-cd34-412f-9b4d-b9fa94247dd4 for instance with vm_state active and task_state deleting.
Nov 16 10:12:30 user nova-compute[85141]: INFO nova.compute.manager [None req-25f3ec20-7819-4e59-9464-e77bfbb53c94 tempest-DeleteServersTestJSON-1770650847 tempest-DeleteServersTestJSON-1770650847-project-member] [instance: a4cdcb5b-b2a6-4736-85c8-7e6cdab8c9b1] Took 0.77 seconds to detach 1 volumes for instance.
Nov 16 10:12:30 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-25f3ec20-7819-4e59-9464-e77bfbb53c94 tempest-DeleteServersTestJSON-1770650847 tempest-DeleteServersTestJSON-1770650847-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:12:30 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-25f3ec20-7819-4e59-9464-e77bfbb53c94 tempest-DeleteServersTestJSON-1770650847 tempest-DeleteServersTestJSON-1770650847-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:12:30 user nova-compute[85141]: DEBUG nova.compute.provider_tree [None req-25f3ec20-7819-4e59-9464-e77bfbb53c94 tempest-DeleteServersTestJSON-1770650847 tempest-DeleteServersTestJSON-1770650847-project-member] Inventory has not changed in ProviderTree for provider: bf8e0fa1-16b6-408f-9203-c4cd63916272 {{(pid=85141) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 10:12:30 user nova-compute[85141]: DEBUG nova.scheduler.client.report [None req-25f3ec20-7819-4e59-9464-e77bfbb53c94 tempest-DeleteServersTestJSON-1770650847 tempest-DeleteServersTestJSON-1770650847-project-member] Inventory has not changed for provider bf8e0fa1-16b6-408f-9203-c4cd63916272 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=85141) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 10:12:30 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-25f3ec20-7819-4e59-9464-e77bfbb53c94 tempest-DeleteServersTestJSON-1770650847 tempest-DeleteServersTestJSON-1770650847-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.327s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:12:30 user nova-compute[85141]: INFO nova.scheduler.client.report [None req-25f3ec20-7819-4e59-9464-e77bfbb53c94 tempest-DeleteServersTestJSON-1770650847 tempest-DeleteServersTestJSON-1770650847-project-member] Deleted allocations for instance a4cdcb5b-b2a6-4736-85c8-7e6cdab8c9b1
Nov 16 10:12:30 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-25f3ec20-7819-4e59-9464-e77bfbb53c94 tempest-DeleteServersTestJSON-1770650847 tempest-DeleteServersTestJSON-1770650847-project-member] Lock "a4cdcb5b-b2a6-4736-85c8-7e6cdab8c9b1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.957s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:12:33 user nova-compute[85141]: DEBUG nova.compute.manager [req-d87562b0-4e36-4ff2-9b0d-f6420dd89b16 req-e820a77d-8e8f-4cff-8021-fcb4bd0d615c service nova] [instance: 361a2044-8fd0-4975-8a19-814bf7a6da41] Received event network-changed-dd85b227-3f3d-4f02-a323-661af6a9dc92 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:12:33 user nova-compute[85141]: DEBUG nova.compute.manager [req-d87562b0-4e36-4ff2-9b0d-f6420dd89b16 req-e820a77d-8e8f-4cff-8021-fcb4bd0d615c service nova] [instance: 361a2044-8fd0-4975-8a19-814bf7a6da41] Refreshing instance network info cache due to event network-changed-dd85b227-3f3d-4f02-a323-661af6a9dc92. {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 10:12:33 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-d87562b0-4e36-4ff2-9b0d-f6420dd89b16 req-e820a77d-8e8f-4cff-8021-fcb4bd0d615c service nova] Acquiring lock "refresh_cache-361a2044-8fd0-4975-8a19-814bf7a6da41" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:12:33 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-d87562b0-4e36-4ff2-9b0d-f6420dd89b16 req-e820a77d-8e8f-4cff-8021-fcb4bd0d615c service nova] Acquired lock "refresh_cache-361a2044-8fd0-4975-8a19-814bf7a6da41" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:12:33 user nova-compute[85141]: DEBUG nova.network.neutron [req-d87562b0-4e36-4ff2-9b0d-f6420dd89b16 req-e820a77d-8e8f-4cff-8021-fcb4bd0d615c service nova] [instance: 361a2044-8fd0-4975-8a19-814bf7a6da41] Refreshing network info cache for port dd85b227-3f3d-4f02-a323-661af6a9dc92 {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 10:12:33 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:12:33 user nova-compute[85141]: DEBUG nova.network.neutron [req-d87562b0-4e36-4ff2-9b0d-f6420dd89b16 req-e820a77d-8e8f-4cff-8021-fcb4bd0d615c service nova] [instance: 361a2044-8fd0-4975-8a19-814bf7a6da41] Updated VIF entry in instance network info cache for port dd85b227-3f3d-4f02-a323-661af6a9dc92. {{(pid=85141) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 10:12:33 user nova-compute[85141]: DEBUG nova.network.neutron [req-d87562b0-4e36-4ff2-9b0d-f6420dd89b16 req-e820a77d-8e8f-4cff-8021-fcb4bd0d615c service nova] [instance: 361a2044-8fd0-4975-8a19-814bf7a6da41] Updating instance_info_cache with network_info: [{"id": "dd85b227-3f3d-4f02-a323-661af6a9dc92", "address": "fa:16:3e:b7:94:48", "network": {"id": "1d55ecdc-2f77-4c38-b487-0099d658e0ec", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1226034564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b9e035160ba427c80e5668982136a49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd85b227-3f", "ovs_interfaceid": "dd85b227-3f3d-4f02-a323-661af6a9dc92", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:12:33 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-d87562b0-4e36-4ff2-9b0d-f6420dd89b16 req-e820a77d-8e8f-4cff-8021-fcb4bd0d615c service nova] Releasing lock "refresh_cache-361a2044-8fd0-4975-8a19-814bf7a6da41" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:12:36 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-b203b7f0-e58a-4735-b17c-dd8765c5e502 tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] Acquiring lock "361a2044-8fd0-4975-8a19-814bf7a6da41" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:12:36 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-b203b7f0-e58a-4735-b17c-dd8765c5e502 tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] Lock "361a2044-8fd0-4975-8a19-814bf7a6da41" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:12:36 user nova-compute[85141]: DEBUG nova.objects.instance [None req-b203b7f0-e58a-4735-b17c-dd8765c5e502 tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] Lazy-loading 'flavor' on Instance uuid 361a2044-8fd0-4975-8a19-814bf7a6da41 {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:12:36 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-b203b7f0-e58a-4735-b17c-dd8765c5e502 tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] Lock "361a2044-8fd0-4975-8a19-814bf7a6da41" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.093s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:12:36 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-b203b7f0-e58a-4735-b17c-dd8765c5e502 tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] Acquiring lock "361a2044-8fd0-4975-8a19-814bf7a6da41" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:12:36 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-b203b7f0-e58a-4735-b17c-dd8765c5e502 tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] Lock "361a2044-8fd0-4975-8a19-814bf7a6da41" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:12:36 user nova-compute[85141]: INFO nova.compute.manager [None req-b203b7f0-e58a-4735-b17c-dd8765c5e502 tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] [instance: 361a2044-8fd0-4975-8a19-814bf7a6da41] Attaching volume 5feab5a7-6ec4-4e13-84bc-bff657a0d0de to /dev/vdb
Nov 16 10:12:36 user nova-compute[85141]: DEBUG os_brick.utils [None req-b203b7f0-e58a-4735-b17c-dd8765c5e502 tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 10:12:36 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:12:36 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:12:36 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1ffd785-7019-4644-b8ea-2dab78fc523c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c7834de5c295\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:12:36 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:12:36 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:12:36 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d67b018-bf90-4421-b91f-3a1af12fb201]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:12:36 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:12:36 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:12:36 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e8f32ce-de09-4eee-b63b-bd2d72f142c3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:12:36 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5951065-0b1b-4834-82ad-b571dcd5f448]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:12:36 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-b203b7f0-e58a-4735-b17c-dd8765c5e502 tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] Running cmd (subprocess): nvme version {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:12:36 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-b203b7f0-e58a-4735-b17c-dd8765c5e502 tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] 'nvme version' failed. Not Retrying. {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 10:12:36 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b203b7f0-e58a-4735-b17c-dd8765c5e502 tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] nvme not present on system {{(pid=85141) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 10:12:36 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:12:36 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 10:12:36 user nova-compute[85141]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 10:12:36 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[6da017b3-2d25-4003-b8c2-a59606d12470]: (4, '') {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:12:36 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.lightos [None req-b203b7f0-e58a-4735-b17c-dd8765c5e502 tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=85141) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 10:12:36 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.lightos [None req-b203b7f0-e58a-4735-b17c-dd8765c5e502 tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=85141) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 10:12:36 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.lightos [None req-b203b7f0-e58a-4735-b17c-dd8765c5e502 tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] LIGHTOS: no hostnqn found. {{(pid=85141) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 10:12:36 user nova-compute[85141]: DEBUG os_brick.utils [None req-b203b7f0-e58a-4735-b17c-dd8765c5e502 tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] <== get_connector_properties: return (112ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c7834de5c295', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 10:12:36 user nova-compute[85141]: DEBUG nova.virt.block_device [None req-b203b7f0-e58a-4735-b17c-dd8765c5e502 tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] [instance: 361a2044-8fd0-4975-8a19-814bf7a6da41] Updating existing volume attachment record: de88ea8b-21e4-4d17-8493-c16de6b0e142 {{(pid=85141) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 10:12:37 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:12:38 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:12:41 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b203b7f0-e58a-4735-b17c-dd8765c5e502 tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] [instance: 361a2044-8fd0-4975-8a19-814bf7a6da41] Calling os-brick to attach iSCSI Volume {{(pid=85141) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 10:12:41 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-b203b7f0-e58a-4735-b17c-dd8765c5e502 tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51806b6080>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5feab5a7-6ec4-4e13-84bc-bff657a0d0de', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WvmNryYH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 10:12:41 user nova-compute[85141]: WARNING os_brick.initiator.connectors.base [None req-b203b7f0-e58a-4735-b17c-dd8765c5e502 tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 10:12:41 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-b203b7f0-e58a-4735-b17c-dd8765c5e502 tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 10:12:41 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-b203b7f0-e58a-4735-b17c-dd8765c5e502 tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 10:12:41 user nova-compute[85141]: WARNING os_brick.initiator.connectors.base [None req-b203b7f0-e58a-4735-b17c-dd8765c5e502 tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 10:12:41 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-b203b7f0-e58a-4735-b17c-dd8765c5e502 tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5feab5a7-6ec4-4e13-84bc-bff657a0d0de" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 10:12:41 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-b203b7f0-e58a-4735-b17c-dd8765c5e502 tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5feab5a7-6ec4-4e13-84bc-bff657a0d0de" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 10:12:41 user nova-compute[85141]: INFO os_brick.initiator.connectors.iscsi [None req-b203b7f0-e58a-4735-b17c-dd8765c5e502 tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 10:12:41 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5feab5a7-6ec4-4e13-84bc-bff657a0d0de -p 172.16.0.220:3260 {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:12:41 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5feab5a7-6ec4-4e13-84bc-bff657a0d0de -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:12:41 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[c94f977f-901c-4349-9bbb-1df6d9e146cc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:12:41 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-b203b7f0-e58a-4735-b17c-dd8765c5e502 tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 10:12:41 user nova-compute[85141]:  {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:12:41 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5feab5a7-6ec4-4e13-84bc-bff657a0d0de -p 172.16.0.220:3260 --interface default --op new {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:12:41 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5feab5a7-6ec4-4e13-84bc-bff657a0d0de -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:12:41 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[428309cc-f506-480e-abcf-ac847322a394]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5feab5a7-6ec4-4e13-84bc-bff657a0d0de] added\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:12:41 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-b203b7f0-e58a-4735-b17c-dd8765c5e502 tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5feab5a7-6ec4-4e13-84bc-bff657a0d0de] added
Nov 16 10:12:41 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:12:41 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5feab5a7-6ec4-4e13-84bc-bff657a0d0de -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:12:41 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5feab5a7-6ec4-4e13-84bc-bff657a0d0de -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:12:41 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddfc7d47-414c-4506-8ca2-ace32875e5f7]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:12:41 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-b203b7f0-e58a-4735-b17c-dd8765c5e502 tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:12:41 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5feab5a7-6ec4-4e13-84bc-bff657a0d0de -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:12:41 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5feab5a7-6ec4-4e13-84bc-bff657a0d0de -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:12:41 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[029fc7ba-6c29-48b9-a8b9-8603e25cdb61]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:12:41 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-b203b7f0-e58a-4735-b17c-dd8765c5e502 tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:12:41 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5feab5a7-6ec4-4e13-84bc-bff657a0d0de -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WvmNryYH {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:12:41 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5feab5a7-6ec4-4e13-84bc-bff657a0d0de -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WvmNryYH" returned: 0 in 0.017s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:12:41 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[75a50598-e09e-48b6-abda-fb8c129acc84]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:12:41 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-b203b7f0-e58a-4735-b17c-dd8765c5e502 tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WvmNryYH'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:12:41 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5feab5a7-6ec4-4e13-84bc-bff657a0d0de -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:12:41 user nova-compute[85141]: DEBUG nova.compute.manager [req-c42c1a76-7e57-4cda-a30f-617dd7725864 req-fa76cddc-90ba-4803-a5b6-7ddf995e989b service nova] [instance: ad1ace46-2e8e-42e1-a0f5-2384078fcf09] Received event network-changed-2a895913-f200-44a4-b3bc-4a1c876e2714 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:12:41 user nova-compute[85141]: DEBUG nova.compute.manager [req-c42c1a76-7e57-4cda-a30f-617dd7725864 req-fa76cddc-90ba-4803-a5b6-7ddf995e989b service nova] [instance: ad1ace46-2e8e-42e1-a0f5-2384078fcf09] Refreshing instance network info cache due to event network-changed-2a895913-f200-44a4-b3bc-4a1c876e2714. {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 10:12:41 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-c42c1a76-7e57-4cda-a30f-617dd7725864 req-fa76cddc-90ba-4803-a5b6-7ddf995e989b service nova] Acquiring lock "refresh_cache-ad1ace46-2e8e-42e1-a0f5-2384078fcf09" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:12:41 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-c42c1a76-7e57-4cda-a30f-617dd7725864 req-fa76cddc-90ba-4803-a5b6-7ddf995e989b service nova] Acquired lock "refresh_cache-ad1ace46-2e8e-42e1-a0f5-2384078fcf09" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:12:41 user nova-compute[85141]: DEBUG nova.network.neutron [req-c42c1a76-7e57-4cda-a30f-617dd7725864 req-fa76cddc-90ba-4803-a5b6-7ddf995e989b service nova] [instance: ad1ace46-2e8e-42e1-a0f5-2384078fcf09] Refreshing network info cache for port 2a895913-f200-44a4-b3bc-4a1c876e2714 {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 10:12:41 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5feab5a7-6ec4-4e13-84bc-bff657a0d0de -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:12:41 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2fe2f14-8111-4aad-9487-50b28658070d]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:12:41 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-b203b7f0-e58a-4735-b17c-dd8765c5e502 tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:12:41 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:12:41 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:12:41 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[8926c615-4755-4f1e-920f-50818c7f81c2]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42c041ec-fa39-4035-b82b-867caf3565df (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4df10d9-a60c-45ed-981d-96f704534fb8 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4973f768-f126-41d6-b534-458d6c49f9b3 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fcde20-e019-4cf0-ad90-6c8100f4a8d2 (non-flash)\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:12:41 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-b203b7f0-e58a-4735-b17c-dd8765c5e502 tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42c041ec-fa39-4035-b82b-867caf3565df (non-flash)
Nov 16 10:12:41 user nova-compute[85141]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4df10d9-a60c-45ed-981d-96f704534fb8 (non-flash)
Nov 16 10:12:41 user nova-compute[85141]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4973f768-f126-41d6-b534-458d6c49f9b3 (non-flash)
Nov 16 10:12:41 user nova-compute[85141]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fcde20-e019-4cf0-ad90-6c8100f4a8d2 (non-flash)
Nov 16 10:12:41 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:12:41 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-b203b7f0-e58a-4735-b17c-dd8765c5e502 tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42c041ec-fa39-4035-b82b-867caf3565df (non-flash)
Nov 16 10:12:41 user nova-compute[85141]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4df10d9-a60c-45ed-981d-96f704534fb8 (non-flash)
Nov 16 10:12:41 user nova-compute[85141]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4973f768-f126-41d6-b534-458d6c49f9b3 (non-flash)
Nov 16 10:12:41 user nova-compute[85141]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fcde20-e019-4cf0-ad90-6c8100f4a8d2 (non-flash)
Nov 16 10:12:41 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 10:12:41 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5feab5a7-6ec4-4e13-84bc-bff657a0d0de -p 172.16.0.220:3260 --login {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:12:41 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5feab5a7-6ec4-4e13-84bc-bff657a0d0de -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:12:41 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[173034e5-6fef-4bc3-a46d-31bdc42eef35]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5feab5a7-6ec4-4e13-84bc-bff657a0d0de, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5feab5a7-6ec4-4e13-84bc-bff657a0d0de, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:12:41 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-b203b7f0-e58a-4735-b17c-dd8765c5e502 tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5feab5a7-6ec4-4e13-84bc-bff657a0d0de, portal: 172.16.0.220,3260]
Nov 16 10:12:41 user nova-compute[85141]: Login to [iface: default, target: iqn.2010-10.org.openstack:5feab5a7-6ec4-4e13-84bc-bff657a0d0de, portal: 172.16.0.220,3260] successful.
Nov 16 10:12:41 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:12:41 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5feab5a7-6ec4-4e13-84bc-bff657a0d0de -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:12:41 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5feab5a7-6ec4-4e13-84bc-bff657a0d0de -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:12:41 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[a46037a9-bb8a-4e51-a2a3-c08d9887ad10]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:12:41 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-b203b7f0-e58a-4735-b17c-dd8765c5e502 tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:12:41 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:12:41 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:12:41 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f66516f-d1e9-458d-8e49-1b8b7db26a8e]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42c041ec-fa39-4035-b82b-867caf3565df (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4df10d9-a60c-45ed-981d-96f704534fb8 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4973f768-f126-41d6-b534-458d6c49f9b3 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fcde20-e019-4cf0-ad90-6c8100f4a8d2 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5feab5a7-6ec4-4e13-84bc-bff657a0d0de (non-flash)\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:12:41 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-b203b7f0-e58a-4735-b17c-dd8765c5e502 tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42c041ec-fa39-4035-b82b-867caf3565df (non-flash)
Nov 16 10:12:41 user nova-compute[85141]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4df10d9-a60c-45ed-981d-96f704534fb8 (non-flash)
Nov 16 10:12:41 user nova-compute[85141]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4973f768-f126-41d6-b534-458d6c49f9b3 (non-flash)
Nov 16 10:12:41 user nova-compute[85141]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fcde20-e019-4cf0-ad90-6c8100f4a8d2 (non-flash)
Nov 16 10:12:41 user nova-compute[85141]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5feab5a7-6ec4-4e13-84bc-bff657a0d0de (non-flash)
Nov 16 10:12:41 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:12:41 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-b203b7f0-e58a-4735-b17c-dd8765c5e502 tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42c041ec-fa39-4035-b82b-867caf3565df (non-flash)
Nov 16 10:12:41 user nova-compute[85141]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4df10d9-a60c-45ed-981d-96f704534fb8 (non-flash)
Nov 16 10:12:41 user nova-compute[85141]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4973f768-f126-41d6-b534-458d6c49f9b3 (non-flash)
Nov 16 10:12:41 user nova-compute[85141]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fcde20-e019-4cf0-ad90-6c8100f4a8d2 (non-flash)
Nov 16 10:12:41 user nova-compute[85141]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5feab5a7-6ec4-4e13-84bc-bff657a0d0de (non-flash)
Nov 16 10:12:41 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 10:12:41 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-b203b7f0-e58a-4735-b17c-dd8765c5e502 tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5feab5a7-6ec4-4e13-84bc-bff657a0d0de" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.294s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 10:12:41 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-b203b7f0-e58a-4735-b17c-dd8765c5e502 tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] Connected to 172.16.0.220:3260 {{(pid=85141) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 10:12:41 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-b203b7f0-e58a-4735-b17c-dd8765c5e502 tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] HCTL ('37', '-', '-', 0) found on session 7 with lun 0 {{(pid=85141) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 10:12:41 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-b203b7f0-e58a-4735-b17c-dd8765c5e502 tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=85141) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 10:12:41 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:12:41 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.023s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:12:41 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[58d704b1-ed88-45d7-ae10-fab289dfc357]: (4, ('- - 0', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:12:41 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-b203b7f0-e58a-4735-b17c-dd8765c5e502 tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] Searching for a device in session 7 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=85141) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 10:12:41 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-b203b7f0-e58a-4735-b17c-dd8765c5e502 tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:5feab5a7-6ec4-4e13-84bc-bff657a0d0de', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WvmNryYH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=85141) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 10:12:41 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-154e52c8-22a7-45c8-a26b-4fe6cd419a0c tempest-TestVolumeSwap-1428287604 tempest-TestVolumeSwap-1428287604-project-member] Acquiring lock "ad1ace46-2e8e-42e1-a0f5-2384078fcf09" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:12:41 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-154e52c8-22a7-45c8-a26b-4fe6cd419a0c tempest-TestVolumeSwap-1428287604 tempest-TestVolumeSwap-1428287604-project-member] Lock "ad1ace46-2e8e-42e1-a0f5-2384078fcf09" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:12:41 user nova-compute[85141]: DEBUG nova.objects.instance [None req-154e52c8-22a7-45c8-a26b-4fe6cd419a0c tempest-TestVolumeSwap-1428287604 tempest-TestVolumeSwap-1428287604-project-member] Lazy-loading 'flavor' on Instance uuid ad1ace46-2e8e-42e1-a0f5-2384078fcf09 {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:12:42 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-154e52c8-22a7-45c8-a26b-4fe6cd419a0c tempest-TestVolumeSwap-1428287604 tempest-TestVolumeSwap-1428287604-project-member] Lock "ad1ace46-2e8e-42e1-a0f5-2384078fcf09" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.149s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:12:42 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:12:42 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-154e52c8-22a7-45c8-a26b-4fe6cd419a0c tempest-TestVolumeSwap-1428287604 tempest-TestVolumeSwap-1428287604-project-member] Acquiring lock "ad1ace46-2e8e-42e1-a0f5-2384078fcf09" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:12:42 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-154e52c8-22a7-45c8-a26b-4fe6cd419a0c tempest-TestVolumeSwap-1428287604 tempest-TestVolumeSwap-1428287604-project-member] Lock "ad1ace46-2e8e-42e1-a0f5-2384078fcf09" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:12:42 user nova-compute[85141]: INFO nova.compute.manager [None req-154e52c8-22a7-45c8-a26b-4fe6cd419a0c tempest-TestVolumeSwap-1428287604 tempest-TestVolumeSwap-1428287604-project-member] [instance: ad1ace46-2e8e-42e1-a0f5-2384078fcf09] Attaching volume 7e233047-dda3-4f2e-803c-7b69a57ac656 to /dev/vdb
Nov 16 10:12:42 user nova-compute[85141]: DEBUG os_brick.utils [None req-154e52c8-22a7-45c8-a26b-4fe6cd419a0c tempest-TestVolumeSwap-1428287604 tempest-TestVolumeSwap-1428287604-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 10:12:42 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:12:42 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:12:42 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[d24ba95a-d054-4640-88bc-54705a82af45]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c7834de5c295\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:12:42 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:12:42 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.013s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:12:42 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a6acc40-bfd7-42e5-be84-8388d5b598b2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:12:42 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:12:42 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.013s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:12:42 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc17facd-9d27-4d19-93e4-7868673d0e84]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:12:42 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[b86dcc22-bbd0-4cc7-a747-2675b8cbb3c0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:12:42 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-154e52c8-22a7-45c8-a26b-4fe6cd419a0c tempest-TestVolumeSwap-1428287604 tempest-TestVolumeSwap-1428287604-project-member] Running cmd (subprocess): nvme version {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:12:42 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-154e52c8-22a7-45c8-a26b-4fe6cd419a0c tempest-TestVolumeSwap-1428287604 tempest-TestVolumeSwap-1428287604-project-member] 'nvme version' failed. Not Retrying. {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 10:12:42 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.nvmeof [None req-154e52c8-22a7-45c8-a26b-4fe6cd419a0c tempest-TestVolumeSwap-1428287604 tempest-TestVolumeSwap-1428287604-project-member] nvme not present on system {{(pid=85141) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 10:12:42 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:12:42 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 10:12:42 user nova-compute[85141]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 10:12:42 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4b9630d-d162-4f63-8913-27b8cfd48bef]: (4, '') {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:12:42 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.lightos [None req-154e52c8-22a7-45c8-a26b-4fe6cd419a0c tempest-TestVolumeSwap-1428287604 tempest-TestVolumeSwap-1428287604-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=85141) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 10:12:42 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.lightos [None req-154e52c8-22a7-45c8-a26b-4fe6cd419a0c tempest-TestVolumeSwap-1428287604 tempest-TestVolumeSwap-1428287604-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=85141) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 10:12:42 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.lightos [None req-154e52c8-22a7-45c8-a26b-4fe6cd419a0c tempest-TestVolumeSwap-1428287604 tempest-TestVolumeSwap-1428287604-project-member] LIGHTOS: no hostnqn found. {{(pid=85141) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 10:12:42 user nova-compute[85141]: DEBUG os_brick.utils [None req-154e52c8-22a7-45c8-a26b-4fe6cd419a0c tempest-TestVolumeSwap-1428287604 tempest-TestVolumeSwap-1428287604-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c7834de5c295', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 10:12:42 user nova-compute[85141]: DEBUG nova.virt.block_device [None req-154e52c8-22a7-45c8-a26b-4fe6cd419a0c tempest-TestVolumeSwap-1428287604 tempest-TestVolumeSwap-1428287604-project-member] [instance: ad1ace46-2e8e-42e1-a0f5-2384078fcf09] Updating existing volume attachment record: ca2367ae-e604-4f16-80fd-c07ed23d7932 {{(pid=85141) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 10:12:42 user nova-compute[85141]: DEBUG nova.compute.manager [req-afc0fab6-235b-4f8d-8783-0df1b5f34c04 req-9c28f770-1bc4-4b87-97e3-34b5f9441c47 service nova] [instance: ff964caf-b473-47bc-89d2-f7189264721c] Received event network-changed-75922f14-4d10-428a-baf5-bc27dfa373a6 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:12:42 user nova-compute[85141]: DEBUG nova.compute.manager [req-afc0fab6-235b-4f8d-8783-0df1b5f34c04 req-9c28f770-1bc4-4b87-97e3-34b5f9441c47 service nova] [instance: ff964caf-b473-47bc-89d2-f7189264721c] Refreshing instance network info cache due to event network-changed-75922f14-4d10-428a-baf5-bc27dfa373a6. {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 10:12:42 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-afc0fab6-235b-4f8d-8783-0df1b5f34c04 req-9c28f770-1bc4-4b87-97e3-34b5f9441c47 service nova] Acquiring lock "refresh_cache-ff964caf-b473-47bc-89d2-f7189264721c" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:12:42 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-afc0fab6-235b-4f8d-8783-0df1b5f34c04 req-9c28f770-1bc4-4b87-97e3-34b5f9441c47 service nova] Acquired lock "refresh_cache-ff964caf-b473-47bc-89d2-f7189264721c" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:12:42 user nova-compute[85141]: DEBUG nova.network.neutron [req-afc0fab6-235b-4f8d-8783-0df1b5f34c04 req-9c28f770-1bc4-4b87-97e3-34b5f9441c47 service nova] [instance: ff964caf-b473-47bc-89d2-f7189264721c] Refreshing network info cache for port 75922f14-4d10-428a-baf5-bc27dfa373a6 {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 10:12:42 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-b203b7f0-e58a-4735-b17c-dd8765c5e502 tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.347s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 10:12:42 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-b203b7f0-e58a-4735-b17c-dd8765c5e502 tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] <== connect_volume: return (1348ms) {'type': 'block', 'scsi_wwn': '23862336331323539', 'path': '/dev/sdf'} {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 10:12:42 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b203b7f0-e58a-4735-b17c-dd8765c5e502 tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] [instance: 361a2044-8fd0-4975-8a19-814bf7a6da41] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23862336331323539', 'path': '/dev/sdf'} {{(pid=85141) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 10:12:42 user nova-compute[85141]: DEBUG nova.objects.instance [None req-b203b7f0-e58a-4735-b17c-dd8765c5e502 tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] Lazy-loading 'flavor' on Instance uuid 361a2044-8fd0-4975-8a19-814bf7a6da41 {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:12:42 user nova-compute[85141]: DEBUG nova.virt.libvirt.guest [None req-b203b7f0-e58a-4735-b17c-dd8765c5e502 tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 10:12:42 user nova-compute[85141]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 10:12:42 user nova-compute[85141]:   <source dev="/dev/sdf"/>
Nov 16 10:12:42 user nova-compute[85141]:   <target dev="vdb" bus="virtio"/>
Nov 16 10:12:42 user nova-compute[85141]:   <serial>5feab5a7-6ec4-4e13-84bc-bff657a0d0de</serial>
Nov 16 10:12:42 user nova-compute[85141]: </disk>
Nov 16 10:12:42 user nova-compute[85141]:  {{(pid=85141) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 10:12:43 user nova-compute[85141]: DEBUG nova.network.neutron [req-c42c1a76-7e57-4cda-a30f-617dd7725864 req-fa76cddc-90ba-4803-a5b6-7ddf995e989b service nova] [instance: ad1ace46-2e8e-42e1-a0f5-2384078fcf09] Updated VIF entry in instance network info cache for port 2a895913-f200-44a4-b3bc-4a1c876e2714. {{(pid=85141) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 10:12:43 user nova-compute[85141]: DEBUG nova.network.neutron [req-c42c1a76-7e57-4cda-a30f-617dd7725864 req-fa76cddc-90ba-4803-a5b6-7ddf995e989b service nova] [instance: ad1ace46-2e8e-42e1-a0f5-2384078fcf09] Updating instance_info_cache with network_info: [{"id": "2a895913-f200-44a4-b3bc-4a1c876e2714", "address": "fa:16:3e:dc:86:3e", "network": {"id": "cf5d3eb6-a02c-4169-8137-4f7b19a49a84", "bridge": "br-int", "label": "tempest-TestVolumeSwap-36902130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "466fcdf8030148ca8afbd0e8ffd24a11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a895913-f2", "ovs_interfaceid": "2a895913-f200-44a4-b3bc-4a1c876e2714", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:12:43 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-c42c1a76-7e57-4cda-a30f-617dd7725864 req-fa76cddc-90ba-4803-a5b6-7ddf995e989b service nova] Releasing lock "refresh_cache-ad1ace46-2e8e-42e1-a0f5-2384078fcf09" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:12:43 user nova-compute[85141]: DEBUG nova.network.neutron [req-afc0fab6-235b-4f8d-8783-0df1b5f34c04 req-9c28f770-1bc4-4b87-97e3-34b5f9441c47 service nova] [instance: ff964caf-b473-47bc-89d2-f7189264721c] Updated VIF entry in instance network info cache for port 75922f14-4d10-428a-baf5-bc27dfa373a6. {{(pid=85141) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 10:12:43 user nova-compute[85141]: DEBUG nova.network.neutron [req-afc0fab6-235b-4f8d-8783-0df1b5f34c04 req-9c28f770-1bc4-4b87-97e3-34b5f9441c47 service nova] [instance: ff964caf-b473-47bc-89d2-f7189264721c] Updating instance_info_cache with network_info: [{"id": "75922f14-4d10-428a-baf5-bc27dfa373a6", "address": "fa:16:3e:3f:0d:5b", "network": {"id": "19e4c869-308d-4f73-99a4-653683c91209", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-208861710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb4a953734f44d049877b7658cae923c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75922f14-4d", "ovs_interfaceid": "75922f14-4d10-428a-baf5-bc27dfa373a6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:12:43 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-afc0fab6-235b-4f8d-8783-0df1b5f34c04 req-9c28f770-1bc4-4b87-97e3-34b5f9441c47 service nova] Releasing lock "refresh_cache-ff964caf-b473-47bc-89d2-f7189264721c" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:12:43 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-b203b7f0-e58a-4735-b17c-dd8765c5e502 tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] No BDM found with device name vda, not building metadata. {{(pid=85141) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 10:12:43 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-b203b7f0-e58a-4735-b17c-dd8765c5e502 tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] No BDM found with device name vdb, not building metadata. {{(pid=85141) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 10:12:43 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-b203b7f0-e58a-4735-b17c-dd8765c5e502 tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] No VIF found with MAC fa:16:3e:b7:94:48, not building metadata {{(pid=85141) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 10:12:43 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-b203b7f0-e58a-4735-b17c-dd8765c5e502 tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] Lock "361a2044-8fd0-4975-8a19-814bf7a6da41" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.199s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:12:43 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:12:43 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-2bcdd8f5-5b52-4ffe-b864-7ffc87b8fac3 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] Acquiring lock "interface-0ca61bd2-268e-4c49-ba04-a5cb39143a9b-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:12:43 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-2bcdd8f5-5b52-4ffe-b864-7ffc87b8fac3 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] Lock "interface-0ca61bd2-268e-4c49-ba04-a5cb39143a9b-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:12:43 user nova-compute[85141]: DEBUG nova.objects.instance [None req-2bcdd8f5-5b52-4ffe-b864-7ffc87b8fac3 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] Lazy-loading 'flavor' on Instance uuid 0ca61bd2-268e-4c49-ba04-a5cb39143a9b {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:12:43 user nova-compute[85141]: DEBUG nova.compute.manager [req-711a4183-b03f-442a-82ab-ad6fe1b23e36 req-a83dcd94-66da-4a4a-aec5-17283df83bb5 service nova] [instance: 0ca61bd2-268e-4c49-ba04-a5cb39143a9b] Received event network-changed-56375501-2a9c-4821-8446-31156fc0f231 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:12:43 user nova-compute[85141]: DEBUG nova.compute.manager [req-711a4183-b03f-442a-82ab-ad6fe1b23e36 req-a83dcd94-66da-4a4a-aec5-17283df83bb5 service nova] [instance: 0ca61bd2-268e-4c49-ba04-a5cb39143a9b] Refreshing instance network info cache due to event network-changed-56375501-2a9c-4821-8446-31156fc0f231. {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 10:12:43 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-711a4183-b03f-442a-82ab-ad6fe1b23e36 req-a83dcd94-66da-4a4a-aec5-17283df83bb5 service nova] Acquiring lock "refresh_cache-0ca61bd2-268e-4c49-ba04-a5cb39143a9b" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:12:43 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-711a4183-b03f-442a-82ab-ad6fe1b23e36 req-a83dcd94-66da-4a4a-aec5-17283df83bb5 service nova] Acquired lock "refresh_cache-0ca61bd2-268e-4c49-ba04-a5cb39143a9b" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:12:43 user nova-compute[85141]: DEBUG nova.network.neutron [req-711a4183-b03f-442a-82ab-ad6fe1b23e36 req-a83dcd94-66da-4a4a-aec5-17283df83bb5 service nova] [instance: 0ca61bd2-268e-4c49-ba04-a5cb39143a9b] Refreshing network info cache for port 56375501-2a9c-4821-8446-31156fc0f231 {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 10:12:44 user nova-compute[85141]: DEBUG nova.objects.instance [None req-2bcdd8f5-5b52-4ffe-b864-7ffc87b8fac3 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] Lazy-loading 'pci_requests' on Instance uuid 0ca61bd2-268e-4c49-ba04-a5cb39143a9b {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:12:44 user nova-compute[85141]: DEBUG nova.objects.base [None req-2bcdd8f5-5b52-4ffe-b864-7ffc87b8fac3 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] Object Instance<0ca61bd2-268e-4c49-ba04-a5cb39143a9b> lazy-loaded attributes: flavor,pci_requests {{(pid=85141) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 10:12:44 user nova-compute[85141]: DEBUG nova.network.neutron [None req-2bcdd8f5-5b52-4ffe-b864-7ffc87b8fac3 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] [instance: 0ca61bd2-268e-4c49-ba04-a5cb39143a9b] allocate_for_instance() {{(pid=85141) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 10:12:44 user nova-compute[85141]: DEBUG nova.policy [None req-2bcdd8f5-5b52-4ffe-b864-7ffc87b8fac3 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8734a61ff9fb4e14b1b542b8ecdfdeec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9317f5645af406c899fcc5df61362bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85141) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 10:12:44 user nova-compute[85141]: DEBUG nova.network.neutron [req-711a4183-b03f-442a-82ab-ad6fe1b23e36 req-a83dcd94-66da-4a4a-aec5-17283df83bb5 service nova] [instance: 0ca61bd2-268e-4c49-ba04-a5cb39143a9b] Updated VIF entry in instance network info cache for port 56375501-2a9c-4821-8446-31156fc0f231. {{(pid=85141) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 10:12:44 user nova-compute[85141]: DEBUG nova.network.neutron [req-711a4183-b03f-442a-82ab-ad6fe1b23e36 req-a83dcd94-66da-4a4a-aec5-17283df83bb5 service nova] [instance: 0ca61bd2-268e-4c49-ba04-a5cb39143a9b] Updating instance_info_cache with network_info: [{"id": "56375501-2a9c-4821-8446-31156fc0f231", "address": "fa:16:3e:12:0a:da", "network": {"id": "cd9a5383-79fc-4957-9a8e-30a18ac26969", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1797454995-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9317f5645af406c899fcc5df61362bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56375501-2a", "ovs_interfaceid": "56375501-2a9c-4821-8446-31156fc0f231", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:12:44 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-711a4183-b03f-442a-82ab-ad6fe1b23e36 req-a83dcd94-66da-4a4a-aec5-17283df83bb5 service nova] Releasing lock "refresh_cache-0ca61bd2-268e-4c49-ba04-a5cb39143a9b" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:12:44 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-cd63184a-c0d0-4bde-a703-fcd59712ca5d tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] Acquiring lock "361a2044-8fd0-4975-8a19-814bf7a6da41" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:12:44 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-cd63184a-c0d0-4bde-a703-fcd59712ca5d tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] Lock "361a2044-8fd0-4975-8a19-814bf7a6da41" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:12:44 user nova-compute[85141]: INFO nova.compute.manager [None req-cd63184a-c0d0-4bde-a703-fcd59712ca5d tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] [instance: 361a2044-8fd0-4975-8a19-814bf7a6da41] Detaching volume 5feab5a7-6ec4-4e13-84bc-bff657a0d0de
Nov 16 10:12:44 user nova-compute[85141]: DEBUG nova.compute.manager [req-b31688ae-b39d-43b3-82a1-f9097565fa3d req-e936fd49-0859-4edd-b45d-07a62b411bfc service nova] [instance: 6caf3667-5613-4ef4-a597-1820e6c1c0ac] Received event network-changed-ad2b755f-6905-4256-be59-b64dae993293 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:12:44 user nova-compute[85141]: DEBUG nova.compute.manager [req-b31688ae-b39d-43b3-82a1-f9097565fa3d req-e936fd49-0859-4edd-b45d-07a62b411bfc service nova] [instance: 6caf3667-5613-4ef4-a597-1820e6c1c0ac] Refreshing instance network info cache due to event network-changed-ad2b755f-6905-4256-be59-b64dae993293. {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 10:12:44 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-b31688ae-b39d-43b3-82a1-f9097565fa3d req-e936fd49-0859-4edd-b45d-07a62b411bfc service nova] Acquiring lock "refresh_cache-6caf3667-5613-4ef4-a597-1820e6c1c0ac" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:12:44 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-b31688ae-b39d-43b3-82a1-f9097565fa3d req-e936fd49-0859-4edd-b45d-07a62b411bfc service nova] Acquired lock "refresh_cache-6caf3667-5613-4ef4-a597-1820e6c1c0ac" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:12:44 user nova-compute[85141]: DEBUG nova.network.neutron [req-b31688ae-b39d-43b3-82a1-f9097565fa3d req-e936fd49-0859-4edd-b45d-07a62b411bfc service nova] [instance: 6caf3667-5613-4ef4-a597-1820e6c1c0ac] Refreshing network info cache for port ad2b755f-6905-4256-be59-b64dae993293 {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 10:12:44 user nova-compute[85141]: INFO nova.virt.block_device [None req-cd63184a-c0d0-4bde-a703-fcd59712ca5d tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] [instance: 361a2044-8fd0-4975-8a19-814bf7a6da41] Attempting to driver detach volume 5feab5a7-6ec4-4e13-84bc-bff657a0d0de from mountpoint /dev/vdb
Nov 16 10:12:44 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-cd63184a-c0d0-4bde-a703-fcd59712ca5d tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] Attempting to detach device vdb from instance 361a2044-8fd0-4975-8a19-814bf7a6da41 from the persistent domain config. {{(pid=85141) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 10:12:44 user nova-compute[85141]: DEBUG nova.virt.libvirt.guest [None req-cd63184a-c0d0-4bde-a703-fcd59712ca5d tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 10:12:44 user nova-compute[85141]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 10:12:44 user nova-compute[85141]:   <source dev="/dev/sdf"/>
Nov 16 10:12:44 user nova-compute[85141]:   <target dev="vdb" bus="virtio"/>
Nov 16 10:12:44 user nova-compute[85141]:   <serial>5feab5a7-6ec4-4e13-84bc-bff657a0d0de</serial>
Nov 16 10:12:44 user nova-compute[85141]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 10:12:44 user nova-compute[85141]: </disk>
Nov 16 10:12:44 user nova-compute[85141]:  {{(pid=85141) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 10:12:44 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-cd63184a-c0d0-4bde-a703-fcd59712ca5d tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] Successfully detached device vdb from instance 361a2044-8fd0-4975-8a19-814bf7a6da41 from the persistent domain config.
Nov 16 10:12:44 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-cd63184a-c0d0-4bde-a703-fcd59712ca5d tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 361a2044-8fd0-4975-8a19-814bf7a6da41 from the live domain config. {{(pid=85141) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 10:12:44 user nova-compute[85141]: DEBUG nova.virt.libvirt.guest [None req-cd63184a-c0d0-4bde-a703-fcd59712ca5d tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 10:12:44 user nova-compute[85141]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 10:12:44 user nova-compute[85141]:   <source dev="/dev/sdf"/>
Nov 16 10:12:44 user nova-compute[85141]:   <target dev="vdb" bus="virtio"/>
Nov 16 10:12:44 user nova-compute[85141]:   <serial>5feab5a7-6ec4-4e13-84bc-bff657a0d0de</serial>
Nov 16 10:12:44 user nova-compute[85141]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 10:12:44 user nova-compute[85141]: </disk>
Nov 16 10:12:44 user nova-compute[85141]:  {{(pid=85141) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 10:12:44 user nova-compute[85141]: DEBUG nova.network.neutron [None req-2bcdd8f5-5b52-4ffe-b864-7ffc87b8fac3 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] [instance: 0ca61bd2-268e-4c49-ba04-a5cb39143a9b] Successfully created port: 0fd660bd-1d7b-45d1-8906-d20417082456 {{(pid=85141) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 10:12:45 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-1bb357f0-6d8f-4fb2-9dcc-8a64f3cb73c1 tempest-AttachSCSIVolumeTestJSON-1774410022 tempest-AttachSCSIVolumeTestJSON-1774410022-project-member] Acquiring lock "ff964caf-b473-47bc-89d2-f7189264721c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:12:45 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-1bb357f0-6d8f-4fb2-9dcc-8a64f3cb73c1 tempest-AttachSCSIVolumeTestJSON-1774410022 tempest-AttachSCSIVolumeTestJSON-1774410022-project-member] Lock "ff964caf-b473-47bc-89d2-f7189264721c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:12:45 user nova-compute[85141]: DEBUG nova.objects.instance [None req-1bb357f0-6d8f-4fb2-9dcc-8a64f3cb73c1 tempest-AttachSCSIVolumeTestJSON-1774410022 tempest-AttachSCSIVolumeTestJSON-1774410022-project-member] Lazy-loading 'flavor' on Instance uuid ff964caf-b473-47bc-89d2-f7189264721c {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:12:45 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-1bb357f0-6d8f-4fb2-9dcc-8a64f3cb73c1 tempest-AttachSCSIVolumeTestJSON-1774410022 tempest-AttachSCSIVolumeTestJSON-1774410022-project-member] Lock "ff964caf-b473-47bc-89d2-f7189264721c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:12:45 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-cd63184a-c0d0-4bde-a703-fcd59712ca5d tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 361a2044-8fd0-4975-8a19-814bf7a6da41 {{(pid=85141) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 10:12:45 user nova-compute[85141]: DEBUG nova.network.neutron [req-b31688ae-b39d-43b3-82a1-f9097565fa3d req-e936fd49-0859-4edd-b45d-07a62b411bfc service nova] [instance: 6caf3667-5613-4ef4-a597-1820e6c1c0ac] Updated VIF entry in instance network info cache for port ad2b755f-6905-4256-be59-b64dae993293. {{(pid=85141) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 10:12:45 user nova-compute[85141]: DEBUG nova.network.neutron [req-b31688ae-b39d-43b3-82a1-f9097565fa3d req-e936fd49-0859-4edd-b45d-07a62b411bfc service nova] [instance: 6caf3667-5613-4ef4-a597-1820e6c1c0ac] Updating instance_info_cache with network_info: [{"id": "ad2b755f-6905-4256-be59-b64dae993293", "address": "fa:16:3e:fb:7c:00", "network": {"id": "9b5d58ef-109a-4ccb-90e4-a6b18c02f49c", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1619595955-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.67", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e017c305665f4a98a75d1d77701b6527", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad2b755f-69", "ovs_interfaceid": "ad2b755f-6905-4256-be59-b64dae993293", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:12:45 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-b31688ae-b39d-43b3-82a1-f9097565fa3d req-e936fd49-0859-4edd-b45d-07a62b411bfc service nova] Releasing lock "refresh_cache-6caf3667-5613-4ef4-a597-1820e6c1c0ac" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:12:45 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-1bb357f0-6d8f-4fb2-9dcc-8a64f3cb73c1 tempest-AttachSCSIVolumeTestJSON-1774410022 tempest-AttachSCSIVolumeTestJSON-1774410022-project-member] Acquiring lock "ff964caf-b473-47bc-89d2-f7189264721c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:12:45 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-1bb357f0-6d8f-4fb2-9dcc-8a64f3cb73c1 tempest-AttachSCSIVolumeTestJSON-1774410022 tempest-AttachSCSIVolumeTestJSON-1774410022-project-member] Lock "ff964caf-b473-47bc-89d2-f7189264721c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:12:45 user nova-compute[85141]: INFO nova.compute.manager [None req-1bb357f0-6d8f-4fb2-9dcc-8a64f3cb73c1 tempest-AttachSCSIVolumeTestJSON-1774410022 tempest-AttachSCSIVolumeTestJSON-1774410022-project-member] [instance: ff964caf-b473-47bc-89d2-f7189264721c] Attaching volume 8ca01473-0233-4122-b008-ffa407ca3e70 to /dev/sdc
Nov 16 10:12:45 user nova-compute[85141]: DEBUG os_brick.utils [None req-1bb357f0-6d8f-4fb2-9dcc-8a64f3cb73c1 tempest-AttachSCSIVolumeTestJSON-1774410022 tempest-AttachSCSIVolumeTestJSON-1774410022-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 10:12:45 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:12:45 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.021s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:12:45 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa3382d0-ed56-4dd1-99e5-9934c93e149e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c7834de5c295\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:12:45 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:12:45 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:12:45 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9b08bc5-01c3-4b9d-bc52-d1b7e0fa3252]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:12:45 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:12:45 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:12:45 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fe50e7f-07be-4fa0-85ee-16e2c14d61a5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:12:45 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf1cc11b-240d-40d4-8148-77508d2279c3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:12:45 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-1bb357f0-6d8f-4fb2-9dcc-8a64f3cb73c1 tempest-AttachSCSIVolumeTestJSON-1774410022 tempest-AttachSCSIVolumeTestJSON-1774410022-project-member] Running cmd (subprocess): nvme version {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:12:45 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-1bb357f0-6d8f-4fb2-9dcc-8a64f3cb73c1 tempest-AttachSCSIVolumeTestJSON-1774410022 tempest-AttachSCSIVolumeTestJSON-1774410022-project-member] 'nvme version' failed. Not Retrying. {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 10:12:45 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1bb357f0-6d8f-4fb2-9dcc-8a64f3cb73c1 tempest-AttachSCSIVolumeTestJSON-1774410022 tempest-AttachSCSIVolumeTestJSON-1774410022-project-member] nvme not present on system {{(pid=85141) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 10:12:45 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:12:45 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 10:12:45 user nova-compute[85141]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 10:12:45 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[f41b8252-9aea-4b31-b1f7-eef75c34704e]: (4, '') {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:12:45 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.lightos [None req-1bb357f0-6d8f-4fb2-9dcc-8a64f3cb73c1 tempest-AttachSCSIVolumeTestJSON-1774410022 tempest-AttachSCSIVolumeTestJSON-1774410022-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=85141) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 10:12:45 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.lightos [None req-1bb357f0-6d8f-4fb2-9dcc-8a64f3cb73c1 tempest-AttachSCSIVolumeTestJSON-1774410022 tempest-AttachSCSIVolumeTestJSON-1774410022-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=85141) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 10:12:45 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.lightos [None req-1bb357f0-6d8f-4fb2-9dcc-8a64f3cb73c1 tempest-AttachSCSIVolumeTestJSON-1774410022 tempest-AttachSCSIVolumeTestJSON-1774410022-project-member] LIGHTOS: no hostnqn found. {{(pid=85141) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 10:12:45 user nova-compute[85141]: DEBUG os_brick.utils [None req-1bb357f0-6d8f-4fb2-9dcc-8a64f3cb73c1 tempest-AttachSCSIVolumeTestJSON-1774410022 tempest-AttachSCSIVolumeTestJSON-1774410022-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c7834de5c295', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 10:12:45 user nova-compute[85141]: DEBUG nova.virt.block_device [None req-1bb357f0-6d8f-4fb2-9dcc-8a64f3cb73c1 tempest-AttachSCSIVolumeTestJSON-1774410022 tempest-AttachSCSIVolumeTestJSON-1774410022-project-member] [instance: ff964caf-b473-47bc-89d2-f7189264721c] Updating existing volume attachment record: ca3b2c66-8fcb-49fa-aef1-b025a2d4f6d8 {{(pid=85141) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 10:12:45 user nova-compute[85141]: DEBUG nova.network.neutron [None req-2bcdd8f5-5b52-4ffe-b864-7ffc87b8fac3 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] [instance: 0ca61bd2-268e-4c49-ba04-a5cb39143a9b] Successfully updated port: 0fd660bd-1d7b-45d1-8906-d20417082456 {{(pid=85141) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 10:12:45 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-2bcdd8f5-5b52-4ffe-b864-7ffc87b8fac3 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] Acquiring lock "refresh_cache-0ca61bd2-268e-4c49-ba04-a5cb39143a9b" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:12:45 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-2bcdd8f5-5b52-4ffe-b864-7ffc87b8fac3 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] Acquired lock "refresh_cache-0ca61bd2-268e-4c49-ba04-a5cb39143a9b" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:12:45 user nova-compute[85141]: DEBUG nova.network.neutron [None req-2bcdd8f5-5b52-4ffe-b864-7ffc87b8fac3 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] [instance: 0ca61bd2-268e-4c49-ba04-a5cb39143a9b] Building network info cache for instance {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 10:12:45 user nova-compute[85141]: INFO nova.compute.manager [None req-68a55eb0-e7c0-4da6-939c-890e936d1f9c tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] [instance: 6caf3667-5613-4ef4-a597-1820e6c1c0ac] Rebuilding instance
Nov 16 10:12:45 user nova-compute[85141]: DEBUG nova.compute.manager [req-8c879899-7b72-4528-b7fa-e467b273e2c4 req-acf051c1-7c73-4d63-a292-c44e84152030 service nova] [instance: 0ca61bd2-268e-4c49-ba04-a5cb39143a9b] Received event network-changed-0fd660bd-1d7b-45d1-8906-d20417082456 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:12:45 user nova-compute[85141]: DEBUG nova.compute.manager [req-8c879899-7b72-4528-b7fa-e467b273e2c4 req-acf051c1-7c73-4d63-a292-c44e84152030 service nova] [instance: 0ca61bd2-268e-4c49-ba04-a5cb39143a9b] Refreshing instance network info cache due to event network-changed-0fd660bd-1d7b-45d1-8906-d20417082456. {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 10:12:45 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-8c879899-7b72-4528-b7fa-e467b273e2c4 req-acf051c1-7c73-4d63-a292-c44e84152030 service nova] Acquiring lock "refresh_cache-0ca61bd2-268e-4c49-ba04-a5cb39143a9b" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:12:45 user nova-compute[85141]: DEBUG nova.compute.manager [None req-68a55eb0-e7c0-4da6-939c-890e936d1f9c tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] [instance: 6caf3667-5613-4ef4-a597-1820e6c1c0ac] Checking state {{(pid=85141) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 10:12:45 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:12:45 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:12:46 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:12:46 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:12:46 user nova-compute[85141]: DEBUG nova.compute.manager [req-69823e4c-16a9-4c10-aa78-417871b73ca0 req-1a1c4058-51ef-4a5e-b1f2-4b7d92f5595f service nova] [instance: 6caf3667-5613-4ef4-a597-1820e6c1c0ac] Received event network-vif-unplugged-ad2b755f-6905-4256-be59-b64dae993293 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:12:46 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-69823e4c-16a9-4c10-aa78-417871b73ca0 req-1a1c4058-51ef-4a5e-b1f2-4b7d92f5595f service nova] Acquiring lock "6caf3667-5613-4ef4-a597-1820e6c1c0ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:12:46 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-69823e4c-16a9-4c10-aa78-417871b73ca0 req-1a1c4058-51ef-4a5e-b1f2-4b7d92f5595f service nova] Lock "6caf3667-5613-4ef4-a597-1820e6c1c0ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:12:46 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-69823e4c-16a9-4c10-aa78-417871b73ca0 req-1a1c4058-51ef-4a5e-b1f2-4b7d92f5595f service nova] Lock "6caf3667-5613-4ef4-a597-1820e6c1c0ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:12:46 user nova-compute[85141]: DEBUG nova.compute.manager [req-69823e4c-16a9-4c10-aa78-417871b73ca0 req-1a1c4058-51ef-4a5e-b1f2-4b7d92f5595f service nova] [instance: 6caf3667-5613-4ef4-a597-1820e6c1c0ac] No waiting events found dispatching network-vif-unplugged-ad2b755f-6905-4256-be59-b64dae993293 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:12:46 user nova-compute[85141]: WARNING nova.compute.manager [req-69823e4c-16a9-4c10-aa78-417871b73ca0 req-1a1c4058-51ef-4a5e-b1f2-4b7d92f5595f service nova] [instance: 6caf3667-5613-4ef4-a597-1820e6c1c0ac] Received unexpected event network-vif-unplugged-ad2b755f-6905-4256-be59-b64dae993293 for instance with vm_state active and task_state rebuilding.
Nov 16 10:12:46 user nova-compute[85141]: DEBUG nova.network.neutron [None req-2bcdd8f5-5b52-4ffe-b864-7ffc87b8fac3 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] [instance: 0ca61bd2-268e-4c49-ba04-a5cb39143a9b] Updating instance_info_cache with network_info: [{"id": "56375501-2a9c-4821-8446-31156fc0f231", "address": "fa:16:3e:12:0a:da", "network": {"id": "cd9a5383-79fc-4957-9a8e-30a18ac26969", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1797454995-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9317f5645af406c899fcc5df61362bb", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56375501-2a", "ovs_interfaceid": "56375501-2a9c-4821-8446-31156fc0f231", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0fd660bd-1d7b-45d1-8906-d20417082456", "address": "fa:16:3e:86:c2:f1", "network": {"id": "a0932a5f-6790-40ed-a554-3a9e85f287d0", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-35889031", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "b9317f5645af406c899fcc5df61362bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fd660bd-1d", "ovs_interfaceid": "0fd660bd-1d7b-45d1-8906-d20417082456", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:12:46 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-2bcdd8f5-5b52-4ffe-b864-7ffc87b8fac3 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] Releasing lock "refresh_cache-0ca61bd2-268e-4c49-ba04-a5cb39143a9b" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:12:46 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-8c879899-7b72-4528-b7fa-e467b273e2c4 req-acf051c1-7c73-4d63-a292-c44e84152030 service nova] Acquired lock "refresh_cache-0ca61bd2-268e-4c49-ba04-a5cb39143a9b" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:12:46 user nova-compute[85141]: DEBUG nova.network.neutron [req-8c879899-7b72-4528-b7fa-e467b273e2c4 req-acf051c1-7c73-4d63-a292-c44e84152030 service nova] [instance: 0ca61bd2-268e-4c49-ba04-a5cb39143a9b] Refreshing network info cache for port 0fd660bd-1d7b-45d1-8906-d20417082456 {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 10:12:46 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-2bcdd8f5-5b52-4ffe-b864-7ffc87b8fac3 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T10:10:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-716916570',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-716916570',id=8,image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLJjo671Ow+Mmgs0Sg26Qz/3lV+acwH0zhTjdI/jAzpHJeJFVSCAeG6lSBMe0VPCPV8jS6nF17VjHRJ+udtegobTbD+V4E/SBllDlIvaieW2o7QXUoKkfv8rtxZTi+1HzQ==',key_name='tempest-keypair-612763063',keypairs=<?>,launch_index=0,launched_at=2023-11-16T10:11:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='b9317f5645af406c899fcc5df61362bb',ramdisk_id='',reservation_id='r-xpla73zu',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1293058027',owner_user_name='tempest-TaggedAttachmentsTest-1293058027-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T10:11:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8734a61ff9fb4e14b1b542b8ecdfdeec',uuid=0ca61bd2-268e-4c49-ba04-a5cb39143a9b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0fd660bd-1d7b-45d1-8906-d20417082456", "address": "fa:16:3e:86:c2:f1", "network": {"id": "a0932a5f-6790-40ed-a554-3a9e85f287d0", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-35889031", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "b9317f5645af406c899fcc5df61362bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fd660bd-1d", "ovs_interfaceid": "0fd660bd-1d7b-45d1-8906-d20417082456", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 10:12:46 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-2bcdd8f5-5b52-4ffe-b864-7ffc87b8fac3 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] Converting VIF {"id": "0fd660bd-1d7b-45d1-8906-d20417082456", "address": "fa:16:3e:86:c2:f1", "network": {"id": "a0932a5f-6790-40ed-a554-3a9e85f287d0", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-35889031", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "b9317f5645af406c899fcc5df61362bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fd660bd-1d", "ovs_interfaceid": "0fd660bd-1d7b-45d1-8906-d20417082456", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:12:46 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-2bcdd8f5-5b52-4ffe-b864-7ffc87b8fac3 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:c2:f1,bridge_name='br-int',has_traffic_filtering=True,id=0fd660bd-1d7b-45d1-8906-d20417082456,network=Network(a0932a5f-6790-40ed-a554-3a9e85f287d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0fd660bd-1d') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:12:46 user nova-compute[85141]: DEBUG os_vif [None req-2bcdd8f5-5b52-4ffe-b864-7ffc87b8fac3 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:c2:f1,bridge_name='br-int',has_traffic_filtering=True,id=0fd660bd-1d7b-45d1-8906-d20417082456,network=Network(a0932a5f-6790-40ed-a554-3a9e85f287d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0fd660bd-1d') {{(pid=85141) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 10:12:46 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:12:46 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:12:46 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 10:12:46 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:12:46 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4da2a90f-1bed-54e7-bfb9-bd2263bd126e', '_type': 'linux-noop'}}, row=False) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:12:46 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:12:46 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:12:46 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:12:46 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:12:46 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0fd660bd-1d, may_exist=True, interface_attrs={}) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:12:46 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0fd660bd-1d, col_values=(('qos', UUID('81300972-e348-417c-a756-3227a8dbdd45')),), if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:12:46 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0fd660bd-1d, col_values=(('external_ids', {'iface-id': '0fd660bd-1d7b-45d1-8906-d20417082456', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:86:c2:f1', 'vm-uuid': '0ca61bd2-268e-4c49-ba04-a5cb39143a9b'}),), if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:12:46 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:12:46 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:12:46 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:12:46 user nova-compute[85141]: INFO os_vif [None req-2bcdd8f5-5b52-4ffe-b864-7ffc87b8fac3 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:c2:f1,bridge_name='br-int',has_traffic_filtering=True,id=0fd660bd-1d7b-45d1-8906-d20417082456,network=Network(a0932a5f-6790-40ed-a554-3a9e85f287d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0fd660bd-1d')
Nov 16 10:12:46 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-2bcdd8f5-5b52-4ffe-b864-7ffc87b8fac3 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T10:10:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-716916570',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-716916570',id=8,image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLJjo671Ow+Mmgs0Sg26Qz/3lV+acwH0zhTjdI/jAzpHJeJFVSCAeG6lSBMe0VPCPV8jS6nF17VjHRJ+udtegobTbD+V4E/SBllDlIvaieW2o7QXUoKkfv8rtxZTi+1HzQ==',key_name='tempest-keypair-612763063',keypairs=<?>,launch_index=0,launched_at=2023-11-16T10:11:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='b9317f5645af406c899fcc5df61362bb',ramdisk_id='',reservation_id='r-xpla73zu',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1293058027',owner_user_name='tempest-TaggedAttachmentsTest-1293058027-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T10:11:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8734a61ff9fb4e14b1b542b8ecdfdeec',uuid=0ca61bd2-268e-4c49-ba04-a5cb39143a9b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0fd660bd-1d7b-45d1-8906-d20417082456", "address": "fa:16:3e:86:c2:f1", "network": {"id": "a0932a5f-6790-40ed-a554-3a9e85f287d0", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-35889031", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "b9317f5645af406c899fcc5df61362bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fd660bd-1d", "ovs_interfaceid": "0fd660bd-1d7b-45d1-8906-d20417082456", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=85141) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 10:12:46 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-2bcdd8f5-5b52-4ffe-b864-7ffc87b8fac3 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] Converting VIF {"id": "0fd660bd-1d7b-45d1-8906-d20417082456", "address": "fa:16:3e:86:c2:f1", "network": {"id": "a0932a5f-6790-40ed-a554-3a9e85f287d0", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-35889031", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "b9317f5645af406c899fcc5df61362bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fd660bd-1d", "ovs_interfaceid": "0fd660bd-1d7b-45d1-8906-d20417082456", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:12:46 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-2bcdd8f5-5b52-4ffe-b864-7ffc87b8fac3 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:c2:f1,bridge_name='br-int',has_traffic_filtering=True,id=0fd660bd-1d7b-45d1-8906-d20417082456,network=Network(a0932a5f-6790-40ed-a554-3a9e85f287d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0fd660bd-1d') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:12:46 user nova-compute[85141]: DEBUG nova.virt.libvirt.guest [None req-2bcdd8f5-5b52-4ffe-b864-7ffc87b8fac3 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] attach device xml: <interface type="ethernet">
Nov 16 10:12:46 user nova-compute[85141]:   <mac address="fa:16:3e:86:c2:f1"/>
Nov 16 10:12:46 user nova-compute[85141]:   <model type="virtio"/>
Nov 16 10:12:46 user nova-compute[85141]:   <mtu size="1442"/>
Nov 16 10:12:46 user nova-compute[85141]:   <target dev="tap0fd660bd-1d"/>
Nov 16 10:12:46 user nova-compute[85141]: </interface>
Nov 16 10:12:46 user nova-compute[85141]:  {{(pid=85141) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 10:12:46 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:12:46 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:12:46 user nova-compute[85141]: DEBUG nova.network.neutron [req-8c879899-7b72-4528-b7fa-e467b273e2c4 req-acf051c1-7c73-4d63-a292-c44e84152030 service nova] [instance: 0ca61bd2-268e-4c49-ba04-a5cb39143a9b] Updated VIF entry in instance network info cache for port 0fd660bd-1d7b-45d1-8906-d20417082456. {{(pid=85141) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 10:12:46 user nova-compute[85141]: DEBUG nova.network.neutron [req-8c879899-7b72-4528-b7fa-e467b273e2c4 req-acf051c1-7c73-4d63-a292-c44e84152030 service nova] [instance: 0ca61bd2-268e-4c49-ba04-a5cb39143a9b] Updating instance_info_cache with network_info: [{"id": "56375501-2a9c-4821-8446-31156fc0f231", "address": "fa:16:3e:12:0a:da", "network": {"id": "cd9a5383-79fc-4957-9a8e-30a18ac26969", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1797454995-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9317f5645af406c899fcc5df61362bb", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56375501-2a", "ovs_interfaceid": "56375501-2a9c-4821-8446-31156fc0f231", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0fd660bd-1d7b-45d1-8906-d20417082456", "address": "fa:16:3e:86:c2:f1", "network": {"id": "a0932a5f-6790-40ed-a554-3a9e85f287d0", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-35889031", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "b9317f5645af406c899fcc5df61362bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fd660bd-1d", "ovs_interfaceid": "0fd660bd-1d7b-45d1-8906-d20417082456", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:12:46 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-8c879899-7b72-4528-b7fa-e467b273e2c4 req-acf051c1-7c73-4d63-a292-c44e84152030 service nova] Releasing lock "refresh_cache-0ca61bd2-268e-4c49-ba04-a5cb39143a9b" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:12:46 user nova-compute[85141]: INFO nova.virt.libvirt.driver [-] [instance: 6caf3667-5613-4ef4-a597-1820e6c1c0ac] Instance destroyed successfully.
Nov 16 10:12:46 user nova-compute[85141]: INFO nova.virt.libvirt.driver [-] [instance: 6caf3667-5613-4ef4-a597-1820e6c1c0ac] Instance destroyed successfully.
Nov 16 10:12:46 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-68a55eb0-e7c0-4da6-939c-890e936d1f9c tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T10:10:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1948154362',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1086260035',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPTxuc2pFbo8Kj1fpySyu2hi+5RREMihAI4J3BcHJNw6/EhxEylOLh1w3NMl0ucAMBcFIFr2hryAmkgpSqOT6RfhW0NUWmUq9zKgRAUTsN4Epu8nh4W95o4JP2jn8aOc3w==',key_name='tempest-keypair-731314932',keypairs=<?>,launch_index=0,launched_at=2023-11-16T10:11:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='e017c305665f4a98a75d1d77701b6527',ramdisk_id='',reservation_id='r-4eesetti',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1581977623',owner_user_name='tempest-ServerActionsV293TestJSON-1581977623-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T10:12:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ae4bf3b050ed4cd7901541e9ce1c838f',uuid=6caf3667-5613-4ef4-a597-1820e6c1c0ac,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ad2b755f-6905-4256-be59-b64dae993293", "address": "fa:16:3e:fb:7c:00", "network": {"id": "9b5d58ef-109a-4ccb-90e4-a6b18c02f49c", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1619595955-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.67", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e017c305665f4a98a75d1d77701b6527", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad2b755f-69", "ovs_interfaceid": "ad2b755f-6905-4256-be59-b64dae993293", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 10:12:46 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-68a55eb0-e7c0-4da6-939c-890e936d1f9c tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] Converting VIF {"id": "ad2b755f-6905-4256-be59-b64dae993293", "address": "fa:16:3e:fb:7c:00", "network": {"id": "9b5d58ef-109a-4ccb-90e4-a6b18c02f49c", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1619595955-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.67", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e017c305665f4a98a75d1d77701b6527", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad2b755f-69", "ovs_interfaceid": "ad2b755f-6905-4256-be59-b64dae993293", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:12:46 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-68a55eb0-e7c0-4da6-939c-890e936d1f9c tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fb:7c:00,bridge_name='br-int',has_traffic_filtering=True,id=ad2b755f-6905-4256-be59-b64dae993293,network=Network(9b5d58ef-109a-4ccb-90e4-a6b18c02f49c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad2b755f-69') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:12:46 user nova-compute[85141]: DEBUG os_vif [None req-68a55eb0-e7c0-4da6-939c-890e936d1f9c tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fb:7c:00,bridge_name='br-int',has_traffic_filtering=True,id=ad2b755f-6905-4256-be59-b64dae993293,network=Network(9b5d58ef-109a-4ccb-90e4-a6b18c02f49c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad2b755f-69') {{(pid=85141) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 10:12:46 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:12:46 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapad2b755f-69, bridge=br-int, if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:12:46 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:12:46 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:12:46 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:12:46 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:12:46 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b6d2a92a-36df-4d38-8e10-87a9a6f858ae) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:12:46 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:12:46 user nova-compute[85141]: INFO os_vif [None req-68a55eb0-e7c0-4da6-939c-890e936d1f9c tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fb:7c:00,bridge_name='br-int',has_traffic_filtering=True,id=ad2b755f-6905-4256-be59-b64dae993293,network=Network(9b5d58ef-109a-4ccb-90e4-a6b18c02f49c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad2b755f-69')
Nov 16 10:12:46 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-68a55eb0-e7c0-4da6-939c-890e936d1f9c tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] [instance: 6caf3667-5613-4ef4-a597-1820e6c1c0ac] calling os-brick to detach iSCSI Volume {{(pid=85141) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 10:12:46 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-68a55eb0-e7c0-4da6-939c-890e936d1f9c tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51806b6080>, {'target_iqn': 'iqn.2010-10.org.openstack:42c041ec-fa39-4035-b82b-867caf3565df', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CbSKnRJc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 10:12:46 user nova-compute[85141]: WARNING os_brick.initiator.connectors.base [None req-68a55eb0-e7c0-4da6-939c-890e936d1f9c tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 16 10:12:46 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-68a55eb0-e7c0-4da6-939c-890e936d1f9c tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 10:12:46 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-68a55eb0-e7c0-4da6-939c-890e936d1f9c tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 10:12:46 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-2bcdd8f5-5b52-4ffe-b864-7ffc87b8fac3 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] No BDM found with device name vda, not building metadata. {{(pid=85141) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 10:12:46 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-2bcdd8f5-5b52-4ffe-b864-7ffc87b8fac3 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] No BDM found with device name hda, not building metadata. {{(pid=85141) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 10:12:46 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-2bcdd8f5-5b52-4ffe-b864-7ffc87b8fac3 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] No VIF found with MAC fa:16:3e:12:0a:da, not building metadata {{(pid=85141) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 10:12:46 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:12:46 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:12:46 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[08995e26-dbff-4873-b01b-695532d93a9e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5feab5a7-6ec4-4e13-84bc-bff657a0d0de\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4973f768-f126-41d6-b534-458d6c49f9b3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:27fcde20-e019-4cf0-ad90-6c8100f4a8d2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b4df10d9-a60c-45ed-981d-96f704534fb8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:42c041ec-fa39-4035-b82b-867caf3565df\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:12:46 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-68a55eb0-e7c0-4da6-939c-890e936d1f9c tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 10:12:46 user nova-compute[85141]: No targets found.
Nov 16 10:12:46 user nova-compute[85141]: iSNS:
Nov 16 10:12:46 user nova-compute[85141]: No targets found.
Nov 16 10:12:46 user nova-compute[85141]: STATIC:
Nov 16 10:12:46 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:5feab5a7-6ec4-4e13-84bc-bff657a0d0de
Nov 16 10:12:46 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:12:46 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:12:46 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:4973f768-f126-41d6-b534-458d6c49f9b3
Nov 16 10:12:46 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:12:46 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:12:46 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:27fcde20-e019-4cf0-ad90-6c8100f4a8d2
Nov 16 10:12:46 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:12:46 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:12:46 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:b4df10d9-a60c-45ed-981d-96f704534fb8
Nov 16 10:12:46 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:12:46 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:12:46 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:42c041ec-fa39-4035-b82b-867caf3565df
Nov 16 10:12:46 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:12:46 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:12:46 user nova-compute[85141]: FIRMWARE:
Nov 16 10:12:46 user nova-compute[85141]: No targets found.
Nov 16 10:12:46 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:12:46 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-68a55eb0-e7c0-4da6-939c-890e936d1f9c tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 10:12:46 user nova-compute[85141]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 10:12:46 user nova-compute[85141]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=85141) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 10:12:46 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-68a55eb0-e7c0-4da6-939c-890e936d1f9c tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:42c041ec-fa39-4035-b82b-867caf3565df', 0)] {{(pid=85141) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 10:12:46 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:12:47 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:12:47 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[27fed928-18be-42ad-b429-f56a76658d71]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:27fcde20-e019-4cf0-ad90-6c8100f4a8d2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:42c041ec-fa39-4035-b82b-867caf3565df\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4973f768-f126-41d6-b534-458d6c49f9b3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5feab5a7-6ec4-4e13-84bc-bff657a0d0de\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b4df10d9-a60c-45ed-981d-96f704534fb8\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:12:47 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:12:47 user nova-compute[85141]: DEBUG nova.virt.libvirt.guest [None req-2bcdd8f5-5b52-4ffe-b864-7ffc87b8fac3 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 10:12:47 user nova-compute[85141]:   <nova:package version="0.0.0"/>
Nov 16 10:12:47 user nova-compute[85141]:   <nova:name>tempest-device-tagging-server-716916570</nova:name>
Nov 16 10:12:47 user nova-compute[85141]:   <nova:creationTime>2023-11-16 10:12:47</nova:creationTime>
Nov 16 10:12:47 user nova-compute[85141]:   <nova:flavor name="m1.tiny">
Nov 16 10:12:47 user nova-compute[85141]:     <nova:memory>512</nova:memory>
Nov 16 10:12:47 user nova-compute[85141]:     <nova:disk>1</nova:disk>
Nov 16 10:12:47 user nova-compute[85141]:     <nova:swap>0</nova:swap>
Nov 16 10:12:47 user nova-compute[85141]:     <nova:ephemeral>0</nova:ephemeral>
Nov 16 10:12:47 user nova-compute[85141]:     <nova:vcpus>1</nova:vcpus>
Nov 16 10:12:47 user nova-compute[85141]:   </nova:flavor>
Nov 16 10:12:47 user nova-compute[85141]:   <nova:owner>
Nov 16 10:12:47 user nova-compute[85141]:     <nova:user uuid="8734a61ff9fb4e14b1b542b8ecdfdeec">tempest-TaggedAttachmentsTest-1293058027-project-member</nova:user>
Nov 16 10:12:47 user nova-compute[85141]:     <nova:project uuid="b9317f5645af406c899fcc5df61362bb">tempest-TaggedAttachmentsTest-1293058027</nova:project>
Nov 16 10:12:47 user nova-compute[85141]:   </nova:owner>
Nov 16 10:12:47 user nova-compute[85141]:   <nova:root type="image" uuid="bc4ca70f-a459-4d5c-a9e6-80f1948eb48b"/>
Nov 16 10:12:47 user nova-compute[85141]:   <nova:ports>
Nov 16 10:12:47 user nova-compute[85141]:     <nova:port uuid="56375501-2a9c-4821-8446-31156fc0f231">
Nov 16 10:12:47 user nova-compute[85141]:       <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 16 10:12:47 user nova-compute[85141]:     </nova:port>
Nov 16 10:12:47 user nova-compute[85141]:     <nova:port uuid="0fd660bd-1d7b-45d1-8906-d20417082456">
Nov 16 10:12:47 user nova-compute[85141]:       <nova:ip type="fixed" address="10.10.10.69" ipVersion="4"/>
Nov 16 10:12:47 user nova-compute[85141]:     </nova:port>
Nov 16 10:12:47 user nova-compute[85141]:   </nova:ports>
Nov 16 10:12:47 user nova-compute[85141]: </nova:instance>
Nov 16 10:12:47 user nova-compute[85141]:  {{(pid=85141) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 16 10:12:47 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:12:47 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:12:47 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:12:47 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:12:47 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7322619-3e2a-4458-8860-9f463417a17c]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42c041ec-fa39-4035-b82b-867caf3565df (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4df10d9-a60c-45ed-981d-96f704534fb8 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4973f768-f126-41d6-b534-458d6c49f9b3 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fcde20-e019-4cf0-ad90-6c8100f4a8d2 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5feab5a7-6ec4-4e13-84bc-bff657a0d0de (non-flash)\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:12:47 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-68a55eb0-e7c0-4da6-939c-890e936d1f9c tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42c041ec-fa39-4035-b82b-867caf3565df (non-flash)
Nov 16 10:12:47 user nova-compute[85141]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4df10d9-a60c-45ed-981d-96f704534fb8 (non-flash)
Nov 16 10:12:47 user nova-compute[85141]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4973f768-f126-41d6-b534-458d6c49f9b3 (non-flash)
Nov 16 10:12:47 user nova-compute[85141]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fcde20-e019-4cf0-ad90-6c8100f4a8d2 (non-flash)
Nov 16 10:12:47 user nova-compute[85141]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5feab5a7-6ec4-4e13-84bc-bff657a0d0de (non-flash)
Nov 16 10:12:47 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:12:47 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-68a55eb0-e7c0-4da6-939c-890e936d1f9c tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42c041ec-fa39-4035-b82b-867caf3565df (non-flash)
Nov 16 10:12:47 user nova-compute[85141]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4df10d9-a60c-45ed-981d-96f704534fb8 (non-flash)
Nov 16 10:12:47 user nova-compute[85141]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4973f768-f126-41d6-b534-458d6c49f9b3 (non-flash)
Nov 16 10:12:47 user nova-compute[85141]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fcde20-e019-4cf0-ad90-6c8100f4a8d2 (non-flash)
Nov 16 10:12:47 user nova-compute[85141]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5feab5a7-6ec4-4e13-84bc-bff657a0d0de (non-flash)
Nov 16 10:12:47 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 10:12:47 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-68a55eb0-e7c0-4da6-939c-890e936d1f9c tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f51a0a5d750>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:42c041ec-fa39-4035-b82b-867caf3565df'): ({'sdb'}, set())}) {{(pid=85141) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 10:12:47 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-68a55eb0-e7c0-4da6-939c-890e936d1f9c tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] Removing single pathed devices sdb {{(pid=85141) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 10:12:47 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:12:47 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-2bcdd8f5-5b52-4ffe-b864-7ffc87b8fac3 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] Lock "interface-0ca61bd2-268e-4c49-ba04-a5cb39143a9b-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 3.323s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:12:47 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:12:47 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5f39a62-cf5f-4cec-9ee4-972c09936a86]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:12:47 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:12:47 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:12:47 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:12:47 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:12:47 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fac56aa-0907-4670-92c0-4bf47235a99d]: (4, ('ok\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:12:47 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-68a55eb0-e7c0-4da6-939c-890e936d1f9c tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] Flushing IO for device /dev/sdb {{(pid=85141) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 10:12:47 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:12:47 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:12:47 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2a39a38-eccc-4ab8-9e72-41deb661e290]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:12:47 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-68a55eb0-e7c0-4da6-939c-890e936d1f9c tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=85141) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 10:12:47 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:12:47 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.036s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:12:47 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[98d19b20-4792-43d7-873b-7df26640b007]: (4, ('1', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:12:47 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-68a55eb0-e7c0-4da6-939c-890e936d1f9c tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=85141) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 10:12:47 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-68a55eb0-e7c0-4da6-939c-890e936d1f9c tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] SCSI volumes sdb have been removed. {{(pid=85141) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 10:12:47 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-68a55eb0-e7c0-4da6-939c-890e936d1f9c tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:42c041ec-fa39-4035-b82b-867caf3565df')] {{(pid=85141) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 10:12:47 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42c041ec-fa39-4035-b82b-867caf3565df -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:12:47 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42c041ec-fa39-4035-b82b-867caf3565df -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:12:47 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[270db726-d556-4de2-899d-3a22ea385d9d]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:12:47 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-68a55eb0-e7c0-4da6-939c-890e936d1f9c tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:12:47 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42c041ec-fa39-4035-b82b-867caf3565df -p 172.16.0.220:3260 --logout {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:12:47 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42c041ec-fa39-4035-b82b-867caf3565df -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:12:47 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[d085f1c7-b296-4137-bdfb-933710975596]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:42c041ec-fa39-4035-b82b-867caf3565df, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:42c041ec-fa39-4035-b82b-867caf3565df, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:12:47 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-68a55eb0-e7c0-4da6-939c-890e936d1f9c tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:42c041ec-fa39-4035-b82b-867caf3565df, portal: 172.16.0.220,3260]
Nov 16 10:12:47 user nova-compute[85141]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:42c041ec-fa39-4035-b82b-867caf3565df, portal: 172.16.0.220,3260] successful.
Nov 16 10:12:47 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:12:47 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42c041ec-fa39-4035-b82b-867caf3565df -p 172.16.0.220:3260 --op delete {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:12:47 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42c041ec-fa39-4035-b82b-867caf3565df -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:12:47 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a6bf3d8-dbd5-44ee-8f39-b96a54fe87f3]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:12:47 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-68a55eb0-e7c0-4da6-939c-890e936d1f9c tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:12:47 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-68a55eb0-e7c0-4da6-939c-890e936d1f9c tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.326s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 10:12:47 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-68a55eb0-e7c0-4da6-939c-890e936d1f9c tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] <== disconnect_volume: return (327ms) None {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 10:12:47 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-68a55eb0-e7c0-4da6-939c-890e936d1f9c tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] [instance: 6caf3667-5613-4ef4-a597-1820e6c1c0ac] Disconnected iSCSI Volume {{(pid=85141) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 10:12:47 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-68a55eb0-e7c0-4da6-939c-890e936d1f9c tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] [instance: 6caf3667-5613-4ef4-a597-1820e6c1c0ac] Deleting instance files /opt/stack/data/nova/instances/6caf3667-5613-4ef4-a597-1820e6c1c0ac_del
Nov 16 10:12:47 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-68a55eb0-e7c0-4da6-939c-890e936d1f9c tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] [instance: 6caf3667-5613-4ef4-a597-1820e6c1c0ac] Deletion of /opt/stack/data/nova/instances/6caf3667-5613-4ef4-a597-1820e6c1c0ac_del complete
Nov 16 10:12:47 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-f66d16a1-c7ae-4f7c-96fd-20965aa64265 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] Acquiring lock "0ca61bd2-268e-4c49-ba04-a5cb39143a9b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:12:47 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-f66d16a1-c7ae-4f7c-96fd-20965aa64265 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] Lock "0ca61bd2-268e-4c49-ba04-a5cb39143a9b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:12:47 user nova-compute[85141]: DEBUG nova.objects.instance [None req-f66d16a1-c7ae-4f7c-96fd-20965aa64265 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] Lazy-loading 'flavor' on Instance uuid 0ca61bd2-268e-4c49-ba04-a5cb39143a9b {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:12:47 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-f66d16a1-c7ae-4f7c-96fd-20965aa64265 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] Lock "0ca61bd2-268e-4c49-ba04-a5cb39143a9b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.078s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:12:47 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-68a55eb0-e7c0-4da6-939c-890e936d1f9c tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] [instance: 6caf3667-5613-4ef4-a597-1820e6c1c0ac] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance 6caf3667-5613-4ef4-a597-1820e6c1c0ac could not be found.
Nov 16 10:12:47 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-68a55eb0-e7c0-4da6-939c-890e936d1f9c tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] [instance: 6caf3667-5613-4ef4-a597-1820e6c1c0ac] calling os-brick to detach iSCSI Volume {{(pid=85141) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 10:12:47 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-68a55eb0-e7c0-4da6-939c-890e936d1f9c tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51806b6080>, {'target_iqn': 'iqn.2010-10.org.openstack:42c041ec-fa39-4035-b82b-867caf3565df', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CbSKnRJc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 10:12:47 user nova-compute[85141]: WARNING os_brick.initiator.connectors.base [None req-68a55eb0-e7c0-4da6-939c-890e936d1f9c tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 16 10:12:47 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-68a55eb0-e7c0-4da6-939c-890e936d1f9c tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 10:12:47 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-68a55eb0-e7c0-4da6-939c-890e936d1f9c tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 10:12:47 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:12:47 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:12:47 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d7a053e-ee2d-40c4-8723-2af40af6cfc8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5feab5a7-6ec4-4e13-84bc-bff657a0d0de\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4973f768-f126-41d6-b534-458d6c49f9b3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:27fcde20-e019-4cf0-ad90-6c8100f4a8d2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b4df10d9-a60c-45ed-981d-96f704534fb8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:12:47 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-68a55eb0-e7c0-4da6-939c-890e936d1f9c tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 10:12:47 user nova-compute[85141]: No targets found.
Nov 16 10:12:47 user nova-compute[85141]: iSNS:
Nov 16 10:12:47 user nova-compute[85141]: No targets found.
Nov 16 10:12:47 user nova-compute[85141]: STATIC:
Nov 16 10:12:47 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:5feab5a7-6ec4-4e13-84bc-bff657a0d0de
Nov 16 10:12:47 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:12:47 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:12:47 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:4973f768-f126-41d6-b534-458d6c49f9b3
Nov 16 10:12:47 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:12:47 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:12:47 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:27fcde20-e019-4cf0-ad90-6c8100f4a8d2
Nov 16 10:12:47 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:12:47 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:12:47 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:b4df10d9-a60c-45ed-981d-96f704534fb8
Nov 16 10:12:47 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:12:47 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:12:47 user nova-compute[85141]: FIRMWARE:
Nov 16 10:12:47 user nova-compute[85141]: No targets found.
Nov 16 10:12:47 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:12:47 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-68a55eb0-e7c0-4da6-939c-890e936d1f9c tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 10:12:47 user nova-compute[85141]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 10:12:47 user nova-compute[85141]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=85141) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 10:12:47 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-68a55eb0-e7c0-4da6-939c-890e936d1f9c tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:42c041ec-fa39-4035-b82b-867caf3565df', 0)] {{(pid=85141) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 10:12:47 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:12:47 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:12:47 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[e708d74c-1503-42dc-96e4-f1879f3d0c16]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:27fcde20-e019-4cf0-ad90-6c8100f4a8d2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4973f768-f126-41d6-b534-458d6c49f9b3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5feab5a7-6ec4-4e13-84bc-bff657a0d0de\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b4df10d9-a60c-45ed-981d-96f704534fb8\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:12:47 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:12:47 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:12:47 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[74cf2777-7a14-434f-a825-b61f620cee18]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4df10d9-a60c-45ed-981d-96f704534fb8 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4973f768-f126-41d6-b534-458d6c49f9b3 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fcde20-e019-4cf0-ad90-6c8100f4a8d2 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5feab5a7-6ec4-4e13-84bc-bff657a0d0de (non-flash)\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:12:47 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-68a55eb0-e7c0-4da6-939c-890e936d1f9c tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4df10d9-a60c-45ed-981d-96f704534fb8 (non-flash)
Nov 16 10:12:47 user nova-compute[85141]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4973f768-f126-41d6-b534-458d6c49f9b3 (non-flash)
Nov 16 10:12:47 user nova-compute[85141]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fcde20-e019-4cf0-ad90-6c8100f4a8d2 (non-flash)
Nov 16 10:12:47 user nova-compute[85141]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5feab5a7-6ec4-4e13-84bc-bff657a0d0de (non-flash)
Nov 16 10:12:47 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:12:47 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-68a55eb0-e7c0-4da6-939c-890e936d1f9c tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4df10d9-a60c-45ed-981d-96f704534fb8 (non-flash)
Nov 16 10:12:47 user nova-compute[85141]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4973f768-f126-41d6-b534-458d6c49f9b3 (non-flash)
Nov 16 10:12:47 user nova-compute[85141]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fcde20-e019-4cf0-ad90-6c8100f4a8d2 (non-flash)
Nov 16 10:12:47 user nova-compute[85141]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5feab5a7-6ec4-4e13-84bc-bff657a0d0de (non-flash)
Nov 16 10:12:47 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 10:12:47 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-68a55eb0-e7c0-4da6-939c-890e936d1f9c tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5180691630>, {}) {{(pid=85141) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 10:12:47 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-68a55eb0-e7c0-4da6-939c-890e936d1f9c tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] Disconnecting from: [] {{(pid=85141) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 10:12:47 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-68a55eb0-e7c0-4da6-939c-890e936d1f9c tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.076s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 10:12:47 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-68a55eb0-e7c0-4da6-939c-890e936d1f9c tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] <== disconnect_volume: return (77ms) None {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 10:12:47 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-68a55eb0-e7c0-4da6-939c-890e936d1f9c tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] [instance: 6caf3667-5613-4ef4-a597-1820e6c1c0ac] Disconnected iSCSI Volume {{(pid=85141) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 10:12:47 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-f66d16a1-c7ae-4f7c-96fd-20965aa64265 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] Acquiring lock "0ca61bd2-268e-4c49-ba04-a5cb39143a9b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:12:47 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-f66d16a1-c7ae-4f7c-96fd-20965aa64265 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] Lock "0ca61bd2-268e-4c49-ba04-a5cb39143a9b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:12:47 user nova-compute[85141]: INFO nova.compute.manager [None req-f66d16a1-c7ae-4f7c-96fd-20965aa64265 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] [instance: 0ca61bd2-268e-4c49-ba04-a5cb39143a9b] Attaching volume eff563f0-92d3-47a1-addc-e3eaa6828d59 to /dev/vdb
Nov 16 10:12:48 user nova-compute[85141]: DEBUG nova.compute.manager [req-8c3383c3-4452-4a47-9a90-b34a1e2a6b6b req-e8d2bc59-437e-48c8-b922-31ca0dc0b36e service nova] [instance: 6caf3667-5613-4ef4-a597-1820e6c1c0ac] Received event network-vif-plugged-ad2b755f-6905-4256-be59-b64dae993293 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:12:48 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-8c3383c3-4452-4a47-9a90-b34a1e2a6b6b req-e8d2bc59-437e-48c8-b922-31ca0dc0b36e service nova] Acquiring lock "6caf3667-5613-4ef4-a597-1820e6c1c0ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:12:48 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-8c3383c3-4452-4a47-9a90-b34a1e2a6b6b req-e8d2bc59-437e-48c8-b922-31ca0dc0b36e service nova] Lock "6caf3667-5613-4ef4-a597-1820e6c1c0ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:12:48 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-8c3383c3-4452-4a47-9a90-b34a1e2a6b6b req-e8d2bc59-437e-48c8-b922-31ca0dc0b36e service nova] Lock "6caf3667-5613-4ef4-a597-1820e6c1c0ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:12:48 user nova-compute[85141]: DEBUG nova.compute.manager [req-8c3383c3-4452-4a47-9a90-b34a1e2a6b6b req-e8d2bc59-437e-48c8-b922-31ca0dc0b36e service nova] [instance: 6caf3667-5613-4ef4-a597-1820e6c1c0ac] No waiting events found dispatching network-vif-plugged-ad2b755f-6905-4256-be59-b64dae993293 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:12:48 user nova-compute[85141]: WARNING nova.compute.manager [req-8c3383c3-4452-4a47-9a90-b34a1e2a6b6b req-e8d2bc59-437e-48c8-b922-31ca0dc0b36e service nova] [instance: 6caf3667-5613-4ef4-a597-1820e6c1c0ac] Received unexpected event network-vif-plugged-ad2b755f-6905-4256-be59-b64dae993293 for instance with vm_state active and task_state rebuilding.
Nov 16 10:12:48 user nova-compute[85141]: DEBUG nova.compute.manager [req-8c3383c3-4452-4a47-9a90-b34a1e2a6b6b req-e8d2bc59-437e-48c8-b922-31ca0dc0b36e service nova] [instance: 0ca61bd2-268e-4c49-ba04-a5cb39143a9b] Received event network-vif-plugged-0fd660bd-1d7b-45d1-8906-d20417082456 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:12:48 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-8c3383c3-4452-4a47-9a90-b34a1e2a6b6b req-e8d2bc59-437e-48c8-b922-31ca0dc0b36e service nova] Acquiring lock "0ca61bd2-268e-4c49-ba04-a5cb39143a9b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:12:48 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-8c3383c3-4452-4a47-9a90-b34a1e2a6b6b req-e8d2bc59-437e-48c8-b922-31ca0dc0b36e service nova] Lock "0ca61bd2-268e-4c49-ba04-a5cb39143a9b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:12:48 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-8c3383c3-4452-4a47-9a90-b34a1e2a6b6b req-e8d2bc59-437e-48c8-b922-31ca0dc0b36e service nova] Lock "0ca61bd2-268e-4c49-ba04-a5cb39143a9b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:12:48 user nova-compute[85141]: DEBUG nova.compute.manager [req-8c3383c3-4452-4a47-9a90-b34a1e2a6b6b req-e8d2bc59-437e-48c8-b922-31ca0dc0b36e service nova] [instance: 0ca61bd2-268e-4c49-ba04-a5cb39143a9b] No waiting events found dispatching network-vif-plugged-0fd660bd-1d7b-45d1-8906-d20417082456 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:12:48 user nova-compute[85141]: WARNING nova.compute.manager [req-8c3383c3-4452-4a47-9a90-b34a1e2a6b6b req-e8d2bc59-437e-48c8-b922-31ca0dc0b36e service nova] [instance: 0ca61bd2-268e-4c49-ba04-a5cb39143a9b] Received unexpected event network-vif-plugged-0fd660bd-1d7b-45d1-8906-d20417082456 for instance with vm_state active and task_state None.
Nov 16 10:12:48 user nova-compute[85141]: DEBUG nova.compute.manager [req-8c3383c3-4452-4a47-9a90-b34a1e2a6b6b req-e8d2bc59-437e-48c8-b922-31ca0dc0b36e service nova] [instance: 0ca61bd2-268e-4c49-ba04-a5cb39143a9b] Received event network-vif-plugged-0fd660bd-1d7b-45d1-8906-d20417082456 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:12:48 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-8c3383c3-4452-4a47-9a90-b34a1e2a6b6b req-e8d2bc59-437e-48c8-b922-31ca0dc0b36e service nova] Acquiring lock "0ca61bd2-268e-4c49-ba04-a5cb39143a9b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:12:48 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-8c3383c3-4452-4a47-9a90-b34a1e2a6b6b req-e8d2bc59-437e-48c8-b922-31ca0dc0b36e service nova] Lock "0ca61bd2-268e-4c49-ba04-a5cb39143a9b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:12:48 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-8c3383c3-4452-4a47-9a90-b34a1e2a6b6b req-e8d2bc59-437e-48c8-b922-31ca0dc0b36e service nova] Lock "0ca61bd2-268e-4c49-ba04-a5cb39143a9b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:12:48 user nova-compute[85141]: DEBUG nova.compute.manager [req-8c3383c3-4452-4a47-9a90-b34a1e2a6b6b req-e8d2bc59-437e-48c8-b922-31ca0dc0b36e service nova] [instance: 0ca61bd2-268e-4c49-ba04-a5cb39143a9b] No waiting events found dispatching network-vif-plugged-0fd660bd-1d7b-45d1-8906-d20417082456 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:12:48 user nova-compute[85141]: WARNING nova.compute.manager [req-8c3383c3-4452-4a47-9a90-b34a1e2a6b6b req-e8d2bc59-437e-48c8-b922-31ca0dc0b36e service nova] [instance: 0ca61bd2-268e-4c49-ba04-a5cb39143a9b] Received unexpected event network-vif-plugged-0fd660bd-1d7b-45d1-8906-d20417082456 for instance with vm_state active and task_state None.
Nov 16 10:12:48 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-154e52c8-22a7-45c8-a26b-4fe6cd419a0c tempest-TestVolumeSwap-1428287604 tempest-TestVolumeSwap-1428287604-project-member] [instance: ad1ace46-2e8e-42e1-a0f5-2384078fcf09] Calling os-brick to attach iSCSI Volume {{(pid=85141) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 10:12:48 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-154e52c8-22a7-45c8-a26b-4fe6cd419a0c tempest-TestVolumeSwap-1428287604 tempest-TestVolumeSwap-1428287604-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51806b6080>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7e233047-dda3-4f2e-803c-7b69a57ac656', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UtNLBDJC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 10:12:48 user nova-compute[85141]: WARNING os_brick.initiator.connectors.base [None req-154e52c8-22a7-45c8-a26b-4fe6cd419a0c tempest-TestVolumeSwap-1428287604 tempest-TestVolumeSwap-1428287604-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 10:12:48 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-154e52c8-22a7-45c8-a26b-4fe6cd419a0c tempest-TestVolumeSwap-1428287604 tempest-TestVolumeSwap-1428287604-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 10:12:48 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-154e52c8-22a7-45c8-a26b-4fe6cd419a0c tempest-TestVolumeSwap-1428287604 tempest-TestVolumeSwap-1428287604-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 10:12:48 user nova-compute[85141]: WARNING os_brick.initiator.connectors.base [None req-154e52c8-22a7-45c8-a26b-4fe6cd419a0c tempest-TestVolumeSwap-1428287604 tempest-TestVolumeSwap-1428287604-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 10:12:48 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-154e52c8-22a7-45c8-a26b-4fe6cd419a0c tempest-TestVolumeSwap-1428287604 tempest-TestVolumeSwap-1428287604-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7e233047-dda3-4f2e-803c-7b69a57ac656" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 10:12:48 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-154e52c8-22a7-45c8-a26b-4fe6cd419a0c tempest-TestVolumeSwap-1428287604 tempest-TestVolumeSwap-1428287604-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7e233047-dda3-4f2e-803c-7b69a57ac656" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 10:12:48 user nova-compute[85141]: INFO os_brick.initiator.connectors.iscsi [None req-154e52c8-22a7-45c8-a26b-4fe6cd419a0c tempest-TestVolumeSwap-1428287604 tempest-TestVolumeSwap-1428287604-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 10:12:48 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e233047-dda3-4f2e-803c-7b69a57ac656 -p 172.16.0.220:3260 {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:12:48 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e233047-dda3-4f2e-803c-7b69a57ac656 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:12:48 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[a225bf96-01f9-4168-9af8-d8df8e658922]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:12:48 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-154e52c8-22a7-45c8-a26b-4fe6cd419a0c tempest-TestVolumeSwap-1428287604 tempest-TestVolumeSwap-1428287604-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 10:12:48 user nova-compute[85141]:  {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:12:48 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e233047-dda3-4f2e-803c-7b69a57ac656 -p 172.16.0.220:3260 --interface default --op new {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:12:48 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e233047-dda3-4f2e-803c-7b69a57ac656 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:12:48 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc978802-02c5-4a7e-9497-a3ef2a5f01c3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7e233047-dda3-4f2e-803c-7b69a57ac656] added\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:12:48 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-154e52c8-22a7-45c8-a26b-4fe6cd419a0c tempest-TestVolumeSwap-1428287604 tempest-TestVolumeSwap-1428287604-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7e233047-dda3-4f2e-803c-7b69a57ac656] added
Nov 16 10:12:48 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:12:48 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e233047-dda3-4f2e-803c-7b69a57ac656 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:12:48 user nova-compute[85141]: DEBUG os_brick.utils [None req-f66d16a1-c7ae-4f7c-96fd-20965aa64265 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 10:12:48 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:12:48 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:12:48 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c62c887-f8fd-40ae-bc6e-6facd2a820a5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c7834de5c295\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:12:48 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e233047-dda3-4f2e-803c-7b69a57ac656 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:12:48 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[d475fcac-bbd5-4e2c-b1d8-609ba2d226fb]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:12:48 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-154e52c8-22a7-45c8-a26b-4fe6cd419a0c tempest-TestVolumeSwap-1428287604 tempest-TestVolumeSwap-1428287604-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:12:48 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:12:48 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e233047-dda3-4f2e-803c-7b69a57ac656 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:12:48 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:12:48 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bb3a370-0491-4c3a-891e-680ebc09476d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:12:48 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:12:48 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e233047-dda3-4f2e-803c-7b69a57ac656 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:12:48 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[00b2d4a0-313e-4132-b5d9-9f46e1f1e79d]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:12:48 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-154e52c8-22a7-45c8-a26b-4fe6cd419a0c tempest-TestVolumeSwap-1428287604 tempest-TestVolumeSwap-1428287604-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:12:48 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e233047-dda3-4f2e-803c-7b69a57ac656 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UtNLBDJC {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:12:48 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:12:48 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d5229fb-85b4-4aa0-a3e9-307edbc24198]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:12:48 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[72298daf-3e49-4a3c-bc44-119cf1f8690f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:12:48 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-f66d16a1-c7ae-4f7c-96fd-20965aa64265 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] Running cmd (subprocess): nvme version {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:12:48 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-f66d16a1-c7ae-4f7c-96fd-20965aa64265 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] 'nvme version' failed. Not Retrying. {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 10:12:48 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e233047-dda3-4f2e-803c-7b69a57ac656 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UtNLBDJC" returned: 0 in 0.017s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:12:48 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[b11e17ca-ed4b-4c2b-8b4d-31fd523b02cd]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:12:48 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f66d16a1-c7ae-4f7c-96fd-20965aa64265 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] nvme not present on system {{(pid=85141) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 10:12:48 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-154e52c8-22a7-45c8-a26b-4fe6cd419a0c tempest-TestVolumeSwap-1428287604 tempest-TestVolumeSwap-1428287604-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UtNLBDJC'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:12:48 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:12:48 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e233047-dda3-4f2e-803c-7b69a57ac656 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:12:48 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 10:12:48 user nova-compute[85141]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 10:12:48 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[265bb5ab-70f7-46ce-9d1c-d93751479609]: (4, '') {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:12:48 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.lightos [None req-f66d16a1-c7ae-4f7c-96fd-20965aa64265 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=85141) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 10:12:48 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.lightos [None req-f66d16a1-c7ae-4f7c-96fd-20965aa64265 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=85141) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 10:12:48 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.lightos [None req-f66d16a1-c7ae-4f7c-96fd-20965aa64265 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] LIGHTOS: no hostnqn found. {{(pid=85141) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 10:12:48 user nova-compute[85141]: DEBUG os_brick.utils [None req-f66d16a1-c7ae-4f7c-96fd-20965aa64265 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c7834de5c295', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 10:12:48 user nova-compute[85141]: DEBUG nova.virt.block_device [None req-f66d16a1-c7ae-4f7c-96fd-20965aa64265 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] [instance: 0ca61bd2-268e-4c49-ba04-a5cb39143a9b] Updating existing volume attachment record: 78402ea6-cf6d-43ef-93ed-b80bcb8ecf9d {{(pid=85141) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 10:12:48 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e233047-dda3-4f2e-803c-7b69a57ac656 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:12:48 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c179ecc-1a44-4f32-86e9-2dc7782325f4]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:12:48 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-154e52c8-22a7-45c8-a26b-4fe6cd419a0c tempest-TestVolumeSwap-1428287604 tempest-TestVolumeSwap-1428287604-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:12:48 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:12:48 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:12:48 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bfa012f-baeb-4a21-80ec-09f4e6088fd9]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4df10d9-a60c-45ed-981d-96f704534fb8 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4973f768-f126-41d6-b534-458d6c49f9b3 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fcde20-e019-4cf0-ad90-6c8100f4a8d2 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5feab5a7-6ec4-4e13-84bc-bff657a0d0de (non-flash)\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:12:48 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-154e52c8-22a7-45c8-a26b-4fe6cd419a0c tempest-TestVolumeSwap-1428287604 tempest-TestVolumeSwap-1428287604-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4df10d9-a60c-45ed-981d-96f704534fb8 (non-flash)
Nov 16 10:12:48 user nova-compute[85141]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4973f768-f126-41d6-b534-458d6c49f9b3 (non-flash)
Nov 16 10:12:48 user nova-compute[85141]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fcde20-e019-4cf0-ad90-6c8100f4a8d2 (non-flash)
Nov 16 10:12:48 user nova-compute[85141]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5feab5a7-6ec4-4e13-84bc-bff657a0d0de (non-flash)
Nov 16 10:12:48 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:12:48 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-154e52c8-22a7-45c8-a26b-4fe6cd419a0c tempest-TestVolumeSwap-1428287604 tempest-TestVolumeSwap-1428287604-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4df10d9-a60c-45ed-981d-96f704534fb8 (non-flash)
Nov 16 10:12:48 user nova-compute[85141]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4973f768-f126-41d6-b534-458d6c49f9b3 (non-flash)
Nov 16 10:12:48 user nova-compute[85141]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fcde20-e019-4cf0-ad90-6c8100f4a8d2 (non-flash)
Nov 16 10:12:48 user nova-compute[85141]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5feab5a7-6ec4-4e13-84bc-bff657a0d0de (non-flash)
Nov 16 10:12:48 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 10:12:48 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e233047-dda3-4f2e-803c-7b69a57ac656 -p 172.16.0.220:3260 --login {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:12:48 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e233047-dda3-4f2e-803c-7b69a57ac656 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:12:48 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[305be891-8032-4d59-88e4-d4ba3b5b2add]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7e233047-dda3-4f2e-803c-7b69a57ac656, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7e233047-dda3-4f2e-803c-7b69a57ac656, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:12:48 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-154e52c8-22a7-45c8-a26b-4fe6cd419a0c tempest-TestVolumeSwap-1428287604 tempest-TestVolumeSwap-1428287604-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7e233047-dda3-4f2e-803c-7b69a57ac656, portal: 172.16.0.220,3260]
Nov 16 10:12:48 user nova-compute[85141]: Login to [iface: default, target: iqn.2010-10.org.openstack:7e233047-dda3-4f2e-803c-7b69a57ac656, portal: 172.16.0.220,3260] successful.
Nov 16 10:12:48 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:12:48 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e233047-dda3-4f2e-803c-7b69a57ac656 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:12:48 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e233047-dda3-4f2e-803c-7b69a57ac656 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:12:48 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9d736ab-8317-47d1-8eaf-b63b87afb1a2]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:12:48 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-154e52c8-22a7-45c8-a26b-4fe6cd419a0c tempest-TestVolumeSwap-1428287604 tempest-TestVolumeSwap-1428287604-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:12:48 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:12:48 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:12:48 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[663a0e8d-7f5d-493f-9fb0-82d78eea0093]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4df10d9-a60c-45ed-981d-96f704534fb8 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4973f768-f126-41d6-b534-458d6c49f9b3 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fcde20-e019-4cf0-ad90-6c8100f4a8d2 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5feab5a7-6ec4-4e13-84bc-bff657a0d0de (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e233047-dda3-4f2e-803c-7b69a57ac656 (non-flash)\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:12:48 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-154e52c8-22a7-45c8-a26b-4fe6cd419a0c tempest-TestVolumeSwap-1428287604 tempest-TestVolumeSwap-1428287604-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4df10d9-a60c-45ed-981d-96f704534fb8 (non-flash)
Nov 16 10:12:48 user nova-compute[85141]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4973f768-f126-41d6-b534-458d6c49f9b3 (non-flash)
Nov 16 10:12:48 user nova-compute[85141]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fcde20-e019-4cf0-ad90-6c8100f4a8d2 (non-flash)
Nov 16 10:12:48 user nova-compute[85141]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5feab5a7-6ec4-4e13-84bc-bff657a0d0de (non-flash)
Nov 16 10:12:48 user nova-compute[85141]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e233047-dda3-4f2e-803c-7b69a57ac656 (non-flash)
Nov 16 10:12:48 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:12:48 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-154e52c8-22a7-45c8-a26b-4fe6cd419a0c tempest-TestVolumeSwap-1428287604 tempest-TestVolumeSwap-1428287604-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4df10d9-a60c-45ed-981d-96f704534fb8 (non-flash)
Nov 16 10:12:48 user nova-compute[85141]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4973f768-f126-41d6-b534-458d6c49f9b3 (non-flash)
Nov 16 10:12:48 user nova-compute[85141]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fcde20-e019-4cf0-ad90-6c8100f4a8d2 (non-flash)
Nov 16 10:12:48 user nova-compute[85141]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5feab5a7-6ec4-4e13-84bc-bff657a0d0de (non-flash)
Nov 16 10:12:48 user nova-compute[85141]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e233047-dda3-4f2e-803c-7b69a57ac656 (non-flash)
Nov 16 10:12:48 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 10:12:48 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-154e52c8-22a7-45c8-a26b-4fe6cd419a0c tempest-TestVolumeSwap-1428287604 tempest-TestVolumeSwap-1428287604-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7e233047-dda3-4f2e-803c-7b69a57ac656" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.344s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 10:12:48 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-154e52c8-22a7-45c8-a26b-4fe6cd419a0c tempest-TestVolumeSwap-1428287604 tempest-TestVolumeSwap-1428287604-project-member] Connected to 172.16.0.220:3260 {{(pid=85141) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 10:12:48 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-154e52c8-22a7-45c8-a26b-4fe6cd419a0c tempest-TestVolumeSwap-1428287604 tempest-TestVolumeSwap-1428287604-project-member] HCTL ('33', '-', '-', 0) found on session 8 with lun 0 {{(pid=85141) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 10:12:48 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-154e52c8-22a7-45c8-a26b-4fe6cd419a0c tempest-TestVolumeSwap-1428287604 tempest-TestVolumeSwap-1428287604-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=85141) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 10:12:48 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:12:48 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:12:48 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[faf593b6-20f4-4d75-bfe4-d4dffb5f9b84]: (4, ('- - 0', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:12:48 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-154e52c8-22a7-45c8-a26b-4fe6cd419a0c tempest-TestVolumeSwap-1428287604 tempest-TestVolumeSwap-1428287604-project-member] Searching for a device in session 8 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=85141) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 10:12:48 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-154e52c8-22a7-45c8-a26b-4fe6cd419a0c tempest-TestVolumeSwap-1428287604 tempest-TestVolumeSwap-1428287604-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:7e233047-dda3-4f2e-803c-7b69a57ac656', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UtNLBDJC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=85141) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 10:12:48 user nova-compute[85141]: DEBUG nova.compute.manager [None req-68a55eb0-e7c0-4da6-939c-890e936d1f9c tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] [instance: 6caf3667-5613-4ef4-a597-1820e6c1c0ac] Preparing to wait for external event volume-reimaged-42c041ec-fa39-4035-b82b-867caf3565df {{(pid=85141) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Nov 16 10:12:48 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-68a55eb0-e7c0-4da6-939c-890e936d1f9c tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] Acquiring lock "6caf3667-5613-4ef4-a597-1820e6c1c0ac-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:12:48 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-68a55eb0-e7c0-4da6-939c-890e936d1f9c tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] Lock "6caf3667-5613-4ef4-a597-1820e6c1c0ac-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:12:48 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-68a55eb0-e7c0-4da6-939c-890e936d1f9c tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] Lock "6caf3667-5613-4ef4-a597-1820e6c1c0ac-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:12:49 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-154e52c8-22a7-45c8-a26b-4fe6cd419a0c tempest-TestVolumeSwap-1428287604 tempest-TestVolumeSwap-1428287604-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.377s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 10:12:49 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-154e52c8-22a7-45c8-a26b-4fe6cd419a0c tempest-TestVolumeSwap-1428287604 tempest-TestVolumeSwap-1428287604-project-member] <== connect_volume: return (1378ms) {'type': 'block', 'scsi_wwn': '26637343634643561', 'path': '/dev/sdb'} {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 10:12:49 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-154e52c8-22a7-45c8-a26b-4fe6cd419a0c tempest-TestVolumeSwap-1428287604 tempest-TestVolumeSwap-1428287604-project-member] [instance: ad1ace46-2e8e-42e1-a0f5-2384078fcf09] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26637343634643561', 'path': '/dev/sdb'} {{(pid=85141) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 10:12:49 user nova-compute[85141]: DEBUG nova.objects.instance [None req-154e52c8-22a7-45c8-a26b-4fe6cd419a0c tempest-TestVolumeSwap-1428287604 tempest-TestVolumeSwap-1428287604-project-member] Lazy-loading 'flavor' on Instance uuid ad1ace46-2e8e-42e1-a0f5-2384078fcf09 {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:12:49 user nova-compute[85141]: DEBUG nova.virt.libvirt.guest [None req-154e52c8-22a7-45c8-a26b-4fe6cd419a0c tempest-TestVolumeSwap-1428287604 tempest-TestVolumeSwap-1428287604-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 10:12:49 user nova-compute[85141]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 10:12:49 user nova-compute[85141]:   <source dev="/dev/sdb"/>
Nov 16 10:12:49 user nova-compute[85141]:   <target dev="vdb" bus="virtio"/>
Nov 16 10:12:49 user nova-compute[85141]:   <serial>7e233047-dda3-4f2e-803c-7b69a57ac656</serial>
Nov 16 10:12:49 user nova-compute[85141]: </disk>
Nov 16 10:12:49 user nova-compute[85141]:  {{(pid=85141) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 10:12:50 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-154e52c8-22a7-45c8-a26b-4fe6cd419a0c tempest-TestVolumeSwap-1428287604 tempest-TestVolumeSwap-1428287604-project-member] No BDM found with device name vda, not building metadata. {{(pid=85141) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 10:12:50 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-154e52c8-22a7-45c8-a26b-4fe6cd419a0c tempest-TestVolumeSwap-1428287604 tempest-TestVolumeSwap-1428287604-project-member] No BDM found with device name vdb, not building metadata. {{(pid=85141) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 10:12:50 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-154e52c8-22a7-45c8-a26b-4fe6cd419a0c tempest-TestVolumeSwap-1428287604 tempest-TestVolumeSwap-1428287604-project-member] No VIF found with MAC fa:16:3e:dc:86:3e, not building metadata {{(pid=85141) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 10:12:50 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-154e52c8-22a7-45c8-a26b-4fe6cd419a0c tempest-TestVolumeSwap-1428287604 tempest-TestVolumeSwap-1428287604-project-member] Lock "ad1ace46-2e8e-42e1-a0f5-2384078fcf09" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.976s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:12:51 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1bb357f0-6d8f-4fb2-9dcc-8a64f3cb73c1 tempest-AttachSCSIVolumeTestJSON-1774410022 tempest-AttachSCSIVolumeTestJSON-1774410022-project-member] [instance: ff964caf-b473-47bc-89d2-f7189264721c] Calling os-brick to attach iSCSI Volume {{(pid=85141) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 10:12:51 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bb357f0-6d8f-4fb2-9dcc-8a64f3cb73c1 tempest-AttachSCSIVolumeTestJSON-1774410022 tempest-AttachSCSIVolumeTestJSON-1774410022-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51806b6080>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8ca01473-0233-4122-b008-ffa407ca3e70', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FJKSkofB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 10:12:51 user nova-compute[85141]: WARNING os_brick.initiator.connectors.base [None req-1bb357f0-6d8f-4fb2-9dcc-8a64f3cb73c1 tempest-AttachSCSIVolumeTestJSON-1774410022 tempest-AttachSCSIVolumeTestJSON-1774410022-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 10:12:51 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-1bb357f0-6d8f-4fb2-9dcc-8a64f3cb73c1 tempest-AttachSCSIVolumeTestJSON-1774410022 tempest-AttachSCSIVolumeTestJSON-1774410022-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 10:12:51 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-1bb357f0-6d8f-4fb2-9dcc-8a64f3cb73c1 tempest-AttachSCSIVolumeTestJSON-1774410022 tempest-AttachSCSIVolumeTestJSON-1774410022-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 10:12:51 user nova-compute[85141]: WARNING os_brick.initiator.connectors.base [None req-1bb357f0-6d8f-4fb2-9dcc-8a64f3cb73c1 tempest-AttachSCSIVolumeTestJSON-1774410022 tempest-AttachSCSIVolumeTestJSON-1774410022-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 10:12:51 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-1bb357f0-6d8f-4fb2-9dcc-8a64f3cb73c1 tempest-AttachSCSIVolumeTestJSON-1774410022 tempest-AttachSCSIVolumeTestJSON-1774410022-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8ca01473-0233-4122-b008-ffa407ca3e70" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 10:12:51 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-1bb357f0-6d8f-4fb2-9dcc-8a64f3cb73c1 tempest-AttachSCSIVolumeTestJSON-1774410022 tempest-AttachSCSIVolumeTestJSON-1774410022-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8ca01473-0233-4122-b008-ffa407ca3e70" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 10:12:51 user nova-compute[85141]: INFO os_brick.initiator.connectors.iscsi [None req-1bb357f0-6d8f-4fb2-9dcc-8a64f3cb73c1 tempest-AttachSCSIVolumeTestJSON-1774410022 tempest-AttachSCSIVolumeTestJSON-1774410022-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 10:12:51 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ca01473-0233-4122-b008-ffa407ca3e70 -p 172.16.0.220:3260 {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:12:51 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ca01473-0233-4122-b008-ffa407ca3e70 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:12:51 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0056b9d-016f-4ac9-9740-8964ef6c6e78]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:12:51 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bb357f0-6d8f-4fb2-9dcc-8a64f3cb73c1 tempest-AttachSCSIVolumeTestJSON-1774410022 tempest-AttachSCSIVolumeTestJSON-1774410022-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 10:12:51 user nova-compute[85141]:  {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:12:51 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ca01473-0233-4122-b008-ffa407ca3e70 -p 172.16.0.220:3260 --interface default --op new {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:12:51 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ca01473-0233-4122-b008-ffa407ca3e70 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:12:51 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[9edc37d4-3b2c-49bf-af73-b81933c56f46]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8ca01473-0233-4122-b008-ffa407ca3e70] added\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:12:51 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bb357f0-6d8f-4fb2-9dcc-8a64f3cb73c1 tempest-AttachSCSIVolumeTestJSON-1774410022 tempest-AttachSCSIVolumeTestJSON-1774410022-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8ca01473-0233-4122-b008-ffa407ca3e70] added
Nov 16 10:12:51 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:12:51 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ca01473-0233-4122-b008-ffa407ca3e70 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:12:51 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ca01473-0233-4122-b008-ffa407ca3e70 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:12:51 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[39853358-c660-4f92-aa8e-7fb7f791da2f]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:12:51 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bb357f0-6d8f-4fb2-9dcc-8a64f3cb73c1 tempest-AttachSCSIVolumeTestJSON-1774410022 tempest-AttachSCSIVolumeTestJSON-1774410022-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:12:51 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ca01473-0233-4122-b008-ffa407ca3e70 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:12:51 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ca01473-0233-4122-b008-ffa407ca3e70 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:12:51 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[16b3cf12-35ba-4f63-a927-b70ae13d2bf3]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:12:51 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bb357f0-6d8f-4fb2-9dcc-8a64f3cb73c1 tempest-AttachSCSIVolumeTestJSON-1774410022 tempest-AttachSCSIVolumeTestJSON-1774410022-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:12:51 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ca01473-0233-4122-b008-ffa407ca3e70 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FJKSkofB {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:12:51 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ca01473-0233-4122-b008-ffa407ca3e70 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FJKSkofB" returned: 0 in 0.019s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:12:51 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[c28c21a6-3713-434e-9c26-d622bb81c992]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:12:51 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bb357f0-6d8f-4fb2-9dcc-8a64f3cb73c1 tempest-AttachSCSIVolumeTestJSON-1774410022 tempest-AttachSCSIVolumeTestJSON-1774410022-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FJKSkofB'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:12:51 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ca01473-0233-4122-b008-ffa407ca3e70 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:12:51 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ca01473-0233-4122-b008-ffa407ca3e70 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:12:51 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bc91bdc-039b-4432-94e6-d0d54033e0a0]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:12:51 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bb357f0-6d8f-4fb2-9dcc-8a64f3cb73c1 tempest-AttachSCSIVolumeTestJSON-1774410022 tempest-AttachSCSIVolumeTestJSON-1774410022-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:12:51 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:12:51 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:12:51 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[c89282ad-ebfb-4254-98a6-fbf3307fc144]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4df10d9-a60c-45ed-981d-96f704534fb8 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4973f768-f126-41d6-b534-458d6c49f9b3 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fcde20-e019-4cf0-ad90-6c8100f4a8d2 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5feab5a7-6ec4-4e13-84bc-bff657a0d0de (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e233047-dda3-4f2e-803c-7b69a57ac656 (non-flash)\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:12:51 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bb357f0-6d8f-4fb2-9dcc-8a64f3cb73c1 tempest-AttachSCSIVolumeTestJSON-1774410022 tempest-AttachSCSIVolumeTestJSON-1774410022-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4df10d9-a60c-45ed-981d-96f704534fb8 (non-flash)
Nov 16 10:12:51 user nova-compute[85141]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4973f768-f126-41d6-b534-458d6c49f9b3 (non-flash)
Nov 16 10:12:51 user nova-compute[85141]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fcde20-e019-4cf0-ad90-6c8100f4a8d2 (non-flash)
Nov 16 10:12:51 user nova-compute[85141]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5feab5a7-6ec4-4e13-84bc-bff657a0d0de (non-flash)
Nov 16 10:12:51 user nova-compute[85141]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e233047-dda3-4f2e-803c-7b69a57ac656 (non-flash)
Nov 16 10:12:51 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:12:51 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bb357f0-6d8f-4fb2-9dcc-8a64f3cb73c1 tempest-AttachSCSIVolumeTestJSON-1774410022 tempest-AttachSCSIVolumeTestJSON-1774410022-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4df10d9-a60c-45ed-981d-96f704534fb8 (non-flash)
Nov 16 10:12:51 user nova-compute[85141]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4973f768-f126-41d6-b534-458d6c49f9b3 (non-flash)
Nov 16 10:12:51 user nova-compute[85141]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fcde20-e019-4cf0-ad90-6c8100f4a8d2 (non-flash)
Nov 16 10:12:51 user nova-compute[85141]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5feab5a7-6ec4-4e13-84bc-bff657a0d0de (non-flash)
Nov 16 10:12:51 user nova-compute[85141]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e233047-dda3-4f2e-803c-7b69a57ac656 (non-flash)
Nov 16 10:12:51 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 10:12:51 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ca01473-0233-4122-b008-ffa407ca3e70 -p 172.16.0.220:3260 --login {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:12:51 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ca01473-0233-4122-b008-ffa407ca3e70 -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:12:51 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[92bddb99-ee7f-4cf1-937f-ff955729c8dc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8ca01473-0233-4122-b008-ffa407ca3e70, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8ca01473-0233-4122-b008-ffa407ca3e70, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:12:51 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bb357f0-6d8f-4fb2-9dcc-8a64f3cb73c1 tempest-AttachSCSIVolumeTestJSON-1774410022 tempest-AttachSCSIVolumeTestJSON-1774410022-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8ca01473-0233-4122-b008-ffa407ca3e70, portal: 172.16.0.220,3260]
Nov 16 10:12:51 user nova-compute[85141]: Login to [iface: default, target: iqn.2010-10.org.openstack:8ca01473-0233-4122-b008-ffa407ca3e70, portal: 172.16.0.220,3260] successful.
Nov 16 10:12:51 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:12:51 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ca01473-0233-4122-b008-ffa407ca3e70 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:12:51 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ca01473-0233-4122-b008-ffa407ca3e70 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:12:51 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[0366fe61-fb4b-406d-b73f-ce8143cf88c4]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:12:51 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bb357f0-6d8f-4fb2-9dcc-8a64f3cb73c1 tempest-AttachSCSIVolumeTestJSON-1774410022 tempest-AttachSCSIVolumeTestJSON-1774410022-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:12:51 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:12:51 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:12:51 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1368af7-e5f0-4817-a5a1-b7cf3bc3b88f]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4df10d9-a60c-45ed-981d-96f704534fb8 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4973f768-f126-41d6-b534-458d6c49f9b3 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fcde20-e019-4cf0-ad90-6c8100f4a8d2 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5feab5a7-6ec4-4e13-84bc-bff657a0d0de (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e233047-dda3-4f2e-803c-7b69a57ac656 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ca01473-0233-4122-b008-ffa407ca3e70 (non-flash)\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:12:51 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bb357f0-6d8f-4fb2-9dcc-8a64f3cb73c1 tempest-AttachSCSIVolumeTestJSON-1774410022 tempest-AttachSCSIVolumeTestJSON-1774410022-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4df10d9-a60c-45ed-981d-96f704534fb8 (non-flash)
Nov 16 10:12:51 user nova-compute[85141]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4973f768-f126-41d6-b534-458d6c49f9b3 (non-flash)
Nov 16 10:12:51 user nova-compute[85141]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fcde20-e019-4cf0-ad90-6c8100f4a8d2 (non-flash)
Nov 16 10:12:51 user nova-compute[85141]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5feab5a7-6ec4-4e13-84bc-bff657a0d0de (non-flash)
Nov 16 10:12:51 user nova-compute[85141]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e233047-dda3-4f2e-803c-7b69a57ac656 (non-flash)
Nov 16 10:12:51 user nova-compute[85141]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ca01473-0233-4122-b008-ffa407ca3e70 (non-flash)
Nov 16 10:12:51 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:12:51 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bb357f0-6d8f-4fb2-9dcc-8a64f3cb73c1 tempest-AttachSCSIVolumeTestJSON-1774410022 tempest-AttachSCSIVolumeTestJSON-1774410022-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4df10d9-a60c-45ed-981d-96f704534fb8 (non-flash)
Nov 16 10:12:51 user nova-compute[85141]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4973f768-f126-41d6-b534-458d6c49f9b3 (non-flash)
Nov 16 10:12:51 user nova-compute[85141]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fcde20-e019-4cf0-ad90-6c8100f4a8d2 (non-flash)
Nov 16 10:12:51 user nova-compute[85141]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5feab5a7-6ec4-4e13-84bc-bff657a0d0de (non-flash)
Nov 16 10:12:51 user nova-compute[85141]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e233047-dda3-4f2e-803c-7b69a57ac656 (non-flash)
Nov 16 10:12:51 user nova-compute[85141]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ca01473-0233-4122-b008-ffa407ca3e70 (non-flash)
Nov 16 10:12:51 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 10:12:51 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-1bb357f0-6d8f-4fb2-9dcc-8a64f3cb73c1 tempest-AttachSCSIVolumeTestJSON-1774410022 tempest-AttachSCSIVolumeTestJSON-1774410022-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8ca01473-0233-4122-b008-ffa407ca3e70" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.286s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 10:12:51 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bb357f0-6d8f-4fb2-9dcc-8a64f3cb73c1 tempest-AttachSCSIVolumeTestJSON-1774410022 tempest-AttachSCSIVolumeTestJSON-1774410022-project-member] Connected to 172.16.0.220:3260 {{(pid=85141) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 10:12:51 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-1bb357f0-6d8f-4fb2-9dcc-8a64f3cb73c1 tempest-AttachSCSIVolumeTestJSON-1774410022 tempest-AttachSCSIVolumeTestJSON-1774410022-project-member] HCTL ('38', '-', '-', 0) found on session 9 with lun 0 {{(pid=85141) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 10:12:51 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-1bb357f0-6d8f-4fb2-9dcc-8a64f3cb73c1 tempest-AttachSCSIVolumeTestJSON-1774410022 tempest-AttachSCSIVolumeTestJSON-1774410022-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=85141) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 10:12:51 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:12:51 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.018s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:12:51 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[4207948d-7eda-413a-aa0c-66b1b5af6586]: (4, ('- - 0', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:12:51 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-1bb357f0-6d8f-4fb2-9dcc-8a64f3cb73c1 tempest-AttachSCSIVolumeTestJSON-1774410022 tempest-AttachSCSIVolumeTestJSON-1774410022-project-member] Searching for a device in session 9 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=85141) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 10:12:51 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bb357f0-6d8f-4fb2-9dcc-8a64f3cb73c1 tempest-AttachSCSIVolumeTestJSON-1774410022 tempest-AttachSCSIVolumeTestJSON-1774410022-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:8ca01473-0233-4122-b008-ffa407ca3e70', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FJKSkofB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=85141) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 10:12:51 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-7563521d-9bc0-404e-87e4-0c0b253b214a tempest-TestVolumeSwap-1037451778 tempest-TestVolumeSwap-1037451778-project-admin] Acquiring lock "ad1ace46-2e8e-42e1-a0f5-2384078fcf09" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:12:51 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-7563521d-9bc0-404e-87e4-0c0b253b214a tempest-TestVolumeSwap-1037451778 tempest-TestVolumeSwap-1037451778-project-admin] Lock "ad1ace46-2e8e-42e1-a0f5-2384078fcf09" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:12:51 user nova-compute[85141]: DEBUG os_brick.utils [None req-7563521d-9bc0-404e-87e4-0c0b253b214a tempest-TestVolumeSwap-1037451778 tempest-TestVolumeSwap-1037451778-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 10:12:51 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:12:51 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:12:51 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[39c5f803-f286-4c59-94bb-6140ac6e366d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c7834de5c295\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:12:51 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:12:51 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:12:51 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[7209aec6-5e2a-4e67-b7a4-1ccd442d10a4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:12:51 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:12:51 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:12:51 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[8317fcd7-20e5-4352-8f03-21f2947ced71]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:12:51 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[59e1abb1-142b-4eec-841c-d9223db97aa0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:12:51 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-7563521d-9bc0-404e-87e4-0c0b253b214a tempest-TestVolumeSwap-1037451778 tempest-TestVolumeSwap-1037451778-project-admin] Running cmd (subprocess): nvme version {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:12:51 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-7563521d-9bc0-404e-87e4-0c0b253b214a tempest-TestVolumeSwap-1037451778 tempest-TestVolumeSwap-1037451778-project-admin] 'nvme version' failed. Not Retrying. {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 10:12:51 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7563521d-9bc0-404e-87e4-0c0b253b214a tempest-TestVolumeSwap-1037451778 tempest-TestVolumeSwap-1037451778-project-admin] nvme not present on system {{(pid=85141) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 10:12:51 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:12:51 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 10:12:51 user nova-compute[85141]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 10:12:51 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[31c8565c-4f57-4eeb-a602-ed1bf30ca105]: (4, '') {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:12:51 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.lightos [None req-7563521d-9bc0-404e-87e4-0c0b253b214a tempest-TestVolumeSwap-1037451778 tempest-TestVolumeSwap-1037451778-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=85141) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 10:12:51 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.lightos [None req-7563521d-9bc0-404e-87e4-0c0b253b214a tempest-TestVolumeSwap-1037451778 tempest-TestVolumeSwap-1037451778-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=85141) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 10:12:51 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.lightos [None req-7563521d-9bc0-404e-87e4-0c0b253b214a tempest-TestVolumeSwap-1037451778 tempest-TestVolumeSwap-1037451778-project-admin] LIGHTOS: no hostnqn found. {{(pid=85141) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 10:12:51 user nova-compute[85141]: DEBUG os_brick.utils [None req-7563521d-9bc0-404e-87e4-0c0b253b214a tempest-TestVolumeSwap-1037451778 tempest-TestVolumeSwap-1037451778-project-admin] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c7834de5c295', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 10:12:51 user nova-compute[85141]: INFO nova.compute.manager [None req-7563521d-9bc0-404e-87e4-0c0b253b214a tempest-TestVolumeSwap-1037451778 tempest-TestVolumeSwap-1037451778-project-admin] [instance: ad1ace46-2e8e-42e1-a0f5-2384078fcf09] Swapping volume 7e233047-dda3-4f2e-803c-7b69a57ac656 for eb0e3ad6-04d7-4405-b4ae-0440b2a396ce
Nov 16 10:12:51 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:12:52 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:12:52 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-1bb357f0-6d8f-4fb2-9dcc-8a64f3cb73c1 tempest-AttachSCSIVolumeTestJSON-1774410022 tempest-AttachSCSIVolumeTestJSON-1774410022-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.327s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 10:12:52 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bb357f0-6d8f-4fb2-9dcc-8a64f3cb73c1 tempest-AttachSCSIVolumeTestJSON-1774410022 tempest-AttachSCSIVolumeTestJSON-1774410022-project-member] <== connect_volume: return (1328ms) {'type': 'block', 'scsi_wwn': '23665356666623863', 'path': '/dev/sdg'} {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 10:12:52 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1bb357f0-6d8f-4fb2-9dcc-8a64f3cb73c1 tempest-AttachSCSIVolumeTestJSON-1774410022 tempest-AttachSCSIVolumeTestJSON-1774410022-project-member] [instance: ff964caf-b473-47bc-89d2-f7189264721c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23665356666623863', 'path': '/dev/sdg'} {{(pid=85141) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 10:12:52 user nova-compute[85141]: DEBUG nova.objects.instance [None req-1bb357f0-6d8f-4fb2-9dcc-8a64f3cb73c1 tempest-AttachSCSIVolumeTestJSON-1774410022 tempest-AttachSCSIVolumeTestJSON-1774410022-project-member] Lazy-loading 'flavor' on Instance uuid ff964caf-b473-47bc-89d2-f7189264721c {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:12:52 user nova-compute[85141]: DEBUG nova.virt.libvirt.guest [None req-1bb357f0-6d8f-4fb2-9dcc-8a64f3cb73c1 tempest-AttachSCSIVolumeTestJSON-1774410022 tempest-AttachSCSIVolumeTestJSON-1774410022-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 10:12:52 user nova-compute[85141]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 10:12:52 user nova-compute[85141]:   <source dev="/dev/sdg"/>
Nov 16 10:12:52 user nova-compute[85141]:   <target dev="sdc" bus="scsi"/>
Nov 16 10:12:52 user nova-compute[85141]:   <serial>8ca01473-0233-4122-b008-ffa407ca3e70</serial>
Nov 16 10:12:52 user nova-compute[85141]:   <address type="drive" controller="0" unit="2"/>
Nov 16 10:12:52 user nova-compute[85141]: </disk>
Nov 16 10:12:52 user nova-compute[85141]:  {{(pid=85141) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 10:12:53 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-1bb357f0-6d8f-4fb2-9dcc-8a64f3cb73c1 tempest-AttachSCSIVolumeTestJSON-1774410022 tempest-AttachSCSIVolumeTestJSON-1774410022-project-member] No BDM found with device name sda, not building metadata. {{(pid=85141) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 10:12:53 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-1bb357f0-6d8f-4fb2-9dcc-8a64f3cb73c1 tempest-AttachSCSIVolumeTestJSON-1774410022 tempest-AttachSCSIVolumeTestJSON-1774410022-project-member] No BDM found with device name sdb, not building metadata. {{(pid=85141) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 10:12:53 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-1bb357f0-6d8f-4fb2-9dcc-8a64f3cb73c1 tempest-AttachSCSIVolumeTestJSON-1774410022 tempest-AttachSCSIVolumeTestJSON-1774410022-project-member] No BDM found with device name sdc, not building metadata. {{(pid=85141) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 10:12:53 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-1bb357f0-6d8f-4fb2-9dcc-8a64f3cb73c1 tempest-AttachSCSIVolumeTestJSON-1774410022 tempest-AttachSCSIVolumeTestJSON-1774410022-project-member] No VIF found with MAC fa:16:3e:3f:0d:5b, not building metadata {{(pid=85141) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 10:12:53 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-1bb357f0-6d8f-4fb2-9dcc-8a64f3cb73c1 tempest-AttachSCSIVolumeTestJSON-1774410022 tempest-AttachSCSIVolumeTestJSON-1774410022-project-member] Lock "ff964caf-b473-47bc-89d2-f7189264721c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.896s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:12:53 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f66d16a1-c7ae-4f7c-96fd-20965aa64265 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] [instance: 0ca61bd2-268e-4c49-ba04-a5cb39143a9b] Calling os-brick to attach iSCSI Volume {{(pid=85141) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 10:12:53 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-f66d16a1-c7ae-4f7c-96fd-20965aa64265 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51806b6080>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:eff563f0-92d3-47a1-addc-e3eaa6828d59', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bGWrKVEk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 10:12:53 user nova-compute[85141]: WARNING os_brick.initiator.connectors.base [None req-f66d16a1-c7ae-4f7c-96fd-20965aa64265 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 10:12:53 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-f66d16a1-c7ae-4f7c-96fd-20965aa64265 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 10:12:53 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-f66d16a1-c7ae-4f7c-96fd-20965aa64265 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 10:12:53 user nova-compute[85141]: WARNING os_brick.initiator.connectors.base [None req-f66d16a1-c7ae-4f7c-96fd-20965aa64265 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 10:12:53 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-f66d16a1-c7ae-4f7c-96fd-20965aa64265 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eff563f0-92d3-47a1-addc-e3eaa6828d59" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 10:12:53 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-f66d16a1-c7ae-4f7c-96fd-20965aa64265 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eff563f0-92d3-47a1-addc-e3eaa6828d59" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 10:12:53 user nova-compute[85141]: INFO os_brick.initiator.connectors.iscsi [None req-f66d16a1-c7ae-4f7c-96fd-20965aa64265 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 10:12:53 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eff563f0-92d3-47a1-addc-e3eaa6828d59 -p 172.16.0.220:3260 {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:12:53 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eff563f0-92d3-47a1-addc-e3eaa6828d59 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:12:53 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2dc460f-d068-46eb-9d61-b7db502c8247]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:12:53 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-f66d16a1-c7ae-4f7c-96fd-20965aa64265 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 10:12:53 user nova-compute[85141]:  {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:12:53 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eff563f0-92d3-47a1-addc-e3eaa6828d59 -p 172.16.0.220:3260 --interface default --op new {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:12:53 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eff563f0-92d3-47a1-addc-e3eaa6828d59 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:12:53 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc7b4d95-c22d-41cd-9cf1-dff24121c5ce]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:eff563f0-92d3-47a1-addc-e3eaa6828d59] added\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:12:53 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-f66d16a1-c7ae-4f7c-96fd-20965aa64265 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:eff563f0-92d3-47a1-addc-e3eaa6828d59] added
Nov 16 10:12:53 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:12:53 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eff563f0-92d3-47a1-addc-e3eaa6828d59 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:12:53 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eff563f0-92d3-47a1-addc-e3eaa6828d59 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:12:53 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[37936a98-2acc-49fa-98f0-a61b23de92a8]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:12:53 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-f66d16a1-c7ae-4f7c-96fd-20965aa64265 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:12:53 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eff563f0-92d3-47a1-addc-e3eaa6828d59 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:12:53 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eff563f0-92d3-47a1-addc-e3eaa6828d59 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:12:53 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c358758-50df-429c-a755-2b315f9f76c2]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:12:53 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-f66d16a1-c7ae-4f7c-96fd-20965aa64265 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:12:53 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eff563f0-92d3-47a1-addc-e3eaa6828d59 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bGWrKVEk {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:12:53 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eff563f0-92d3-47a1-addc-e3eaa6828d59 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bGWrKVEk" returned: 0 in 0.020s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:12:53 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9a693b5-340d-4863-ac5a-5e363da7a11c]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:12:53 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-f66d16a1-c7ae-4f7c-96fd-20965aa64265 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bGWrKVEk'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:12:53 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eff563f0-92d3-47a1-addc-e3eaa6828d59 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:12:53 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eff563f0-92d3-47a1-addc-e3eaa6828d59 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:12:53 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[71884d7b-5e0b-4a94-8103-729b76ad7106]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:12:53 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-f66d16a1-c7ae-4f7c-96fd-20965aa64265 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:12:53 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:12:53 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:12:53 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffe65f00-af65-446b-8f0f-0a5004e1b9cf]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4df10d9-a60c-45ed-981d-96f704534fb8 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4973f768-f126-41d6-b534-458d6c49f9b3 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fcde20-e019-4cf0-ad90-6c8100f4a8d2 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5feab5a7-6ec4-4e13-84bc-bff657a0d0de (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e233047-dda3-4f2e-803c-7b69a57ac656 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ca01473-0233-4122-b008-ffa407ca3e70 (non-flash)\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:12:53 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-f66d16a1-c7ae-4f7c-96fd-20965aa64265 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4df10d9-a60c-45ed-981d-96f704534fb8 (non-flash)
Nov 16 10:12:53 user nova-compute[85141]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4973f768-f126-41d6-b534-458d6c49f9b3 (non-flash)
Nov 16 10:12:53 user nova-compute[85141]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fcde20-e019-4cf0-ad90-6c8100f4a8d2 (non-flash)
Nov 16 10:12:53 user nova-compute[85141]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5feab5a7-6ec4-4e13-84bc-bff657a0d0de (non-flash)
Nov 16 10:12:53 user nova-compute[85141]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e233047-dda3-4f2e-803c-7b69a57ac656 (non-flash)
Nov 16 10:12:53 user nova-compute[85141]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ca01473-0233-4122-b008-ffa407ca3e70 (non-flash)
Nov 16 10:12:53 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:12:53 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-f66d16a1-c7ae-4f7c-96fd-20965aa64265 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4df10d9-a60c-45ed-981d-96f704534fb8 (non-flash)
Nov 16 10:12:53 user nova-compute[85141]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4973f768-f126-41d6-b534-458d6c49f9b3 (non-flash)
Nov 16 10:12:53 user nova-compute[85141]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fcde20-e019-4cf0-ad90-6c8100f4a8d2 (non-flash)
Nov 16 10:12:53 user nova-compute[85141]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5feab5a7-6ec4-4e13-84bc-bff657a0d0de (non-flash)
Nov 16 10:12:53 user nova-compute[85141]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e233047-dda3-4f2e-803c-7b69a57ac656 (non-flash)
Nov 16 10:12:53 user nova-compute[85141]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ca01473-0233-4122-b008-ffa407ca3e70 (non-flash)
Nov 16 10:12:53 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 10:12:53 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eff563f0-92d3-47a1-addc-e3eaa6828d59 -p 172.16.0.220:3260 --login {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:12:53 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eff563f0-92d3-47a1-addc-e3eaa6828d59 -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:12:53 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[93fce95b-d63d-4c03-bbe8-89535476ce22]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:eff563f0-92d3-47a1-addc-e3eaa6828d59, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:eff563f0-92d3-47a1-addc-e3eaa6828d59, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:12:53 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-f66d16a1-c7ae-4f7c-96fd-20965aa64265 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:eff563f0-92d3-47a1-addc-e3eaa6828d59, portal: 172.16.0.220,3260]
Nov 16 10:12:53 user nova-compute[85141]: Login to [iface: default, target: iqn.2010-10.org.openstack:eff563f0-92d3-47a1-addc-e3eaa6828d59, portal: 172.16.0.220,3260] successful.
Nov 16 10:12:53 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:12:53 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eff563f0-92d3-47a1-addc-e3eaa6828d59 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:12:53 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eff563f0-92d3-47a1-addc-e3eaa6828d59 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:12:53 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc2b1cd7-28cd-42b6-8472-7980985a8c1b]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:12:53 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-f66d16a1-c7ae-4f7c-96fd-20965aa64265 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:12:53 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:12:54 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:12:54 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[64c55fff-f360-418f-a0d3-bc19b1765f14]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eff563f0-92d3-47a1-addc-e3eaa6828d59 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4df10d9-a60c-45ed-981d-96f704534fb8 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4973f768-f126-41d6-b534-458d6c49f9b3 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fcde20-e019-4cf0-ad90-6c8100f4a8d2 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5feab5a7-6ec4-4e13-84bc-bff657a0d0de (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e233047-dda3-4f2e-803c-7b69a57ac656 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ca01473-0233-4122-b008-ffa407ca3e70 (non-flash)\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:12:54 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-f66d16a1-c7ae-4f7c-96fd-20965aa64265 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eff563f0-92d3-47a1-addc-e3eaa6828d59 (non-flash)
Nov 16 10:12:54 user nova-compute[85141]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4df10d9-a60c-45ed-981d-96f704534fb8 (non-flash)
Nov 16 10:12:54 user nova-compute[85141]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4973f768-f126-41d6-b534-458d6c49f9b3 (non-flash)
Nov 16 10:12:54 user nova-compute[85141]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fcde20-e019-4cf0-ad90-6c8100f4a8d2 (non-flash)
Nov 16 10:12:54 user nova-compute[85141]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5feab5a7-6ec4-4e13-84bc-bff657a0d0de (non-flash)
Nov 16 10:12:54 user nova-compute[85141]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e233047-dda3-4f2e-803c-7b69a57ac656 (non-flash)
Nov 16 10:12:54 user nova-compute[85141]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ca01473-0233-4122-b008-ffa407ca3e70 (non-flash)
Nov 16 10:12:54 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:12:54 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-f66d16a1-c7ae-4f7c-96fd-20965aa64265 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eff563f0-92d3-47a1-addc-e3eaa6828d59 (non-flash)
Nov 16 10:12:54 user nova-compute[85141]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4df10d9-a60c-45ed-981d-96f704534fb8 (non-flash)
Nov 16 10:12:54 user nova-compute[85141]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4973f768-f126-41d6-b534-458d6c49f9b3 (non-flash)
Nov 16 10:12:54 user nova-compute[85141]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fcde20-e019-4cf0-ad90-6c8100f4a8d2 (non-flash)
Nov 16 10:12:54 user nova-compute[85141]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5feab5a7-6ec4-4e13-84bc-bff657a0d0de (non-flash)
Nov 16 10:12:54 user nova-compute[85141]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e233047-dda3-4f2e-803c-7b69a57ac656 (non-flash)
Nov 16 10:12:54 user nova-compute[85141]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ca01473-0233-4122-b008-ffa407ca3e70 (non-flash)
Nov 16 10:12:54 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 10:12:54 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-f66d16a1-c7ae-4f7c-96fd-20965aa64265 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eff563f0-92d3-47a1-addc-e3eaa6828d59" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.309s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 10:12:54 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-f66d16a1-c7ae-4f7c-96fd-20965aa64265 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] Connected to 172.16.0.220:3260 {{(pid=85141) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 10:12:54 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-f66d16a1-c7ae-4f7c-96fd-20965aa64265 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] HCTL ('39', '-', '-', 0) found on session 10 with lun 0 {{(pid=85141) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 10:12:54 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-f66d16a1-c7ae-4f7c-96fd-20965aa64265 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=85141) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 10:12:54 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:12:54 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.019s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:12:54 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[5838bfb4-4ffb-443a-af68-6ff588f01009]: (4, ('- - 0', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:12:54 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-f66d16a1-c7ae-4f7c-96fd-20965aa64265 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] Searching for a device in session 10 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=85141) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 10:12:54 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-f66d16a1-c7ae-4f7c-96fd-20965aa64265 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:eff563f0-92d3-47a1-addc-e3eaa6828d59', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bGWrKVEk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=85141) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 10:12:54 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-8709ced5-7bbf-4b82-92b1-e1003b2216dc tempest-AttachSCSIVolumeTestJSON-1774410022 tempest-AttachSCSIVolumeTestJSON-1774410022-project-member] Acquiring lock "ff964caf-b473-47bc-89d2-f7189264721c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:12:54 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-8709ced5-7bbf-4b82-92b1-e1003b2216dc tempest-AttachSCSIVolumeTestJSON-1774410022 tempest-AttachSCSIVolumeTestJSON-1774410022-project-member] Lock "ff964caf-b473-47bc-89d2-f7189264721c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:12:54 user nova-compute[85141]: INFO nova.compute.manager [None req-8709ced5-7bbf-4b82-92b1-e1003b2216dc tempest-AttachSCSIVolumeTestJSON-1774410022 tempest-AttachSCSIVolumeTestJSON-1774410022-project-member] [instance: ff964caf-b473-47bc-89d2-f7189264721c] Detaching volume 8ca01473-0233-4122-b008-ffa407ca3e70
Nov 16 10:12:54 user nova-compute[85141]: INFO nova.virt.block_device [None req-8709ced5-7bbf-4b82-92b1-e1003b2216dc tempest-AttachSCSIVolumeTestJSON-1774410022 tempest-AttachSCSIVolumeTestJSON-1774410022-project-member] [instance: ff964caf-b473-47bc-89d2-f7189264721c] Attempting to driver detach volume 8ca01473-0233-4122-b008-ffa407ca3e70 from mountpoint /dev/sdc
Nov 16 10:12:54 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-8709ced5-7bbf-4b82-92b1-e1003b2216dc tempest-AttachSCSIVolumeTestJSON-1774410022 tempest-AttachSCSIVolumeTestJSON-1774410022-project-member] Attempting to detach device sdc from instance ff964caf-b473-47bc-89d2-f7189264721c from the persistent domain config. {{(pid=85141) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 10:12:54 user nova-compute[85141]: DEBUG nova.virt.libvirt.guest [None req-8709ced5-7bbf-4b82-92b1-e1003b2216dc tempest-AttachSCSIVolumeTestJSON-1774410022 tempest-AttachSCSIVolumeTestJSON-1774410022-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 10:12:54 user nova-compute[85141]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 10:12:54 user nova-compute[85141]:   <source dev="/dev/sdg"/>
Nov 16 10:12:54 user nova-compute[85141]:   <target dev="sdc" bus="scsi"/>
Nov 16 10:12:54 user nova-compute[85141]:   <serial>8ca01473-0233-4122-b008-ffa407ca3e70</serial>
Nov 16 10:12:54 user nova-compute[85141]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 16 10:12:54 user nova-compute[85141]: </disk>
Nov 16 10:12:54 user nova-compute[85141]:  {{(pid=85141) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 10:12:54 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-8709ced5-7bbf-4b82-92b1-e1003b2216dc tempest-AttachSCSIVolumeTestJSON-1774410022 tempest-AttachSCSIVolumeTestJSON-1774410022-project-member] Successfully detached device sdc from instance ff964caf-b473-47bc-89d2-f7189264721c from the persistent domain config.
Nov 16 10:12:54 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-8709ced5-7bbf-4b82-92b1-e1003b2216dc tempest-AttachSCSIVolumeTestJSON-1774410022 tempest-AttachSCSIVolumeTestJSON-1774410022-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance ff964caf-b473-47bc-89d2-f7189264721c from the live domain config. {{(pid=85141) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 10:12:54 user nova-compute[85141]: DEBUG nova.virt.libvirt.guest [None req-8709ced5-7bbf-4b82-92b1-e1003b2216dc tempest-AttachSCSIVolumeTestJSON-1774410022 tempest-AttachSCSIVolumeTestJSON-1774410022-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 10:12:54 user nova-compute[85141]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 10:12:54 user nova-compute[85141]:   <source dev="/dev/sdg"/>
Nov 16 10:12:54 user nova-compute[85141]:   <target dev="sdc" bus="scsi"/>
Nov 16 10:12:54 user nova-compute[85141]:   <serial>8ca01473-0233-4122-b008-ffa407ca3e70</serial>
Nov 16 10:12:54 user nova-compute[85141]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 16 10:12:54 user nova-compute[85141]: </disk>
Nov 16 10:12:54 user nova-compute[85141]:  {{(pid=85141) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 10:12:55 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-8709ced5-7bbf-4b82-92b1-e1003b2216dc tempest-AttachSCSIVolumeTestJSON-1774410022 tempest-AttachSCSIVolumeTestJSON-1774410022-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance ff964caf-b473-47bc-89d2-f7189264721c {{(pid=85141) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 10:12:55 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-f66d16a1-c7ae-4f7c-96fd-20965aa64265 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.345s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 10:12:55 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-f66d16a1-c7ae-4f7c-96fd-20965aa64265 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] <== connect_volume: return (1346ms) {'type': 'block', 'scsi_wwn': '23334316535376662', 'path': '/dev/sdh'} {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 10:12:55 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f66d16a1-c7ae-4f7c-96fd-20965aa64265 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] [instance: 0ca61bd2-268e-4c49-ba04-a5cb39143a9b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23334316535376662', 'path': '/dev/sdh'} {{(pid=85141) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 10:12:55 user nova-compute[85141]: DEBUG nova.objects.instance [None req-f66d16a1-c7ae-4f7c-96fd-20965aa64265 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] Lazy-loading 'flavor' on Instance uuid 0ca61bd2-268e-4c49-ba04-a5cb39143a9b {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:12:55 user nova-compute[85141]: DEBUG nova.virt.libvirt.guest [None req-f66d16a1-c7ae-4f7c-96fd-20965aa64265 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 10:12:55 user nova-compute[85141]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 10:12:55 user nova-compute[85141]:   <source dev="/dev/sdh"/>
Nov 16 10:12:55 user nova-compute[85141]:   <target dev="vdb" bus="virtio"/>
Nov 16 10:12:55 user nova-compute[85141]:   <serial>eff563f0-92d3-47a1-addc-e3eaa6828d59</serial>
Nov 16 10:12:55 user nova-compute[85141]: </disk>
Nov 16 10:12:55 user nova-compute[85141]:  {{(pid=85141) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 10:12:55 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-f66d16a1-c7ae-4f7c-96fd-20965aa64265 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] No BDM found with device name vda, not building metadata. {{(pid=85141) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 10:12:55 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-f66d16a1-c7ae-4f7c-96fd-20965aa64265 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] No BDM found with device name hda, not building metadata. {{(pid=85141) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 10:12:55 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-f66d16a1-c7ae-4f7c-96fd-20965aa64265 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] No VIF found with MAC fa:16:3e:12:0a:da, not building metadata {{(pid=85141) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 10:12:55 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-f66d16a1-c7ae-4f7c-96fd-20965aa64265 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] Lock "0ca61bd2-268e-4c49-ba04-a5cb39143a9b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.027s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:12:56 user nova-compute[85141]: DEBUG nova.compute.manager [req-2d0eae11-e230-4431-8726-76eef6ef7fef req-44614408-3f05-4ced-98a8-48ecd74da65b service nova] [instance: 7e2ae11f-161c-4d13-a1a5-37d0a8150e6b] Received event network-changed-f7b5e797-8f96-4f01-847a-4a5b4f208517 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:12:56 user nova-compute[85141]: DEBUG nova.compute.manager [req-2d0eae11-e230-4431-8726-76eef6ef7fef req-44614408-3f05-4ced-98a8-48ecd74da65b service nova] [instance: 7e2ae11f-161c-4d13-a1a5-37d0a8150e6b] Refreshing instance network info cache due to event network-changed-f7b5e797-8f96-4f01-847a-4a5b4f208517. {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 10:12:56 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-2d0eae11-e230-4431-8726-76eef6ef7fef req-44614408-3f05-4ced-98a8-48ecd74da65b service nova] Acquiring lock "refresh_cache-7e2ae11f-161c-4d13-a1a5-37d0a8150e6b" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:12:56 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-2d0eae11-e230-4431-8726-76eef6ef7fef req-44614408-3f05-4ced-98a8-48ecd74da65b service nova] Acquired lock "refresh_cache-7e2ae11f-161c-4d13-a1a5-37d0a8150e6b" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:12:56 user nova-compute[85141]: DEBUG nova.network.neutron [req-2d0eae11-e230-4431-8726-76eef6ef7fef req-44614408-3f05-4ced-98a8-48ecd74da65b service nova] [instance: 7e2ae11f-161c-4d13-a1a5-37d0a8150e6b] Refreshing network info cache for port f7b5e797-8f96-4f01-847a-4a5b4f208517 {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 10:12:56 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-f2061d01-654c-425f-a5a2-2dea845dbadf tempest-VolumesAssistedSnapshotsTest-799935866 tempest-VolumesAssistedSnapshotsTest-799935866-project-admin] Acquiring lock "7e2ae11f-161c-4d13-a1a5-37d0a8150e6b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:12:56 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-f2061d01-654c-425f-a5a2-2dea845dbadf tempest-VolumesAssistedSnapshotsTest-799935866 tempest-VolumesAssistedSnapshotsTest-799935866-project-admin] Lock "7e2ae11f-161c-4d13-a1a5-37d0a8150e6b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:12:56 user nova-compute[85141]: DEBUG nova.objects.instance [None req-f2061d01-654c-425f-a5a2-2dea845dbadf tempest-VolumesAssistedSnapshotsTest-799935866 tempest-VolumesAssistedSnapshotsTest-799935866-project-admin] Lazy-loading 'flavor' on Instance uuid 7e2ae11f-161c-4d13-a1a5-37d0a8150e6b {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:12:56 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-f2061d01-654c-425f-a5a2-2dea845dbadf tempest-VolumesAssistedSnapshotsTest-799935866 tempest-VolumesAssistedSnapshotsTest-799935866-project-admin] Lock "7e2ae11f-161c-4d13-a1a5-37d0a8150e6b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.085s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:12:56 user nova-compute[85141]: DEBUG nova.network.neutron [req-2d0eae11-e230-4431-8726-76eef6ef7fef req-44614408-3f05-4ced-98a8-48ecd74da65b service nova] [instance: 7e2ae11f-161c-4d13-a1a5-37d0a8150e6b] Updated VIF entry in instance network info cache for port f7b5e797-8f96-4f01-847a-4a5b4f208517. {{(pid=85141) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 10:12:56 user nova-compute[85141]: DEBUG nova.network.neutron [req-2d0eae11-e230-4431-8726-76eef6ef7fef req-44614408-3f05-4ced-98a8-48ecd74da65b service nova] [instance: 7e2ae11f-161c-4d13-a1a5-37d0a8150e6b] Updating instance_info_cache with network_info: [{"id": "f7b5e797-8f96-4f01-847a-4a5b4f208517", "address": "fa:16:3e:19:6f:78", "network": {"id": "11563c56-f3fc-41db-a612-aa4e06a845ec", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1298866398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2177d3304c7741efb82eca1323f27f92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7b5e797-8f", "ovs_interfaceid": "f7b5e797-8f96-4f01-847a-4a5b4f208517", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:12:56 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-2d0eae11-e230-4431-8726-76eef6ef7fef req-44614408-3f05-4ced-98a8-48ecd74da65b service nova] Releasing lock "refresh_cache-7e2ae11f-161c-4d13-a1a5-37d0a8150e6b" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:12:56 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-f2061d01-654c-425f-a5a2-2dea845dbadf tempest-VolumesAssistedSnapshotsTest-799935866 tempest-VolumesAssistedSnapshotsTest-799935866-project-admin] Acquiring lock "7e2ae11f-161c-4d13-a1a5-37d0a8150e6b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:12:56 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-f2061d01-654c-425f-a5a2-2dea845dbadf tempest-VolumesAssistedSnapshotsTest-799935866 tempest-VolumesAssistedSnapshotsTest-799935866-project-admin] Lock "7e2ae11f-161c-4d13-a1a5-37d0a8150e6b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:12:56 user nova-compute[85141]: INFO nova.compute.manager [None req-f2061d01-654c-425f-a5a2-2dea845dbadf tempest-VolumesAssistedSnapshotsTest-799935866 tempest-VolumesAssistedSnapshotsTest-799935866-project-admin] [instance: 7e2ae11f-161c-4d13-a1a5-37d0a8150e6b] Attaching volume ba7ca2a3-5f1e-4544-852f-d57100b608e3 to /dev/vdb
Nov 16 10:12:56 user nova-compute[85141]: DEBUG os_brick.utils [None req-f2061d01-654c-425f-a5a2-2dea845dbadf tempest-VolumesAssistedSnapshotsTest-799935866 tempest-VolumesAssistedSnapshotsTest-799935866-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 10:12:56 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:12:56 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:12:56 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc751ba2-081c-4962-a450-bef33adc1341]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c7834de5c295\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:12:56 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:12:56 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:12:56 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b096f12-b3bb-4e13-b373-55bcc3e39828]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:12:56 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:12:56 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:12:56 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c37ed52-e011-4e57-9b0a-aad2e4d903f0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:12:56 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[d13a53c3-7610-4400-b9bb-73f7b05e785d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:12:56 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-f2061d01-654c-425f-a5a2-2dea845dbadf tempest-VolumesAssistedSnapshotsTest-799935866 tempest-VolumesAssistedSnapshotsTest-799935866-project-admin] Running cmd (subprocess): nvme version {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:12:56 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-f2061d01-654c-425f-a5a2-2dea845dbadf tempest-VolumesAssistedSnapshotsTest-799935866 tempest-VolumesAssistedSnapshotsTest-799935866-project-admin] 'nvme version' failed. Not Retrying. {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 10:12:56 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f2061d01-654c-425f-a5a2-2dea845dbadf tempest-VolumesAssistedSnapshotsTest-799935866 tempest-VolumesAssistedSnapshotsTest-799935866-project-admin] nvme not present on system {{(pid=85141) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 10:12:56 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:12:56 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 10:12:56 user nova-compute[85141]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 10:12:56 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bac215a-a573-4107-923d-c8936f6a50c7]: (4, '') {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:12:56 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.lightos [None req-f2061d01-654c-425f-a5a2-2dea845dbadf tempest-VolumesAssistedSnapshotsTest-799935866 tempest-VolumesAssistedSnapshotsTest-799935866-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=85141) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 10:12:56 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.lightos [None req-f2061d01-654c-425f-a5a2-2dea845dbadf tempest-VolumesAssistedSnapshotsTest-799935866 tempest-VolumesAssistedSnapshotsTest-799935866-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=85141) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 10:12:56 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.lightos [None req-f2061d01-654c-425f-a5a2-2dea845dbadf tempest-VolumesAssistedSnapshotsTest-799935866 tempest-VolumesAssistedSnapshotsTest-799935866-project-admin] LIGHTOS: no hostnqn found. {{(pid=85141) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 10:12:56 user nova-compute[85141]: DEBUG os_brick.utils [None req-f2061d01-654c-425f-a5a2-2dea845dbadf tempest-VolumesAssistedSnapshotsTest-799935866 tempest-VolumesAssistedSnapshotsTest-799935866-project-admin] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c7834de5c295', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 10:12:56 user nova-compute[85141]: DEBUG nova.virt.block_device [None req-f2061d01-654c-425f-a5a2-2dea845dbadf tempest-VolumesAssistedSnapshotsTest-799935866 tempest-VolumesAssistedSnapshotsTest-799935866-project-admin] [instance: 7e2ae11f-161c-4d13-a1a5-37d0a8150e6b] Updating existing volume attachment record: ff26d2ce-54df-413c-a944-1f2200d26a0a {{(pid=85141) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 10:12:56 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:12:57 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:12:57 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5418d3a2-d108-4227-8569-605e55a79685 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] Acquiring lock "0ca61bd2-268e-4c49-ba04-a5cb39143a9b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:12:57 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5418d3a2-d108-4227-8569-605e55a79685 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] Lock "0ca61bd2-268e-4c49-ba04-a5cb39143a9b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:12:57 user nova-compute[85141]: INFO nova.compute.manager [None req-5418d3a2-d108-4227-8569-605e55a79685 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] [instance: 0ca61bd2-268e-4c49-ba04-a5cb39143a9b] Detaching volume eff563f0-92d3-47a1-addc-e3eaa6828d59
Nov 16 10:12:57 user nova-compute[85141]: DEBUG nova.compute.manager [None req-7563521d-9bc0-404e-87e4-0c0b253b214a tempest-TestVolumeSwap-1037451778 tempest-TestVolumeSwap-1037451778-project-admin] [instance: ad1ace46-2e8e-42e1-a0f5-2384078fcf09] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:eb0e3ad6-04d7-4405-b4ae-0440b2a396ce', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TGILpNCR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'ad1ace46-2e8e-42e1-a0f5-2384078fcf09', 'attached_at': '', 'detached_at': '', 'volume_id': 'eb0e3ad6-04d7-4405-b4ae-0440b2a396ce', 'serial': 'eb0e3ad6-04d7-4405-b4ae-0440b2a396ce'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:7e233047-dda3-4f2e-803c-7b69a57ac656', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UtNLBDJC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': 'ad1ace46-2e8e-42e1-a0f5-2384078fcf09', 'attached_at': '', 'detached_at': '', 'volume_id': '7e233047-dda3-4f2e-803c-7b69a57ac656', 'serial'} {{(pid=85141) _swap_volume /opt/stack/nova/nova/compute/manager.py:7782}}
Nov 16 10:12:57 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7563521d-9bc0-404e-87e4-0c0b253b214a tempest-TestVolumeSwap-1037451778 tempest-TestVolumeSwap-1037451778-project-admin] [instance: ad1ace46-2e8e-42e1-a0f5-2384078fcf09] Calling os-brick to attach iSCSI Volume {{(pid=85141) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 10:12:57 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-7563521d-9bc0-404e-87e4-0c0b253b214a tempest-TestVolumeSwap-1037451778 tempest-TestVolumeSwap-1037451778-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51806b6080>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:eb0e3ad6-04d7-4405-b4ae-0440b2a396ce', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TGILpNCR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 10:12:57 user nova-compute[85141]: WARNING os_brick.initiator.connectors.base [None req-7563521d-9bc0-404e-87e4-0c0b253b214a tempest-TestVolumeSwap-1037451778 tempest-TestVolumeSwap-1037451778-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 10:12:57 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-7563521d-9bc0-404e-87e4-0c0b253b214a tempest-TestVolumeSwap-1037451778 tempest-TestVolumeSwap-1037451778-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 10:12:57 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-7563521d-9bc0-404e-87e4-0c0b253b214a tempest-TestVolumeSwap-1037451778 tempest-TestVolumeSwap-1037451778-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 10:12:57 user nova-compute[85141]: WARNING os_brick.initiator.connectors.base [None req-7563521d-9bc0-404e-87e4-0c0b253b214a tempest-TestVolumeSwap-1037451778 tempest-TestVolumeSwap-1037451778-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 10:12:57 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-7563521d-9bc0-404e-87e4-0c0b253b214a tempest-TestVolumeSwap-1037451778 tempest-TestVolumeSwap-1037451778-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eb0e3ad6-04d7-4405-b4ae-0440b2a396ce" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 10:12:57 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-7563521d-9bc0-404e-87e4-0c0b253b214a tempest-TestVolumeSwap-1037451778 tempest-TestVolumeSwap-1037451778-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eb0e3ad6-04d7-4405-b4ae-0440b2a396ce" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 10:12:57 user nova-compute[85141]: INFO os_brick.initiator.connectors.iscsi [None req-7563521d-9bc0-404e-87e4-0c0b253b214a tempest-TestVolumeSwap-1037451778 tempest-TestVolumeSwap-1037451778-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 10:12:57 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb0e3ad6-04d7-4405-b4ae-0440b2a396ce -p 172.16.0.220:3260 {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:12:57 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb0e3ad6-04d7-4405-b4ae-0440b2a396ce -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:12:57 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[45446905-4859-43f6-88a1-3fa58ad6938c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:12:57 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-7563521d-9bc0-404e-87e4-0c0b253b214a tempest-TestVolumeSwap-1037451778 tempest-TestVolumeSwap-1037451778-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 10:12:57 user nova-compute[85141]:  {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:12:57 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb0e3ad6-04d7-4405-b4ae-0440b2a396ce -p 172.16.0.220:3260 --interface default --op new {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:12:57 user nova-compute[85141]: INFO nova.virt.block_device [None req-5418d3a2-d108-4227-8569-605e55a79685 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] [instance: 0ca61bd2-268e-4c49-ba04-a5cb39143a9b] Attempting to driver detach volume eff563f0-92d3-47a1-addc-e3eaa6828d59 from mountpoint /dev/vdb
Nov 16 10:12:57 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb0e3ad6-04d7-4405-b4ae-0440b2a396ce -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:12:57 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[b438bfef-e38a-4dbf-af5d-28208b5a215e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:eb0e3ad6-04d7-4405-b4ae-0440b2a396ce] added\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:12:57 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-7563521d-9bc0-404e-87e4-0c0b253b214a tempest-TestVolumeSwap-1037451778 tempest-TestVolumeSwap-1037451778-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:eb0e3ad6-04d7-4405-b4ae-0440b2a396ce] added
Nov 16 10:12:57 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:12:57 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-5418d3a2-d108-4227-8569-605e55a79685 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] Attempting to detach device vdb from instance 0ca61bd2-268e-4c49-ba04-a5cb39143a9b from the persistent domain config. {{(pid=85141) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 10:12:57 user nova-compute[85141]: DEBUG nova.virt.libvirt.guest [None req-5418d3a2-d108-4227-8569-605e55a79685 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 10:12:57 user nova-compute[85141]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 10:12:57 user nova-compute[85141]:   <source dev="/dev/sdh"/>
Nov 16 10:12:57 user nova-compute[85141]:   <target dev="vdb" bus="virtio"/>
Nov 16 10:12:57 user nova-compute[85141]:   <serial>eff563f0-92d3-47a1-addc-e3eaa6828d59</serial>
Nov 16 10:12:57 user nova-compute[85141]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 16 10:12:57 user nova-compute[85141]: </disk>
Nov 16 10:12:57 user nova-compute[85141]:  {{(pid=85141) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 10:12:57 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb0e3ad6-04d7-4405-b4ae-0440b2a396ce -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:12:57 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-5418d3a2-d108-4227-8569-605e55a79685 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] Successfully detached device vdb from instance 0ca61bd2-268e-4c49-ba04-a5cb39143a9b from the persistent domain config.
Nov 16 10:12:57 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-5418d3a2-d108-4227-8569-605e55a79685 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0ca61bd2-268e-4c49-ba04-a5cb39143a9b from the live domain config. {{(pid=85141) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 10:12:57 user nova-compute[85141]: DEBUG nova.virt.libvirt.guest [None req-5418d3a2-d108-4227-8569-605e55a79685 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 10:12:57 user nova-compute[85141]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 10:12:57 user nova-compute[85141]:   <source dev="/dev/sdh"/>
Nov 16 10:12:57 user nova-compute[85141]:   <target dev="vdb" bus="virtio"/>
Nov 16 10:12:57 user nova-compute[85141]:   <serial>eff563f0-92d3-47a1-addc-e3eaa6828d59</serial>
Nov 16 10:12:57 user nova-compute[85141]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 16 10:12:57 user nova-compute[85141]: </disk>
Nov 16 10:12:57 user nova-compute[85141]:  {{(pid=85141) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 10:12:57 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb0e3ad6-04d7-4405-b4ae-0440b2a396ce -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:12:57 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[25731c92-6189-40b5-b2d6-79ef18190eb9]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:12:57 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-7563521d-9bc0-404e-87e4-0c0b253b214a tempest-TestVolumeSwap-1037451778 tempest-TestVolumeSwap-1037451778-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:12:57 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb0e3ad6-04d7-4405-b4ae-0440b2a396ce -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:12:57 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb0e3ad6-04d7-4405-b4ae-0440b2a396ce -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:12:57 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[df0a2703-144e-4234-9a57-1c14cb607db1]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:12:57 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-7563521d-9bc0-404e-87e4-0c0b253b214a tempest-TestVolumeSwap-1037451778 tempest-TestVolumeSwap-1037451778-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:12:57 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb0e3ad6-04d7-4405-b4ae-0440b2a396ce -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TGILpNCR {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:12:57 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb0e3ad6-04d7-4405-b4ae-0440b2a396ce -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TGILpNCR" returned: 0 in 0.025s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:12:57 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a8ada3b-f181-427b-bbd2-de92efd43baf]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:12:57 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-7563521d-9bc0-404e-87e4-0c0b253b214a tempest-TestVolumeSwap-1037451778 tempest-TestVolumeSwap-1037451778-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TGILpNCR'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:12:57 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb0e3ad6-04d7-4405-b4ae-0440b2a396ce -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:12:57 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb0e3ad6-04d7-4405-b4ae-0440b2a396ce -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:12:57 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a0f4a58-f375-4e1f-bdb4-96238b4536e8]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:12:57 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-7563521d-9bc0-404e-87e4-0c0b253b214a tempest-TestVolumeSwap-1037451778 tempest-TestVolumeSwap-1037451778-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:12:57 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:12:57 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:12:57 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[992ede7e-3a09-46d4-a45a-8ac4fddabc3f]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eff563f0-92d3-47a1-addc-e3eaa6828d59 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42c041ec-fa39-4035-b82b-867caf3565df (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4df10d9-a60c-45ed-981d-96f704534fb8 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4973f768-f126-41d6-b534-458d6c49f9b3 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fcde20-e019-4cf0-ad90-6c8100f4a8d2 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5feab5a7-6ec4-4e13-84bc-bff657a0d0de (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e233047-dda3-4f2e-803c-7b69a57ac656 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ca01473-0233-4122-b008-ffa407ca3e70 (non-flash)\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:12:57 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-7563521d-9bc0-404e-87e4-0c0b253b214a tempest-TestVolumeSwap-1037451778 tempest-TestVolumeSwap-1037451778-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eff563f0-92d3-47a1-addc-e3eaa6828d59 (non-flash)
Nov 16 10:12:57 user nova-compute[85141]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42c041ec-fa39-4035-b82b-867caf3565df (non-flash)
Nov 16 10:12:57 user nova-compute[85141]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4df10d9-a60c-45ed-981d-96f704534fb8 (non-flash)
Nov 16 10:12:57 user nova-compute[85141]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4973f768-f126-41d6-b534-458d6c49f9b3 (non-flash)
Nov 16 10:12:57 user nova-compute[85141]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fcde20-e019-4cf0-ad90-6c8100f4a8d2 (non-flash)
Nov 16 10:12:57 user nova-compute[85141]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5feab5a7-6ec4-4e13-84bc-bff657a0d0de (non-flash)
Nov 16 10:12:57 user nova-compute[85141]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e233047-dda3-4f2e-803c-7b69a57ac656 (non-flash)
Nov 16 10:12:57 user nova-compute[85141]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ca01473-0233-4122-b008-ffa407ca3e70 (non-flash)
Nov 16 10:12:57 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:12:57 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-7563521d-9bc0-404e-87e4-0c0b253b214a tempest-TestVolumeSwap-1037451778 tempest-TestVolumeSwap-1037451778-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eff563f0-92d3-47a1-addc-e3eaa6828d59 (non-flash)
Nov 16 10:12:57 user nova-compute[85141]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42c041ec-fa39-4035-b82b-867caf3565df (non-flash)
Nov 16 10:12:57 user nova-compute[85141]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4df10d9-a60c-45ed-981d-96f704534fb8 (non-flash)
Nov 16 10:12:57 user nova-compute[85141]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4973f768-f126-41d6-b534-458d6c49f9b3 (non-flash)
Nov 16 10:12:57 user nova-compute[85141]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fcde20-e019-4cf0-ad90-6c8100f4a8d2 (non-flash)
Nov 16 10:12:57 user nova-compute[85141]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5feab5a7-6ec4-4e13-84bc-bff657a0d0de (non-flash)
Nov 16 10:12:57 user nova-compute[85141]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e233047-dda3-4f2e-803c-7b69a57ac656 (non-flash)
Nov 16 10:12:57 user nova-compute[85141]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ca01473-0233-4122-b008-ffa407ca3e70 (non-flash)
Nov 16 10:12:57 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 10:12:57 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb0e3ad6-04d7-4405-b4ae-0440b2a396ce -p 172.16.0.220:3260 --login {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:12:57 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-5418d3a2-d108-4227-8569-605e55a79685 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0ca61bd2-268e-4c49-ba04-a5cb39143a9b {{(pid=85141) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 10:12:58 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb0e3ad6-04d7-4405-b4ae-0440b2a396ce -p 172.16.0.220:3260 --login" returned: 0 in 1.093s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:12:58 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[6165eabe-9b1f-4858-8825-9655e185d9ec]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:eb0e3ad6-04d7-4405-b4ae-0440b2a396ce, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:eb0e3ad6-04d7-4405-b4ae-0440b2a396ce, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:12:58 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-7563521d-9bc0-404e-87e4-0c0b253b214a tempest-TestVolumeSwap-1037451778 tempest-TestVolumeSwap-1037451778-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:eb0e3ad6-04d7-4405-b4ae-0440b2a396ce, portal: 172.16.0.220,3260]
Nov 16 10:12:58 user nova-compute[85141]: Login to [iface: default, target: iqn.2010-10.org.openstack:eb0e3ad6-04d7-4405-b4ae-0440b2a396ce, portal: 172.16.0.220,3260] successful.
Nov 16 10:12:58 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:12:58 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb0e3ad6-04d7-4405-b4ae-0440b2a396ce -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:12:58 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb0e3ad6-04d7-4405-b4ae-0440b2a396ce -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:12:58 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[131ab651-0bb0-455c-afe7-27c3336c6ab0]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:12:58 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-7563521d-9bc0-404e-87e4-0c0b253b214a tempest-TestVolumeSwap-1037451778 tempest-TestVolumeSwap-1037451778-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:12:58 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:12:58 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:12:58 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[4217224c-5e8c-4701-b31d-579e528de85a]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eff563f0-92d3-47a1-addc-e3eaa6828d59 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42c041ec-fa39-4035-b82b-867caf3565df (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb0e3ad6-04d7-4405-b4ae-0440b2a396ce (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4df10d9-a60c-45ed-981d-96f704534fb8 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4973f768-f126-41d6-b534-458d6c49f9b3 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fcde20-e019-4cf0-ad90-6c8100f4a8d2 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5feab5a7-6ec4-4e13-84bc-bff657a0d0de (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e233047-dda3-4f2e-803c-7b69a57ac656 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ca01473-0233-4122-b008-ffa407ca3e70 (non-flash)\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:12:58 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-7563521d-9bc0-404e-87e4-0c0b253b214a tempest-TestVolumeSwap-1037451778 tempest-TestVolumeSwap-1037451778-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eff563f0-92d3-47a1-addc-e3eaa6828d59 (non-flash)
Nov 16 10:12:58 user nova-compute[85141]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42c041ec-fa39-4035-b82b-867caf3565df (non-flash)
Nov 16 10:12:58 user nova-compute[85141]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb0e3ad6-04d7-4405-b4ae-0440b2a396ce (non-flash)
Nov 16 10:12:58 user nova-compute[85141]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4df10d9-a60c-45ed-981d-96f704534fb8 (non-flash)
Nov 16 10:12:58 user nova-compute[85141]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4973f768-f126-41d6-b534-458d6c49f9b3 (non-flash)
Nov 16 10:12:58 user nova-compute[85141]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fcde20-e019-4cf0-ad90-6c8100f4a8d2 (non-flash)
Nov 16 10:12:58 user nova-compute[85141]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5feab5a7-6ec4-4e13-84bc-bff657a0d0de (non-flash)
Nov 16 10:12:58 user nova-compute[85141]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e233047-dda3-4f2e-803c-7b69a57ac656 (non-flash)
Nov 16 10:12:58 user nova-compute[85141]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ca01473-0233-4122-b008-ffa407ca3e70 (non-flash)
Nov 16 10:12:58 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:12:58 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-7563521d-9bc0-404e-87e4-0c0b253b214a tempest-TestVolumeSwap-1037451778 tempest-TestVolumeSwap-1037451778-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eff563f0-92d3-47a1-addc-e3eaa6828d59 (non-flash)
Nov 16 10:12:58 user nova-compute[85141]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42c041ec-fa39-4035-b82b-867caf3565df (non-flash)
Nov 16 10:12:58 user nova-compute[85141]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb0e3ad6-04d7-4405-b4ae-0440b2a396ce (non-flash)
Nov 16 10:12:58 user nova-compute[85141]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4df10d9-a60c-45ed-981d-96f704534fb8 (non-flash)
Nov 16 10:12:58 user nova-compute[85141]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4973f768-f126-41d6-b534-458d6c49f9b3 (non-flash)
Nov 16 10:12:58 user nova-compute[85141]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fcde20-e019-4cf0-ad90-6c8100f4a8d2 (non-flash)
Nov 16 10:12:58 user nova-compute[85141]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5feab5a7-6ec4-4e13-84bc-bff657a0d0de (non-flash)
Nov 16 10:12:58 user nova-compute[85141]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e233047-dda3-4f2e-803c-7b69a57ac656 (non-flash)
Nov 16 10:12:58 user nova-compute[85141]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ca01473-0233-4122-b008-ffa407ca3e70 (non-flash)
Nov 16 10:12:58 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 10:12:58 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-7563521d-9bc0-404e-87e4-0c0b253b214a tempest-TestVolumeSwap-1037451778 tempest-TestVolumeSwap-1037451778-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eb0e3ad6-04d7-4405-b4ae-0440b2a396ce" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.348s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 10:12:58 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-7563521d-9bc0-404e-87e4-0c0b253b214a tempest-TestVolumeSwap-1037451778 tempest-TestVolumeSwap-1037451778-project-admin] Connected to 172.16.0.220:3260 {{(pid=85141) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 10:12:58 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-7563521d-9bc0-404e-87e4-0c0b253b214a tempest-TestVolumeSwap-1037451778 tempest-TestVolumeSwap-1037451778-project-admin] HCTL ('41', '-', '-', 0) found on session 12 with lun 0 {{(pid=85141) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 10:12:58 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-7563521d-9bc0-404e-87e4-0c0b253b214a tempest-TestVolumeSwap-1037451778 tempest-TestVolumeSwap-1037451778-project-admin] Scanning host 41 c: -, t: -, l: 0) {{(pid=85141) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 10:12:58 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:12:58 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.017s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:12:58 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c55f3d4-b293-4676-959e-d9a5dbc9abc1]: (4, ('- - 0', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:12:58 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-7563521d-9bc0-404e-87e4-0c0b253b214a tempest-TestVolumeSwap-1037451778 tempest-TestVolumeSwap-1037451778-project-admin] Searching for a device in session 12 and hctl ['41', '*', '*', 0] yield: None {{(pid=85141) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 10:12:59 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-7563521d-9bc0-404e-87e4-0c0b253b214a tempest-TestVolumeSwap-1037451778 tempest-TestVolumeSwap-1037451778-project-admin] Searching for a device in session 12 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=85141) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 10:12:59 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-7563521d-9bc0-404e-87e4-0c0b253b214a tempest-TestVolumeSwap-1037451778 tempest-TestVolumeSwap-1037451778-project-admin] Connected to sdj using {'target_iqn': 'iqn.2010-10.org.openstack:eb0e3ad6-04d7-4405-b4ae-0440b2a396ce', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TGILpNCR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=85141) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 10:12:59 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-7563521d-9bc0-404e-87e4-0c0b253b214a tempest-TestVolumeSwap-1037451778 tempest-TestVolumeSwap-1037451778-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.386s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 10:12:59 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-7563521d-9bc0-404e-87e4-0c0b253b214a tempest-TestVolumeSwap-1037451778 tempest-TestVolumeSwap-1037451778-project-admin] <== connect_volume: return (2388ms) {'type': 'block', 'scsi_wwn': '26236306331306637', 'path': '/dev/sdj'} {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 10:12:59 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7563521d-9bc0-404e-87e4-0c0b253b214a tempest-TestVolumeSwap-1037451778 tempest-TestVolumeSwap-1037451778-project-admin] [instance: ad1ace46-2e8e-42e1-a0f5-2384078fcf09] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26236306331306637', 'path': '/dev/sdj'} {{(pid=85141) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 10:12:59 user nova-compute[85141]: DEBUG nova.objects.instance [None req-7563521d-9bc0-404e-87e4-0c0b253b214a tempest-TestVolumeSwap-1037451778 tempest-TestVolumeSwap-1037451778-project-admin] Lazy-loading 'flavor' on Instance uuid ad1ace46-2e8e-42e1-a0f5-2384078fcf09 {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:13:00 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-b7e5d344-969a-41ad-8e49-3965984c0748 tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] Acquiring lock "8f872e56-0fdc-4d3c-ab3d-64497d036dc8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:13:00 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-b7e5d344-969a-41ad-8e49-3965984c0748 tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] Lock "8f872e56-0fdc-4d3c-ab3d-64497d036dc8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:13:00 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-b7e5d344-969a-41ad-8e49-3965984c0748 tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] Acquiring lock "8f872e56-0fdc-4d3c-ab3d-64497d036dc8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:13:00 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-b7e5d344-969a-41ad-8e49-3965984c0748 tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] Lock "8f872e56-0fdc-4d3c-ab3d-64497d036dc8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:13:00 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-b7e5d344-969a-41ad-8e49-3965984c0748 tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] Lock "8f872e56-0fdc-4d3c-ab3d-64497d036dc8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:13:00 user nova-compute[85141]: INFO nova.compute.manager [None req-b7e5d344-969a-41ad-8e49-3965984c0748 tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] [instance: 8f872e56-0fdc-4d3c-ab3d-64497d036dc8] Terminating instance
Nov 16 10:13:00 user nova-compute[85141]: DEBUG nova.compute.manager [None req-b7e5d344-969a-41ad-8e49-3965984c0748 tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] [instance: 8f872e56-0fdc-4d3c-ab3d-64497d036dc8] Start destroying the instance on the hypervisor. {{(pid=85141) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 10:13:00 user nova-compute[85141]: DEBUG nova.virt.libvirt.guest [None req-7563521d-9bc0-404e-87e4-0c0b253b214a tempest-TestVolumeSwap-1037451778 tempest-TestVolumeSwap-1037451778-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=85141) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 10:13:00 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:13:00 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:13:00 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:13:00 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:13:00 user nova-compute[85141]: DEBUG nova.compute.manager [req-974aa0d3-4e72-4e77-a455-9a850879bc2d req-cbb9bc2f-d1ba-477a-ac37-37fafd570f49 service nova] [instance: 8f872e56-0fdc-4d3c-ab3d-64497d036dc8] Received event network-vif-unplugged-d2be9459-4384-4c88-931b-098de7e2413d {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:13:00 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-974aa0d3-4e72-4e77-a455-9a850879bc2d req-cbb9bc2f-d1ba-477a-ac37-37fafd570f49 service nova] Acquiring lock "8f872e56-0fdc-4d3c-ab3d-64497d036dc8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:13:00 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-974aa0d3-4e72-4e77-a455-9a850879bc2d req-cbb9bc2f-d1ba-477a-ac37-37fafd570f49 service nova] Lock "8f872e56-0fdc-4d3c-ab3d-64497d036dc8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:13:00 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-974aa0d3-4e72-4e77-a455-9a850879bc2d req-cbb9bc2f-d1ba-477a-ac37-37fafd570f49 service nova] Lock "8f872e56-0fdc-4d3c-ab3d-64497d036dc8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:13:00 user nova-compute[85141]: DEBUG nova.compute.manager [req-974aa0d3-4e72-4e77-a455-9a850879bc2d req-cbb9bc2f-d1ba-477a-ac37-37fafd570f49 service nova] [instance: 8f872e56-0fdc-4d3c-ab3d-64497d036dc8] No waiting events found dispatching network-vif-unplugged-d2be9459-4384-4c88-931b-098de7e2413d {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:13:00 user nova-compute[85141]: DEBUG nova.compute.manager [req-974aa0d3-4e72-4e77-a455-9a850879bc2d req-cbb9bc2f-d1ba-477a-ac37-37fafd570f49 service nova] [instance: 8f872e56-0fdc-4d3c-ab3d-64497d036dc8] Received event network-vif-unplugged-d2be9459-4384-4c88-931b-098de7e2413d for instance with task_state deleting. {{(pid=85141) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 10:13:00 user nova-compute[85141]: DEBUG nova.virt.libvirt.guest [None req-7563521d-9bc0-404e-87e4-0c0b253b214a tempest-TestVolumeSwap-1037451778 tempest-TestVolumeSwap-1037451778-project-admin] COPY block job progress, current cursor: 128974848 final cursor: 1073741824 {{(pid=85141) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 10:13:00 user nova-compute[85141]: INFO nova.virt.libvirt.driver [-] [instance: 8f872e56-0fdc-4d3c-ab3d-64497d036dc8] Instance destroyed successfully.
Nov 16 10:13:00 user nova-compute[85141]: DEBUG nova.objects.instance [None req-b7e5d344-969a-41ad-8e49-3965984c0748 tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] Lazy-loading 'resources' on Instance uuid 8f872e56-0fdc-4d3c-ab3d-64497d036dc8 {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:13:01 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-b7e5d344-969a-41ad-8e49-3965984c0748 tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T10:11:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1670250104',display_name='tempest-VolumesActionsTest-instance-1670250104',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1670250104',id=11,image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-16T10:11:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b35983b98d3c404d8cddce2894f97dba',ramdisk_id='',reservation_id='r-jxybo979',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1337688058',owner_user_name='tempest-VolumesActionsTest-1337688058-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T10:11:20Z,user_data=None,user_id='3b83d10371214ba68a125f52df7e33ad',uuid=8f872e56-0fdc-4d3c-ab3d-64497d036dc8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d2be9459-4384-4c88-931b-098de7e2413d", "address": "fa:16:3e:7d:fc:b3", "network": {"id": "20b79aa8-c67e-4ab4-aa9f-659587f8bcb2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1635312124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b35983b98d3c404d8cddce2894f97dba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2be9459-43", "ovs_interfaceid": "d2be9459-4384-4c88-931b-098de7e2413d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 10:13:01 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-b7e5d344-969a-41ad-8e49-3965984c0748 tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] Converting VIF {"id": "d2be9459-4384-4c88-931b-098de7e2413d", "address": "fa:16:3e:7d:fc:b3", "network": {"id": "20b79aa8-c67e-4ab4-aa9f-659587f8bcb2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1635312124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b35983b98d3c404d8cddce2894f97dba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2be9459-43", "ovs_interfaceid": "d2be9459-4384-4c88-931b-098de7e2413d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:13:01 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-b7e5d344-969a-41ad-8e49-3965984c0748 tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:fc:b3,bridge_name='br-int',has_traffic_filtering=True,id=d2be9459-4384-4c88-931b-098de7e2413d,network=Network(20b79aa8-c67e-4ab4-aa9f-659587f8bcb2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2be9459-43') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:13:01 user nova-compute[85141]: DEBUG os_vif [None req-b7e5d344-969a-41ad-8e49-3965984c0748 tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:fc:b3,bridge_name='br-int',has_traffic_filtering=True,id=d2be9459-4384-4c88-931b-098de7e2413d,network=Network(20b79aa8-c67e-4ab4-aa9f-659587f8bcb2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2be9459-43') {{(pid=85141) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 10:13:01 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:13:01 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd2be9459-43, bridge=br-int, if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:13:01 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:13:01 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:13:01 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:13:01 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=629863bb-ac1a-47bf-b7e4-c3a6360bd8c3) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:13:01 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:13:01 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:13:01 user nova-compute[85141]: INFO os_vif [None req-b7e5d344-969a-41ad-8e49-3965984c0748 tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:fc:b3,bridge_name='br-int',has_traffic_filtering=True,id=d2be9459-4384-4c88-931b-098de7e2413d,network=Network(20b79aa8-c67e-4ab4-aa9f-659587f8bcb2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2be9459-43')
Nov 16 10:13:01 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-b7e5d344-969a-41ad-8e49-3965984c0748 tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] [instance: 8f872e56-0fdc-4d3c-ab3d-64497d036dc8] Deleting instance files /opt/stack/data/nova/instances/8f872e56-0fdc-4d3c-ab3d-64497d036dc8_del
Nov 16 10:13:01 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-b7e5d344-969a-41ad-8e49-3965984c0748 tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] [instance: 8f872e56-0fdc-4d3c-ab3d-64497d036dc8] Deletion of /opt/stack/data/nova/instances/8f872e56-0fdc-4d3c-ab3d-64497d036dc8_del complete
Nov 16 10:13:01 user nova-compute[85141]: INFO nova.compute.manager [None req-b7e5d344-969a-41ad-8e49-3965984c0748 tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] [instance: 8f872e56-0fdc-4d3c-ab3d-64497d036dc8] Took 1.01 seconds to destroy the instance on the hypervisor.
Nov 16 10:13:01 user nova-compute[85141]: DEBUG oslo.service.loopingcall [None req-b7e5d344-969a-41ad-8e49-3965984c0748 tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=85141) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 10:13:01 user nova-compute[85141]: DEBUG nova.compute.manager [-] [instance: 8f872e56-0fdc-4d3c-ab3d-64497d036dc8] Deallocating network for instance {{(pid=85141) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 10:13:01 user nova-compute[85141]: DEBUG nova.network.neutron [-] [instance: 8f872e56-0fdc-4d3c-ab3d-64497d036dc8] deallocate_for_instance() {{(pid=85141) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 10:13:01 user nova-compute[85141]: DEBUG nova.virt.libvirt.guest [None req-7563521d-9bc0-404e-87e4-0c0b253b214a tempest-TestVolumeSwap-1037451778 tempest-TestVolumeSwap-1037451778-project-admin] COPY block job progress, current cursor: 244318208 final cursor: 1073741824 {{(pid=85141) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 10:13:01 user nova-compute[85141]: DEBUG nova.network.neutron [-] [instance: 8f872e56-0fdc-4d3c-ab3d-64497d036dc8] Updating instance_info_cache with network_info: [] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:13:01 user nova-compute[85141]: INFO nova.compute.manager [-] [instance: 8f872e56-0fdc-4d3c-ab3d-64497d036dc8] Took 0.51 seconds to deallocate network for instance.
Nov 16 10:13:01 user nova-compute[85141]: DEBUG nova.compute.manager [req-0b341683-4b1f-406e-8571-6e50a7a29e2d req-e6a5f52d-4a17-4645-9213-a77c8ff16f21 service nova] [instance: 8f872e56-0fdc-4d3c-ab3d-64497d036dc8] Received event network-vif-deleted-d2be9459-4384-4c88-931b-098de7e2413d {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:13:01 user nova-compute[85141]: INFO nova.compute.manager [req-0b341683-4b1f-406e-8571-6e50a7a29e2d req-e6a5f52d-4a17-4645-9213-a77c8ff16f21 service nova] [instance: 8f872e56-0fdc-4d3c-ab3d-64497d036dc8] Neutron deleted interface d2be9459-4384-4c88-931b-098de7e2413d; detaching it from the instance and deleting it from the info cache
Nov 16 10:13:01 user nova-compute[85141]: DEBUG nova.network.neutron [req-0b341683-4b1f-406e-8571-6e50a7a29e2d req-e6a5f52d-4a17-4645-9213-a77c8ff16f21 service nova] [instance: 8f872e56-0fdc-4d3c-ab3d-64497d036dc8] Updating instance_info_cache with network_info: [] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:13:01 user nova-compute[85141]: DEBUG nova.compute.manager [req-0b341683-4b1f-406e-8571-6e50a7a29e2d req-e6a5f52d-4a17-4645-9213-a77c8ff16f21 service nova] [instance: 8f872e56-0fdc-4d3c-ab3d-64497d036dc8] Detach interface failed, port_id=d2be9459-4384-4c88-931b-098de7e2413d, reason: Instance 8f872e56-0fdc-4d3c-ab3d-64497d036dc8 could not be found. {{(pid=85141) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 16 10:13:01 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-b7e5d344-969a-41ad-8e49-3965984c0748 tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:13:01 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-b7e5d344-969a-41ad-8e49-3965984c0748 tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:13:01 user nova-compute[85141]: DEBUG nova.virt.libvirt.guest [None req-7563521d-9bc0-404e-87e4-0c0b253b214a tempest-TestVolumeSwap-1037451778 tempest-TestVolumeSwap-1037451778-project-admin] COPY block job progress, current cursor: 352321536 final cursor: 1073741824 {{(pid=85141) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 10:13:02 user nova-compute[85141]: DEBUG nova.compute.provider_tree [None req-b7e5d344-969a-41ad-8e49-3965984c0748 tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] Inventory has not changed in ProviderTree for provider: bf8e0fa1-16b6-408f-9203-c4cd63916272 {{(pid=85141) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 10:13:02 user nova-compute[85141]: DEBUG nova.scheduler.client.report [None req-b7e5d344-969a-41ad-8e49-3965984c0748 tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] Inventory has not changed for provider bf8e0fa1-16b6-408f-9203-c4cd63916272 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=85141) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 10:13:02 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:13:02 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-b7e5d344-969a-41ad-8e49-3965984c0748 tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.387s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:13:02 user nova-compute[85141]: INFO nova.scheduler.client.report [None req-b7e5d344-969a-41ad-8e49-3965984c0748 tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] Deleted allocations for instance 8f872e56-0fdc-4d3c-ab3d-64497d036dc8
Nov 16 10:13:02 user nova-compute[85141]: DEBUG nova.virt.libvirt.guest [None req-7563521d-9bc0-404e-87e4-0c0b253b214a tempest-TestVolumeSwap-1037451778 tempest-TestVolumeSwap-1037451778-project-admin] COPY block job progress, current cursor: 450887680 final cursor: 1073741824 {{(pid=85141) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 10:13:02 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-b7e5d344-969a-41ad-8e49-3965984c0748 tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] Lock "8f872e56-0fdc-4d3c-ab3d-64497d036dc8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.172s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:13:02 user nova-compute[85141]: DEBUG nova.compute.manager [req-6ea55350-a05f-4380-99fc-6e2862b86f0f req-d440c4bd-8404-4e3a-9909-942d286bae52 service nova] [instance: 8f872e56-0fdc-4d3c-ab3d-64497d036dc8] Received event network-vif-plugged-d2be9459-4384-4c88-931b-098de7e2413d {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:13:02 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-6ea55350-a05f-4380-99fc-6e2862b86f0f req-d440c4bd-8404-4e3a-9909-942d286bae52 service nova] Acquiring lock "8f872e56-0fdc-4d3c-ab3d-64497d036dc8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:13:02 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-6ea55350-a05f-4380-99fc-6e2862b86f0f req-d440c4bd-8404-4e3a-9909-942d286bae52 service nova] Lock "8f872e56-0fdc-4d3c-ab3d-64497d036dc8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:13:02 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-6ea55350-a05f-4380-99fc-6e2862b86f0f req-d440c4bd-8404-4e3a-9909-942d286bae52 service nova] Lock "8f872e56-0fdc-4d3c-ab3d-64497d036dc8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:13:02 user nova-compute[85141]: DEBUG nova.compute.manager [req-6ea55350-a05f-4380-99fc-6e2862b86f0f req-d440c4bd-8404-4e3a-9909-942d286bae52 service nova] [instance: 8f872e56-0fdc-4d3c-ab3d-64497d036dc8] No waiting events found dispatching network-vif-plugged-d2be9459-4384-4c88-931b-098de7e2413d {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:13:02 user nova-compute[85141]: WARNING nova.compute.manager [req-6ea55350-a05f-4380-99fc-6e2862b86f0f req-d440c4bd-8404-4e3a-9909-942d286bae52 service nova] [instance: 8f872e56-0fdc-4d3c-ab3d-64497d036dc8] Received unexpected event network-vif-plugged-d2be9459-4384-4c88-931b-098de7e2413d for instance with vm_state deleted and task_state None.
Nov 16 10:13:02 user nova-compute[85141]: DEBUG nova.compute.manager [req-68a55eb0-e7c0-4da6-939c-890e936d1f9c req-bd0fc40c-5c22-495c-9b02-bdd84225c7f6 service nova] [instance: 6caf3667-5613-4ef4-a597-1820e6c1c0ac] Received event volume-reimaged-42c041ec-fa39-4035-b82b-867caf3565df {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:13:02 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-68a55eb0-e7c0-4da6-939c-890e936d1f9c req-bd0fc40c-5c22-495c-9b02-bdd84225c7f6 service nova] Acquiring lock "6caf3667-5613-4ef4-a597-1820e6c1c0ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:13:02 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-68a55eb0-e7c0-4da6-939c-890e936d1f9c req-bd0fc40c-5c22-495c-9b02-bdd84225c7f6 service nova] Lock "6caf3667-5613-4ef4-a597-1820e6c1c0ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:13:02 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-68a55eb0-e7c0-4da6-939c-890e936d1f9c req-bd0fc40c-5c22-495c-9b02-bdd84225c7f6 service nova] Lock "6caf3667-5613-4ef4-a597-1820e6c1c0ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:13:02 user nova-compute[85141]: DEBUG nova.compute.manager [req-68a55eb0-e7c0-4da6-939c-890e936d1f9c req-bd0fc40c-5c22-495c-9b02-bdd84225c7f6 service nova] [instance: 6caf3667-5613-4ef4-a597-1820e6c1c0ac] Processing event volume-reimaged-42c041ec-fa39-4035-b82b-867caf3565df {{(pid=85141) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10872}}
Nov 16 10:13:02 user nova-compute[85141]: DEBUG nova.compute.manager [None req-68a55eb0-e7c0-4da6-939c-890e936d1f9c tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] [instance: 6caf3667-5613-4ef4-a597-1820e6c1c0ac] Instance event wait completed in 13 seconds for volume-reimaged {{(pid=85141) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 10:13:02 user nova-compute[85141]: DEBUG nova.virt.libvirt.guest [None req-7563521d-9bc0-404e-87e4-0c0b253b214a tempest-TestVolumeSwap-1037451778 tempest-TestVolumeSwap-1037451778-project-admin] COPY block job progress, current cursor: 619708416 final cursor: 1073741824 {{(pid=85141) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 10:13:02 user nova-compute[85141]: INFO nova.virt.block_device [None req-68a55eb0-e7c0-4da6-939c-890e936d1f9c tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] [instance: 6caf3667-5613-4ef4-a597-1820e6c1c0ac] Booting with volume 42c041ec-fa39-4035-b82b-867caf3565df at /dev/vda
Nov 16 10:13:02 user nova-compute[85141]: DEBUG os_brick.utils [None req-68a55eb0-e7c0-4da6-939c-890e936d1f9c tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 10:13:02 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:13:02 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:13:02 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbf46c21-003f-4a8d-b047-39fc8d5aa78d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c7834de5c295\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:13:02 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:13:03 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.098s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:13:03 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1f029ab-0c8a-4664-b41a-6aeaf73f5dcb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:13:03 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:13:03 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:13:03 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[babe9a73-30d0-4e6b-8eef-b6a27a78df57]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:13:03 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[a73094fd-9d67-4888-9af9-951a2f4cdfb7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:13:03 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-68a55eb0-e7c0-4da6-939c-890e936d1f9c tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] Running cmd (subprocess): nvme version {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:13:03 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-68a55eb0-e7c0-4da6-939c-890e936d1f9c tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] 'nvme version' failed. Not Retrying. {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 10:13:03 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.nvmeof [None req-68a55eb0-e7c0-4da6-939c-890e936d1f9c tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] nvme not present on system {{(pid=85141) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 10:13:03 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:13:03 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 10:13:03 user nova-compute[85141]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 10:13:03 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[09074fe7-c4d9-43a4-bd55-807ff53930f9]: (4, '') {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:13:03 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.lightos [None req-68a55eb0-e7c0-4da6-939c-890e936d1f9c tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=85141) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 10:13:03 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.lightos [None req-68a55eb0-e7c0-4da6-939c-890e936d1f9c tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=85141) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 10:13:03 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.lightos [None req-68a55eb0-e7c0-4da6-939c-890e936d1f9c tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] LIGHTOS: no hostnqn found. {{(pid=85141) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 10:13:03 user nova-compute[85141]: DEBUG os_brick.utils [None req-68a55eb0-e7c0-4da6-939c-890e936d1f9c tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] <== get_connector_properties: return (201ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c7834de5c295', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 10:13:03 user nova-compute[85141]: DEBUG nova.virt.block_device [None req-68a55eb0-e7c0-4da6-939c-890e936d1f9c tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] [instance: 6caf3667-5613-4ef4-a597-1820e6c1c0ac] Updating existing volume attachment record: 9202a934-bd2b-40c8-9ab6-9d878fee4c13 {{(pid=85141) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 10:13:03 user nova-compute[85141]: DEBUG nova.virt.libvirt.guest [None req-7563521d-9bc0-404e-87e4-0c0b253b214a tempest-TestVolumeSwap-1037451778 tempest-TestVolumeSwap-1037451778-project-admin] COPY block job progress, current cursor: 621805568 final cursor: 1073741824 {{(pid=85141) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 10:13:03 user nova-compute[85141]: DEBUG nova.virt.libvirt.guest [None req-7563521d-9bc0-404e-87e4-0c0b253b214a tempest-TestVolumeSwap-1037451778 tempest-TestVolumeSwap-1037451778-project-admin] COPY block job progress, current cursor: 621805568 final cursor: 1073741824 {{(pid=85141) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 10:13:04 user nova-compute[85141]: DEBUG nova.virt.libvirt.guest [None req-7563521d-9bc0-404e-87e4-0c0b253b214a tempest-TestVolumeSwap-1037451778 tempest-TestVolumeSwap-1037451778-project-admin] COPY block job progress, current cursor: 656408576 final cursor: 1073741824 {{(pid=85141) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 10:13:04 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f2061d01-654c-425f-a5a2-2dea845dbadf tempest-VolumesAssistedSnapshotsTest-799935866 tempest-VolumesAssistedSnapshotsTest-799935866-project-admin] [instance: 7e2ae11f-161c-4d13-a1a5-37d0a8150e6b] Calling os-brick to attach iSCSI Volume {{(pid=85141) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 10:13:04 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2061d01-654c-425f-a5a2-2dea845dbadf tempest-VolumesAssistedSnapshotsTest-799935866 tempest-VolumesAssistedSnapshotsTest-799935866-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51806b6080>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ba7ca2a3-5f1e-4544-852f-d57100b608e3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mXecbdDQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 10:13:04 user nova-compute[85141]: WARNING os_brick.initiator.connectors.base [None req-f2061d01-654c-425f-a5a2-2dea845dbadf tempest-VolumesAssistedSnapshotsTest-799935866 tempest-VolumesAssistedSnapshotsTest-799935866-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 10:13:04 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-f2061d01-654c-425f-a5a2-2dea845dbadf tempest-VolumesAssistedSnapshotsTest-799935866 tempest-VolumesAssistedSnapshotsTest-799935866-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 10:13:04 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-f2061d01-654c-425f-a5a2-2dea845dbadf tempest-VolumesAssistedSnapshotsTest-799935866 tempest-VolumesAssistedSnapshotsTest-799935866-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 10:13:04 user nova-compute[85141]: WARNING os_brick.initiator.connectors.base [None req-f2061d01-654c-425f-a5a2-2dea845dbadf tempest-VolumesAssistedSnapshotsTest-799935866 tempest-VolumesAssistedSnapshotsTest-799935866-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 10:13:04 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-f2061d01-654c-425f-a5a2-2dea845dbadf tempest-VolumesAssistedSnapshotsTest-799935866 tempest-VolumesAssistedSnapshotsTest-799935866-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ba7ca2a3-5f1e-4544-852f-d57100b608e3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 10:13:04 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-f2061d01-654c-425f-a5a2-2dea845dbadf tempest-VolumesAssistedSnapshotsTest-799935866 tempest-VolumesAssistedSnapshotsTest-799935866-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ba7ca2a3-5f1e-4544-852f-d57100b608e3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 10:13:04 user nova-compute[85141]: INFO os_brick.initiator.connectors.iscsi [None req-f2061d01-654c-425f-a5a2-2dea845dbadf tempest-VolumesAssistedSnapshotsTest-799935866 tempest-VolumesAssistedSnapshotsTest-799935866-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 10:13:04 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba7ca2a3-5f1e-4544-852f-d57100b608e3 -p 172.16.0.220:3260 {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:13:04 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba7ca2a3-5f1e-4544-852f-d57100b608e3 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:13:04 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4f7afda-4c2a-4c80-878b-ab0adf781340]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:13:04 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2061d01-654c-425f-a5a2-2dea845dbadf tempest-VolumesAssistedSnapshotsTest-799935866 tempest-VolumesAssistedSnapshotsTest-799935866-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 10:13:04 user nova-compute[85141]:  {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:13:04 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba7ca2a3-5f1e-4544-852f-d57100b608e3 -p 172.16.0.220:3260 --interface default --op new {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:13:04 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba7ca2a3-5f1e-4544-852f-d57100b608e3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:13:04 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e326f4a-606a-4234-a075-71b8d1497dde]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ba7ca2a3-5f1e-4544-852f-d57100b608e3] added\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:13:04 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2061d01-654c-425f-a5a2-2dea845dbadf tempest-VolumesAssistedSnapshotsTest-799935866 tempest-VolumesAssistedSnapshotsTest-799935866-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ba7ca2a3-5f1e-4544-852f-d57100b608e3] added
Nov 16 10:13:04 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:13:04 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba7ca2a3-5f1e-4544-852f-d57100b608e3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:13:04 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba7ca2a3-5f1e-4544-852f-d57100b608e3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:13:04 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[a04504b9-2e88-40c9-bc3b-3b55ce4e9463]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:13:04 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2061d01-654c-425f-a5a2-2dea845dbadf tempest-VolumesAssistedSnapshotsTest-799935866 tempest-VolumesAssistedSnapshotsTest-799935866-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:13:04 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba7ca2a3-5f1e-4544-852f-d57100b608e3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:13:04 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba7ca2a3-5f1e-4544-852f-d57100b608e3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:13:04 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a4394f9-507a-42a7-bcf1-425068c1428b]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:13:04 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2061d01-654c-425f-a5a2-2dea845dbadf tempest-VolumesAssistedSnapshotsTest-799935866 tempest-VolumesAssistedSnapshotsTest-799935866-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:13:04 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba7ca2a3-5f1e-4544-852f-d57100b608e3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mXecbdDQ {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:13:04 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba7ca2a3-5f1e-4544-852f-d57100b608e3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mXecbdDQ" returned: 0 in 0.018s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:13:04 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[32c81086-7ecd-42f7-a070-e2df28d6473e]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:13:04 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2061d01-654c-425f-a5a2-2dea845dbadf tempest-VolumesAssistedSnapshotsTest-799935866 tempest-VolumesAssistedSnapshotsTest-799935866-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mXecbdDQ'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:13:04 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba7ca2a3-5f1e-4544-852f-d57100b608e3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:13:04 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba7ca2a3-5f1e-4544-852f-d57100b608e3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:13:04 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[f95b9e76-07e3-47c1-bffb-f01c9e5ff144]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:13:04 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2061d01-654c-425f-a5a2-2dea845dbadf tempest-VolumesAssistedSnapshotsTest-799935866 tempest-VolumesAssistedSnapshotsTest-799935866-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:13:04 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:13:04 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.047s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:13:04 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c7e2279-fe24-42e7-b226-e9429547d594]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eff563f0-92d3-47a1-addc-e3eaa6828d59 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb0e3ad6-04d7-4405-b4ae-0440b2a396ce (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4df10d9-a60c-45ed-981d-96f704534fb8 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4973f768-f126-41d6-b534-458d6c49f9b3 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fcde20-e019-4cf0-ad90-6c8100f4a8d2 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5feab5a7-6ec4-4e13-84bc-bff657a0d0de (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e233047-dda3-4f2e-803c-7b69a57ac656 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ca01473-0233-4122-b008-ffa407ca3e70 (non-flash)\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:13:04 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2061d01-654c-425f-a5a2-2dea845dbadf tempest-VolumesAssistedSnapshotsTest-799935866 tempest-VolumesAssistedSnapshotsTest-799935866-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eff563f0-92d3-47a1-addc-e3eaa6828d59 (non-flash)
Nov 16 10:13:04 user nova-compute[85141]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb0e3ad6-04d7-4405-b4ae-0440b2a396ce (non-flash)
Nov 16 10:13:04 user nova-compute[85141]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4df10d9-a60c-45ed-981d-96f704534fb8 (non-flash)
Nov 16 10:13:04 user nova-compute[85141]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4973f768-f126-41d6-b534-458d6c49f9b3 (non-flash)
Nov 16 10:13:04 user nova-compute[85141]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fcde20-e019-4cf0-ad90-6c8100f4a8d2 (non-flash)
Nov 16 10:13:04 user nova-compute[85141]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5feab5a7-6ec4-4e13-84bc-bff657a0d0de (non-flash)
Nov 16 10:13:04 user nova-compute[85141]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e233047-dda3-4f2e-803c-7b69a57ac656 (non-flash)
Nov 16 10:13:04 user nova-compute[85141]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ca01473-0233-4122-b008-ffa407ca3e70 (non-flash)
Nov 16 10:13:04 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:13:04 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2061d01-654c-425f-a5a2-2dea845dbadf tempest-VolumesAssistedSnapshotsTest-799935866 tempest-VolumesAssistedSnapshotsTest-799935866-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eff563f0-92d3-47a1-addc-e3eaa6828d59 (non-flash)
Nov 16 10:13:04 user nova-compute[85141]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb0e3ad6-04d7-4405-b4ae-0440b2a396ce (non-flash)
Nov 16 10:13:04 user nova-compute[85141]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4df10d9-a60c-45ed-981d-96f704534fb8 (non-flash)
Nov 16 10:13:04 user nova-compute[85141]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4973f768-f126-41d6-b534-458d6c49f9b3 (non-flash)
Nov 16 10:13:04 user nova-compute[85141]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fcde20-e019-4cf0-ad90-6c8100f4a8d2 (non-flash)
Nov 16 10:13:04 user nova-compute[85141]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5feab5a7-6ec4-4e13-84bc-bff657a0d0de (non-flash)
Nov 16 10:13:04 user nova-compute[85141]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e233047-dda3-4f2e-803c-7b69a57ac656 (non-flash)
Nov 16 10:13:04 user nova-compute[85141]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ca01473-0233-4122-b008-ffa407ca3e70 (non-flash)
Nov 16 10:13:04 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 10:13:04 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba7ca2a3-5f1e-4544-852f-d57100b608e3 -p 172.16.0.220:3260 --login {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:13:04 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba7ca2a3-5f1e-4544-852f-d57100b608e3 -p 172.16.0.220:3260 --login" returned: 0 in 0.100s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:13:04 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[478f9f5e-4d33-4ba5-ae83-ff3eb08dccc2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ba7ca2a3-5f1e-4544-852f-d57100b608e3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ba7ca2a3-5f1e-4544-852f-d57100b608e3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:13:04 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2061d01-654c-425f-a5a2-2dea845dbadf tempest-VolumesAssistedSnapshotsTest-799935866 tempest-VolumesAssistedSnapshotsTest-799935866-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ba7ca2a3-5f1e-4544-852f-d57100b608e3, portal: 172.16.0.220,3260]
Nov 16 10:13:04 user nova-compute[85141]: Login to [iface: default, target: iqn.2010-10.org.openstack:ba7ca2a3-5f1e-4544-852f-d57100b608e3, portal: 172.16.0.220,3260] successful.
Nov 16 10:13:04 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:13:04 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba7ca2a3-5f1e-4544-852f-d57100b608e3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:13:04 user nova-compute[85141]: DEBUG nova.virt.libvirt.guest [None req-7563521d-9bc0-404e-87e4-0c0b253b214a tempest-TestVolumeSwap-1037451778 tempest-TestVolumeSwap-1037451778-project-admin] COPY block job progress, current cursor: 786432000 final cursor: 1073741824 {{(pid=85141) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 10:13:04 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba7ca2a3-5f1e-4544-852f-d57100b608e3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:13:04 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b17708a-416f-4ecb-ac2f-10a710f0dbf0]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:13:04 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2061d01-654c-425f-a5a2-2dea845dbadf tempest-VolumesAssistedSnapshotsTest-799935866 tempest-VolumesAssistedSnapshotsTest-799935866-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:13:04 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:13:04 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:13:04 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee6abd79-dea3-4c20-a022-80cf0c16a9d1]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eff563f0-92d3-47a1-addc-e3eaa6828d59 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb0e3ad6-04d7-4405-b4ae-0440b2a396ce (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba7ca2a3-5f1e-4544-852f-d57100b608e3 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4df10d9-a60c-45ed-981d-96f704534fb8 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4973f768-f126-41d6-b534-458d6c49f9b3 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fcde20-e019-4cf0-ad90-6c8100f4a8d2 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5feab5a7-6ec4-4e13-84bc-bff657a0d0de (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e233047-dda3-4f2e-803c-7b69a57ac656 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ca01473-0233-4122-b008-ffa407ca3e70 (non-flash)\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:13:04 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2061d01-654c-425f-a5a2-2dea845dbadf tempest-VolumesAssistedSnapshotsTest-799935866 tempest-VolumesAssistedSnapshotsTest-799935866-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eff563f0-92d3-47a1-addc-e3eaa6828d59 (non-flash)
Nov 16 10:13:04 user nova-compute[85141]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb0e3ad6-04d7-4405-b4ae-0440b2a396ce (non-flash)
Nov 16 10:13:04 user nova-compute[85141]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba7ca2a3-5f1e-4544-852f-d57100b608e3 (non-flash)
Nov 16 10:13:04 user nova-compute[85141]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4df10d9-a60c-45ed-981d-96f704534fb8 (non-flash)
Nov 16 10:13:04 user nova-compute[85141]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4973f768-f126-41d6-b534-458d6c49f9b3 (non-flash)
Nov 16 10:13:04 user nova-compute[85141]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fcde20-e019-4cf0-ad90-6c8100f4a8d2 (non-flash)
Nov 16 10:13:04 user nova-compute[85141]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5feab5a7-6ec4-4e13-84bc-bff657a0d0de (non-flash)
Nov 16 10:13:04 user nova-compute[85141]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e233047-dda3-4f2e-803c-7b69a57ac656 (non-flash)
Nov 16 10:13:04 user nova-compute[85141]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ca01473-0233-4122-b008-ffa407ca3e70 (non-flash)
Nov 16 10:13:04 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:13:04 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2061d01-654c-425f-a5a2-2dea845dbadf tempest-VolumesAssistedSnapshotsTest-799935866 tempest-VolumesAssistedSnapshotsTest-799935866-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eff563f0-92d3-47a1-addc-e3eaa6828d59 (non-flash)
Nov 16 10:13:04 user nova-compute[85141]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb0e3ad6-04d7-4405-b4ae-0440b2a396ce (non-flash)
Nov 16 10:13:04 user nova-compute[85141]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba7ca2a3-5f1e-4544-852f-d57100b608e3 (non-flash)
Nov 16 10:13:04 user nova-compute[85141]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4df10d9-a60c-45ed-981d-96f704534fb8 (non-flash)
Nov 16 10:13:04 user nova-compute[85141]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4973f768-f126-41d6-b534-458d6c49f9b3 (non-flash)
Nov 16 10:13:04 user nova-compute[85141]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fcde20-e019-4cf0-ad90-6c8100f4a8d2 (non-flash)
Nov 16 10:13:04 user nova-compute[85141]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5feab5a7-6ec4-4e13-84bc-bff657a0d0de (non-flash)
Nov 16 10:13:04 user nova-compute[85141]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e233047-dda3-4f2e-803c-7b69a57ac656 (non-flash)
Nov 16 10:13:04 user nova-compute[85141]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ca01473-0233-4122-b008-ffa407ca3e70 (non-flash)
Nov 16 10:13:04 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 10:13:04 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-f2061d01-654c-425f-a5a2-2dea845dbadf tempest-VolumesAssistedSnapshotsTest-799935866 tempest-VolumesAssistedSnapshotsTest-799935866-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ba7ca2a3-5f1e-4544-852f-d57100b608e3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.361s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 10:13:04 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2061d01-654c-425f-a5a2-2dea845dbadf tempest-VolumesAssistedSnapshotsTest-799935866 tempest-VolumesAssistedSnapshotsTest-799935866-project-admin] Connected to 172.16.0.220:3260 {{(pid=85141) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 10:13:04 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-f2061d01-654c-425f-a5a2-2dea845dbadf tempest-VolumesAssistedSnapshotsTest-799935866 tempest-VolumesAssistedSnapshotsTest-799935866-project-admin] HCTL ('40', '-', '-', 0) found on session 13 with lun 0 {{(pid=85141) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 10:13:04 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-f2061d01-654c-425f-a5a2-2dea845dbadf tempest-VolumesAssistedSnapshotsTest-799935866 tempest-VolumesAssistedSnapshotsTest-799935866-project-admin] Scanning host 40 c: -, t: -, l: 0) {{(pid=85141) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 10:13:04 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:13:04 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.015s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:13:04 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[fed58ffa-d6f7-4163-8005-506890347cc1]: (4, ('- - 0', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:13:04 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-f2061d01-654c-425f-a5a2-2dea845dbadf tempest-VolumesAssistedSnapshotsTest-799935866 tempest-VolumesAssistedSnapshotsTest-799935866-project-admin] Searching for a device in session 13 and hctl ['40', '*', '*', 0] yield: None {{(pid=85141) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 10:13:05 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-cd63184a-c0d0-4bde-a703-fcd59712ca5d tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 361a2044-8fd0-4975-8a19-814bf7a6da41 is timed out.
Nov 16 10:13:05 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-cd63184a-c0d0-4bde-a703-fcd59712ca5d tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] Successfully detached device vdb from instance 361a2044-8fd0-4975-8a19-814bf7a6da41 from the live domain config.
Nov 16 10:13:05 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd63184a-c0d0-4bde-a703-fcd59712ca5d tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] [instance: 361a2044-8fd0-4975-8a19-814bf7a6da41] calling os-brick to detach iSCSI Volume {{(pid=85141) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 10:13:05 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd63184a-c0d0-4bde-a703-fcd59712ca5d tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51806b6080>, {'target_iqn': 'iqn.2010-10.org.openstack:5feab5a7-6ec4-4e13-84bc-bff657a0d0de', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WvmNryYH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 10:13:05 user nova-compute[85141]: WARNING os_brick.initiator.connectors.base [None req-cd63184a-c0d0-4bde-a703-fcd59712ca5d tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 10:13:05 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-cd63184a-c0d0-4bde-a703-fcd59712ca5d tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 10:13:05 user nova-compute[85141]: DEBUG nova.virt.libvirt.guest [None req-7563521d-9bc0-404e-87e4-0c0b253b214a tempest-TestVolumeSwap-1037451778 tempest-TestVolumeSwap-1037451778-project-admin] COPY block job progress, current cursor: 904921088 final cursor: 1073741824 {{(pid=85141) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 10:13:05 user nova-compute[85141]: DEBUG nova.virt.libvirt.guest [None req-7563521d-9bc0-404e-87e4-0c0b253b214a tempest-TestVolumeSwap-1037451778 tempest-TestVolumeSwap-1037451778-project-admin] COPY block job progress, current cursor: 1037041664 final cursor: 1073741824 {{(pid=85141) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 10:13:05 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-f2061d01-654c-425f-a5a2-2dea845dbadf tempest-VolumesAssistedSnapshotsTest-799935866 tempest-VolumesAssistedSnapshotsTest-799935866-project-admin] Searching for a device in session 13 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=85141) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 10:13:05 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2061d01-654c-425f-a5a2-2dea845dbadf tempest-VolumesAssistedSnapshotsTest-799935866 tempest-VolumesAssistedSnapshotsTest-799935866-project-admin] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:ba7ca2a3-5f1e-4544-852f-d57100b608e3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mXecbdDQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=85141) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 10:13:05 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-f2061d01-654c-425f-a5a2-2dea845dbadf tempest-VolumesAssistedSnapshotsTest-799935866 tempest-VolumesAssistedSnapshotsTest-799935866-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.395s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 10:13:05 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2061d01-654c-425f-a5a2-2dea845dbadf tempest-VolumesAssistedSnapshotsTest-799935866 tempest-VolumesAssistedSnapshotsTest-799935866-project-admin] <== connect_volume: return (1397ms) {'type': 'block', 'scsi_wwn': '23138326232383831', 'path': '/dev/sdi'} {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 10:13:05 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f2061d01-654c-425f-a5a2-2dea845dbadf tempest-VolumesAssistedSnapshotsTest-799935866 tempest-VolumesAssistedSnapshotsTest-799935866-project-admin] [instance: 7e2ae11f-161c-4d13-a1a5-37d0a8150e6b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23138326232383831', 'path': '/dev/sdi'} {{(pid=85141) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 10:13:05 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-cd63184a-c0d0-4bde-a703-fcd59712ca5d tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.641s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 10:13:05 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:13:05 user nova-compute[85141]: DEBUG nova.objects.instance [None req-f2061d01-654c-425f-a5a2-2dea845dbadf tempest-VolumesAssistedSnapshotsTest-799935866 tempest-VolumesAssistedSnapshotsTest-799935866-project-admin] Lazy-loading 'flavor' on Instance uuid 7e2ae11f-161c-4d13-a1a5-37d0a8150e6b {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:13:05 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:13:05 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e7dde80-1fc2-424e-ad22-caeafb04ad47]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5feab5a7-6ec4-4e13-84bc-bff657a0d0de\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ba7ca2a3-5f1e-4544-852f-d57100b608e3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4973f768-f126-41d6-b534-458d6c49f9b3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:eff563f0-92d3-47a1-addc-e3eaa6828d59\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8ca01473-0233-4122-b008-ffa407ca3e70\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:27fcde20-e019-4cf0-ad90-6c8100f4a8d2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7e233047-dda3-4f2e-803c-7b69a57ac656\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:eb0e3ad6-04d7-4405-b4ae-0440b2a396ce\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b4df10d9-a60c-45ed-981d-96f704534fb8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:13:05 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd63184a-c0d0-4bde-a703-fcd59712ca5d tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 10:13:05 user nova-compute[85141]: No targets found.
Nov 16 10:13:05 user nova-compute[85141]: iSNS:
Nov 16 10:13:05 user nova-compute[85141]: No targets found.
Nov 16 10:13:05 user nova-compute[85141]: STATIC:
Nov 16 10:13:05 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:5feab5a7-6ec4-4e13-84bc-bff657a0d0de
Nov 16 10:13:05 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:13:05 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:13:05 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:ba7ca2a3-5f1e-4544-852f-d57100b608e3
Nov 16 10:13:05 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:13:05 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:13:05 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:4973f768-f126-41d6-b534-458d6c49f9b3
Nov 16 10:13:05 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:13:05 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:13:05 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:eff563f0-92d3-47a1-addc-e3eaa6828d59
Nov 16 10:13:05 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:13:05 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:13:05 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:8ca01473-0233-4122-b008-ffa407ca3e70
Nov 16 10:13:05 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:13:05 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:13:05 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:27fcde20-e019-4cf0-ad90-6c8100f4a8d2
Nov 16 10:13:05 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:13:05 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:13:05 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:7e233047-dda3-4f2e-803c-7b69a57ac656
Nov 16 10:13:05 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:13:05 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:13:05 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:eb0e3ad6-04d7-4405-b4ae-0440b2a396ce
Nov 16 10:13:05 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:13:05 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:13:05 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:b4df10d9-a60c-45ed-981d-96f704534fb8
Nov 16 10:13:05 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:13:05 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:13:05 user nova-compute[85141]: FIRMWARE:
Nov 16 10:13:05 user nova-compute[85141]: No targets found.
Nov 16 10:13:05 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:13:05 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd63184a-c0d0-4bde-a703-fcd59712ca5d tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 10:13:05 user nova-compute[85141]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 10:13:05 user nova-compute[85141]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=85141) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 10:13:05 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd63184a-c0d0-4bde-a703-fcd59712ca5d tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5feab5a7-6ec4-4e13-84bc-bff657a0d0de', 0)] {{(pid=85141) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 10:13:05 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:13:05 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:13:05 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cc64bb2-d839-4de6-9972-f6cec461fe68]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:27fcde20-e019-4cf0-ad90-6c8100f4a8d2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4973f768-f126-41d6-b534-458d6c49f9b3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5feab5a7-6ec4-4e13-84bc-bff657a0d0de\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7e233047-dda3-4f2e-803c-7b69a57ac656\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8ca01473-0233-4122-b008-ffa407ca3e70\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b4df10d9-a60c-45ed-981d-96f704534fb8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ba7ca2a3-5f1e-4544-852f-d57100b608e3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eb0e3ad6-04d7-4405-b4ae-0440b2a396ce\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eff563f0-92d3-47a1-addc-e3eaa6828d59\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:13:05 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:13:05 user nova-compute[85141]: DEBUG nova.virt.libvirt.guest [None req-f2061d01-654c-425f-a5a2-2dea845dbadf tempest-VolumesAssistedSnapshotsTest-799935866 tempest-VolumesAssistedSnapshotsTest-799935866-project-admin] attach device xml: <disk type="block" device="disk">
Nov 16 10:13:05 user nova-compute[85141]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 10:13:05 user nova-compute[85141]:   <source dev="/dev/sdi"/>
Nov 16 10:13:05 user nova-compute[85141]:   <target dev="vdb" bus="virtio"/>
Nov 16 10:13:05 user nova-compute[85141]:   <serial>ba7ca2a3-5f1e-4544-852f-d57100b608e3</serial>
Nov 16 10:13:05 user nova-compute[85141]: </disk>
Nov 16 10:13:05 user nova-compute[85141]:  {{(pid=85141) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 10:13:05 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:13:05 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[8529788e-7125-424f-9f39-f8c1188c1d6d]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eff563f0-92d3-47a1-addc-e3eaa6828d59 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb0e3ad6-04d7-4405-b4ae-0440b2a396ce (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba7ca2a3-5f1e-4544-852f-d57100b608e3 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4df10d9-a60c-45ed-981d-96f704534fb8 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4973f768-f126-41d6-b534-458d6c49f9b3 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fcde20-e019-4cf0-ad90-6c8100f4a8d2 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5feab5a7-6ec4-4e13-84bc-bff657a0d0de (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e233047-dda3-4f2e-803c-7b69a57ac656 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ca01473-0233-4122-b008-ffa407ca3e70 (non-flash)\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:13:05 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd63184a-c0d0-4bde-a703-fcd59712ca5d tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eff563f0-92d3-47a1-addc-e3eaa6828d59 (non-flash)
Nov 16 10:13:05 user nova-compute[85141]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb0e3ad6-04d7-4405-b4ae-0440b2a396ce (non-flash)
Nov 16 10:13:05 user nova-compute[85141]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba7ca2a3-5f1e-4544-852f-d57100b608e3 (non-flash)
Nov 16 10:13:05 user nova-compute[85141]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4df10d9-a60c-45ed-981d-96f704534fb8 (non-flash)
Nov 16 10:13:05 user nova-compute[85141]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4973f768-f126-41d6-b534-458d6c49f9b3 (non-flash)
Nov 16 10:13:05 user nova-compute[85141]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fcde20-e019-4cf0-ad90-6c8100f4a8d2 (non-flash)
Nov 16 10:13:05 user nova-compute[85141]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5feab5a7-6ec4-4e13-84bc-bff657a0d0de (non-flash)
Nov 16 10:13:05 user nova-compute[85141]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e233047-dda3-4f2e-803c-7b69a57ac656 (non-flash)
Nov 16 10:13:05 user nova-compute[85141]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ca01473-0233-4122-b008-ffa407ca3e70 (non-flash)
Nov 16 10:13:05 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:13:05 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd63184a-c0d0-4bde-a703-fcd59712ca5d tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eff563f0-92d3-47a1-addc-e3eaa6828d59 (non-flash)
Nov 16 10:13:05 user nova-compute[85141]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb0e3ad6-04d7-4405-b4ae-0440b2a396ce (non-flash)
Nov 16 10:13:05 user nova-compute[85141]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba7ca2a3-5f1e-4544-852f-d57100b608e3 (non-flash)
Nov 16 10:13:05 user nova-compute[85141]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4df10d9-a60c-45ed-981d-96f704534fb8 (non-flash)
Nov 16 10:13:05 user nova-compute[85141]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4973f768-f126-41d6-b534-458d6c49f9b3 (non-flash)
Nov 16 10:13:05 user nova-compute[85141]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fcde20-e019-4cf0-ad90-6c8100f4a8d2 (non-flash)
Nov 16 10:13:05 user nova-compute[85141]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5feab5a7-6ec4-4e13-84bc-bff657a0d0de (non-flash)
Nov 16 10:13:05 user nova-compute[85141]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e233047-dda3-4f2e-803c-7b69a57ac656 (non-flash)
Nov 16 10:13:05 user nova-compute[85141]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ca01473-0233-4122-b008-ffa407ca3e70 (non-flash)
Nov 16 10:13:05 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 10:13:05 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd63184a-c0d0-4bde-a703-fcd59712ca5d tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f51a38ddf30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5feab5a7-6ec4-4e13-84bc-bff657a0d0de'): ({'sdf'}, set())}) {{(pid=85141) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 10:13:05 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-cd63184a-c0d0-4bde-a703-fcd59712ca5d tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] Removing single pathed devices sdf {{(pid=85141) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 10:13:05 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:13:06 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:13:06 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bfac6c5-ac13-4d10-8205-30821bfd5efd]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:13:06 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:13:06 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.018s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:13:06 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[42e502a2-7fe0-4b4d-a3f8-e82b8856852c]: (4, ('ok\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:13:06 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-cd63184a-c0d0-4bde-a703-fcd59712ca5d tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] Flushing IO for device /dev/sdf {{(pid=85141) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 10:13:06 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:13:06 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:13:06 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:13:06 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d6a75f6-e773-41d7-b087-273fa7407173]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:13:06 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-cd63184a-c0d0-4bde-a703-fcd59712ca5d tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=85141) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 10:13:06 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:13:06 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.043s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:13:06 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f61a318-38c5-4484-9d74-c7961d546a40]: (4, ('1', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:13:06 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-cd63184a-c0d0-4bde-a703-fcd59712ca5d tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=85141) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 10:13:06 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-cd63184a-c0d0-4bde-a703-fcd59712ca5d tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] SCSI volumes sdf have been removed. {{(pid=85141) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 10:13:06 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd63184a-c0d0-4bde-a703-fcd59712ca5d tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5feab5a7-6ec4-4e13-84bc-bff657a0d0de')] {{(pid=85141) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 10:13:06 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5feab5a7-6ec4-4e13-84bc-bff657a0d0de -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:13:06 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5feab5a7-6ec4-4e13-84bc-bff657a0d0de -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:13:06 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[b24fced2-e80e-4876-a12b-0c3e0ed415be]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:13:06 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd63184a-c0d0-4bde-a703-fcd59712ca5d tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:13:06 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5feab5a7-6ec4-4e13-84bc-bff657a0d0de -p 172.16.0.220:3260 --logout {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:13:06 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5feab5a7-6ec4-4e13-84bc-bff657a0d0de -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:13:06 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[a70343d3-9766-4418-9a8d-07d7e3a76407]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:5feab5a7-6ec4-4e13-84bc-bff657a0d0de, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:5feab5a7-6ec4-4e13-84bc-bff657a0d0de, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:13:06 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd63184a-c0d0-4bde-a703-fcd59712ca5d tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:5feab5a7-6ec4-4e13-84bc-bff657a0d0de, portal: 172.16.0.220,3260]
Nov 16 10:13:06 user nova-compute[85141]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:5feab5a7-6ec4-4e13-84bc-bff657a0d0de, portal: 172.16.0.220,3260] successful.
Nov 16 10:13:06 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:13:06 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5feab5a7-6ec4-4e13-84bc-bff657a0d0de -p 172.16.0.220:3260 --op delete {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:13:06 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5feab5a7-6ec4-4e13-84bc-bff657a0d0de -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:13:06 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6d09bd0-e7ed-4f13-a66c-741fbcd98dba]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:13:06 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd63184a-c0d0-4bde-a703-fcd59712ca5d tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:13:06 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-cd63184a-c0d0-4bde-a703-fcd59712ca5d tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.339s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 10:13:06 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd63184a-c0d0-4bde-a703-fcd59712ca5d tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] <== disconnect_volume: return (980ms) None {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 10:13:06 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd63184a-c0d0-4bde-a703-fcd59712ca5d tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] [instance: 361a2044-8fd0-4975-8a19-814bf7a6da41] Disconnected iSCSI Volume {{(pid=85141) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 10:13:06 user nova-compute[85141]: DEBUG nova.virt.libvirt.guest [None req-7563521d-9bc0-404e-87e4-0c0b253b214a tempest-TestVolumeSwap-1037451778 tempest-TestVolumeSwap-1037451778-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=85141) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 10:13:06 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-f2061d01-654c-425f-a5a2-2dea845dbadf tempest-VolumesAssistedSnapshotsTest-799935866 tempest-VolumesAssistedSnapshotsTest-799935866-project-admin] No BDM found with device name vda, not building metadata. {{(pid=85141) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 10:13:06 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-f2061d01-654c-425f-a5a2-2dea845dbadf tempest-VolumesAssistedSnapshotsTest-799935866 tempest-VolumesAssistedSnapshotsTest-799935866-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=85141) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 10:13:06 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-f2061d01-654c-425f-a5a2-2dea845dbadf tempest-VolumesAssistedSnapshotsTest-799935866 tempest-VolumesAssistedSnapshotsTest-799935866-project-admin] No VIF found with MAC fa:16:3e:19:6f:78, not building metadata {{(pid=85141) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 10:13:06 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7563521d-9bc0-404e-87e4-0c0b253b214a tempest-TestVolumeSwap-1037451778 tempest-TestVolumeSwap-1037451778-project-admin] [instance: ad1ace46-2e8e-42e1-a0f5-2384078fcf09] calling os-brick to detach iSCSI Volume {{(pid=85141) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 10:13:06 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-7563521d-9bc0-404e-87e4-0c0b253b214a tempest-TestVolumeSwap-1037451778 tempest-TestVolumeSwap-1037451778-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51806b6080>, {'target_iqn': 'iqn.2010-10.org.openstack:7e233047-dda3-4f2e-803c-7b69a57ac656', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UtNLBDJC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 10:13:06 user nova-compute[85141]: WARNING os_brick.initiator.connectors.base [None req-7563521d-9bc0-404e-87e4-0c0b253b214a tempest-TestVolumeSwap-1037451778 tempest-TestVolumeSwap-1037451778-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 10:13:06 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-7563521d-9bc0-404e-87e4-0c0b253b214a tempest-TestVolumeSwap-1037451778 tempest-TestVolumeSwap-1037451778-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 10:13:06 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-7563521d-9bc0-404e-87e4-0c0b253b214a tempest-TestVolumeSwap-1037451778 tempest-TestVolumeSwap-1037451778-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 10:13:06 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:13:06 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:13:06 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4583947-dff3-413a-b878-e85e2b2b110e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ba7ca2a3-5f1e-4544-852f-d57100b608e3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4973f768-f126-41d6-b534-458d6c49f9b3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:eff563f0-92d3-47a1-addc-e3eaa6828d59\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8ca01473-0233-4122-b008-ffa407ca3e70\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:27fcde20-e019-4cf0-ad90-6c8100f4a8d2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7e233047-dda3-4f2e-803c-7b69a57ac656\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:eb0e3ad6-04d7-4405-b4ae-0440b2a396ce\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b4df10d9-a60c-45ed-981d-96f704534fb8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:13:06 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-7563521d-9bc0-404e-87e4-0c0b253b214a tempest-TestVolumeSwap-1037451778 tempest-TestVolumeSwap-1037451778-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 10:13:06 user nova-compute[85141]: No targets found.
Nov 16 10:13:06 user nova-compute[85141]: iSNS:
Nov 16 10:13:06 user nova-compute[85141]: No targets found.
Nov 16 10:13:06 user nova-compute[85141]: STATIC:
Nov 16 10:13:06 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:ba7ca2a3-5f1e-4544-852f-d57100b608e3
Nov 16 10:13:06 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:13:06 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:13:06 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:4973f768-f126-41d6-b534-458d6c49f9b3
Nov 16 10:13:06 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:13:06 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:13:06 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:eff563f0-92d3-47a1-addc-e3eaa6828d59
Nov 16 10:13:06 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:13:06 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:13:06 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:8ca01473-0233-4122-b008-ffa407ca3e70
Nov 16 10:13:06 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:13:06 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:13:06 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:27fcde20-e019-4cf0-ad90-6c8100f4a8d2
Nov 16 10:13:06 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:13:06 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:13:06 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:7e233047-dda3-4f2e-803c-7b69a57ac656
Nov 16 10:13:06 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:13:06 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:13:06 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:eb0e3ad6-04d7-4405-b4ae-0440b2a396ce
Nov 16 10:13:06 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:13:06 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:13:06 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:b4df10d9-a60c-45ed-981d-96f704534fb8
Nov 16 10:13:06 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:13:06 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:13:06 user nova-compute[85141]: FIRMWARE:
Nov 16 10:13:06 user nova-compute[85141]: No targets found.
Nov 16 10:13:06 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:13:06 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-7563521d-9bc0-404e-87e4-0c0b253b214a tempest-TestVolumeSwap-1037451778 tempest-TestVolumeSwap-1037451778-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 10:13:06 user nova-compute[85141]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 10:13:06 user nova-compute[85141]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=85141) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 10:13:06 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-7563521d-9bc0-404e-87e4-0c0b253b214a tempest-TestVolumeSwap-1037451778 tempest-TestVolumeSwap-1037451778-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7e233047-dda3-4f2e-803c-7b69a57ac656', 0)] {{(pid=85141) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 10:13:06 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:13:06 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-f2061d01-654c-425f-a5a2-2dea845dbadf tempest-VolumesAssistedSnapshotsTest-799935866 tempest-VolumesAssistedSnapshotsTest-799935866-project-admin] Lock "7e2ae11f-161c-4d13-a1a5-37d0a8150e6b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.913s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:13:06 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:13:06 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3836536-6cb8-43e2-b7b0-fa8e90e09175]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:27fcde20-e019-4cf0-ad90-6c8100f4a8d2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4973f768-f126-41d6-b534-458d6c49f9b3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7e233047-dda3-4f2e-803c-7b69a57ac656\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8ca01473-0233-4122-b008-ffa407ca3e70\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b4df10d9-a60c-45ed-981d-96f704534fb8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ba7ca2a3-5f1e-4544-852f-d57100b608e3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eb0e3ad6-04d7-4405-b4ae-0440b2a396ce\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eff563f0-92d3-47a1-addc-e3eaa6828d59\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:13:06 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:13:06 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:13:06 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6bf4c93-d8bf-42d4-941e-795266c9c2a3]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eff563f0-92d3-47a1-addc-e3eaa6828d59 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb0e3ad6-04d7-4405-b4ae-0440b2a396ce (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba7ca2a3-5f1e-4544-852f-d57100b608e3 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4df10d9-a60c-45ed-981d-96f704534fb8 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4973f768-f126-41d6-b534-458d6c49f9b3 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fcde20-e019-4cf0-ad90-6c8100f4a8d2 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e233047-dda3-4f2e-803c-7b69a57ac656 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ca01473-0233-4122-b008-ffa407ca3e70 (non-flash)\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:13:06 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-7563521d-9bc0-404e-87e4-0c0b253b214a tempest-TestVolumeSwap-1037451778 tempest-TestVolumeSwap-1037451778-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eff563f0-92d3-47a1-addc-e3eaa6828d59 (non-flash)
Nov 16 10:13:06 user nova-compute[85141]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb0e3ad6-04d7-4405-b4ae-0440b2a396ce (non-flash)
Nov 16 10:13:06 user nova-compute[85141]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba7ca2a3-5f1e-4544-852f-d57100b608e3 (non-flash)
Nov 16 10:13:06 user nova-compute[85141]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4df10d9-a60c-45ed-981d-96f704534fb8 (non-flash)
Nov 16 10:13:06 user nova-compute[85141]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4973f768-f126-41d6-b534-458d6c49f9b3 (non-flash)
Nov 16 10:13:06 user nova-compute[85141]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fcde20-e019-4cf0-ad90-6c8100f4a8d2 (non-flash)
Nov 16 10:13:06 user nova-compute[85141]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e233047-dda3-4f2e-803c-7b69a57ac656 (non-flash)
Nov 16 10:13:06 user nova-compute[85141]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ca01473-0233-4122-b008-ffa407ca3e70 (non-flash)
Nov 16 10:13:06 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:13:06 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-7563521d-9bc0-404e-87e4-0c0b253b214a tempest-TestVolumeSwap-1037451778 tempest-TestVolumeSwap-1037451778-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eff563f0-92d3-47a1-addc-e3eaa6828d59 (non-flash)
Nov 16 10:13:06 user nova-compute[85141]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb0e3ad6-04d7-4405-b4ae-0440b2a396ce (non-flash)
Nov 16 10:13:06 user nova-compute[85141]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba7ca2a3-5f1e-4544-852f-d57100b608e3 (non-flash)
Nov 16 10:13:06 user nova-compute[85141]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4df10d9-a60c-45ed-981d-96f704534fb8 (non-flash)
Nov 16 10:13:06 user nova-compute[85141]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4973f768-f126-41d6-b534-458d6c49f9b3 (non-flash)
Nov 16 10:13:06 user nova-compute[85141]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fcde20-e019-4cf0-ad90-6c8100f4a8d2 (non-flash)
Nov 16 10:13:06 user nova-compute[85141]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e233047-dda3-4f2e-803c-7b69a57ac656 (non-flash)
Nov 16 10:13:06 user nova-compute[85141]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ca01473-0233-4122-b008-ffa407ca3e70 (non-flash)
Nov 16 10:13:06 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 10:13:06 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-7563521d-9bc0-404e-87e4-0c0b253b214a tempest-TestVolumeSwap-1037451778 tempest-TestVolumeSwap-1037451778-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f51806713f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7e233047-dda3-4f2e-803c-7b69a57ac656'): ({'sdb'}, set())}) {{(pid=85141) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 10:13:06 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-7563521d-9bc0-404e-87e4-0c0b253b214a tempest-TestVolumeSwap-1037451778 tempest-TestVolumeSwap-1037451778-project-admin] Removing single pathed devices sdb {{(pid=85141) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 10:13:06 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:13:06 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:13:06 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[a59bdf3c-00ee-4185-8abc-5bd2bccb6143]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:13:06 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:13:06 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:13:06 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[590a1a05-e728-44b9-9b84-e83424319861]: (4, ('ok\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:13:06 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-7563521d-9bc0-404e-87e4-0c0b253b214a tempest-TestVolumeSwap-1037451778 tempest-TestVolumeSwap-1037451778-project-admin] Flushing IO for device /dev/sdb {{(pid=85141) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 10:13:06 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:13:06 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:13:06 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b5ba2c8-2916-4675-a446-5ca3790be2e8]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:13:06 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-7563521d-9bc0-404e-87e4-0c0b253b214a tempest-TestVolumeSwap-1037451778 tempest-TestVolumeSwap-1037451778-project-admin] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=85141) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 10:13:06 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:13:06 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:13:06 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[494ddb3f-5be9-4cc6-8046-0091ef44c889]: (4, ('1', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:13:06 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-7563521d-9bc0-404e-87e4-0c0b253b214a tempest-TestVolumeSwap-1037451778 tempest-TestVolumeSwap-1037451778-project-admin] Checking to see if SCSI volumes sdb have been removed. {{(pid=85141) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 10:13:06 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-7563521d-9bc0-404e-87e4-0c0b253b214a tempest-TestVolumeSwap-1037451778 tempest-TestVolumeSwap-1037451778-project-admin] SCSI volumes sdb have been removed. {{(pid=85141) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 10:13:06 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-7563521d-9bc0-404e-87e4-0c0b253b214a tempest-TestVolumeSwap-1037451778 tempest-TestVolumeSwap-1037451778-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7e233047-dda3-4f2e-803c-7b69a57ac656')] {{(pid=85141) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 10:13:06 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e233047-dda3-4f2e-803c-7b69a57ac656 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:13:06 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e233047-dda3-4f2e-803c-7b69a57ac656 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:13:06 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0342080-0d24-45c3-958c-87b921498b51]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:13:06 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-7563521d-9bc0-404e-87e4-0c0b253b214a tempest-TestVolumeSwap-1037451778 tempest-TestVolumeSwap-1037451778-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:13:06 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e233047-dda3-4f2e-803c-7b69a57ac656 -p 172.16.0.220:3260 --logout {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:13:06 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e233047-dda3-4f2e-803c-7b69a57ac656 -p 172.16.0.220:3260 --logout" returned: 0 in 0.081s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:13:06 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c98e0d6-13e1-4bb5-bc18-38ea5b73e366]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:7e233047-dda3-4f2e-803c-7b69a57ac656, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:7e233047-dda3-4f2e-803c-7b69a57ac656, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:13:06 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-7563521d-9bc0-404e-87e4-0c0b253b214a tempest-TestVolumeSwap-1037451778 tempest-TestVolumeSwap-1037451778-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:7e233047-dda3-4f2e-803c-7b69a57ac656, portal: 172.16.0.220,3260]
Nov 16 10:13:06 user nova-compute[85141]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:7e233047-dda3-4f2e-803c-7b69a57ac656, portal: 172.16.0.220,3260] successful.
Nov 16 10:13:06 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:13:06 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e233047-dda3-4f2e-803c-7b69a57ac656 -p 172.16.0.220:3260 --op delete {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:13:06 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e233047-dda3-4f2e-803c-7b69a57ac656 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:13:06 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d11c0db-6cb6-48dc-aabe-d08e134ce61d]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:13:06 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-7563521d-9bc0-404e-87e4-0c0b253b214a tempest-TestVolumeSwap-1037451778 tempest-TestVolumeSwap-1037451778-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:13:06 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-7563521d-9bc0-404e-87e4-0c0b253b214a tempest-TestVolumeSwap-1037451778 tempest-TestVolumeSwap-1037451778-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.359s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 10:13:06 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-7563521d-9bc0-404e-87e4-0c0b253b214a tempest-TestVolumeSwap-1037451778 tempest-TestVolumeSwap-1037451778-project-admin] <== disconnect_volume: return (360ms) None {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 10:13:06 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7563521d-9bc0-404e-87e4-0c0b253b214a tempest-TestVolumeSwap-1037451778 tempest-TestVolumeSwap-1037451778-project-admin] [instance: ad1ace46-2e8e-42e1-a0f5-2384078fcf09] Disconnected iSCSI Volume {{(pid=85141) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 10:13:06 user nova-compute[85141]: DEBUG nova.compute.manager [None req-7563521d-9bc0-404e-87e4-0c0b253b214a tempest-TestVolumeSwap-1037451778 tempest-TestVolumeSwap-1037451778-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:eb0e3ad6-04d7-4405-b4ae-0440b2a396ce', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TGILpNCR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, 'status': 'reserved', 'instance': 'ad1ace46-2e8e-42e1-a0f5-2384078fcf09', 'attached_at': '', 'detached_at': '', 'volume_id': 'eb0e3ad6-04d7-4405-b4ae-0440b2a396ce', 'serial'} {{(pid=85141) _swap_volume /opt/stack/nova/nova/compute/manager.py:7791}}
Nov 16 10:13:06 user nova-compute[85141]: DEBUG nova.compute.manager [None req-7563521d-9bc0-404e-87e4-0c0b253b214a tempest-TestVolumeSwap-1037451778 tempest-TestVolumeSwap-1037451778-project-admin] [instance: ad1ace46-2e8e-42e1-a0f5-2384078fcf09] swap_volume: removing Cinder connection for volume 7e233047-dda3-4f2e-803c-7b69a57ac656 {{(pid=85141) _swap_volume /opt/stack/nova/nova/compute/manager.py:7836}}
Nov 16 10:13:07 user nova-compute[85141]: DEBUG nova.objects.instance [None req-cd63184a-c0d0-4bde-a703-fcd59712ca5d tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] Lazy-loading 'flavor' on Instance uuid 361a2044-8fd0-4975-8a19-814bf7a6da41 {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:13:07 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-cd63184a-c0d0-4bde-a703-fcd59712ca5d tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] Lock "361a2044-8fd0-4975-8a19-814bf7a6da41" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.435s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:13:07 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:13:07 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-1b30216b-d366-4837-8817-380c5433db2c tempest-VolumesAssistedSnapshotsTest-1102047891 tempest-VolumesAssistedSnapshotsTest-1102047891-project] [instance: 7e2ae11f-161c-4d13-a1a5-37d0a8150e6b] volume_snapshot_create: create_info: {'snapshot_id': '5b0b2ee8-b24a-442c-9384-8ecfb2177a86', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=85141) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3576}}
Nov 16 10:13:07 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-1b30216b-d366-4837-8817-380c5433db2c tempest-VolumesAssistedSnapshotsTest-1102047891 tempest-VolumesAssistedSnapshotsTest-1102047891-project] [instance: 7e2ae11f-161c-4d13-a1a5-37d0a8150e6b] snap xml: <domainsnapshot>
Nov 16 10:13:07 user nova-compute[85141]:   <disks>
Nov 16 10:13:07 user nova-compute[85141]:     <disk name="/dev/sdi" snapshot="external" type="file">
Nov 16 10:13:07 user nova-compute[85141]:       <source file="/dev/new_file"/>
Nov 16 10:13:07 user nova-compute[85141]:     </disk>
Nov 16 10:13:07 user nova-compute[85141]:     <disk name="vda" snapshot="no"/>
Nov 16 10:13:07 user nova-compute[85141]:   </disks>
Nov 16 10:13:07 user nova-compute[85141]: </domainsnapshot>
Nov 16 10:13:07 user nova-compute[85141]:  {{(pid=85141) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3517}}
Nov 16 10:13:07 user nova-compute[85141]: DEBUG nova.objects.instance [None req-1b30216b-d366-4837-8817-380c5433db2c tempest-VolumesAssistedSnapshotsTest-1102047891 tempest-VolumesAssistedSnapshotsTest-1102047891-project] Lazy-loading 'system_metadata' on Instance uuid 7e2ae11f-161c-4d13-a1a5-37d0a8150e6b {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:13:07 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-1b30216b-d366-4837-8817-380c5433db2c tempest-VolumesAssistedSnapshotsTest-1102047891 tempest-VolumesAssistedSnapshotsTest-1102047891-project] [instance: 7e2ae11f-161c-4d13-a1a5-37d0a8150e6b] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 16 10:13:07 user nova-compute[85141]: ERROR nova.virt.libvirt.driver [None req-1b30216b-d366-4837-8817-380c5433db2c tempest-VolumesAssistedSnapshotsTest-1102047891 tempest-VolumesAssistedSnapshotsTest-1102047891-project] [instance: 7e2ae11f-161c-4d13-a1a5-37d0a8150e6b] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 16 10:13:07 user nova-compute[85141]: ERROR nova.virt.libvirt.driver [instance: 7e2ae11f-161c-4d13-a1a5-37d0a8150e6b] Traceback (most recent call last):
Nov 16 10:13:07 user nova-compute[85141]: ERROR nova.virt.libvirt.driver [instance: 7e2ae11f-161c-4d13-a1a5-37d0a8150e6b]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 16 10:13:07 user nova-compute[85141]: ERROR nova.virt.libvirt.driver [instance: 7e2ae11f-161c-4d13-a1a5-37d0a8150e6b]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 16 10:13:07 user nova-compute[85141]: ERROR nova.virt.libvirt.driver [instance: 7e2ae11f-161c-4d13-a1a5-37d0a8150e6b]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 16 10:13:07 user nova-compute[85141]: ERROR nova.virt.libvirt.driver [instance: 7e2ae11f-161c-4d13-a1a5-37d0a8150e6b]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 16 10:13:07 user nova-compute[85141]: ERROR nova.virt.libvirt.driver [instance: 7e2ae11f-161c-4d13-a1a5-37d0a8150e6b]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 16 10:13:07 user nova-compute[85141]: ERROR nova.virt.libvirt.driver [instance: 7e2ae11f-161c-4d13-a1a5-37d0a8150e6b]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 16 10:13:07 user nova-compute[85141]: ERROR nova.virt.libvirt.driver [instance: 7e2ae11f-161c-4d13-a1a5-37d0a8150e6b]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 16 10:13:07 user nova-compute[85141]: ERROR nova.virt.libvirt.driver [instance: 7e2ae11f-161c-4d13-a1a5-37d0a8150e6b]     rv = execute(f, *args, **kwargs)
Nov 16 10:13:07 user nova-compute[85141]: ERROR nova.virt.libvirt.driver [instance: 7e2ae11f-161c-4d13-a1a5-37d0a8150e6b]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 16 10:13:07 user nova-compute[85141]: ERROR nova.virt.libvirt.driver [instance: 7e2ae11f-161c-4d13-a1a5-37d0a8150e6b]     six.reraise(c, e, tb)
Nov 16 10:13:07 user nova-compute[85141]: ERROR nova.virt.libvirt.driver [instance: 7e2ae11f-161c-4d13-a1a5-37d0a8150e6b]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 16 10:13:07 user nova-compute[85141]: ERROR nova.virt.libvirt.driver [instance: 7e2ae11f-161c-4d13-a1a5-37d0a8150e6b]     raise value
Nov 16 10:13:07 user nova-compute[85141]: ERROR nova.virt.libvirt.driver [instance: 7e2ae11f-161c-4d13-a1a5-37d0a8150e6b]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 16 10:13:07 user nova-compute[85141]: ERROR nova.virt.libvirt.driver [instance: 7e2ae11f-161c-4d13-a1a5-37d0a8150e6b]     rv = meth(*args, **kwargs)
Nov 16 10:13:07 user nova-compute[85141]: ERROR nova.virt.libvirt.driver [instance: 7e2ae11f-161c-4d13-a1a5-37d0a8150e6b]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 16 10:13:07 user nova-compute[85141]: ERROR nova.virt.libvirt.driver [instance: 7e2ae11f-161c-4d13-a1a5-37d0a8150e6b]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 16 10:13:07 user nova-compute[85141]: ERROR nova.virt.libvirt.driver [instance: 7e2ae11f-161c-4d13-a1a5-37d0a8150e6b] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 16 10:13:07 user nova-compute[85141]: ERROR nova.virt.libvirt.driver [instance: 7e2ae11f-161c-4d13-a1a5-37d0a8150e6b] 
Nov 16 10:13:07 user nova-compute[85141]: ERROR nova.virt.libvirt.driver [None req-1b30216b-d366-4837-8817-380c5433db2c tempest-VolumesAssistedSnapshotsTest-1102047891 tempest-VolumesAssistedSnapshotsTest-1102047891-project] [instance: 7e2ae11f-161c-4d13-a1a5-37d0a8150e6b] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 16 10:13:07 user nova-compute[85141]: ERROR nova.virt.libvirt.driver [instance: 7e2ae11f-161c-4d13-a1a5-37d0a8150e6b] Traceback (most recent call last):
Nov 16 10:13:07 user nova-compute[85141]: ERROR nova.virt.libvirt.driver [instance: 7e2ae11f-161c-4d13-a1a5-37d0a8150e6b]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 16 10:13:07 user nova-compute[85141]: ERROR nova.virt.libvirt.driver [instance: 7e2ae11f-161c-4d13-a1a5-37d0a8150e6b]     self._volume_snapshot_create(context, instance, guest,
Nov 16 10:13:07 user nova-compute[85141]: ERROR nova.virt.libvirt.driver [instance: 7e2ae11f-161c-4d13-a1a5-37d0a8150e6b]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 16 10:13:07 user nova-compute[85141]: ERROR nova.virt.libvirt.driver [instance: 7e2ae11f-161c-4d13-a1a5-37d0a8150e6b]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 16 10:13:07 user nova-compute[85141]: ERROR nova.virt.libvirt.driver [instance: 7e2ae11f-161c-4d13-a1a5-37d0a8150e6b]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 16 10:13:07 user nova-compute[85141]: ERROR nova.virt.libvirt.driver [instance: 7e2ae11f-161c-4d13-a1a5-37d0a8150e6b]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 16 10:13:07 user nova-compute[85141]: ERROR nova.virt.libvirt.driver [instance: 7e2ae11f-161c-4d13-a1a5-37d0a8150e6b]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 16 10:13:07 user nova-compute[85141]: ERROR nova.virt.libvirt.driver [instance: 7e2ae11f-161c-4d13-a1a5-37d0a8150e6b]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 16 10:13:07 user nova-compute[85141]: ERROR nova.virt.libvirt.driver [instance: 7e2ae11f-161c-4d13-a1a5-37d0a8150e6b]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 16 10:13:07 user nova-compute[85141]: ERROR nova.virt.libvirt.driver [instance: 7e2ae11f-161c-4d13-a1a5-37d0a8150e6b]     rv = execute(f, *args, **kwargs)
Nov 16 10:13:07 user nova-compute[85141]: ERROR nova.virt.libvirt.driver [instance: 7e2ae11f-161c-4d13-a1a5-37d0a8150e6b]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 16 10:13:07 user nova-compute[85141]: ERROR nova.virt.libvirt.driver [instance: 7e2ae11f-161c-4d13-a1a5-37d0a8150e6b]     six.reraise(c, e, tb)
Nov 16 10:13:07 user nova-compute[85141]: ERROR nova.virt.libvirt.driver [instance: 7e2ae11f-161c-4d13-a1a5-37d0a8150e6b]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 16 10:13:07 user nova-compute[85141]: ERROR nova.virt.libvirt.driver [instance: 7e2ae11f-161c-4d13-a1a5-37d0a8150e6b]     raise value
Nov 16 10:13:07 user nova-compute[85141]: ERROR nova.virt.libvirt.driver [instance: 7e2ae11f-161c-4d13-a1a5-37d0a8150e6b]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 16 10:13:07 user nova-compute[85141]: ERROR nova.virt.libvirt.driver [instance: 7e2ae11f-161c-4d13-a1a5-37d0a8150e6b]     rv = meth(*args, **kwargs)
Nov 16 10:13:07 user nova-compute[85141]: ERROR nova.virt.libvirt.driver [instance: 7e2ae11f-161c-4d13-a1a5-37d0a8150e6b]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 16 10:13:07 user nova-compute[85141]: ERROR nova.virt.libvirt.driver [instance: 7e2ae11f-161c-4d13-a1a5-37d0a8150e6b]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 16 10:13:07 user nova-compute[85141]: ERROR nova.virt.libvirt.driver [instance: 7e2ae11f-161c-4d13-a1a5-37d0a8150e6b] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 16 10:13:07 user nova-compute[85141]: ERROR nova.virt.libvirt.driver [instance: 7e2ae11f-161c-4d13-a1a5-37d0a8150e6b] 
Nov 16 10:13:07 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-814ff144-4c92-45cd-9a5f-eb96aa132069 tempest-VolumesAssistedSnapshotsTest-1102047891 tempest-VolumesAssistedSnapshotsTest-1102047891-project] [instance: 7e2ae11f-161c-4d13-a1a5-37d0a8150e6b] volume_snapshot_delete: delete_info: {'volume_id': 'ba7ca2a3-5f1e-4544-852f-d57100b608e3'} {{(pid=85141) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3677}}
Nov 16 10:13:07 user nova-compute[85141]: ERROR nova.virt.libvirt.driver [None req-814ff144-4c92-45cd-9a5f-eb96aa132069 tempest-VolumesAssistedSnapshotsTest-1102047891 tempest-VolumesAssistedSnapshotsTest-1102047891-project] [instance: 7e2ae11f-161c-4d13-a1a5-37d0a8150e6b] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Nov 16 10:13:07 user nova-compute[85141]: ERROR nova.virt.libvirt.driver [instance: 7e2ae11f-161c-4d13-a1a5-37d0a8150e6b] Traceback (most recent call last):
Nov 16 10:13:07 user nova-compute[85141]: ERROR nova.virt.libvirt.driver [instance: 7e2ae11f-161c-4d13-a1a5-37d0a8150e6b]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 16 10:13:07 user nova-compute[85141]: ERROR nova.virt.libvirt.driver [instance: 7e2ae11f-161c-4d13-a1a5-37d0a8150e6b]     self._volume_snapshot_delete(context, instance, volume_id,
Nov 16 10:13:07 user nova-compute[85141]: ERROR nova.virt.libvirt.driver [instance: 7e2ae11f-161c-4d13-a1a5-37d0a8150e6b]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 16 10:13:07 user nova-compute[85141]: ERROR nova.virt.libvirt.driver [instance: 7e2ae11f-161c-4d13-a1a5-37d0a8150e6b]     if delete_info['type'] != 'qcow2':
Nov 16 10:13:07 user nova-compute[85141]: ERROR nova.virt.libvirt.driver [instance: 7e2ae11f-161c-4d13-a1a5-37d0a8150e6b] KeyError: 'type'
Nov 16 10:13:07 user nova-compute[85141]: ERROR nova.virt.libvirt.driver [instance: 7e2ae11f-161c-4d13-a1a5-37d0a8150e6b] 
Nov 16 10:13:07 user nova-compute[85141]: ERROR nova.virt.libvirt.driver [None req-1b30216b-d366-4837-8817-380c5433db2c tempest-VolumesAssistedSnapshotsTest-1102047891 tempest-VolumesAssistedSnapshotsTest-1102047891-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot 5b0b2ee8-b24a-442c-9384-8ecfb2177a86 could not be found.
Nov 16 10:13:07 user nova-compute[85141]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 16 10:13:07 user nova-compute[85141]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 16 10:13:07 user nova-compute[85141]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Nov 16 10:13:07 user nova-compute[85141]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 16 10:13:07 user nova-compute[85141]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 16 10:13:07 user nova-compute[85141]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 16 10:13:07 user nova-compute[85141]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 16 10:13:07 user nova-compute[85141]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 16 10:13:07 user nova-compute[85141]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 16 10:13:07 user nova-compute[85141]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 16 10:13:07 user nova-compute[85141]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Nov 16 10:13:07 user nova-compute[85141]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 16 10:13:07 user nova-compute[85141]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Nov 16 10:13:07 user nova-compute[85141]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 16 10:13:07 user nova-compute[85141]: ERROR nova.virt.libvirt.driver     raise value
Nov 16 10:13:07 user nova-compute[85141]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 16 10:13:07 user nova-compute[85141]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Nov 16 10:13:07 user nova-compute[85141]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 16 10:13:07 user nova-compute[85141]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 16 10:13:07 user nova-compute[85141]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 16 10:13:07 user nova-compute[85141]: ERROR nova.virt.libvirt.driver 
Nov 16 10:13:07 user nova-compute[85141]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 16 10:13:07 user nova-compute[85141]: ERROR nova.virt.libvirt.driver 
Nov 16 10:13:07 user nova-compute[85141]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 16 10:13:07 user nova-compute[85141]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 16 10:13:07 user nova-compute[85141]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 16 10:13:07 user nova-compute[85141]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 16 10:13:07 user nova-compute[85141]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 16 10:13:07 user nova-compute[85141]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 16 10:13:07 user nova-compute[85141]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 16 10:13:07 user nova-compute[85141]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 16 10:13:07 user nova-compute[85141]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 16 10:13:07 user nova-compute[85141]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 16 10:13:07 user nova-compute[85141]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 16 10:13:07 user nova-compute[85141]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 16 10:13:07 user nova-compute[85141]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 16 10:13:07 user nova-compute[85141]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 16 10:13:07 user nova-compute[85141]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 16 10:13:07 user nova-compute[85141]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot 5b0b2ee8-b24a-442c-9384-8ecfb2177a86 could not be found. (HTTP 404) (Request-ID: req-6807b6a0-4405-4347-b133-edff0e883d27)
Nov 16 10:13:07 user nova-compute[85141]: ERROR nova.virt.libvirt.driver 
Nov 16 10:13:07 user nova-compute[85141]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 16 10:13:07 user nova-compute[85141]: ERROR nova.virt.libvirt.driver 
Nov 16 10:13:07 user nova-compute[85141]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 16 10:13:07 user nova-compute[85141]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 16 10:13:07 user nova-compute[85141]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 16 10:13:07 user nova-compute[85141]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 16 10:13:07 user nova-compute[85141]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 16 10:13:07 user nova-compute[85141]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 16 10:13:07 user nova-compute[85141]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 16 10:13:07 user nova-compute[85141]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 16 10:13:07 user nova-compute[85141]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 16 10:13:07 user nova-compute[85141]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 16 10:13:07 user nova-compute[85141]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 16 10:13:07 user nova-compute[85141]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 16 10:13:07 user nova-compute[85141]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 16 10:13:07 user nova-compute[85141]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 16 10:13:07 user nova-compute[85141]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 16 10:13:07 user nova-compute[85141]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 16 10:13:07 user nova-compute[85141]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 16 10:13:07 user nova-compute[85141]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 16 10:13:07 user nova-compute[85141]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 16 10:13:07 user nova-compute[85141]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 16 10:13:07 user nova-compute[85141]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 16 10:13:07 user nova-compute[85141]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 16 10:13:07 user nova-compute[85141]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 16 10:13:07 user nova-compute[85141]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot 5b0b2ee8-b24a-442c-9384-8ecfb2177a86 could not be found.
Nov 16 10:13:07 user nova-compute[85141]: ERROR nova.virt.libvirt.driver 
Nov 16 10:13:07 user nova-compute[85141]: ERROR oslo_messaging.rpc.server [None req-1b30216b-d366-4837-8817-380c5433db2c tempest-VolumesAssistedSnapshotsTest-1102047891 tempest-VolumesAssistedSnapshotsTest-1102047891-project] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 16 10:13:07 user nova-compute[85141]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 16 10:13:07 user nova-compute[85141]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 16 10:13:07 user nova-compute[85141]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 16 10:13:07 user nova-compute[85141]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 16 10:13:07 user nova-compute[85141]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 16 10:13:07 user nova-compute[85141]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 16 10:13:07 user nova-compute[85141]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 16 10:13:07 user nova-compute[85141]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 16 10:13:07 user nova-compute[85141]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 16 10:13:07 user nova-compute[85141]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 16 10:13:07 user nova-compute[85141]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 16 10:13:07 user nova-compute[85141]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 16 10:13:07 user nova-compute[85141]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 16 10:13:07 user nova-compute[85141]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 16 10:13:07 user nova-compute[85141]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 16 10:13:07 user nova-compute[85141]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 16 10:13:07 user nova-compute[85141]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 16 10:13:07 user nova-compute[85141]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4505, in volume_snapshot_create
Nov 16 10:13:07 user nova-compute[85141]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Nov 16 10:13:07 user nova-compute[85141]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3597, in volume_snapshot_create
Nov 16 10:13:07 user nova-compute[85141]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 16 10:13:07 user nova-compute[85141]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 16 10:13:07 user nova-compute[85141]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 16 10:13:07 user nova-compute[85141]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 16 10:13:07 user nova-compute[85141]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 16 10:13:07 user nova-compute[85141]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 16 10:13:07 user nova-compute[85141]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Nov 16 10:13:07 user nova-compute[85141]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 16 10:13:07 user nova-compute[85141]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 16 10:13:07 user nova-compute[85141]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 16 10:13:07 user nova-compute[85141]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 16 10:13:07 user nova-compute[85141]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 16 10:13:07 user nova-compute[85141]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 16 10:13:07 user nova-compute[85141]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 16 10:13:07 user nova-compute[85141]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Nov 16 10:13:07 user nova-compute[85141]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 16 10:13:07 user nova-compute[85141]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Nov 16 10:13:07 user nova-compute[85141]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 16 10:13:07 user nova-compute[85141]: ERROR oslo_messaging.rpc.server     raise value
Nov 16 10:13:07 user nova-compute[85141]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 16 10:13:07 user nova-compute[85141]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Nov 16 10:13:07 user nova-compute[85141]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 16 10:13:07 user nova-compute[85141]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 16 10:13:07 user nova-compute[85141]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 16 10:13:07 user nova-compute[85141]: ERROR oslo_messaging.rpc.server 
Nov 16 10:13:07 user nova-compute[85141]: DEBUG nova.compute.manager [None req-7563521d-9bc0-404e-87e4-0c0b253b214a tempest-TestVolumeSwap-1037451778 tempest-TestVolumeSwap-1037451778-project-admin] [instance: ad1ace46-2e8e-42e1-a0f5-2384078fcf09] swap_volume: Updating volume 7e233047-dda3-4f2e-803c-7b69a57ac656 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:eb0e3ad6-04d7-4405-b4ae-0440b2a396ce", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "TGILpNCR", "auth_password": "bo45IKCUqHkv30", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdj", "volume_id": "eb0e3ad6-04d7-4405-b4ae-0440b2a396ce"}, "status": "reserved", "instance": "ad1ace46-2e8e-42e1-a0f5-2384078fcf09", "attached_at": "", "detached_at": "", "volume_id": "eb0e3ad6-04d7-4405-b4ae-0440b2a396ce", "serial": "eb0e3ad6-04d7-4405-b4ae-0440b2a396ce"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': 'eb0e3ad6-04d7-4405-b4ae-0440b2a396ce', 'no_device': None, 'attachment_id': '216ae799-f309-4506-89ca-c6a40d8cdd70'} {{(pid=85141) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7984}}
Nov 16 10:13:07 user nova-compute[85141]: ERROR nova.virt.libvirt.driver [None req-814ff144-4c92-45cd-9a5f-eb96aa132069 tempest-VolumesAssistedSnapshotsTest-1102047891 tempest-VolumesAssistedSnapshotsTest-1102047891-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 16 10:13:07 user nova-compute[85141]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 16 10:13:07 user nova-compute[85141]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 16 10:13:07 user nova-compute[85141]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Nov 16 10:13:07 user nova-compute[85141]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 16 10:13:07 user nova-compute[85141]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Nov 16 10:13:07 user nova-compute[85141]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Nov 16 10:13:07 user nova-compute[85141]: ERROR nova.virt.libvirt.driver 
Nov 16 10:13:07 user nova-compute[85141]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 16 10:13:07 user nova-compute[85141]: ERROR nova.virt.libvirt.driver 
Nov 16 10:13:07 user nova-compute[85141]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 16 10:13:07 user nova-compute[85141]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 16 10:13:07 user nova-compute[85141]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 16 10:13:07 user nova-compute[85141]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 16 10:13:07 user nova-compute[85141]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 16 10:13:07 user nova-compute[85141]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 16 10:13:07 user nova-compute[85141]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 16 10:13:07 user nova-compute[85141]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 16 10:13:07 user nova-compute[85141]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 16 10:13:07 user nova-compute[85141]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 16 10:13:07 user nova-compute[85141]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 16 10:13:07 user nova-compute[85141]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 16 10:13:07 user nova-compute[85141]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 16 10:13:07 user nova-compute[85141]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 16 10:13:07 user nova-compute[85141]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 16 10:13:07 user nova-compute[85141]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-ba6a2a67-2a8a-4edc-9262-572ad8ce537d)
Nov 16 10:13:07 user nova-compute[85141]: ERROR nova.virt.libvirt.driver 
Nov 16 10:13:07 user nova-compute[85141]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 16 10:13:07 user nova-compute[85141]: ERROR nova.virt.libvirt.driver 
Nov 16 10:13:07 user nova-compute[85141]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 16 10:13:07 user nova-compute[85141]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 16 10:13:07 user nova-compute[85141]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 16 10:13:07 user nova-compute[85141]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 16 10:13:07 user nova-compute[85141]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 16 10:13:07 user nova-compute[85141]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 16 10:13:07 user nova-compute[85141]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 16 10:13:07 user nova-compute[85141]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 16 10:13:07 user nova-compute[85141]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 16 10:13:07 user nova-compute[85141]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 16 10:13:07 user nova-compute[85141]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 16 10:13:07 user nova-compute[85141]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 16 10:13:07 user nova-compute[85141]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 16 10:13:07 user nova-compute[85141]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 16 10:13:07 user nova-compute[85141]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 16 10:13:07 user nova-compute[85141]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 16 10:13:07 user nova-compute[85141]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 16 10:13:07 user nova-compute[85141]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 16 10:13:07 user nova-compute[85141]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 16 10:13:07 user nova-compute[85141]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 16 10:13:07 user nova-compute[85141]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 16 10:13:07 user nova-compute[85141]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 16 10:13:07 user nova-compute[85141]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 16 10:13:07 user nova-compute[85141]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 16 10:13:07 user nova-compute[85141]: ERROR nova.virt.libvirt.driver 
Nov 16 10:13:07 user nova-compute[85141]: ERROR oslo_messaging.rpc.server [None req-814ff144-4c92-45cd-9a5f-eb96aa132069 tempest-VolumesAssistedSnapshotsTest-1102047891 tempest-VolumesAssistedSnapshotsTest-1102047891-project] Exception during message handling: KeyError: 'type'
Nov 16 10:13:07 user nova-compute[85141]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 16 10:13:07 user nova-compute[85141]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 16 10:13:07 user nova-compute[85141]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 16 10:13:07 user nova-compute[85141]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 16 10:13:07 user nova-compute[85141]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 16 10:13:07 user nova-compute[85141]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 16 10:13:07 user nova-compute[85141]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 16 10:13:07 user nova-compute[85141]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 16 10:13:07 user nova-compute[85141]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 16 10:13:07 user nova-compute[85141]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 16 10:13:07 user nova-compute[85141]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 16 10:13:07 user nova-compute[85141]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 16 10:13:07 user nova-compute[85141]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 16 10:13:07 user nova-compute[85141]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 16 10:13:07 user nova-compute[85141]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 16 10:13:07 user nova-compute[85141]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 16 10:13:07 user nova-compute[85141]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 16 10:13:07 user nova-compute[85141]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4517, in volume_snapshot_delete
Nov 16 10:13:07 user nova-compute[85141]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Nov 16 10:13:07 user nova-compute[85141]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3853, in volume_snapshot_delete
Nov 16 10:13:07 user nova-compute[85141]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 16 10:13:07 user nova-compute[85141]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 16 10:13:07 user nova-compute[85141]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 16 10:13:07 user nova-compute[85141]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 16 10:13:07 user nova-compute[85141]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 16 10:13:07 user nova-compute[85141]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 16 10:13:07 user nova-compute[85141]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Nov 16 10:13:07 user nova-compute[85141]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 16 10:13:07 user nova-compute[85141]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Nov 16 10:13:07 user nova-compute[85141]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Nov 16 10:13:07 user nova-compute[85141]: ERROR oslo_messaging.rpc.server 
Nov 16 10:13:07 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-7563521d-9bc0-404e-87e4-0c0b253b214a tempest-TestVolumeSwap-1037451778 tempest-TestVolumeSwap-1037451778-project-admin] Lock "ad1ace46-2e8e-42e1-a0f5-2384078fcf09" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 16.178s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:13:08 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-c72cdda9-682a-44eb-a5c4-51216a8e3c94 tempest-VolumesAssistedSnapshotsTest-799935866 tempest-VolumesAssistedSnapshotsTest-799935866-project-admin] Acquiring lock "7e2ae11f-161c-4d13-a1a5-37d0a8150e6b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:13:08 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-c72cdda9-682a-44eb-a5c4-51216a8e3c94 tempest-VolumesAssistedSnapshotsTest-799935866 tempest-VolumesAssistedSnapshotsTest-799935866-project-admin] Lock "7e2ae11f-161c-4d13-a1a5-37d0a8150e6b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:13:08 user nova-compute[85141]: INFO nova.compute.manager [None req-c72cdda9-682a-44eb-a5c4-51216a8e3c94 tempest-VolumesAssistedSnapshotsTest-799935866 tempest-VolumesAssistedSnapshotsTest-799935866-project-admin] [instance: 7e2ae11f-161c-4d13-a1a5-37d0a8150e6b] Detaching volume ba7ca2a3-5f1e-4544-852f-d57100b608e3
Nov 16 10:13:08 user nova-compute[85141]: INFO nova.virt.block_device [None req-c72cdda9-682a-44eb-a5c4-51216a8e3c94 tempest-VolumesAssistedSnapshotsTest-799935866 tempest-VolumesAssistedSnapshotsTest-799935866-project-admin] [instance: 7e2ae11f-161c-4d13-a1a5-37d0a8150e6b] Attempting to driver detach volume ba7ca2a3-5f1e-4544-852f-d57100b608e3 from mountpoint /dev/vdb
Nov 16 10:13:08 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-c72cdda9-682a-44eb-a5c4-51216a8e3c94 tempest-VolumesAssistedSnapshotsTest-799935866 tempest-VolumesAssistedSnapshotsTest-799935866-project-admin] Attempting to detach device vdb from instance 7e2ae11f-161c-4d13-a1a5-37d0a8150e6b from the persistent domain config. {{(pid=85141) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 10:13:08 user nova-compute[85141]: DEBUG nova.virt.libvirt.guest [None req-c72cdda9-682a-44eb-a5c4-51216a8e3c94 tempest-VolumesAssistedSnapshotsTest-799935866 tempest-VolumesAssistedSnapshotsTest-799935866-project-admin] detach device xml: <disk type="block" device="disk">
Nov 16 10:13:08 user nova-compute[85141]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 10:13:08 user nova-compute[85141]:   <source dev="/dev/sdi"/>
Nov 16 10:13:08 user nova-compute[85141]:   <target dev="vdb" bus="virtio"/>
Nov 16 10:13:08 user nova-compute[85141]:   <serial>ba7ca2a3-5f1e-4544-852f-d57100b608e3</serial>
Nov 16 10:13:08 user nova-compute[85141]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 10:13:08 user nova-compute[85141]: </disk>
Nov 16 10:13:08 user nova-compute[85141]:  {{(pid=85141) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 10:13:08 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-c72cdda9-682a-44eb-a5c4-51216a8e3c94 tempest-VolumesAssistedSnapshotsTest-799935866 tempest-VolumesAssistedSnapshotsTest-799935866-project-admin] Successfully detached device vdb from instance 7e2ae11f-161c-4d13-a1a5-37d0a8150e6b from the persistent domain config.
Nov 16 10:13:08 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-c72cdda9-682a-44eb-a5c4-51216a8e3c94 tempest-VolumesAssistedSnapshotsTest-799935866 tempest-VolumesAssistedSnapshotsTest-799935866-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 7e2ae11f-161c-4d13-a1a5-37d0a8150e6b from the live domain config. {{(pid=85141) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 10:13:08 user nova-compute[85141]: DEBUG nova.virt.libvirt.guest [None req-c72cdda9-682a-44eb-a5c4-51216a8e3c94 tempest-VolumesAssistedSnapshotsTest-799935866 tempest-VolumesAssistedSnapshotsTest-799935866-project-admin] detach device xml: <disk type="block" device="disk">
Nov 16 10:13:08 user nova-compute[85141]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 10:13:08 user nova-compute[85141]:   <source dev="/dev/sdi"/>
Nov 16 10:13:08 user nova-compute[85141]:   <target dev="vdb" bus="virtio"/>
Nov 16 10:13:08 user nova-compute[85141]:   <serial>ba7ca2a3-5f1e-4544-852f-d57100b608e3</serial>
Nov 16 10:13:08 user nova-compute[85141]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 10:13:08 user nova-compute[85141]: </disk>
Nov 16 10:13:08 user nova-compute[85141]:  {{(pid=85141) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 10:13:08 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-c72cdda9-682a-44eb-a5c4-51216a8e3c94 tempest-VolumesAssistedSnapshotsTest-799935866 tempest-VolumesAssistedSnapshotsTest-799935866-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 7e2ae11f-161c-4d13-a1a5-37d0a8150e6b {{(pid=85141) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 10:13:08 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-2e3c140e-c9f9-46ce-a537-0787e8739533 tempest-TestVolumeSwap-1037451778 tempest-TestVolumeSwap-1037451778-project-admin] Acquiring lock "ad1ace46-2e8e-42e1-a0f5-2384078fcf09" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:13:08 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-2e3c140e-c9f9-46ce-a537-0787e8739533 tempest-TestVolumeSwap-1037451778 tempest-TestVolumeSwap-1037451778-project-admin] Lock "ad1ace46-2e8e-42e1-a0f5-2384078fcf09" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:13:08 user nova-compute[85141]: DEBUG os_brick.utils [None req-2e3c140e-c9f9-46ce-a537-0787e8739533 tempest-TestVolumeSwap-1037451778 tempest-TestVolumeSwap-1037451778-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 10:13:08 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:13:08 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:13:08 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf1bc04f-2373-40d7-b9fe-1cc07fbc0260]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c7834de5c295\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:13:08 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:13:08 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:13:08 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[e919e008-3397-46a3-98d3-fdbd0044fec9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:13:08 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:13:08 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:13:08 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[42717f10-37ce-4dd6-9970-14ded53f5fef]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:13:08 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[1559545d-038c-4afb-bc96-890e4f541819]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:13:08 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-2e3c140e-c9f9-46ce-a537-0787e8739533 tempest-TestVolumeSwap-1037451778 tempest-TestVolumeSwap-1037451778-project-admin] Running cmd (subprocess): nvme version {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:13:08 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-2e3c140e-c9f9-46ce-a537-0787e8739533 tempest-TestVolumeSwap-1037451778 tempest-TestVolumeSwap-1037451778-project-admin] 'nvme version' failed. Not Retrying. {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 10:13:08 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2e3c140e-c9f9-46ce-a537-0787e8739533 tempest-TestVolumeSwap-1037451778 tempest-TestVolumeSwap-1037451778-project-admin] nvme not present on system {{(pid=85141) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 10:13:08 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:13:08 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 10:13:08 user nova-compute[85141]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 10:13:08 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[62c02bdf-1d92-41ad-881a-4454404f80d0]: (4, '') {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:13:08 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.lightos [None req-2e3c140e-c9f9-46ce-a537-0787e8739533 tempest-TestVolumeSwap-1037451778 tempest-TestVolumeSwap-1037451778-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=85141) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 10:13:08 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.lightos [None req-2e3c140e-c9f9-46ce-a537-0787e8739533 tempest-TestVolumeSwap-1037451778 tempest-TestVolumeSwap-1037451778-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=85141) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 10:13:08 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.lightos [None req-2e3c140e-c9f9-46ce-a537-0787e8739533 tempest-TestVolumeSwap-1037451778 tempest-TestVolumeSwap-1037451778-project-admin] LIGHTOS: no hostnqn found. {{(pid=85141) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 10:13:08 user nova-compute[85141]: DEBUG os_brick.utils [None req-2e3c140e-c9f9-46ce-a537-0787e8739533 tempest-TestVolumeSwap-1037451778 tempest-TestVolumeSwap-1037451778-project-admin] <== get_connector_properties: return (108ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c7834de5c295', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 10:13:08 user nova-compute[85141]: INFO nova.compute.manager [None req-2e3c140e-c9f9-46ce-a537-0787e8739533 tempest-TestVolumeSwap-1037451778 tempest-TestVolumeSwap-1037451778-project-admin] [instance: ad1ace46-2e8e-42e1-a0f5-2384078fcf09] Swapping volume eb0e3ad6-04d7-4405-b4ae-0440b2a396ce for 7e233047-dda3-4f2e-803c-7b69a57ac656
Nov 16 10:13:09 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-68a55eb0-e7c0-4da6-939c-890e936d1f9c tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] [instance: 6caf3667-5613-4ef4-a597-1820e6c1c0ac] Creating instance directory {{(pid=85141) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 10:13:09 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-68a55eb0-e7c0-4da6-939c-890e936d1f9c tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] [instance: 6caf3667-5613-4ef4-a597-1820e6c1c0ac] Creating image(s)
Nov 16 10:13:09 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-68a55eb0-e7c0-4da6-939c-890e936d1f9c tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] [instance: 6caf3667-5613-4ef4-a597-1820e6c1c0ac] Did not create local disks {{(pid=85141) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 16 10:13:09 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-68a55eb0-e7c0-4da6-939c-890e936d1f9c tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] [instance: 6caf3667-5613-4ef4-a597-1820e6c1c0ac] Ensure instance console log exists: /opt/stack/data/nova/instances/6caf3667-5613-4ef4-a597-1820e6c1c0ac/console.log {{(pid=85141) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 10:13:09 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-68a55eb0-e7c0-4da6-939c-890e936d1f9c tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:13:09 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-68a55eb0-e7c0-4da6-939c-890e936d1f9c tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:13:09 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-68a55eb0-e7c0-4da6-939c-890e936d1f9c tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:13:09 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-68a55eb0-e7c0-4da6-939c-890e936d1f9c tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] [instance: 6caf3667-5613-4ef4-a597-1820e6c1c0ac] Start _get_guest_xml network_info=[{"id": "ad2b755f-6905-4256-be59-b64dae993293", "address": "fa:16:3e:fb:7c:00", "network": {"id": "9b5d58ef-109a-4ccb-90e4-a6b18c02f49c", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1619595955-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.67", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e017c305665f4a98a75d1d77701b6527", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad2b755f-69", "ovs_interfaceid": "ad2b755f-6905-4256-be59-b64dae993293", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T10:06:42Z,direct_url=<?>,disk_format='qcow2',id=bc4ca70f-a459-4d5c-a9e6-80f1948eb48b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1044631a5fe84ce8904864a7024049fa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T10:06:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:42c041ec-fa39-4035-b82b-867caf3565df', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CbSKnRJc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '6caf3667-5613-4ef4-a597-1820e6c1c0ac', 'attached_at': '', 'detached_at': '', 'volume_id': '42c041ec-fa39-4035-b82b-867caf3565df', 'serial': '42c041ec-fa39-4035-b82b-867caf3565df'}, 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'attachment_id': '9202a934-bd2b-40c8-9ab6-9d878fee4c13', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=85141) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 10:13:09 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-68a55eb0-e7c0-4da6-939c-890e936d1f9c tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 16 10:13:09 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-68a55eb0-e7c0-4da6-939c-890e936d1f9c tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 16 10:13:09 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-68a55eb0-e7c0-4da6-939c-890e936d1f9c tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=85141) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 10:13:09 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-68a55eb0-e7c0-4da6-939c-890e936d1f9c tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] CPU controller missing on host. {{(pid=85141) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 10:13:09 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-68a55eb0-e7c0-4da6-939c-890e936d1f9c tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=85141) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 10:13:09 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-68a55eb0-e7c0-4da6-939c-890e936d1f9c tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] CPU controller found on host. {{(pid=85141) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 10:13:09 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-68a55eb0-e7c0-4da6-939c-890e936d1f9c tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=85141) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 10:13:09 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-68a55eb0-e7c0-4da6-939c-890e936d1f9c tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T10:06:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T10:06:42Z,direct_url=<?>,disk_format='qcow2',id=bc4ca70f-a459-4d5c-a9e6-80f1948eb48b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1044631a5fe84ce8904864a7024049fa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T10:06:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 10:13:09 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-68a55eb0-e7c0-4da6-939c-890e936d1f9c tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] Flavor limits 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 10:13:09 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-68a55eb0-e7c0-4da6-939c-890e936d1f9c tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] Image limits 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 10:13:09 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-68a55eb0-e7c0-4da6-939c-890e936d1f9c tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] Flavor pref 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 10:13:09 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-68a55eb0-e7c0-4da6-939c-890e936d1f9c tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] Image pref 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 10:13:09 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-68a55eb0-e7c0-4da6-939c-890e936d1f9c tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 10:13:09 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-68a55eb0-e7c0-4da6-939c-890e936d1f9c tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 10:13:09 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-68a55eb0-e7c0-4da6-939c-890e936d1f9c tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=85141) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 10:13:09 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-68a55eb0-e7c0-4da6-939c-890e936d1f9c tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] Got 1 possible topologies {{(pid=85141) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 10:13:09 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-68a55eb0-e7c0-4da6-939c-890e936d1f9c tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 10:13:09 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-68a55eb0-e7c0-4da6-939c-890e936d1f9c tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 10:13:09 user nova-compute[85141]: DEBUG nova.objects.instance [None req-68a55eb0-e7c0-4da6-939c-890e936d1f9c tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] Lazy-loading 'vcpu_model' on Instance uuid 6caf3667-5613-4ef4-a597-1820e6c1c0ac {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:13:09 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-68a55eb0-e7c0-4da6-939c-890e936d1f9c tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] [instance: 6caf3667-5613-4ef4-a597-1820e6c1c0ac] Calling os-brick to attach iSCSI Volume {{(pid=85141) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 10:13:09 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-68a55eb0-e7c0-4da6-939c-890e936d1f9c tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51806b6080>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:42c041ec-fa39-4035-b82b-867caf3565df', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CbSKnRJc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 10:13:09 user nova-compute[85141]: WARNING os_brick.initiator.connectors.base [None req-68a55eb0-e7c0-4da6-939c-890e936d1f9c tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 16 10:13:09 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-68a55eb0-e7c0-4da6-939c-890e936d1f9c tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 10:13:09 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-68a55eb0-e7c0-4da6-939c-890e936d1f9c tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 10:13:09 user nova-compute[85141]: WARNING os_brick.initiator.connectors.base [None req-68a55eb0-e7c0-4da6-939c-890e936d1f9c tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 16 10:13:09 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-68a55eb0-e7c0-4da6-939c-890e936d1f9c tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:42c041ec-fa39-4035-b82b-867caf3565df" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 10:13:09 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-68a55eb0-e7c0-4da6-939c-890e936d1f9c tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:42c041ec-fa39-4035-b82b-867caf3565df" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 10:13:09 user nova-compute[85141]: INFO os_brick.initiator.connectors.iscsi [None req-68a55eb0-e7c0-4da6-939c-890e936d1f9c tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 10:13:09 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42c041ec-fa39-4035-b82b-867caf3565df -p 172.16.0.220:3260 {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:13:09 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42c041ec-fa39-4035-b82b-867caf3565df -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:13:09 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[37c3e1e9-0dac-429b-9359-826fa10fa8bd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:13:09 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-68a55eb0-e7c0-4da6-939c-890e936d1f9c tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 10:13:09 user nova-compute[85141]:  {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:13:09 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42c041ec-fa39-4035-b82b-867caf3565df -p 172.16.0.220:3260 --interface default --op new {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:13:09 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42c041ec-fa39-4035-b82b-867caf3565df -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.036s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:13:09 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ee27c89-a97d-45ab-b184-3f8a1ef13dc8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:42c041ec-fa39-4035-b82b-867caf3565df] added\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:13:09 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-68a55eb0-e7c0-4da6-939c-890e936d1f9c tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:42c041ec-fa39-4035-b82b-867caf3565df] added
Nov 16 10:13:09 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:13:09 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42c041ec-fa39-4035-b82b-867caf3565df -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:13:09 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42c041ec-fa39-4035-b82b-867caf3565df -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:13:09 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[41191aea-5f5a-46b1-9257-d59821e78bfe]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:13:09 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-68a55eb0-e7c0-4da6-939c-890e936d1f9c tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:13:09 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42c041ec-fa39-4035-b82b-867caf3565df -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:13:09 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42c041ec-fa39-4035-b82b-867caf3565df -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:13:09 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[74419d25-ced1-4e5a-8a1f-92b46913c4cd]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:13:09 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-68a55eb0-e7c0-4da6-939c-890e936d1f9c tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:13:09 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42c041ec-fa39-4035-b82b-867caf3565df -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CbSKnRJc {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:13:09 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42c041ec-fa39-4035-b82b-867caf3565df -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CbSKnRJc" returned: 0 in 0.018s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:13:09 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4efc936-0dde-4579-852d-bfa0ff3f65eb]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:13:09 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-68a55eb0-e7c0-4da6-939c-890e936d1f9c tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CbSKnRJc'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:13:09 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42c041ec-fa39-4035-b82b-867caf3565df -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:13:09 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42c041ec-fa39-4035-b82b-867caf3565df -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:13:09 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[70f9f0be-31ee-4ca7-a2d2-51c47f85c636]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:13:09 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-68a55eb0-e7c0-4da6-939c-890e936d1f9c tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:13:09 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:13:09 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:13:09 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[82dd20d0-2bed-4d88-9b73-6784500b2638]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eff563f0-92d3-47a1-addc-e3eaa6828d59 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb0e3ad6-04d7-4405-b4ae-0440b2a396ce (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba7ca2a3-5f1e-4544-852f-d57100b608e3 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4df10d9-a60c-45ed-981d-96f704534fb8 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4973f768-f126-41d6-b534-458d6c49f9b3 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fcde20-e019-4cf0-ad90-6c8100f4a8d2 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ca01473-0233-4122-b008-ffa407ca3e70 (non-flash)\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:13:09 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-68a55eb0-e7c0-4da6-939c-890e936d1f9c tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eff563f0-92d3-47a1-addc-e3eaa6828d59 (non-flash)
Nov 16 10:13:09 user nova-compute[85141]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb0e3ad6-04d7-4405-b4ae-0440b2a396ce (non-flash)
Nov 16 10:13:09 user nova-compute[85141]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba7ca2a3-5f1e-4544-852f-d57100b608e3 (non-flash)
Nov 16 10:13:09 user nova-compute[85141]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4df10d9-a60c-45ed-981d-96f704534fb8 (non-flash)
Nov 16 10:13:09 user nova-compute[85141]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4973f768-f126-41d6-b534-458d6c49f9b3 (non-flash)
Nov 16 10:13:09 user nova-compute[85141]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fcde20-e019-4cf0-ad90-6c8100f4a8d2 (non-flash)
Nov 16 10:13:09 user nova-compute[85141]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ca01473-0233-4122-b008-ffa407ca3e70 (non-flash)
Nov 16 10:13:09 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:13:09 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-68a55eb0-e7c0-4da6-939c-890e936d1f9c tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eff563f0-92d3-47a1-addc-e3eaa6828d59 (non-flash)
Nov 16 10:13:09 user nova-compute[85141]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb0e3ad6-04d7-4405-b4ae-0440b2a396ce (non-flash)
Nov 16 10:13:09 user nova-compute[85141]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba7ca2a3-5f1e-4544-852f-d57100b608e3 (non-flash)
Nov 16 10:13:09 user nova-compute[85141]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4df10d9-a60c-45ed-981d-96f704534fb8 (non-flash)
Nov 16 10:13:09 user nova-compute[85141]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4973f768-f126-41d6-b534-458d6c49f9b3 (non-flash)
Nov 16 10:13:09 user nova-compute[85141]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fcde20-e019-4cf0-ad90-6c8100f4a8d2 (non-flash)
Nov 16 10:13:09 user nova-compute[85141]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ca01473-0233-4122-b008-ffa407ca3e70 (non-flash)
Nov 16 10:13:09 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 10:13:09 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42c041ec-fa39-4035-b82b-867caf3565df -p 172.16.0.220:3260 --login {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:13:09 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42c041ec-fa39-4035-b82b-867caf3565df -p 172.16.0.220:3260 --login" returned: 0 in 0.081s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:13:09 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd6ef67f-8e4e-4aa6-bd12-855bf03388b8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:42c041ec-fa39-4035-b82b-867caf3565df, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:42c041ec-fa39-4035-b82b-867caf3565df, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:13:09 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-68a55eb0-e7c0-4da6-939c-890e936d1f9c tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:42c041ec-fa39-4035-b82b-867caf3565df, portal: 172.16.0.220,3260]
Nov 16 10:13:09 user nova-compute[85141]: Login to [iface: default, target: iqn.2010-10.org.openstack:42c041ec-fa39-4035-b82b-867caf3565df, portal: 172.16.0.220,3260] successful.
Nov 16 10:13:09 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:13:09 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42c041ec-fa39-4035-b82b-867caf3565df -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:13:09 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42c041ec-fa39-4035-b82b-867caf3565df -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:13:09 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5dddaa8-52cc-4d8e-a81f-1f76e9543e5c]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:13:09 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-68a55eb0-e7c0-4da6-939c-890e936d1f9c tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:13:09 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:13:09 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:13:09 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ba13f3f-2f5b-4e48-8d3c-5aaeea335c87]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eff563f0-92d3-47a1-addc-e3eaa6828d59 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb0e3ad6-04d7-4405-b4ae-0440b2a396ce (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba7ca2a3-5f1e-4544-852f-d57100b608e3 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42c041ec-fa39-4035-b82b-867caf3565df (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4df10d9-a60c-45ed-981d-96f704534fb8 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4973f768-f126-41d6-b534-458d6c49f9b3 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fcde20-e019-4cf0-ad90-6c8100f4a8d2 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ca01473-0233-4122-b008-ffa407ca3e70 (non-flash)\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:13:09 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-68a55eb0-e7c0-4da6-939c-890e936d1f9c tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eff563f0-92d3-47a1-addc-e3eaa6828d59 (non-flash)
Nov 16 10:13:09 user nova-compute[85141]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb0e3ad6-04d7-4405-b4ae-0440b2a396ce (non-flash)
Nov 16 10:13:09 user nova-compute[85141]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba7ca2a3-5f1e-4544-852f-d57100b608e3 (non-flash)
Nov 16 10:13:09 user nova-compute[85141]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42c041ec-fa39-4035-b82b-867caf3565df (non-flash)
Nov 16 10:13:09 user nova-compute[85141]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4df10d9-a60c-45ed-981d-96f704534fb8 (non-flash)
Nov 16 10:13:09 user nova-compute[85141]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4973f768-f126-41d6-b534-458d6c49f9b3 (non-flash)
Nov 16 10:13:09 user nova-compute[85141]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fcde20-e019-4cf0-ad90-6c8100f4a8d2 (non-flash)
Nov 16 10:13:09 user nova-compute[85141]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ca01473-0233-4122-b008-ffa407ca3e70 (non-flash)
Nov 16 10:13:09 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:13:09 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-68a55eb0-e7c0-4da6-939c-890e936d1f9c tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eff563f0-92d3-47a1-addc-e3eaa6828d59 (non-flash)
Nov 16 10:13:09 user nova-compute[85141]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb0e3ad6-04d7-4405-b4ae-0440b2a396ce (non-flash)
Nov 16 10:13:09 user nova-compute[85141]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba7ca2a3-5f1e-4544-852f-d57100b608e3 (non-flash)
Nov 16 10:13:09 user nova-compute[85141]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42c041ec-fa39-4035-b82b-867caf3565df (non-flash)
Nov 16 10:13:09 user nova-compute[85141]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4df10d9-a60c-45ed-981d-96f704534fb8 (non-flash)
Nov 16 10:13:09 user nova-compute[85141]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4973f768-f126-41d6-b534-458d6c49f9b3 (non-flash)
Nov 16 10:13:09 user nova-compute[85141]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fcde20-e019-4cf0-ad90-6c8100f4a8d2 (non-flash)
Nov 16 10:13:09 user nova-compute[85141]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ca01473-0233-4122-b008-ffa407ca3e70 (non-flash)
Nov 16 10:13:09 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 10:13:09 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-68a55eb0-e7c0-4da6-939c-890e936d1f9c tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:42c041ec-fa39-4035-b82b-867caf3565df" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.334s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 10:13:09 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-68a55eb0-e7c0-4da6-939c-890e936d1f9c tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] Connected to 172.16.0.220:3260 {{(pid=85141) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 10:13:09 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-68a55eb0-e7c0-4da6-939c-890e936d1f9c tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] HCTL ('33', '-', '-', 0) found on session 14 with lun 0 {{(pid=85141) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 10:13:09 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-68a55eb0-e7c0-4da6-939c-890e936d1f9c tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=85141) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 10:13:09 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:13:09 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:13:09 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9b6482b-d3b7-403a-b932-c1965efc203d]: (4, ('- - 0', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:13:09 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-68a55eb0-e7c0-4da6-939c-890e936d1f9c tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] Searching for a device in session 14 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=85141) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 10:13:09 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-68a55eb0-e7c0-4da6-939c-890e936d1f9c tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:42c041ec-fa39-4035-b82b-867caf3565df', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CbSKnRJc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=85141) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 10:13:10 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-68a55eb0-e7c0-4da6-939c-890e936d1f9c tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.370s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 10:13:10 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-68a55eb0-e7c0-4da6-939c-890e936d1f9c tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] <== connect_volume: return (1372ms) {'type': 'block', 'scsi_wwn': '23334313731353566', 'path': '/dev/sdb'} {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 10:13:10 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-68a55eb0-e7c0-4da6-939c-890e936d1f9c tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] [instance: 6caf3667-5613-4ef4-a597-1820e6c1c0ac] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23334313731353566', 'path': '/dev/sdb'} {{(pid=85141) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 10:13:10 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-68a55eb0-e7c0-4da6-939c-890e936d1f9c tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-16T10:10:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1948154362',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1086260035',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPTxuc2pFbo8Kj1fpySyu2hi+5RREMihAI4J3BcHJNw6/EhxEylOLh1w3NMl0ucAMBcFIFr2hryAmkgpSqOT6RfhW0NUWmUq9zKgRAUTsN4Epu8nh4W95o4JP2jn8aOc3w==',key_name='tempest-keypair-731314932',keypairs=<?>,launch_index=0,launched_at=2023-11-16T10:11:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='e017c305665f4a98a75d1d77701b6527',ramdisk_id='',reservation_id='r-4eesetti',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1581977623',owner_user_name='tempest-ServerActionsV293TestJSON-1581977623-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T10:13:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ae4bf3b050ed4cd7901541e9ce1c838f',uuid=6caf3667-5613-4ef4-a597-1820e6c1c0ac,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ad2b755f-6905-4256-be59-b64dae993293", "address": "fa:16:3e:fb:7c:00", "network": {"id": "9b5d58ef-109a-4ccb-90e4-a6b18c02f49c", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1619595955-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.67", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e017c305665f4a98a75d1d77701b6527", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad2b755f-69", "ovs_interfaceid": "ad2b755f-6905-4256-be59-b64dae993293", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=85141) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 10:13:10 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-68a55eb0-e7c0-4da6-939c-890e936d1f9c tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] Converting VIF {"id": "ad2b755f-6905-4256-be59-b64dae993293", "address": "fa:16:3e:fb:7c:00", "network": {"id": "9b5d58ef-109a-4ccb-90e4-a6b18c02f49c", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1619595955-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.67", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e017c305665f4a98a75d1d77701b6527", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad2b755f-69", "ovs_interfaceid": "ad2b755f-6905-4256-be59-b64dae993293", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:13:10 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-68a55eb0-e7c0-4da6-939c-890e936d1f9c tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fb:7c:00,bridge_name='br-int',has_traffic_filtering=True,id=ad2b755f-6905-4256-be59-b64dae993293,network=Network(9b5d58ef-109a-4ccb-90e4-a6b18c02f49c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad2b755f-69') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:13:10 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-68a55eb0-e7c0-4da6-939c-890e936d1f9c tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] [instance: 6caf3667-5613-4ef4-a597-1820e6c1c0ac] End _get_guest_xml xml=<domain type="kvm">
Nov 16 10:13:10 user nova-compute[85141]:   <uuid>6caf3667-5613-4ef4-a597-1820e6c1c0ac</uuid>
Nov 16 10:13:10 user nova-compute[85141]:   <name>instance-00000009</name>
Nov 16 10:13:10 user nova-compute[85141]:   <memory>524288</memory>
Nov 16 10:13:10 user nova-compute[85141]:   <vcpu>1</vcpu>
Nov 16 10:13:10 user nova-compute[85141]:   <metadata>
Nov 16 10:13:10 user nova-compute[85141]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 10:13:10 user nova-compute[85141]:       <nova:package version="0.0.0"/>
Nov 16 10:13:10 user nova-compute[85141]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1948154362</nova:name>
Nov 16 10:13:10 user nova-compute[85141]:       <nova:creationTime>2023-11-16 10:13:09</nova:creationTime>
Nov 16 10:13:10 user nova-compute[85141]:       <nova:flavor name="m1.tiny">
Nov 16 10:13:10 user nova-compute[85141]:         <nova:memory>512</nova:memory>
Nov 16 10:13:10 user nova-compute[85141]:         <nova:disk>1</nova:disk>
Nov 16 10:13:10 user nova-compute[85141]:         <nova:swap>0</nova:swap>
Nov 16 10:13:10 user nova-compute[85141]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 10:13:10 user nova-compute[85141]:         <nova:vcpus>1</nova:vcpus>
Nov 16 10:13:10 user nova-compute[85141]:       </nova:flavor>
Nov 16 10:13:10 user nova-compute[85141]:       <nova:owner>
Nov 16 10:13:10 user nova-compute[85141]:         <nova:user uuid="ae4bf3b050ed4cd7901541e9ce1c838f">tempest-ServerActionsV293TestJSON-1581977623-project-member</nova:user>
Nov 16 10:13:10 user nova-compute[85141]:         <nova:project uuid="e017c305665f4a98a75d1d77701b6527">tempest-ServerActionsV293TestJSON-1581977623</nova:project>
Nov 16 10:13:10 user nova-compute[85141]:       </nova:owner>
Nov 16 10:13:10 user nova-compute[85141]:       <nova:ports>
Nov 16 10:13:10 user nova-compute[85141]:         <nova:port uuid="ad2b755f-6905-4256-be59-b64dae993293">
Nov 16 10:13:10 user nova-compute[85141]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 16 10:13:10 user nova-compute[85141]:         </nova:port>
Nov 16 10:13:10 user nova-compute[85141]:       </nova:ports>
Nov 16 10:13:10 user nova-compute[85141]:     </nova:instance>
Nov 16 10:13:10 user nova-compute[85141]:   </metadata>
Nov 16 10:13:10 user nova-compute[85141]:   <sysinfo type="smbios">
Nov 16 10:13:10 user nova-compute[85141]:     <system>
Nov 16 10:13:10 user nova-compute[85141]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 10:13:10 user nova-compute[85141]:       <entry name="product">OpenStack Nova</entry>
Nov 16 10:13:10 user nova-compute[85141]:       <entry name="version">0.0.0</entry>
Nov 16 10:13:10 user nova-compute[85141]:       <entry name="serial">6caf3667-5613-4ef4-a597-1820e6c1c0ac</entry>
Nov 16 10:13:10 user nova-compute[85141]:       <entry name="uuid">6caf3667-5613-4ef4-a597-1820e6c1c0ac</entry>
Nov 16 10:13:10 user nova-compute[85141]:       <entry name="family">Virtual Machine</entry>
Nov 16 10:13:10 user nova-compute[85141]:     </system>
Nov 16 10:13:10 user nova-compute[85141]:   </sysinfo>
Nov 16 10:13:10 user nova-compute[85141]:   <os>
Nov 16 10:13:10 user nova-compute[85141]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 10:13:10 user nova-compute[85141]:     <boot dev="hd"/>
Nov 16 10:13:10 user nova-compute[85141]:     <smbios mode="sysinfo"/>
Nov 16 10:13:10 user nova-compute[85141]:   </os>
Nov 16 10:13:10 user nova-compute[85141]:   <features>
Nov 16 10:13:10 user nova-compute[85141]:     <acpi/>
Nov 16 10:13:10 user nova-compute[85141]:     <apic/>
Nov 16 10:13:10 user nova-compute[85141]:     <vmcoreinfo/>
Nov 16 10:13:10 user nova-compute[85141]:   </features>
Nov 16 10:13:10 user nova-compute[85141]:   <clock offset="utc">
Nov 16 10:13:10 user nova-compute[85141]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 10:13:10 user nova-compute[85141]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 10:13:10 user nova-compute[85141]:     <timer name="hpet" present="no"/>
Nov 16 10:13:10 user nova-compute[85141]:   </clock>
Nov 16 10:13:10 user nova-compute[85141]:   <cpu mode="custom" match="exact">
Nov 16 10:13:10 user nova-compute[85141]:     <model>Nehalem</model>
Nov 16 10:13:10 user nova-compute[85141]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 10:13:10 user nova-compute[85141]:   </cpu>
Nov 16 10:13:10 user nova-compute[85141]:   <devices>
Nov 16 10:13:10 user nova-compute[85141]:     <disk type="block" device="disk">
Nov 16 10:13:10 user nova-compute[85141]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 10:13:10 user nova-compute[85141]:       <source dev="/dev/sdb"/>
Nov 16 10:13:10 user nova-compute[85141]:       <target dev="vda" bus="virtio"/>
Nov 16 10:13:10 user nova-compute[85141]:       <serial>42c041ec-fa39-4035-b82b-867caf3565df</serial>
Nov 16 10:13:10 user nova-compute[85141]:     </disk>
Nov 16 10:13:10 user nova-compute[85141]:     <interface type="ethernet">
Nov 16 10:13:10 user nova-compute[85141]:       <mac address="fa:16:3e:fb:7c:00"/>
Nov 16 10:13:10 user nova-compute[85141]:       <model type="virtio"/>
Nov 16 10:13:10 user nova-compute[85141]:       <mtu size="1442"/>
Nov 16 10:13:10 user nova-compute[85141]:       <target dev="tapad2b755f-69"/>
Nov 16 10:13:10 user nova-compute[85141]:     </interface>
Nov 16 10:13:10 user nova-compute[85141]:     <serial type="pty">
Nov 16 10:13:10 user nova-compute[85141]:       <log file="/opt/stack/data/nova/instances/6caf3667-5613-4ef4-a597-1820e6c1c0ac/console.log" append="off"/>
Nov 16 10:13:10 user nova-compute[85141]:     </serial>
Nov 16 10:13:10 user nova-compute[85141]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 10:13:10 user nova-compute[85141]:     <video>
Nov 16 10:13:10 user nova-compute[85141]:       <model type="virtio"/>
Nov 16 10:13:10 user nova-compute[85141]:     </video>
Nov 16 10:13:10 user nova-compute[85141]:     <rng model="virtio">
Nov 16 10:13:10 user nova-compute[85141]:       <backend model="random">/dev/urandom</backend>
Nov 16 10:13:10 user nova-compute[85141]:     </rng>
Nov 16 10:13:10 user nova-compute[85141]:     <controller type="usb" index="0" model="none"/>
Nov 16 10:13:10 user nova-compute[85141]:     <memballoon model="virtio">
Nov 16 10:13:10 user nova-compute[85141]:       <stats period="10"/>
Nov 16 10:13:10 user nova-compute[85141]:     </memballoon>
Nov 16 10:13:10 user nova-compute[85141]:   </devices>
Nov 16 10:13:10 user nova-compute[85141]: </domain>
Nov 16 10:13:10 user nova-compute[85141]:  {{(pid=85141) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 10:13:10 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-68a55eb0-e7c0-4da6-939c-890e936d1f9c tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-16T10:10:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1948154362',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1086260035',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPTxuc2pFbo8Kj1fpySyu2hi+5RREMihAI4J3BcHJNw6/EhxEylOLh1w3NMl0ucAMBcFIFr2hryAmkgpSqOT6RfhW0NUWmUq9zKgRAUTsN4Epu8nh4W95o4JP2jn8aOc3w==',key_name='tempest-keypair-731314932',keypairs=<?>,launch_index=0,launched_at=2023-11-16T10:11:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='e017c305665f4a98a75d1d77701b6527',ramdisk_id='',reservation_id='r-4eesetti',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1581977623',owner_user_name='tempest-ServerActionsV293TestJSON-1581977623-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T10:13:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ae4bf3b050ed4cd7901541e9ce1c838f',uuid=6caf3667-5613-4ef4-a597-1820e6c1c0ac,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ad2b755f-6905-4256-be59-b64dae993293", "address": "fa:16:3e:fb:7c:00", "network": {"id": "9b5d58ef-109a-4ccb-90e4-a6b18c02f49c", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1619595955-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.67", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e017c305665f4a98a75d1d77701b6527", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad2b755f-69", "ovs_interfaceid": "ad2b755f-6905-4256-be59-b64dae993293", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 10:13:10 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-68a55eb0-e7c0-4da6-939c-890e936d1f9c tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] Converting VIF {"id": "ad2b755f-6905-4256-be59-b64dae993293", "address": "fa:16:3e:fb:7c:00", "network": {"id": "9b5d58ef-109a-4ccb-90e4-a6b18c02f49c", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1619595955-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.67", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e017c305665f4a98a75d1d77701b6527", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad2b755f-69", "ovs_interfaceid": "ad2b755f-6905-4256-be59-b64dae993293", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:13:10 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-68a55eb0-e7c0-4da6-939c-890e936d1f9c tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fb:7c:00,bridge_name='br-int',has_traffic_filtering=True,id=ad2b755f-6905-4256-be59-b64dae993293,network=Network(9b5d58ef-109a-4ccb-90e4-a6b18c02f49c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad2b755f-69') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:13:10 user nova-compute[85141]: DEBUG os_vif [None req-68a55eb0-e7c0-4da6-939c-890e936d1f9c tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fb:7c:00,bridge_name='br-int',has_traffic_filtering=True,id=ad2b755f-6905-4256-be59-b64dae993293,network=Network(9b5d58ef-109a-4ccb-90e4-a6b18c02f49c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad2b755f-69') {{(pid=85141) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 10:13:10 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:13:10 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:13:10 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 10:13:10 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:13:10 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b313a02c-4340-5f9c-982c-acdea0346c62', '_type': 'linux-noop'}}, row=False) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:13:10 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:13:10 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:13:10 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:13:10 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapad2b755f-69, may_exist=True, interface_attrs={}) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:13:10 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapad2b755f-69, col_values=(('qos', UUID('cf1df4c5-dd82-4185-b107-d9a311c3811c')),), if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:13:10 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapad2b755f-69, col_values=(('external_ids', {'iface-id': 'ad2b755f-6905-4256-be59-b64dae993293', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fb:7c:00', 'vm-uuid': '6caf3667-5613-4ef4-a597-1820e6c1c0ac'}),), if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:13:10 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:13:10 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:13:10 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:13:10 user nova-compute[85141]: INFO os_vif [None req-68a55eb0-e7c0-4da6-939c-890e936d1f9c tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fb:7c:00,bridge_name='br-int',has_traffic_filtering=True,id=ad2b755f-6905-4256-be59-b64dae993293,network=Network(9b5d58ef-109a-4ccb-90e4-a6b18c02f49c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad2b755f-69')
Nov 16 10:13:10 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-68a55eb0-e7c0-4da6-939c-890e936d1f9c tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] No BDM found with device name vda, not building metadata. {{(pid=85141) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 10:13:10 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-68a55eb0-e7c0-4da6-939c-890e936d1f9c tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] No VIF found with MAC fa:16:3e:fb:7c:00, not building metadata {{(pid=85141) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 10:13:10 user nova-compute[85141]: DEBUG nova.compute.manager [req-63883ee3-1696-410e-b715-da3098349177 req-8fa25bab-b311-45be-9ad3-85b3be8f0c80 service nova] [instance: eef3cc09-054b-4a17-b621-4f3737d5420e] Received event network-changed-277c1d3d-ed49-4b8c-82e3-902fa6c8a2f5 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:13:10 user nova-compute[85141]: DEBUG nova.compute.manager [req-63883ee3-1696-410e-b715-da3098349177 req-8fa25bab-b311-45be-9ad3-85b3be8f0c80 service nova] [instance: eef3cc09-054b-4a17-b621-4f3737d5420e] Refreshing instance network info cache due to event network-changed-277c1d3d-ed49-4b8c-82e3-902fa6c8a2f5. {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 10:13:10 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-63883ee3-1696-410e-b715-da3098349177 req-8fa25bab-b311-45be-9ad3-85b3be8f0c80 service nova] Acquiring lock "refresh_cache-eef3cc09-054b-4a17-b621-4f3737d5420e" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:13:10 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-63883ee3-1696-410e-b715-da3098349177 req-8fa25bab-b311-45be-9ad3-85b3be8f0c80 service nova] Acquired lock "refresh_cache-eef3cc09-054b-4a17-b621-4f3737d5420e" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:13:10 user nova-compute[85141]: DEBUG nova.network.neutron [req-63883ee3-1696-410e-b715-da3098349177 req-8fa25bab-b311-45be-9ad3-85b3be8f0c80 service nova] [instance: eef3cc09-054b-4a17-b621-4f3737d5420e] Refreshing network info cache for port 277c1d3d-ed49-4b8c-82e3-902fa6c8a2f5 {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 10:13:11 user nova-compute[85141]: DEBUG nova.network.neutron [req-63883ee3-1696-410e-b715-da3098349177 req-8fa25bab-b311-45be-9ad3-85b3be8f0c80 service nova] [instance: eef3cc09-054b-4a17-b621-4f3737d5420e] Updated VIF entry in instance network info cache for port 277c1d3d-ed49-4b8c-82e3-902fa6c8a2f5. {{(pid=85141) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 10:13:11 user nova-compute[85141]: DEBUG nova.network.neutron [req-63883ee3-1696-410e-b715-da3098349177 req-8fa25bab-b311-45be-9ad3-85b3be8f0c80 service nova] [instance: eef3cc09-054b-4a17-b621-4f3737d5420e] Updating instance_info_cache with network_info: [{"id": "277c1d3d-ed49-4b8c-82e3-902fa6c8a2f5", "address": "fa:16:3e:60:a2:e0", "network": {"id": "1f8e2c11-f9ae-480d-a6e3-1df589fdd7bc", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-976382911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eafaf607b5ff4b448aaaea253a321827", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap277c1d3d-ed", "ovs_interfaceid": "277c1d3d-ed49-4b8c-82e3-902fa6c8a2f5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f742ff18-5ea3-42a0-b229-27a32badce8a", "address": "fa:16:3e:38:78:2d", "network": {"id": "85a74d82-5c98-4f2b-a38d-3e9ebe6a1e13", "bridge": "br-int", "label": "tempest-device-tagging-net1-178618229", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.216", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "eafaf607b5ff4b448aaaea253a321827", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf742ff18-5e", "ovs_interfaceid": "f742ff18-5ea3-42a0-b229-27a32badce8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0f7c87ad-4076-4aca-8d9b-1fae099dd325", "address": "fa:16:3e:7a:05:a4", "network": {"id": "85a74d82-5c98-4f2b-a38d-3e9ebe6a1e13", "bridge": "br-int", "label": "tempest-device-tagging-net1-178618229", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.102", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "eafaf607b5ff4b448aaaea253a321827", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f7c87ad-40", "ovs_interfaceid": "0f7c87ad-4076-4aca-8d9b-1fae099dd325", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d6b517e2-8788-4775-b327-11601713da4d", "address": "fa:16:3e:81:5a:0a", "network": {"id": "85a74d82-5c98-4f2b-a38d-3e9ebe6a1e13", "bridge": "br-int", "label": "tempest-device-tagging-net1-178618229", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.253", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "eafaf607b5ff4b448aaaea253a321827", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6b517e2-87", "ovs_interfaceid": "d6b517e2-8788-4775-b327-11601713da4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0c9cc79d-1ded-40cc-84fc-f6b70a9bb555", "address": "fa:16:3e:d4:13:c9", "network": {"id": "85a74d82-5c98-4f2b-a38d-3e9ebe6a1e13", "bridge": "br-int", "label": "tempest-device-tagging-net1-178618229", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.61", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "eafaf607b5ff4b448aaaea253a321827", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c9cc79d-1d", "ovs_interfaceid": "0c9cc79d-1ded-40cc-84fc-f6b70a9bb555", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b0183e60-7f49-44a1-a24c-30db287f2453", "address": "fa:16:3e:b2:23:6e", "network": {"id": "a9e0ac50-1fbb-4d94-a22f-6fcf40dd0194", "bridge": "br-int", "label": "tempest-device-tagging-net2-947660195", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "eafaf607b5ff4b448aaaea253a321827", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0183e60-7f", "ovs_interfaceid": "b0183e60-7f49-44a1-a24c-30db287f2453", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "21180772-80b3-48e1-90e9-39590611ff08", "address": "fa:16:3e:c1:ed:f9", "network": {"id": "a9e0ac50-1fbb-4d94-a22f-6fcf40dd0194", "bridge": "br-int", "label": "tempest-device-tagging-net2-947660195", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "eafaf607b5ff4b448aaaea253a321827", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21180772-80", "ovs_interfaceid": "21180772-80b3-48e1-90e9-39590611ff08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:13:11 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-63883ee3-1696-410e-b715-da3098349177 req-8fa25bab-b311-45be-9ad3-85b3be8f0c80 service nova] Releasing lock "refresh_cache-eef3cc09-054b-4a17-b621-4f3737d5420e" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:13:12 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:13:12 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:13:12 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:13:12 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:13:12 user nova-compute[85141]: DEBUG nova.compute.manager [req-314194fc-7bfc-45ca-9a32-e0ccb87639b2 req-0180af7a-7bd7-4d3a-9a49-e965f99c2da8 service nova] [instance: 6caf3667-5613-4ef4-a597-1820e6c1c0ac] Received event network-vif-plugged-ad2b755f-6905-4256-be59-b64dae993293 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:13:12 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-314194fc-7bfc-45ca-9a32-e0ccb87639b2 req-0180af7a-7bd7-4d3a-9a49-e965f99c2da8 service nova] Acquiring lock "6caf3667-5613-4ef4-a597-1820e6c1c0ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:13:12 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-314194fc-7bfc-45ca-9a32-e0ccb87639b2 req-0180af7a-7bd7-4d3a-9a49-e965f99c2da8 service nova] Lock "6caf3667-5613-4ef4-a597-1820e6c1c0ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:13:12 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-314194fc-7bfc-45ca-9a32-e0ccb87639b2 req-0180af7a-7bd7-4d3a-9a49-e965f99c2da8 service nova] Lock "6caf3667-5613-4ef4-a597-1820e6c1c0ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:13:12 user nova-compute[85141]: DEBUG nova.compute.manager [req-314194fc-7bfc-45ca-9a32-e0ccb87639b2 req-0180af7a-7bd7-4d3a-9a49-e965f99c2da8 service nova] [instance: 6caf3667-5613-4ef4-a597-1820e6c1c0ac] No waiting events found dispatching network-vif-plugged-ad2b755f-6905-4256-be59-b64dae993293 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:13:12 user nova-compute[85141]: WARNING nova.compute.manager [req-314194fc-7bfc-45ca-9a32-e0ccb87639b2 req-0180af7a-7bd7-4d3a-9a49-e965f99c2da8 service nova] [instance: 6caf3667-5613-4ef4-a597-1820e6c1c0ac] Received unexpected event network-vif-plugged-ad2b755f-6905-4256-be59-b64dae993293 for instance with vm_state active and task_state rebuild_spawning.
Nov 16 10:13:12 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:13:12 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:13:13 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-a33076d6-5841-4a55-8d9a-ab2ffc688743 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] Acquiring lock "eef3cc09-054b-4a17-b621-4f3737d5420e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:13:13 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-a33076d6-5841-4a55-8d9a-ab2ffc688743 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] Lock "eef3cc09-054b-4a17-b621-4f3737d5420e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:13:13 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-a33076d6-5841-4a55-8d9a-ab2ffc688743 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] Acquiring lock "eef3cc09-054b-4a17-b621-4f3737d5420e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:13:13 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-a33076d6-5841-4a55-8d9a-ab2ffc688743 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] Lock "eef3cc09-054b-4a17-b621-4f3737d5420e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:13:13 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-a33076d6-5841-4a55-8d9a-ab2ffc688743 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] Lock "eef3cc09-054b-4a17-b621-4f3737d5420e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:13:13 user nova-compute[85141]: INFO nova.compute.manager [None req-a33076d6-5841-4a55-8d9a-ab2ffc688743 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] [instance: eef3cc09-054b-4a17-b621-4f3737d5420e] Terminating instance
Nov 16 10:13:13 user nova-compute[85141]: DEBUG nova.compute.manager [None req-a33076d6-5841-4a55-8d9a-ab2ffc688743 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] [instance: eef3cc09-054b-4a17-b621-4f3737d5420e] Start destroying the instance on the hypervisor. {{(pid=85141) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 10:13:13 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:13:13 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:13:13 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:13:13 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:13:13 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:13:13 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:13:13 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:13:13 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:13:13 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:13:13 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:13:13 user nova-compute[85141]: DEBUG nova.compute.manager [req-216e24a6-2a0e-4745-9beb-a9474849695e req-ef8c929f-af33-4fc9-bd73-508c5c52096a service nova] [instance: eef3cc09-054b-4a17-b621-4f3737d5420e] Received event network-vif-unplugged-0f7c87ad-4076-4aca-8d9b-1fae099dd325 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:13:13 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-216e24a6-2a0e-4745-9beb-a9474849695e req-ef8c929f-af33-4fc9-bd73-508c5c52096a service nova] Acquiring lock "eef3cc09-054b-4a17-b621-4f3737d5420e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:13:13 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-216e24a6-2a0e-4745-9beb-a9474849695e req-ef8c929f-af33-4fc9-bd73-508c5c52096a service nova] Lock "eef3cc09-054b-4a17-b621-4f3737d5420e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:13:13 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-216e24a6-2a0e-4745-9beb-a9474849695e req-ef8c929f-af33-4fc9-bd73-508c5c52096a service nova] Lock "eef3cc09-054b-4a17-b621-4f3737d5420e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:13:13 user nova-compute[85141]: DEBUG nova.compute.manager [req-216e24a6-2a0e-4745-9beb-a9474849695e req-ef8c929f-af33-4fc9-bd73-508c5c52096a service nova] [instance: eef3cc09-054b-4a17-b621-4f3737d5420e] No waiting events found dispatching network-vif-unplugged-0f7c87ad-4076-4aca-8d9b-1fae099dd325 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:13:13 user nova-compute[85141]: DEBUG nova.compute.manager [req-216e24a6-2a0e-4745-9beb-a9474849695e req-ef8c929f-af33-4fc9-bd73-508c5c52096a service nova] [instance: eef3cc09-054b-4a17-b621-4f3737d5420e] Received event network-vif-unplugged-0f7c87ad-4076-4aca-8d9b-1fae099dd325 for instance with task_state deleting. {{(pid=85141) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 10:13:13 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:13:13 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:13:14 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:13:14 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:13:14 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:13:14 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:13:14 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:13:14 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:13:14 user nova-compute[85141]: DEBUG nova.compute.manager [None req-68a55eb0-e7c0-4da6-939c-890e936d1f9c tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] [instance: 6caf3667-5613-4ef4-a597-1820e6c1c0ac] Instance event wait completed in 0 seconds for  {{(pid=85141) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 10:13:14 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-68a55eb0-e7c0-4da6-939c-890e936d1f9c tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] [instance: 6caf3667-5613-4ef4-a597-1820e6c1c0ac] Guest created on hypervisor {{(pid=85141) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 10:13:14 user nova-compute[85141]: INFO nova.virt.libvirt.driver [-] [instance: 6caf3667-5613-4ef4-a597-1820e6c1c0ac] Instance spawned successfully.
Nov 16 10:13:14 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-68a55eb0-e7c0-4da6-939c-890e936d1f9c tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] [instance: 6caf3667-5613-4ef4-a597-1820e6c1c0ac] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 10:13:14 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-68a55eb0-e7c0-4da6-939c-890e936d1f9c tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] [instance: 6caf3667-5613-4ef4-a597-1820e6c1c0ac] Found default for hw_cdrom_bus of ide {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:13:14 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-68a55eb0-e7c0-4da6-939c-890e936d1f9c tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] [instance: 6caf3667-5613-4ef4-a597-1820e6c1c0ac] Found default for hw_disk_bus of virtio {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:13:14 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-68a55eb0-e7c0-4da6-939c-890e936d1f9c tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] [instance: 6caf3667-5613-4ef4-a597-1820e6c1c0ac] Found default for hw_input_bus of None {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:13:14 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-68a55eb0-e7c0-4da6-939c-890e936d1f9c tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] [instance: 6caf3667-5613-4ef4-a597-1820e6c1c0ac] Found default for hw_pointer_model of None {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:13:14 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-68a55eb0-e7c0-4da6-939c-890e936d1f9c tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] [instance: 6caf3667-5613-4ef4-a597-1820e6c1c0ac] Found default for hw_video_model of virtio {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:13:14 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-68a55eb0-e7c0-4da6-939c-890e936d1f9c tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] [instance: 6caf3667-5613-4ef4-a597-1820e6c1c0ac] Found default for hw_vif_model of virtio {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:13:14 user nova-compute[85141]: DEBUG nova.compute.manager [req-f2f36568-2244-407e-b473-cc00ab60f0cc req-c5170156-4a20-4bd3-bbe6-9e0e15185f18 service nova] [instance: 6caf3667-5613-4ef4-a597-1820e6c1c0ac] Received event network-vif-plugged-ad2b755f-6905-4256-be59-b64dae993293 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:13:14 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-f2f36568-2244-407e-b473-cc00ab60f0cc req-c5170156-4a20-4bd3-bbe6-9e0e15185f18 service nova] Acquiring lock "6caf3667-5613-4ef4-a597-1820e6c1c0ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:13:14 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-f2f36568-2244-407e-b473-cc00ab60f0cc req-c5170156-4a20-4bd3-bbe6-9e0e15185f18 service nova] Lock "6caf3667-5613-4ef4-a597-1820e6c1c0ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:13:14 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-f2f36568-2244-407e-b473-cc00ab60f0cc req-c5170156-4a20-4bd3-bbe6-9e0e15185f18 service nova] Lock "6caf3667-5613-4ef4-a597-1820e6c1c0ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:13:14 user nova-compute[85141]: DEBUG nova.compute.manager [req-f2f36568-2244-407e-b473-cc00ab60f0cc req-c5170156-4a20-4bd3-bbe6-9e0e15185f18 service nova] [instance: 6caf3667-5613-4ef4-a597-1820e6c1c0ac] No waiting events found dispatching network-vif-plugged-ad2b755f-6905-4256-be59-b64dae993293 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:13:14 user nova-compute[85141]: WARNING nova.compute.manager [req-f2f36568-2244-407e-b473-cc00ab60f0cc req-c5170156-4a20-4bd3-bbe6-9e0e15185f18 service nova] [instance: 6caf3667-5613-4ef4-a597-1820e6c1c0ac] Received unexpected event network-vif-plugged-ad2b755f-6905-4256-be59-b64dae993293 for instance with vm_state active and task_state rebuild_spawning.
Nov 16 10:13:14 user nova-compute[85141]: DEBUG nova.compute.manager [req-f2f36568-2244-407e-b473-cc00ab60f0cc req-c5170156-4a20-4bd3-bbe6-9e0e15185f18 service nova] [instance: eef3cc09-054b-4a17-b621-4f3737d5420e] Received event network-vif-unplugged-277c1d3d-ed49-4b8c-82e3-902fa6c8a2f5 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:13:14 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-f2f36568-2244-407e-b473-cc00ab60f0cc req-c5170156-4a20-4bd3-bbe6-9e0e15185f18 service nova] Acquiring lock "eef3cc09-054b-4a17-b621-4f3737d5420e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:13:14 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-f2f36568-2244-407e-b473-cc00ab60f0cc req-c5170156-4a20-4bd3-bbe6-9e0e15185f18 service nova] Lock "eef3cc09-054b-4a17-b621-4f3737d5420e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:13:14 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-f2f36568-2244-407e-b473-cc00ab60f0cc req-c5170156-4a20-4bd3-bbe6-9e0e15185f18 service nova] Lock "eef3cc09-054b-4a17-b621-4f3737d5420e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:13:14 user nova-compute[85141]: DEBUG nova.compute.manager [req-f2f36568-2244-407e-b473-cc00ab60f0cc req-c5170156-4a20-4bd3-bbe6-9e0e15185f18 service nova] [instance: eef3cc09-054b-4a17-b621-4f3737d5420e] No waiting events found dispatching network-vif-unplugged-277c1d3d-ed49-4b8c-82e3-902fa6c8a2f5 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:13:14 user nova-compute[85141]: DEBUG nova.compute.manager [req-f2f36568-2244-407e-b473-cc00ab60f0cc req-c5170156-4a20-4bd3-bbe6-9e0e15185f18 service nova] [instance: eef3cc09-054b-4a17-b621-4f3737d5420e] Received event network-vif-unplugged-277c1d3d-ed49-4b8c-82e3-902fa6c8a2f5 for instance with task_state deleting. {{(pid=85141) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 10:13:14 user nova-compute[85141]: DEBUG nova.compute.manager [req-f2f36568-2244-407e-b473-cc00ab60f0cc req-c5170156-4a20-4bd3-bbe6-9e0e15185f18 service nova] [instance: eef3cc09-054b-4a17-b621-4f3737d5420e] Received event network-vif-plugged-277c1d3d-ed49-4b8c-82e3-902fa6c8a2f5 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:13:14 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-f2f36568-2244-407e-b473-cc00ab60f0cc req-c5170156-4a20-4bd3-bbe6-9e0e15185f18 service nova] Acquiring lock "eef3cc09-054b-4a17-b621-4f3737d5420e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:13:14 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-f2f36568-2244-407e-b473-cc00ab60f0cc req-c5170156-4a20-4bd3-bbe6-9e0e15185f18 service nova] Lock "eef3cc09-054b-4a17-b621-4f3737d5420e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:13:14 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-f2f36568-2244-407e-b473-cc00ab60f0cc req-c5170156-4a20-4bd3-bbe6-9e0e15185f18 service nova] Lock "eef3cc09-054b-4a17-b621-4f3737d5420e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:13:14 user nova-compute[85141]: DEBUG nova.compute.manager [req-f2f36568-2244-407e-b473-cc00ab60f0cc req-c5170156-4a20-4bd3-bbe6-9e0e15185f18 service nova] [instance: eef3cc09-054b-4a17-b621-4f3737d5420e] No waiting events found dispatching network-vif-plugged-277c1d3d-ed49-4b8c-82e3-902fa6c8a2f5 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:13:14 user nova-compute[85141]: WARNING nova.compute.manager [req-f2f36568-2244-407e-b473-cc00ab60f0cc req-c5170156-4a20-4bd3-bbe6-9e0e15185f18 service nova] [instance: eef3cc09-054b-4a17-b621-4f3737d5420e] Received unexpected event network-vif-plugged-277c1d3d-ed49-4b8c-82e3-902fa6c8a2f5 for instance with vm_state active and task_state deleting.
Nov 16 10:13:14 user nova-compute[85141]: DEBUG nova.compute.manager [req-f2f36568-2244-407e-b473-cc00ab60f0cc req-c5170156-4a20-4bd3-bbe6-9e0e15185f18 service nova] [instance: eef3cc09-054b-4a17-b621-4f3737d5420e] Received event network-vif-unplugged-f742ff18-5ea3-42a0-b229-27a32badce8a {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:13:14 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-f2f36568-2244-407e-b473-cc00ab60f0cc req-c5170156-4a20-4bd3-bbe6-9e0e15185f18 service nova] Acquiring lock "eef3cc09-054b-4a17-b621-4f3737d5420e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:13:14 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-f2f36568-2244-407e-b473-cc00ab60f0cc req-c5170156-4a20-4bd3-bbe6-9e0e15185f18 service nova] Lock "eef3cc09-054b-4a17-b621-4f3737d5420e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:13:14 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-f2f36568-2244-407e-b473-cc00ab60f0cc req-c5170156-4a20-4bd3-bbe6-9e0e15185f18 service nova] Lock "eef3cc09-054b-4a17-b621-4f3737d5420e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:13:14 user nova-compute[85141]: DEBUG nova.compute.manager [req-f2f36568-2244-407e-b473-cc00ab60f0cc req-c5170156-4a20-4bd3-bbe6-9e0e15185f18 service nova] [instance: eef3cc09-054b-4a17-b621-4f3737d5420e] No waiting events found dispatching network-vif-unplugged-f742ff18-5ea3-42a0-b229-27a32badce8a {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:13:14 user nova-compute[85141]: DEBUG nova.compute.manager [req-f2f36568-2244-407e-b473-cc00ab60f0cc req-c5170156-4a20-4bd3-bbe6-9e0e15185f18 service nova] [instance: eef3cc09-054b-4a17-b621-4f3737d5420e] Received event network-vif-unplugged-f742ff18-5ea3-42a0-b229-27a32badce8a for instance with task_state deleting. {{(pid=85141) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 10:13:14 user nova-compute[85141]: DEBUG nova.compute.manager [req-f2f36568-2244-407e-b473-cc00ab60f0cc req-c5170156-4a20-4bd3-bbe6-9e0e15185f18 service nova] [instance: eef3cc09-054b-4a17-b621-4f3737d5420e] Received event network-vif-plugged-f742ff18-5ea3-42a0-b229-27a32badce8a {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:13:14 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-f2f36568-2244-407e-b473-cc00ab60f0cc req-c5170156-4a20-4bd3-bbe6-9e0e15185f18 service nova] Acquiring lock "eef3cc09-054b-4a17-b621-4f3737d5420e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:13:14 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-f2f36568-2244-407e-b473-cc00ab60f0cc req-c5170156-4a20-4bd3-bbe6-9e0e15185f18 service nova] Lock "eef3cc09-054b-4a17-b621-4f3737d5420e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:13:14 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-f2f36568-2244-407e-b473-cc00ab60f0cc req-c5170156-4a20-4bd3-bbe6-9e0e15185f18 service nova] Lock "eef3cc09-054b-4a17-b621-4f3737d5420e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:13:14 user nova-compute[85141]: DEBUG nova.compute.manager [req-f2f36568-2244-407e-b473-cc00ab60f0cc req-c5170156-4a20-4bd3-bbe6-9e0e15185f18 service nova] [instance: eef3cc09-054b-4a17-b621-4f3737d5420e] No waiting events found dispatching network-vif-plugged-f742ff18-5ea3-42a0-b229-27a32badce8a {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:13:14 user nova-compute[85141]: WARNING nova.compute.manager [req-f2f36568-2244-407e-b473-cc00ab60f0cc req-c5170156-4a20-4bd3-bbe6-9e0e15185f18 service nova] [instance: eef3cc09-054b-4a17-b621-4f3737d5420e] Received unexpected event network-vif-plugged-f742ff18-5ea3-42a0-b229-27a32badce8a for instance with vm_state active and task_state deleting.
Nov 16 10:13:14 user nova-compute[85141]: DEBUG nova.compute.manager [req-95770fce-096d-44f5-ad75-db9a9670566f req-bc95d0bd-9a61-405d-8c16-b58469440b2f service nova] [instance: eef3cc09-054b-4a17-b621-4f3737d5420e] Received event network-vif-unplugged-21180772-80b3-48e1-90e9-39590611ff08 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:13:14 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-95770fce-096d-44f5-ad75-db9a9670566f req-bc95d0bd-9a61-405d-8c16-b58469440b2f service nova] Acquiring lock "eef3cc09-054b-4a17-b621-4f3737d5420e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:13:14 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-95770fce-096d-44f5-ad75-db9a9670566f req-bc95d0bd-9a61-405d-8c16-b58469440b2f service nova] Lock "eef3cc09-054b-4a17-b621-4f3737d5420e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:13:14 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-95770fce-096d-44f5-ad75-db9a9670566f req-bc95d0bd-9a61-405d-8c16-b58469440b2f service nova] Lock "eef3cc09-054b-4a17-b621-4f3737d5420e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:13:14 user nova-compute[85141]: DEBUG nova.compute.manager [req-95770fce-096d-44f5-ad75-db9a9670566f req-bc95d0bd-9a61-405d-8c16-b58469440b2f service nova] [instance: eef3cc09-054b-4a17-b621-4f3737d5420e] No waiting events found dispatching network-vif-unplugged-21180772-80b3-48e1-90e9-39590611ff08 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:13:14 user nova-compute[85141]: DEBUG nova.compute.manager [req-95770fce-096d-44f5-ad75-db9a9670566f req-bc95d0bd-9a61-405d-8c16-b58469440b2f service nova] [instance: eef3cc09-054b-4a17-b621-4f3737d5420e] Received event network-vif-unplugged-21180772-80b3-48e1-90e9-39590611ff08 for instance with task_state deleting. {{(pid=85141) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 10:13:14 user nova-compute[85141]: DEBUG nova.compute.manager [None req-68a55eb0-e7c0-4da6-939c-890e936d1f9c tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] [instance: 6caf3667-5613-4ef4-a597-1820e6c1c0ac] Checking state {{(pid=85141) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 10:13:14 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:13:14 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-68a55eb0-e7c0-4da6-939c-890e936d1f9c tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:13:14 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-68a55eb0-e7c0-4da6-939c-890e936d1f9c tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.002s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:13:14 user nova-compute[85141]: DEBUG nova.objects.instance [None req-68a55eb0-e7c0-4da6-939c-890e936d1f9c tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] [instance: 6caf3667-5613-4ef4-a597-1820e6c1c0ac] Trying to apply a migration context that does not seem to be set for this instance {{(pid=85141) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Nov 16 10:13:14 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:13:14 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:13:14 user nova-compute[85141]: DEBUG nova.compute.manager [None req-2e3c140e-c9f9-46ce-a537-0787e8739533 tempest-TestVolumeSwap-1037451778 tempest-TestVolumeSwap-1037451778-project-admin] [instance: ad1ace46-2e8e-42e1-a0f5-2384078fcf09] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:7e233047-dda3-4f2e-803c-7b69a57ac656', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UtNLBDJC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'ad1ace46-2e8e-42e1-a0f5-2384078fcf09', 'attached_at': '', 'detached_at': '', 'volume_id': '7e233047-dda3-4f2e-803c-7b69a57ac656', 'serial': '7e233047-dda3-4f2e-803c-7b69a57ac656'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:eb0e3ad6-04d7-4405-b4ae-0440b2a396ce', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TGILpNCR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj', 'volume_id': 'eb0e3ad6-04d7-4405-b4ae-0440b2a396ce'}, 'status': 'reserved', 'instance': 'ad1ace46-2e8e-42e1-a0f5-2384078fcf09', 'attached_at': '', 'detached_at': '', 'volume_id': 'eb0e3ad6-04d7-4405-b4ae-0440b2a396ce', 'serial'} {{(pid=85141) _swap_volume /opt/stack/nova/nova/compute/manager.py:7782}}
Nov 16 10:13:14 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2e3c140e-c9f9-46ce-a537-0787e8739533 tempest-TestVolumeSwap-1037451778 tempest-TestVolumeSwap-1037451778-project-admin] [instance: ad1ace46-2e8e-42e1-a0f5-2384078fcf09] Calling os-brick to attach iSCSI Volume {{(pid=85141) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 10:13:14 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e3c140e-c9f9-46ce-a537-0787e8739533 tempest-TestVolumeSwap-1037451778 tempest-TestVolumeSwap-1037451778-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51806b6080>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7e233047-dda3-4f2e-803c-7b69a57ac656', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UtNLBDJC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 10:13:14 user nova-compute[85141]: WARNING os_brick.initiator.connectors.base [None req-2e3c140e-c9f9-46ce-a537-0787e8739533 tempest-TestVolumeSwap-1037451778 tempest-TestVolumeSwap-1037451778-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 10:13:14 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-2e3c140e-c9f9-46ce-a537-0787e8739533 tempest-TestVolumeSwap-1037451778 tempest-TestVolumeSwap-1037451778-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 10:13:14 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-2e3c140e-c9f9-46ce-a537-0787e8739533 tempest-TestVolumeSwap-1037451778 tempest-TestVolumeSwap-1037451778-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 10:13:14 user nova-compute[85141]: WARNING os_brick.initiator.connectors.base [None req-2e3c140e-c9f9-46ce-a537-0787e8739533 tempest-TestVolumeSwap-1037451778 tempest-TestVolumeSwap-1037451778-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 10:13:14 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-2e3c140e-c9f9-46ce-a537-0787e8739533 tempest-TestVolumeSwap-1037451778 tempest-TestVolumeSwap-1037451778-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7e233047-dda3-4f2e-803c-7b69a57ac656" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 10:13:14 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-2e3c140e-c9f9-46ce-a537-0787e8739533 tempest-TestVolumeSwap-1037451778 tempest-TestVolumeSwap-1037451778-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7e233047-dda3-4f2e-803c-7b69a57ac656" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 10:13:14 user nova-compute[85141]: INFO os_brick.initiator.connectors.iscsi [None req-2e3c140e-c9f9-46ce-a537-0787e8739533 tempest-TestVolumeSwap-1037451778 tempest-TestVolumeSwap-1037451778-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 10:13:14 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e233047-dda3-4f2e-803c-7b69a57ac656 -p 172.16.0.220:3260 {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:13:14 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e233047-dda3-4f2e-803c-7b69a57ac656 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:13:14 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[320acc4d-5fb1-4bfc-8eb3-faf2510f6f1e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:13:14 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e3c140e-c9f9-46ce-a537-0787e8739533 tempest-TestVolumeSwap-1037451778 tempest-TestVolumeSwap-1037451778-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 10:13:14 user nova-compute[85141]:  {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:13:14 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-68a55eb0-e7c0-4da6-939c-890e936d1f9c tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.142s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:13:14 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e233047-dda3-4f2e-803c-7b69a57ac656 -p 172.16.0.220:3260 --interface default --op new {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:13:14 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e233047-dda3-4f2e-803c-7b69a57ac656 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:13:14 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[177aee15-4093-4cb5-9b05-e975a807538d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7e233047-dda3-4f2e-803c-7b69a57ac656] added\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:13:14 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e3c140e-c9f9-46ce-a537-0787e8739533 tempest-TestVolumeSwap-1037451778 tempest-TestVolumeSwap-1037451778-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7e233047-dda3-4f2e-803c-7b69a57ac656] added
Nov 16 10:13:14 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:13:14 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e233047-dda3-4f2e-803c-7b69a57ac656 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:13:14 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e233047-dda3-4f2e-803c-7b69a57ac656 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:13:14 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[0013f827-af42-44ac-94ed-8dc4771d9ba4]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:13:14 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e3c140e-c9f9-46ce-a537-0787e8739533 tempest-TestVolumeSwap-1037451778 tempest-TestVolumeSwap-1037451778-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:13:14 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e233047-dda3-4f2e-803c-7b69a57ac656 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:13:14 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e233047-dda3-4f2e-803c-7b69a57ac656 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:13:14 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbae34b8-fb05-4a79-849b-b5ce706a3599]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:13:14 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e3c140e-c9f9-46ce-a537-0787e8739533 tempest-TestVolumeSwap-1037451778 tempest-TestVolumeSwap-1037451778-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:13:14 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e233047-dda3-4f2e-803c-7b69a57ac656 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UtNLBDJC {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:13:14 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e233047-dda3-4f2e-803c-7b69a57ac656 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UtNLBDJC" returned: 0 in 0.024s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:13:14 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[8db27765-5b68-46bb-af8e-252ca6573570]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:13:14 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e3c140e-c9f9-46ce-a537-0787e8739533 tempest-TestVolumeSwap-1037451778 tempest-TestVolumeSwap-1037451778-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UtNLBDJC'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:13:14 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e233047-dda3-4f2e-803c-7b69a57ac656 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:13:14 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e233047-dda3-4f2e-803c-7b69a57ac656 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.033s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:13:14 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd3e1c3b-59b1-4cf6-bb98-ea928a37f23f]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:13:14 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e3c140e-c9f9-46ce-a537-0787e8739533 tempest-TestVolumeSwap-1037451778 tempest-TestVolumeSwap-1037451778-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:13:14 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:13:14 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.040s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:13:14 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a299e7b-22b9-4dfd-9254-5209b6f8041f]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eff563f0-92d3-47a1-addc-e3eaa6828d59 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb0e3ad6-04d7-4405-b4ae-0440b2a396ce (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba7ca2a3-5f1e-4544-852f-d57100b608e3 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42c041ec-fa39-4035-b82b-867caf3565df (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4df10d9-a60c-45ed-981d-96f704534fb8 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4973f768-f126-41d6-b534-458d6c49f9b3 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fcde20-e019-4cf0-ad90-6c8100f4a8d2 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ca01473-0233-4122-b008-ffa407ca3e70 (non-flash)\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:13:14 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e3c140e-c9f9-46ce-a537-0787e8739533 tempest-TestVolumeSwap-1037451778 tempest-TestVolumeSwap-1037451778-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eff563f0-92d3-47a1-addc-e3eaa6828d59 (non-flash)
Nov 16 10:13:14 user nova-compute[85141]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb0e3ad6-04d7-4405-b4ae-0440b2a396ce (non-flash)
Nov 16 10:13:14 user nova-compute[85141]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba7ca2a3-5f1e-4544-852f-d57100b608e3 (non-flash)
Nov 16 10:13:14 user nova-compute[85141]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42c041ec-fa39-4035-b82b-867caf3565df (non-flash)
Nov 16 10:13:14 user nova-compute[85141]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4df10d9-a60c-45ed-981d-96f704534fb8 (non-flash)
Nov 16 10:13:14 user nova-compute[85141]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4973f768-f126-41d6-b534-458d6c49f9b3 (non-flash)
Nov 16 10:13:14 user nova-compute[85141]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fcde20-e019-4cf0-ad90-6c8100f4a8d2 (non-flash)
Nov 16 10:13:14 user nova-compute[85141]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ca01473-0233-4122-b008-ffa407ca3e70 (non-flash)
Nov 16 10:13:14 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:13:14 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e3c140e-c9f9-46ce-a537-0787e8739533 tempest-TestVolumeSwap-1037451778 tempest-TestVolumeSwap-1037451778-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eff563f0-92d3-47a1-addc-e3eaa6828d59 (non-flash)
Nov 16 10:13:14 user nova-compute[85141]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb0e3ad6-04d7-4405-b4ae-0440b2a396ce (non-flash)
Nov 16 10:13:14 user nova-compute[85141]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba7ca2a3-5f1e-4544-852f-d57100b608e3 (non-flash)
Nov 16 10:13:14 user nova-compute[85141]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42c041ec-fa39-4035-b82b-867caf3565df (non-flash)
Nov 16 10:13:14 user nova-compute[85141]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4df10d9-a60c-45ed-981d-96f704534fb8 (non-flash)
Nov 16 10:13:14 user nova-compute[85141]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4973f768-f126-41d6-b534-458d6c49f9b3 (non-flash)
Nov 16 10:13:14 user nova-compute[85141]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fcde20-e019-4cf0-ad90-6c8100f4a8d2 (non-flash)
Nov 16 10:13:14 user nova-compute[85141]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ca01473-0233-4122-b008-ffa407ca3e70 (non-flash)
Nov 16 10:13:14 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 10:13:14 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e233047-dda3-4f2e-803c-7b69a57ac656 -p 172.16.0.220:3260 --login {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:13:15 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-8709ced5-7bbf-4b82-92b1-e1003b2216dc tempest-AttachSCSIVolumeTestJSON-1774410022 tempest-AttachSCSIVolumeTestJSON-1774410022-project-member] Waiting for libvirt event about the detach of device sdc with device alias scsi0-0-0-2 from instance ff964caf-b473-47bc-89d2-f7189264721c is timed out.
Nov 16 10:13:15 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-8709ced5-7bbf-4b82-92b1-e1003b2216dc tempest-AttachSCSIVolumeTestJSON-1774410022 tempest-AttachSCSIVolumeTestJSON-1774410022-project-member] Successfully detached device sdc from instance ff964caf-b473-47bc-89d2-f7189264721c from the live domain config.
Nov 16 10:13:15 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8709ced5-7bbf-4b82-92b1-e1003b2216dc tempest-AttachSCSIVolumeTestJSON-1774410022 tempest-AttachSCSIVolumeTestJSON-1774410022-project-member] [instance: ff964caf-b473-47bc-89d2-f7189264721c] calling os-brick to detach iSCSI Volume {{(pid=85141) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 10:13:15 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-8709ced5-7bbf-4b82-92b1-e1003b2216dc tempest-AttachSCSIVolumeTestJSON-1774410022 tempest-AttachSCSIVolumeTestJSON-1774410022-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51806b6080>, {'target_iqn': 'iqn.2010-10.org.openstack:8ca01473-0233-4122-b008-ffa407ca3e70', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FJKSkofB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 10:13:15 user nova-compute[85141]: WARNING os_brick.initiator.connectors.base [None req-8709ced5-7bbf-4b82-92b1-e1003b2216dc tempest-AttachSCSIVolumeTestJSON-1774410022 tempest-AttachSCSIVolumeTestJSON-1774410022-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 10:13:15 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-8709ced5-7bbf-4b82-92b1-e1003b2216dc tempest-AttachSCSIVolumeTestJSON-1774410022 tempest-AttachSCSIVolumeTestJSON-1774410022-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 10:13:15 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e233047-dda3-4f2e-803c-7b69a57ac656 -p 172.16.0.220:3260 --login" returned: 0 in 0.130s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:13:15 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c02260c-33cc-4ca9-bd75-181c47b198db]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7e233047-dda3-4f2e-803c-7b69a57ac656, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7e233047-dda3-4f2e-803c-7b69a57ac656, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:13:15 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e3c140e-c9f9-46ce-a537-0787e8739533 tempest-TestVolumeSwap-1037451778 tempest-TestVolumeSwap-1037451778-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7e233047-dda3-4f2e-803c-7b69a57ac656, portal: 172.16.0.220,3260]
Nov 16 10:13:15 user nova-compute[85141]: Login to [iface: default, target: iqn.2010-10.org.openstack:7e233047-dda3-4f2e-803c-7b69a57ac656, portal: 172.16.0.220,3260] successful.
Nov 16 10:13:15 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:13:15 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e233047-dda3-4f2e-803c-7b69a57ac656 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:13:15 user nova-compute[85141]: INFO nova.virt.libvirt.driver [-] [instance: eef3cc09-054b-4a17-b621-4f3737d5420e] Instance destroyed successfully.
Nov 16 10:13:15 user nova-compute[85141]: DEBUG nova.objects.instance [None req-a33076d6-5841-4a55-8d9a-ab2ffc688743 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] Lazy-loading 'resources' on Instance uuid eef3cc09-054b-4a17-b621-4f3737d5420e {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:13:15 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e233047-dda3-4f2e-803c-7b69a57ac656 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:13:15 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[836446ac-f336-4e78-af80-50adae92c678]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:13:15 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e3c140e-c9f9-46ce-a537-0787e8739533 tempest-TestVolumeSwap-1037451778 tempest-TestVolumeSwap-1037451778-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:13:15 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-a33076d6-5841-4a55-8d9a-ab2ffc688743 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T10:11:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-51502851',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-51502851',id=12,image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM5vBaIfg5DdeW2zM4rA9EPiY+/ZYvJ/N5o4qpg6svPMp2TYXZseykJJc31kLM1fey6shmBY6qpJdgABWdhRsE2tAeMaXqi2NUagwQmOeDuf7yyD8QSo96HgIsUX6lNTkQ==',key_name='tempest-keypair-876906675',keypairs=<?>,launch_index=0,launched_at=2023-11-16T10:11:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='eafaf607b5ff4b448aaaea253a321827',ramdisk_id='',reservation_id='r-5mbq86rv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1883132768',owner_user_name='tempest-TaggedBootDevicesTest_v242-1883132768-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T10:11:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8b186b80e92e41878b8ab7e839181fca',uuid=eef3cc09-054b-4a17-b621-4f3737d5420e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "277c1d3d-ed49-4b8c-82e3-902fa6c8a2f5", "address": "fa:16:3e:60:a2:e0", "network": {"id": "1f8e2c11-f9ae-480d-a6e3-1df589fdd7bc", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-976382911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eafaf607b5ff4b448aaaea253a321827", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap277c1d3d-ed", "ovs_interfaceid": "277c1d3d-ed49-4b8c-82e3-902fa6c8a2f5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 10:13:15 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-a33076d6-5841-4a55-8d9a-ab2ffc688743 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] Converting VIF {"id": "277c1d3d-ed49-4b8c-82e3-902fa6c8a2f5", "address": "fa:16:3e:60:a2:e0", "network": {"id": "1f8e2c11-f9ae-480d-a6e3-1df589fdd7bc", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-976382911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eafaf607b5ff4b448aaaea253a321827", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap277c1d3d-ed", "ovs_interfaceid": "277c1d3d-ed49-4b8c-82e3-902fa6c8a2f5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:13:15 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-a33076d6-5841-4a55-8d9a-ab2ffc688743 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:60:a2:e0,bridge_name='br-int',has_traffic_filtering=True,id=277c1d3d-ed49-4b8c-82e3-902fa6c8a2f5,network=Network(1f8e2c11-f9ae-480d-a6e3-1df589fdd7bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap277c1d3d-ed') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:13:15 user nova-compute[85141]: DEBUG os_vif [None req-a33076d6-5841-4a55-8d9a-ab2ffc688743 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:60:a2:e0,bridge_name='br-int',has_traffic_filtering=True,id=277c1d3d-ed49-4b8c-82e3-902fa6c8a2f5,network=Network(1f8e2c11-f9ae-480d-a6e3-1df589fdd7bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap277c1d3d-ed') {{(pid=85141) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 10:13:15 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:13:15 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:13:15 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap277c1d3d-ed, bridge=br-int, if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:13:15 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:13:15 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:13:15 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:13:15 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[f997ec64-ca5c-46e9-b8fd-4287cdf66a42]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eff563f0-92d3-47a1-addc-e3eaa6828d59 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb0e3ad6-04d7-4405-b4ae-0440b2a396ce (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba7ca2a3-5f1e-4544-852f-d57100b608e3 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42c041ec-fa39-4035-b82b-867caf3565df (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e233047-dda3-4f2e-803c-7b69a57ac656 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4df10d9-a60c-45ed-981d-96f704534fb8 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4973f768-f126-41d6-b534-458d6c49f9b3 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fcde20-e019-4cf0-ad90-6c8100f4a8d2 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ca01473-0233-4122-b008-ffa407ca3e70 (non-flash)\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:13:15 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e3c140e-c9f9-46ce-a537-0787e8739533 tempest-TestVolumeSwap-1037451778 tempest-TestVolumeSwap-1037451778-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eff563f0-92d3-47a1-addc-e3eaa6828d59 (non-flash)
Nov 16 10:13:15 user nova-compute[85141]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb0e3ad6-04d7-4405-b4ae-0440b2a396ce (non-flash)
Nov 16 10:13:15 user nova-compute[85141]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba7ca2a3-5f1e-4544-852f-d57100b608e3 (non-flash)
Nov 16 10:13:15 user nova-compute[85141]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42c041ec-fa39-4035-b82b-867caf3565df (non-flash)
Nov 16 10:13:15 user nova-compute[85141]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e233047-dda3-4f2e-803c-7b69a57ac656 (non-flash)
Nov 16 10:13:15 user nova-compute[85141]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4df10d9-a60c-45ed-981d-96f704534fb8 (non-flash)
Nov 16 10:13:15 user nova-compute[85141]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4973f768-f126-41d6-b534-458d6c49f9b3 (non-flash)
Nov 16 10:13:15 user nova-compute[85141]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fcde20-e019-4cf0-ad90-6c8100f4a8d2 (non-flash)
Nov 16 10:13:15 user nova-compute[85141]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ca01473-0233-4122-b008-ffa407ca3e70 (non-flash)
Nov 16 10:13:15 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:13:15 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e3c140e-c9f9-46ce-a537-0787e8739533 tempest-TestVolumeSwap-1037451778 tempest-TestVolumeSwap-1037451778-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eff563f0-92d3-47a1-addc-e3eaa6828d59 (non-flash)
Nov 16 10:13:15 user nova-compute[85141]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb0e3ad6-04d7-4405-b4ae-0440b2a396ce (non-flash)
Nov 16 10:13:15 user nova-compute[85141]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba7ca2a3-5f1e-4544-852f-d57100b608e3 (non-flash)
Nov 16 10:13:15 user nova-compute[85141]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42c041ec-fa39-4035-b82b-867caf3565df (non-flash)
Nov 16 10:13:15 user nova-compute[85141]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e233047-dda3-4f2e-803c-7b69a57ac656 (non-flash)
Nov 16 10:13:15 user nova-compute[85141]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4df10d9-a60c-45ed-981d-96f704534fb8 (non-flash)
Nov 16 10:13:15 user nova-compute[85141]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4973f768-f126-41d6-b534-458d6c49f9b3 (non-flash)
Nov 16 10:13:15 user nova-compute[85141]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fcde20-e019-4cf0-ad90-6c8100f4a8d2 (non-flash)
Nov 16 10:13:15 user nova-compute[85141]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ca01473-0233-4122-b008-ffa407ca3e70 (non-flash)
Nov 16 10:13:15 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 10:13:15 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-2e3c140e-c9f9-46ce-a537-0787e8739533 tempest-TestVolumeSwap-1037451778 tempest-TestVolumeSwap-1037451778-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7e233047-dda3-4f2e-803c-7b69a57ac656" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.441s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 10:13:15 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e3c140e-c9f9-46ce-a537-0787e8739533 tempest-TestVolumeSwap-1037451778 tempest-TestVolumeSwap-1037451778-project-admin] Connected to 172.16.0.220:3260 {{(pid=85141) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 10:13:15 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-2e3c140e-c9f9-46ce-a537-0787e8739533 tempest-TestVolumeSwap-1037451778 tempest-TestVolumeSwap-1037451778-project-admin] HCTL ('37', '-', '-', 0) found on session 15 with lun 0 {{(pid=85141) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 10:13:15 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-2e3c140e-c9f9-46ce-a537-0787e8739533 tempest-TestVolumeSwap-1037451778 tempest-TestVolumeSwap-1037451778-project-admin] Scanning host 37 c: -, t: -, l: 0) {{(pid=85141) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 10:13:15 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:13:15 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.019s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:13:15 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a24eb44-648d-419c-ba8b-ea88710ea809]: (4, ('- - 0', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:13:15 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-2e3c140e-c9f9-46ce-a537-0787e8739533 tempest-TestVolumeSwap-1037451778 tempest-TestVolumeSwap-1037451778-project-admin] Searching for a device in session 15 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=85141) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 10:13:15 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e3c140e-c9f9-46ce-a537-0787e8739533 tempest-TestVolumeSwap-1037451778 tempest-TestVolumeSwap-1037451778-project-admin] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:7e233047-dda3-4f2e-803c-7b69a57ac656', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UtNLBDJC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=85141) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 10:13:15 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:13:15 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:13:15 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=42a7fcc2-1fef-4f84-ae9c-8d3261399093) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:13:15 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:13:15 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:13:15 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:13:15 user nova-compute[85141]: INFO os_vif [None req-a33076d6-5841-4a55-8d9a-ab2ffc688743 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:60:a2:e0,bridge_name='br-int',has_traffic_filtering=True,id=277c1d3d-ed49-4b8c-82e3-902fa6c8a2f5,network=Network(1f8e2c11-f9ae-480d-a6e3-1df589fdd7bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap277c1d3d-ed')
Nov 16 10:13:15 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-a33076d6-5841-4a55-8d9a-ab2ffc688743 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T10:11:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-51502851',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-51502851',id=12,image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM5vBaIfg5DdeW2zM4rA9EPiY+/ZYvJ/N5o4qpg6svPMp2TYXZseykJJc31kLM1fey6shmBY6qpJdgABWdhRsE2tAeMaXqi2NUagwQmOeDuf7yyD8QSo96HgIsUX6lNTkQ==',key_name='tempest-keypair-876906675',keypairs=<?>,launch_index=0,launched_at=2023-11-16T10:11:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='eafaf607b5ff4b448aaaea253a321827',ramdisk_id='',reservation_id='r-5mbq86rv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1883132768',owner_user_name='tempest-TaggedBootDevicesTest_v242-1883132768-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T10:11:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8b186b80e92e41878b8ab7e839181fca',uuid=eef3cc09-054b-4a17-b621-4f3737d5420e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f742ff18-5ea3-42a0-b229-27a32badce8a", "address": "fa:16:3e:38:78:2d", "network": {"id": "85a74d82-5c98-4f2b-a38d-3e9ebe6a1e13", "bridge": "br-int", "label": "tempest-device-tagging-net1-178618229", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.216", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "eafaf607b5ff4b448aaaea253a321827", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf742ff18-5e", "ovs_interfaceid": "f742ff18-5ea3-42a0-b229-27a32badce8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=85141) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 10:13:15 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-a33076d6-5841-4a55-8d9a-ab2ffc688743 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] Converting VIF {"id": "f742ff18-5ea3-42a0-b229-27a32badce8a", "address": "fa:16:3e:38:78:2d", "network": {"id": "85a74d82-5c98-4f2b-a38d-3e9ebe6a1e13", "bridge": "br-int", "label": "tempest-device-tagging-net1-178618229", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.216", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "eafaf607b5ff4b448aaaea253a321827", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf742ff18-5e", "ovs_interfaceid": "f742ff18-5ea3-42a0-b229-27a32badce8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:13:15 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-a33076d6-5841-4a55-8d9a-ab2ffc688743 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:78:2d,bridge_name='br-int',has_traffic_filtering=True,id=f742ff18-5ea3-42a0-b229-27a32badce8a,network=Network(85a74d82-5c98-4f2b-a38d-3e9ebe6a1e13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf742ff18-5e') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:13:15 user nova-compute[85141]: DEBUG os_vif [None req-a33076d6-5841-4a55-8d9a-ab2ffc688743 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:78:2d,bridge_name='br-int',has_traffic_filtering=True,id=f742ff18-5ea3-42a0-b229-27a32badce8a,network=Network(85a74d82-5c98-4f2b-a38d-3e9ebe6a1e13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf742ff18-5e') {{(pid=85141) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 10:13:15 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:13:15 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf742ff18-5e, bridge=br-int, if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:13:15 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:13:15 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:13:15 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:13:15 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:13:15 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f2ca5321-d8ac-481d-a5fe-f5c12d82c868) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:13:15 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:13:15 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:13:15 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:13:15 user nova-compute[85141]: INFO os_vif [None req-a33076d6-5841-4a55-8d9a-ab2ffc688743 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:78:2d,bridge_name='br-int',has_traffic_filtering=True,id=f742ff18-5ea3-42a0-b229-27a32badce8a,network=Network(85a74d82-5c98-4f2b-a38d-3e9ebe6a1e13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf742ff18-5e')
Nov 16 10:13:15 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-a33076d6-5841-4a55-8d9a-ab2ffc688743 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T10:11:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-51502851',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-51502851',id=12,image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM5vBaIfg5DdeW2zM4rA9EPiY+/ZYvJ/N5o4qpg6svPMp2TYXZseykJJc31kLM1fey6shmBY6qpJdgABWdhRsE2tAeMaXqi2NUagwQmOeDuf7yyD8QSo96HgIsUX6lNTkQ==',key_name='tempest-keypair-876906675',keypairs=<?>,launch_index=0,launched_at=2023-11-16T10:11:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='eafaf607b5ff4b448aaaea253a321827',ramdisk_id='',reservation_id='r-5mbq86rv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1883132768',owner_user_name='tempest-TaggedBootDevicesTest_v242-1883132768-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T10:11:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8b186b80e92e41878b8ab7e839181fca',uuid=eef3cc09-054b-4a17-b621-4f3737d5420e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0f7c87ad-4076-4aca-8d9b-1fae099dd325", "address": "fa:16:3e:7a:05:a4", "network": {"id": "85a74d82-5c98-4f2b-a38d-3e9ebe6a1e13", "bridge": "br-int", "label": "tempest-device-tagging-net1-178618229", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.102", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "eafaf607b5ff4b448aaaea253a321827", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f7c87ad-40", "ovs_interfaceid": "0f7c87ad-4076-4aca-8d9b-1fae099dd325", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=85141) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 10:13:15 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-a33076d6-5841-4a55-8d9a-ab2ffc688743 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] Converting VIF {"id": "0f7c87ad-4076-4aca-8d9b-1fae099dd325", "address": "fa:16:3e:7a:05:a4", "network": {"id": "85a74d82-5c98-4f2b-a38d-3e9ebe6a1e13", "bridge": "br-int", "label": "tempest-device-tagging-net1-178618229", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.102", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "eafaf607b5ff4b448aaaea253a321827", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f7c87ad-40", "ovs_interfaceid": "0f7c87ad-4076-4aca-8d9b-1fae099dd325", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:13:15 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-a33076d6-5841-4a55-8d9a-ab2ffc688743 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7a:05:a4,bridge_name='br-int',has_traffic_filtering=True,id=0f7c87ad-4076-4aca-8d9b-1fae099dd325,network=Network(85a74d82-5c98-4f2b-a38d-3e9ebe6a1e13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap0f7c87ad-40') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:13:15 user nova-compute[85141]: DEBUG os_vif [None req-a33076d6-5841-4a55-8d9a-ab2ffc688743 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:05:a4,bridge_name='br-int',has_traffic_filtering=True,id=0f7c87ad-4076-4aca-8d9b-1fae099dd325,network=Network(85a74d82-5c98-4f2b-a38d-3e9ebe6a1e13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap0f7c87ad-40') {{(pid=85141) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 10:13:15 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:13:15 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0f7c87ad-40, bridge=br-int, if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:13:15 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:13:15 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:13:15 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:13:15 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:13:15 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=292f6634-0b60-4320-92d7-ae9f8fe9a55c) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:13:15 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:13:15 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:13:15 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:13:15 user nova-compute[85141]: INFO os_vif [None req-a33076d6-5841-4a55-8d9a-ab2ffc688743 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:05:a4,bridge_name='br-int',has_traffic_filtering=True,id=0f7c87ad-4076-4aca-8d9b-1fae099dd325,network=Network(85a74d82-5c98-4f2b-a38d-3e9ebe6a1e13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap0f7c87ad-40')
Nov 16 10:13:15 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-a33076d6-5841-4a55-8d9a-ab2ffc688743 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T10:11:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-51502851',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-51502851',id=12,image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM5vBaIfg5DdeW2zM4rA9EPiY+/ZYvJ/N5o4qpg6svPMp2TYXZseykJJc31kLM1fey6shmBY6qpJdgABWdhRsE2tAeMaXqi2NUagwQmOeDuf7yyD8QSo96HgIsUX6lNTkQ==',key_name='tempest-keypair-876906675',keypairs=<?>,launch_index=0,launched_at=2023-11-16T10:11:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='eafaf607b5ff4b448aaaea253a321827',ramdisk_id='',reservation_id='r-5mbq86rv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1883132768',owner_user_name='tempest-TaggedBootDevicesTest_v242-1883132768-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T10:11:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8b186b80e92e41878b8ab7e839181fca',uuid=eef3cc09-054b-4a17-b621-4f3737d5420e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d6b517e2-8788-4775-b327-11601713da4d", "address": "fa:16:3e:81:5a:0a", "network": {"id": "85a74d82-5c98-4f2b-a38d-3e9ebe6a1e13", "bridge": "br-int", "label": "tempest-device-tagging-net1-178618229", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.253", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "eafaf607b5ff4b448aaaea253a321827", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6b517e2-87", "ovs_interfaceid": "d6b517e2-8788-4775-b327-11601713da4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 10:13:15 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-a33076d6-5841-4a55-8d9a-ab2ffc688743 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] Converting VIF {"id": "d6b517e2-8788-4775-b327-11601713da4d", "address": "fa:16:3e:81:5a:0a", "network": {"id": "85a74d82-5c98-4f2b-a38d-3e9ebe6a1e13", "bridge": "br-int", "label": "tempest-device-tagging-net1-178618229", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.253", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "eafaf607b5ff4b448aaaea253a321827", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6b517e2-87", "ovs_interfaceid": "d6b517e2-8788-4775-b327-11601713da4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:13:15 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-a33076d6-5841-4a55-8d9a-ab2ffc688743 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:81:5a:0a,bridge_name='br-int',has_traffic_filtering=True,id=d6b517e2-8788-4775-b327-11601713da4d,network=Network(85a74d82-5c98-4f2b-a38d-3e9ebe6a1e13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6b517e2-87') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:13:15 user nova-compute[85141]: DEBUG os_vif [None req-a33076d6-5841-4a55-8d9a-ab2ffc688743 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:5a:0a,bridge_name='br-int',has_traffic_filtering=True,id=d6b517e2-8788-4775-b327-11601713da4d,network=Network(85a74d82-5c98-4f2b-a38d-3e9ebe6a1e13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6b517e2-87') {{(pid=85141) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 10:13:15 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:13:15 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd6b517e2-87, bridge=br-int, if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:13:15 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:13:15 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:13:15 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:13:15 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:13:15 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2763e00f-349b-4cea-9c14-c5380a07dca1) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:13:15 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:13:15 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:13:15 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:13:15 user nova-compute[85141]: INFO os_vif [None req-a33076d6-5841-4a55-8d9a-ab2ffc688743 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:5a:0a,bridge_name='br-int',has_traffic_filtering=True,id=d6b517e2-8788-4775-b327-11601713da4d,network=Network(85a74d82-5c98-4f2b-a38d-3e9ebe6a1e13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6b517e2-87')
Nov 16 10:13:15 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-a33076d6-5841-4a55-8d9a-ab2ffc688743 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T10:11:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-51502851',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-51502851',id=12,image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM5vBaIfg5DdeW2zM4rA9EPiY+/ZYvJ/N5o4qpg6svPMp2TYXZseykJJc31kLM1fey6shmBY6qpJdgABWdhRsE2tAeMaXqi2NUagwQmOeDuf7yyD8QSo96HgIsUX6lNTkQ==',key_name='tempest-keypair-876906675',keypairs=<?>,launch_index=0,launched_at=2023-11-16T10:11:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='eafaf607b5ff4b448aaaea253a321827',ramdisk_id='',reservation_id='r-5mbq86rv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1883132768',owner_user_name='tempest-TaggedBootDevicesTest_v242-1883132768-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T10:11:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8b186b80e92e41878b8ab7e839181fca',uuid=eef3cc09-054b-4a17-b621-4f3737d5420e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0c9cc79d-1ded-40cc-84fc-f6b70a9bb555", "address": "fa:16:3e:d4:13:c9", "network": {"id": "85a74d82-5c98-4f2b-a38d-3e9ebe6a1e13", "bridge": "br-int", "label": "tempest-device-tagging-net1-178618229", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.61", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "eafaf607b5ff4b448aaaea253a321827", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c9cc79d-1d", "ovs_interfaceid": "0c9cc79d-1ded-40cc-84fc-f6b70a9bb555", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 10:13:15 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-a33076d6-5841-4a55-8d9a-ab2ffc688743 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] Converting VIF {"id": "0c9cc79d-1ded-40cc-84fc-f6b70a9bb555", "address": "fa:16:3e:d4:13:c9", "network": {"id": "85a74d82-5c98-4f2b-a38d-3e9ebe6a1e13", "bridge": "br-int", "label": "tempest-device-tagging-net1-178618229", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.61", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "eafaf607b5ff4b448aaaea253a321827", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c9cc79d-1d", "ovs_interfaceid": "0c9cc79d-1ded-40cc-84fc-f6b70a9bb555", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:13:15 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-a33076d6-5841-4a55-8d9a-ab2ffc688743 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:13:c9,bridge_name='br-int',has_traffic_filtering=True,id=0c9cc79d-1ded-40cc-84fc-f6b70a9bb555,network=Network(85a74d82-5c98-4f2b-a38d-3e9ebe6a1e13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c9cc79d-1d') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:13:15 user nova-compute[85141]: DEBUG os_vif [None req-a33076d6-5841-4a55-8d9a-ab2ffc688743 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:13:c9,bridge_name='br-int',has_traffic_filtering=True,id=0c9cc79d-1ded-40cc-84fc-f6b70a9bb555,network=Network(85a74d82-5c98-4f2b-a38d-3e9ebe6a1e13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c9cc79d-1d') {{(pid=85141) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 10:13:15 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:13:15 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0c9cc79d-1d, bridge=br-int, if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:13:15 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:13:15 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:13:15 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:13:15 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:13:15 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2cb69807-7f5f-4e00-ae11-33295c3c81e7) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:13:15 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:13:15 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:13:15 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:13:15 user nova-compute[85141]: INFO os_vif [None req-a33076d6-5841-4a55-8d9a-ab2ffc688743 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:13:c9,bridge_name='br-int',has_traffic_filtering=True,id=0c9cc79d-1ded-40cc-84fc-f6b70a9bb555,network=Network(85a74d82-5c98-4f2b-a38d-3e9ebe6a1e13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c9cc79d-1d')
Nov 16 10:13:15 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-a33076d6-5841-4a55-8d9a-ab2ffc688743 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T10:11:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-51502851',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-51502851',id=12,image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM5vBaIfg5DdeW2zM4rA9EPiY+/ZYvJ/N5o4qpg6svPMp2TYXZseykJJc31kLM1fey6shmBY6qpJdgABWdhRsE2tAeMaXqi2NUagwQmOeDuf7yyD8QSo96HgIsUX6lNTkQ==',key_name='tempest-keypair-876906675',keypairs=<?>,launch_index=0,launched_at=2023-11-16T10:11:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='eafaf607b5ff4b448aaaea253a321827',ramdisk_id='',reservation_id='r-5mbq86rv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1883132768',owner_user_name='tempest-TaggedBootDevicesTest_v242-1883132768-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T10:11:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8b186b80e92e41878b8ab7e839181fca',uuid=eef3cc09-054b-4a17-b621-4f3737d5420e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b0183e60-7f49-44a1-a24c-30db287f2453", "address": "fa:16:3e:b2:23:6e", "network": {"id": "a9e0ac50-1fbb-4d94-a22f-6fcf40dd0194", "bridge": "br-int", "label": "tempest-device-tagging-net2-947660195", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "eafaf607b5ff4b448aaaea253a321827", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0183e60-7f", "ovs_interfaceid": "b0183e60-7f49-44a1-a24c-30db287f2453", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 10:13:15 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-a33076d6-5841-4a55-8d9a-ab2ffc688743 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] Converting VIF {"id": "b0183e60-7f49-44a1-a24c-30db287f2453", "address": "fa:16:3e:b2:23:6e", "network": {"id": "a9e0ac50-1fbb-4d94-a22f-6fcf40dd0194", "bridge": "br-int", "label": "tempest-device-tagging-net2-947660195", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "eafaf607b5ff4b448aaaea253a321827", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0183e60-7f", "ovs_interfaceid": "b0183e60-7f49-44a1-a24c-30db287f2453", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:13:15 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-a33076d6-5841-4a55-8d9a-ab2ffc688743 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:23:6e,bridge_name='br-int',has_traffic_filtering=True,id=b0183e60-7f49-44a1-a24c-30db287f2453,network=Network(a9e0ac50-1fbb-4d94-a22f-6fcf40dd0194),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0183e60-7f') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:13:15 user nova-compute[85141]: DEBUG os_vif [None req-a33076d6-5841-4a55-8d9a-ab2ffc688743 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:23:6e,bridge_name='br-int',has_traffic_filtering=True,id=b0183e60-7f49-44a1-a24c-30db287f2453,network=Network(a9e0ac50-1fbb-4d94-a22f-6fcf40dd0194),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0183e60-7f') {{(pid=85141) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 10:13:15 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:13:15 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb0183e60-7f, bridge=br-int, if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:13:15 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:13:15 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:13:15 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:13:15 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:13:15 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8572342b-75e5-4188-9e30-6143c1641790) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:13:15 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:13:15 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:13:15 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:13:15 user nova-compute[85141]: INFO os_vif [None req-a33076d6-5841-4a55-8d9a-ab2ffc688743 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:23:6e,bridge_name='br-int',has_traffic_filtering=True,id=b0183e60-7f49-44a1-a24c-30db287f2453,network=Network(a9e0ac50-1fbb-4d94-a22f-6fcf40dd0194),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0183e60-7f')
Nov 16 10:13:15 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-a33076d6-5841-4a55-8d9a-ab2ffc688743 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T10:11:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-51502851',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-51502851',id=12,image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM5vBaIfg5DdeW2zM4rA9EPiY+/ZYvJ/N5o4qpg6svPMp2TYXZseykJJc31kLM1fey6shmBY6qpJdgABWdhRsE2tAeMaXqi2NUagwQmOeDuf7yyD8QSo96HgIsUX6lNTkQ==',key_name='tempest-keypair-876906675',keypairs=<?>,launch_index=0,launched_at=2023-11-16T10:11:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='eafaf607b5ff4b448aaaea253a321827',ramdisk_id='',reservation_id='r-5mbq86rv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1883132768',owner_user_name='tempest-TaggedBootDevicesTest_v242-1883132768-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T10:11:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8b186b80e92e41878b8ab7e839181fca',uuid=eef3cc09-054b-4a17-b621-4f3737d5420e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "21180772-80b3-48e1-90e9-39590611ff08", "address": "fa:16:3e:c1:ed:f9", "network": {"id": "a9e0ac50-1fbb-4d94-a22f-6fcf40dd0194", "bridge": "br-int", "label": "tempest-device-tagging-net2-947660195", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "eafaf607b5ff4b448aaaea253a321827", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21180772-80", "ovs_interfaceid": "21180772-80b3-48e1-90e9-39590611ff08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 10:13:15 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-a33076d6-5841-4a55-8d9a-ab2ffc688743 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] Converting VIF {"id": "21180772-80b3-48e1-90e9-39590611ff08", "address": "fa:16:3e:c1:ed:f9", "network": {"id": "a9e0ac50-1fbb-4d94-a22f-6fcf40dd0194", "bridge": "br-int", "label": "tempest-device-tagging-net2-947660195", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "eafaf607b5ff4b448aaaea253a321827", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21180772-80", "ovs_interfaceid": "21180772-80b3-48e1-90e9-39590611ff08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:13:15 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-a33076d6-5841-4a55-8d9a-ab2ffc688743 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:ed:f9,bridge_name='br-int',has_traffic_filtering=True,id=21180772-80b3-48e1-90e9-39590611ff08,network=Network(a9e0ac50-1fbb-4d94-a22f-6fcf40dd0194),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21180772-80') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:13:15 user nova-compute[85141]: DEBUG os_vif [None req-a33076d6-5841-4a55-8d9a-ab2ffc688743 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:ed:f9,bridge_name='br-int',has_traffic_filtering=True,id=21180772-80b3-48e1-90e9-39590611ff08,network=Network(a9e0ac50-1fbb-4d94-a22f-6fcf40dd0194),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21180772-80') {{(pid=85141) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 10:13:15 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:13:15 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap21180772-80, bridge=br-int, if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:13:15 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:13:15 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:13:15 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:13:15 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b2be448e-88ae-4bcc-a428-bbc39d405812) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:13:15 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:13:15 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:13:15 user nova-compute[85141]: INFO os_vif [None req-a33076d6-5841-4a55-8d9a-ab2ffc688743 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:ed:f9,bridge_name='br-int',has_traffic_filtering=True,id=21180772-80b3-48e1-90e9-39590611ff08,network=Network(a9e0ac50-1fbb-4d94-a22f-6fcf40dd0194),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21180772-80')
Nov 16 10:13:15 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a33076d6-5841-4a55-8d9a-ab2ffc688743 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] [instance: eef3cc09-054b-4a17-b621-4f3737d5420e] calling os-brick to detach iSCSI Volume {{(pid=85141) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 10:13:15 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-a33076d6-5841-4a55-8d9a-ab2ffc688743 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51806b6080>, {'target_iqn': 'iqn.2010-10.org.openstack:b4df10d9-a60c-45ed-981d-96f704534fb8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fitzudYG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 10:13:15 user nova-compute[85141]: WARNING os_brick.initiator.connectors.base [None req-a33076d6-5841-4a55-8d9a-ab2ffc688743 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 10:13:15 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-a33076d6-5841-4a55-8d9a-ab2ffc688743 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 10:13:15 user nova-compute[85141]: DEBUG nova.compute.manager [req-aae736c2-6984-46c8-8e96-23d993852cb9 req-85c5a912-180c-4358-a7d2-d760a8af84ff service nova] [instance: eef3cc09-054b-4a17-b621-4f3737d5420e] Received event network-vif-plugged-0f7c87ad-4076-4aca-8d9b-1fae099dd325 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:13:15 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-aae736c2-6984-46c8-8e96-23d993852cb9 req-85c5a912-180c-4358-a7d2-d760a8af84ff service nova] Acquiring lock "eef3cc09-054b-4a17-b621-4f3737d5420e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:13:15 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-aae736c2-6984-46c8-8e96-23d993852cb9 req-85c5a912-180c-4358-a7d2-d760a8af84ff service nova] Lock "eef3cc09-054b-4a17-b621-4f3737d5420e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:13:15 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-aae736c2-6984-46c8-8e96-23d993852cb9 req-85c5a912-180c-4358-a7d2-d760a8af84ff service nova] Lock "eef3cc09-054b-4a17-b621-4f3737d5420e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:13:15 user nova-compute[85141]: DEBUG nova.compute.manager [req-aae736c2-6984-46c8-8e96-23d993852cb9 req-85c5a912-180c-4358-a7d2-d760a8af84ff service nova] [instance: eef3cc09-054b-4a17-b621-4f3737d5420e] No waiting events found dispatching network-vif-plugged-0f7c87ad-4076-4aca-8d9b-1fae099dd325 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:13:15 user nova-compute[85141]: WARNING nova.compute.manager [req-aae736c2-6984-46c8-8e96-23d993852cb9 req-85c5a912-180c-4358-a7d2-d760a8af84ff service nova] [instance: eef3cc09-054b-4a17-b621-4f3737d5420e] Received unexpected event network-vif-plugged-0f7c87ad-4076-4aca-8d9b-1fae099dd325 for instance with vm_state active and task_state deleting.
Nov 16 10:13:15 user nova-compute[85141]: DEBUG nova.compute.manager [req-aae736c2-6984-46c8-8e96-23d993852cb9 req-85c5a912-180c-4358-a7d2-d760a8af84ff service nova] [instance: eef3cc09-054b-4a17-b621-4f3737d5420e] Received event network-vif-unplugged-d6b517e2-8788-4775-b327-11601713da4d {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:13:15 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-aae736c2-6984-46c8-8e96-23d993852cb9 req-85c5a912-180c-4358-a7d2-d760a8af84ff service nova] Acquiring lock "eef3cc09-054b-4a17-b621-4f3737d5420e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:13:15 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-aae736c2-6984-46c8-8e96-23d993852cb9 req-85c5a912-180c-4358-a7d2-d760a8af84ff service nova] Lock "eef3cc09-054b-4a17-b621-4f3737d5420e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:13:15 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-aae736c2-6984-46c8-8e96-23d993852cb9 req-85c5a912-180c-4358-a7d2-d760a8af84ff service nova] Lock "eef3cc09-054b-4a17-b621-4f3737d5420e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:13:15 user nova-compute[85141]: DEBUG nova.compute.manager [req-aae736c2-6984-46c8-8e96-23d993852cb9 req-85c5a912-180c-4358-a7d2-d760a8af84ff service nova] [instance: eef3cc09-054b-4a17-b621-4f3737d5420e] No waiting events found dispatching network-vif-unplugged-d6b517e2-8788-4775-b327-11601713da4d {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:13:15 user nova-compute[85141]: DEBUG nova.compute.manager [req-aae736c2-6984-46c8-8e96-23d993852cb9 req-85c5a912-180c-4358-a7d2-d760a8af84ff service nova] [instance: eef3cc09-054b-4a17-b621-4f3737d5420e] Received event network-vif-unplugged-d6b517e2-8788-4775-b327-11601713da4d for instance with task_state deleting. {{(pid=85141) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 10:13:15 user nova-compute[85141]: DEBUG nova.compute.manager [req-aae736c2-6984-46c8-8e96-23d993852cb9 req-85c5a912-180c-4358-a7d2-d760a8af84ff service nova] [instance: eef3cc09-054b-4a17-b621-4f3737d5420e] Received event network-vif-plugged-d6b517e2-8788-4775-b327-11601713da4d {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:13:15 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-aae736c2-6984-46c8-8e96-23d993852cb9 req-85c5a912-180c-4358-a7d2-d760a8af84ff service nova] Acquiring lock "eef3cc09-054b-4a17-b621-4f3737d5420e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:13:15 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-aae736c2-6984-46c8-8e96-23d993852cb9 req-85c5a912-180c-4358-a7d2-d760a8af84ff service nova] Lock "eef3cc09-054b-4a17-b621-4f3737d5420e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:13:15 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-aae736c2-6984-46c8-8e96-23d993852cb9 req-85c5a912-180c-4358-a7d2-d760a8af84ff service nova] Lock "eef3cc09-054b-4a17-b621-4f3737d5420e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:13:15 user nova-compute[85141]: DEBUG nova.compute.manager [req-aae736c2-6984-46c8-8e96-23d993852cb9 req-85c5a912-180c-4358-a7d2-d760a8af84ff service nova] [instance: eef3cc09-054b-4a17-b621-4f3737d5420e] No waiting events found dispatching network-vif-plugged-d6b517e2-8788-4775-b327-11601713da4d {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:13:15 user nova-compute[85141]: WARNING nova.compute.manager [req-aae736c2-6984-46c8-8e96-23d993852cb9 req-85c5a912-180c-4358-a7d2-d760a8af84ff service nova] [instance: eef3cc09-054b-4a17-b621-4f3737d5420e] Received unexpected event network-vif-plugged-d6b517e2-8788-4775-b327-11601713da4d for instance with vm_state active and task_state deleting.
Nov 16 10:13:16 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-2e3c140e-c9f9-46ce-a537-0787e8739533 tempest-TestVolumeSwap-1037451778 tempest-TestVolumeSwap-1037451778-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.487s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 10:13:16 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e3c140e-c9f9-46ce-a537-0787e8739533 tempest-TestVolumeSwap-1037451778 tempest-TestVolumeSwap-1037451778-project-admin] <== connect_volume: return (1488ms) {'type': 'block', 'scsi_wwn': '26637343634643561', 'path': '/dev/sdf'} {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 10:13:16 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2e3c140e-c9f9-46ce-a537-0787e8739533 tempest-TestVolumeSwap-1037451778 tempest-TestVolumeSwap-1037451778-project-admin] [instance: ad1ace46-2e8e-42e1-a0f5-2384078fcf09] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26637343634643561', 'path': '/dev/sdf'} {{(pid=85141) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 10:13:16 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-8709ced5-7bbf-4b82-92b1-e1003b2216dc tempest-AttachSCSIVolumeTestJSON-1774410022 tempest-AttachSCSIVolumeTestJSON-1774410022-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.153s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 10:13:16 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:13:16 user nova-compute[85141]: DEBUG nova.objects.instance [None req-2e3c140e-c9f9-46ce-a537-0787e8739533 tempest-TestVolumeSwap-1037451778 tempest-TestVolumeSwap-1037451778-project-admin] Lazy-loading 'flavor' on Instance uuid ad1ace46-2e8e-42e1-a0f5-2384078fcf09 {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:13:16 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:13:16 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[48d0cb23-a6f5-400d-9d1c-56b4655486ef]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ba7ca2a3-5f1e-4544-852f-d57100b608e3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4973f768-f126-41d6-b534-458d6c49f9b3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:eff563f0-92d3-47a1-addc-e3eaa6828d59\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8ca01473-0233-4122-b008-ffa407ca3e70\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:27fcde20-e019-4cf0-ad90-6c8100f4a8d2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7e233047-dda3-4f2e-803c-7b69a57ac656\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:eb0e3ad6-04d7-4405-b4ae-0440b2a396ce\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b4df10d9-a60c-45ed-981d-96f704534fb8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:42c041ec-fa39-4035-b82b-867caf3565df\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:13:16 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-8709ced5-7bbf-4b82-92b1-e1003b2216dc tempest-AttachSCSIVolumeTestJSON-1774410022 tempest-AttachSCSIVolumeTestJSON-1774410022-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 10:13:16 user nova-compute[85141]: No targets found.
Nov 16 10:13:16 user nova-compute[85141]: iSNS:
Nov 16 10:13:16 user nova-compute[85141]: No targets found.
Nov 16 10:13:16 user nova-compute[85141]: STATIC:
Nov 16 10:13:16 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:ba7ca2a3-5f1e-4544-852f-d57100b608e3
Nov 16 10:13:16 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:13:16 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:13:16 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:4973f768-f126-41d6-b534-458d6c49f9b3
Nov 16 10:13:16 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:13:16 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:13:16 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:eff563f0-92d3-47a1-addc-e3eaa6828d59
Nov 16 10:13:16 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:13:16 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:13:16 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:8ca01473-0233-4122-b008-ffa407ca3e70
Nov 16 10:13:16 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:13:16 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:13:16 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:27fcde20-e019-4cf0-ad90-6c8100f4a8d2
Nov 16 10:13:16 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:13:16 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:13:16 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:7e233047-dda3-4f2e-803c-7b69a57ac656
Nov 16 10:13:16 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:13:16 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:13:16 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:eb0e3ad6-04d7-4405-b4ae-0440b2a396ce
Nov 16 10:13:16 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:13:16 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:13:16 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:b4df10d9-a60c-45ed-981d-96f704534fb8
Nov 16 10:13:16 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:13:16 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:13:16 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:42c041ec-fa39-4035-b82b-867caf3565df
Nov 16 10:13:16 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:13:16 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:13:16 user nova-compute[85141]: FIRMWARE:
Nov 16 10:13:16 user nova-compute[85141]: No targets found.
Nov 16 10:13:16 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:13:16 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-8709ced5-7bbf-4b82-92b1-e1003b2216dc tempest-AttachSCSIVolumeTestJSON-1774410022 tempest-AttachSCSIVolumeTestJSON-1774410022-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 10:13:16 user nova-compute[85141]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 10:13:16 user nova-compute[85141]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=85141) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 10:13:16 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-8709ced5-7bbf-4b82-92b1-e1003b2216dc tempest-AttachSCSIVolumeTestJSON-1774410022 tempest-AttachSCSIVolumeTestJSON-1774410022-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8ca01473-0233-4122-b008-ffa407ca3e70', 0)] {{(pid=85141) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 10:13:16 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:13:16 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:13:16 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aa47119-c384-4e30-868a-c0308cfe3ec7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:27fcde20-e019-4cf0-ad90-6c8100f4a8d2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:42c041ec-fa39-4035-b82b-867caf3565df\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4973f768-f126-41d6-b534-458d6c49f9b3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7e233047-dda3-4f2e-803c-7b69a57ac656\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8ca01473-0233-4122-b008-ffa407ca3e70\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b4df10d9-a60c-45ed-981d-96f704534fb8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ba7ca2a3-5f1e-4544-852f-d57100b608e3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eb0e3ad6-04d7-4405-b4ae-0440b2a396ce\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eff563f0-92d3-47a1-addc-e3eaa6828d59\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:13:16 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:13:16 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:13:16 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbdd92f1-96e8-43a5-8818-0134582f1971]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eff563f0-92d3-47a1-addc-e3eaa6828d59 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb0e3ad6-04d7-4405-b4ae-0440b2a396ce (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba7ca2a3-5f1e-4544-852f-d57100b608e3 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42c041ec-fa39-4035-b82b-867caf3565df (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e233047-dda3-4f2e-803c-7b69a57ac656 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4df10d9-a60c-45ed-981d-96f704534fb8 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4973f768-f126-41d6-b534-458d6c49f9b3 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fcde20-e019-4cf0-ad90-6c8100f4a8d2 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ca01473-0233-4122-b008-ffa407ca3e70 (non-flash)\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:13:16 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-8709ced5-7bbf-4b82-92b1-e1003b2216dc tempest-AttachSCSIVolumeTestJSON-1774410022 tempest-AttachSCSIVolumeTestJSON-1774410022-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eff563f0-92d3-47a1-addc-e3eaa6828d59 (non-flash)
Nov 16 10:13:16 user nova-compute[85141]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb0e3ad6-04d7-4405-b4ae-0440b2a396ce (non-flash)
Nov 16 10:13:16 user nova-compute[85141]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba7ca2a3-5f1e-4544-852f-d57100b608e3 (non-flash)
Nov 16 10:13:16 user nova-compute[85141]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42c041ec-fa39-4035-b82b-867caf3565df (non-flash)
Nov 16 10:13:16 user nova-compute[85141]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e233047-dda3-4f2e-803c-7b69a57ac656 (non-flash)
Nov 16 10:13:16 user nova-compute[85141]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4df10d9-a60c-45ed-981d-96f704534fb8 (non-flash)
Nov 16 10:13:16 user nova-compute[85141]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4973f768-f126-41d6-b534-458d6c49f9b3 (non-flash)
Nov 16 10:13:16 user nova-compute[85141]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fcde20-e019-4cf0-ad90-6c8100f4a8d2 (non-flash)
Nov 16 10:13:16 user nova-compute[85141]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ca01473-0233-4122-b008-ffa407ca3e70 (non-flash)
Nov 16 10:13:16 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:13:16 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-8709ced5-7bbf-4b82-92b1-e1003b2216dc tempest-AttachSCSIVolumeTestJSON-1774410022 tempest-AttachSCSIVolumeTestJSON-1774410022-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eff563f0-92d3-47a1-addc-e3eaa6828d59 (non-flash)
Nov 16 10:13:16 user nova-compute[85141]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb0e3ad6-04d7-4405-b4ae-0440b2a396ce (non-flash)
Nov 16 10:13:16 user nova-compute[85141]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba7ca2a3-5f1e-4544-852f-d57100b608e3 (non-flash)
Nov 16 10:13:16 user nova-compute[85141]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42c041ec-fa39-4035-b82b-867caf3565df (non-flash)
Nov 16 10:13:16 user nova-compute[85141]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e233047-dda3-4f2e-803c-7b69a57ac656 (non-flash)
Nov 16 10:13:16 user nova-compute[85141]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4df10d9-a60c-45ed-981d-96f704534fb8 (non-flash)
Nov 16 10:13:16 user nova-compute[85141]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4973f768-f126-41d6-b534-458d6c49f9b3 (non-flash)
Nov 16 10:13:16 user nova-compute[85141]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fcde20-e019-4cf0-ad90-6c8100f4a8d2 (non-flash)
Nov 16 10:13:16 user nova-compute[85141]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ca01473-0233-4122-b008-ffa407ca3e70 (non-flash)
Nov 16 10:13:16 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 10:13:16 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-8709ced5-7bbf-4b82-92b1-e1003b2216dc tempest-AttachSCSIVolumeTestJSON-1774410022 tempest-AttachSCSIVolumeTestJSON-1774410022-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f51802981f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8ca01473-0233-4122-b008-ffa407ca3e70'): ({'sdg'}, set())}) {{(pid=85141) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 10:13:16 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-8709ced5-7bbf-4b82-92b1-e1003b2216dc tempest-AttachSCSIVolumeTestJSON-1774410022 tempest-AttachSCSIVolumeTestJSON-1774410022-project-member] Removing single pathed devices sdg {{(pid=85141) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 10:13:16 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:13:16 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:13:16 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4d0653d-bd53-4204-9816-fa2019e0db27]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:13:16 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:13:16 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.018s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:13:16 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[32dd2e6b-0552-4a36-b6ec-604ace639f1d]: (4, ('ok\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:13:16 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-8709ced5-7bbf-4b82-92b1-e1003b2216dc tempest-AttachSCSIVolumeTestJSON-1774410022 tempest-AttachSCSIVolumeTestJSON-1774410022-project-member] Flushing IO for device /dev/sdg {{(pid=85141) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 10:13:16 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:13:16 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.012s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:13:16 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[3edfe115-37a7-4638-bd89-62825fa7fec0]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:13:16 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-8709ced5-7bbf-4b82-92b1-e1003b2216dc tempest-AttachSCSIVolumeTestJSON-1774410022 tempest-AttachSCSIVolumeTestJSON-1774410022-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=85141) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 10:13:16 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:13:16 user nova-compute[85141]: DEBUG nova.compute.manager [req-91be0210-548c-4d12-8900-923dc0041ff9 req-f133af7a-7dda-4468-bcae-e429da00f7d0 service nova] [instance: eef3cc09-054b-4a17-b621-4f3737d5420e] Received event network-vif-unplugged-0c9cc79d-1ded-40cc-84fc-f6b70a9bb555 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:13:16 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-91be0210-548c-4d12-8900-923dc0041ff9 req-f133af7a-7dda-4468-bcae-e429da00f7d0 service nova] Acquiring lock "eef3cc09-054b-4a17-b621-4f3737d5420e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:13:16 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-91be0210-548c-4d12-8900-923dc0041ff9 req-f133af7a-7dda-4468-bcae-e429da00f7d0 service nova] Lock "eef3cc09-054b-4a17-b621-4f3737d5420e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:13:16 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-91be0210-548c-4d12-8900-923dc0041ff9 req-f133af7a-7dda-4468-bcae-e429da00f7d0 service nova] Lock "eef3cc09-054b-4a17-b621-4f3737d5420e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:13:16 user nova-compute[85141]: DEBUG nova.compute.manager [req-91be0210-548c-4d12-8900-923dc0041ff9 req-f133af7a-7dda-4468-bcae-e429da00f7d0 service nova] [instance: eef3cc09-054b-4a17-b621-4f3737d5420e] No waiting events found dispatching network-vif-unplugged-0c9cc79d-1ded-40cc-84fc-f6b70a9bb555 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:13:16 user nova-compute[85141]: DEBUG nova.compute.manager [req-91be0210-548c-4d12-8900-923dc0041ff9 req-f133af7a-7dda-4468-bcae-e429da00f7d0 service nova] [instance: eef3cc09-054b-4a17-b621-4f3737d5420e] Received event network-vif-unplugged-0c9cc79d-1ded-40cc-84fc-f6b70a9bb555 for instance with task_state deleting. {{(pid=85141) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 10:13:16 user nova-compute[85141]: DEBUG nova.compute.manager [req-91be0210-548c-4d12-8900-923dc0041ff9 req-f133af7a-7dda-4468-bcae-e429da00f7d0 service nova] [instance: eef3cc09-054b-4a17-b621-4f3737d5420e] Received event network-vif-plugged-0c9cc79d-1ded-40cc-84fc-f6b70a9bb555 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:13:16 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-91be0210-548c-4d12-8900-923dc0041ff9 req-f133af7a-7dda-4468-bcae-e429da00f7d0 service nova] Acquiring lock "eef3cc09-054b-4a17-b621-4f3737d5420e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:13:16 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-91be0210-548c-4d12-8900-923dc0041ff9 req-f133af7a-7dda-4468-bcae-e429da00f7d0 service nova] Lock "eef3cc09-054b-4a17-b621-4f3737d5420e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:13:16 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-91be0210-548c-4d12-8900-923dc0041ff9 req-f133af7a-7dda-4468-bcae-e429da00f7d0 service nova] Lock "eef3cc09-054b-4a17-b621-4f3737d5420e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:13:16 user nova-compute[85141]: DEBUG nova.compute.manager [req-91be0210-548c-4d12-8900-923dc0041ff9 req-f133af7a-7dda-4468-bcae-e429da00f7d0 service nova] [instance: eef3cc09-054b-4a17-b621-4f3737d5420e] No waiting events found dispatching network-vif-plugged-0c9cc79d-1ded-40cc-84fc-f6b70a9bb555 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:13:16 user nova-compute[85141]: WARNING nova.compute.manager [req-91be0210-548c-4d12-8900-923dc0041ff9 req-f133af7a-7dda-4468-bcae-e429da00f7d0 service nova] [instance: eef3cc09-054b-4a17-b621-4f3737d5420e] Received unexpected event network-vif-plugged-0c9cc79d-1ded-40cc-84fc-f6b70a9bb555 for instance with vm_state active and task_state deleting.
Nov 16 10:13:16 user nova-compute[85141]: DEBUG nova.compute.manager [req-91be0210-548c-4d12-8900-923dc0041ff9 req-f133af7a-7dda-4468-bcae-e429da00f7d0 service nova] [instance: eef3cc09-054b-4a17-b621-4f3737d5420e] Received event network-vif-unplugged-b0183e60-7f49-44a1-a24c-30db287f2453 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:13:16 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-91be0210-548c-4d12-8900-923dc0041ff9 req-f133af7a-7dda-4468-bcae-e429da00f7d0 service nova] Acquiring lock "eef3cc09-054b-4a17-b621-4f3737d5420e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:13:16 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-91be0210-548c-4d12-8900-923dc0041ff9 req-f133af7a-7dda-4468-bcae-e429da00f7d0 service nova] Lock "eef3cc09-054b-4a17-b621-4f3737d5420e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:13:16 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-91be0210-548c-4d12-8900-923dc0041ff9 req-f133af7a-7dda-4468-bcae-e429da00f7d0 service nova] Lock "eef3cc09-054b-4a17-b621-4f3737d5420e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.007s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:13:16 user nova-compute[85141]: DEBUG nova.compute.manager [req-91be0210-548c-4d12-8900-923dc0041ff9 req-f133af7a-7dda-4468-bcae-e429da00f7d0 service nova] [instance: eef3cc09-054b-4a17-b621-4f3737d5420e] No waiting events found dispatching network-vif-unplugged-b0183e60-7f49-44a1-a24c-30db287f2453 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:13:16 user nova-compute[85141]: DEBUG nova.compute.manager [req-91be0210-548c-4d12-8900-923dc0041ff9 req-f133af7a-7dda-4468-bcae-e429da00f7d0 service nova] [instance: eef3cc09-054b-4a17-b621-4f3737d5420e] Received event network-vif-unplugged-b0183e60-7f49-44a1-a24c-30db287f2453 for instance with task_state deleting. {{(pid=85141) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 10:13:16 user nova-compute[85141]: DEBUG nova.compute.manager [req-91be0210-548c-4d12-8900-923dc0041ff9 req-f133af7a-7dda-4468-bcae-e429da00f7d0 service nova] [instance: eef3cc09-054b-4a17-b621-4f3737d5420e] Received event network-vif-plugged-b0183e60-7f49-44a1-a24c-30db287f2453 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:13:16 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-91be0210-548c-4d12-8900-923dc0041ff9 req-f133af7a-7dda-4468-bcae-e429da00f7d0 service nova] Acquiring lock "eef3cc09-054b-4a17-b621-4f3737d5420e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:13:16 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-91be0210-548c-4d12-8900-923dc0041ff9 req-f133af7a-7dda-4468-bcae-e429da00f7d0 service nova] Lock "eef3cc09-054b-4a17-b621-4f3737d5420e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:13:16 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-91be0210-548c-4d12-8900-923dc0041ff9 req-f133af7a-7dda-4468-bcae-e429da00f7d0 service nova] Lock "eef3cc09-054b-4a17-b621-4f3737d5420e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:13:16 user nova-compute[85141]: DEBUG nova.compute.manager [req-91be0210-548c-4d12-8900-923dc0041ff9 req-f133af7a-7dda-4468-bcae-e429da00f7d0 service nova] [instance: eef3cc09-054b-4a17-b621-4f3737d5420e] No waiting events found dispatching network-vif-plugged-b0183e60-7f49-44a1-a24c-30db287f2453 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:13:16 user nova-compute[85141]: WARNING nova.compute.manager [req-91be0210-548c-4d12-8900-923dc0041ff9 req-f133af7a-7dda-4468-bcae-e429da00f7d0 service nova] [instance: eef3cc09-054b-4a17-b621-4f3737d5420e] Received unexpected event network-vif-plugged-b0183e60-7f49-44a1-a24c-30db287f2453 for instance with vm_state active and task_state deleting.
Nov 16 10:13:16 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.054s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:13:16 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[5220d96e-bd5e-47a3-afbb-88da56d6fb51]: (4, ('1', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:13:16 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-8709ced5-7bbf-4b82-92b1-e1003b2216dc tempest-AttachSCSIVolumeTestJSON-1774410022 tempest-AttachSCSIVolumeTestJSON-1774410022-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=85141) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 10:13:16 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-8709ced5-7bbf-4b82-92b1-e1003b2216dc tempest-AttachSCSIVolumeTestJSON-1774410022 tempest-AttachSCSIVolumeTestJSON-1774410022-project-member] SCSI volumes sdg have been removed. {{(pid=85141) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 10:13:16 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-8709ced5-7bbf-4b82-92b1-e1003b2216dc tempest-AttachSCSIVolumeTestJSON-1774410022 tempest-AttachSCSIVolumeTestJSON-1774410022-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8ca01473-0233-4122-b008-ffa407ca3e70')] {{(pid=85141) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 10:13:16 user nova-compute[85141]: DEBUG nova.compute.manager [req-a0a27c9a-6672-438e-9f28-3719d0de3178 req-9906803c-89c2-4095-95b6-3171561eae2c service nova] [instance: eef3cc09-054b-4a17-b621-4f3737d5420e] Received event network-vif-plugged-21180772-80b3-48e1-90e9-39590611ff08 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:13:16 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-a0a27c9a-6672-438e-9f28-3719d0de3178 req-9906803c-89c2-4095-95b6-3171561eae2c service nova] Acquiring lock "eef3cc09-054b-4a17-b621-4f3737d5420e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:13:16 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-a0a27c9a-6672-438e-9f28-3719d0de3178 req-9906803c-89c2-4095-95b6-3171561eae2c service nova] Lock "eef3cc09-054b-4a17-b621-4f3737d5420e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:13:16 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-a0a27c9a-6672-438e-9f28-3719d0de3178 req-9906803c-89c2-4095-95b6-3171561eae2c service nova] Lock "eef3cc09-054b-4a17-b621-4f3737d5420e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:13:16 user nova-compute[85141]: DEBUG nova.compute.manager [req-a0a27c9a-6672-438e-9f28-3719d0de3178 req-9906803c-89c2-4095-95b6-3171561eae2c service nova] [instance: eef3cc09-054b-4a17-b621-4f3737d5420e] No waiting events found dispatching network-vif-plugged-21180772-80b3-48e1-90e9-39590611ff08 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:13:16 user nova-compute[85141]: WARNING nova.compute.manager [req-a0a27c9a-6672-438e-9f28-3719d0de3178 req-9906803c-89c2-4095-95b6-3171561eae2c service nova] [instance: eef3cc09-054b-4a17-b621-4f3737d5420e] Received unexpected event network-vif-plugged-21180772-80b3-48e1-90e9-39590611ff08 for instance with vm_state active and task_state deleting.
Nov 16 10:13:16 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ca01473-0233-4122-b008-ffa407ca3e70 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:13:16 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ca01473-0233-4122-b008-ffa407ca3e70 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:13:16 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cdb2144-869d-4e7d-a4f8-0fd63cb81aae]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:13:16 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-8709ced5-7bbf-4b82-92b1-e1003b2216dc tempest-AttachSCSIVolumeTestJSON-1774410022 tempest-AttachSCSIVolumeTestJSON-1774410022-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:13:16 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ca01473-0233-4122-b008-ffa407ca3e70 -p 172.16.0.220:3260 --logout {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:13:16 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ca01473-0233-4122-b008-ffa407ca3e70 -p 172.16.0.220:3260 --logout" returned: 0 in 0.077s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:13:16 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[09a635fe-aafb-4fb2-bd6f-7f0c6c604472]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:8ca01473-0233-4122-b008-ffa407ca3e70, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:8ca01473-0233-4122-b008-ffa407ca3e70, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:13:16 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-8709ced5-7bbf-4b82-92b1-e1003b2216dc tempest-AttachSCSIVolumeTestJSON-1774410022 tempest-AttachSCSIVolumeTestJSON-1774410022-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:8ca01473-0233-4122-b008-ffa407ca3e70, portal: 172.16.0.220,3260]
Nov 16 10:13:16 user nova-compute[85141]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:8ca01473-0233-4122-b008-ffa407ca3e70, portal: 172.16.0.220,3260] successful.
Nov 16 10:13:16 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:13:16 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ca01473-0233-4122-b008-ffa407ca3e70 -p 172.16.0.220:3260 --op delete {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:13:16 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ca01473-0233-4122-b008-ffa407ca3e70 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.037s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:13:16 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[d31e3e14-eef7-4420-8840-53a8a5b224c5]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:13:16 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-8709ced5-7bbf-4b82-92b1-e1003b2216dc tempest-AttachSCSIVolumeTestJSON-1774410022 tempest-AttachSCSIVolumeTestJSON-1774410022-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:13:16 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-8709ced5-7bbf-4b82-92b1-e1003b2216dc tempest-AttachSCSIVolumeTestJSON-1774410022 tempest-AttachSCSIVolumeTestJSON-1774410022-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.377s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 10:13:16 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-8709ced5-7bbf-4b82-92b1-e1003b2216dc tempest-AttachSCSIVolumeTestJSON-1774410022 tempest-AttachSCSIVolumeTestJSON-1774410022-project-member] <== disconnect_volume: return (1531ms) None {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 10:13:16 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8709ced5-7bbf-4b82-92b1-e1003b2216dc tempest-AttachSCSIVolumeTestJSON-1774410022 tempest-AttachSCSIVolumeTestJSON-1774410022-project-member] [instance: ff964caf-b473-47bc-89d2-f7189264721c] Disconnected iSCSI Volume {{(pid=85141) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 10:13:16 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-a33076d6-5841-4a55-8d9a-ab2ffc688743 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.935s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 10:13:16 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:13:16 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.030s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:13:16 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[f91c3e98-0ca7-4e3d-9d86-2ddeb707c620]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ba7ca2a3-5f1e-4544-852f-d57100b608e3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4973f768-f126-41d6-b534-458d6c49f9b3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:eff563f0-92d3-47a1-addc-e3eaa6828d59\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:27fcde20-e019-4cf0-ad90-6c8100f4a8d2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7e233047-dda3-4f2e-803c-7b69a57ac656\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:eb0e3ad6-04d7-4405-b4ae-0440b2a396ce\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b4df10d9-a60c-45ed-981d-96f704534fb8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:42c041ec-fa39-4035-b82b-867caf3565df\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:13:16 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-a33076d6-5841-4a55-8d9a-ab2ffc688743 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 10:13:16 user nova-compute[85141]: No targets found.
Nov 16 10:13:16 user nova-compute[85141]: iSNS:
Nov 16 10:13:16 user nova-compute[85141]: No targets found.
Nov 16 10:13:16 user nova-compute[85141]: STATIC:
Nov 16 10:13:16 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:ba7ca2a3-5f1e-4544-852f-d57100b608e3
Nov 16 10:13:16 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:13:16 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:13:16 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:4973f768-f126-41d6-b534-458d6c49f9b3
Nov 16 10:13:16 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:13:16 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:13:16 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:eff563f0-92d3-47a1-addc-e3eaa6828d59
Nov 16 10:13:16 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:13:16 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:13:16 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:27fcde20-e019-4cf0-ad90-6c8100f4a8d2
Nov 16 10:13:16 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:13:16 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:13:16 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:7e233047-dda3-4f2e-803c-7b69a57ac656
Nov 16 10:13:16 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:13:16 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:13:16 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:eb0e3ad6-04d7-4405-b4ae-0440b2a396ce
Nov 16 10:13:16 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:13:16 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:13:16 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:b4df10d9-a60c-45ed-981d-96f704534fb8
Nov 16 10:13:16 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:13:16 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:13:16 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:42c041ec-fa39-4035-b82b-867caf3565df
Nov 16 10:13:16 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:13:16 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:13:16 user nova-compute[85141]: FIRMWARE:
Nov 16 10:13:16 user nova-compute[85141]: No targets found.
Nov 16 10:13:16 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:13:16 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-a33076d6-5841-4a55-8d9a-ab2ffc688743 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 10:13:16 user nova-compute[85141]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 10:13:16 user nova-compute[85141]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=85141) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 10:13:16 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-a33076d6-5841-4a55-8d9a-ab2ffc688743 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b4df10d9-a60c-45ed-981d-96f704534fb8', 0)] {{(pid=85141) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 10:13:16 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:13:16 user nova-compute[85141]: DEBUG nova.virt.libvirt.guest [None req-2e3c140e-c9f9-46ce-a537-0787e8739533 tempest-TestVolumeSwap-1037451778 tempest-TestVolumeSwap-1037451778-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=85141) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 10:13:16 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.027s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:13:16 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea00c556-c84e-4aed-8a7a-24663bdb6ba0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:27fcde20-e019-4cf0-ad90-6c8100f4a8d2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:42c041ec-fa39-4035-b82b-867caf3565df\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4973f768-f126-41d6-b534-458d6c49f9b3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7e233047-dda3-4f2e-803c-7b69a57ac656\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b4df10d9-a60c-45ed-981d-96f704534fb8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ba7ca2a3-5f1e-4544-852f-d57100b608e3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eb0e3ad6-04d7-4405-b4ae-0440b2a396ce\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eff563f0-92d3-47a1-addc-e3eaa6828d59\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:13:16 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:13:16 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:13:16 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a2e0fa5-1427-4c36-9673-7a3b512a3b2e]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eff563f0-92d3-47a1-addc-e3eaa6828d59 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb0e3ad6-04d7-4405-b4ae-0440b2a396ce (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba7ca2a3-5f1e-4544-852f-d57100b608e3 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42c041ec-fa39-4035-b82b-867caf3565df (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e233047-dda3-4f2e-803c-7b69a57ac656 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4df10d9-a60c-45ed-981d-96f704534fb8 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4973f768-f126-41d6-b534-458d6c49f9b3 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fcde20-e019-4cf0-ad90-6c8100f4a8d2 (non-flash)\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:13:16 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-a33076d6-5841-4a55-8d9a-ab2ffc688743 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eff563f0-92d3-47a1-addc-e3eaa6828d59 (non-flash)
Nov 16 10:13:16 user nova-compute[85141]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb0e3ad6-04d7-4405-b4ae-0440b2a396ce (non-flash)
Nov 16 10:13:16 user nova-compute[85141]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba7ca2a3-5f1e-4544-852f-d57100b608e3 (non-flash)
Nov 16 10:13:16 user nova-compute[85141]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42c041ec-fa39-4035-b82b-867caf3565df (non-flash)
Nov 16 10:13:16 user nova-compute[85141]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e233047-dda3-4f2e-803c-7b69a57ac656 (non-flash)
Nov 16 10:13:16 user nova-compute[85141]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4df10d9-a60c-45ed-981d-96f704534fb8 (non-flash)
Nov 16 10:13:16 user nova-compute[85141]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4973f768-f126-41d6-b534-458d6c49f9b3 (non-flash)
Nov 16 10:13:16 user nova-compute[85141]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fcde20-e019-4cf0-ad90-6c8100f4a8d2 (non-flash)
Nov 16 10:13:16 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:13:16 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-a33076d6-5841-4a55-8d9a-ab2ffc688743 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eff563f0-92d3-47a1-addc-e3eaa6828d59 (non-flash)
Nov 16 10:13:16 user nova-compute[85141]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb0e3ad6-04d7-4405-b4ae-0440b2a396ce (non-flash)
Nov 16 10:13:16 user nova-compute[85141]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba7ca2a3-5f1e-4544-852f-d57100b608e3 (non-flash)
Nov 16 10:13:16 user nova-compute[85141]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42c041ec-fa39-4035-b82b-867caf3565df (non-flash)
Nov 16 10:13:16 user nova-compute[85141]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e233047-dda3-4f2e-803c-7b69a57ac656 (non-flash)
Nov 16 10:13:16 user nova-compute[85141]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4df10d9-a60c-45ed-981d-96f704534fb8 (non-flash)
Nov 16 10:13:16 user nova-compute[85141]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4973f768-f126-41d6-b534-458d6c49f9b3 (non-flash)
Nov 16 10:13:16 user nova-compute[85141]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fcde20-e019-4cf0-ad90-6c8100f4a8d2 (non-flash)
Nov 16 10:13:16 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 10:13:16 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-a33076d6-5841-4a55-8d9a-ab2ffc688743 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f51a0a5c1f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b4df10d9-a60c-45ed-981d-96f704534fb8'): ({'sdc'}, set())}) {{(pid=85141) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 10:13:16 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-a33076d6-5841-4a55-8d9a-ab2ffc688743 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] Removing single pathed devices sdc {{(pid=85141) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 10:13:16 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:13:16 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:13:16 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[978508a3-9f78-43b4-8fe3-c0e01813bd2a]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:13:16 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:13:16 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:13:16 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[e53cc4cf-797b-4fe6-a03c-1917d4e724bb]: (4, ('ok\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:13:16 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-a33076d6-5841-4a55-8d9a-ab2ffc688743 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] Flushing IO for device /dev/sdc {{(pid=85141) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 10:13:16 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:13:16 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:13:16 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6c68247-7d80-442c-bcc7-953d92e76e92]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:13:16 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-a33076d6-5841-4a55-8d9a-ab2ffc688743 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=85141) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 10:13:16 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:13:16 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.051s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:13:16 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cc61972-20d4-4ac1-9a78-0568d9c22f2f]: (4, ('1', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:13:16 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-a33076d6-5841-4a55-8d9a-ab2ffc688743 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=85141) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 10:13:16 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-a33076d6-5841-4a55-8d9a-ab2ffc688743 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] SCSI volumes sdc have been removed. {{(pid=85141) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 10:13:16 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-a33076d6-5841-4a55-8d9a-ab2ffc688743 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b4df10d9-a60c-45ed-981d-96f704534fb8')] {{(pid=85141) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 10:13:16 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4df10d9-a60c-45ed-981d-96f704534fb8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:13:16 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4df10d9-a60c-45ed-981d-96f704534fb8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:13:16 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cbe62d2-fc8d-47a8-b271-6c14235bab7d]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:13:16 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-a33076d6-5841-4a55-8d9a-ab2ffc688743 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:13:16 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4df10d9-a60c-45ed-981d-96f704534fb8 -p 172.16.0.220:3260 --logout {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:13:16 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4df10d9-a60c-45ed-981d-96f704534fb8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.083s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:13:16 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[60b62261-895d-47ee-b274-99521d193488]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:b4df10d9-a60c-45ed-981d-96f704534fb8, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:b4df10d9-a60c-45ed-981d-96f704534fb8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:13:16 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-a33076d6-5841-4a55-8d9a-ab2ffc688743 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:b4df10d9-a60c-45ed-981d-96f704534fb8, portal: 172.16.0.220,3260]
Nov 16 10:13:16 user nova-compute[85141]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:b4df10d9-a60c-45ed-981d-96f704534fb8, portal: 172.16.0.220,3260] successful.
Nov 16 10:13:16 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:13:16 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4df10d9-a60c-45ed-981d-96f704534fb8 -p 172.16.0.220:3260 --op delete {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:13:17 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4df10d9-a60c-45ed-981d-96f704534fb8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.038s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:13:17 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[81c89e44-ae1f-4fdc-b5b8-958f53bc0291]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:13:17 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-a33076d6-5841-4a55-8d9a-ab2ffc688743 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:13:17 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-a33076d6-5841-4a55-8d9a-ab2ffc688743 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.398s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 10:13:17 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-a33076d6-5841-4a55-8d9a-ab2ffc688743 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] <== disconnect_volume: return (1333ms) None {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 10:13:17 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a33076d6-5841-4a55-8d9a-ab2ffc688743 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] [instance: eef3cc09-054b-4a17-b621-4f3737d5420e] Disconnected iSCSI Volume {{(pid=85141) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 10:13:17 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a33076d6-5841-4a55-8d9a-ab2ffc688743 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] [instance: eef3cc09-054b-4a17-b621-4f3737d5420e] calling os-brick to detach iSCSI Volume {{(pid=85141) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 10:13:17 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-a33076d6-5841-4a55-8d9a-ab2ffc688743 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51806b6080>, {'target_iqn': 'iqn.2010-10.org.openstack:4973f768-f126-41d6-b534-458d6c49f9b3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JxPrVHFZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 10:13:17 user nova-compute[85141]: WARNING os_brick.initiator.connectors.base [None req-a33076d6-5841-4a55-8d9a-ab2ffc688743 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 10:13:17 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-a33076d6-5841-4a55-8d9a-ab2ffc688743 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 10:13:17 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-a33076d6-5841-4a55-8d9a-ab2ffc688743 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 10:13:17 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:13:17 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:13:17 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[db3659a1-838d-4e6a-b73f-2cfe7bfc79f8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ba7ca2a3-5f1e-4544-852f-d57100b608e3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4973f768-f126-41d6-b534-458d6c49f9b3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:eff563f0-92d3-47a1-addc-e3eaa6828d59\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:27fcde20-e019-4cf0-ad90-6c8100f4a8d2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7e233047-dda3-4f2e-803c-7b69a57ac656\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:eb0e3ad6-04d7-4405-b4ae-0440b2a396ce\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:42c041ec-fa39-4035-b82b-867caf3565df\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:13:17 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-a33076d6-5841-4a55-8d9a-ab2ffc688743 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 10:13:17 user nova-compute[85141]: No targets found.
Nov 16 10:13:17 user nova-compute[85141]: iSNS:
Nov 16 10:13:17 user nova-compute[85141]: No targets found.
Nov 16 10:13:17 user nova-compute[85141]: STATIC:
Nov 16 10:13:17 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:ba7ca2a3-5f1e-4544-852f-d57100b608e3
Nov 16 10:13:17 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:13:17 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:13:17 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:4973f768-f126-41d6-b534-458d6c49f9b3
Nov 16 10:13:17 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:13:17 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:13:17 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:eff563f0-92d3-47a1-addc-e3eaa6828d59
Nov 16 10:13:17 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:13:17 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:13:17 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:27fcde20-e019-4cf0-ad90-6c8100f4a8d2
Nov 16 10:13:17 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:13:17 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:13:17 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:7e233047-dda3-4f2e-803c-7b69a57ac656
Nov 16 10:13:17 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:13:17 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:13:17 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:eb0e3ad6-04d7-4405-b4ae-0440b2a396ce
Nov 16 10:13:17 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:13:17 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:13:17 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:42c041ec-fa39-4035-b82b-867caf3565df
Nov 16 10:13:17 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:13:17 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:13:17 user nova-compute[85141]: FIRMWARE:
Nov 16 10:13:17 user nova-compute[85141]: No targets found.
Nov 16 10:13:17 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:13:17 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-a33076d6-5841-4a55-8d9a-ab2ffc688743 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 10:13:17 user nova-compute[85141]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 10:13:17 user nova-compute[85141]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=85141) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 10:13:17 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-a33076d6-5841-4a55-8d9a-ab2ffc688743 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4973f768-f126-41d6-b534-458d6c49f9b3', 0)] {{(pid=85141) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 10:13:17 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:13:17 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:13:17 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d4198de-4ebf-420c-bfb1-fb020b996b9e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:27fcde20-e019-4cf0-ad90-6c8100f4a8d2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:42c041ec-fa39-4035-b82b-867caf3565df\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4973f768-f126-41d6-b534-458d6c49f9b3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7e233047-dda3-4f2e-803c-7b69a57ac656\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ba7ca2a3-5f1e-4544-852f-d57100b608e3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eb0e3ad6-04d7-4405-b4ae-0440b2a396ce\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eff563f0-92d3-47a1-addc-e3eaa6828d59\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:13:17 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:13:17 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:13:17 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3934558-6099-49b6-a3bc-3b6a247331c8]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eff563f0-92d3-47a1-addc-e3eaa6828d59 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb0e3ad6-04d7-4405-b4ae-0440b2a396ce (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba7ca2a3-5f1e-4544-852f-d57100b608e3 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42c041ec-fa39-4035-b82b-867caf3565df (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e233047-dda3-4f2e-803c-7b69a57ac656 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4973f768-f126-41d6-b534-458d6c49f9b3 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fcde20-e019-4cf0-ad90-6c8100f4a8d2 (non-flash)\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:13:17 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-a33076d6-5841-4a55-8d9a-ab2ffc688743 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eff563f0-92d3-47a1-addc-e3eaa6828d59 (non-flash)
Nov 16 10:13:17 user nova-compute[85141]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb0e3ad6-04d7-4405-b4ae-0440b2a396ce (non-flash)
Nov 16 10:13:17 user nova-compute[85141]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba7ca2a3-5f1e-4544-852f-d57100b608e3 (non-flash)
Nov 16 10:13:17 user nova-compute[85141]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42c041ec-fa39-4035-b82b-867caf3565df (non-flash)
Nov 16 10:13:17 user nova-compute[85141]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e233047-dda3-4f2e-803c-7b69a57ac656 (non-flash)
Nov 16 10:13:17 user nova-compute[85141]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4973f768-f126-41d6-b534-458d6c49f9b3 (non-flash)
Nov 16 10:13:17 user nova-compute[85141]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fcde20-e019-4cf0-ad90-6c8100f4a8d2 (non-flash)
Nov 16 10:13:17 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:13:17 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-a33076d6-5841-4a55-8d9a-ab2ffc688743 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eff563f0-92d3-47a1-addc-e3eaa6828d59 (non-flash)
Nov 16 10:13:17 user nova-compute[85141]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb0e3ad6-04d7-4405-b4ae-0440b2a396ce (non-flash)
Nov 16 10:13:17 user nova-compute[85141]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba7ca2a3-5f1e-4544-852f-d57100b608e3 (non-flash)
Nov 16 10:13:17 user nova-compute[85141]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42c041ec-fa39-4035-b82b-867caf3565df (non-flash)
Nov 16 10:13:17 user nova-compute[85141]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e233047-dda3-4f2e-803c-7b69a57ac656 (non-flash)
Nov 16 10:13:17 user nova-compute[85141]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4973f768-f126-41d6-b534-458d6c49f9b3 (non-flash)
Nov 16 10:13:17 user nova-compute[85141]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fcde20-e019-4cf0-ad90-6c8100f4a8d2 (non-flash)
Nov 16 10:13:17 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 10:13:17 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-a33076d6-5841-4a55-8d9a-ab2ffc688743 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f51a0a5c1f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4973f768-f126-41d6-b534-458d6c49f9b3'): ({'sdd'}, set())}) {{(pid=85141) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 10:13:17 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-a33076d6-5841-4a55-8d9a-ab2ffc688743 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] Removing single pathed devices sdd {{(pid=85141) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 10:13:17 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:13:17 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:13:17 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b944ab7-42a1-4388-820f-1c74901d9d04]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:13:17 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:13:17 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:13:17 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:13:17 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cd5a794-beb6-4dd4-b1c8-c0e73f18dd0c]: (4, ('ok\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:13:17 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-a33076d6-5841-4a55-8d9a-ab2ffc688743 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] Flushing IO for device /dev/sdd {{(pid=85141) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 10:13:17 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:13:17 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:13:17 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8af6c16-ec44-4335-a7e6-3763f08a7358]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:13:17 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-a33076d6-5841-4a55-8d9a-ab2ffc688743 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=85141) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 10:13:17 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:13:17 user nova-compute[85141]: DEBUG nova.virt.libvirt.guest [None req-2e3c140e-c9f9-46ce-a537-0787e8739533 tempest-TestVolumeSwap-1037451778 tempest-TestVolumeSwap-1037451778-project-admin] COPY block job progress, current cursor: 60817408 final cursor: 1073741824 {{(pid=85141) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 10:13:17 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.041s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:13:17 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e7d6bca-b168-4e1d-9439-8ed58c9d16e6]: (4, ('1', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:13:17 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-a33076d6-5841-4a55-8d9a-ab2ffc688743 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=85141) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 10:13:17 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-a33076d6-5841-4a55-8d9a-ab2ffc688743 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] SCSI volumes sdd have been removed. {{(pid=85141) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 10:13:17 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-a33076d6-5841-4a55-8d9a-ab2ffc688743 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4973f768-f126-41d6-b534-458d6c49f9b3')] {{(pid=85141) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 10:13:17 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4973f768-f126-41d6-b534-458d6c49f9b3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:13:17 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4973f768-f126-41d6-b534-458d6c49f9b3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:13:17 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9398b42-c56d-4c14-82a5-d495ae4537f9]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:13:17 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-a33076d6-5841-4a55-8d9a-ab2ffc688743 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:13:17 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4973f768-f126-41d6-b534-458d6c49f9b3 -p 172.16.0.220:3260 --logout {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:13:17 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4973f768-f126-41d6-b534-458d6c49f9b3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:13:17 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7d2cd46-c0a4-457c-b4f2-e2c62d4fa4bb]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:4973f768-f126-41d6-b534-458d6c49f9b3, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:4973f768-f126-41d6-b534-458d6c49f9b3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:13:17 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-a33076d6-5841-4a55-8d9a-ab2ffc688743 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:4973f768-f126-41d6-b534-458d6c49f9b3, portal: 172.16.0.220,3260]
Nov 16 10:13:17 user nova-compute[85141]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:4973f768-f126-41d6-b534-458d6c49f9b3, portal: 172.16.0.220,3260] successful.
Nov 16 10:13:17 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:13:17 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4973f768-f126-41d6-b534-458d6c49f9b3 -p 172.16.0.220:3260 --op delete {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:13:17 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4973f768-f126-41d6-b534-458d6c49f9b3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:13:17 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5f9fb34-fced-4a67-b70f-00384e4e198f]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:13:17 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-a33076d6-5841-4a55-8d9a-ab2ffc688743 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:13:17 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-a33076d6-5841-4a55-8d9a-ab2ffc688743 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.318s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 10:13:17 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-a33076d6-5841-4a55-8d9a-ab2ffc688743 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] <== disconnect_volume: return (319ms) None {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 10:13:17 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a33076d6-5841-4a55-8d9a-ab2ffc688743 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] [instance: eef3cc09-054b-4a17-b621-4f3737d5420e] Disconnected iSCSI Volume {{(pid=85141) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 10:13:17 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a33076d6-5841-4a55-8d9a-ab2ffc688743 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] [instance: eef3cc09-054b-4a17-b621-4f3737d5420e] calling os-brick to detach iSCSI Volume {{(pid=85141) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 10:13:17 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-a33076d6-5841-4a55-8d9a-ab2ffc688743 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51806b6080>, {'target_iqn': 'iqn.2010-10.org.openstack:27fcde20-e019-4cf0-ad90-6c8100f4a8d2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RQOFZdBu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 10:13:17 user nova-compute[85141]: WARNING os_brick.initiator.connectors.base [None req-a33076d6-5841-4a55-8d9a-ab2ffc688743 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 10:13:17 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-a33076d6-5841-4a55-8d9a-ab2ffc688743 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 10:13:17 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-a33076d6-5841-4a55-8d9a-ab2ffc688743 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 10:13:17 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:13:17 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:13:17 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c469947-b9f9-4ad0-b586-1008071d5407]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ba7ca2a3-5f1e-4544-852f-d57100b608e3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:eff563f0-92d3-47a1-addc-e3eaa6828d59\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:27fcde20-e019-4cf0-ad90-6c8100f4a8d2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7e233047-dda3-4f2e-803c-7b69a57ac656\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:eb0e3ad6-04d7-4405-b4ae-0440b2a396ce\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:42c041ec-fa39-4035-b82b-867caf3565df\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:13:17 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-a33076d6-5841-4a55-8d9a-ab2ffc688743 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 10:13:17 user nova-compute[85141]: No targets found.
Nov 16 10:13:17 user nova-compute[85141]: iSNS:
Nov 16 10:13:17 user nova-compute[85141]: No targets found.
Nov 16 10:13:17 user nova-compute[85141]: STATIC:
Nov 16 10:13:17 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:ba7ca2a3-5f1e-4544-852f-d57100b608e3
Nov 16 10:13:17 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:13:17 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:13:17 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:eff563f0-92d3-47a1-addc-e3eaa6828d59
Nov 16 10:13:17 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:13:17 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:13:17 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:27fcde20-e019-4cf0-ad90-6c8100f4a8d2
Nov 16 10:13:17 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:13:17 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:13:17 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:7e233047-dda3-4f2e-803c-7b69a57ac656
Nov 16 10:13:17 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:13:17 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:13:17 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:eb0e3ad6-04d7-4405-b4ae-0440b2a396ce
Nov 16 10:13:17 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:13:17 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:13:17 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:42c041ec-fa39-4035-b82b-867caf3565df
Nov 16 10:13:17 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:13:17 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:13:17 user nova-compute[85141]: FIRMWARE:
Nov 16 10:13:17 user nova-compute[85141]: No targets found.
Nov 16 10:13:17 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:13:17 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-a33076d6-5841-4a55-8d9a-ab2ffc688743 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 10:13:17 user nova-compute[85141]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 10:13:17 user nova-compute[85141]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=85141) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 10:13:17 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-a33076d6-5841-4a55-8d9a-ab2ffc688743 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:27fcde20-e019-4cf0-ad90-6c8100f4a8d2', 0)] {{(pid=85141) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 10:13:17 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:13:17 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:13:17 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9e4f07f-5e73-4466-8131-975c7f3f333d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:27fcde20-e019-4cf0-ad90-6c8100f4a8d2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:42c041ec-fa39-4035-b82b-867caf3565df\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7e233047-dda3-4f2e-803c-7b69a57ac656\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ba7ca2a3-5f1e-4544-852f-d57100b608e3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eb0e3ad6-04d7-4405-b4ae-0440b2a396ce\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eff563f0-92d3-47a1-addc-e3eaa6828d59\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:13:17 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:13:17 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:13:17 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[78194834-2def-4ff8-a635-55e9c11de3c6]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eff563f0-92d3-47a1-addc-e3eaa6828d59 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb0e3ad6-04d7-4405-b4ae-0440b2a396ce (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba7ca2a3-5f1e-4544-852f-d57100b608e3 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42c041ec-fa39-4035-b82b-867caf3565df (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e233047-dda3-4f2e-803c-7b69a57ac656 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fcde20-e019-4cf0-ad90-6c8100f4a8d2 (non-flash)\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:13:17 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-a33076d6-5841-4a55-8d9a-ab2ffc688743 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eff563f0-92d3-47a1-addc-e3eaa6828d59 (non-flash)
Nov 16 10:13:17 user nova-compute[85141]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb0e3ad6-04d7-4405-b4ae-0440b2a396ce (non-flash)
Nov 16 10:13:17 user nova-compute[85141]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba7ca2a3-5f1e-4544-852f-d57100b608e3 (non-flash)
Nov 16 10:13:17 user nova-compute[85141]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42c041ec-fa39-4035-b82b-867caf3565df (non-flash)
Nov 16 10:13:17 user nova-compute[85141]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e233047-dda3-4f2e-803c-7b69a57ac656 (non-flash)
Nov 16 10:13:17 user nova-compute[85141]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fcde20-e019-4cf0-ad90-6c8100f4a8d2 (non-flash)
Nov 16 10:13:17 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:13:17 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-a33076d6-5841-4a55-8d9a-ab2ffc688743 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eff563f0-92d3-47a1-addc-e3eaa6828d59 (non-flash)
Nov 16 10:13:17 user nova-compute[85141]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb0e3ad6-04d7-4405-b4ae-0440b2a396ce (non-flash)
Nov 16 10:13:17 user nova-compute[85141]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba7ca2a3-5f1e-4544-852f-d57100b608e3 (non-flash)
Nov 16 10:13:17 user nova-compute[85141]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42c041ec-fa39-4035-b82b-867caf3565df (non-flash)
Nov 16 10:13:17 user nova-compute[85141]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e233047-dda3-4f2e-803c-7b69a57ac656 (non-flash)
Nov 16 10:13:17 user nova-compute[85141]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27fcde20-e019-4cf0-ad90-6c8100f4a8d2 (non-flash)
Nov 16 10:13:17 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 10:13:17 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-a33076d6-5841-4a55-8d9a-ab2ffc688743 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f51a0a5c1f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:27fcde20-e019-4cf0-ad90-6c8100f4a8d2'): ({'sde'}, set())}) {{(pid=85141) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 10:13:17 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-a33076d6-5841-4a55-8d9a-ab2ffc688743 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] Removing single pathed devices sde {{(pid=85141) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 10:13:17 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:13:17 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:13:17 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[b56de79b-9539-4d5a-b104-eaff74ff1900]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:13:17 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:13:17 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:13:17 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[e631e7aa-fc9d-4ae8-92be-e9f814154395]: (4, ('ok\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:13:17 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-a33076d6-5841-4a55-8d9a-ab2ffc688743 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] Flushing IO for device /dev/sde {{(pid=85141) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 10:13:17 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:13:17 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.012s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:13:17 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ff165b1-b492-41dc-af0d-2230eadfd44e]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:13:17 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-a33076d6-5841-4a55-8d9a-ab2ffc688743 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=85141) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 10:13:17 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:13:17 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.042s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:13:17 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3ecc917-f699-42d2-973d-defb109b317c]: (4, ('1', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:13:17 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-a33076d6-5841-4a55-8d9a-ab2ffc688743 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=85141) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 10:13:17 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-a33076d6-5841-4a55-8d9a-ab2ffc688743 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] SCSI volumes sde have been removed. {{(pid=85141) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 10:13:17 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-a33076d6-5841-4a55-8d9a-ab2ffc688743 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:27fcde20-e019-4cf0-ad90-6c8100f4a8d2')] {{(pid=85141) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 10:13:17 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27fcde20-e019-4cf0-ad90-6c8100f4a8d2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:13:17 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27fcde20-e019-4cf0-ad90-6c8100f4a8d2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:13:17 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1b8db4d-468b-4846-990b-dc80b382ce44]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:13:17 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-a33076d6-5841-4a55-8d9a-ab2ffc688743 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:13:17 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27fcde20-e019-4cf0-ad90-6c8100f4a8d2 -p 172.16.0.220:3260 --logout {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:13:17 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27fcde20-e019-4cf0-ad90-6c8100f4a8d2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:13:17 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[26c39cc5-f581-46b0-9c76-7615d4d4e310]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:27fcde20-e019-4cf0-ad90-6c8100f4a8d2, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:27fcde20-e019-4cf0-ad90-6c8100f4a8d2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:13:17 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-a33076d6-5841-4a55-8d9a-ab2ffc688743 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:27fcde20-e019-4cf0-ad90-6c8100f4a8d2, portal: 172.16.0.220,3260]
Nov 16 10:13:17 user nova-compute[85141]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:27fcde20-e019-4cf0-ad90-6c8100f4a8d2, portal: 172.16.0.220,3260] successful.
Nov 16 10:13:17 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:13:17 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27fcde20-e019-4cf0-ad90-6c8100f4a8d2 -p 172.16.0.220:3260 --op delete {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:13:17 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27fcde20-e019-4cf0-ad90-6c8100f4a8d2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:13:17 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[791d85ce-1c9a-40a9-9638-cb9ffc092a14]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:13:17 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-a33076d6-5841-4a55-8d9a-ab2ffc688743 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:13:17 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-a33076d6-5841-4a55-8d9a-ab2ffc688743 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.320s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 10:13:17 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-a33076d6-5841-4a55-8d9a-ab2ffc688743 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] <== disconnect_volume: return (322ms) None {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 10:13:17 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a33076d6-5841-4a55-8d9a-ab2ffc688743 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] [instance: eef3cc09-054b-4a17-b621-4f3737d5420e] Disconnected iSCSI Volume {{(pid=85141) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 10:13:17 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-a33076d6-5841-4a55-8d9a-ab2ffc688743 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] [instance: eef3cc09-054b-4a17-b621-4f3737d5420e] Deleting instance files /opt/stack/data/nova/instances/eef3cc09-054b-4a17-b621-4f3737d5420e_del
Nov 16 10:13:17 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-a33076d6-5841-4a55-8d9a-ab2ffc688743 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] [instance: eef3cc09-054b-4a17-b621-4f3737d5420e] Deletion of /opt/stack/data/nova/instances/eef3cc09-054b-4a17-b621-4f3737d5420e_del complete
Nov 16 10:13:17 user nova-compute[85141]: DEBUG nova.virt.libvirt.guest [None req-2e3c140e-c9f9-46ce-a537-0787e8739533 tempest-TestVolumeSwap-1037451778 tempest-TestVolumeSwap-1037451778-project-admin] COPY block job progress, current cursor: 60817408 final cursor: 1073741824 {{(pid=85141) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 10:13:17 user nova-compute[85141]: INFO nova.compute.manager [None req-a33076d6-5841-4a55-8d9a-ab2ffc688743 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] [instance: eef3cc09-054b-4a17-b621-4f3737d5420e] Took 4.39 seconds to destroy the instance on the hypervisor.
Nov 16 10:13:17 user nova-compute[85141]: DEBUG oslo.service.loopingcall [None req-a33076d6-5841-4a55-8d9a-ab2ffc688743 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=85141) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 10:13:17 user nova-compute[85141]: DEBUG nova.compute.manager [-] [instance: eef3cc09-054b-4a17-b621-4f3737d5420e] Deallocating network for instance {{(pid=85141) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 10:13:17 user nova-compute[85141]: DEBUG nova.network.neutron [-] [instance: eef3cc09-054b-4a17-b621-4f3737d5420e] deallocate_for_instance() {{(pid=85141) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 10:13:17 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-5418d3a2-d108-4227-8569-605e55a79685 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 0ca61bd2-268e-4c49-ba04-a5cb39143a9b is timed out.
Nov 16 10:13:17 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-5418d3a2-d108-4227-8569-605e55a79685 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] Successfully detached device vdb from instance 0ca61bd2-268e-4c49-ba04-a5cb39143a9b from the live domain config.
Nov 16 10:13:17 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5418d3a2-d108-4227-8569-605e55a79685 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] [instance: 0ca61bd2-268e-4c49-ba04-a5cb39143a9b] calling os-brick to detach iSCSI Volume {{(pid=85141) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 10:13:17 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-5418d3a2-d108-4227-8569-605e55a79685 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51806b6080>, {'target_iqn': 'iqn.2010-10.org.openstack:eff563f0-92d3-47a1-addc-e3eaa6828d59', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bGWrKVEk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 10:13:17 user nova-compute[85141]: WARNING os_brick.initiator.connectors.base [None req-5418d3a2-d108-4227-8569-605e55a79685 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 10:13:17 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-5418d3a2-d108-4227-8569-605e55a79685 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 10:13:17 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-5418d3a2-d108-4227-8569-605e55a79685 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 10:13:17 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:13:17 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:13:17 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b965031-ed36-4a13-8e3c-8c23e4607678]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ba7ca2a3-5f1e-4544-852f-d57100b608e3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:eff563f0-92d3-47a1-addc-e3eaa6828d59\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7e233047-dda3-4f2e-803c-7b69a57ac656\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:eb0e3ad6-04d7-4405-b4ae-0440b2a396ce\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:42c041ec-fa39-4035-b82b-867caf3565df\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:13:17 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-5418d3a2-d108-4227-8569-605e55a79685 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 10:13:17 user nova-compute[85141]: No targets found.
Nov 16 10:13:17 user nova-compute[85141]: iSNS:
Nov 16 10:13:17 user nova-compute[85141]: No targets found.
Nov 16 10:13:17 user nova-compute[85141]: STATIC:
Nov 16 10:13:17 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:ba7ca2a3-5f1e-4544-852f-d57100b608e3
Nov 16 10:13:17 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:13:17 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:13:17 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:eff563f0-92d3-47a1-addc-e3eaa6828d59
Nov 16 10:13:17 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:13:17 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:13:17 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:7e233047-dda3-4f2e-803c-7b69a57ac656
Nov 16 10:13:17 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:13:17 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:13:17 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:eb0e3ad6-04d7-4405-b4ae-0440b2a396ce
Nov 16 10:13:17 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:13:17 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:13:17 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:42c041ec-fa39-4035-b82b-867caf3565df
Nov 16 10:13:17 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:13:17 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:13:17 user nova-compute[85141]: FIRMWARE:
Nov 16 10:13:17 user nova-compute[85141]: No targets found.
Nov 16 10:13:17 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:13:17 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-5418d3a2-d108-4227-8569-605e55a79685 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 10:13:17 user nova-compute[85141]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 10:13:17 user nova-compute[85141]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=85141) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 10:13:17 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-5418d3a2-d108-4227-8569-605e55a79685 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eff563f0-92d3-47a1-addc-e3eaa6828d59', 0)] {{(pid=85141) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 10:13:17 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:13:17 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:13:17 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5f8ce06-12d6-4e66-bc9b-7da717f44334]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:42c041ec-fa39-4035-b82b-867caf3565df\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7e233047-dda3-4f2e-803c-7b69a57ac656\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ba7ca2a3-5f1e-4544-852f-d57100b608e3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eb0e3ad6-04d7-4405-b4ae-0440b2a396ce\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eff563f0-92d3-47a1-addc-e3eaa6828d59\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:13:17 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:13:18 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:13:18 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0de2750-edc3-4434-9c5d-03420b371b1c]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eff563f0-92d3-47a1-addc-e3eaa6828d59 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb0e3ad6-04d7-4405-b4ae-0440b2a396ce (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba7ca2a3-5f1e-4544-852f-d57100b608e3 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42c041ec-fa39-4035-b82b-867caf3565df (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e233047-dda3-4f2e-803c-7b69a57ac656 (non-flash)\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:13:18 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-5418d3a2-d108-4227-8569-605e55a79685 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eff563f0-92d3-47a1-addc-e3eaa6828d59 (non-flash)
Nov 16 10:13:18 user nova-compute[85141]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb0e3ad6-04d7-4405-b4ae-0440b2a396ce (non-flash)
Nov 16 10:13:18 user nova-compute[85141]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba7ca2a3-5f1e-4544-852f-d57100b608e3 (non-flash)
Nov 16 10:13:18 user nova-compute[85141]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42c041ec-fa39-4035-b82b-867caf3565df (non-flash)
Nov 16 10:13:18 user nova-compute[85141]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e233047-dda3-4f2e-803c-7b69a57ac656 (non-flash)
Nov 16 10:13:18 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:13:18 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-5418d3a2-d108-4227-8569-605e55a79685 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eff563f0-92d3-47a1-addc-e3eaa6828d59 (non-flash)
Nov 16 10:13:18 user nova-compute[85141]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb0e3ad6-04d7-4405-b4ae-0440b2a396ce (non-flash)
Nov 16 10:13:18 user nova-compute[85141]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba7ca2a3-5f1e-4544-852f-d57100b608e3 (non-flash)
Nov 16 10:13:18 user nova-compute[85141]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42c041ec-fa39-4035-b82b-867caf3565df (non-flash)
Nov 16 10:13:18 user nova-compute[85141]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e233047-dda3-4f2e-803c-7b69a57ac656 (non-flash)
Nov 16 10:13:18 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 10:13:18 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-5418d3a2-d108-4227-8569-605e55a79685 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f518021fa30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eff563f0-92d3-47a1-addc-e3eaa6828d59'): ({'sdh'}, set())}) {{(pid=85141) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 10:13:18 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-5418d3a2-d108-4227-8569-605e55a79685 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] Removing single pathed devices sdh {{(pid=85141) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 10:13:18 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:13:18 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:13:18 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd5b321d-e468-4a18-b6f5-4743c03f9ebc]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:13:18 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:13:18 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.018s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:13:18 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[6066e271-d532-49a2-92f1-a18f68f530f9]: (4, ('ok\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:13:18 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-5418d3a2-d108-4227-8569-605e55a79685 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] Flushing IO for device /dev/sdh {{(pid=85141) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 10:13:18 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:13:18 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.012s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:13:18 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[33ab1b61-f33c-45ec-92b0-1302cc8bfbf6]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:13:18 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-5418d3a2-d108-4227-8569-605e55a79685 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=85141) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 10:13:18 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:13:18 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.037s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:13:18 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[59414406-96fb-4c70-a0cc-e6a397fc4da0]: (4, ('1', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:13:18 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-5418d3a2-d108-4227-8569-605e55a79685 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=85141) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 10:13:18 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-5418d3a2-d108-4227-8569-605e55a79685 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] SCSI volumes sdh have been removed. {{(pid=85141) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 10:13:18 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-5418d3a2-d108-4227-8569-605e55a79685 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eff563f0-92d3-47a1-addc-e3eaa6828d59')] {{(pid=85141) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 10:13:18 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eff563f0-92d3-47a1-addc-e3eaa6828d59 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:13:18 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eff563f0-92d3-47a1-addc-e3eaa6828d59 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:13:18 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fe9f6b2-7d8f-4243-9d94-44c7b057adb2]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:13:18 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-5418d3a2-d108-4227-8569-605e55a79685 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:13:18 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eff563f0-92d3-47a1-addc-e3eaa6828d59 -p 172.16.0.220:3260 --logout {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:13:18 user nova-compute[85141]: DEBUG nova.virt.libvirt.guest [None req-2e3c140e-c9f9-46ce-a537-0787e8739533 tempest-TestVolumeSwap-1037451778 tempest-TestVolumeSwap-1037451778-project-admin] COPY block job progress, current cursor: 60817408 final cursor: 1073741824 {{(pid=85141) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 10:13:18 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eff563f0-92d3-47a1-addc-e3eaa6828d59 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:13:18 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[f737ee34-6ada-49a3-9081-03d9dfd98850]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:eff563f0-92d3-47a1-addc-e3eaa6828d59, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:eff563f0-92d3-47a1-addc-e3eaa6828d59, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:13:18 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-5418d3a2-d108-4227-8569-605e55a79685 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:eff563f0-92d3-47a1-addc-e3eaa6828d59, portal: 172.16.0.220,3260]
Nov 16 10:13:18 user nova-compute[85141]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:eff563f0-92d3-47a1-addc-e3eaa6828d59, portal: 172.16.0.220,3260] successful.
Nov 16 10:13:18 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:13:18 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eff563f0-92d3-47a1-addc-e3eaa6828d59 -p 172.16.0.220:3260 --op delete {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:13:18 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eff563f0-92d3-47a1-addc-e3eaa6828d59 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:13:18 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[71a772b8-f1f5-4f7c-9f97-f35cb1bf99f4]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:13:18 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-5418d3a2-d108-4227-8569-605e55a79685 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:13:18 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-5418d3a2-d108-4227-8569-605e55a79685 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.319s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 10:13:18 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-5418d3a2-d108-4227-8569-605e55a79685 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] <== disconnect_volume: return (321ms) None {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 10:13:18 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5418d3a2-d108-4227-8569-605e55a79685 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] [instance: 0ca61bd2-268e-4c49-ba04-a5cb39143a9b] Disconnected iSCSI Volume {{(pid=85141) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 10:13:18 user nova-compute[85141]: DEBUG nova.virt.libvirt.guest [None req-2e3c140e-c9f9-46ce-a537-0787e8739533 tempest-TestVolumeSwap-1037451778 tempest-TestVolumeSwap-1037451778-project-admin] COPY block job progress, current cursor: 60817408 final cursor: 1073741824 {{(pid=85141) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 10:13:19 user nova-compute[85141]: DEBUG nova.virt.libvirt.guest [None req-2e3c140e-c9f9-46ce-a537-0787e8739533 tempest-TestVolumeSwap-1037451778 tempest-TestVolumeSwap-1037451778-project-admin] COPY block job progress, current cursor: 112197632 final cursor: 1073741824 {{(pid=85141) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 10:13:19 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:13:19 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:13:19 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Starting heal instance info cache {{(pid=85141) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 10:13:19 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Acquiring lock "refresh_cache-d842f90e-663b-4c95-9d7c-d092d2bac41f" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:13:19 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Acquired lock "refresh_cache-d842f90e-663b-4c95-9d7c-d092d2bac41f" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:13:19 user nova-compute[85141]: DEBUG nova.network.neutron [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] [instance: d842f90e-663b-4c95-9d7c-d092d2bac41f] Forcefully refreshing network info cache for instance {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 10:13:19 user nova-compute[85141]: DEBUG nova.virt.libvirt.guest [None req-2e3c140e-c9f9-46ce-a537-0787e8739533 tempest-TestVolumeSwap-1037451778 tempest-TestVolumeSwap-1037451778-project-admin] COPY block job progress, current cursor: 261095424 final cursor: 1073741824 {{(pid=85141) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 10:13:20 user nova-compute[85141]: DEBUG nova.compute.manager [req-6a845614-4a3e-463a-ab9a-3b28711d00a9 req-ef2d5148-b0b0-44d7-ae16-d7dc8864b3e4 service nova] [instance: eef3cc09-054b-4a17-b621-4f3737d5420e] Received event network-vif-deleted-0c9cc79d-1ded-40cc-84fc-f6b70a9bb555 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:13:20 user nova-compute[85141]: INFO nova.compute.manager [req-6a845614-4a3e-463a-ab9a-3b28711d00a9 req-ef2d5148-b0b0-44d7-ae16-d7dc8864b3e4 service nova] [instance: eef3cc09-054b-4a17-b621-4f3737d5420e] Neutron deleted interface 0c9cc79d-1ded-40cc-84fc-f6b70a9bb555; detaching it from the instance and deleting it from the info cache
Nov 16 10:13:20 user nova-compute[85141]: DEBUG nova.network.neutron [req-6a845614-4a3e-463a-ab9a-3b28711d00a9 req-ef2d5148-b0b0-44d7-ae16-d7dc8864b3e4 service nova] [instance: eef3cc09-054b-4a17-b621-4f3737d5420e] Updating instance_info_cache with network_info: [{"id": "277c1d3d-ed49-4b8c-82e3-902fa6c8a2f5", "address": "fa:16:3e:60:a2:e0", "network": {"id": "1f8e2c11-f9ae-480d-a6e3-1df589fdd7bc", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-976382911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eafaf607b5ff4b448aaaea253a321827", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap277c1d3d-ed", "ovs_interfaceid": "277c1d3d-ed49-4b8c-82e3-902fa6c8a2f5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f742ff18-5ea3-42a0-b229-27a32badce8a", "address": "fa:16:3e:38:78:2d", "network": {"id": "85a74d82-5c98-4f2b-a38d-3e9ebe6a1e13", "bridge": "br-int", "label": "tempest-device-tagging-net1-178618229", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.216", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "eafaf607b5ff4b448aaaea253a321827", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf742ff18-5e", "ovs_interfaceid": "f742ff18-5ea3-42a0-b229-27a32badce8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0f7c87ad-4076-4aca-8d9b-1fae099dd325", "address": "fa:16:3e:7a:05:a4", "network": {"id": "85a74d82-5c98-4f2b-a38d-3e9ebe6a1e13", "bridge": "br-int", "label": "tempest-device-tagging-net1-178618229", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.102", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "eafaf607b5ff4b448aaaea253a321827", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f7c87ad-40", "ovs_interfaceid": "0f7c87ad-4076-4aca-8d9b-1fae099dd325", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d6b517e2-8788-4775-b327-11601713da4d", "address": "fa:16:3e:81:5a:0a", "network": {"id": "85a74d82-5c98-4f2b-a38d-3e9ebe6a1e13", "bridge": "br-int", "label": "tempest-device-tagging-net1-178618229", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.253", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "eafaf607b5ff4b448aaaea253a321827", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6b517e2-87", "ovs_interfaceid": "d6b517e2-8788-4775-b327-11601713da4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b0183e60-7f49-44a1-a24c-30db287f2453", "address": "fa:16:3e:b2:23:6e", "network": {"id": "a9e0ac50-1fbb-4d94-a22f-6fcf40dd0194", "bridge": "br-int", "label": "tempest-device-tagging-net2-947660195", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "eafaf607b5ff4b448aaaea253a321827", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0183e60-7f", "ovs_interfaceid": "b0183e60-7f49-44a1-a24c-30db287f2453", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "21180772-80b3-48e1-90e9-39590611ff08", "address": "fa:16:3e:c1:ed:f9", "network": {"id": "a9e0ac50-1fbb-4d94-a22f-6fcf40dd0194", "bridge": "br-int", "label": "tempest-device-tagging-net2-947660195", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "eafaf607b5ff4b448aaaea253a321827", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21180772-80", "ovs_interfaceid": "21180772-80b3-48e1-90e9-39590611ff08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:13:20 user nova-compute[85141]: DEBUG nova.objects.instance [None req-8709ced5-7bbf-4b82-92b1-e1003b2216dc tempest-AttachSCSIVolumeTestJSON-1774410022 tempest-AttachSCSIVolumeTestJSON-1774410022-project-member] Lazy-loading 'flavor' on Instance uuid ff964caf-b473-47bc-89d2-f7189264721c {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:13:20 user nova-compute[85141]: DEBUG nova.compute.manager [req-6a845614-4a3e-463a-ab9a-3b28711d00a9 req-ef2d5148-b0b0-44d7-ae16-d7dc8864b3e4 service nova] [instance: eef3cc09-054b-4a17-b621-4f3737d5420e] Detach interface failed, port_id=0c9cc79d-1ded-40cc-84fc-f6b70a9bb555, reason: Instance eef3cc09-054b-4a17-b621-4f3737d5420e could not be found. {{(pid=85141) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 16 10:13:20 user nova-compute[85141]: DEBUG nova.objects.instance [None req-5418d3a2-d108-4227-8569-605e55a79685 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] Lazy-loading 'flavor' on Instance uuid 0ca61bd2-268e-4c49-ba04-a5cb39143a9b {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:13:20 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-8709ced5-7bbf-4b82-92b1-e1003b2216dc tempest-AttachSCSIVolumeTestJSON-1774410022 tempest-AttachSCSIVolumeTestJSON-1774410022-project-member] Lock "ff964caf-b473-47bc-89d2-f7189264721c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 25.642s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:13:20 user nova-compute[85141]: DEBUG nova.virt.libvirt.guest [None req-2e3c140e-c9f9-46ce-a537-0787e8739533 tempest-TestVolumeSwap-1037451778 tempest-TestVolumeSwap-1037451778-project-admin] COPY block job progress, current cursor: 358612992 final cursor: 1073741824 {{(pid=85141) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 10:13:20 user nova-compute[85141]: DEBUG nova.network.neutron [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] [instance: d842f90e-663b-4c95-9d7c-d092d2bac41f] Updating instance_info_cache with network_info: [{"id": "6ce8849e-50a1-4b8a-bf75-1016ef3c2315", "address": "fa:16:3e:a2:a8:01", "network": {"id": "e40e4bd2-4277-40b1-9451-1c8365ffa488", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1333036447-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "733b504d4dbe4f028963cf2c197f0064", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ce8849e-50", "ovs_interfaceid": "6ce8849e-50a1-4b8a-bf75-1016ef3c2315", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:13:20 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Releasing lock "refresh_cache-d842f90e-663b-4c95-9d7c-d092d2bac41f" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:13:20 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] [instance: d842f90e-663b-4c95-9d7c-d092d2bac41f] Updated the network info_cache for instance {{(pid=85141) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 10:13:20 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:13:20 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5418d3a2-d108-4227-8569-605e55a79685 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] Lock "0ca61bd2-268e-4c49-ba04-a5cb39143a9b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.959s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:13:20 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:13:20 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:13:20 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:13:20 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=85141) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 10:13:20 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:13:20 user nova-compute[85141]: DEBUG nova.virt.libvirt.guest [None req-2e3c140e-c9f9-46ce-a537-0787e8739533 tempest-TestVolumeSwap-1037451778 tempest-TestVolumeSwap-1037451778-project-admin] COPY block job progress, current cursor: 535822336 final cursor: 1073741824 {{(pid=85141) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 10:13:21 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-e3c2ed09-bd60-46a3-a5d8-0c2fb1d60d80 tempest-AttachSCSIVolumeTestJSON-1774410022 tempest-AttachSCSIVolumeTestJSON-1774410022-project-member] Acquiring lock "ff964caf-b473-47bc-89d2-f7189264721c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:13:21 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-e3c2ed09-bd60-46a3-a5d8-0c2fb1d60d80 tempest-AttachSCSIVolumeTestJSON-1774410022 tempest-AttachSCSIVolumeTestJSON-1774410022-project-member] Lock "ff964caf-b473-47bc-89d2-f7189264721c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:13:21 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-e3c2ed09-bd60-46a3-a5d8-0c2fb1d60d80 tempest-AttachSCSIVolumeTestJSON-1774410022 tempest-AttachSCSIVolumeTestJSON-1774410022-project-member] Acquiring lock "ff964caf-b473-47bc-89d2-f7189264721c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:13:21 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-e3c2ed09-bd60-46a3-a5d8-0c2fb1d60d80 tempest-AttachSCSIVolumeTestJSON-1774410022 tempest-AttachSCSIVolumeTestJSON-1774410022-project-member] Lock "ff964caf-b473-47bc-89d2-f7189264721c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:13:21 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-e3c2ed09-bd60-46a3-a5d8-0c2fb1d60d80 tempest-AttachSCSIVolumeTestJSON-1774410022 tempest-AttachSCSIVolumeTestJSON-1774410022-project-member] Lock "ff964caf-b473-47bc-89d2-f7189264721c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:13:21 user nova-compute[85141]: INFO nova.compute.manager [None req-e3c2ed09-bd60-46a3-a5d8-0c2fb1d60d80 tempest-AttachSCSIVolumeTestJSON-1774410022 tempest-AttachSCSIVolumeTestJSON-1774410022-project-member] [instance: ff964caf-b473-47bc-89d2-f7189264721c] Terminating instance
Nov 16 10:13:21 user nova-compute[85141]: DEBUG nova.compute.manager [None req-e3c2ed09-bd60-46a3-a5d8-0c2fb1d60d80 tempest-AttachSCSIVolumeTestJSON-1774410022 tempest-AttachSCSIVolumeTestJSON-1774410022-project-member] [instance: ff964caf-b473-47bc-89d2-f7189264721c] Start destroying the instance on the hypervisor. {{(pid=85141) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 10:13:21 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:13:21 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-22f2f808-c9d7-4b18-8632-3357d5e96196 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] Acquiring lock "interface-0ca61bd2-268e-4c49-ba04-a5cb39143a9b-0fd660bd-1d7b-45d1-8906-d20417082456" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:13:21 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-22f2f808-c9d7-4b18-8632-3357d5e96196 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] Lock "interface-0ca61bd2-268e-4c49-ba04-a5cb39143a9b-0fd660bd-1d7b-45d1-8906-d20417082456" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:13:21 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:13:21 user nova-compute[85141]: DEBUG nova.virt.libvirt.guest [None req-2e3c140e-c9f9-46ce-a537-0787e8739533 tempest-TestVolumeSwap-1037451778 tempest-TestVolumeSwap-1037451778-project-admin] COPY block job progress, current cursor: 661651456 final cursor: 1073741824 {{(pid=85141) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 10:13:21 user nova-compute[85141]: DEBUG nova.objects.instance [None req-22f2f808-c9d7-4b18-8632-3357d5e96196 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] Lazy-loading 'flavor' on Instance uuid 0ca61bd2-268e-4c49-ba04-a5cb39143a9b {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:13:21 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:13:21 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager.update_available_resource {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:13:21 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-22f2f808-c9d7-4b18-8632-3357d5e96196 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T10:10:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-716916570',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-716916570',id=8,image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLJjo671Ow+Mmgs0Sg26Qz/3lV+acwH0zhTjdI/jAzpHJeJFVSCAeG6lSBMe0VPCPV8jS6nF17VjHRJ+udtegobTbD+V4E/SBllDlIvaieW2o7QXUoKkfv8rtxZTi+1HzQ==',key_name='tempest-keypair-612763063',keypairs=<?>,launch_index=0,launched_at=2023-11-16T10:11:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b9317f5645af406c899fcc5df61362bb',ramdisk_id='',reservation_id='r-xpla73zu',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1293058027',owner_user_name='tempest-TaggedAttachmentsTest-1293058027-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T10:11:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8734a61ff9fb4e14b1b542b8ecdfdeec',uuid=0ca61bd2-268e-4c49-ba04-a5cb39143a9b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0fd660bd-1d7b-45d1-8906-d20417082456", "address": "fa:16:3e:86:c2:f1", "network": {"id": "a0932a5f-6790-40ed-a554-3a9e85f287d0", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-35889031", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "b9317f5645af406c899fcc5df61362bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fd660bd-1d", "ovs_interfaceid": "0fd660bd-1d7b-45d1-8906-d20417082456", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=85141) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 10:13:21 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-22f2f808-c9d7-4b18-8632-3357d5e96196 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] Converting VIF {"id": "0fd660bd-1d7b-45d1-8906-d20417082456", "address": "fa:16:3e:86:c2:f1", "network": {"id": "a0932a5f-6790-40ed-a554-3a9e85f287d0", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-35889031", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "b9317f5645af406c899fcc5df61362bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fd660bd-1d", "ovs_interfaceid": "0fd660bd-1d7b-45d1-8906-d20417082456", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:13:21 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-22f2f808-c9d7-4b18-8632-3357d5e96196 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:c2:f1,bridge_name='br-int',has_traffic_filtering=True,id=0fd660bd-1d7b-45d1-8906-d20417082456,network=Network(a0932a5f-6790-40ed-a554-3a9e85f287d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0fd660bd-1d') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:13:21 user nova-compute[85141]: DEBUG nova.virt.libvirt.guest [None req-22f2f808-c9d7-4b18-8632-3357d5e96196 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:86:c2:f1"/><model type="virtio"/><mtu size="1442"/><target dev="tap0fd660bd-1d"/></interface> {{(pid=85141) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 16 10:13:21 user nova-compute[85141]: DEBUG nova.virt.libvirt.guest [None req-22f2f808-c9d7-4b18-8632-3357d5e96196 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:86:c2:f1"/><model type="virtio"/><mtu size="1442"/><target dev="tap0fd660bd-1d"/></interface> {{(pid=85141) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 16 10:13:21 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-22f2f808-c9d7-4b18-8632-3357d5e96196 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] Attempting to detach device tap0fd660bd-1d from instance 0ca61bd2-268e-4c49-ba04-a5cb39143a9b from the persistent domain config. {{(pid=85141) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 10:13:21 user nova-compute[85141]: DEBUG nova.virt.libvirt.guest [None req-22f2f808-c9d7-4b18-8632-3357d5e96196 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] detach device xml: <interface type="ethernet">
Nov 16 10:13:21 user nova-compute[85141]:   <mac address="fa:16:3e:86:c2:f1"/>
Nov 16 10:13:21 user nova-compute[85141]:   <model type="virtio"/>
Nov 16 10:13:21 user nova-compute[85141]:   <mtu size="1442"/>
Nov 16 10:13:21 user nova-compute[85141]:   <target dev="tap0fd660bd-1d"/>
Nov 16 10:13:21 user nova-compute[85141]: </interface>
Nov 16 10:13:21 user nova-compute[85141]:  {{(pid=85141) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 10:13:21 user nova-compute[85141]: DEBUG nova.virt.libvirt.guest [None req-22f2f808-c9d7-4b18-8632-3357d5e96196 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:86:c2:f1"/><model type="virtio"/><mtu size="1442"/><target dev="tap0fd660bd-1d"/></interface> {{(pid=85141) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 16 10:13:21 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:13:21 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:13:21 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:13:21 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Auditing locally available compute resources for user (node: user) {{(pid=85141) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 10:13:21 user nova-compute[85141]: DEBUG nova.virt.libvirt.guest [None req-22f2f808-c9d7-4b18-8632-3357d5e96196 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:86:c2:f1"/><model type="virtio"/><mtu size="1442"/><target dev="tap0fd660bd-1d"/></interface>not found in domain: <domain type='kvm' id='7'>
Nov 16 10:13:21 user nova-compute[85141]:   <name>instance-00000008</name>
Nov 16 10:13:21 user nova-compute[85141]:   <uuid>0ca61bd2-268e-4c49-ba04-a5cb39143a9b</uuid>
Nov 16 10:13:21 user nova-compute[85141]:   <metadata>
Nov 16 10:13:21 user nova-compute[85141]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 10:13:21 user nova-compute[85141]:   <nova:package version="0.0.0"/>
Nov 16 10:13:21 user nova-compute[85141]:   <nova:name>tempest-device-tagging-server-716916570</nova:name>
Nov 16 10:13:21 user nova-compute[85141]:   <nova:creationTime>2023-11-16 10:12:47</nova:creationTime>
Nov 16 10:13:21 user nova-compute[85141]:   <nova:flavor name="m1.tiny">
Nov 16 10:13:21 user nova-compute[85141]:     <nova:memory>512</nova:memory>
Nov 16 10:13:21 user nova-compute[85141]:     <nova:disk>1</nova:disk>
Nov 16 10:13:21 user nova-compute[85141]:     <nova:swap>0</nova:swap>
Nov 16 10:13:21 user nova-compute[85141]:     <nova:ephemeral>0</nova:ephemeral>
Nov 16 10:13:21 user nova-compute[85141]:     <nova:vcpus>1</nova:vcpus>
Nov 16 10:13:21 user nova-compute[85141]:   </nova:flavor>
Nov 16 10:13:21 user nova-compute[85141]:   <nova:owner>
Nov 16 10:13:21 user nova-compute[85141]:     <nova:user uuid="8734a61ff9fb4e14b1b542b8ecdfdeec">tempest-TaggedAttachmentsTest-1293058027-project-member</nova:user>
Nov 16 10:13:21 user nova-compute[85141]:     <nova:project uuid="b9317f5645af406c899fcc5df61362bb">tempest-TaggedAttachmentsTest-1293058027</nova:project>
Nov 16 10:13:21 user nova-compute[85141]:   </nova:owner>
Nov 16 10:13:21 user nova-compute[85141]:   <nova:root type="image" uuid="bc4ca70f-a459-4d5c-a9e6-80f1948eb48b"/>
Nov 16 10:13:21 user nova-compute[85141]:   <nova:ports>
Nov 16 10:13:21 user nova-compute[85141]:     <nova:port uuid="56375501-2a9c-4821-8446-31156fc0f231">
Nov 16 10:13:21 user nova-compute[85141]:       <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 16 10:13:21 user nova-compute[85141]:     </nova:port>
Nov 16 10:13:21 user nova-compute[85141]:     <nova:port uuid="0fd660bd-1d7b-45d1-8906-d20417082456">
Nov 16 10:13:21 user nova-compute[85141]:       <nova:ip type="fixed" address="10.10.10.69" ipVersion="4"/>
Nov 16 10:13:21 user nova-compute[85141]:     </nova:port>
Nov 16 10:13:21 user nova-compute[85141]:   </nova:ports>
Nov 16 10:13:21 user nova-compute[85141]: </nova:instance>
Nov 16 10:13:21 user nova-compute[85141]:   </metadata>
Nov 16 10:13:21 user nova-compute[85141]:   <memory unit='KiB'>524288</memory>
Nov 16 10:13:21 user nova-compute[85141]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 16 10:13:21 user nova-compute[85141]:   <vcpu placement='static'>1</vcpu>
Nov 16 10:13:21 user nova-compute[85141]:   <resource>
Nov 16 10:13:21 user nova-compute[85141]:     <partition>/machine</partition>
Nov 16 10:13:21 user nova-compute[85141]:   </resource>
Nov 16 10:13:21 user nova-compute[85141]:   <sysinfo type='smbios'>
Nov 16 10:13:21 user nova-compute[85141]:     <system>
Nov 16 10:13:21 user nova-compute[85141]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 16 10:13:21 user nova-compute[85141]:       <entry name='product'>OpenStack Nova</entry>
Nov 16 10:13:21 user nova-compute[85141]:       <entry name='version'>0.0.0</entry>
Nov 16 10:13:21 user nova-compute[85141]:       <entry name='serial'>0ca61bd2-268e-4c49-ba04-a5cb39143a9b</entry>
Nov 16 10:13:21 user nova-compute[85141]:       <entry name='uuid'>0ca61bd2-268e-4c49-ba04-a5cb39143a9b</entry>
Nov 16 10:13:21 user nova-compute[85141]:       <entry name='family'>Virtual Machine</entry>
Nov 16 10:13:21 user nova-compute[85141]:     </system>
Nov 16 10:13:21 user nova-compute[85141]:   </sysinfo>
Nov 16 10:13:21 user nova-compute[85141]:   <os>
Nov 16 10:13:21 user nova-compute[85141]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 16 10:13:21 user nova-compute[85141]:     <boot dev='hd'/>
Nov 16 10:13:21 user nova-compute[85141]:     <smbios mode='sysinfo'/>
Nov 16 10:13:21 user nova-compute[85141]:   </os>
Nov 16 10:13:21 user nova-compute[85141]:   <features>
Nov 16 10:13:21 user nova-compute[85141]:     <acpi/>
Nov 16 10:13:21 user nova-compute[85141]:     <apic/>
Nov 16 10:13:21 user nova-compute[85141]:     <vmcoreinfo state='on'/>
Nov 16 10:13:21 user nova-compute[85141]:   </features>
Nov 16 10:13:21 user nova-compute[85141]:   <cpu mode='custom' match='exact' check='full'>
Nov 16 10:13:21 user nova-compute[85141]:     <model fallback='forbid'>Nehalem</model>
Nov 16 10:13:21 user nova-compute[85141]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 16 10:13:21 user nova-compute[85141]:     <feature policy='require' name='vme'/>
Nov 16 10:13:21 user nova-compute[85141]:     <feature policy='require' name='x2apic'/>
Nov 16 10:13:21 user nova-compute[85141]:     <feature policy='require' name='hypervisor'/>
Nov 16 10:13:21 user nova-compute[85141]:   </cpu>
Nov 16 10:13:21 user nova-compute[85141]:   <clock offset='utc'>
Nov 16 10:13:21 user nova-compute[85141]:     <timer name='pit' tickpolicy='delay'/>
Nov 16 10:13:21 user nova-compute[85141]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 16 10:13:21 user nova-compute[85141]:     <timer name='hpet' present='no'/>
Nov 16 10:13:21 user nova-compute[85141]:   </clock>
Nov 16 10:13:21 user nova-compute[85141]:   <on_poweroff>destroy</on_poweroff>
Nov 16 10:13:21 user nova-compute[85141]:   <on_reboot>restart</on_reboot>
Nov 16 10:13:21 user nova-compute[85141]:   <on_crash>destroy</on_crash>
Nov 16 10:13:21 user nova-compute[85141]:   <devices>
Nov 16 10:13:21 user nova-compute[85141]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 16 10:13:21 user nova-compute[85141]:     <disk type='file' device='disk'>
Nov 16 10:13:21 user nova-compute[85141]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 16 10:13:21 user nova-compute[85141]:       <source file='/opt/stack/data/nova/instances/0ca61bd2-268e-4c49-ba04-a5cb39143a9b/disk' index='2'/>
Nov 16 10:13:21 user nova-compute[85141]:       <backingStore type='file' index='3'>
Nov 16 10:13:21 user nova-compute[85141]:         <format type='raw'/>
Nov 16 10:13:21 user nova-compute[85141]:         <source file='/opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811'/>
Nov 16 10:13:21 user nova-compute[85141]:         <backingStore/>
Nov 16 10:13:21 user nova-compute[85141]:       </backingStore>
Nov 16 10:13:21 user nova-compute[85141]:       <target dev='vda' bus='virtio'/>
Nov 16 10:13:21 user nova-compute[85141]:       <alias name='virtio-disk0'/>
Nov 16 10:13:21 user nova-compute[85141]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 16 10:13:21 user nova-compute[85141]:     </disk>
Nov 16 10:13:21 user nova-compute[85141]:     <disk type='file' device='cdrom'>
Nov 16 10:13:21 user nova-compute[85141]:       <driver name='qemu' type='raw' cache='none'/>
Nov 16 10:13:21 user nova-compute[85141]:       <source file='/opt/stack/data/nova/instances/0ca61bd2-268e-4c49-ba04-a5cb39143a9b/disk.config' index='1'/>
Nov 16 10:13:21 user nova-compute[85141]:       <backingStore/>
Nov 16 10:13:21 user nova-compute[85141]:       <target dev='hda' bus='ide'/>
Nov 16 10:13:21 user nova-compute[85141]:       <readonly/>
Nov 16 10:13:21 user nova-compute[85141]:       <alias name='ide0-0-0'/>
Nov 16 10:13:21 user nova-compute[85141]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 16 10:13:21 user nova-compute[85141]:     </disk>
Nov 16 10:13:21 user nova-compute[85141]:     <controller type='usb' index='0' model='none'>
Nov 16 10:13:21 user nova-compute[85141]:       <alias name='usb'/>
Nov 16 10:13:21 user nova-compute[85141]:     </controller>
Nov 16 10:13:21 user nova-compute[85141]:     <controller type='pci' index='0' model='pci-root'>
Nov 16 10:13:21 user nova-compute[85141]:       <alias name='pci.0'/>
Nov 16 10:13:21 user nova-compute[85141]:     </controller>
Nov 16 10:13:21 user nova-compute[85141]:     <controller type='ide' index='0'>
Nov 16 10:13:21 user nova-compute[85141]:       <alias name='ide'/>
Nov 16 10:13:21 user nova-compute[85141]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 16 10:13:21 user nova-compute[85141]:     </controller>
Nov 16 10:13:21 user nova-compute[85141]:     <interface type='ethernet'>
Nov 16 10:13:21 user nova-compute[85141]:       <mac address='fa:16:3e:12:0a:da'/>
Nov 16 10:13:21 user nova-compute[85141]:       <target dev='tap56375501-2a'/>
Nov 16 10:13:21 user nova-compute[85141]:       <model type='virtio'/>
Nov 16 10:13:21 user nova-compute[85141]:       <mtu size='1442'/>
Nov 16 10:13:21 user nova-compute[85141]:       <alias name='net0'/>
Nov 16 10:13:21 user nova-compute[85141]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 16 10:13:21 user nova-compute[85141]:     </interface>
Nov 16 10:13:21 user nova-compute[85141]:     <interface type='ethernet'>
Nov 16 10:13:21 user nova-compute[85141]:       <mac address='fa:16:3e:86:c2:f1'/>
Nov 16 10:13:21 user nova-compute[85141]:       <target dev='tap0fd660bd-1d'/>
Nov 16 10:13:21 user nova-compute[85141]:       <model type='virtio'/>
Nov 16 10:13:21 user nova-compute[85141]:       <mtu size='1442'/>
Nov 16 10:13:21 user nova-compute[85141]:       <alias name='net1'/>
Nov 16 10:13:21 user nova-compute[85141]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Nov 16 10:13:21 user nova-compute[85141]:     </interface>
Nov 16 10:13:21 user nova-compute[85141]:     <serial type='pty'>
Nov 16 10:13:21 user nova-compute[85141]:       <source path='/dev/pts/6'/>
Nov 16 10:13:21 user nova-compute[85141]:       <log file='/opt/stack/data/nova/instances/0ca61bd2-268e-4c49-ba04-a5cb39143a9b/console.log' append='off'/>
Nov 16 10:13:21 user nova-compute[85141]:       <target type='isa-serial' port='0'>
Nov 16 10:13:21 user nova-compute[85141]:         <model name='isa-serial'/>
Nov 16 10:13:21 user nova-compute[85141]:       </target>
Nov 16 10:13:21 user nova-compute[85141]:       <alias name='serial0'/>
Nov 16 10:13:21 user nova-compute[85141]:     </serial>
Nov 16 10:13:21 user nova-compute[85141]:     <console type='pty' tty='/dev/pts/6'>
Nov 16 10:13:21 user nova-compute[85141]:       <source path='/dev/pts/6'/>
Nov 16 10:13:21 user nova-compute[85141]:       <log file='/opt/stack/data/nova/instances/0ca61bd2-268e-4c49-ba04-a5cb39143a9b/console.log' append='off'/>
Nov 16 10:13:21 user nova-compute[85141]:       <target type='serial' port='0'/>
Nov 16 10:13:21 user nova-compute[85141]:       <alias name='serial0'/>
Nov 16 10:13:21 user nova-compute[85141]:     </console>
Nov 16 10:13:21 user nova-compute[85141]:     <input type='mouse' bus='ps2'>
Nov 16 10:13:21 user nova-compute[85141]:       <alias name='input0'/>
Nov 16 10:13:21 user nova-compute[85141]:     </input>
Nov 16 10:13:21 user nova-compute[85141]:     <input type='keyboard' bus='ps2'>
Nov 16 10:13:21 user nova-compute[85141]:       <alias name='input1'/>
Nov 16 10:13:21 user nova-compute[85141]:     </input>
Nov 16 10:13:21 user nova-compute[85141]:     <graphics type='vnc' port='5906' autoport='yes' listen='0.0.0.0'>
Nov 16 10:13:21 user nova-compute[85141]:       <listen type='address' address='0.0.0.0'/>
Nov 16 10:13:21 user nova-compute[85141]:     </graphics>
Nov 16 10:13:21 user nova-compute[85141]:     <audio id='1' type='none'/>
Nov 16 10:13:21 user nova-compute[85141]:     <video>
Nov 16 10:13:21 user nova-compute[85141]:       <model type='virtio' heads='1' primary='yes'/>
Nov 16 10:13:21 user nova-compute[85141]:       <alias name='video0'/>
Nov 16 10:13:21 user nova-compute[85141]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 16 10:13:21 user nova-compute[85141]:     </video>
Nov 16 10:13:21 user nova-compute[85141]:     <memballoon model='virtio'>
Nov 16 10:13:21 user nova-compute[85141]:       <stats period='10'/>
Nov 16 10:13:21 user nova-compute[85141]:       <alias name='balloon0'/>
Nov 16 10:13:21 user nova-compute[85141]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 16 10:13:21 user nova-compute[85141]:     </memballoon>
Nov 16 10:13:21 user nova-compute[85141]:     <rng model='virtio'>
Nov 16 10:13:21 user nova-compute[85141]:       <backend model='random'>/dev/urandom</backend>
Nov 16 10:13:21 user nova-compute[85141]:       <alias name='rng0'/>
Nov 16 10:13:21 user nova-compute[85141]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 16 10:13:21 user nova-compute[85141]:     </rng>
Nov 16 10:13:21 user nova-compute[85141]:   </devices>
Nov 16 10:13:21 user nova-compute[85141]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 16 10:13:21 user nova-compute[85141]:     <label>libvirt-0ca61bd2-268e-4c49-ba04-a5cb39143a9b</label>
Nov 16 10:13:21 user nova-compute[85141]:     <imagelabel>libvirt-0ca61bd2-268e-4c49-ba04-a5cb39143a9b</imagelabel>
Nov 16 10:13:21 user nova-compute[85141]:   </seclabel>
Nov 16 10:13:21 user nova-compute[85141]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 16 10:13:21 user nova-compute[85141]:     <label>+64055:+108</label>
Nov 16 10:13:21 user nova-compute[85141]:     <imagelabel>+64055:+108</imagelabel>
Nov 16 10:13:21 user nova-compute[85141]:   </seclabel>
Nov 16 10:13:21 user nova-compute[85141]: </domain>
Nov 16 10:13:21 user nova-compute[85141]:  {{(pid=85141) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 16 10:13:21 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-22f2f808-c9d7-4b18-8632-3357d5e96196 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] Successfully detached device tap0fd660bd-1d from instance 0ca61bd2-268e-4c49-ba04-a5cb39143a9b from the persistent domain config.
Nov 16 10:13:21 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-22f2f808-c9d7-4b18-8632-3357d5e96196 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] (1/8): Attempting to detach device tap0fd660bd-1d with device alias net1 from instance 0ca61bd2-268e-4c49-ba04-a5cb39143a9b from the live domain config. {{(pid=85141) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 10:13:21 user nova-compute[85141]: DEBUG nova.virt.libvirt.guest [None req-22f2f808-c9d7-4b18-8632-3357d5e96196 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] detach device xml: <interface type="ethernet">
Nov 16 10:13:21 user nova-compute[85141]:   <mac address="fa:16:3e:86:c2:f1"/>
Nov 16 10:13:21 user nova-compute[85141]:   <model type="virtio"/>
Nov 16 10:13:21 user nova-compute[85141]:   <mtu size="1442"/>
Nov 16 10:13:21 user nova-compute[85141]:   <target dev="tap0fd660bd-1d"/>
Nov 16 10:13:21 user nova-compute[85141]: </interface>
Nov 16 10:13:21 user nova-compute[85141]:  {{(pid=85141) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 10:13:21 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-22f2f808-c9d7-4b18-8632-3357d5e96196 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] Start waiting for the detach event from libvirt for device tap0fd660bd-1d with device alias net1 for instance 0ca61bd2-268e-4c49-ba04-a5cb39143a9b {{(pid=85141) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 10:13:21 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:13:21 user nova-compute[85141]: DEBUG nova.virt.libvirt.guest [None req-2e3c140e-c9f9-46ce-a537-0787e8739533 tempest-TestVolumeSwap-1037451778 tempest-TestVolumeSwap-1037451778-project-admin] COPY block job progress, current cursor: 783286272 final cursor: 1073741824 {{(pid=85141) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 10:13:21 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:13:21 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:13:22 user nova-compute[85141]: INFO nova.virt.libvirt.driver [-] [instance: ff964caf-b473-47bc-89d2-f7189264721c] Instance destroyed successfully.
Nov 16 10:13:22 user nova-compute[85141]: DEBUG nova.objects.instance [None req-e3c2ed09-bd60-46a3-a5d8-0c2fb1d60d80 tempest-AttachSCSIVolumeTestJSON-1774410022 tempest-AttachSCSIVolumeTestJSON-1774410022-project-member] Lazy-loading 'resources' on Instance uuid ff964caf-b473-47bc-89d2-f7189264721c {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:13:22 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-e3c2ed09-bd60-46a3-a5d8-0c2fb1d60d80 tempest-AttachSCSIVolumeTestJSON-1774410022 tempest-AttachSCSIVolumeTestJSON-1774410022-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T10:10:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1772339303',display_name='tempest-AttachSCSIVolumeTestJSON-server-1772339303',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1772339303',id=7,image_ref='164bf389-5fc3-484a-8449-60bd5a23b06e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDMln6WwOuenH5UifdUEyDzooJXlOJ/uEE/ZLrkfrx8/kYuR0jY8HjvZ8O1Pj9ApEpSzzaNVUsr/9g4vs2TFOuaJeS/8kk/H4NFEMB3BhmxqR9RQoVOLnyrk04Jh+7JdMA==',key_name='tempest-keypair-101610908',keypairs=<?>,launch_index=0,launched_at=2023-11-16T10:11:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='eb4a953734f44d049877b7658cae923c',ramdisk_id='',reservation_id='r-q4qhnvrx',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='164bf389-5fc3-484a-8449-60bd5a23b06e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1774410022',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1774410022-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T10:11:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5604acaea0e24287869ede44b6df80e1',uuid=ff964caf-b473-47bc-89d2-f7189264721c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "75922f14-4d10-428a-baf5-bc27dfa373a6", "address": "fa:16:3e:3f:0d:5b", "network": {"id": "19e4c869-308d-4f73-99a4-653683c91209", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-208861710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb4a953734f44d049877b7658cae923c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75922f14-4d", "ovs_interfaceid": "75922f14-4d10-428a-baf5-bc27dfa373a6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 10:13:22 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-e3c2ed09-bd60-46a3-a5d8-0c2fb1d60d80 tempest-AttachSCSIVolumeTestJSON-1774410022 tempest-AttachSCSIVolumeTestJSON-1774410022-project-member] Converting VIF {"id": "75922f14-4d10-428a-baf5-bc27dfa373a6", "address": "fa:16:3e:3f:0d:5b", "network": {"id": "19e4c869-308d-4f73-99a4-653683c91209", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-208861710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb4a953734f44d049877b7658cae923c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75922f14-4d", "ovs_interfaceid": "75922f14-4d10-428a-baf5-bc27dfa373a6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:13:22 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-e3c2ed09-bd60-46a3-a5d8-0c2fb1d60d80 tempest-AttachSCSIVolumeTestJSON-1774410022 tempest-AttachSCSIVolumeTestJSON-1774410022-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3f:0d:5b,bridge_name='br-int',has_traffic_filtering=True,id=75922f14-4d10-428a-baf5-bc27dfa373a6,network=Network(19e4c869-308d-4f73-99a4-653683c91209),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75922f14-4d') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:13:22 user nova-compute[85141]: DEBUG os_vif [None req-e3c2ed09-bd60-46a3-a5d8-0c2fb1d60d80 tempest-AttachSCSIVolumeTestJSON-1774410022 tempest-AttachSCSIVolumeTestJSON-1774410022-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3f:0d:5b,bridge_name='br-int',has_traffic_filtering=True,id=75922f14-4d10-428a-baf5-bc27dfa373a6,network=Network(19e4c869-308d-4f73-99a4-653683c91209),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75922f14-4d') {{(pid=85141) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 10:13:22 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:13:22 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap75922f14-4d, bridge=br-int, if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:13:22 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:13:22 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:13:22 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:13:22 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ac795020-ccbf-46ab-a8e5-ce47f3a38649) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:13:22 user nova-compute[85141]: DEBUG nova.compute.manager [req-7a70f461-650f-4628-b636-1086f3245bf3 req-fc939f29-c7b4-48b0-b106-f53b95a4b3cf service nova] [instance: 0ca61bd2-268e-4c49-ba04-a5cb39143a9b] Received event network-vif-unplugged-0fd660bd-1d7b-45d1-8906-d20417082456 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:13:22 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-7a70f461-650f-4628-b636-1086f3245bf3 req-fc939f29-c7b4-48b0-b106-f53b95a4b3cf service nova] Acquiring lock "0ca61bd2-268e-4c49-ba04-a5cb39143a9b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:13:22 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-7a70f461-650f-4628-b636-1086f3245bf3 req-fc939f29-c7b4-48b0-b106-f53b95a4b3cf service nova] Lock "0ca61bd2-268e-4c49-ba04-a5cb39143a9b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:13:22 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-7a70f461-650f-4628-b636-1086f3245bf3 req-fc939f29-c7b4-48b0-b106-f53b95a4b3cf service nova] Lock "0ca61bd2-268e-4c49-ba04-a5cb39143a9b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:13:22 user nova-compute[85141]: DEBUG nova.compute.manager [req-7a70f461-650f-4628-b636-1086f3245bf3 req-fc939f29-c7b4-48b0-b106-f53b95a4b3cf service nova] [instance: 0ca61bd2-268e-4c49-ba04-a5cb39143a9b] No waiting events found dispatching network-vif-unplugged-0fd660bd-1d7b-45d1-8906-d20417082456 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:13:22 user nova-compute[85141]: WARNING nova.compute.manager [req-7a70f461-650f-4628-b636-1086f3245bf3 req-fc939f29-c7b4-48b0-b106-f53b95a4b3cf service nova] [instance: 0ca61bd2-268e-4c49-ba04-a5cb39143a9b] Received unexpected event network-vif-unplugged-0fd660bd-1d7b-45d1-8906-d20417082456 for instance with vm_state active and task_state None.
Nov 16 10:13:22 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:13:22 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:13:22 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:13:22 user nova-compute[85141]: INFO os_vif [None req-e3c2ed09-bd60-46a3-a5d8-0c2fb1d60d80 tempest-AttachSCSIVolumeTestJSON-1774410022 tempest-AttachSCSIVolumeTestJSON-1774410022-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3f:0d:5b,bridge_name='br-int',has_traffic_filtering=True,id=75922f14-4d10-428a-baf5-bc27dfa373a6,network=Network(19e4c869-308d-4f73-99a4-653683c91209),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75922f14-4d')
Nov 16 10:13:22 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-e3c2ed09-bd60-46a3-a5d8-0c2fb1d60d80 tempest-AttachSCSIVolumeTestJSON-1774410022 tempest-AttachSCSIVolumeTestJSON-1774410022-project-member] [instance: ff964caf-b473-47bc-89d2-f7189264721c] Deleting instance files /opt/stack/data/nova/instances/ff964caf-b473-47bc-89d2-f7189264721c_del
Nov 16 10:13:22 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-e3c2ed09-bd60-46a3-a5d8-0c2fb1d60d80 tempest-AttachSCSIVolumeTestJSON-1774410022 tempest-AttachSCSIVolumeTestJSON-1774410022-project-member] [instance: ff964caf-b473-47bc-89d2-f7189264721c] Deletion of /opt/stack/data/nova/instances/ff964caf-b473-47bc-89d2-f7189264721c_del complete
Nov 16 10:13:22 user nova-compute[85141]: DEBUG nova.compute.manager [req-07c1eccd-691d-4b1d-9f75-bae9ef6c1f95 req-c3d40897-12ad-4ef0-b4b0-42badaa7411d service nova] [instance: eef3cc09-054b-4a17-b621-4f3737d5420e] Received event network-vif-deleted-277c1d3d-ed49-4b8c-82e3-902fa6c8a2f5 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:13:22 user nova-compute[85141]: INFO nova.compute.manager [req-07c1eccd-691d-4b1d-9f75-bae9ef6c1f95 req-c3d40897-12ad-4ef0-b4b0-42badaa7411d service nova] [instance: eef3cc09-054b-4a17-b621-4f3737d5420e] Neutron deleted interface 277c1d3d-ed49-4b8c-82e3-902fa6c8a2f5; detaching it from the instance and deleting it from the info cache
Nov 16 10:13:22 user nova-compute[85141]: DEBUG nova.network.neutron [req-07c1eccd-691d-4b1d-9f75-bae9ef6c1f95 req-c3d40897-12ad-4ef0-b4b0-42badaa7411d service nova] [instance: eef3cc09-054b-4a17-b621-4f3737d5420e] Updating instance_info_cache with network_info: [{"id": "f742ff18-5ea3-42a0-b229-27a32badce8a", "address": "fa:16:3e:38:78:2d", "network": {"id": "85a74d82-5c98-4f2b-a38d-3e9ebe6a1e13", "bridge": "br-int", "label": "tempest-device-tagging-net1-178618229", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.216", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "eafaf607b5ff4b448aaaea253a321827", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf742ff18-5e", "ovs_interfaceid": "f742ff18-5ea3-42a0-b229-27a32badce8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0f7c87ad-4076-4aca-8d9b-1fae099dd325", "address": "fa:16:3e:7a:05:a4", "network": {"id": "85a74d82-5c98-4f2b-a38d-3e9ebe6a1e13", "bridge": "br-int", "label": "tempest-device-tagging-net1-178618229", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.102", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "eafaf607b5ff4b448aaaea253a321827", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f7c87ad-40", "ovs_interfaceid": "0f7c87ad-4076-4aca-8d9b-1fae099dd325", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d6b517e2-8788-4775-b327-11601713da4d", "address": "fa:16:3e:81:5a:0a", "network": {"id": "85a74d82-5c98-4f2b-a38d-3e9ebe6a1e13", "bridge": "br-int", "label": "tempest-device-tagging-net1-178618229", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.253", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "eafaf607b5ff4b448aaaea253a321827", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6b517e2-87", "ovs_interfaceid": "d6b517e2-8788-4775-b327-11601713da4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b0183e60-7f49-44a1-a24c-30db287f2453", "address": "fa:16:3e:b2:23:6e", "network": {"id": "a9e0ac50-1fbb-4d94-a22f-6fcf40dd0194", "bridge": "br-int", "label": "tempest-device-tagging-net2-947660195", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "eafaf607b5ff4b448aaaea253a321827", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0183e60-7f", "ovs_interfaceid": "b0183e60-7f49-44a1-a24c-30db287f2453", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "21180772-80b3-48e1-90e9-39590611ff08", "address": "fa:16:3e:c1:ed:f9", "network": {"id": "a9e0ac50-1fbb-4d94-a22f-6fcf40dd0194", "bridge": "br-int", "label": "tempest-device-tagging-net2-947660195", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "eafaf607b5ff4b448aaaea253a321827", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21180772-80", "ovs_interfaceid": "21180772-80b3-48e1-90e9-39590611ff08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:13:22 user nova-compute[85141]: INFO nova.compute.manager [None req-e3c2ed09-bd60-46a3-a5d8-0c2fb1d60d80 tempest-AttachSCSIVolumeTestJSON-1774410022 tempest-AttachSCSIVolumeTestJSON-1774410022-project-member] [instance: ff964caf-b473-47bc-89d2-f7189264721c] Took 1.16 seconds to destroy the instance on the hypervisor.
Nov 16 10:13:22 user nova-compute[85141]: DEBUG oslo.service.loopingcall [None req-e3c2ed09-bd60-46a3-a5d8-0c2fb1d60d80 tempest-AttachSCSIVolumeTestJSON-1774410022 tempest-AttachSCSIVolumeTestJSON-1774410022-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=85141) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 10:13:22 user nova-compute[85141]: DEBUG nova.compute.manager [-] [instance: ff964caf-b473-47bc-89d2-f7189264721c] Deallocating network for instance {{(pid=85141) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 10:13:22 user nova-compute[85141]: DEBUG nova.network.neutron [-] [instance: ff964caf-b473-47bc-89d2-f7189264721c] deallocate_for_instance() {{(pid=85141) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 10:13:22 user nova-compute[85141]: DEBUG nova.compute.manager [req-07c1eccd-691d-4b1d-9f75-bae9ef6c1f95 req-c3d40897-12ad-4ef0-b4b0-42badaa7411d service nova] [instance: eef3cc09-054b-4a17-b621-4f3737d5420e] Detach interface failed, port_id=277c1d3d-ed49-4b8c-82e3-902fa6c8a2f5, reason: Instance eef3cc09-054b-4a17-b621-4f3737d5420e could not be found. {{(pid=85141) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 16 10:13:22 user nova-compute[85141]: DEBUG nova.compute.manager [req-07c1eccd-691d-4b1d-9f75-bae9ef6c1f95 req-c3d40897-12ad-4ef0-b4b0-42badaa7411d service nova] [instance: ff964caf-b473-47bc-89d2-f7189264721c] Received event network-vif-unplugged-75922f14-4d10-428a-baf5-bc27dfa373a6 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:13:22 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-07c1eccd-691d-4b1d-9f75-bae9ef6c1f95 req-c3d40897-12ad-4ef0-b4b0-42badaa7411d service nova] Acquiring lock "ff964caf-b473-47bc-89d2-f7189264721c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:13:22 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-07c1eccd-691d-4b1d-9f75-bae9ef6c1f95 req-c3d40897-12ad-4ef0-b4b0-42badaa7411d service nova] Lock "ff964caf-b473-47bc-89d2-f7189264721c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:13:22 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-07c1eccd-691d-4b1d-9f75-bae9ef6c1f95 req-c3d40897-12ad-4ef0-b4b0-42badaa7411d service nova] Lock "ff964caf-b473-47bc-89d2-f7189264721c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:13:22 user nova-compute[85141]: DEBUG nova.compute.manager [req-07c1eccd-691d-4b1d-9f75-bae9ef6c1f95 req-c3d40897-12ad-4ef0-b4b0-42badaa7411d service nova] [instance: ff964caf-b473-47bc-89d2-f7189264721c] No waiting events found dispatching network-vif-unplugged-75922f14-4d10-428a-baf5-bc27dfa373a6 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:13:22 user nova-compute[85141]: DEBUG nova.compute.manager [req-07c1eccd-691d-4b1d-9f75-bae9ef6c1f95 req-c3d40897-12ad-4ef0-b4b0-42badaa7411d service nova] [instance: ff964caf-b473-47bc-89d2-f7189264721c] Received event network-vif-unplugged-75922f14-4d10-428a-baf5-bc27dfa373a6 for instance with task_state deleting. {{(pid=85141) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 10:13:22 user nova-compute[85141]: DEBUG nova.compute.manager [req-07c1eccd-691d-4b1d-9f75-bae9ef6c1f95 req-c3d40897-12ad-4ef0-b4b0-42badaa7411d service nova] [instance: eef3cc09-054b-4a17-b621-4f3737d5420e] Received event network-vif-deleted-21180772-80b3-48e1-90e9-39590611ff08 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:13:22 user nova-compute[85141]: INFO nova.compute.manager [req-07c1eccd-691d-4b1d-9f75-bae9ef6c1f95 req-c3d40897-12ad-4ef0-b4b0-42badaa7411d service nova] [instance: eef3cc09-054b-4a17-b621-4f3737d5420e] Neutron deleted interface 21180772-80b3-48e1-90e9-39590611ff08; detaching it from the instance and deleting it from the info cache
Nov 16 10:13:22 user nova-compute[85141]: DEBUG nova.network.neutron [req-07c1eccd-691d-4b1d-9f75-bae9ef6c1f95 req-c3d40897-12ad-4ef0-b4b0-42badaa7411d service nova] [instance: eef3cc09-054b-4a17-b621-4f3737d5420e] Updating instance_info_cache with network_info: [{"id": "f742ff18-5ea3-42a0-b229-27a32badce8a", "address": "fa:16:3e:38:78:2d", "network": {"id": "85a74d82-5c98-4f2b-a38d-3e9ebe6a1e13", "bridge": "br-int", "label": "tempest-device-tagging-net1-178618229", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.216", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "eafaf607b5ff4b448aaaea253a321827", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf742ff18-5e", "ovs_interfaceid": "f742ff18-5ea3-42a0-b229-27a32badce8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0f7c87ad-4076-4aca-8d9b-1fae099dd325", "address": "fa:16:3e:7a:05:a4", "network": {"id": "85a74d82-5c98-4f2b-a38d-3e9ebe6a1e13", "bridge": "br-int", "label": "tempest-device-tagging-net1-178618229", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.102", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "eafaf607b5ff4b448aaaea253a321827", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f7c87ad-40", "ovs_interfaceid": "0f7c87ad-4076-4aca-8d9b-1fae099dd325", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d6b517e2-8788-4775-b327-11601713da4d", "address": "fa:16:3e:81:5a:0a", "network": {"id": "85a74d82-5c98-4f2b-a38d-3e9ebe6a1e13", "bridge": "br-int", "label": "tempest-device-tagging-net1-178618229", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.253", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "eafaf607b5ff4b448aaaea253a321827", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6b517e2-87", "ovs_interfaceid": "d6b517e2-8788-4775-b327-11601713da4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b0183e60-7f49-44a1-a24c-30db287f2453", "address": "fa:16:3e:b2:23:6e", "network": {"id": "a9e0ac50-1fbb-4d94-a22f-6fcf40dd0194", "bridge": "br-int", "label": "tempest-device-tagging-net2-947660195", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "eafaf607b5ff4b448aaaea253a321827", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0183e60-7f", "ovs_interfaceid": "b0183e60-7f49-44a1-a24c-30db287f2453", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:13:22 user nova-compute[85141]: DEBUG nova.virt.libvirt.guest [None req-2e3c140e-c9f9-46ce-a537-0787e8739533 tempest-TestVolumeSwap-1037451778 tempest-TestVolumeSwap-1037451778-project-admin] COPY block job progress, current cursor: 927989760 final cursor: 1073741824 {{(pid=85141) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 10:13:22 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e65ccf79-718d-4eeb-8914-f0db2e2c9ce2/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:13:22 user nova-compute[85141]: DEBUG nova.compute.manager [req-07c1eccd-691d-4b1d-9f75-bae9ef6c1f95 req-c3d40897-12ad-4ef0-b4b0-42badaa7411d service nova] [instance: eef3cc09-054b-4a17-b621-4f3737d5420e] Detach interface failed, port_id=21180772-80b3-48e1-90e9-39590611ff08, reason: Instance eef3cc09-054b-4a17-b621-4f3737d5420e could not be found. {{(pid=85141) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 16 10:13:22 user nova-compute[85141]: DEBUG nova.compute.manager [req-07c1eccd-691d-4b1d-9f75-bae9ef6c1f95 req-c3d40897-12ad-4ef0-b4b0-42badaa7411d service nova] [instance: ff964caf-b473-47bc-89d2-f7189264721c] Received event network-vif-plugged-75922f14-4d10-428a-baf5-bc27dfa373a6 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:13:22 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-07c1eccd-691d-4b1d-9f75-bae9ef6c1f95 req-c3d40897-12ad-4ef0-b4b0-42badaa7411d service nova] Acquiring lock "ff964caf-b473-47bc-89d2-f7189264721c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:13:22 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-07c1eccd-691d-4b1d-9f75-bae9ef6c1f95 req-c3d40897-12ad-4ef0-b4b0-42badaa7411d service nova] Lock "ff964caf-b473-47bc-89d2-f7189264721c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:13:22 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-07c1eccd-691d-4b1d-9f75-bae9ef6c1f95 req-c3d40897-12ad-4ef0-b4b0-42badaa7411d service nova] Lock "ff964caf-b473-47bc-89d2-f7189264721c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:13:22 user nova-compute[85141]: DEBUG nova.compute.manager [req-07c1eccd-691d-4b1d-9f75-bae9ef6c1f95 req-c3d40897-12ad-4ef0-b4b0-42badaa7411d service nova] [instance: ff964caf-b473-47bc-89d2-f7189264721c] No waiting events found dispatching network-vif-plugged-75922f14-4d10-428a-baf5-bc27dfa373a6 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:13:22 user nova-compute[85141]: WARNING nova.compute.manager [req-07c1eccd-691d-4b1d-9f75-bae9ef6c1f95 req-c3d40897-12ad-4ef0-b4b0-42badaa7411d service nova] [instance: ff964caf-b473-47bc-89d2-f7189264721c] Received unexpected event network-vif-plugged-75922f14-4d10-428a-baf5-bc27dfa373a6 for instance with vm_state active and task_state deleting.
Nov 16 10:13:22 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e65ccf79-718d-4eeb-8914-f0db2e2c9ce2/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:13:22 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e65ccf79-718d-4eeb-8914-f0db2e2c9ce2/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:13:22 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e65ccf79-718d-4eeb-8914-f0db2e2c9ce2/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:13:22 user nova-compute[85141]: DEBUG nova.virt.libvirt.guest [None req-2e3c140e-c9f9-46ce-a537-0787e8739533 tempest-TestVolumeSwap-1037451778 tempest-TestVolumeSwap-1037451778-project-admin] COPY block job progress, current cursor: 1055916032 final cursor: 1073741824 {{(pid=85141) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 10:13:22 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/361a2044-8fd0-4975-8a19-814bf7a6da41/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:13:23 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:13:23 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/361a2044-8fd0-4975-8a19-814bf7a6da41/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:13:23 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/361a2044-8fd0-4975-8a19-814bf7a6da41/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:13:23 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/361a2044-8fd0-4975-8a19-814bf7a6da41/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:13:23 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ca61bd2-268e-4c49-ba04-a5cb39143a9b/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:13:23 user nova-compute[85141]: DEBUG nova.virt.libvirt.guest [None req-2e3c140e-c9f9-46ce-a537-0787e8739533 tempest-TestVolumeSwap-1037451778 tempest-TestVolumeSwap-1037451778-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=85141) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 10:13:23 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2e3c140e-c9f9-46ce-a537-0787e8739533 tempest-TestVolumeSwap-1037451778 tempest-TestVolumeSwap-1037451778-project-admin] [instance: ad1ace46-2e8e-42e1-a0f5-2384078fcf09] calling os-brick to detach iSCSI Volume {{(pid=85141) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 10:13:23 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e3c140e-c9f9-46ce-a537-0787e8739533 tempest-TestVolumeSwap-1037451778 tempest-TestVolumeSwap-1037451778-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51806b6080>, {'target_iqn': 'iqn.2010-10.org.openstack:eb0e3ad6-04d7-4405-b4ae-0440b2a396ce', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TGILpNCR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj', 'volume_id': 'eb0e3ad6-04d7-4405-b4ae-0440b2a396ce'}, None), 'kwargs': False}}" {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 10:13:23 user nova-compute[85141]: WARNING os_brick.initiator.connectors.base [None req-2e3c140e-c9f9-46ce-a537-0787e8739533 tempest-TestVolumeSwap-1037451778 tempest-TestVolumeSwap-1037451778-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 10:13:23 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-2e3c140e-c9f9-46ce-a537-0787e8739533 tempest-TestVolumeSwap-1037451778 tempest-TestVolumeSwap-1037451778-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 10:13:23 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-2e3c140e-c9f9-46ce-a537-0787e8739533 tempest-TestVolumeSwap-1037451778 tempest-TestVolumeSwap-1037451778-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.004s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 10:13:23 user nova-compute[85141]: DEBUG nova.network.neutron [-] [instance: eef3cc09-054b-4a17-b621-4f3737d5420e] Updating instance_info_cache with network_info: [] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:13:23 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:13:23 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ca61bd2-268e-4c49-ba04-a5cb39143a9b/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:13:23 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ca61bd2-268e-4c49-ba04-a5cb39143a9b/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:13:23 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:13:23 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef16f918-6f0c-48b9-bdcb-f0bdb8e8e220]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ba7ca2a3-5f1e-4544-852f-d57100b608e3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7e233047-dda3-4f2e-803c-7b69a57ac656\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:eb0e3ad6-04d7-4405-b4ae-0440b2a396ce\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:42c041ec-fa39-4035-b82b-867caf3565df\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:13:23 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e3c140e-c9f9-46ce-a537-0787e8739533 tempest-TestVolumeSwap-1037451778 tempest-TestVolumeSwap-1037451778-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 10:13:23 user nova-compute[85141]: No targets found.
Nov 16 10:13:23 user nova-compute[85141]: iSNS:
Nov 16 10:13:23 user nova-compute[85141]: No targets found.
Nov 16 10:13:23 user nova-compute[85141]: STATIC:
Nov 16 10:13:23 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:ba7ca2a3-5f1e-4544-852f-d57100b608e3
Nov 16 10:13:23 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:13:23 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:13:23 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:7e233047-dda3-4f2e-803c-7b69a57ac656
Nov 16 10:13:23 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:13:23 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:13:23 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:eb0e3ad6-04d7-4405-b4ae-0440b2a396ce
Nov 16 10:13:23 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:13:23 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:13:23 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:42c041ec-fa39-4035-b82b-867caf3565df
Nov 16 10:13:23 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:13:23 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:13:23 user nova-compute[85141]: FIRMWARE:
Nov 16 10:13:23 user nova-compute[85141]: No targets found.
Nov 16 10:13:23 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:13:23 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e3c140e-c9f9-46ce-a537-0787e8739533 tempest-TestVolumeSwap-1037451778 tempest-TestVolumeSwap-1037451778-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 10:13:23 user nova-compute[85141]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 10:13:23 user nova-compute[85141]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=85141) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 10:13:23 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e3c140e-c9f9-46ce-a537-0787e8739533 tempest-TestVolumeSwap-1037451778 tempest-TestVolumeSwap-1037451778-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eb0e3ad6-04d7-4405-b4ae-0440b2a396ce', 0)] {{(pid=85141) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 10:13:23 user nova-compute[85141]: INFO nova.compute.manager [-] [instance: eef3cc09-054b-4a17-b621-4f3737d5420e] Took 5.83 seconds to deallocate network for instance.
Nov 16 10:13:23 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:13:23 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:13:23 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[74b1d241-1784-4fcd-8519-94086d940c04]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:42c041ec-fa39-4035-b82b-867caf3565df\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7e233047-dda3-4f2e-803c-7b69a57ac656\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ba7ca2a3-5f1e-4544-852f-d57100b608e3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eb0e3ad6-04d7-4405-b4ae-0440b2a396ce\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:13:23 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:13:23 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:13:23 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbe09e72-64f4-45db-8c49-4fad6aeb812a]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb0e3ad6-04d7-4405-b4ae-0440b2a396ce (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba7ca2a3-5f1e-4544-852f-d57100b608e3 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42c041ec-fa39-4035-b82b-867caf3565df (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e233047-dda3-4f2e-803c-7b69a57ac656 (non-flash)\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:13:23 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e3c140e-c9f9-46ce-a537-0787e8739533 tempest-TestVolumeSwap-1037451778 tempest-TestVolumeSwap-1037451778-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb0e3ad6-04d7-4405-b4ae-0440b2a396ce (non-flash)
Nov 16 10:13:23 user nova-compute[85141]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba7ca2a3-5f1e-4544-852f-d57100b608e3 (non-flash)
Nov 16 10:13:23 user nova-compute[85141]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42c041ec-fa39-4035-b82b-867caf3565df (non-flash)
Nov 16 10:13:23 user nova-compute[85141]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e233047-dda3-4f2e-803c-7b69a57ac656 (non-flash)
Nov 16 10:13:23 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:13:23 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e3c140e-c9f9-46ce-a537-0787e8739533 tempest-TestVolumeSwap-1037451778 tempest-TestVolumeSwap-1037451778-project-admin] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb0e3ad6-04d7-4405-b4ae-0440b2a396ce (non-flash)
Nov 16 10:13:23 user nova-compute[85141]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba7ca2a3-5f1e-4544-852f-d57100b608e3 (non-flash)
Nov 16 10:13:23 user nova-compute[85141]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42c041ec-fa39-4035-b82b-867caf3565df (non-flash)
Nov 16 10:13:23 user nova-compute[85141]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e233047-dda3-4f2e-803c-7b69a57ac656 (non-flash)
Nov 16 10:13:23 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 10:13:23 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e3c140e-c9f9-46ce-a537-0787e8739533 tempest-TestVolumeSwap-1037451778 tempest-TestVolumeSwap-1037451778-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f51a38ddf30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eb0e3ad6-04d7-4405-b4ae-0440b2a396ce'): ({'sdj'}, set())}) {{(pid=85141) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 10:13:23 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-2e3c140e-c9f9-46ce-a537-0787e8739533 tempest-TestVolumeSwap-1037451778 tempest-TestVolumeSwap-1037451778-project-admin] Removing single pathed devices sdj {{(pid=85141) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 10:13:23 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:13:23 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:13:23 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[46f26a63-cb2e-48eb-a323-c2139352f123]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:13:23 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:13:23 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.019s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:13:23 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[704befab-1fcd-4cad-ab22-e0b09ade9c01]: (4, ('ok\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:13:23 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-2e3c140e-c9f9-46ce-a537-0787e8739533 tempest-TestVolumeSwap-1037451778 tempest-TestVolumeSwap-1037451778-project-admin] Flushing IO for device /dev/sdj {{(pid=85141) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 10:13:23 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:13:23 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.013s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:13:23 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8dd37a2-3018-4a52-8284-6f35fb4bd759]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:13:23 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-2e3c140e-c9f9-46ce-a537-0787e8739533 tempest-TestVolumeSwap-1037451778 tempest-TestVolumeSwap-1037451778-project-admin] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=85141) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 10:13:23 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ca61bd2-268e-4c49-ba04-a5cb39143a9b/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:13:23 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:13:23 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d842f90e-663b-4c95-9d7c-d092d2bac41f/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:13:23 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.072s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:13:23 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[f18f0cb5-0cce-4c9e-864d-92fd37e66d62]: (4, ('1', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:13:23 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-2e3c140e-c9f9-46ce-a537-0787e8739533 tempest-TestVolumeSwap-1037451778 tempest-TestVolumeSwap-1037451778-project-admin] Checking to see if SCSI volumes sdj have been removed. {{(pid=85141) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 10:13:23 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-2e3c140e-c9f9-46ce-a537-0787e8739533 tempest-TestVolumeSwap-1037451778 tempest-TestVolumeSwap-1037451778-project-admin] SCSI volumes sdj have been removed. {{(pid=85141) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 10:13:23 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e3c140e-c9f9-46ce-a537-0787e8739533 tempest-TestVolumeSwap-1037451778 tempest-TestVolumeSwap-1037451778-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eb0e3ad6-04d7-4405-b4ae-0440b2a396ce')] {{(pid=85141) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 10:13:23 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb0e3ad6-04d7-4405-b4ae-0440b2a396ce -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:13:23 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb0e3ad6-04d7-4405-b4ae-0440b2a396ce -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:13:23 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ff6af1c-432e-459d-bfb9-51dcc8deede1]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:13:23 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e3c140e-c9f9-46ce-a537-0787e8739533 tempest-TestVolumeSwap-1037451778 tempest-TestVolumeSwap-1037451778-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:13:23 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb0e3ad6-04d7-4405-b4ae-0440b2a396ce -p 172.16.0.220:3260 --logout {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:13:23 user nova-compute[85141]: DEBUG nova.network.neutron [-] [instance: ff964caf-b473-47bc-89d2-f7189264721c] Updating instance_info_cache with network_info: [] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:13:23 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb0e3ad6-04d7-4405-b4ae-0440b2a396ce -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:13:23 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[edd0dce3-1616-4060-9af0-a611d52fec8b]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:eb0e3ad6-04d7-4405-b4ae-0440b2a396ce, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:eb0e3ad6-04d7-4405-b4ae-0440b2a396ce, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:13:23 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e3c140e-c9f9-46ce-a537-0787e8739533 tempest-TestVolumeSwap-1037451778 tempest-TestVolumeSwap-1037451778-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:eb0e3ad6-04d7-4405-b4ae-0440b2a396ce, portal: 172.16.0.220,3260]
Nov 16 10:13:23 user nova-compute[85141]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:eb0e3ad6-04d7-4405-b4ae-0440b2a396ce, portal: 172.16.0.220,3260] successful.
Nov 16 10:13:23 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:13:23 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb0e3ad6-04d7-4405-b4ae-0440b2a396ce -p 172.16.0.220:3260 --op delete {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:13:23 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb0e3ad6-04d7-4405-b4ae-0440b2a396ce -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:13:23 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[537ff3db-c9c7-4708-9521-c1ed835a4538]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:13:23 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e3c140e-c9f9-46ce-a537-0787e8739533 tempest-TestVolumeSwap-1037451778 tempest-TestVolumeSwap-1037451778-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:13:23 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-2e3c140e-c9f9-46ce-a537-0787e8739533 tempest-TestVolumeSwap-1037451778 tempest-TestVolumeSwap-1037451778-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.418s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 10:13:23 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e3c140e-c9f9-46ce-a537-0787e8739533 tempest-TestVolumeSwap-1037451778 tempest-TestVolumeSwap-1037451778-project-admin] <== disconnect_volume: return (423ms) None {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 10:13:23 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2e3c140e-c9f9-46ce-a537-0787e8739533 tempest-TestVolumeSwap-1037451778 tempest-TestVolumeSwap-1037451778-project-admin] [instance: ad1ace46-2e8e-42e1-a0f5-2384078fcf09] Disconnected iSCSI Volume {{(pid=85141) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 10:13:23 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d842f90e-663b-4c95-9d7c-d092d2bac41f/disk --force-share --output=json" returned: 0 in 0.287s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:13:24 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d842f90e-663b-4c95-9d7c-d092d2bac41f/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:13:24 user nova-compute[85141]: INFO nova.compute.manager [-] [instance: ff964caf-b473-47bc-89d2-f7189264721c] Took 1.75 seconds to deallocate network for instance.
Nov 16 10:13:24 user nova-compute[85141]: DEBUG nova.compute.manager [None req-2e3c140e-c9f9-46ce-a537-0787e8739533 tempest-TestVolumeSwap-1037451778 tempest-TestVolumeSwap-1037451778-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:7e233047-dda3-4f2e-803c-7b69a57ac656', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UtNLBDJC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, 'status': 'reserved', 'instance': 'ad1ace46-2e8e-42e1-a0f5-2384078fcf09', 'attached_at': '', 'detached_at': '', 'volume_id': '7e233047-dda3-4f2e-803c-7b69a57ac656', 'serial'} {{(pid=85141) _swap_volume /opt/stack/nova/nova/compute/manager.py:7791}}
Nov 16 10:13:24 user nova-compute[85141]: DEBUG nova.compute.manager [None req-2e3c140e-c9f9-46ce-a537-0787e8739533 tempest-TestVolumeSwap-1037451778 tempest-TestVolumeSwap-1037451778-project-admin] [instance: ad1ace46-2e8e-42e1-a0f5-2384078fcf09] swap_volume: removing Cinder connection for volume eb0e3ad6-04d7-4405-b4ae-0440b2a396ce {{(pid=85141) _swap_volume /opt/stack/nova/nova/compute/manager.py:7836}}
Nov 16 10:13:24 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-e3c2ed09-bd60-46a3-a5d8-0c2fb1d60d80 tempest-AttachSCSIVolumeTestJSON-1774410022 tempest-AttachSCSIVolumeTestJSON-1774410022-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:13:24 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-e3c2ed09-bd60-46a3-a5d8-0c2fb1d60d80 tempest-AttachSCSIVolumeTestJSON-1774410022 tempest-AttachSCSIVolumeTestJSON-1774410022-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:13:24 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d842f90e-663b-4c95-9d7c-d092d2bac41f/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:13:24 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Error from libvirt while getting description of instance-00000007: [Error Code 42] Domain not found: no domain with matching uuid 'ff964caf-b473-47bc-89d2-f7189264721c' (instance-00000007): libvirt.libvirtError: Domain not found: no domain with matching uuid 'ff964caf-b473-47bc-89d2-f7189264721c' (instance-00000007)
Nov 16 10:13:24 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad1ace46-2e8e-42e1-a0f5-2384078fcf09/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:13:24 user nova-compute[85141]: DEBUG nova.compute.manager [req-fc0ade04-6eec-4aca-9b01-13d10b0733d8 req-61efc214-e204-45d2-80c1-7f05065f18dd service nova] [instance: 0ca61bd2-268e-4c49-ba04-a5cb39143a9b] Received event network-vif-plugged-0fd660bd-1d7b-45d1-8906-d20417082456 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:13:24 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-fc0ade04-6eec-4aca-9b01-13d10b0733d8 req-61efc214-e204-45d2-80c1-7f05065f18dd service nova] Acquiring lock "0ca61bd2-268e-4c49-ba04-a5cb39143a9b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:13:24 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-fc0ade04-6eec-4aca-9b01-13d10b0733d8 req-61efc214-e204-45d2-80c1-7f05065f18dd service nova] Lock "0ca61bd2-268e-4c49-ba04-a5cb39143a9b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:13:24 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-fc0ade04-6eec-4aca-9b01-13d10b0733d8 req-61efc214-e204-45d2-80c1-7f05065f18dd service nova] Lock "0ca61bd2-268e-4c49-ba04-a5cb39143a9b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:13:24 user nova-compute[85141]: DEBUG nova.compute.manager [req-fc0ade04-6eec-4aca-9b01-13d10b0733d8 req-61efc214-e204-45d2-80c1-7f05065f18dd service nova] [instance: 0ca61bd2-268e-4c49-ba04-a5cb39143a9b] No waiting events found dispatching network-vif-plugged-0fd660bd-1d7b-45d1-8906-d20417082456 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:13:24 user nova-compute[85141]: WARNING nova.compute.manager [req-fc0ade04-6eec-4aca-9b01-13d10b0733d8 req-61efc214-e204-45d2-80c1-7f05065f18dd service nova] [instance: 0ca61bd2-268e-4c49-ba04-a5cb39143a9b] Received unexpected event network-vif-plugged-0fd660bd-1d7b-45d1-8906-d20417082456 for instance with vm_state active and task_state None.
Nov 16 10:13:24 user nova-compute[85141]: DEBUG nova.compute.manager [req-79343225-9c76-4131-a05d-c7daa8002efd req-59c993ec-c737-4196-87db-d5ba16ac80e3 service nova] [instance: eef3cc09-054b-4a17-b621-4f3737d5420e] Received event network-vif-deleted-d6b517e2-8788-4775-b327-11601713da4d {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:13:24 user nova-compute[85141]: DEBUG nova.compute.manager [req-79343225-9c76-4131-a05d-c7daa8002efd req-59c993ec-c737-4196-87db-d5ba16ac80e3 service nova] [instance: eef3cc09-054b-4a17-b621-4f3737d5420e] Received event network-vif-deleted-b0183e60-7f49-44a1-a24c-30db287f2453 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:13:24 user nova-compute[85141]: DEBUG nova.compute.manager [req-79343225-9c76-4131-a05d-c7daa8002efd req-59c993ec-c737-4196-87db-d5ba16ac80e3 service nova] [instance: ff964caf-b473-47bc-89d2-f7189264721c] Received event network-vif-deleted-75922f14-4d10-428a-baf5-bc27dfa373a6 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:13:24 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad1ace46-2e8e-42e1-a0f5-2384078fcf09/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:13:24 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad1ace46-2e8e-42e1-a0f5-2384078fcf09/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:13:24 user nova-compute[85141]: DEBUG nova.compute.provider_tree [None req-e3c2ed09-bd60-46a3-a5d8-0c2fb1d60d80 tempest-AttachSCSIVolumeTestJSON-1774410022 tempest-AttachSCSIVolumeTestJSON-1774410022-project-member] Inventory has not changed in ProviderTree for provider: bf8e0fa1-16b6-408f-9203-c4cd63916272 {{(pid=85141) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 10:13:24 user nova-compute[85141]: DEBUG nova.scheduler.client.report [None req-e3c2ed09-bd60-46a3-a5d8-0c2fb1d60d80 tempest-AttachSCSIVolumeTestJSON-1774410022 tempest-AttachSCSIVolumeTestJSON-1774410022-project-member] Inventory has not changed for provider bf8e0fa1-16b6-408f-9203-c4cd63916272 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=85141) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 10:13:24 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad1ace46-2e8e-42e1-a0f5-2384078fcf09/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:13:24 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=85141) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 10:13:24 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=85141) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 10:13:24 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e2ae11f-161c-4d13-a1a5-37d0a8150e6b/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:13:24 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-e3c2ed09-bd60-46a3-a5d8-0c2fb1d60d80 tempest-AttachSCSIVolumeTestJSON-1774410022 tempest-AttachSCSIVolumeTestJSON-1774410022-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.722s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:13:24 user nova-compute[85141]: INFO nova.scheduler.client.report [None req-e3c2ed09-bd60-46a3-a5d8-0c2fb1d60d80 tempest-AttachSCSIVolumeTestJSON-1774410022 tempest-AttachSCSIVolumeTestJSON-1774410022-project-member] Deleted allocations for instance ff964caf-b473-47bc-89d2-f7189264721c
Nov 16 10:13:24 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-e3c2ed09-bd60-46a3-a5d8-0c2fb1d60d80 tempest-AttachSCSIVolumeTestJSON-1774410022 tempest-AttachSCSIVolumeTestJSON-1774410022-project-member] Lock "ff964caf-b473-47bc-89d2-f7189264721c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.858s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:13:24 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e2ae11f-161c-4d13-a1a5-37d0a8150e6b/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:13:24 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e2ae11f-161c-4d13-a1a5-37d0a8150e6b/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:13:25 user nova-compute[85141]: DEBUG nova.compute.manager [None req-2e3c140e-c9f9-46ce-a537-0787e8739533 tempest-TestVolumeSwap-1037451778 tempest-TestVolumeSwap-1037451778-project-admin] [instance: ad1ace46-2e8e-42e1-a0f5-2384078fcf09] swap_volume: Updating volume eb0e3ad6-04d7-4405-b4ae-0440b2a396ce BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:7e233047-dda3-4f2e-803c-7b69a57ac656", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "UtNLBDJC", "auth_password": "Kz7uRmWxjNyAds", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdf", "volume_id": "7e233047-dda3-4f2e-803c-7b69a57ac656"}, "status": "reserved", "instance": "ad1ace46-2e8e-42e1-a0f5-2384078fcf09", "attached_at": "", "detached_at": "", "volume_id": "7e233047-dda3-4f2e-803c-7b69a57ac656", "serial": "7e233047-dda3-4f2e-803c-7b69a57ac656"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '7e233047-dda3-4f2e-803c-7b69a57ac656', 'no_device': None, 'attachment_id': '04eaa038-61fc-453b-8c6c-67466965624c'} {{(pid=85141) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7984}}
Nov 16 10:13:25 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-2e3c140e-c9f9-46ce-a537-0787e8739533 tempest-TestVolumeSwap-1037451778 tempest-TestVolumeSwap-1037451778-project-admin] Lock "ad1ace46-2e8e-42e1-a0f5-2384078fcf09" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 16.412s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:13:25 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e2ae11f-161c-4d13-a1a5-37d0a8150e6b/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:13:25 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:13:25 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:13:25 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:13:25 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Hypervisor/Node resource view: name=user free_ram=7727MB free_disk=25.430282592773438GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=85141) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 10:13:25 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:13:25 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:13:25 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance d842f90e-663b-4c95-9d7c-d092d2bac41f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:13:25 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance e65ccf79-718d-4eeb-8914-f0db2e2c9ce2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:13:25 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance 361a2044-8fd0-4975-8a19-814bf7a6da41 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:13:25 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance ad1ace46-2e8e-42e1-a0f5-2384078fcf09 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:13:25 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance 0ca61bd2-268e-4c49-ba04-a5cb39143a9b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:13:25 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance 6caf3667-5613-4ef4-a597-1820e6c1c0ac actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:13:25 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance 7e2ae11f-161c-4d13-a1a5-37d0a8150e6b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:13:25 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance eef3cc09-054b-4a17-b621-4f3737d5420e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:13:25 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=85141) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 10:13:25 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=85141) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 10:13:26 user nova-compute[85141]: DEBUG nova.compute.provider_tree [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Inventory has not changed in ProviderTree for provider: bf8e0fa1-16b6-408f-9203-c4cd63916272 {{(pid=85141) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 10:13:26 user nova-compute[85141]: DEBUG nova.scheduler.client.report [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Inventory has not changed for provider bf8e0fa1-16b6-408f-9203-c4cd63916272 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=85141) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 10:13:26 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Compute_service record updated for user:user {{(pid=85141) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 10:13:26 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.594s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:13:26 user nova-compute[85141]: INFO nova.compute.manager [None req-a33076d6-5841-4a55-8d9a-ab2ffc688743 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] [instance: eef3cc09-054b-4a17-b621-4f3737d5420e] Took 2.90 seconds to detach 3 volumes for instance.
Nov 16 10:13:26 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-ec25c880-8b57-4476-b347-2eb498c7d5cf tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Acquiring lock "f01dc8cf-1a69-4618-a15d-0c1075157f05" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:13:26 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-ec25c880-8b57-4476-b347-2eb498c7d5cf tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Lock "f01dc8cf-1a69-4618-a15d-0c1075157f05" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:13:26 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-a33076d6-5841-4a55-8d9a-ab2ffc688743 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:13:26 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-a33076d6-5841-4a55-8d9a-ab2ffc688743 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:13:26 user nova-compute[85141]: DEBUG nova.compute.manager [None req-ec25c880-8b57-4476-b347-2eb498c7d5cf tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] [instance: f01dc8cf-1a69-4618-a15d-0c1075157f05] Starting instance... {{(pid=85141) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 10:13:26 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-ec25c880-8b57-4476-b347-2eb498c7d5cf tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:13:26 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-6bae5a19-8207-4e63-b6bb-3b55bde6ac07 tempest-TestVolumeSwap-1428287604 tempest-TestVolumeSwap-1428287604-project-member] Acquiring lock "ad1ace46-2e8e-42e1-a0f5-2384078fcf09" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:13:26 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-6bae5a19-8207-4e63-b6bb-3b55bde6ac07 tempest-TestVolumeSwap-1428287604 tempest-TestVolumeSwap-1428287604-project-member] Lock "ad1ace46-2e8e-42e1-a0f5-2384078fcf09" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:13:26 user nova-compute[85141]: INFO nova.compute.manager [None req-6bae5a19-8207-4e63-b6bb-3b55bde6ac07 tempest-TestVolumeSwap-1428287604 tempest-TestVolumeSwap-1428287604-project-member] [instance: ad1ace46-2e8e-42e1-a0f5-2384078fcf09] Detaching volume 7e233047-dda3-4f2e-803c-7b69a57ac656
Nov 16 10:13:26 user nova-compute[85141]: INFO nova.virt.block_device [None req-6bae5a19-8207-4e63-b6bb-3b55bde6ac07 tempest-TestVolumeSwap-1428287604 tempest-TestVolumeSwap-1428287604-project-member] [instance: ad1ace46-2e8e-42e1-a0f5-2384078fcf09] Attempting to driver detach volume 7e233047-dda3-4f2e-803c-7b69a57ac656 from mountpoint /dev/vdb
Nov 16 10:13:26 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-6bae5a19-8207-4e63-b6bb-3b55bde6ac07 tempest-TestVolumeSwap-1428287604 tempest-TestVolumeSwap-1428287604-project-member] Attempting to detach device vdb from instance ad1ace46-2e8e-42e1-a0f5-2384078fcf09 from the persistent domain config. {{(pid=85141) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 10:13:26 user nova-compute[85141]: DEBUG nova.virt.libvirt.guest [None req-6bae5a19-8207-4e63-b6bb-3b55bde6ac07 tempest-TestVolumeSwap-1428287604 tempest-TestVolumeSwap-1428287604-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 10:13:26 user nova-compute[85141]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 10:13:26 user nova-compute[85141]:   <source dev="/dev/sdf"/>
Nov 16 10:13:26 user nova-compute[85141]:   <target dev="vdb" bus="virtio"/>
Nov 16 10:13:26 user nova-compute[85141]:   <serial>7e233047-dda3-4f2e-803c-7b69a57ac656</serial>
Nov 16 10:13:26 user nova-compute[85141]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 10:13:26 user nova-compute[85141]: </disk>
Nov 16 10:13:26 user nova-compute[85141]:  {{(pid=85141) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 10:13:26 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-6bae5a19-8207-4e63-b6bb-3b55bde6ac07 tempest-TestVolumeSwap-1428287604 tempest-TestVolumeSwap-1428287604-project-member] Successfully detached device vdb from instance ad1ace46-2e8e-42e1-a0f5-2384078fcf09 from the persistent domain config.
Nov 16 10:13:26 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-6bae5a19-8207-4e63-b6bb-3b55bde6ac07 tempest-TestVolumeSwap-1428287604 tempest-TestVolumeSwap-1428287604-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ad1ace46-2e8e-42e1-a0f5-2384078fcf09 from the live domain config. {{(pid=85141) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 10:13:26 user nova-compute[85141]: DEBUG nova.virt.libvirt.guest [None req-6bae5a19-8207-4e63-b6bb-3b55bde6ac07 tempest-TestVolumeSwap-1428287604 tempest-TestVolumeSwap-1428287604-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 10:13:26 user nova-compute[85141]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 10:13:26 user nova-compute[85141]:   <source dev="/dev/sdf"/>
Nov 16 10:13:26 user nova-compute[85141]:   <target dev="vdb" bus="virtio"/>
Nov 16 10:13:26 user nova-compute[85141]:   <serial>7e233047-dda3-4f2e-803c-7b69a57ac656</serial>
Nov 16 10:13:26 user nova-compute[85141]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 10:13:26 user nova-compute[85141]: </disk>
Nov 16 10:13:26 user nova-compute[85141]:  {{(pid=85141) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 10:13:26 user nova-compute[85141]: DEBUG nova.compute.provider_tree [None req-a33076d6-5841-4a55-8d9a-ab2ffc688743 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] Inventory has not changed in ProviderTree for provider: bf8e0fa1-16b6-408f-9203-c4cd63916272 {{(pid=85141) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 10:13:26 user nova-compute[85141]: DEBUG nova.scheduler.client.report [None req-a33076d6-5841-4a55-8d9a-ab2ffc688743 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] Inventory has not changed for provider bf8e0fa1-16b6-408f-9203-c4cd63916272 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=85141) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 10:13:27 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-a33076d6-5841-4a55-8d9a-ab2ffc688743 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.498s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:13:27 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-ec25c880-8b57-4476-b347-2eb498c7d5cf tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.392s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:13:27 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-ec25c880-8b57-4476-b347-2eb498c7d5cf tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=85141) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 10:13:27 user nova-compute[85141]: INFO nova.compute.claims [None req-ec25c880-8b57-4476-b347-2eb498c7d5cf tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] [instance: f01dc8cf-1a69-4618-a15d-0c1075157f05] Claim successful on node user
Nov 16 10:13:27 user nova-compute[85141]: INFO nova.scheduler.client.report [None req-a33076d6-5841-4a55-8d9a-ab2ffc688743 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] Deleted allocations for instance eef3cc09-054b-4a17-b621-4f3737d5420e
Nov 16 10:13:27 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:13:27 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:13:27 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-a33076d6-5841-4a55-8d9a-ab2ffc688743 tempest-TaggedBootDevicesTest_v242-1883132768 tempest-TaggedBootDevicesTest_v242-1883132768-project-member] Lock "eef3cc09-054b-4a17-b621-4f3737d5420e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 13.839s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:13:27 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-6bae5a19-8207-4e63-b6bb-3b55bde6ac07 tempest-TestVolumeSwap-1428287604 tempest-TestVolumeSwap-1428287604-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ad1ace46-2e8e-42e1-a0f5-2384078fcf09 {{(pid=85141) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 10:13:27 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:13:27 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:13:27 user nova-compute[85141]: DEBUG nova.compute.provider_tree [None req-ec25c880-8b57-4476-b347-2eb498c7d5cf tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Inventory has not changed in ProviderTree for provider: bf8e0fa1-16b6-408f-9203-c4cd63916272 {{(pid=85141) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 10:13:27 user nova-compute[85141]: DEBUG nova.scheduler.client.report [None req-ec25c880-8b57-4476-b347-2eb498c7d5cf tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Inventory has not changed for provider bf8e0fa1-16b6-408f-9203-c4cd63916272 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=85141) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 10:13:27 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-ec25c880-8b57-4476-b347-2eb498c7d5cf tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.354s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:13:27 user nova-compute[85141]: DEBUG nova.compute.manager [None req-ec25c880-8b57-4476-b347-2eb498c7d5cf tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] [instance: f01dc8cf-1a69-4618-a15d-0c1075157f05] Start building networks asynchronously for instance. {{(pid=85141) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 10:13:27 user nova-compute[85141]: DEBUG nova.compute.manager [None req-ec25c880-8b57-4476-b347-2eb498c7d5cf tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] [instance: f01dc8cf-1a69-4618-a15d-0c1075157f05] Allocating IP information in the background. {{(pid=85141) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 10:13:27 user nova-compute[85141]: DEBUG nova.network.neutron [None req-ec25c880-8b57-4476-b347-2eb498c7d5cf tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] [instance: f01dc8cf-1a69-4618-a15d-0c1075157f05] allocate_for_instance() {{(pid=85141) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 10:13:27 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-ec25c880-8b57-4476-b347-2eb498c7d5cf tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] [instance: f01dc8cf-1a69-4618-a15d-0c1075157f05] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 10:13:27 user nova-compute[85141]: DEBUG nova.compute.manager [None req-ec25c880-8b57-4476-b347-2eb498c7d5cf tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] [instance: f01dc8cf-1a69-4618-a15d-0c1075157f05] Start building block device mappings for instance. {{(pid=85141) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 10:13:27 user nova-compute[85141]: DEBUG nova.policy [None req-ec25c880-8b57-4476-b347-2eb498c7d5cf tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ffe6ceff3cc346b59b4fbf294b9fc1a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733b504d4dbe4f028963cf2c197f0064', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85141) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 10:13:27 user nova-compute[85141]: INFO nova.virt.block_device [None req-ec25c880-8b57-4476-b347-2eb498c7d5cf tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] [instance: f01dc8cf-1a69-4618-a15d-0c1075157f05] Booting with blank volume at /dev/vda
Nov 16 10:13:28 user nova-compute[85141]: DEBUG nova.network.neutron [None req-ec25c880-8b57-4476-b347-2eb498c7d5cf tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] [instance: f01dc8cf-1a69-4618-a15d-0c1075157f05] Successfully created port: 52edc378-51f4-43c3-b9f3-2d0201ed125d {{(pid=85141) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 10:13:28 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-c72cdda9-682a-44eb-a5c4-51216a8e3c94 tempest-VolumesAssistedSnapshotsTest-799935866 tempest-VolumesAssistedSnapshotsTest-799935866-project-admin] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 7e2ae11f-161c-4d13-a1a5-37d0a8150e6b is timed out.
Nov 16 10:13:28 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-c72cdda9-682a-44eb-a5c4-51216a8e3c94 tempest-VolumesAssistedSnapshotsTest-799935866 tempest-VolumesAssistedSnapshotsTest-799935866-project-admin] Successfully detached device vdb from instance 7e2ae11f-161c-4d13-a1a5-37d0a8150e6b from the live domain config.
Nov 16 10:13:28 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c72cdda9-682a-44eb-a5c4-51216a8e3c94 tempest-VolumesAssistedSnapshotsTest-799935866 tempest-VolumesAssistedSnapshotsTest-799935866-project-admin] [instance: 7e2ae11f-161c-4d13-a1a5-37d0a8150e6b] calling os-brick to detach iSCSI Volume {{(pid=85141) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 10:13:28 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-c72cdda9-682a-44eb-a5c4-51216a8e3c94 tempest-VolumesAssistedSnapshotsTest-799935866 tempest-VolumesAssistedSnapshotsTest-799935866-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51806b6080>, {'target_iqn': 'iqn.2010-10.org.openstack:ba7ca2a3-5f1e-4544-852f-d57100b608e3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mXecbdDQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': False}}" {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 10:13:28 user nova-compute[85141]: WARNING os_brick.initiator.connectors.base [None req-c72cdda9-682a-44eb-a5c4-51216a8e3c94 tempest-VolumesAssistedSnapshotsTest-799935866 tempest-VolumesAssistedSnapshotsTest-799935866-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 10:13:28 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-c72cdda9-682a-44eb-a5c4-51216a8e3c94 tempest-VolumesAssistedSnapshotsTest-799935866 tempest-VolumesAssistedSnapshotsTest-799935866-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 10:13:28 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-c72cdda9-682a-44eb-a5c4-51216a8e3c94 tempest-VolumesAssistedSnapshotsTest-799935866 tempest-VolumesAssistedSnapshotsTest-799935866-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 10:13:28 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:13:28 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:13:28 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5d4c431-0fb6-4082-9890-ef22f3e231ff]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ba7ca2a3-5f1e-4544-852f-d57100b608e3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7e233047-dda3-4f2e-803c-7b69a57ac656\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:42c041ec-fa39-4035-b82b-867caf3565df\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:13:28 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-c72cdda9-682a-44eb-a5c4-51216a8e3c94 tempest-VolumesAssistedSnapshotsTest-799935866 tempest-VolumesAssistedSnapshotsTest-799935866-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 10:13:28 user nova-compute[85141]: No targets found.
Nov 16 10:13:28 user nova-compute[85141]: iSNS:
Nov 16 10:13:28 user nova-compute[85141]: No targets found.
Nov 16 10:13:28 user nova-compute[85141]: STATIC:
Nov 16 10:13:28 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:ba7ca2a3-5f1e-4544-852f-d57100b608e3
Nov 16 10:13:28 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:13:28 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:13:28 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:7e233047-dda3-4f2e-803c-7b69a57ac656
Nov 16 10:13:28 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:13:28 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:13:28 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:42c041ec-fa39-4035-b82b-867caf3565df
Nov 16 10:13:28 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:13:28 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:13:28 user nova-compute[85141]: FIRMWARE:
Nov 16 10:13:28 user nova-compute[85141]: No targets found.
Nov 16 10:13:28 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:13:28 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-c72cdda9-682a-44eb-a5c4-51216a8e3c94 tempest-VolumesAssistedSnapshotsTest-799935866 tempest-VolumesAssistedSnapshotsTest-799935866-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 10:13:28 user nova-compute[85141]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 10:13:28 user nova-compute[85141]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=85141) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 10:13:28 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-c72cdda9-682a-44eb-a5c4-51216a8e3c94 tempest-VolumesAssistedSnapshotsTest-799935866 tempest-VolumesAssistedSnapshotsTest-799935866-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ba7ca2a3-5f1e-4544-852f-d57100b608e3', 0)] {{(pid=85141) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 10:13:28 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:13:28 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:13:28 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[97d83399-91f3-4b9d-a420-8664fdae43c9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:42c041ec-fa39-4035-b82b-867caf3565df\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7e233047-dda3-4f2e-803c-7b69a57ac656\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ba7ca2a3-5f1e-4544-852f-d57100b608e3\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:13:28 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:13:28 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:13:28 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3031bba-8bad-43da-bcfd-ead59ab1dcb0]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba7ca2a3-5f1e-4544-852f-d57100b608e3 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42c041ec-fa39-4035-b82b-867caf3565df (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e233047-dda3-4f2e-803c-7b69a57ac656 (non-flash)\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:13:28 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-c72cdda9-682a-44eb-a5c4-51216a8e3c94 tempest-VolumesAssistedSnapshotsTest-799935866 tempest-VolumesAssistedSnapshotsTest-799935866-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba7ca2a3-5f1e-4544-852f-d57100b608e3 (non-flash)
Nov 16 10:13:28 user nova-compute[85141]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42c041ec-fa39-4035-b82b-867caf3565df (non-flash)
Nov 16 10:13:28 user nova-compute[85141]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e233047-dda3-4f2e-803c-7b69a57ac656 (non-flash)
Nov 16 10:13:28 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:13:28 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-c72cdda9-682a-44eb-a5c4-51216a8e3c94 tempest-VolumesAssistedSnapshotsTest-799935866 tempest-VolumesAssistedSnapshotsTest-799935866-project-admin] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba7ca2a3-5f1e-4544-852f-d57100b608e3 (non-flash)
Nov 16 10:13:28 user nova-compute[85141]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42c041ec-fa39-4035-b82b-867caf3565df (non-flash)
Nov 16 10:13:28 user nova-compute[85141]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e233047-dda3-4f2e-803c-7b69a57ac656 (non-flash)
Nov 16 10:13:28 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 10:13:28 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-c72cdda9-682a-44eb-a5c4-51216a8e3c94 tempest-VolumesAssistedSnapshotsTest-799935866 tempest-VolumesAssistedSnapshotsTest-799935866-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5198185900>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ba7ca2a3-5f1e-4544-852f-d57100b608e3'): ({'sdi'}, set())}) {{(pid=85141) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 10:13:28 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-c72cdda9-682a-44eb-a5c4-51216a8e3c94 tempest-VolumesAssistedSnapshotsTest-799935866 tempest-VolumesAssistedSnapshotsTest-799935866-project-admin] Removing single pathed devices sdi {{(pid=85141) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 10:13:28 user nova-compute[85141]: DEBUG nova.network.neutron [None req-ec25c880-8b57-4476-b347-2eb498c7d5cf tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] [instance: f01dc8cf-1a69-4618-a15d-0c1075157f05] Successfully updated port: 52edc378-51f4-43c3-b9f3-2d0201ed125d {{(pid=85141) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 10:13:28 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:13:28 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-ec25c880-8b57-4476-b347-2eb498c7d5cf tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Acquiring lock "refresh_cache-f01dc8cf-1a69-4618-a15d-0c1075157f05" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:13:28 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-ec25c880-8b57-4476-b347-2eb498c7d5cf tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Acquired lock "refresh_cache-f01dc8cf-1a69-4618-a15d-0c1075157f05" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:13:28 user nova-compute[85141]: DEBUG nova.network.neutron [None req-ec25c880-8b57-4476-b347-2eb498c7d5cf tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] [instance: f01dc8cf-1a69-4618-a15d-0c1075157f05] Building network info cache for instance {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 10:13:28 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:13:28 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[710965b0-9356-4ddc-818b-6233e6daebea]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:13:28 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:13:28 user nova-compute[85141]: DEBUG nova.compute.manager [req-513abddd-b29d-4058-b0a9-acdd3dddae5b req-82248774-d047-4a0a-b8b0-fcde570cd6ac service nova] [instance: f01dc8cf-1a69-4618-a15d-0c1075157f05] Received event network-changed-52edc378-51f4-43c3-b9f3-2d0201ed125d {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:13:28 user nova-compute[85141]: DEBUG nova.compute.manager [req-513abddd-b29d-4058-b0a9-acdd3dddae5b req-82248774-d047-4a0a-b8b0-fcde570cd6ac service nova] [instance: f01dc8cf-1a69-4618-a15d-0c1075157f05] Refreshing instance network info cache due to event network-changed-52edc378-51f4-43c3-b9f3-2d0201ed125d. {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 10:13:28 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-513abddd-b29d-4058-b0a9-acdd3dddae5b req-82248774-d047-4a0a-b8b0-fcde570cd6ac service nova] Acquiring lock "refresh_cache-f01dc8cf-1a69-4618-a15d-0c1075157f05" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:13:28 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.023s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:13:28 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7d6a037-ce7d-4c5b-a50b-5632dbcc312a]: (4, ('ok\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:13:28 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-c72cdda9-682a-44eb-a5c4-51216a8e3c94 tempest-VolumesAssistedSnapshotsTest-799935866 tempest-VolumesAssistedSnapshotsTest-799935866-project-admin] Flushing IO for device /dev/sdi {{(pid=85141) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 10:13:28 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:13:28 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.015s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:13:28 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a20e57e-914e-4aab-8bae-bb47be27fbd8]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:13:28 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-c72cdda9-682a-44eb-a5c4-51216a8e3c94 tempest-VolumesAssistedSnapshotsTest-799935866 tempest-VolumesAssistedSnapshotsTest-799935866-project-admin] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=85141) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 10:13:28 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:13:28 user nova-compute[85141]: DEBUG nova.network.neutron [None req-ec25c880-8b57-4476-b347-2eb498c7d5cf tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] [instance: f01dc8cf-1a69-4618-a15d-0c1075157f05] Instance cache missing network info. {{(pid=85141) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 10:13:28 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.048s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:13:28 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[603d0a38-bb5d-4f11-bc36-4d4380510fdb]: (4, ('1', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:13:28 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-c72cdda9-682a-44eb-a5c4-51216a8e3c94 tempest-VolumesAssistedSnapshotsTest-799935866 tempest-VolumesAssistedSnapshotsTest-799935866-project-admin] Checking to see if SCSI volumes sdi have been removed. {{(pid=85141) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 10:13:28 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-c72cdda9-682a-44eb-a5c4-51216a8e3c94 tempest-VolumesAssistedSnapshotsTest-799935866 tempest-VolumesAssistedSnapshotsTest-799935866-project-admin] SCSI volumes sdi have been removed. {{(pid=85141) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 10:13:28 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-c72cdda9-682a-44eb-a5c4-51216a8e3c94 tempest-VolumesAssistedSnapshotsTest-799935866 tempest-VolumesAssistedSnapshotsTest-799935866-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ba7ca2a3-5f1e-4544-852f-d57100b608e3')] {{(pid=85141) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 10:13:28 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba7ca2a3-5f1e-4544-852f-d57100b608e3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:13:28 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba7ca2a3-5f1e-4544-852f-d57100b608e3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:13:28 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2051b93-fff1-4dc8-8b77-80c8d968952a]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:13:28 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-c72cdda9-682a-44eb-a5c4-51216a8e3c94 tempest-VolumesAssistedSnapshotsTest-799935866 tempest-VolumesAssistedSnapshotsTest-799935866-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:13:28 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba7ca2a3-5f1e-4544-852f-d57100b608e3 -p 172.16.0.220:3260 --logout {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:13:29 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba7ca2a3-5f1e-4544-852f-d57100b608e3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:13:29 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[d606fb76-03de-4ac3-a45b-b161cf8784a8]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:ba7ca2a3-5f1e-4544-852f-d57100b608e3, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:ba7ca2a3-5f1e-4544-852f-d57100b608e3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:13:29 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-c72cdda9-682a-44eb-a5c4-51216a8e3c94 tempest-VolumesAssistedSnapshotsTest-799935866 tempest-VolumesAssistedSnapshotsTest-799935866-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:ba7ca2a3-5f1e-4544-852f-d57100b608e3, portal: 172.16.0.220,3260]
Nov 16 10:13:29 user nova-compute[85141]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:ba7ca2a3-5f1e-4544-852f-d57100b608e3, portal: 172.16.0.220,3260] successful.
Nov 16 10:13:29 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:13:29 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba7ca2a3-5f1e-4544-852f-d57100b608e3 -p 172.16.0.220:3260 --op delete {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:13:29 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba7ca2a3-5f1e-4544-852f-d57100b608e3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:13:29 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9bcb876-bada-4b94-a23a-9bc2afb77cef]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:13:29 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-c72cdda9-682a-44eb-a5c4-51216a8e3c94 tempest-VolumesAssistedSnapshotsTest-799935866 tempest-VolumesAssistedSnapshotsTest-799935866-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:13:29 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-c72cdda9-682a-44eb-a5c4-51216a8e3c94 tempest-VolumesAssistedSnapshotsTest-799935866 tempest-VolumesAssistedSnapshotsTest-799935866-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.339s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 10:13:29 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-c72cdda9-682a-44eb-a5c4-51216a8e3c94 tempest-VolumesAssistedSnapshotsTest-799935866 tempest-VolumesAssistedSnapshotsTest-799935866-project-admin] <== disconnect_volume: return (341ms) None {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 10:13:29 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c72cdda9-682a-44eb-a5c4-51216a8e3c94 tempest-VolumesAssistedSnapshotsTest-799935866 tempest-VolumesAssistedSnapshotsTest-799935866-project-admin] [instance: 7e2ae11f-161c-4d13-a1a5-37d0a8150e6b] Disconnected iSCSI Volume {{(pid=85141) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 10:13:29 user nova-compute[85141]: DEBUG nova.network.neutron [None req-ec25c880-8b57-4476-b347-2eb498c7d5cf tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] [instance: f01dc8cf-1a69-4618-a15d-0c1075157f05] Updating instance_info_cache with network_info: [{"id": "52edc378-51f4-43c3-b9f3-2d0201ed125d", "address": "fa:16:3e:38:1f:8f", "network": {"id": "e40e4bd2-4277-40b1-9451-1c8365ffa488", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1333036447-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "733b504d4dbe4f028963cf2c197f0064", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52edc378-51", "ovs_interfaceid": "52edc378-51f4-43c3-b9f3-2d0201ed125d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:13:29 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-ec25c880-8b57-4476-b347-2eb498c7d5cf tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Releasing lock "refresh_cache-f01dc8cf-1a69-4618-a15d-0c1075157f05" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:13:29 user nova-compute[85141]: DEBUG nova.compute.manager [None req-ec25c880-8b57-4476-b347-2eb498c7d5cf tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] [instance: f01dc8cf-1a69-4618-a15d-0c1075157f05] Instance network_info: |[{"id": "52edc378-51f4-43c3-b9f3-2d0201ed125d", "address": "fa:16:3e:38:1f:8f", "network": {"id": "e40e4bd2-4277-40b1-9451-1c8365ffa488", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1333036447-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "733b504d4dbe4f028963cf2c197f0064", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52edc378-51", "ovs_interfaceid": "52edc378-51f4-43c3-b9f3-2d0201ed125d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=85141) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 10:13:29 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-513abddd-b29d-4058-b0a9-acdd3dddae5b req-82248774-d047-4a0a-b8b0-fcde570cd6ac service nova] Acquired lock "refresh_cache-f01dc8cf-1a69-4618-a15d-0c1075157f05" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:13:29 user nova-compute[85141]: DEBUG nova.network.neutron [req-513abddd-b29d-4058-b0a9-acdd3dddae5b req-82248774-d047-4a0a-b8b0-fcde570cd6ac service nova] [instance: f01dc8cf-1a69-4618-a15d-0c1075157f05] Refreshing network info cache for port 52edc378-51f4-43c3-b9f3-2d0201ed125d {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 10:13:29 user nova-compute[85141]: DEBUG nova.network.neutron [req-513abddd-b29d-4058-b0a9-acdd3dddae5b req-82248774-d047-4a0a-b8b0-fcde570cd6ac service nova] [instance: f01dc8cf-1a69-4618-a15d-0c1075157f05] Updated VIF entry in instance network info cache for port 52edc378-51f4-43c3-b9f3-2d0201ed125d. {{(pid=85141) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 10:13:29 user nova-compute[85141]: DEBUG nova.network.neutron [req-513abddd-b29d-4058-b0a9-acdd3dddae5b req-82248774-d047-4a0a-b8b0-fcde570cd6ac service nova] [instance: f01dc8cf-1a69-4618-a15d-0c1075157f05] Updating instance_info_cache with network_info: [{"id": "52edc378-51f4-43c3-b9f3-2d0201ed125d", "address": "fa:16:3e:38:1f:8f", "network": {"id": "e40e4bd2-4277-40b1-9451-1c8365ffa488", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1333036447-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "733b504d4dbe4f028963cf2c197f0064", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52edc378-51", "ovs_interfaceid": "52edc378-51f4-43c3-b9f3-2d0201ed125d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:13:29 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-513abddd-b29d-4058-b0a9-acdd3dddae5b req-82248774-d047-4a0a-b8b0-fcde570cd6ac service nova] Releasing lock "refresh_cache-f01dc8cf-1a69-4618-a15d-0c1075157f05" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:13:30 user nova-compute[85141]: DEBUG nova.objects.instance [None req-c72cdda9-682a-44eb-a5c4-51216a8e3c94 tempest-VolumesAssistedSnapshotsTest-799935866 tempest-VolumesAssistedSnapshotsTest-799935866-project-admin] Lazy-loading 'flavor' on Instance uuid 7e2ae11f-161c-4d13-a1a5-37d0a8150e6b {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:13:30 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-c72cdda9-682a-44eb-a5c4-51216a8e3c94 tempest-VolumesAssistedSnapshotsTest-799935866 tempest-VolumesAssistedSnapshotsTest-799935866-project-admin] Lock "7e2ae11f-161c-4d13-a1a5-37d0a8150e6b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.258s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:13:31 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:13:32 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:13:32 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:13:33 user nova-compute[85141]: DEBUG os_brick.utils [None req-ec25c880-8b57-4476-b347-2eb498c7d5cf tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 10:13:33 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:13:33 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:13:33 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d68331e-2523-4830-bb29-94b4fe88f852]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c7834de5c295\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:13:33 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:13:33 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:13:33 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcc05a00-b07c-47b4-9a9e-9c0d36674e79]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:13:33 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:13:33 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:13:33 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bce38f5-299a-4364-a296-22abbcc9023f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:13:33 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf73e6b5-f813-4ca1-bfc3-bad872700349]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:13:33 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-ec25c880-8b57-4476-b347-2eb498c7d5cf tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Running cmd (subprocess): nvme version {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:13:33 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-ec25c880-8b57-4476-b347-2eb498c7d5cf tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] 'nvme version' failed. Not Retrying. {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 10:13:33 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ec25c880-8b57-4476-b347-2eb498c7d5cf tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] nvme not present on system {{(pid=85141) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 10:13:33 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:13:33 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 10:13:33 user nova-compute[85141]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 10:13:33 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[dec7dfd6-1723-428e-b9f4-56d90b2089f2]: (4, '') {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:13:33 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.lightos [None req-ec25c880-8b57-4476-b347-2eb498c7d5cf tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=85141) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 10:13:33 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.lightos [None req-ec25c880-8b57-4476-b347-2eb498c7d5cf tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=85141) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 10:13:33 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.lightos [None req-ec25c880-8b57-4476-b347-2eb498c7d5cf tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] LIGHTOS: no hostnqn found. {{(pid=85141) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 10:13:33 user nova-compute[85141]: DEBUG os_brick.utils [None req-ec25c880-8b57-4476-b347-2eb498c7d5cf tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c7834de5c295', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 10:13:33 user nova-compute[85141]: DEBUG nova.virt.block_device [None req-ec25c880-8b57-4476-b347-2eb498c7d5cf tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] [instance: f01dc8cf-1a69-4618-a15d-0c1075157f05] Updating existing volume attachment record: 8fcd016e-544d-4236-9dc0-90fec00bb3d8 {{(pid=85141) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 10:13:33 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:13:35 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-923c055b-1894-4a98-822a-17e90474cecf tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] Acquiring lock "8ff05707-78c9-4f78-95e4-660f10636b7a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:13:35 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-923c055b-1894-4a98-822a-17e90474cecf tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] Lock "8ff05707-78c9-4f78-95e4-660f10636b7a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:13:35 user nova-compute[85141]: DEBUG nova.compute.manager [None req-923c055b-1894-4a98-822a-17e90474cecf tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] [instance: 8ff05707-78c9-4f78-95e4-660f10636b7a] Starting instance... {{(pid=85141) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 10:13:36 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-923c055b-1894-4a98-822a-17e90474cecf tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:13:36 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-923c055b-1894-4a98-822a-17e90474cecf tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:13:36 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-923c055b-1894-4a98-822a-17e90474cecf tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=85141) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 10:13:36 user nova-compute[85141]: INFO nova.compute.claims [None req-923c055b-1894-4a98-822a-17e90474cecf tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] [instance: 8ff05707-78c9-4f78-95e4-660f10636b7a] Claim successful on node user
Nov 16 10:13:36 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-d19fb610-8984-440d-9060-461ca2ae9388 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Acquiring lock "059d6974-bd0c-4f73-91fc-8202ebda4238" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:13:36 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-d19fb610-8984-440d-9060-461ca2ae9388 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Lock "059d6974-bd0c-4f73-91fc-8202ebda4238" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:13:36 user nova-compute[85141]: DEBUG nova.compute.manager [None req-d19fb610-8984-440d-9060-461ca2ae9388 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] [instance: 059d6974-bd0c-4f73-91fc-8202ebda4238] Starting instance... {{(pid=85141) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 10:13:36 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-d19fb610-8984-440d-9060-461ca2ae9388 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:13:36 user nova-compute[85141]: DEBUG nova.compute.provider_tree [None req-923c055b-1894-4a98-822a-17e90474cecf tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] Inventory has not changed in ProviderTree for provider: bf8e0fa1-16b6-408f-9203-c4cd63916272 {{(pid=85141) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 10:13:36 user nova-compute[85141]: DEBUG nova.scheduler.client.report [None req-923c055b-1894-4a98-822a-17e90474cecf tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] Inventory has not changed for provider bf8e0fa1-16b6-408f-9203-c4cd63916272 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=85141) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 10:13:36 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-923c055b-1894-4a98-822a-17e90474cecf tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.536s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:13:36 user nova-compute[85141]: DEBUG nova.compute.manager [None req-923c055b-1894-4a98-822a-17e90474cecf tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] [instance: 8ff05707-78c9-4f78-95e4-660f10636b7a] Start building networks asynchronously for instance. {{(pid=85141) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 10:13:36 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-d19fb610-8984-440d-9060-461ca2ae9388 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.188s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:13:36 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-d19fb610-8984-440d-9060-461ca2ae9388 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=85141) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 10:13:36 user nova-compute[85141]: INFO nova.compute.claims [None req-d19fb610-8984-440d-9060-461ca2ae9388 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] [instance: 059d6974-bd0c-4f73-91fc-8202ebda4238] Claim successful on node user
Nov 16 10:13:36 user nova-compute[85141]: DEBUG nova.compute.manager [None req-923c055b-1894-4a98-822a-17e90474cecf tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] [instance: 8ff05707-78c9-4f78-95e4-660f10636b7a] Allocating IP information in the background. {{(pid=85141) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 10:13:36 user nova-compute[85141]: DEBUG nova.network.neutron [None req-923c055b-1894-4a98-822a-17e90474cecf tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] [instance: 8ff05707-78c9-4f78-95e4-660f10636b7a] allocate_for_instance() {{(pid=85141) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 10:13:36 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-923c055b-1894-4a98-822a-17e90474cecf tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] [instance: 8ff05707-78c9-4f78-95e4-660f10636b7a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 10:13:36 user nova-compute[85141]: DEBUG nova.compute.manager [None req-923c055b-1894-4a98-822a-17e90474cecf tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] [instance: 8ff05707-78c9-4f78-95e4-660f10636b7a] Start building block device mappings for instance. {{(pid=85141) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 10:13:36 user nova-compute[85141]: DEBUG nova.policy [None req-923c055b-1894-4a98-822a-17e90474cecf tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cb1fde08d82e4eedb97f1501eafa3bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b9e035160ba427c80e5668982136a49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85141) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 10:13:36 user nova-compute[85141]: DEBUG nova.compute.manager [None req-923c055b-1894-4a98-822a-17e90474cecf tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] [instance: 8ff05707-78c9-4f78-95e4-660f10636b7a] Start spawning the instance on the hypervisor. {{(pid=85141) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 10:13:36 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-923c055b-1894-4a98-822a-17e90474cecf tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] [instance: 8ff05707-78c9-4f78-95e4-660f10636b7a] Creating instance directory {{(pid=85141) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 10:13:36 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-923c055b-1894-4a98-822a-17e90474cecf tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] [instance: 8ff05707-78c9-4f78-95e4-660f10636b7a] Creating image(s)
Nov 16 10:13:36 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-923c055b-1894-4a98-822a-17e90474cecf tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] Acquiring lock "/opt/stack/data/nova/instances/8ff05707-78c9-4f78-95e4-660f10636b7a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:13:36 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-923c055b-1894-4a98-822a-17e90474cecf tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] Lock "/opt/stack/data/nova/instances/8ff05707-78c9-4f78-95e4-660f10636b7a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:13:36 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-923c055b-1894-4a98-822a-17e90474cecf tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] Lock "/opt/stack/data/nova/instances/8ff05707-78c9-4f78-95e4-660f10636b7a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:13:36 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-923c055b-1894-4a98-822a-17e90474cecf tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:13:37 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-923c055b-1894-4a98-822a-17e90474cecf tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json" returned: 0 in 0.185s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:13:37 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-923c055b-1894-4a98-822a-17e90474cecf tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] Acquiring lock "60a78556fb399ed4a41bc3ca4bccf77c96d8e811" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:13:37 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-923c055b-1894-4a98-822a-17e90474cecf tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] Lock "60a78556fb399ed4a41bc3ca4bccf77c96d8e811" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:13:37 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-923c055b-1894-4a98-822a-17e90474cecf tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:13:37 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:13:37 user nova-compute[85141]: DEBUG nova.compute.provider_tree [None req-d19fb610-8984-440d-9060-461ca2ae9388 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Inventory has not changed in ProviderTree for provider: bf8e0fa1-16b6-408f-9203-c4cd63916272 {{(pid=85141) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 10:13:37 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:13:37 user nova-compute[85141]: DEBUG nova.scheduler.client.report [None req-d19fb610-8984-440d-9060-461ca2ae9388 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Inventory has not changed for provider bf8e0fa1-16b6-408f-9203-c4cd63916272 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=85141) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 10:13:37 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-d19fb610-8984-440d-9060-461ca2ae9388 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.630s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:13:37 user nova-compute[85141]: DEBUG nova.compute.manager [None req-d19fb610-8984-440d-9060-461ca2ae9388 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] [instance: 059d6974-bd0c-4f73-91fc-8202ebda4238] Start building networks asynchronously for instance. {{(pid=85141) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 10:13:37 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-923c055b-1894-4a98-822a-17e90474cecf tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json" returned: 0 in 0.177s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:13:37 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-923c055b-1894-4a98-822a-17e90474cecf tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811,backing_fmt=raw /opt/stack/data/nova/instances/8ff05707-78c9-4f78-95e4-660f10636b7a/disk 1073741824 {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:13:37 user nova-compute[85141]: DEBUG nova.compute.manager [None req-d19fb610-8984-440d-9060-461ca2ae9388 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] [instance: 059d6974-bd0c-4f73-91fc-8202ebda4238] Allocating IP information in the background. {{(pid=85141) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 10:13:37 user nova-compute[85141]: DEBUG nova.network.neutron [None req-d19fb610-8984-440d-9060-461ca2ae9388 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] [instance: 059d6974-bd0c-4f73-91fc-8202ebda4238] allocate_for_instance() {{(pid=85141) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 10:13:37 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-d19fb610-8984-440d-9060-461ca2ae9388 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] [instance: 059d6974-bd0c-4f73-91fc-8202ebda4238] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 10:13:37 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-923c055b-1894-4a98-822a-17e90474cecf tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811,backing_fmt=raw /opt/stack/data/nova/instances/8ff05707-78c9-4f78-95e4-660f10636b7a/disk 1073741824" returned: 0 in 0.078s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:13:37 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-923c055b-1894-4a98-822a-17e90474cecf tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] Lock "60a78556fb399ed4a41bc3ca4bccf77c96d8e811" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.260s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:13:37 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-923c055b-1894-4a98-822a-17e90474cecf tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:13:37 user nova-compute[85141]: DEBUG nova.compute.manager [None req-d19fb610-8984-440d-9060-461ca2ae9388 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] [instance: 059d6974-bd0c-4f73-91fc-8202ebda4238] Start building block device mappings for instance. {{(pid=85141) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 10:13:37 user nova-compute[85141]: DEBUG nova.network.neutron [None req-923c055b-1894-4a98-822a-17e90474cecf tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] [instance: 8ff05707-78c9-4f78-95e4-660f10636b7a] Successfully created port: e4ce9608-d62c-4289-a5eb-ff3dc20be4fd {{(pid=85141) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 10:13:37 user nova-compute[85141]: DEBUG nova.compute.manager [None req-d19fb610-8984-440d-9060-461ca2ae9388 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] [instance: 059d6974-bd0c-4f73-91fc-8202ebda4238] Start spawning the instance on the hypervisor. {{(pid=85141) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 10:13:37 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-d19fb610-8984-440d-9060-461ca2ae9388 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] [instance: 059d6974-bd0c-4f73-91fc-8202ebda4238] Creating instance directory {{(pid=85141) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 10:13:37 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-d19fb610-8984-440d-9060-461ca2ae9388 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] [instance: 059d6974-bd0c-4f73-91fc-8202ebda4238] Creating image(s)
Nov 16 10:13:37 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-d19fb610-8984-440d-9060-461ca2ae9388 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Acquiring lock "/opt/stack/data/nova/instances/059d6974-bd0c-4f73-91fc-8202ebda4238/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:13:37 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-d19fb610-8984-440d-9060-461ca2ae9388 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Lock "/opt/stack/data/nova/instances/059d6974-bd0c-4f73-91fc-8202ebda4238/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:13:37 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-d19fb610-8984-440d-9060-461ca2ae9388 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Lock "/opt/stack/data/nova/instances/059d6974-bd0c-4f73-91fc-8202ebda4238/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:13:37 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-d19fb610-8984-440d-9060-461ca2ae9388 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:13:37 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-923c055b-1894-4a98-822a-17e90474cecf tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json" returned: 0 in 0.197s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:13:37 user nova-compute[85141]: DEBUG nova.virt.disk.api [None req-923c055b-1894-4a98-822a-17e90474cecf tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8ff05707-78c9-4f78-95e4-660f10636b7a/disk. size=1073741824 {{(pid=85141) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 10:13:37 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-923c055b-1894-4a98-822a-17e90474cecf tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff05707-78c9-4f78-95e4-660f10636b7a/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:13:37 user nova-compute[85141]: DEBUG nova.policy [None req-d19fb610-8984-440d-9060-461ca2ae9388 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e95802a919de4345add493a8d7873e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '879fa3f4dfc34726b20149b8a7db22dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85141) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 10:13:37 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-d19fb610-8984-440d-9060-461ca2ae9388 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json" returned: 0 in 0.179s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:13:37 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-d19fb610-8984-440d-9060-461ca2ae9388 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Acquiring lock "60a78556fb399ed4a41bc3ca4bccf77c96d8e811" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:13:37 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-d19fb610-8984-440d-9060-461ca2ae9388 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Lock "60a78556fb399ed4a41bc3ca4bccf77c96d8e811" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:13:37 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-d19fb610-8984-440d-9060-461ca2ae9388 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:13:37 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-923c055b-1894-4a98-822a-17e90474cecf tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff05707-78c9-4f78-95e4-660f10636b7a/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:13:37 user nova-compute[85141]: DEBUG nova.virt.disk.api [None req-923c055b-1894-4a98-822a-17e90474cecf tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] Cannot resize image /opt/stack/data/nova/instances/8ff05707-78c9-4f78-95e4-660f10636b7a/disk to a smaller size. {{(pid=85141) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 10:13:37 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-923c055b-1894-4a98-822a-17e90474cecf tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] [instance: 8ff05707-78c9-4f78-95e4-660f10636b7a] Created local disks {{(pid=85141) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 10:13:37 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-923c055b-1894-4a98-822a-17e90474cecf tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] [instance: 8ff05707-78c9-4f78-95e4-660f10636b7a] Ensure instance console log exists: /opt/stack/data/nova/instances/8ff05707-78c9-4f78-95e4-660f10636b7a/console.log {{(pid=85141) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 10:13:37 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-923c055b-1894-4a98-822a-17e90474cecf tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:13:37 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-923c055b-1894-4a98-822a-17e90474cecf tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:13:37 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-923c055b-1894-4a98-822a-17e90474cecf tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:13:37 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-d19fb610-8984-440d-9060-461ca2ae9388 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json" returned: 0 in 0.184s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:13:37 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-d19fb610-8984-440d-9060-461ca2ae9388 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811,backing_fmt=raw /opt/stack/data/nova/instances/059d6974-bd0c-4f73-91fc-8202ebda4238/disk 1073741824 {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:13:37 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-d19fb610-8984-440d-9060-461ca2ae9388 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811,backing_fmt=raw /opt/stack/data/nova/instances/059d6974-bd0c-4f73-91fc-8202ebda4238/disk 1073741824" returned: 0 in 0.046s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:13:37 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-d19fb610-8984-440d-9060-461ca2ae9388 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Lock "60a78556fb399ed4a41bc3ca4bccf77c96d8e811" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.236s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:13:37 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-d19fb610-8984-440d-9060-461ca2ae9388 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:13:38 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-d19fb610-8984-440d-9060-461ca2ae9388 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json" returned: 0 in 0.181s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:13:38 user nova-compute[85141]: DEBUG nova.virt.disk.api [None req-d19fb610-8984-440d-9060-461ca2ae9388 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Checking if we can resize image /opt/stack/data/nova/instances/059d6974-bd0c-4f73-91fc-8202ebda4238/disk. size=1073741824 {{(pid=85141) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 10:13:38 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-d19fb610-8984-440d-9060-461ca2ae9388 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/059d6974-bd0c-4f73-91fc-8202ebda4238/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:13:38 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-d19fb610-8984-440d-9060-461ca2ae9388 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/059d6974-bd0c-4f73-91fc-8202ebda4238/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:13:38 user nova-compute[85141]: DEBUG nova.virt.disk.api [None req-d19fb610-8984-440d-9060-461ca2ae9388 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Cannot resize image /opt/stack/data/nova/instances/059d6974-bd0c-4f73-91fc-8202ebda4238/disk to a smaller size. {{(pid=85141) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 10:13:38 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-d19fb610-8984-440d-9060-461ca2ae9388 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] [instance: 059d6974-bd0c-4f73-91fc-8202ebda4238] Created local disks {{(pid=85141) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 10:13:38 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-d19fb610-8984-440d-9060-461ca2ae9388 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] [instance: 059d6974-bd0c-4f73-91fc-8202ebda4238] Ensure instance console log exists: /opt/stack/data/nova/instances/059d6974-bd0c-4f73-91fc-8202ebda4238/console.log {{(pid=85141) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 10:13:38 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-d19fb610-8984-440d-9060-461ca2ae9388 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:13:38 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-d19fb610-8984-440d-9060-461ca2ae9388 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:13:38 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-d19fb610-8984-440d-9060-461ca2ae9388 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:13:38 user nova-compute[85141]: DEBUG nova.network.neutron [None req-923c055b-1894-4a98-822a-17e90474cecf tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] [instance: 8ff05707-78c9-4f78-95e4-660f10636b7a] Successfully updated port: e4ce9608-d62c-4289-a5eb-ff3dc20be4fd {{(pid=85141) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 10:13:38 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-923c055b-1894-4a98-822a-17e90474cecf tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] Acquiring lock "refresh_cache-8ff05707-78c9-4f78-95e4-660f10636b7a" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:13:38 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-923c055b-1894-4a98-822a-17e90474cecf tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] Acquired lock "refresh_cache-8ff05707-78c9-4f78-95e4-660f10636b7a" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:13:38 user nova-compute[85141]: DEBUG nova.network.neutron [None req-923c055b-1894-4a98-822a-17e90474cecf tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] [instance: 8ff05707-78c9-4f78-95e4-660f10636b7a] Building network info cache for instance {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 10:13:38 user nova-compute[85141]: DEBUG nova.compute.manager [req-7dbe86e2-5575-4942-9f94-393ba5cf8a47 req-e979b21e-21f8-4fbf-8961-4a29495b63a8 service nova] [instance: 8ff05707-78c9-4f78-95e4-660f10636b7a] Received event network-changed-e4ce9608-d62c-4289-a5eb-ff3dc20be4fd {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:13:38 user nova-compute[85141]: DEBUG nova.compute.manager [req-7dbe86e2-5575-4942-9f94-393ba5cf8a47 req-e979b21e-21f8-4fbf-8961-4a29495b63a8 service nova] [instance: 8ff05707-78c9-4f78-95e4-660f10636b7a] Refreshing instance network info cache due to event network-changed-e4ce9608-d62c-4289-a5eb-ff3dc20be4fd. {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 10:13:38 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-7dbe86e2-5575-4942-9f94-393ba5cf8a47 req-e979b21e-21f8-4fbf-8961-4a29495b63a8 service nova] Acquiring lock "refresh_cache-8ff05707-78c9-4f78-95e4-660f10636b7a" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:13:38 user nova-compute[85141]: DEBUG nova.network.neutron [None req-923c055b-1894-4a98-822a-17e90474cecf tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] [instance: 8ff05707-78c9-4f78-95e4-660f10636b7a] Instance cache missing network info. {{(pid=85141) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 10:13:38 user nova-compute[85141]: DEBUG nova.network.neutron [None req-d19fb610-8984-440d-9060-461ca2ae9388 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] [instance: 059d6974-bd0c-4f73-91fc-8202ebda4238] Successfully created port: 89bf502f-593d-4c6e-aa83-a041e0ad7b28 {{(pid=85141) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 10:13:38 user nova-compute[85141]: DEBUG nova.compute.manager [None req-ec25c880-8b57-4476-b347-2eb498c7d5cf tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] [instance: f01dc8cf-1a69-4618-a15d-0c1075157f05] Start spawning the instance on the hypervisor. {{(pid=85141) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 10:13:38 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-ec25c880-8b57-4476-b347-2eb498c7d5cf tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] [instance: f01dc8cf-1a69-4618-a15d-0c1075157f05] Creating instance directory {{(pid=85141) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 10:13:38 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-ec25c880-8b57-4476-b347-2eb498c7d5cf tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] [instance: f01dc8cf-1a69-4618-a15d-0c1075157f05] Creating image(s)
Nov 16 10:13:38 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-ec25c880-8b57-4476-b347-2eb498c7d5cf tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] [instance: f01dc8cf-1a69-4618-a15d-0c1075157f05] Did not create local disks {{(pid=85141) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 16 10:13:38 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-ec25c880-8b57-4476-b347-2eb498c7d5cf tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] [instance: f01dc8cf-1a69-4618-a15d-0c1075157f05] Ensure instance console log exists: /opt/stack/data/nova/instances/f01dc8cf-1a69-4618-a15d-0c1075157f05/console.log {{(pid=85141) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 10:13:38 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-ec25c880-8b57-4476-b347-2eb498c7d5cf tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:13:38 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-ec25c880-8b57-4476-b347-2eb498c7d5cf tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:13:38 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-ec25c880-8b57-4476-b347-2eb498c7d5cf tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:13:38 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-ec25c880-8b57-4476-b347-2eb498c7d5cf tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] [instance: f01dc8cf-1a69-4618-a15d-0c1075157f05] Start _get_guest_xml network_info=[{"id": "52edc378-51f4-43c3-b9f3-2d0201ed125d", "address": "fa:16:3e:38:1f:8f", "network": {"id": "e40e4bd2-4277-40b1-9451-1c8365ffa488", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1333036447-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "733b504d4dbe4f028963cf2c197f0064", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52edc378-51", "ovs_interfaceid": "52edc378-51f4-43c3-b9f3-2d0201ed125d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T10:06:42Z,direct_url=<?>,disk_format='qcow2',id=bc4ca70f-a459-4d5c-a9e6-80f1948eb48b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1044631a5fe84ce8904864a7024049fa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T10:06:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pHECSWij', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f01dc8cf-1a69-4618-a15d-0c1075157f05', 'attached_at': '', 'detached_at': '', 'volume_id': 'f762b977-47ad-490c-a516-0216703bebee', 'serial': 'f762b977-47ad-490c-a516-0216703bebee'}, 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'attachment_id': '8fcd016e-544d-4236-9dc0-90fec00bb3d8', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=85141) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 10:13:38 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-ec25c880-8b57-4476-b347-2eb498c7d5cf tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:13:38 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-ec25c880-8b57-4476-b347-2eb498c7d5cf tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:13:38 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-ec25c880-8b57-4476-b347-2eb498c7d5cf tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=85141) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 10:13:38 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-ec25c880-8b57-4476-b347-2eb498c7d5cf tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] CPU controller missing on host. {{(pid=85141) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 10:13:38 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-ec25c880-8b57-4476-b347-2eb498c7d5cf tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=85141) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 10:13:38 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-ec25c880-8b57-4476-b347-2eb498c7d5cf tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] CPU controller found on host. {{(pid=85141) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 10:13:38 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-ec25c880-8b57-4476-b347-2eb498c7d5cf tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=85141) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 10:13:38 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-ec25c880-8b57-4476-b347-2eb498c7d5cf tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T10:06:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T10:06:42Z,direct_url=<?>,disk_format='qcow2',id=bc4ca70f-a459-4d5c-a9e6-80f1948eb48b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1044631a5fe84ce8904864a7024049fa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T10:06:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 10:13:38 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-ec25c880-8b57-4476-b347-2eb498c7d5cf tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Flavor limits 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 10:13:38 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-ec25c880-8b57-4476-b347-2eb498c7d5cf tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Image limits 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 10:13:38 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-ec25c880-8b57-4476-b347-2eb498c7d5cf tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Flavor pref 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 10:13:38 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-ec25c880-8b57-4476-b347-2eb498c7d5cf tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Image pref 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 10:13:38 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-ec25c880-8b57-4476-b347-2eb498c7d5cf tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 10:13:38 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-ec25c880-8b57-4476-b347-2eb498c7d5cf tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 10:13:38 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-ec25c880-8b57-4476-b347-2eb498c7d5cf tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=85141) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 10:13:38 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-ec25c880-8b57-4476-b347-2eb498c7d5cf tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Got 1 possible topologies {{(pid=85141) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 10:13:38 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-ec25c880-8b57-4476-b347-2eb498c7d5cf tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 10:13:38 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-ec25c880-8b57-4476-b347-2eb498c7d5cf tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 10:13:38 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ec25c880-8b57-4476-b347-2eb498c7d5cf tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] [instance: f01dc8cf-1a69-4618-a15d-0c1075157f05] Calling os-brick to attach iSCSI Volume {{(pid=85141) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 10:13:38 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec25c880-8b57-4476-b347-2eb498c7d5cf tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51806b6080>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pHECSWij', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 10:13:38 user nova-compute[85141]: WARNING os_brick.initiator.connectors.base [None req-ec25c880-8b57-4476-b347-2eb498c7d5cf tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 10:13:38 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-ec25c880-8b57-4476-b347-2eb498c7d5cf tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 10:13:38 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-ec25c880-8b57-4476-b347-2eb498c7d5cf tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 10:13:38 user nova-compute[85141]: WARNING os_brick.initiator.connectors.base [None req-ec25c880-8b57-4476-b347-2eb498c7d5cf tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 10:13:38 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-ec25c880-8b57-4476-b347-2eb498c7d5cf tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 10:13:38 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-ec25c880-8b57-4476-b347-2eb498c7d5cf tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 10:13:38 user nova-compute[85141]: INFO os_brick.initiator.connectors.iscsi [None req-ec25c880-8b57-4476-b347-2eb498c7d5cf tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 10:13:38 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee -p 172.16.0.220:3260 {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:13:38 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:13:38 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[8693b0c3-3806-48ea-b877-fa8c1f1c2045]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:13:38 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec25c880-8b57-4476-b347-2eb498c7d5cf tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 10:13:38 user nova-compute[85141]:  {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:13:38 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee -p 172.16.0.220:3260 --interface default --op new {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:13:38 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:13:38 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[aceb45cb-9759-4efa-934c-64c1ac36304c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee] added\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:13:38 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec25c880-8b57-4476-b347-2eb498c7d5cf tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee] added
Nov 16 10:13:38 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:13:38 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:13:38 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:13:38 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[311b8752-82bf-4741-a84a-1c722a264fb1]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:13:38 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec25c880-8b57-4476-b347-2eb498c7d5cf tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:13:38 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:13:38 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:13:38 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b5a70f6-e01e-4460-b22f-b36ea6270df7]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:13:38 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec25c880-8b57-4476-b347-2eb498c7d5cf tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:13:38 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pHECSWij {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:13:39 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pHECSWij" returned: 0 in 0.017s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:13:39 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cb8a0d6-f8fa-4ab2-b412-b624b5fceb20]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:13:39 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec25c880-8b57-4476-b347-2eb498c7d5cf tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pHECSWij'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:13:39 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:13:39 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:13:39 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ee76ad7-1c39-4aad-8700-bc0892aa3847]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:13:39 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec25c880-8b57-4476-b347-2eb498c7d5cf tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:13:39 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:13:39 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:13:39 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[580ffe4b-0cb5-41c9-bcb1-7b6982916b66]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42c041ec-fa39-4035-b82b-867caf3565df (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e233047-dda3-4f2e-803c-7b69a57ac656 (non-flash)\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:13:39 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec25c880-8b57-4476-b347-2eb498c7d5cf tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42c041ec-fa39-4035-b82b-867caf3565df (non-flash)
Nov 16 10:13:39 user nova-compute[85141]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e233047-dda3-4f2e-803c-7b69a57ac656 (non-flash)
Nov 16 10:13:39 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:13:39 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec25c880-8b57-4476-b347-2eb498c7d5cf tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42c041ec-fa39-4035-b82b-867caf3565df (non-flash)
Nov 16 10:13:39 user nova-compute[85141]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e233047-dda3-4f2e-803c-7b69a57ac656 (non-flash)
Nov 16 10:13:39 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 10:13:39 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee -p 172.16.0.220:3260 --login {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:13:39 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:13:39 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f17b97c-ea2f-47c5-92b4-5b47b086e551]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:13:39 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec25c880-8b57-4476-b347-2eb498c7d5cf tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee, portal: 172.16.0.220,3260]
Nov 16 10:13:39 user nova-compute[85141]: Login to [iface: default, target: iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee, portal: 172.16.0.220,3260] successful.
Nov 16 10:13:39 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:13:39 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:13:39 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:13:39 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[92d40b43-420d-4af5-aefe-52d03eaa6c00]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:13:39 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec25c880-8b57-4476-b347-2eb498c7d5cf tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:13:39 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:13:39 user nova-compute[85141]: DEBUG nova.network.neutron [None req-923c055b-1894-4a98-822a-17e90474cecf tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] [instance: 8ff05707-78c9-4f78-95e4-660f10636b7a] Updating instance_info_cache with network_info: [{"id": "e4ce9608-d62c-4289-a5eb-ff3dc20be4fd", "address": "fa:16:3e:4e:f1:9b", "network": {"id": "1d55ecdc-2f77-4c38-b487-0099d658e0ec", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1226034564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b9e035160ba427c80e5668982136a49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4ce9608-d6", "ovs_interfaceid": "e4ce9608-d62c-4289-a5eb-ff3dc20be4fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:13:39 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:13:39 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7e13328-ec00-402f-a52f-13c56b70ceb2]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42c041ec-fa39-4035-b82b-867caf3565df (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e233047-dda3-4f2e-803c-7b69a57ac656 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:13:39 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec25c880-8b57-4476-b347-2eb498c7d5cf tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42c041ec-fa39-4035-b82b-867caf3565df (non-flash)
Nov 16 10:13:39 user nova-compute[85141]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e233047-dda3-4f2e-803c-7b69a57ac656 (non-flash)
Nov 16 10:13:39 user nova-compute[85141]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)
Nov 16 10:13:39 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:13:39 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec25c880-8b57-4476-b347-2eb498c7d5cf tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42c041ec-fa39-4035-b82b-867caf3565df (non-flash)
Nov 16 10:13:39 user nova-compute[85141]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e233047-dda3-4f2e-803c-7b69a57ac656 (non-flash)
Nov 16 10:13:39 user nova-compute[85141]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)
Nov 16 10:13:39 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 10:13:39 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-ec25c880-8b57-4476-b347-2eb498c7d5cf tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.270s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 10:13:39 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec25c880-8b57-4476-b347-2eb498c7d5cf tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Connected to 172.16.0.220:3260 {{(pid=85141) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 10:13:39 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-ec25c880-8b57-4476-b347-2eb498c7d5cf tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] HCTL ('34', '-', '-', 0) found on session 16 with lun 0 {{(pid=85141) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 10:13:39 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-ec25c880-8b57-4476-b347-2eb498c7d5cf tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=85141) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 10:13:39 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-923c055b-1894-4a98-822a-17e90474cecf tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] Releasing lock "refresh_cache-8ff05707-78c9-4f78-95e4-660f10636b7a" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:13:39 user nova-compute[85141]: DEBUG nova.compute.manager [None req-923c055b-1894-4a98-822a-17e90474cecf tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] [instance: 8ff05707-78c9-4f78-95e4-660f10636b7a] Instance network_info: |[{"id": "e4ce9608-d62c-4289-a5eb-ff3dc20be4fd", "address": "fa:16:3e:4e:f1:9b", "network": {"id": "1d55ecdc-2f77-4c38-b487-0099d658e0ec", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1226034564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b9e035160ba427c80e5668982136a49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4ce9608-d6", "ovs_interfaceid": "e4ce9608-d62c-4289-a5eb-ff3dc20be4fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=85141) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 10:13:39 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:13:39 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-7dbe86e2-5575-4942-9f94-393ba5cf8a47 req-e979b21e-21f8-4fbf-8961-4a29495b63a8 service nova] Acquired lock "refresh_cache-8ff05707-78c9-4f78-95e4-660f10636b7a" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:13:39 user nova-compute[85141]: DEBUG nova.network.neutron [req-7dbe86e2-5575-4942-9f94-393ba5cf8a47 req-e979b21e-21f8-4fbf-8961-4a29495b63a8 service nova] [instance: 8ff05707-78c9-4f78-95e4-660f10636b7a] Refreshing network info cache for port e4ce9608-d62c-4289-a5eb-ff3dc20be4fd {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 10:13:39 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-923c055b-1894-4a98-822a-17e90474cecf tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] [instance: 8ff05707-78c9-4f78-95e4-660f10636b7a] Start _get_guest_xml network_info=[{"id": "e4ce9608-d62c-4289-a5eb-ff3dc20be4fd", "address": "fa:16:3e:4e:f1:9b", "network": {"id": "1d55ecdc-2f77-4c38-b487-0099d658e0ec", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1226034564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b9e035160ba427c80e5668982136a49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4ce9608-d6", "ovs_interfaceid": "e4ce9608-d62c-4289-a5eb-ff3dc20be4fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T10:06:42Z,direct_url=<?>,disk_format='qcow2',id=bc4ca70f-a459-4d5c-a9e6-80f1948eb48b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1044631a5fe84ce8904864a7024049fa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T10:06:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_options': None, 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'image_id': 'bc4ca70f-a459-4d5c-a9e6-80f1948eb48b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=85141) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 10:13:39 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-923c055b-1894-4a98-822a-17e90474cecf tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:13:39 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-923c055b-1894-4a98-822a-17e90474cecf tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:13:39 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:13:39 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[afec1214-724f-4bb0-8c3e-51fc5bd3e1a6]: (4, ('- - 0', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:13:39 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-ec25c880-8b57-4476-b347-2eb498c7d5cf tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Searching for a device in session 16 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=85141) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 10:13:39 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec25c880-8b57-4476-b347-2eb498c7d5cf tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pHECSWij', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=85141) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 10:13:39 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-923c055b-1894-4a98-822a-17e90474cecf tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=85141) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 10:13:39 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-923c055b-1894-4a98-822a-17e90474cecf tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] CPU controller missing on host. {{(pid=85141) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 10:13:39 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-923c055b-1894-4a98-822a-17e90474cecf tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=85141) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 10:13:39 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-923c055b-1894-4a98-822a-17e90474cecf tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] CPU controller found on host. {{(pid=85141) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 10:13:39 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-923c055b-1894-4a98-822a-17e90474cecf tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=85141) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 10:13:39 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-923c055b-1894-4a98-822a-17e90474cecf tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T10:06:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T10:06:42Z,direct_url=<?>,disk_format='qcow2',id=bc4ca70f-a459-4d5c-a9e6-80f1948eb48b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1044631a5fe84ce8904864a7024049fa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T10:06:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 10:13:39 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-923c055b-1894-4a98-822a-17e90474cecf tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] Flavor limits 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 10:13:39 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-923c055b-1894-4a98-822a-17e90474cecf tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] Image limits 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 10:13:39 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-923c055b-1894-4a98-822a-17e90474cecf tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] Flavor pref 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 10:13:39 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-923c055b-1894-4a98-822a-17e90474cecf tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] Image pref 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 10:13:39 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-923c055b-1894-4a98-822a-17e90474cecf tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 10:13:39 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-923c055b-1894-4a98-822a-17e90474cecf tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 10:13:39 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-923c055b-1894-4a98-822a-17e90474cecf tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=85141) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 10:13:39 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-923c055b-1894-4a98-822a-17e90474cecf tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] Got 1 possible topologies {{(pid=85141) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 10:13:39 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-923c055b-1894-4a98-822a-17e90474cecf tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 10:13:39 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-923c055b-1894-4a98-822a-17e90474cecf tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 10:13:39 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-923c055b-1894-4a98-822a-17e90474cecf tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T10:13:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1565498532',display_name='tempest-VolumesAdminNegativeTest-server-1565498532',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1565498532',id=14,image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5b9e035160ba427c80e5668982136a49',ramdisk_id='',reservation_id='r-w8rilfip',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1984071326',owner_user_name='tempest-VolumesAdminNegativeTest-1984071326-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T10:13:37Z,user_data=None,user_id='cb1fde08d82e4eedb97f1501eafa3bd0',uuid=8ff05707-78c9-4f78-95e4-660f10636b7a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e4ce9608-d62c-4289-a5eb-ff3dc20be4fd", "address": "fa:16:3e:4e:f1:9b", "network": {"id": "1d55ecdc-2f77-4c38-b487-0099d658e0ec", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1226034564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b9e035160ba427c80e5668982136a49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4ce9608-d6", "ovs_interfaceid": "e4ce9608-d62c-4289-a5eb-ff3dc20be4fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=85141) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 10:13:39 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-923c055b-1894-4a98-822a-17e90474cecf tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] Converting VIF {"id": "e4ce9608-d62c-4289-a5eb-ff3dc20be4fd", "address": "fa:16:3e:4e:f1:9b", "network": {"id": "1d55ecdc-2f77-4c38-b487-0099d658e0ec", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1226034564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b9e035160ba427c80e5668982136a49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4ce9608-d6", "ovs_interfaceid": "e4ce9608-d62c-4289-a5eb-ff3dc20be4fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:13:39 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-923c055b-1894-4a98-822a-17e90474cecf tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4e:f1:9b,bridge_name='br-int',has_traffic_filtering=True,id=e4ce9608-d62c-4289-a5eb-ff3dc20be4fd,network=Network(1d55ecdc-2f77-4c38-b487-0099d658e0ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4ce9608-d6') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:13:39 user nova-compute[85141]: DEBUG nova.objects.instance [None req-923c055b-1894-4a98-822a-17e90474cecf tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] Lazy-loading 'pci_devices' on Instance uuid 8ff05707-78c9-4f78-95e4-660f10636b7a {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:13:39 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-923c055b-1894-4a98-822a-17e90474cecf tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] [instance: 8ff05707-78c9-4f78-95e4-660f10636b7a] End _get_guest_xml xml=<domain type="kvm">
Nov 16 10:13:39 user nova-compute[85141]:   <uuid>8ff05707-78c9-4f78-95e4-660f10636b7a</uuid>
Nov 16 10:13:39 user nova-compute[85141]:   <name>instance-0000000e</name>
Nov 16 10:13:39 user nova-compute[85141]:   <memory>524288</memory>
Nov 16 10:13:39 user nova-compute[85141]:   <vcpu>1</vcpu>
Nov 16 10:13:39 user nova-compute[85141]:   <metadata>
Nov 16 10:13:39 user nova-compute[85141]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 10:13:39 user nova-compute[85141]:       <nova:package version="0.0.0"/>
Nov 16 10:13:39 user nova-compute[85141]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1565498532</nova:name>
Nov 16 10:13:39 user nova-compute[85141]:       <nova:creationTime>2023-11-16 10:13:39</nova:creationTime>
Nov 16 10:13:39 user nova-compute[85141]:       <nova:flavor name="m1.tiny">
Nov 16 10:13:39 user nova-compute[85141]:         <nova:memory>512</nova:memory>
Nov 16 10:13:39 user nova-compute[85141]:         <nova:disk>1</nova:disk>
Nov 16 10:13:39 user nova-compute[85141]:         <nova:swap>0</nova:swap>
Nov 16 10:13:39 user nova-compute[85141]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 10:13:39 user nova-compute[85141]:         <nova:vcpus>1</nova:vcpus>
Nov 16 10:13:39 user nova-compute[85141]:       </nova:flavor>
Nov 16 10:13:39 user nova-compute[85141]:       <nova:owner>
Nov 16 10:13:39 user nova-compute[85141]:         <nova:user uuid="cb1fde08d82e4eedb97f1501eafa3bd0">tempest-VolumesAdminNegativeTest-1984071326-project-member</nova:user>
Nov 16 10:13:39 user nova-compute[85141]:         <nova:project uuid="5b9e035160ba427c80e5668982136a49">tempest-VolumesAdminNegativeTest-1984071326</nova:project>
Nov 16 10:13:39 user nova-compute[85141]:       </nova:owner>
Nov 16 10:13:39 user nova-compute[85141]:       <nova:root type="image" uuid="bc4ca70f-a459-4d5c-a9e6-80f1948eb48b"/>
Nov 16 10:13:39 user nova-compute[85141]:       <nova:ports>
Nov 16 10:13:39 user nova-compute[85141]:         <nova:port uuid="e4ce9608-d62c-4289-a5eb-ff3dc20be4fd">
Nov 16 10:13:39 user nova-compute[85141]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 16 10:13:39 user nova-compute[85141]:         </nova:port>
Nov 16 10:13:39 user nova-compute[85141]:       </nova:ports>
Nov 16 10:13:39 user nova-compute[85141]:     </nova:instance>
Nov 16 10:13:39 user nova-compute[85141]:   </metadata>
Nov 16 10:13:39 user nova-compute[85141]:   <sysinfo type="smbios">
Nov 16 10:13:39 user nova-compute[85141]:     <system>
Nov 16 10:13:39 user nova-compute[85141]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 10:13:39 user nova-compute[85141]:       <entry name="product">OpenStack Nova</entry>
Nov 16 10:13:39 user nova-compute[85141]:       <entry name="version">0.0.0</entry>
Nov 16 10:13:39 user nova-compute[85141]:       <entry name="serial">8ff05707-78c9-4f78-95e4-660f10636b7a</entry>
Nov 16 10:13:39 user nova-compute[85141]:       <entry name="uuid">8ff05707-78c9-4f78-95e4-660f10636b7a</entry>
Nov 16 10:13:39 user nova-compute[85141]:       <entry name="family">Virtual Machine</entry>
Nov 16 10:13:39 user nova-compute[85141]:     </system>
Nov 16 10:13:39 user nova-compute[85141]:   </sysinfo>
Nov 16 10:13:39 user nova-compute[85141]:   <os>
Nov 16 10:13:39 user nova-compute[85141]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 10:13:39 user nova-compute[85141]:     <boot dev="hd"/>
Nov 16 10:13:39 user nova-compute[85141]:     <smbios mode="sysinfo"/>
Nov 16 10:13:39 user nova-compute[85141]:   </os>
Nov 16 10:13:39 user nova-compute[85141]:   <features>
Nov 16 10:13:39 user nova-compute[85141]:     <acpi/>
Nov 16 10:13:39 user nova-compute[85141]:     <apic/>
Nov 16 10:13:39 user nova-compute[85141]:     <vmcoreinfo/>
Nov 16 10:13:39 user nova-compute[85141]:   </features>
Nov 16 10:13:39 user nova-compute[85141]:   <clock offset="utc">
Nov 16 10:13:39 user nova-compute[85141]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 10:13:39 user nova-compute[85141]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 10:13:39 user nova-compute[85141]:     <timer name="hpet" present="no"/>
Nov 16 10:13:39 user nova-compute[85141]:   </clock>
Nov 16 10:13:39 user nova-compute[85141]:   <cpu mode="custom" match="exact">
Nov 16 10:13:39 user nova-compute[85141]:     <model>Nehalem</model>
Nov 16 10:13:39 user nova-compute[85141]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 10:13:39 user nova-compute[85141]:   </cpu>
Nov 16 10:13:39 user nova-compute[85141]:   <devices>
Nov 16 10:13:39 user nova-compute[85141]:     <disk type="file" device="disk">
Nov 16 10:13:39 user nova-compute[85141]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 10:13:39 user nova-compute[85141]:       <source file="/opt/stack/data/nova/instances/8ff05707-78c9-4f78-95e4-660f10636b7a/disk"/>
Nov 16 10:13:39 user nova-compute[85141]:       <target dev="vda" bus="virtio"/>
Nov 16 10:13:39 user nova-compute[85141]:     </disk>
Nov 16 10:13:39 user nova-compute[85141]:     <interface type="ethernet">
Nov 16 10:13:39 user nova-compute[85141]:       <mac address="fa:16:3e:4e:f1:9b"/>
Nov 16 10:13:39 user nova-compute[85141]:       <model type="virtio"/>
Nov 16 10:13:39 user nova-compute[85141]:       <mtu size="1442"/>
Nov 16 10:13:39 user nova-compute[85141]:       <target dev="tape4ce9608-d6"/>
Nov 16 10:13:39 user nova-compute[85141]:     </interface>
Nov 16 10:13:39 user nova-compute[85141]:     <serial type="pty">
Nov 16 10:13:39 user nova-compute[85141]:       <log file="/opt/stack/data/nova/instances/8ff05707-78c9-4f78-95e4-660f10636b7a/console.log" append="off"/>
Nov 16 10:13:39 user nova-compute[85141]:     </serial>
Nov 16 10:13:39 user nova-compute[85141]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 10:13:39 user nova-compute[85141]:     <video>
Nov 16 10:13:39 user nova-compute[85141]:       <model type="virtio"/>
Nov 16 10:13:39 user nova-compute[85141]:     </video>
Nov 16 10:13:39 user nova-compute[85141]:     <rng model="virtio">
Nov 16 10:13:39 user nova-compute[85141]:       <backend model="random">/dev/urandom</backend>
Nov 16 10:13:39 user nova-compute[85141]:     </rng>
Nov 16 10:13:39 user nova-compute[85141]:     <controller type="usb" index="0" model="none"/>
Nov 16 10:13:39 user nova-compute[85141]:     <memballoon model="virtio">
Nov 16 10:13:39 user nova-compute[85141]:       <stats period="10"/>
Nov 16 10:13:39 user nova-compute[85141]:     </memballoon>
Nov 16 10:13:39 user nova-compute[85141]:   </devices>
Nov 16 10:13:39 user nova-compute[85141]: </domain>
Nov 16 10:13:39 user nova-compute[85141]:  {{(pid=85141) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 10:13:39 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-923c055b-1894-4a98-822a-17e90474cecf tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T10:13:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1565498532',display_name='tempest-VolumesAdminNegativeTest-server-1565498532',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1565498532',id=14,image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5b9e035160ba427c80e5668982136a49',ramdisk_id='',reservation_id='r-w8rilfip',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1984071326',owner_user_name='tempest-VolumesAdminNegativeTest-1984071326-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T10:13:37Z,user_data=None,user_id='cb1fde08d82e4eedb97f1501eafa3bd0',uuid=8ff05707-78c9-4f78-95e4-660f10636b7a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e4ce9608-d62c-4289-a5eb-ff3dc20be4fd", "address": "fa:16:3e:4e:f1:9b", "network": {"id": "1d55ecdc-2f77-4c38-b487-0099d658e0ec", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1226034564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b9e035160ba427c80e5668982136a49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4ce9608-d6", "ovs_interfaceid": "e4ce9608-d62c-4289-a5eb-ff3dc20be4fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 10:13:39 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-923c055b-1894-4a98-822a-17e90474cecf tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] Converting VIF {"id": "e4ce9608-d62c-4289-a5eb-ff3dc20be4fd", "address": "fa:16:3e:4e:f1:9b", "network": {"id": "1d55ecdc-2f77-4c38-b487-0099d658e0ec", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1226034564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b9e035160ba427c80e5668982136a49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4ce9608-d6", "ovs_interfaceid": "e4ce9608-d62c-4289-a5eb-ff3dc20be4fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:13:39 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-923c055b-1894-4a98-822a-17e90474cecf tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4e:f1:9b,bridge_name='br-int',has_traffic_filtering=True,id=e4ce9608-d62c-4289-a5eb-ff3dc20be4fd,network=Network(1d55ecdc-2f77-4c38-b487-0099d658e0ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4ce9608-d6') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:13:39 user nova-compute[85141]: DEBUG os_vif [None req-923c055b-1894-4a98-822a-17e90474cecf tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:f1:9b,bridge_name='br-int',has_traffic_filtering=True,id=e4ce9608-d62c-4289-a5eb-ff3dc20be4fd,network=Network(1d55ecdc-2f77-4c38-b487-0099d658e0ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4ce9608-d6') {{(pid=85141) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 10:13:39 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:13:39 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:13:39 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 10:13:39 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:13:39 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '77723c70-f5c8-59fd-b174-9f186b22475f', '_type': 'linux-noop'}}, row=False) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:13:39 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:13:39 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:13:39 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:13:39 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:13:39 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape4ce9608-d6, may_exist=True, interface_attrs={}) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:13:39 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape4ce9608-d6, col_values=(('qos', UUID('22afe6c9-b083-4986-8138-e26322c33ba6')),), if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:13:39 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape4ce9608-d6, col_values=(('external_ids', {'iface-id': 'e4ce9608-d62c-4289-a5eb-ff3dc20be4fd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4e:f1:9b', 'vm-uuid': '8ff05707-78c9-4f78-95e4-660f10636b7a'}),), if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:13:39 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:13:39 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:13:39 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:13:39 user nova-compute[85141]: INFO os_vif [None req-923c055b-1894-4a98-822a-17e90474cecf tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:f1:9b,bridge_name='br-int',has_traffic_filtering=True,id=e4ce9608-d62c-4289-a5eb-ff3dc20be4fd,network=Network(1d55ecdc-2f77-4c38-b487-0099d658e0ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4ce9608-d6')
Nov 16 10:13:39 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-923c055b-1894-4a98-822a-17e90474cecf tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] No BDM found with device name vda, not building metadata. {{(pid=85141) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 10:13:39 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-923c055b-1894-4a98-822a-17e90474cecf tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] No VIF found with MAC fa:16:3e:4e:f1:9b, not building metadata {{(pid=85141) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 10:13:39 user nova-compute[85141]: DEBUG nova.network.neutron [req-7dbe86e2-5575-4942-9f94-393ba5cf8a47 req-e979b21e-21f8-4fbf-8961-4a29495b63a8 service nova] [instance: 8ff05707-78c9-4f78-95e4-660f10636b7a] Updated VIF entry in instance network info cache for port e4ce9608-d62c-4289-a5eb-ff3dc20be4fd. {{(pid=85141) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 10:13:39 user nova-compute[85141]: DEBUG nova.network.neutron [req-7dbe86e2-5575-4942-9f94-393ba5cf8a47 req-e979b21e-21f8-4fbf-8961-4a29495b63a8 service nova] [instance: 8ff05707-78c9-4f78-95e4-660f10636b7a] Updating instance_info_cache with network_info: [{"id": "e4ce9608-d62c-4289-a5eb-ff3dc20be4fd", "address": "fa:16:3e:4e:f1:9b", "network": {"id": "1d55ecdc-2f77-4c38-b487-0099d658e0ec", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1226034564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b9e035160ba427c80e5668982136a49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4ce9608-d6", "ovs_interfaceid": "e4ce9608-d62c-4289-a5eb-ff3dc20be4fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:13:39 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-7dbe86e2-5575-4942-9f94-393ba5cf8a47 req-e979b21e-21f8-4fbf-8961-4a29495b63a8 service nova] Releasing lock "refresh_cache-8ff05707-78c9-4f78-95e4-660f10636b7a" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:13:39 user nova-compute[85141]: DEBUG nova.network.neutron [None req-d19fb610-8984-440d-9060-461ca2ae9388 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] [instance: 059d6974-bd0c-4f73-91fc-8202ebda4238] Successfully updated port: 89bf502f-593d-4c6e-aa83-a041e0ad7b28 {{(pid=85141) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 10:13:39 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-d19fb610-8984-440d-9060-461ca2ae9388 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Acquiring lock "refresh_cache-059d6974-bd0c-4f73-91fc-8202ebda4238" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:13:39 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-d19fb610-8984-440d-9060-461ca2ae9388 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Acquired lock "refresh_cache-059d6974-bd0c-4f73-91fc-8202ebda4238" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:13:39 user nova-compute[85141]: DEBUG nova.network.neutron [None req-d19fb610-8984-440d-9060-461ca2ae9388 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] [instance: 059d6974-bd0c-4f73-91fc-8202ebda4238] Building network info cache for instance {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 10:13:40 user nova-compute[85141]: DEBUG nova.network.neutron [None req-d19fb610-8984-440d-9060-461ca2ae9388 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] [instance: 059d6974-bd0c-4f73-91fc-8202ebda4238] Instance cache missing network info. {{(pid=85141) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 10:13:40 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-ec25c880-8b57-4476-b347-2eb498c7d5cf tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.309s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 10:13:40 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec25c880-8b57-4476-b347-2eb498c7d5cf tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] <== connect_volume: return (1310ms) {'type': 'block', 'scsi_wwn': '23330333531646234', 'path': '/dev/sdc'} {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 10:13:40 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ec25c880-8b57-4476-b347-2eb498c7d5cf tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] [instance: f01dc8cf-1a69-4618-a15d-0c1075157f05] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23330333531646234', 'path': '/dev/sdc'} {{(pid=85141) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 10:13:40 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-ec25c880-8b57-4476-b347-2eb498c7d5cf tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T10:13:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-979622720',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-979622720',id=13,image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='733b504d4dbe4f028963cf2c197f0064',ramdisk_id='',reservation_id='r-ag7dsbiu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-742384119',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T10:13:28Z,user_data=None,user_id='ffe6ceff3cc346b59b4fbf294b9fc1a3',uuid=f01dc8cf-1a69-4618-a15d-0c1075157f05,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "52edc378-51f4-43c3-b9f3-2d0201ed125d", "address": "fa:16:3e:38:1f:8f", "network": {"id": "e40e4bd2-4277-40b1-9451-1c8365ffa488", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1333036447-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "733b504d4dbe4f028963cf2c197f0064", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52edc378-51", "ovs_interfaceid": "52edc378-51f4-43c3-b9f3-2d0201ed125d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=85141) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 10:13:40 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-ec25c880-8b57-4476-b347-2eb498c7d5cf tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Converting VIF {"id": "52edc378-51f4-43c3-b9f3-2d0201ed125d", "address": "fa:16:3e:38:1f:8f", "network": {"id": "e40e4bd2-4277-40b1-9451-1c8365ffa488", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1333036447-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "733b504d4dbe4f028963cf2c197f0064", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52edc378-51", "ovs_interfaceid": "52edc378-51f4-43c3-b9f3-2d0201ed125d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:13:40 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-ec25c880-8b57-4476-b347-2eb498c7d5cf tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:1f:8f,bridge_name='br-int',has_traffic_filtering=True,id=52edc378-51f4-43c3-b9f3-2d0201ed125d,network=Network(e40e4bd2-4277-40b1-9451-1c8365ffa488),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52edc378-51') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:13:40 user nova-compute[85141]: DEBUG nova.objects.instance [None req-ec25c880-8b57-4476-b347-2eb498c7d5cf tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Lazy-loading 'pci_devices' on Instance uuid f01dc8cf-1a69-4618-a15d-0c1075157f05 {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:13:40 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-ec25c880-8b57-4476-b347-2eb498c7d5cf tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] [instance: f01dc8cf-1a69-4618-a15d-0c1075157f05] End _get_guest_xml xml=<domain type="kvm">
Nov 16 10:13:40 user nova-compute[85141]:   <uuid>f01dc8cf-1a69-4618-a15d-0c1075157f05</uuid>
Nov 16 10:13:40 user nova-compute[85141]:   <name>instance-0000000d</name>
Nov 16 10:13:40 user nova-compute[85141]:   <memory>524288</memory>
Nov 16 10:13:40 user nova-compute[85141]:   <vcpu>1</vcpu>
Nov 16 10:13:40 user nova-compute[85141]:   <metadata>
Nov 16 10:13:40 user nova-compute[85141]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 10:13:40 user nova-compute[85141]:       <nova:package version="0.0.0"/>
Nov 16 10:13:40 user nova-compute[85141]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-979622720</nova:name>
Nov 16 10:13:40 user nova-compute[85141]:       <nova:creationTime>2023-11-16 10:13:38</nova:creationTime>
Nov 16 10:13:40 user nova-compute[85141]:       <nova:flavor name="m1.tiny">
Nov 16 10:13:40 user nova-compute[85141]:         <nova:memory>512</nova:memory>
Nov 16 10:13:40 user nova-compute[85141]:         <nova:disk>1</nova:disk>
Nov 16 10:13:40 user nova-compute[85141]:         <nova:swap>0</nova:swap>
Nov 16 10:13:40 user nova-compute[85141]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 10:13:40 user nova-compute[85141]:         <nova:vcpus>1</nova:vcpus>
Nov 16 10:13:40 user nova-compute[85141]:       </nova:flavor>
Nov 16 10:13:40 user nova-compute[85141]:       <nova:owner>
Nov 16 10:13:40 user nova-compute[85141]:         <nova:user uuid="ffe6ceff3cc346b59b4fbf294b9fc1a3">tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member</nova:user>
Nov 16 10:13:40 user nova-compute[85141]:         <nova:project uuid="733b504d4dbe4f028963cf2c197f0064">tempest-ServerBootFromVolumeStableRescueTest-742384119</nova:project>
Nov 16 10:13:40 user nova-compute[85141]:       </nova:owner>
Nov 16 10:13:40 user nova-compute[85141]:       <nova:root type="image" uuid="bc4ca70f-a459-4d5c-a9e6-80f1948eb48b"/>
Nov 16 10:13:40 user nova-compute[85141]:       <nova:ports>
Nov 16 10:13:40 user nova-compute[85141]:         <nova:port uuid="52edc378-51f4-43c3-b9f3-2d0201ed125d">
Nov 16 10:13:40 user nova-compute[85141]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 16 10:13:40 user nova-compute[85141]:         </nova:port>
Nov 16 10:13:40 user nova-compute[85141]:       </nova:ports>
Nov 16 10:13:40 user nova-compute[85141]:     </nova:instance>
Nov 16 10:13:40 user nova-compute[85141]:   </metadata>
Nov 16 10:13:40 user nova-compute[85141]:   <sysinfo type="smbios">
Nov 16 10:13:40 user nova-compute[85141]:     <system>
Nov 16 10:13:40 user nova-compute[85141]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 10:13:40 user nova-compute[85141]:       <entry name="product">OpenStack Nova</entry>
Nov 16 10:13:40 user nova-compute[85141]:       <entry name="version">0.0.0</entry>
Nov 16 10:13:40 user nova-compute[85141]:       <entry name="serial">f01dc8cf-1a69-4618-a15d-0c1075157f05</entry>
Nov 16 10:13:40 user nova-compute[85141]:       <entry name="uuid">f01dc8cf-1a69-4618-a15d-0c1075157f05</entry>
Nov 16 10:13:40 user nova-compute[85141]:       <entry name="family">Virtual Machine</entry>
Nov 16 10:13:40 user nova-compute[85141]:     </system>
Nov 16 10:13:40 user nova-compute[85141]:   </sysinfo>
Nov 16 10:13:40 user nova-compute[85141]:   <os>
Nov 16 10:13:40 user nova-compute[85141]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 10:13:40 user nova-compute[85141]:     <boot dev="hd"/>
Nov 16 10:13:40 user nova-compute[85141]:     <smbios mode="sysinfo"/>
Nov 16 10:13:40 user nova-compute[85141]:   </os>
Nov 16 10:13:40 user nova-compute[85141]:   <features>
Nov 16 10:13:40 user nova-compute[85141]:     <acpi/>
Nov 16 10:13:40 user nova-compute[85141]:     <apic/>
Nov 16 10:13:40 user nova-compute[85141]:     <vmcoreinfo/>
Nov 16 10:13:40 user nova-compute[85141]:   </features>
Nov 16 10:13:40 user nova-compute[85141]:   <clock offset="utc">
Nov 16 10:13:40 user nova-compute[85141]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 10:13:40 user nova-compute[85141]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 10:13:40 user nova-compute[85141]:     <timer name="hpet" present="no"/>
Nov 16 10:13:40 user nova-compute[85141]:   </clock>
Nov 16 10:13:40 user nova-compute[85141]:   <cpu mode="custom" match="exact">
Nov 16 10:13:40 user nova-compute[85141]:     <model>Nehalem</model>
Nov 16 10:13:40 user nova-compute[85141]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 10:13:40 user nova-compute[85141]:   </cpu>
Nov 16 10:13:40 user nova-compute[85141]:   <devices>
Nov 16 10:13:40 user nova-compute[85141]:     <disk type="block" device="disk">
Nov 16 10:13:40 user nova-compute[85141]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 10:13:40 user nova-compute[85141]:       <source dev="/dev/sdc"/>
Nov 16 10:13:40 user nova-compute[85141]:       <target dev="vda" bus="virtio"/>
Nov 16 10:13:40 user nova-compute[85141]:       <serial>f762b977-47ad-490c-a516-0216703bebee</serial>
Nov 16 10:13:40 user nova-compute[85141]:     </disk>
Nov 16 10:13:40 user nova-compute[85141]:     <interface type="ethernet">
Nov 16 10:13:40 user nova-compute[85141]:       <mac address="fa:16:3e:38:1f:8f"/>
Nov 16 10:13:40 user nova-compute[85141]:       <model type="virtio"/>
Nov 16 10:13:40 user nova-compute[85141]:       <mtu size="1442"/>
Nov 16 10:13:40 user nova-compute[85141]:       <target dev="tap52edc378-51"/>
Nov 16 10:13:40 user nova-compute[85141]:     </interface>
Nov 16 10:13:40 user nova-compute[85141]:     <serial type="pty">
Nov 16 10:13:40 user nova-compute[85141]:       <log file="/opt/stack/data/nova/instances/f01dc8cf-1a69-4618-a15d-0c1075157f05/console.log" append="off"/>
Nov 16 10:13:40 user nova-compute[85141]:     </serial>
Nov 16 10:13:40 user nova-compute[85141]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 10:13:40 user nova-compute[85141]:     <video>
Nov 16 10:13:40 user nova-compute[85141]:       <model type="virtio"/>
Nov 16 10:13:40 user nova-compute[85141]:     </video>
Nov 16 10:13:40 user nova-compute[85141]:     <rng model="virtio">
Nov 16 10:13:40 user nova-compute[85141]:       <backend model="random">/dev/urandom</backend>
Nov 16 10:13:40 user nova-compute[85141]:     </rng>
Nov 16 10:13:40 user nova-compute[85141]:     <controller type="usb" index="0" model="none"/>
Nov 16 10:13:40 user nova-compute[85141]:     <memballoon model="virtio">
Nov 16 10:13:40 user nova-compute[85141]:       <stats period="10"/>
Nov 16 10:13:40 user nova-compute[85141]:     </memballoon>
Nov 16 10:13:40 user nova-compute[85141]:   </devices>
Nov 16 10:13:40 user nova-compute[85141]: </domain>
Nov 16 10:13:40 user nova-compute[85141]:  {{(pid=85141) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 10:13:40 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-ec25c880-8b57-4476-b347-2eb498c7d5cf tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T10:13:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-979622720',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-979622720',id=13,image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='733b504d4dbe4f028963cf2c197f0064',ramdisk_id='',reservation_id='r-ag7dsbiu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-742384119',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T10:13:28Z,user_data=None,user_id='ffe6ceff3cc346b59b4fbf294b9fc1a3',uuid=f01dc8cf-1a69-4618-a15d-0c1075157f05,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "52edc378-51f4-43c3-b9f3-2d0201ed125d", "address": "fa:16:3e:38:1f:8f", "network": {"id": "e40e4bd2-4277-40b1-9451-1c8365ffa488", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1333036447-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "733b504d4dbe4f028963cf2c197f0064", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52edc378-51", "ovs_interfaceid": "52edc378-51f4-43c3-b9f3-2d0201ed125d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 10:13:40 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-ec25c880-8b57-4476-b347-2eb498c7d5cf tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Converting VIF {"id": "52edc378-51f4-43c3-b9f3-2d0201ed125d", "address": "fa:16:3e:38:1f:8f", "network": {"id": "e40e4bd2-4277-40b1-9451-1c8365ffa488", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1333036447-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "733b504d4dbe4f028963cf2c197f0064", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52edc378-51", "ovs_interfaceid": "52edc378-51f4-43c3-b9f3-2d0201ed125d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:13:40 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-ec25c880-8b57-4476-b347-2eb498c7d5cf tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:1f:8f,bridge_name='br-int',has_traffic_filtering=True,id=52edc378-51f4-43c3-b9f3-2d0201ed125d,network=Network(e40e4bd2-4277-40b1-9451-1c8365ffa488),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52edc378-51') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:13:40 user nova-compute[85141]: DEBUG os_vif [None req-ec25c880-8b57-4476-b347-2eb498c7d5cf tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:1f:8f,bridge_name='br-int',has_traffic_filtering=True,id=52edc378-51f4-43c3-b9f3-2d0201ed125d,network=Network(e40e4bd2-4277-40b1-9451-1c8365ffa488),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52edc378-51') {{(pid=85141) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 10:13:40 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:13:40 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:13:40 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 10:13:40 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:13:40 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd0acc8bc-4f42-54e3-a4cc-a0ab52fbf8f0', '_type': 'linux-noop'}}, row=False) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:13:40 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:13:40 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:13:40 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:13:40 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:13:40 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap52edc378-51, may_exist=True, interface_attrs={}) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:13:40 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap52edc378-51, col_values=(('qos', UUID('b13d590b-1f58-416e-b01d-af1612cf6eae')),), if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:13:40 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap52edc378-51, col_values=(('external_ids', {'iface-id': '52edc378-51f4-43c3-b9f3-2d0201ed125d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:38:1f:8f', 'vm-uuid': 'f01dc8cf-1a69-4618-a15d-0c1075157f05'}),), if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:13:40 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:13:40 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:13:40 user nova-compute[85141]: INFO os_vif [None req-ec25c880-8b57-4476-b347-2eb498c7d5cf tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:1f:8f,bridge_name='br-int',has_traffic_filtering=True,id=52edc378-51f4-43c3-b9f3-2d0201ed125d,network=Network(e40e4bd2-4277-40b1-9451-1c8365ffa488),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52edc378-51')
Nov 16 10:13:40 user nova-compute[85141]: DEBUG nova.network.neutron [None req-d19fb610-8984-440d-9060-461ca2ae9388 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] [instance: 059d6974-bd0c-4f73-91fc-8202ebda4238] Updating instance_info_cache with network_info: [{"id": "89bf502f-593d-4c6e-aa83-a041e0ad7b28", "address": "fa:16:3e:40:09:f4", "network": {"id": "859d1f09-56c4-4c2b-b2c3-02b1938e8dbf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1562516834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "879fa3f4dfc34726b20149b8a7db22dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89bf502f-59", "ovs_interfaceid": "89bf502f-593d-4c6e-aa83-a041e0ad7b28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:13:40 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-d19fb610-8984-440d-9060-461ca2ae9388 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Releasing lock "refresh_cache-059d6974-bd0c-4f73-91fc-8202ebda4238" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:13:40 user nova-compute[85141]: DEBUG nova.compute.manager [None req-d19fb610-8984-440d-9060-461ca2ae9388 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] [instance: 059d6974-bd0c-4f73-91fc-8202ebda4238] Instance network_info: |[{"id": "89bf502f-593d-4c6e-aa83-a041e0ad7b28", "address": "fa:16:3e:40:09:f4", "network": {"id": "859d1f09-56c4-4c2b-b2c3-02b1938e8dbf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1562516834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "879fa3f4dfc34726b20149b8a7db22dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89bf502f-59", "ovs_interfaceid": "89bf502f-593d-4c6e-aa83-a041e0ad7b28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=85141) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 10:13:40 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-d19fb610-8984-440d-9060-461ca2ae9388 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] [instance: 059d6974-bd0c-4f73-91fc-8202ebda4238] Start _get_guest_xml network_info=[{"id": "89bf502f-593d-4c6e-aa83-a041e0ad7b28", "address": "fa:16:3e:40:09:f4", "network": {"id": "859d1f09-56c4-4c2b-b2c3-02b1938e8dbf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1562516834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "879fa3f4dfc34726b20149b8a7db22dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89bf502f-59", "ovs_interfaceid": "89bf502f-593d-4c6e-aa83-a041e0ad7b28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T10:06:42Z,direct_url=<?>,disk_format='qcow2',id=bc4ca70f-a459-4d5c-a9e6-80f1948eb48b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1044631a5fe84ce8904864a7024049fa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T10:06:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_options': None, 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'image_id': 'bc4ca70f-a459-4d5c-a9e6-80f1948eb48b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=85141) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 10:13:40 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-d19fb610-8984-440d-9060-461ca2ae9388 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:13:40 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-d19fb610-8984-440d-9060-461ca2ae9388 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:13:40 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-d19fb610-8984-440d-9060-461ca2ae9388 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=85141) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 10:13:40 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-d19fb610-8984-440d-9060-461ca2ae9388 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] CPU controller missing on host. {{(pid=85141) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 10:13:40 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-d19fb610-8984-440d-9060-461ca2ae9388 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=85141) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 10:13:40 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-d19fb610-8984-440d-9060-461ca2ae9388 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] CPU controller found on host. {{(pid=85141) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 10:13:40 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-d19fb610-8984-440d-9060-461ca2ae9388 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=85141) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 10:13:40 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-d19fb610-8984-440d-9060-461ca2ae9388 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T10:06:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T10:06:42Z,direct_url=<?>,disk_format='qcow2',id=bc4ca70f-a459-4d5c-a9e6-80f1948eb48b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1044631a5fe84ce8904864a7024049fa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T10:06:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 10:13:40 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-d19fb610-8984-440d-9060-461ca2ae9388 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Flavor limits 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 10:13:40 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-d19fb610-8984-440d-9060-461ca2ae9388 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Image limits 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 10:13:40 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-d19fb610-8984-440d-9060-461ca2ae9388 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Flavor pref 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 10:13:40 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-d19fb610-8984-440d-9060-461ca2ae9388 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Image pref 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 10:13:40 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-d19fb610-8984-440d-9060-461ca2ae9388 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 10:13:40 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-d19fb610-8984-440d-9060-461ca2ae9388 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 10:13:40 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-d19fb610-8984-440d-9060-461ca2ae9388 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=85141) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 10:13:40 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-d19fb610-8984-440d-9060-461ca2ae9388 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Got 1 possible topologies {{(pid=85141) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 10:13:40 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-d19fb610-8984-440d-9060-461ca2ae9388 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 10:13:40 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-d19fb610-8984-440d-9060-461ca2ae9388 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 10:13:40 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-d19fb610-8984-440d-9060-461ca2ae9388 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T10:13:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1354808700',display_name='tempest-ServerActionsTestOtherA-server-1354808700',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1354808700',id=15,image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFB91nOE4JIg0PQZ9Fq9iMRTb/Qm6bpwHSXAkC8g5YxG6awy4b4nS0XAfWSm4O4f40Blu3eMfyuYdZY8eI6KFpQYslLrgvG2jeJNbK6AHNNiLWxDV8sQbQZDDAy7NeOUMQ==',key_name='tempest-keypair-799272913',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='879fa3f4dfc34726b20149b8a7db22dc',ramdisk_id='',reservation_id='r-joc06p7i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1137992555',owner_user_name='tempest-ServerActionsTestOtherA-1137992555-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T10:13:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e95802a919de4345add493a8d7873e48',uuid=059d6974-bd0c-4f73-91fc-8202ebda4238,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "89bf502f-593d-4c6e-aa83-a041e0ad7b28", "address": "fa:16:3e:40:09:f4", "network": {"id": "859d1f09-56c4-4c2b-b2c3-02b1938e8dbf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1562516834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "879fa3f4dfc34726b20149b8a7db22dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89bf502f-59", "ovs_interfaceid": "89bf502f-593d-4c6e-aa83-a041e0ad7b28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=85141) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 10:13:40 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-d19fb610-8984-440d-9060-461ca2ae9388 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Converting VIF {"id": "89bf502f-593d-4c6e-aa83-a041e0ad7b28", "address": "fa:16:3e:40:09:f4", "network": {"id": "859d1f09-56c4-4c2b-b2c3-02b1938e8dbf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1562516834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "879fa3f4dfc34726b20149b8a7db22dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89bf502f-59", "ovs_interfaceid": "89bf502f-593d-4c6e-aa83-a041e0ad7b28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:13:40 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-d19fb610-8984-440d-9060-461ca2ae9388 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:40:09:f4,bridge_name='br-int',has_traffic_filtering=True,id=89bf502f-593d-4c6e-aa83-a041e0ad7b28,network=Network(859d1f09-56c4-4c2b-b2c3-02b1938e8dbf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89bf502f-59') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:13:40 user nova-compute[85141]: DEBUG nova.objects.instance [None req-d19fb610-8984-440d-9060-461ca2ae9388 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Lazy-loading 'pci_devices' on Instance uuid 059d6974-bd0c-4f73-91fc-8202ebda4238 {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:13:40 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-ec25c880-8b57-4476-b347-2eb498c7d5cf tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] No BDM found with device name vda, not building metadata. {{(pid=85141) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 10:13:40 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-ec25c880-8b57-4476-b347-2eb498c7d5cf tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] No VIF found with MAC fa:16:3e:38:1f:8f, not building metadata {{(pid=85141) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 10:13:40 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-d19fb610-8984-440d-9060-461ca2ae9388 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] [instance: 059d6974-bd0c-4f73-91fc-8202ebda4238] End _get_guest_xml xml=<domain type="kvm">
Nov 16 10:13:40 user nova-compute[85141]:   <uuid>059d6974-bd0c-4f73-91fc-8202ebda4238</uuid>
Nov 16 10:13:40 user nova-compute[85141]:   <name>instance-0000000f</name>
Nov 16 10:13:40 user nova-compute[85141]:   <memory>524288</memory>
Nov 16 10:13:40 user nova-compute[85141]:   <vcpu>1</vcpu>
Nov 16 10:13:40 user nova-compute[85141]:   <metadata>
Nov 16 10:13:40 user nova-compute[85141]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 10:13:40 user nova-compute[85141]:       <nova:package version="0.0.0"/>
Nov 16 10:13:40 user nova-compute[85141]:       <nova:name>tempest-ServerActionsTestOtherA-server-1354808700</nova:name>
Nov 16 10:13:40 user nova-compute[85141]:       <nova:creationTime>2023-11-16 10:13:40</nova:creationTime>
Nov 16 10:13:40 user nova-compute[85141]:       <nova:flavor name="m1.tiny">
Nov 16 10:13:40 user nova-compute[85141]:         <nova:memory>512</nova:memory>
Nov 16 10:13:40 user nova-compute[85141]:         <nova:disk>1</nova:disk>
Nov 16 10:13:40 user nova-compute[85141]:         <nova:swap>0</nova:swap>
Nov 16 10:13:40 user nova-compute[85141]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 10:13:40 user nova-compute[85141]:         <nova:vcpus>1</nova:vcpus>
Nov 16 10:13:40 user nova-compute[85141]:       </nova:flavor>
Nov 16 10:13:40 user nova-compute[85141]:       <nova:owner>
Nov 16 10:13:40 user nova-compute[85141]:         <nova:user uuid="e95802a919de4345add493a8d7873e48">tempest-ServerActionsTestOtherA-1137992555-project-member</nova:user>
Nov 16 10:13:40 user nova-compute[85141]:         <nova:project uuid="879fa3f4dfc34726b20149b8a7db22dc">tempest-ServerActionsTestOtherA-1137992555</nova:project>
Nov 16 10:13:40 user nova-compute[85141]:       </nova:owner>
Nov 16 10:13:40 user nova-compute[85141]:       <nova:root type="image" uuid="bc4ca70f-a459-4d5c-a9e6-80f1948eb48b"/>
Nov 16 10:13:40 user nova-compute[85141]:       <nova:ports>
Nov 16 10:13:40 user nova-compute[85141]:         <nova:port uuid="89bf502f-593d-4c6e-aa83-a041e0ad7b28">
Nov 16 10:13:40 user nova-compute[85141]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 16 10:13:40 user nova-compute[85141]:         </nova:port>
Nov 16 10:13:40 user nova-compute[85141]:       </nova:ports>
Nov 16 10:13:40 user nova-compute[85141]:     </nova:instance>
Nov 16 10:13:40 user nova-compute[85141]:   </metadata>
Nov 16 10:13:40 user nova-compute[85141]:   <sysinfo type="smbios">
Nov 16 10:13:40 user nova-compute[85141]:     <system>
Nov 16 10:13:40 user nova-compute[85141]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 10:13:40 user nova-compute[85141]:       <entry name="product">OpenStack Nova</entry>
Nov 16 10:13:40 user nova-compute[85141]:       <entry name="version">0.0.0</entry>
Nov 16 10:13:40 user nova-compute[85141]:       <entry name="serial">059d6974-bd0c-4f73-91fc-8202ebda4238</entry>
Nov 16 10:13:40 user nova-compute[85141]:       <entry name="uuid">059d6974-bd0c-4f73-91fc-8202ebda4238</entry>
Nov 16 10:13:40 user nova-compute[85141]:       <entry name="family">Virtual Machine</entry>
Nov 16 10:13:40 user nova-compute[85141]:     </system>
Nov 16 10:13:40 user nova-compute[85141]:   </sysinfo>
Nov 16 10:13:40 user nova-compute[85141]:   <os>
Nov 16 10:13:40 user nova-compute[85141]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 10:13:40 user nova-compute[85141]:     <boot dev="hd"/>
Nov 16 10:13:40 user nova-compute[85141]:     <smbios mode="sysinfo"/>
Nov 16 10:13:40 user nova-compute[85141]:   </os>
Nov 16 10:13:40 user nova-compute[85141]:   <features>
Nov 16 10:13:40 user nova-compute[85141]:     <acpi/>
Nov 16 10:13:40 user nova-compute[85141]:     <apic/>
Nov 16 10:13:40 user nova-compute[85141]:     <vmcoreinfo/>
Nov 16 10:13:40 user nova-compute[85141]:   </features>
Nov 16 10:13:40 user nova-compute[85141]:   <clock offset="utc">
Nov 16 10:13:40 user nova-compute[85141]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 10:13:40 user nova-compute[85141]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 10:13:40 user nova-compute[85141]:     <timer name="hpet" present="no"/>
Nov 16 10:13:40 user nova-compute[85141]:   </clock>
Nov 16 10:13:40 user nova-compute[85141]:   <cpu mode="custom" match="exact">
Nov 16 10:13:40 user nova-compute[85141]:     <model>Nehalem</model>
Nov 16 10:13:40 user nova-compute[85141]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 10:13:40 user nova-compute[85141]:   </cpu>
Nov 16 10:13:40 user nova-compute[85141]:   <devices>
Nov 16 10:13:40 user nova-compute[85141]:     <disk type="file" device="disk">
Nov 16 10:13:40 user nova-compute[85141]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 10:13:40 user nova-compute[85141]:       <source file="/opt/stack/data/nova/instances/059d6974-bd0c-4f73-91fc-8202ebda4238/disk"/>
Nov 16 10:13:40 user nova-compute[85141]:       <target dev="vda" bus="virtio"/>
Nov 16 10:13:40 user nova-compute[85141]:     </disk>
Nov 16 10:13:40 user nova-compute[85141]:     <interface type="ethernet">
Nov 16 10:13:40 user nova-compute[85141]:       <mac address="fa:16:3e:40:09:f4"/>
Nov 16 10:13:40 user nova-compute[85141]:       <model type="virtio"/>
Nov 16 10:13:40 user nova-compute[85141]:       <mtu size="1442"/>
Nov 16 10:13:40 user nova-compute[85141]:       <target dev="tap89bf502f-59"/>
Nov 16 10:13:40 user nova-compute[85141]:     </interface>
Nov 16 10:13:40 user nova-compute[85141]:     <serial type="pty">
Nov 16 10:13:40 user nova-compute[85141]:       <log file="/opt/stack/data/nova/instances/059d6974-bd0c-4f73-91fc-8202ebda4238/console.log" append="off"/>
Nov 16 10:13:40 user nova-compute[85141]:     </serial>
Nov 16 10:13:40 user nova-compute[85141]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 10:13:40 user nova-compute[85141]:     <video>
Nov 16 10:13:40 user nova-compute[85141]:       <model type="virtio"/>
Nov 16 10:13:40 user nova-compute[85141]:     </video>
Nov 16 10:13:40 user nova-compute[85141]:     <rng model="virtio">
Nov 16 10:13:40 user nova-compute[85141]:       <backend model="random">/dev/urandom</backend>
Nov 16 10:13:40 user nova-compute[85141]:     </rng>
Nov 16 10:13:40 user nova-compute[85141]:     <controller type="usb" index="0" model="none"/>
Nov 16 10:13:40 user nova-compute[85141]:     <memballoon model="virtio">
Nov 16 10:13:40 user nova-compute[85141]:       <stats period="10"/>
Nov 16 10:13:40 user nova-compute[85141]:     </memballoon>
Nov 16 10:13:40 user nova-compute[85141]:   </devices>
Nov 16 10:13:40 user nova-compute[85141]: </domain>
Nov 16 10:13:40 user nova-compute[85141]:  {{(pid=85141) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 10:13:40 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-d19fb610-8984-440d-9060-461ca2ae9388 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T10:13:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1354808700',display_name='tempest-ServerActionsTestOtherA-server-1354808700',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1354808700',id=15,image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFB91nOE4JIg0PQZ9Fq9iMRTb/Qm6bpwHSXAkC8g5YxG6awy4b4nS0XAfWSm4O4f40Blu3eMfyuYdZY8eI6KFpQYslLrgvG2jeJNbK6AHNNiLWxDV8sQbQZDDAy7NeOUMQ==',key_name='tempest-keypair-799272913',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='879fa3f4dfc34726b20149b8a7db22dc',ramdisk_id='',reservation_id='r-joc06p7i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1137992555',owner_user_name='tempest-ServerActionsTestOtherA-1137992555-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T10:13:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e95802a919de4345add493a8d7873e48',uuid=059d6974-bd0c-4f73-91fc-8202ebda4238,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "89bf502f-593d-4c6e-aa83-a041e0ad7b28", "address": "fa:16:3e:40:09:f4", "network": {"id": "859d1f09-56c4-4c2b-b2c3-02b1938e8dbf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1562516834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "879fa3f4dfc34726b20149b8a7db22dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89bf502f-59", "ovs_interfaceid": "89bf502f-593d-4c6e-aa83-a041e0ad7b28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 10:13:40 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-d19fb610-8984-440d-9060-461ca2ae9388 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Converting VIF {"id": "89bf502f-593d-4c6e-aa83-a041e0ad7b28", "address": "fa:16:3e:40:09:f4", "network": {"id": "859d1f09-56c4-4c2b-b2c3-02b1938e8dbf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1562516834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "879fa3f4dfc34726b20149b8a7db22dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89bf502f-59", "ovs_interfaceid": "89bf502f-593d-4c6e-aa83-a041e0ad7b28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:13:40 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-d19fb610-8984-440d-9060-461ca2ae9388 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:40:09:f4,bridge_name='br-int',has_traffic_filtering=True,id=89bf502f-593d-4c6e-aa83-a041e0ad7b28,network=Network(859d1f09-56c4-4c2b-b2c3-02b1938e8dbf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89bf502f-59') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:13:40 user nova-compute[85141]: DEBUG os_vif [None req-d19fb610-8984-440d-9060-461ca2ae9388 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:09:f4,bridge_name='br-int',has_traffic_filtering=True,id=89bf502f-593d-4c6e-aa83-a041e0ad7b28,network=Network(859d1f09-56c4-4c2b-b2c3-02b1938e8dbf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89bf502f-59') {{(pid=85141) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 10:13:40 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:13:40 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:13:40 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 10:13:40 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:13:40 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'edb413e9-446c-56fa-b7a4-489daa7b5078', '_type': 'linux-noop'}}, row=False) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:13:40 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:13:40 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:13:40 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:13:40 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:13:40 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap89bf502f-59, may_exist=True, interface_attrs={}) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:13:40 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap89bf502f-59, col_values=(('qos', UUID('47a99a10-7ac9-43a5-bd88-0a4d84a30769')),), if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:13:40 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap89bf502f-59, col_values=(('external_ids', {'iface-id': '89bf502f-593d-4c6e-aa83-a041e0ad7b28', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:40:09:f4', 'vm-uuid': '059d6974-bd0c-4f73-91fc-8202ebda4238'}),), if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:13:40 user nova-compute[85141]: DEBUG nova.compute.manager [req-d656f60f-857f-490a-a04b-a5d4a2465b11 req-85fad30e-99b7-467d-9cf0-4d0f9eaf1181 service nova] [instance: 059d6974-bd0c-4f73-91fc-8202ebda4238] Received event network-changed-89bf502f-593d-4c6e-aa83-a041e0ad7b28 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:13:40 user nova-compute[85141]: DEBUG nova.compute.manager [req-d656f60f-857f-490a-a04b-a5d4a2465b11 req-85fad30e-99b7-467d-9cf0-4d0f9eaf1181 service nova] [instance: 059d6974-bd0c-4f73-91fc-8202ebda4238] Refreshing instance network info cache due to event network-changed-89bf502f-593d-4c6e-aa83-a041e0ad7b28. {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 10:13:40 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-d656f60f-857f-490a-a04b-a5d4a2465b11 req-85fad30e-99b7-467d-9cf0-4d0f9eaf1181 service nova] Acquiring lock "refresh_cache-059d6974-bd0c-4f73-91fc-8202ebda4238" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:13:40 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-d656f60f-857f-490a-a04b-a5d4a2465b11 req-85fad30e-99b7-467d-9cf0-4d0f9eaf1181 service nova] Acquired lock "refresh_cache-059d6974-bd0c-4f73-91fc-8202ebda4238" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:13:40 user nova-compute[85141]: DEBUG nova.network.neutron [req-d656f60f-857f-490a-a04b-a5d4a2465b11 req-85fad30e-99b7-467d-9cf0-4d0f9eaf1181 service nova] [instance: 059d6974-bd0c-4f73-91fc-8202ebda4238] Refreshing network info cache for port 89bf502f-593d-4c6e-aa83-a041e0ad7b28 {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 10:13:40 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:13:40 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:13:40 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:13:40 user nova-compute[85141]: INFO os_vif [None req-d19fb610-8984-440d-9060-461ca2ae9388 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:09:f4,bridge_name='br-int',has_traffic_filtering=True,id=89bf502f-593d-4c6e-aa83-a041e0ad7b28,network=Network(859d1f09-56c4-4c2b-b2c3-02b1938e8dbf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89bf502f-59')
Nov 16 10:13:40 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-d19fb610-8984-440d-9060-461ca2ae9388 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] No BDM found with device name vda, not building metadata. {{(pid=85141) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 10:13:40 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-d19fb610-8984-440d-9060-461ca2ae9388 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] No VIF found with MAC fa:16:3e:40:09:f4, not building metadata {{(pid=85141) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 10:13:40 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:13:40 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:13:40 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:13:40 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:13:40 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:13:40 user nova-compute[85141]: DEBUG nova.compute.manager [req-af7bcec4-cf49-4c48-b24f-fff15b1160fe req-6fd848e5-e7bc-4cb6-8075-43879a57b02a service nova] [instance: 8ff05707-78c9-4f78-95e4-660f10636b7a] Received event network-vif-plugged-e4ce9608-d62c-4289-a5eb-ff3dc20be4fd {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:13:40 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-af7bcec4-cf49-4c48-b24f-fff15b1160fe req-6fd848e5-e7bc-4cb6-8075-43879a57b02a service nova] Acquiring lock "8ff05707-78c9-4f78-95e4-660f10636b7a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:13:40 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-af7bcec4-cf49-4c48-b24f-fff15b1160fe req-6fd848e5-e7bc-4cb6-8075-43879a57b02a service nova] Lock "8ff05707-78c9-4f78-95e4-660f10636b7a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:13:40 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-af7bcec4-cf49-4c48-b24f-fff15b1160fe req-6fd848e5-e7bc-4cb6-8075-43879a57b02a service nova] Lock "8ff05707-78c9-4f78-95e4-660f10636b7a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:13:40 user nova-compute[85141]: DEBUG nova.compute.manager [req-af7bcec4-cf49-4c48-b24f-fff15b1160fe req-6fd848e5-e7bc-4cb6-8075-43879a57b02a service nova] [instance: 8ff05707-78c9-4f78-95e4-660f10636b7a] No waiting events found dispatching network-vif-plugged-e4ce9608-d62c-4289-a5eb-ff3dc20be4fd {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:13:40 user nova-compute[85141]: WARNING nova.compute.manager [req-af7bcec4-cf49-4c48-b24f-fff15b1160fe req-6fd848e5-e7bc-4cb6-8075-43879a57b02a service nova] [instance: 8ff05707-78c9-4f78-95e4-660f10636b7a] Received unexpected event network-vif-plugged-e4ce9608-d62c-4289-a5eb-ff3dc20be4fd for instance with vm_state building and task_state spawning.
Nov 16 10:13:40 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:13:40 user nova-compute[85141]: DEBUG nova.network.neutron [req-d656f60f-857f-490a-a04b-a5d4a2465b11 req-85fad30e-99b7-467d-9cf0-4d0f9eaf1181 service nova] [instance: 059d6974-bd0c-4f73-91fc-8202ebda4238] Updated VIF entry in instance network info cache for port 89bf502f-593d-4c6e-aa83-a041e0ad7b28. {{(pid=85141) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 10:13:40 user nova-compute[85141]: DEBUG nova.network.neutron [req-d656f60f-857f-490a-a04b-a5d4a2465b11 req-85fad30e-99b7-467d-9cf0-4d0f9eaf1181 service nova] [instance: 059d6974-bd0c-4f73-91fc-8202ebda4238] Updating instance_info_cache with network_info: [{"id": "89bf502f-593d-4c6e-aa83-a041e0ad7b28", "address": "fa:16:3e:40:09:f4", "network": {"id": "859d1f09-56c4-4c2b-b2c3-02b1938e8dbf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1562516834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "879fa3f4dfc34726b20149b8a7db22dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89bf502f-59", "ovs_interfaceid": "89bf502f-593d-4c6e-aa83-a041e0ad7b28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:13:40 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-d656f60f-857f-490a-a04b-a5d4a2465b11 req-85fad30e-99b7-467d-9cf0-4d0f9eaf1181 service nova] Releasing lock "refresh_cache-059d6974-bd0c-4f73-91fc-8202ebda4238" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:13:41 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-22f2f808-c9d7-4b18-8632-3357d5e96196 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] Waiting for libvirt event about the detach of device tap0fd660bd-1d with device alias net1 from instance 0ca61bd2-268e-4c49-ba04-a5cb39143a9b is timed out.
Nov 16 10:13:41 user nova-compute[85141]: DEBUG nova.virt.libvirt.guest [None req-22f2f808-c9d7-4b18-8632-3357d5e96196 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:86:c2:f1"/><model type="virtio"/><mtu size="1442"/><target dev="tap0fd660bd-1d"/></interface> {{(pid=85141) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 16 10:13:41 user nova-compute[85141]: DEBUG nova.virt.libvirt.guest [None req-22f2f808-c9d7-4b18-8632-3357d5e96196 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:86:c2:f1"/><model type="virtio"/><mtu size="1442"/><target dev="tap0fd660bd-1d"/></interface>not found in domain: <domain type='kvm' id='7'>
Nov 16 10:13:41 user nova-compute[85141]:   <name>instance-00000008</name>
Nov 16 10:13:41 user nova-compute[85141]:   <uuid>0ca61bd2-268e-4c49-ba04-a5cb39143a9b</uuid>
Nov 16 10:13:41 user nova-compute[85141]:   <metadata>
Nov 16 10:13:41 user nova-compute[85141]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 10:13:41 user nova-compute[85141]:   <nova:package version="0.0.0"/>
Nov 16 10:13:41 user nova-compute[85141]:   <nova:name>tempest-device-tagging-server-716916570</nova:name>
Nov 16 10:13:41 user nova-compute[85141]:   <nova:creationTime>2023-11-16 10:12:47</nova:creationTime>
Nov 16 10:13:41 user nova-compute[85141]:   <nova:flavor name="m1.tiny">
Nov 16 10:13:41 user nova-compute[85141]:     <nova:memory>512</nova:memory>
Nov 16 10:13:41 user nova-compute[85141]:     <nova:disk>1</nova:disk>
Nov 16 10:13:41 user nova-compute[85141]:     <nova:swap>0</nova:swap>
Nov 16 10:13:41 user nova-compute[85141]:     <nova:ephemeral>0</nova:ephemeral>
Nov 16 10:13:41 user nova-compute[85141]:     <nova:vcpus>1</nova:vcpus>
Nov 16 10:13:41 user nova-compute[85141]:   </nova:flavor>
Nov 16 10:13:41 user nova-compute[85141]:   <nova:owner>
Nov 16 10:13:41 user nova-compute[85141]:     <nova:user uuid="8734a61ff9fb4e14b1b542b8ecdfdeec">tempest-TaggedAttachmentsTest-1293058027-project-member</nova:user>
Nov 16 10:13:41 user nova-compute[85141]:     <nova:project uuid="b9317f5645af406c899fcc5df61362bb">tempest-TaggedAttachmentsTest-1293058027</nova:project>
Nov 16 10:13:41 user nova-compute[85141]:   </nova:owner>
Nov 16 10:13:41 user nova-compute[85141]:   <nova:root type="image" uuid="bc4ca70f-a459-4d5c-a9e6-80f1948eb48b"/>
Nov 16 10:13:41 user nova-compute[85141]:   <nova:ports>
Nov 16 10:13:41 user nova-compute[85141]:     <nova:port uuid="56375501-2a9c-4821-8446-31156fc0f231">
Nov 16 10:13:41 user nova-compute[85141]:       <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 16 10:13:41 user nova-compute[85141]:     </nova:port>
Nov 16 10:13:41 user nova-compute[85141]:     <nova:port uuid="0fd660bd-1d7b-45d1-8906-d20417082456">
Nov 16 10:13:41 user nova-compute[85141]:       <nova:ip type="fixed" address="10.10.10.69" ipVersion="4"/>
Nov 16 10:13:41 user nova-compute[85141]:     </nova:port>
Nov 16 10:13:41 user nova-compute[85141]:   </nova:ports>
Nov 16 10:13:41 user nova-compute[85141]: </nova:instance>
Nov 16 10:13:41 user nova-compute[85141]:   </metadata>
Nov 16 10:13:41 user nova-compute[85141]:   <memory unit='KiB'>524288</memory>
Nov 16 10:13:41 user nova-compute[85141]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 16 10:13:41 user nova-compute[85141]:   <vcpu placement='static'>1</vcpu>
Nov 16 10:13:41 user nova-compute[85141]:   <resource>
Nov 16 10:13:41 user nova-compute[85141]:     <partition>/machine</partition>
Nov 16 10:13:41 user nova-compute[85141]:   </resource>
Nov 16 10:13:41 user nova-compute[85141]:   <sysinfo type='smbios'>
Nov 16 10:13:41 user nova-compute[85141]:     <system>
Nov 16 10:13:41 user nova-compute[85141]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 16 10:13:41 user nova-compute[85141]:       <entry name='product'>OpenStack Nova</entry>
Nov 16 10:13:41 user nova-compute[85141]:       <entry name='version'>0.0.0</entry>
Nov 16 10:13:41 user nova-compute[85141]:       <entry name='serial'>0ca61bd2-268e-4c49-ba04-a5cb39143a9b</entry>
Nov 16 10:13:41 user nova-compute[85141]:       <entry name='uuid'>0ca61bd2-268e-4c49-ba04-a5cb39143a9b</entry>
Nov 16 10:13:41 user nova-compute[85141]:       <entry name='family'>Virtual Machine</entry>
Nov 16 10:13:41 user nova-compute[85141]:     </system>
Nov 16 10:13:41 user nova-compute[85141]:   </sysinfo>
Nov 16 10:13:41 user nova-compute[85141]:   <os>
Nov 16 10:13:41 user nova-compute[85141]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 16 10:13:41 user nova-compute[85141]:     <boot dev='hd'/>
Nov 16 10:13:41 user nova-compute[85141]:     <smbios mode='sysinfo'/>
Nov 16 10:13:41 user nova-compute[85141]:   </os>
Nov 16 10:13:41 user nova-compute[85141]:   <features>
Nov 16 10:13:41 user nova-compute[85141]:     <acpi/>
Nov 16 10:13:41 user nova-compute[85141]:     <apic/>
Nov 16 10:13:41 user nova-compute[85141]:     <vmcoreinfo state='on'/>
Nov 16 10:13:41 user nova-compute[85141]:   </features>
Nov 16 10:13:41 user nova-compute[85141]:   <cpu mode='custom' match='exact' check='full'>
Nov 16 10:13:41 user nova-compute[85141]:     <model fallback='forbid'>Nehalem</model>
Nov 16 10:13:41 user nova-compute[85141]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 16 10:13:41 user nova-compute[85141]:     <feature policy='require' name='vme'/>
Nov 16 10:13:41 user nova-compute[85141]:     <feature policy='require' name='x2apic'/>
Nov 16 10:13:41 user nova-compute[85141]:     <feature policy='require' name='hypervisor'/>
Nov 16 10:13:41 user nova-compute[85141]:   </cpu>
Nov 16 10:13:41 user nova-compute[85141]:   <clock offset='utc'>
Nov 16 10:13:41 user nova-compute[85141]:     <timer name='pit' tickpolicy='delay'/>
Nov 16 10:13:41 user nova-compute[85141]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 16 10:13:41 user nova-compute[85141]:     <timer name='hpet' present='no'/>
Nov 16 10:13:41 user nova-compute[85141]:   </clock>
Nov 16 10:13:41 user nova-compute[85141]:   <on_poweroff>destroy</on_poweroff>
Nov 16 10:13:41 user nova-compute[85141]:   <on_reboot>restart</on_reboot>
Nov 16 10:13:41 user nova-compute[85141]:   <on_crash>destroy</on_crash>
Nov 16 10:13:41 user nova-compute[85141]:   <devices>
Nov 16 10:13:41 user nova-compute[85141]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 16 10:13:41 user nova-compute[85141]:     <disk type='file' device='disk'>
Nov 16 10:13:41 user nova-compute[85141]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 16 10:13:41 user nova-compute[85141]:       <source file='/opt/stack/data/nova/instances/0ca61bd2-268e-4c49-ba04-a5cb39143a9b/disk' index='2'/>
Nov 16 10:13:41 user nova-compute[85141]:       <backingStore type='file' index='3'>
Nov 16 10:13:41 user nova-compute[85141]:         <format type='raw'/>
Nov 16 10:13:41 user nova-compute[85141]:         <source file='/opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811'/>
Nov 16 10:13:41 user nova-compute[85141]:         <backingStore/>
Nov 16 10:13:41 user nova-compute[85141]:       </backingStore>
Nov 16 10:13:41 user nova-compute[85141]:       <target dev='vda' bus='virtio'/>
Nov 16 10:13:41 user nova-compute[85141]:       <alias name='virtio-disk0'/>
Nov 16 10:13:41 user nova-compute[85141]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 16 10:13:41 user nova-compute[85141]:     </disk>
Nov 16 10:13:41 user nova-compute[85141]:     <disk type='file' device='cdrom'>
Nov 16 10:13:41 user nova-compute[85141]:       <driver name='qemu' type='raw' cache='none'/>
Nov 16 10:13:41 user nova-compute[85141]:       <source file='/opt/stack/data/nova/instances/0ca61bd2-268e-4c49-ba04-a5cb39143a9b/disk.config' index='1'/>
Nov 16 10:13:41 user nova-compute[85141]:       <backingStore/>
Nov 16 10:13:41 user nova-compute[85141]:       <target dev='hda' bus='ide'/>
Nov 16 10:13:41 user nova-compute[85141]:       <readonly/>
Nov 16 10:13:41 user nova-compute[85141]:       <alias name='ide0-0-0'/>
Nov 16 10:13:41 user nova-compute[85141]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 16 10:13:41 user nova-compute[85141]:     </disk>
Nov 16 10:13:41 user nova-compute[85141]:     <controller type='usb' index='0' model='none'>
Nov 16 10:13:41 user nova-compute[85141]:       <alias name='usb'/>
Nov 16 10:13:41 user nova-compute[85141]:     </controller>
Nov 16 10:13:41 user nova-compute[85141]:     <controller type='pci' index='0' model='pci-root'>
Nov 16 10:13:41 user nova-compute[85141]:       <alias name='pci.0'/>
Nov 16 10:13:41 user nova-compute[85141]:     </controller>
Nov 16 10:13:41 user nova-compute[85141]:     <controller type='ide' index='0'>
Nov 16 10:13:41 user nova-compute[85141]:       <alias name='ide'/>
Nov 16 10:13:41 user nova-compute[85141]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 16 10:13:41 user nova-compute[85141]:     </controller>
Nov 16 10:13:41 user nova-compute[85141]:     <interface type='ethernet'>
Nov 16 10:13:41 user nova-compute[85141]:       <mac address='fa:16:3e:12:0a:da'/>
Nov 16 10:13:41 user nova-compute[85141]:       <target dev='tap56375501-2a'/>
Nov 16 10:13:41 user nova-compute[85141]:       <model type='virtio'/>
Nov 16 10:13:41 user nova-compute[85141]:       <mtu size='1442'/>
Nov 16 10:13:41 user nova-compute[85141]:       <alias name='net0'/>
Nov 16 10:13:41 user nova-compute[85141]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 16 10:13:41 user nova-compute[85141]:     </interface>
Nov 16 10:13:41 user nova-compute[85141]:     <serial type='pty'>
Nov 16 10:13:41 user nova-compute[85141]:       <source path='/dev/pts/6'/>
Nov 16 10:13:41 user nova-compute[85141]:       <log file='/opt/stack/data/nova/instances/0ca61bd2-268e-4c49-ba04-a5cb39143a9b/console.log' append='off'/>
Nov 16 10:13:41 user nova-compute[85141]:       <target type='isa-serial' port='0'>
Nov 16 10:13:41 user nova-compute[85141]:         <model name='isa-serial'/>
Nov 16 10:13:41 user nova-compute[85141]:       </target>
Nov 16 10:13:41 user nova-compute[85141]:       <alias name='serial0'/>
Nov 16 10:13:41 user nova-compute[85141]:     </serial>
Nov 16 10:13:41 user nova-compute[85141]:     <console type='pty' tty='/dev/pts/6'>
Nov 16 10:13:41 user nova-compute[85141]:       <source path='/dev/pts/6'/>
Nov 16 10:13:41 user nova-compute[85141]:       <log file='/opt/stack/data/nova/instances/0ca61bd2-268e-4c49-ba04-a5cb39143a9b/console.log' append='off'/>
Nov 16 10:13:41 user nova-compute[85141]:       <target type='serial' port='0'/>
Nov 16 10:13:41 user nova-compute[85141]:       <alias name='serial0'/>
Nov 16 10:13:41 user nova-compute[85141]:     </console>
Nov 16 10:13:41 user nova-compute[85141]:     <input type='mouse' bus='ps2'>
Nov 16 10:13:41 user nova-compute[85141]:       <alias name='input0'/>
Nov 16 10:13:41 user nova-compute[85141]:     </input>
Nov 16 10:13:41 user nova-compute[85141]:     <input type='keyboard' bus='ps2'>
Nov 16 10:13:41 user nova-compute[85141]:       <alias name='input1'/>
Nov 16 10:13:41 user nova-compute[85141]:     </input>
Nov 16 10:13:41 user nova-compute[85141]:     <graphics type='vnc' port='5906' autoport='yes' listen='0.0.0.0'>
Nov 16 10:13:41 user nova-compute[85141]:       <listen type='address' address='0.0.0.0'/>
Nov 16 10:13:41 user nova-compute[85141]:     </graphics>
Nov 16 10:13:41 user nova-compute[85141]:     <audio id='1' type='none'/>
Nov 16 10:13:41 user nova-compute[85141]:     <video>
Nov 16 10:13:41 user nova-compute[85141]:       <model type='virtio' heads='1' primary='yes'/>
Nov 16 10:13:41 user nova-compute[85141]:       <alias name='video0'/>
Nov 16 10:13:41 user nova-compute[85141]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 16 10:13:41 user nova-compute[85141]:     </video>
Nov 16 10:13:41 user nova-compute[85141]:     <memballoon model='virtio'>
Nov 16 10:13:41 user nova-compute[85141]:       <stats period='10'/>
Nov 16 10:13:41 user nova-compute[85141]:       <alias name='balloon0'/>
Nov 16 10:13:41 user nova-compute[85141]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 16 10:13:41 user nova-compute[85141]:     </memballoon>
Nov 16 10:13:41 user nova-compute[85141]:     <rng model='virtio'>
Nov 16 10:13:41 user nova-compute[85141]:       <backend model='random'>/dev/urandom</backend>
Nov 16 10:13:41 user nova-compute[85141]:       <alias name='rng0'/>
Nov 16 10:13:41 user nova-compute[85141]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 16 10:13:41 user nova-compute[85141]:     </rng>
Nov 16 10:13:41 user nova-compute[85141]:   </devices>
Nov 16 10:13:41 user nova-compute[85141]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 16 10:13:41 user nova-compute[85141]:     <label>libvirt-0ca61bd2-268e-4c49-ba04-a5cb39143a9b</label>
Nov 16 10:13:41 user nova-compute[85141]:     <imagelabel>libvirt-0ca61bd2-268e-4c49-ba04-a5cb39143a9b</imagelabel>
Nov 16 10:13:41 user nova-compute[85141]:   </seclabel>
Nov 16 10:13:41 user nova-compute[85141]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 16 10:13:41 user nova-compute[85141]:     <label>+64055:+108</label>
Nov 16 10:13:41 user nova-compute[85141]:     <imagelabel>+64055:+108</imagelabel>
Nov 16 10:13:41 user nova-compute[85141]:   </seclabel>
Nov 16 10:13:41 user nova-compute[85141]: </domain>
Nov 16 10:13:41 user nova-compute[85141]:  {{(pid=85141) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 16 10:13:41 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-22f2f808-c9d7-4b18-8632-3357d5e96196 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] Successfully detached device tap0fd660bd-1d from instance 0ca61bd2-268e-4c49-ba04-a5cb39143a9b from the live domain config.
Nov 16 10:13:41 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-22f2f808-c9d7-4b18-8632-3357d5e96196 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T10:10:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-716916570',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-716916570',id=8,image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLJjo671Ow+Mmgs0Sg26Qz/3lV+acwH0zhTjdI/jAzpHJeJFVSCAeG6lSBMe0VPCPV8jS6nF17VjHRJ+udtegobTbD+V4E/SBllDlIvaieW2o7QXUoKkfv8rtxZTi+1HzQ==',key_name='tempest-keypair-612763063',keypairs=<?>,launch_index=0,launched_at=2023-11-16T10:11:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b9317f5645af406c899fcc5df61362bb',ramdisk_id='',reservation_id='r-xpla73zu',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1293058027',owner_user_name='tempest-TaggedAttachmentsTest-1293058027-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T10:11:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8734a61ff9fb4e14b1b542b8ecdfdeec',uuid=0ca61bd2-268e-4c49-ba04-a5cb39143a9b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0fd660bd-1d7b-45d1-8906-d20417082456", "address": "fa:16:3e:86:c2:f1", "network": {"id": "a0932a5f-6790-40ed-a554-3a9e85f287d0", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-35889031", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "b9317f5645af406c899fcc5df61362bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fd660bd-1d", "ovs_interfaceid": "0fd660bd-1d7b-45d1-8906-d20417082456", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 10:13:41 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-22f2f808-c9d7-4b18-8632-3357d5e96196 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] Converting VIF {"id": "0fd660bd-1d7b-45d1-8906-d20417082456", "address": "fa:16:3e:86:c2:f1", "network": {"id": "a0932a5f-6790-40ed-a554-3a9e85f287d0", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-35889031", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "b9317f5645af406c899fcc5df61362bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fd660bd-1d", "ovs_interfaceid": "0fd660bd-1d7b-45d1-8906-d20417082456", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:13:41 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-22f2f808-c9d7-4b18-8632-3357d5e96196 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:c2:f1,bridge_name='br-int',has_traffic_filtering=True,id=0fd660bd-1d7b-45d1-8906-d20417082456,network=Network(a0932a5f-6790-40ed-a554-3a9e85f287d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0fd660bd-1d') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:13:41 user nova-compute[85141]: DEBUG os_vif [None req-22f2f808-c9d7-4b18-8632-3357d5e96196 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:c2:f1,bridge_name='br-int',has_traffic_filtering=True,id=0fd660bd-1d7b-45d1-8906-d20417082456,network=Network(a0932a5f-6790-40ed-a554-3a9e85f287d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0fd660bd-1d') {{(pid=85141) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 10:13:41 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:13:41 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0fd660bd-1d, bridge=br-int, if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:13:41 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:13:41 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:13:41 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:13:41 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:13:41 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=81300972-e348-417c-a756-3227a8dbdd45) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:13:41 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:13:41 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:13:41 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:13:41 user nova-compute[85141]: INFO os_vif [None req-22f2f808-c9d7-4b18-8632-3357d5e96196 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:c2:f1,bridge_name='br-int',has_traffic_filtering=True,id=0fd660bd-1d7b-45d1-8906-d20417082456,network=Network(a0932a5f-6790-40ed-a554-3a9e85f287d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0fd660bd-1d')
Nov 16 10:13:41 user nova-compute[85141]: DEBUG nova.virt.libvirt.guest [None req-22f2f808-c9d7-4b18-8632-3357d5e96196 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 10:13:41 user nova-compute[85141]:   <nova:package version="0.0.0"/>
Nov 16 10:13:41 user nova-compute[85141]:   <nova:name>tempest-device-tagging-server-716916570</nova:name>
Nov 16 10:13:41 user nova-compute[85141]:   <nova:creationTime>2023-11-16 10:13:41</nova:creationTime>
Nov 16 10:13:41 user nova-compute[85141]:   <nova:flavor name="m1.tiny">
Nov 16 10:13:41 user nova-compute[85141]:     <nova:memory>512</nova:memory>
Nov 16 10:13:41 user nova-compute[85141]:     <nova:disk>1</nova:disk>
Nov 16 10:13:41 user nova-compute[85141]:     <nova:swap>0</nova:swap>
Nov 16 10:13:41 user nova-compute[85141]:     <nova:ephemeral>0</nova:ephemeral>
Nov 16 10:13:41 user nova-compute[85141]:     <nova:vcpus>1</nova:vcpus>
Nov 16 10:13:41 user nova-compute[85141]:   </nova:flavor>
Nov 16 10:13:41 user nova-compute[85141]:   <nova:owner>
Nov 16 10:13:41 user nova-compute[85141]:     <nova:user uuid="8734a61ff9fb4e14b1b542b8ecdfdeec">tempest-TaggedAttachmentsTest-1293058027-project-member</nova:user>
Nov 16 10:13:41 user nova-compute[85141]:     <nova:project uuid="b9317f5645af406c899fcc5df61362bb">tempest-TaggedAttachmentsTest-1293058027</nova:project>
Nov 16 10:13:41 user nova-compute[85141]:   </nova:owner>
Nov 16 10:13:41 user nova-compute[85141]:   <nova:root type="image" uuid="bc4ca70f-a459-4d5c-a9e6-80f1948eb48b"/>
Nov 16 10:13:41 user nova-compute[85141]:   <nova:ports>
Nov 16 10:13:41 user nova-compute[85141]:     <nova:port uuid="56375501-2a9c-4821-8446-31156fc0f231">
Nov 16 10:13:41 user nova-compute[85141]:       <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 16 10:13:41 user nova-compute[85141]:     </nova:port>
Nov 16 10:13:41 user nova-compute[85141]:   </nova:ports>
Nov 16 10:13:41 user nova-compute[85141]: </nova:instance>
Nov 16 10:13:41 user nova-compute[85141]:  {{(pid=85141) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 16 10:13:42 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:13:42 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-22f2f808-c9d7-4b18-8632-3357d5e96196 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] Acquiring lock "refresh_cache-0ca61bd2-268e-4c49-ba04-a5cb39143a9b" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:13:42 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-22f2f808-c9d7-4b18-8632-3357d5e96196 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] Acquired lock "refresh_cache-0ca61bd2-268e-4c49-ba04-a5cb39143a9b" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:13:42 user nova-compute[85141]: DEBUG nova.network.neutron [None req-22f2f808-c9d7-4b18-8632-3357d5e96196 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] [instance: 0ca61bd2-268e-4c49-ba04-a5cb39143a9b] Building network info cache for instance {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 10:13:42 user nova-compute[85141]: DEBUG nova.compute.manager [req-f193bcc1-eaea-4f33-89d6-da2934898238 req-f4e19141-049f-413e-a8ad-3fb9b51a4ebf service nova] [instance: 0ca61bd2-268e-4c49-ba04-a5cb39143a9b] Received event network-vif-deleted-0fd660bd-1d7b-45d1-8906-d20417082456 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:13:42 user nova-compute[85141]: INFO nova.compute.manager [req-f193bcc1-eaea-4f33-89d6-da2934898238 req-f4e19141-049f-413e-a8ad-3fb9b51a4ebf service nova] [instance: 0ca61bd2-268e-4c49-ba04-a5cb39143a9b] Neutron deleted interface 0fd660bd-1d7b-45d1-8906-d20417082456; detaching it from the instance and deleting it from the info cache
Nov 16 10:13:42 user nova-compute[85141]: DEBUG nova.network.neutron [req-f193bcc1-eaea-4f33-89d6-da2934898238 req-f4e19141-049f-413e-a8ad-3fb9b51a4ebf service nova] [instance: 0ca61bd2-268e-4c49-ba04-a5cb39143a9b] Updating instance_info_cache with network_info: [{"id": "56375501-2a9c-4821-8446-31156fc0f231", "address": "fa:16:3e:12:0a:da", "network": {"id": "cd9a5383-79fc-4957-9a8e-30a18ac26969", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1797454995-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9317f5645af406c899fcc5df61362bb", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56375501-2a", "ovs_interfaceid": "56375501-2a9c-4821-8446-31156fc0f231", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:13:42 user nova-compute[85141]: DEBUG nova.objects.instance [req-f193bcc1-eaea-4f33-89d6-da2934898238 req-f4e19141-049f-413e-a8ad-3fb9b51a4ebf service nova] Lazy-loading 'system_metadata' on Instance uuid 0ca61bd2-268e-4c49-ba04-a5cb39143a9b {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:13:42 user nova-compute[85141]: DEBUG nova.objects.instance [req-f193bcc1-eaea-4f33-89d6-da2934898238 req-f4e19141-049f-413e-a8ad-3fb9b51a4ebf service nova] Lazy-loading 'flavor' on Instance uuid 0ca61bd2-268e-4c49-ba04-a5cb39143a9b {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:13:42 user nova-compute[85141]: DEBUG nova.objects.base [req-f193bcc1-eaea-4f33-89d6-da2934898238 req-f4e19141-049f-413e-a8ad-3fb9b51a4ebf service nova] Object Instance<0ca61bd2-268e-4c49-ba04-a5cb39143a9b> lazy-loaded attributes: system_metadata,flavor {{(pid=85141) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 10:13:42 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [req-f193bcc1-eaea-4f33-89d6-da2934898238 req-f4e19141-049f-413e-a8ad-3fb9b51a4ebf service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T10:10:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-716916570',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-716916570',id=8,image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLJjo671Ow+Mmgs0Sg26Qz/3lV+acwH0zhTjdI/jAzpHJeJFVSCAeG6lSBMe0VPCPV8jS6nF17VjHRJ+udtegobTbD+V4E/SBllDlIvaieW2o7QXUoKkfv8rtxZTi+1HzQ==',key_name='tempest-keypair-612763063',keypairs=<?>,launch_index=0,launched_at=2023-11-16T10:11:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b9317f5645af406c899fcc5df61362bb',ramdisk_id='',reservation_id='r-xpla73zu',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1293058027',owner_user_name='tempest-TaggedAttachmentsTest-1293058027-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T10:11:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8734a61ff9fb4e14b1b542b8ecdfdeec',uuid=0ca61bd2-268e-4c49-ba04-a5cb39143a9b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0fd660bd-1d7b-45d1-8906-d20417082456", "address": "fa:16:3e:86:c2:f1", "network": {"id": "a0932a5f-6790-40ed-a554-3a9e85f287d0", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-35889031", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "b9317f5645af406c899fcc5df61362bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fd660bd-1d", "ovs_interfaceid": "0fd660bd-1d7b-45d1-8906-d20417082456", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=85141) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 10:13:42 user nova-compute[85141]: DEBUG nova.network.os_vif_util [req-f193bcc1-eaea-4f33-89d6-da2934898238 req-f4e19141-049f-413e-a8ad-3fb9b51a4ebf service nova] Converting VIF {"id": "0fd660bd-1d7b-45d1-8906-d20417082456", "address": "fa:16:3e:86:c2:f1", "network": {"id": "a0932a5f-6790-40ed-a554-3a9e85f287d0", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-35889031", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "b9317f5645af406c899fcc5df61362bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fd660bd-1d", "ovs_interfaceid": "0fd660bd-1d7b-45d1-8906-d20417082456", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:13:42 user nova-compute[85141]: DEBUG nova.network.os_vif_util [req-f193bcc1-eaea-4f33-89d6-da2934898238 req-f4e19141-049f-413e-a8ad-3fb9b51a4ebf service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:c2:f1,bridge_name='br-int',has_traffic_filtering=True,id=0fd660bd-1d7b-45d1-8906-d20417082456,network=Network(a0932a5f-6790-40ed-a554-3a9e85f287d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0fd660bd-1d') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:13:42 user nova-compute[85141]: DEBUG nova.virt.libvirt.guest [req-f193bcc1-eaea-4f33-89d6-da2934898238 req-f4e19141-049f-413e-a8ad-3fb9b51a4ebf service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:86:c2:f1"/><model type="virtio"/><mtu size="1442"/><target dev="tap0fd660bd-1d"/></interface> {{(pid=85141) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 16 10:13:42 user nova-compute[85141]: DEBUG nova.virt.libvirt.guest [req-f193bcc1-eaea-4f33-89d6-da2934898238 req-f4e19141-049f-413e-a8ad-3fb9b51a4ebf service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:86:c2:f1"/><model type="virtio"/><mtu size="1442"/><target dev="tap0fd660bd-1d"/></interface>not found in domain: <domain type='kvm' id='7'>
Nov 16 10:13:42 user nova-compute[85141]:   <name>instance-00000008</name>
Nov 16 10:13:42 user nova-compute[85141]:   <uuid>0ca61bd2-268e-4c49-ba04-a5cb39143a9b</uuid>
Nov 16 10:13:42 user nova-compute[85141]:   <metadata>
Nov 16 10:13:42 user nova-compute[85141]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 10:13:42 user nova-compute[85141]:   <nova:package version="0.0.0"/>
Nov 16 10:13:42 user nova-compute[85141]:   <nova:name>tempest-device-tagging-server-716916570</nova:name>
Nov 16 10:13:42 user nova-compute[85141]:   <nova:creationTime>2023-11-16 10:13:41</nova:creationTime>
Nov 16 10:13:42 user nova-compute[85141]:   <nova:flavor name="m1.tiny">
Nov 16 10:13:42 user nova-compute[85141]:     <nova:memory>512</nova:memory>
Nov 16 10:13:42 user nova-compute[85141]:     <nova:disk>1</nova:disk>
Nov 16 10:13:42 user nova-compute[85141]:     <nova:swap>0</nova:swap>
Nov 16 10:13:42 user nova-compute[85141]:     <nova:ephemeral>0</nova:ephemeral>
Nov 16 10:13:42 user nova-compute[85141]:     <nova:vcpus>1</nova:vcpus>
Nov 16 10:13:42 user nova-compute[85141]:   </nova:flavor>
Nov 16 10:13:42 user nova-compute[85141]:   <nova:owner>
Nov 16 10:13:42 user nova-compute[85141]:     <nova:user uuid="8734a61ff9fb4e14b1b542b8ecdfdeec">tempest-TaggedAttachmentsTest-1293058027-project-member</nova:user>
Nov 16 10:13:42 user nova-compute[85141]:     <nova:project uuid="b9317f5645af406c899fcc5df61362bb">tempest-TaggedAttachmentsTest-1293058027</nova:project>
Nov 16 10:13:42 user nova-compute[85141]:   </nova:owner>
Nov 16 10:13:42 user nova-compute[85141]:   <nova:root type="image" uuid="bc4ca70f-a459-4d5c-a9e6-80f1948eb48b"/>
Nov 16 10:13:42 user nova-compute[85141]:   <nova:ports>
Nov 16 10:13:42 user nova-compute[85141]:     <nova:port uuid="56375501-2a9c-4821-8446-31156fc0f231">
Nov 16 10:13:42 user nova-compute[85141]:       <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 16 10:13:42 user nova-compute[85141]:     </nova:port>
Nov 16 10:13:42 user nova-compute[85141]:   </nova:ports>
Nov 16 10:13:42 user nova-compute[85141]: </nova:instance>
Nov 16 10:13:42 user nova-compute[85141]:   </metadata>
Nov 16 10:13:42 user nova-compute[85141]:   <memory unit='KiB'>524288</memory>
Nov 16 10:13:42 user nova-compute[85141]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 16 10:13:42 user nova-compute[85141]:   <vcpu placement='static'>1</vcpu>
Nov 16 10:13:42 user nova-compute[85141]:   <resource>
Nov 16 10:13:42 user nova-compute[85141]:     <partition>/machine</partition>
Nov 16 10:13:42 user nova-compute[85141]:   </resource>
Nov 16 10:13:42 user nova-compute[85141]:   <sysinfo type='smbios'>
Nov 16 10:13:42 user nova-compute[85141]:     <system>
Nov 16 10:13:42 user nova-compute[85141]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 16 10:13:42 user nova-compute[85141]:       <entry name='product'>OpenStack Nova</entry>
Nov 16 10:13:42 user nova-compute[85141]:       <entry name='version'>0.0.0</entry>
Nov 16 10:13:42 user nova-compute[85141]:       <entry name='serial'>0ca61bd2-268e-4c49-ba04-a5cb39143a9b</entry>
Nov 16 10:13:42 user nova-compute[85141]:       <entry name='uuid'>0ca61bd2-268e-4c49-ba04-a5cb39143a9b</entry>
Nov 16 10:13:42 user nova-compute[85141]:       <entry name='family'>Virtual Machine</entry>
Nov 16 10:13:42 user nova-compute[85141]:     </system>
Nov 16 10:13:42 user nova-compute[85141]:   </sysinfo>
Nov 16 10:13:42 user nova-compute[85141]:   <os>
Nov 16 10:13:42 user nova-compute[85141]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 16 10:13:42 user nova-compute[85141]:     <boot dev='hd'/>
Nov 16 10:13:42 user nova-compute[85141]:     <smbios mode='sysinfo'/>
Nov 16 10:13:42 user nova-compute[85141]:   </os>
Nov 16 10:13:42 user nova-compute[85141]:   <features>
Nov 16 10:13:42 user nova-compute[85141]:     <acpi/>
Nov 16 10:13:42 user nova-compute[85141]:     <apic/>
Nov 16 10:13:42 user nova-compute[85141]:     <vmcoreinfo state='on'/>
Nov 16 10:13:42 user nova-compute[85141]:   </features>
Nov 16 10:13:42 user nova-compute[85141]:   <cpu mode='custom' match='exact' check='full'>
Nov 16 10:13:42 user nova-compute[85141]:     <model fallback='forbid'>Nehalem</model>
Nov 16 10:13:42 user nova-compute[85141]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 16 10:13:42 user nova-compute[85141]:     <feature policy='require' name='vme'/>
Nov 16 10:13:42 user nova-compute[85141]:     <feature policy='require' name='x2apic'/>
Nov 16 10:13:42 user nova-compute[85141]:     <feature policy='require' name='hypervisor'/>
Nov 16 10:13:42 user nova-compute[85141]:   </cpu>
Nov 16 10:13:42 user nova-compute[85141]:   <clock offset='utc'>
Nov 16 10:13:42 user nova-compute[85141]:     <timer name='pit' tickpolicy='delay'/>
Nov 16 10:13:42 user nova-compute[85141]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 16 10:13:42 user nova-compute[85141]:     <timer name='hpet' present='no'/>
Nov 16 10:13:42 user nova-compute[85141]:   </clock>
Nov 16 10:13:42 user nova-compute[85141]:   <on_poweroff>destroy</on_poweroff>
Nov 16 10:13:42 user nova-compute[85141]:   <on_reboot>restart</on_reboot>
Nov 16 10:13:42 user nova-compute[85141]:   <on_crash>destroy</on_crash>
Nov 16 10:13:42 user nova-compute[85141]:   <devices>
Nov 16 10:13:42 user nova-compute[85141]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 16 10:13:42 user nova-compute[85141]:     <disk type='file' device='disk'>
Nov 16 10:13:42 user nova-compute[85141]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 16 10:13:42 user nova-compute[85141]:       <source file='/opt/stack/data/nova/instances/0ca61bd2-268e-4c49-ba04-a5cb39143a9b/disk' index='2'/>
Nov 16 10:13:42 user nova-compute[85141]:       <backingStore type='file' index='3'>
Nov 16 10:13:42 user nova-compute[85141]:         <format type='raw'/>
Nov 16 10:13:42 user nova-compute[85141]:         <source file='/opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811'/>
Nov 16 10:13:42 user nova-compute[85141]:         <backingStore/>
Nov 16 10:13:42 user nova-compute[85141]:       </backingStore>
Nov 16 10:13:42 user nova-compute[85141]:       <target dev='vda' bus='virtio'/>
Nov 16 10:13:42 user nova-compute[85141]:       <alias name='virtio-disk0'/>
Nov 16 10:13:42 user nova-compute[85141]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 16 10:13:42 user nova-compute[85141]:     </disk>
Nov 16 10:13:42 user nova-compute[85141]:     <disk type='file' device='cdrom'>
Nov 16 10:13:42 user nova-compute[85141]:       <driver name='qemu' type='raw' cache='none'/>
Nov 16 10:13:42 user nova-compute[85141]:       <source file='/opt/stack/data/nova/instances/0ca61bd2-268e-4c49-ba04-a5cb39143a9b/disk.config' index='1'/>
Nov 16 10:13:42 user nova-compute[85141]:       <backingStore/>
Nov 16 10:13:42 user nova-compute[85141]:       <target dev='hda' bus='ide'/>
Nov 16 10:13:42 user nova-compute[85141]:       <readonly/>
Nov 16 10:13:42 user nova-compute[85141]:       <alias name='ide0-0-0'/>
Nov 16 10:13:42 user nova-compute[85141]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 16 10:13:42 user nova-compute[85141]:     </disk>
Nov 16 10:13:42 user nova-compute[85141]:     <controller type='usb' index='0' model='none'>
Nov 16 10:13:42 user nova-compute[85141]:       <alias name='usb'/>
Nov 16 10:13:42 user nova-compute[85141]:     </controller>
Nov 16 10:13:42 user nova-compute[85141]:     <controller type='pci' index='0' model='pci-root'>
Nov 16 10:13:42 user nova-compute[85141]:       <alias name='pci.0'/>
Nov 16 10:13:42 user nova-compute[85141]:     </controller>
Nov 16 10:13:42 user nova-compute[85141]:     <controller type='ide' index='0'>
Nov 16 10:13:42 user nova-compute[85141]:       <alias name='ide'/>
Nov 16 10:13:42 user nova-compute[85141]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 16 10:13:42 user nova-compute[85141]:     </controller>
Nov 16 10:13:42 user nova-compute[85141]:     <interface type='ethernet'>
Nov 16 10:13:42 user nova-compute[85141]:       <mac address='fa:16:3e:12:0a:da'/>
Nov 16 10:13:42 user nova-compute[85141]:       <target dev='tap56375501-2a'/>
Nov 16 10:13:42 user nova-compute[85141]:       <model type='virtio'/>
Nov 16 10:13:42 user nova-compute[85141]:       <mtu size='1442'/>
Nov 16 10:13:42 user nova-compute[85141]:       <alias name='net0'/>
Nov 16 10:13:42 user nova-compute[85141]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 16 10:13:42 user nova-compute[85141]:     </interface>
Nov 16 10:13:42 user nova-compute[85141]:     <serial type='pty'>
Nov 16 10:13:42 user nova-compute[85141]:       <source path='/dev/pts/6'/>
Nov 16 10:13:42 user nova-compute[85141]:       <log file='/opt/stack/data/nova/instances/0ca61bd2-268e-4c49-ba04-a5cb39143a9b/console.log' append='off'/>
Nov 16 10:13:42 user nova-compute[85141]:       <target type='isa-serial' port='0'>
Nov 16 10:13:42 user nova-compute[85141]:         <model name='isa-serial'/>
Nov 16 10:13:42 user nova-compute[85141]:       </target>
Nov 16 10:13:42 user nova-compute[85141]:       <alias name='serial0'/>
Nov 16 10:13:42 user nova-compute[85141]:     </serial>
Nov 16 10:13:42 user nova-compute[85141]:     <console type='pty' tty='/dev/pts/6'>
Nov 16 10:13:42 user nova-compute[85141]:       <source path='/dev/pts/6'/>
Nov 16 10:13:42 user nova-compute[85141]:       <log file='/opt/stack/data/nova/instances/0ca61bd2-268e-4c49-ba04-a5cb39143a9b/console.log' append='off'/>
Nov 16 10:13:42 user nova-compute[85141]:       <target type='serial' port='0'/>
Nov 16 10:13:42 user nova-compute[85141]:       <alias name='serial0'/>
Nov 16 10:13:42 user nova-compute[85141]:     </console>
Nov 16 10:13:42 user nova-compute[85141]:     <input type='mouse' bus='ps2'>
Nov 16 10:13:42 user nova-compute[85141]:       <alias name='input0'/>
Nov 16 10:13:42 user nova-compute[85141]:     </input>
Nov 16 10:13:42 user nova-compute[85141]:     <input type='keyboard' bus='ps2'>
Nov 16 10:13:42 user nova-compute[85141]:       <alias name='input1'/>
Nov 16 10:13:42 user nova-compute[85141]:     </input>
Nov 16 10:13:42 user nova-compute[85141]:     <graphics type='vnc' port='5906' autoport='yes' listen='0.0.0.0'>
Nov 16 10:13:42 user nova-compute[85141]:       <listen type='address' address='0.0.0.0'/>
Nov 16 10:13:42 user nova-compute[85141]:     </graphics>
Nov 16 10:13:42 user nova-compute[85141]:     <audio id='1' type='none'/>
Nov 16 10:13:42 user nova-compute[85141]:     <video>
Nov 16 10:13:42 user nova-compute[85141]:       <model type='virtio' heads='1' primary='yes'/>
Nov 16 10:13:42 user nova-compute[85141]:       <alias name='video0'/>
Nov 16 10:13:42 user nova-compute[85141]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 16 10:13:42 user nova-compute[85141]:     </video>
Nov 16 10:13:42 user nova-compute[85141]:     <memballoon model='virtio'>
Nov 16 10:13:42 user nova-compute[85141]:       <stats period='10'/>
Nov 16 10:13:42 user nova-compute[85141]:       <alias name='balloon0'/>
Nov 16 10:13:42 user nova-compute[85141]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 16 10:13:42 user nova-compute[85141]:     </memballoon>
Nov 16 10:13:42 user nova-compute[85141]:     <rng model='virtio'>
Nov 16 10:13:42 user nova-compute[85141]:       <backend model='random'>/dev/urandom</backend>
Nov 16 10:13:42 user nova-compute[85141]:       <alias name='rng0'/>
Nov 16 10:13:42 user nova-compute[85141]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 16 10:13:42 user nova-compute[85141]:     </rng>
Nov 16 10:13:42 user nova-compute[85141]:   </devices>
Nov 16 10:13:42 user nova-compute[85141]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 16 10:13:42 user nova-compute[85141]:     <label>libvirt-0ca61bd2-268e-4c49-ba04-a5cb39143a9b</label>
Nov 16 10:13:42 user nova-compute[85141]:     <imagelabel>libvirt-0ca61bd2-268e-4c49-ba04-a5cb39143a9b</imagelabel>
Nov 16 10:13:42 user nova-compute[85141]:   </seclabel>
Nov 16 10:13:42 user nova-compute[85141]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 16 10:13:42 user nova-compute[85141]:     <label>+64055:+108</label>
Nov 16 10:13:42 user nova-compute[85141]:     <imagelabel>+64055:+108</imagelabel>
Nov 16 10:13:42 user nova-compute[85141]:   </seclabel>
Nov 16 10:13:42 user nova-compute[85141]: </domain>
Nov 16 10:13:42 user nova-compute[85141]:  {{(pid=85141) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 16 10:13:42 user nova-compute[85141]: DEBUG nova.virt.libvirt.guest [req-f193bcc1-eaea-4f33-89d6-da2934898238 req-f4e19141-049f-413e-a8ad-3fb9b51a4ebf service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:86:c2:f1"/><model type="virtio"/><mtu size="1442"/><target dev="tap0fd660bd-1d"/></interface> {{(pid=85141) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 16 10:13:42 user nova-compute[85141]: DEBUG nova.virt.libvirt.guest [req-f193bcc1-eaea-4f33-89d6-da2934898238 req-f4e19141-049f-413e-a8ad-3fb9b51a4ebf service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:86:c2:f1"/><model type="virtio"/><mtu size="1442"/><target dev="tap0fd660bd-1d"/></interface>not found in domain: <domain type='kvm' id='7'>
Nov 16 10:13:42 user nova-compute[85141]:   <name>instance-00000008</name>
Nov 16 10:13:42 user nova-compute[85141]:   <uuid>0ca61bd2-268e-4c49-ba04-a5cb39143a9b</uuid>
Nov 16 10:13:42 user nova-compute[85141]:   <metadata>
Nov 16 10:13:42 user nova-compute[85141]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 10:13:42 user nova-compute[85141]:   <nova:package version="0.0.0"/>
Nov 16 10:13:42 user nova-compute[85141]:   <nova:name>tempest-device-tagging-server-716916570</nova:name>
Nov 16 10:13:42 user nova-compute[85141]:   <nova:creationTime>2023-11-16 10:13:41</nova:creationTime>
Nov 16 10:13:42 user nova-compute[85141]:   <nova:flavor name="m1.tiny">
Nov 16 10:13:42 user nova-compute[85141]:     <nova:memory>512</nova:memory>
Nov 16 10:13:42 user nova-compute[85141]:     <nova:disk>1</nova:disk>
Nov 16 10:13:42 user nova-compute[85141]:     <nova:swap>0</nova:swap>
Nov 16 10:13:42 user nova-compute[85141]:     <nova:ephemeral>0</nova:ephemeral>
Nov 16 10:13:42 user nova-compute[85141]:     <nova:vcpus>1</nova:vcpus>
Nov 16 10:13:42 user nova-compute[85141]:   </nova:flavor>
Nov 16 10:13:42 user nova-compute[85141]:   <nova:owner>
Nov 16 10:13:42 user nova-compute[85141]:     <nova:user uuid="8734a61ff9fb4e14b1b542b8ecdfdeec">tempest-TaggedAttachmentsTest-1293058027-project-member</nova:user>
Nov 16 10:13:42 user nova-compute[85141]:     <nova:project uuid="b9317f5645af406c899fcc5df61362bb">tempest-TaggedAttachmentsTest-1293058027</nova:project>
Nov 16 10:13:42 user nova-compute[85141]:   </nova:owner>
Nov 16 10:13:42 user nova-compute[85141]:   <nova:root type="image" uuid="bc4ca70f-a459-4d5c-a9e6-80f1948eb48b"/>
Nov 16 10:13:42 user nova-compute[85141]:   <nova:ports>
Nov 16 10:13:42 user nova-compute[85141]:     <nova:port uuid="56375501-2a9c-4821-8446-31156fc0f231">
Nov 16 10:13:42 user nova-compute[85141]:       <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 16 10:13:42 user nova-compute[85141]:     </nova:port>
Nov 16 10:13:42 user nova-compute[85141]:   </nova:ports>
Nov 16 10:13:42 user nova-compute[85141]: </nova:instance>
Nov 16 10:13:42 user nova-compute[85141]:   </metadata>
Nov 16 10:13:42 user nova-compute[85141]:   <memory unit='KiB'>524288</memory>
Nov 16 10:13:42 user nova-compute[85141]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 16 10:13:42 user nova-compute[85141]:   <vcpu placement='static'>1</vcpu>
Nov 16 10:13:42 user nova-compute[85141]:   <resource>
Nov 16 10:13:42 user nova-compute[85141]:     <partition>/machine</partition>
Nov 16 10:13:42 user nova-compute[85141]:   </resource>
Nov 16 10:13:42 user nova-compute[85141]:   <sysinfo type='smbios'>
Nov 16 10:13:42 user nova-compute[85141]:     <system>
Nov 16 10:13:42 user nova-compute[85141]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 16 10:13:42 user nova-compute[85141]:       <entry name='product'>OpenStack Nova</entry>
Nov 16 10:13:42 user nova-compute[85141]:       <entry name='version'>0.0.0</entry>
Nov 16 10:13:42 user nova-compute[85141]:       <entry name='serial'>0ca61bd2-268e-4c49-ba04-a5cb39143a9b</entry>
Nov 16 10:13:42 user nova-compute[85141]:       <entry name='uuid'>0ca61bd2-268e-4c49-ba04-a5cb39143a9b</entry>
Nov 16 10:13:42 user nova-compute[85141]:       <entry name='family'>Virtual Machine</entry>
Nov 16 10:13:42 user nova-compute[85141]:     </system>
Nov 16 10:13:42 user nova-compute[85141]:   </sysinfo>
Nov 16 10:13:42 user nova-compute[85141]:   <os>
Nov 16 10:13:42 user nova-compute[85141]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 16 10:13:42 user nova-compute[85141]:     <boot dev='hd'/>
Nov 16 10:13:42 user nova-compute[85141]:     <smbios mode='sysinfo'/>
Nov 16 10:13:42 user nova-compute[85141]:   </os>
Nov 16 10:13:42 user nova-compute[85141]:   <features>
Nov 16 10:13:42 user nova-compute[85141]:     <acpi/>
Nov 16 10:13:42 user nova-compute[85141]:     <apic/>
Nov 16 10:13:42 user nova-compute[85141]:     <vmcoreinfo state='on'/>
Nov 16 10:13:42 user nova-compute[85141]:   </features>
Nov 16 10:13:42 user nova-compute[85141]:   <cpu mode='custom' match='exact' check='full'>
Nov 16 10:13:42 user nova-compute[85141]:     <model fallback='forbid'>Nehalem</model>
Nov 16 10:13:42 user nova-compute[85141]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 16 10:13:42 user nova-compute[85141]:     <feature policy='require' name='vme'/>
Nov 16 10:13:42 user nova-compute[85141]:     <feature policy='require' name='x2apic'/>
Nov 16 10:13:42 user nova-compute[85141]:     <feature policy='require' name='hypervisor'/>
Nov 16 10:13:42 user nova-compute[85141]:   </cpu>
Nov 16 10:13:42 user nova-compute[85141]:   <clock offset='utc'>
Nov 16 10:13:42 user nova-compute[85141]:     <timer name='pit' tickpolicy='delay'/>
Nov 16 10:13:42 user nova-compute[85141]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 16 10:13:42 user nova-compute[85141]:     <timer name='hpet' present='no'/>
Nov 16 10:13:42 user nova-compute[85141]:   </clock>
Nov 16 10:13:42 user nova-compute[85141]:   <on_poweroff>destroy</on_poweroff>
Nov 16 10:13:42 user nova-compute[85141]:   <on_reboot>restart</on_reboot>
Nov 16 10:13:42 user nova-compute[85141]:   <on_crash>destroy</on_crash>
Nov 16 10:13:42 user nova-compute[85141]:   <devices>
Nov 16 10:13:42 user nova-compute[85141]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 16 10:13:42 user nova-compute[85141]:     <disk type='file' device='disk'>
Nov 16 10:13:42 user nova-compute[85141]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 16 10:13:42 user nova-compute[85141]:       <source file='/opt/stack/data/nova/instances/0ca61bd2-268e-4c49-ba04-a5cb39143a9b/disk' index='2'/>
Nov 16 10:13:42 user nova-compute[85141]:       <backingStore type='file' index='3'>
Nov 16 10:13:42 user nova-compute[85141]:         <format type='raw'/>
Nov 16 10:13:42 user nova-compute[85141]:         <source file='/opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811'/>
Nov 16 10:13:42 user nova-compute[85141]:         <backingStore/>
Nov 16 10:13:42 user nova-compute[85141]:       </backingStore>
Nov 16 10:13:42 user nova-compute[85141]:       <target dev='vda' bus='virtio'/>
Nov 16 10:13:42 user nova-compute[85141]:       <alias name='virtio-disk0'/>
Nov 16 10:13:42 user nova-compute[85141]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 16 10:13:42 user nova-compute[85141]:     </disk>
Nov 16 10:13:42 user nova-compute[85141]:     <disk type='file' device='cdrom'>
Nov 16 10:13:42 user nova-compute[85141]:       <driver name='qemu' type='raw' cache='none'/>
Nov 16 10:13:42 user nova-compute[85141]:       <source file='/opt/stack/data/nova/instances/0ca61bd2-268e-4c49-ba04-a5cb39143a9b/disk.config' index='1'/>
Nov 16 10:13:42 user nova-compute[85141]:       <backingStore/>
Nov 16 10:13:42 user nova-compute[85141]:       <target dev='hda' bus='ide'/>
Nov 16 10:13:42 user nova-compute[85141]:       <readonly/>
Nov 16 10:13:42 user nova-compute[85141]:       <alias name='ide0-0-0'/>
Nov 16 10:13:42 user nova-compute[85141]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 16 10:13:42 user nova-compute[85141]:     </disk>
Nov 16 10:13:42 user nova-compute[85141]:     <controller type='usb' index='0' model='none'>
Nov 16 10:13:42 user nova-compute[85141]:       <alias name='usb'/>
Nov 16 10:13:42 user nova-compute[85141]:     </controller>
Nov 16 10:13:42 user nova-compute[85141]:     <controller type='pci' index='0' model='pci-root'>
Nov 16 10:13:42 user nova-compute[85141]:       <alias name='pci.0'/>
Nov 16 10:13:42 user nova-compute[85141]:     </controller>
Nov 16 10:13:42 user nova-compute[85141]:     <controller type='ide' index='0'>
Nov 16 10:13:42 user nova-compute[85141]:       <alias name='ide'/>
Nov 16 10:13:42 user nova-compute[85141]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 16 10:13:42 user nova-compute[85141]:     </controller>
Nov 16 10:13:42 user nova-compute[85141]:     <interface type='ethernet'>
Nov 16 10:13:42 user nova-compute[85141]:       <mac address='fa:16:3e:12:0a:da'/>
Nov 16 10:13:42 user nova-compute[85141]:       <target dev='tap56375501-2a'/>
Nov 16 10:13:42 user nova-compute[85141]:       <model type='virtio'/>
Nov 16 10:13:42 user nova-compute[85141]:       <mtu size='1442'/>
Nov 16 10:13:42 user nova-compute[85141]:       <alias name='net0'/>
Nov 16 10:13:42 user nova-compute[85141]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 16 10:13:42 user nova-compute[85141]:     </interface>
Nov 16 10:13:42 user nova-compute[85141]:     <serial type='pty'>
Nov 16 10:13:42 user nova-compute[85141]:       <source path='/dev/pts/6'/>
Nov 16 10:13:42 user nova-compute[85141]:       <log file='/opt/stack/data/nova/instances/0ca61bd2-268e-4c49-ba04-a5cb39143a9b/console.log' append='off'/>
Nov 16 10:13:42 user nova-compute[85141]:       <target type='isa-serial' port='0'>
Nov 16 10:13:42 user nova-compute[85141]:         <model name='isa-serial'/>
Nov 16 10:13:42 user nova-compute[85141]:       </target>
Nov 16 10:13:42 user nova-compute[85141]:       <alias name='serial0'/>
Nov 16 10:13:42 user nova-compute[85141]:     </serial>
Nov 16 10:13:42 user nova-compute[85141]:     <console type='pty' tty='/dev/pts/6'>
Nov 16 10:13:42 user nova-compute[85141]:       <source path='/dev/pts/6'/>
Nov 16 10:13:42 user nova-compute[85141]:       <log file='/opt/stack/data/nova/instances/0ca61bd2-268e-4c49-ba04-a5cb39143a9b/console.log' append='off'/>
Nov 16 10:13:42 user nova-compute[85141]:       <target type='serial' port='0'/>
Nov 16 10:13:42 user nova-compute[85141]:       <alias name='serial0'/>
Nov 16 10:13:42 user nova-compute[85141]:     </console>
Nov 16 10:13:42 user nova-compute[85141]:     <input type='mouse' bus='ps2'>
Nov 16 10:13:42 user nova-compute[85141]:       <alias name='input0'/>
Nov 16 10:13:42 user nova-compute[85141]:     </input>
Nov 16 10:13:42 user nova-compute[85141]:     <input type='keyboard' bus='ps2'>
Nov 16 10:13:42 user nova-compute[85141]:       <alias name='input1'/>
Nov 16 10:13:42 user nova-compute[85141]:     </input>
Nov 16 10:13:42 user nova-compute[85141]:     <graphics type='vnc' port='5906' autoport='yes' listen='0.0.0.0'>
Nov 16 10:13:42 user nova-compute[85141]:       <listen type='address' address='0.0.0.0'/>
Nov 16 10:13:42 user nova-compute[85141]:     </graphics>
Nov 16 10:13:42 user nova-compute[85141]:     <audio id='1' type='none'/>
Nov 16 10:13:42 user nova-compute[85141]:     <video>
Nov 16 10:13:42 user nova-compute[85141]:       <model type='virtio' heads='1' primary='yes'/>
Nov 16 10:13:42 user nova-compute[85141]:       <alias name='video0'/>
Nov 16 10:13:42 user nova-compute[85141]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 16 10:13:42 user nova-compute[85141]:     </video>
Nov 16 10:13:42 user nova-compute[85141]:     <memballoon model='virtio'>
Nov 16 10:13:42 user nova-compute[85141]:       <stats period='10'/>
Nov 16 10:13:42 user nova-compute[85141]:       <alias name='balloon0'/>
Nov 16 10:13:42 user nova-compute[85141]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 16 10:13:42 user nova-compute[85141]:     </memballoon>
Nov 16 10:13:42 user nova-compute[85141]:     <rng model='virtio'>
Nov 16 10:13:42 user nova-compute[85141]:       <backend model='random'>/dev/urandom</backend>
Nov 16 10:13:42 user nova-compute[85141]:       <alias name='rng0'/>
Nov 16 10:13:42 user nova-compute[85141]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 16 10:13:42 user nova-compute[85141]:     </rng>
Nov 16 10:13:42 user nova-compute[85141]:   </devices>
Nov 16 10:13:42 user nova-compute[85141]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 16 10:13:42 user nova-compute[85141]:     <label>libvirt-0ca61bd2-268e-4c49-ba04-a5cb39143a9b</label>
Nov 16 10:13:42 user nova-compute[85141]:     <imagelabel>libvirt-0ca61bd2-268e-4c49-ba04-a5cb39143a9b</imagelabel>
Nov 16 10:13:42 user nova-compute[85141]:   </seclabel>
Nov 16 10:13:42 user nova-compute[85141]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 16 10:13:42 user nova-compute[85141]:     <label>+64055:+108</label>
Nov 16 10:13:42 user nova-compute[85141]:     <imagelabel>+64055:+108</imagelabel>
Nov 16 10:13:42 user nova-compute[85141]:   </seclabel>
Nov 16 10:13:42 user nova-compute[85141]: </domain>
Nov 16 10:13:42 user nova-compute[85141]:  {{(pid=85141) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 16 10:13:42 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [req-f193bcc1-eaea-4f33-89d6-da2934898238 req-f4e19141-049f-413e-a8ad-3fb9b51a4ebf service nova] [instance: 0ca61bd2-268e-4c49-ba04-a5cb39143a9b] Detaching interface fa:16:3e:86:c2:f1 failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tap0fd660bd-1d' not found.
Nov 16 10:13:42 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [req-f193bcc1-eaea-4f33-89d6-da2934898238 req-f4e19141-049f-413e-a8ad-3fb9b51a4ebf service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T10:10:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-716916570',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-716916570',id=8,image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLJjo671Ow+Mmgs0Sg26Qz/3lV+acwH0zhTjdI/jAzpHJeJFVSCAeG6lSBMe0VPCPV8jS6nF17VjHRJ+udtegobTbD+V4E/SBllDlIvaieW2o7QXUoKkfv8rtxZTi+1HzQ==',key_name='tempest-keypair-612763063',keypairs=<?>,launch_index=0,launched_at=2023-11-16T10:11:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b9317f5645af406c899fcc5df61362bb',ramdisk_id='',reservation_id='r-xpla73zu',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1293058027',owner_user_name='tempest-TaggedAttachmentsTest-1293058027-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T10:11:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8734a61ff9fb4e14b1b542b8ecdfdeec',uuid=0ca61bd2-268e-4c49-ba04-a5cb39143a9b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0fd660bd-1d7b-45d1-8906-d20417082456", "address": "fa:16:3e:86:c2:f1", "network": {"id": "a0932a5f-6790-40ed-a554-3a9e85f287d0", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-35889031", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "b9317f5645af406c899fcc5df61362bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fd660bd-1d", "ovs_interfaceid": "0fd660bd-1d7b-45d1-8906-d20417082456", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 10:13:42 user nova-compute[85141]: DEBUG nova.network.os_vif_util [req-f193bcc1-eaea-4f33-89d6-da2934898238 req-f4e19141-049f-413e-a8ad-3fb9b51a4ebf service nova] Converting VIF {"id": "0fd660bd-1d7b-45d1-8906-d20417082456", "address": "fa:16:3e:86:c2:f1", "network": {"id": "a0932a5f-6790-40ed-a554-3a9e85f287d0", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-35889031", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "b9317f5645af406c899fcc5df61362bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fd660bd-1d", "ovs_interfaceid": "0fd660bd-1d7b-45d1-8906-d20417082456", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:13:42 user nova-compute[85141]: DEBUG nova.network.os_vif_util [req-f193bcc1-eaea-4f33-89d6-da2934898238 req-f4e19141-049f-413e-a8ad-3fb9b51a4ebf service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:c2:f1,bridge_name='br-int',has_traffic_filtering=True,id=0fd660bd-1d7b-45d1-8906-d20417082456,network=Network(a0932a5f-6790-40ed-a554-3a9e85f287d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0fd660bd-1d') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:13:42 user nova-compute[85141]: DEBUG os_vif [req-f193bcc1-eaea-4f33-89d6-da2934898238 req-f4e19141-049f-413e-a8ad-3fb9b51a4ebf service nova] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:c2:f1,bridge_name='br-int',has_traffic_filtering=True,id=0fd660bd-1d7b-45d1-8906-d20417082456,network=Network(a0932a5f-6790-40ed-a554-3a9e85f287d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0fd660bd-1d') {{(pid=85141) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 10:13:42 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:13:42 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0fd660bd-1d, bridge=br-int, if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:13:42 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 10:13:42 user nova-compute[85141]: INFO os_vif [req-f193bcc1-eaea-4f33-89d6-da2934898238 req-f4e19141-049f-413e-a8ad-3fb9b51a4ebf service nova] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:c2:f1,bridge_name='br-int',has_traffic_filtering=True,id=0fd660bd-1d7b-45d1-8906-d20417082456,network=Network(a0932a5f-6790-40ed-a554-3a9e85f287d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0fd660bd-1d')
Nov 16 10:13:42 user nova-compute[85141]: DEBUG nova.virt.libvirt.guest [req-f193bcc1-eaea-4f33-89d6-da2934898238 req-f4e19141-049f-413e-a8ad-3fb9b51a4ebf service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 10:13:42 user nova-compute[85141]:   <nova:package version="0.0.0"/>
Nov 16 10:13:42 user nova-compute[85141]:   <nova:name>tempest-device-tagging-server-716916570</nova:name>
Nov 16 10:13:42 user nova-compute[85141]:   <nova:creationTime>2023-11-16 10:13:42</nova:creationTime>
Nov 16 10:13:42 user nova-compute[85141]:   <nova:flavor name="m1.tiny">
Nov 16 10:13:42 user nova-compute[85141]:     <nova:memory>512</nova:memory>
Nov 16 10:13:42 user nova-compute[85141]:     <nova:disk>1</nova:disk>
Nov 16 10:13:42 user nova-compute[85141]:     <nova:swap>0</nova:swap>
Nov 16 10:13:42 user nova-compute[85141]:     <nova:ephemeral>0</nova:ephemeral>
Nov 16 10:13:42 user nova-compute[85141]:     <nova:vcpus>1</nova:vcpus>
Nov 16 10:13:42 user nova-compute[85141]:   </nova:flavor>
Nov 16 10:13:42 user nova-compute[85141]:   <nova:owner>
Nov 16 10:13:42 user nova-compute[85141]:     <nova:user uuid="8734a61ff9fb4e14b1b542b8ecdfdeec">tempest-TaggedAttachmentsTest-1293058027-project-member</nova:user>
Nov 16 10:13:42 user nova-compute[85141]:     <nova:project uuid="b9317f5645af406c899fcc5df61362bb">tempest-TaggedAttachmentsTest-1293058027</nova:project>
Nov 16 10:13:42 user nova-compute[85141]:   </nova:owner>
Nov 16 10:13:42 user nova-compute[85141]:   <nova:root type="image" uuid="bc4ca70f-a459-4d5c-a9e6-80f1948eb48b"/>
Nov 16 10:13:42 user nova-compute[85141]:   <nova:ports>
Nov 16 10:13:42 user nova-compute[85141]:     <nova:port uuid="56375501-2a9c-4821-8446-31156fc0f231">
Nov 16 10:13:42 user nova-compute[85141]:       <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 16 10:13:42 user nova-compute[85141]:     </nova:port>
Nov 16 10:13:42 user nova-compute[85141]:   </nova:ports>
Nov 16 10:13:42 user nova-compute[85141]: </nova:instance>
Nov 16 10:13:42 user nova-compute[85141]:  {{(pid=85141) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 16 10:13:42 user nova-compute[85141]: INFO nova.network.neutron [None req-22f2f808-c9d7-4b18-8632-3357d5e96196 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] [instance: 0ca61bd2-268e-4c49-ba04-a5cb39143a9b] Port 0fd660bd-1d7b-45d1-8906-d20417082456 from network info_cache is no longer associated with instance in Neutron. Removing from network info_cache.
Nov 16 10:13:42 user nova-compute[85141]: DEBUG nova.network.neutron [None req-22f2f808-c9d7-4b18-8632-3357d5e96196 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] [instance: 0ca61bd2-268e-4c49-ba04-a5cb39143a9b] Updating instance_info_cache with network_info: [{"id": "56375501-2a9c-4821-8446-31156fc0f231", "address": "fa:16:3e:12:0a:da", "network": {"id": "cd9a5383-79fc-4957-9a8e-30a18ac26969", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1797454995-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9317f5645af406c899fcc5df61362bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56375501-2a", "ovs_interfaceid": "56375501-2a9c-4821-8446-31156fc0f231", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:13:42 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-22f2f808-c9d7-4b18-8632-3357d5e96196 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] Releasing lock "refresh_cache-0ca61bd2-268e-4c49-ba04-a5cb39143a9b" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:13:42 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-22f2f808-c9d7-4b18-8632-3357d5e96196 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] Lock "interface-0ca61bd2-268e-4c49-ba04-a5cb39143a9b-0fd660bd-1d7b-45d1-8906-d20417082456" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 21.619s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:13:42 user nova-compute[85141]: DEBUG nova.compute.manager [req-12687913-3c8c-46ae-8fa2-b83cc9ded03b req-e9b72f49-8546-4346-84af-25dff322860c service nova] [instance: 8ff05707-78c9-4f78-95e4-660f10636b7a] Received event network-vif-plugged-e4ce9608-d62c-4289-a5eb-ff3dc20be4fd {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:13:42 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-12687913-3c8c-46ae-8fa2-b83cc9ded03b req-e9b72f49-8546-4346-84af-25dff322860c service nova] Acquiring lock "8ff05707-78c9-4f78-95e4-660f10636b7a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:13:42 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-12687913-3c8c-46ae-8fa2-b83cc9ded03b req-e9b72f49-8546-4346-84af-25dff322860c service nova] Lock "8ff05707-78c9-4f78-95e4-660f10636b7a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:13:42 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-12687913-3c8c-46ae-8fa2-b83cc9ded03b req-e9b72f49-8546-4346-84af-25dff322860c service nova] Lock "8ff05707-78c9-4f78-95e4-660f10636b7a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:13:42 user nova-compute[85141]: DEBUG nova.compute.manager [req-12687913-3c8c-46ae-8fa2-b83cc9ded03b req-e9b72f49-8546-4346-84af-25dff322860c service nova] [instance: 8ff05707-78c9-4f78-95e4-660f10636b7a] No waiting events found dispatching network-vif-plugged-e4ce9608-d62c-4289-a5eb-ff3dc20be4fd {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:13:42 user nova-compute[85141]: WARNING nova.compute.manager [req-12687913-3c8c-46ae-8fa2-b83cc9ded03b req-e9b72f49-8546-4346-84af-25dff322860c service nova] [instance: 8ff05707-78c9-4f78-95e4-660f10636b7a] Received unexpected event network-vif-plugged-e4ce9608-d62c-4289-a5eb-ff3dc20be4fd for instance with vm_state building and task_state spawning.
Nov 16 10:13:43 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:13:43 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:13:43 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:13:43 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:13:43 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:13:43 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:13:43 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:13:43 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:13:44 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:13:44 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:13:44 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:13:44 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:13:44 user nova-compute[85141]: DEBUG nova.compute.manager [None req-923c055b-1894-4a98-822a-17e90474cecf tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] [instance: 8ff05707-78c9-4f78-95e4-660f10636b7a] Instance event wait completed in 0 seconds for  {{(pid=85141) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 10:13:44 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-923c055b-1894-4a98-822a-17e90474cecf tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] [instance: 8ff05707-78c9-4f78-95e4-660f10636b7a] Guest created on hypervisor {{(pid=85141) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 10:13:44 user nova-compute[85141]: INFO nova.virt.libvirt.driver [-] [instance: 8ff05707-78c9-4f78-95e4-660f10636b7a] Instance spawned successfully.
Nov 16 10:13:44 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-923c055b-1894-4a98-822a-17e90474cecf tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] [instance: 8ff05707-78c9-4f78-95e4-660f10636b7a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 10:13:44 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-923c055b-1894-4a98-822a-17e90474cecf tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] [instance: 8ff05707-78c9-4f78-95e4-660f10636b7a] Found default for hw_cdrom_bus of ide {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:13:44 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-923c055b-1894-4a98-822a-17e90474cecf tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] [instance: 8ff05707-78c9-4f78-95e4-660f10636b7a] Found default for hw_disk_bus of virtio {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:13:44 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-923c055b-1894-4a98-822a-17e90474cecf tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] [instance: 8ff05707-78c9-4f78-95e4-660f10636b7a] Found default for hw_input_bus of None {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:13:44 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-923c055b-1894-4a98-822a-17e90474cecf tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] [instance: 8ff05707-78c9-4f78-95e4-660f10636b7a] Found default for hw_pointer_model of None {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:13:44 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-923c055b-1894-4a98-822a-17e90474cecf tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] [instance: 8ff05707-78c9-4f78-95e4-660f10636b7a] Found default for hw_video_model of virtio {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:13:44 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-923c055b-1894-4a98-822a-17e90474cecf tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] [instance: 8ff05707-78c9-4f78-95e4-660f10636b7a] Found default for hw_vif_model of virtio {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:13:44 user nova-compute[85141]: INFO nova.compute.manager [None req-923c055b-1894-4a98-822a-17e90474cecf tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] [instance: 8ff05707-78c9-4f78-95e4-660f10636b7a] Took 7.67 seconds to spawn the instance on the hypervisor.
Nov 16 10:13:44 user nova-compute[85141]: DEBUG nova.compute.manager [None req-923c055b-1894-4a98-822a-17e90474cecf tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] [instance: 8ff05707-78c9-4f78-95e4-660f10636b7a] Checking state {{(pid=85141) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 10:13:44 user nova-compute[85141]: INFO nova.compute.manager [None req-923c055b-1894-4a98-822a-17e90474cecf tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] [instance: 8ff05707-78c9-4f78-95e4-660f10636b7a] Took 8.62 seconds to build instance.
Nov 16 10:13:44 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-923c055b-1894-4a98-822a-17e90474cecf tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] Lock "8ff05707-78c9-4f78-95e4-660f10636b7a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.714s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:13:44 user nova-compute[85141]: DEBUG nova.compute.manager [req-d10d45be-7c66-45b5-9fdb-826408ceb306 req-55d8d3b2-d056-4eda-95f1-3ddc7d026c97 service nova] [instance: f01dc8cf-1a69-4618-a15d-0c1075157f05] Received event network-vif-plugged-52edc378-51f4-43c3-b9f3-2d0201ed125d {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:13:44 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-d10d45be-7c66-45b5-9fdb-826408ceb306 req-55d8d3b2-d056-4eda-95f1-3ddc7d026c97 service nova] Acquiring lock "f01dc8cf-1a69-4618-a15d-0c1075157f05-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:13:44 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-d10d45be-7c66-45b5-9fdb-826408ceb306 req-55d8d3b2-d056-4eda-95f1-3ddc7d026c97 service nova] Lock "f01dc8cf-1a69-4618-a15d-0c1075157f05-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:13:44 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-d10d45be-7c66-45b5-9fdb-826408ceb306 req-55d8d3b2-d056-4eda-95f1-3ddc7d026c97 service nova] Lock "f01dc8cf-1a69-4618-a15d-0c1075157f05-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:13:44 user nova-compute[85141]: DEBUG nova.compute.manager [req-d10d45be-7c66-45b5-9fdb-826408ceb306 req-55d8d3b2-d056-4eda-95f1-3ddc7d026c97 service nova] [instance: f01dc8cf-1a69-4618-a15d-0c1075157f05] No waiting events found dispatching network-vif-plugged-52edc378-51f4-43c3-b9f3-2d0201ed125d {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:13:44 user nova-compute[85141]: WARNING nova.compute.manager [req-d10d45be-7c66-45b5-9fdb-826408ceb306 req-55d8d3b2-d056-4eda-95f1-3ddc7d026c97 service nova] [instance: f01dc8cf-1a69-4618-a15d-0c1075157f05] Received unexpected event network-vif-plugged-52edc378-51f4-43c3-b9f3-2d0201ed125d for instance with vm_state building and task_state spawning.
Nov 16 10:13:44 user nova-compute[85141]: DEBUG nova.compute.manager [req-d10d45be-7c66-45b5-9fdb-826408ceb306 req-55d8d3b2-d056-4eda-95f1-3ddc7d026c97 service nova] [instance: f01dc8cf-1a69-4618-a15d-0c1075157f05] Received event network-vif-plugged-52edc378-51f4-43c3-b9f3-2d0201ed125d {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:13:44 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-d10d45be-7c66-45b5-9fdb-826408ceb306 req-55d8d3b2-d056-4eda-95f1-3ddc7d026c97 service nova] Acquiring lock "f01dc8cf-1a69-4618-a15d-0c1075157f05-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:13:44 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-d10d45be-7c66-45b5-9fdb-826408ceb306 req-55d8d3b2-d056-4eda-95f1-3ddc7d026c97 service nova] Lock "f01dc8cf-1a69-4618-a15d-0c1075157f05-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:13:44 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-d10d45be-7c66-45b5-9fdb-826408ceb306 req-55d8d3b2-d056-4eda-95f1-3ddc7d026c97 service nova] Lock "f01dc8cf-1a69-4618-a15d-0c1075157f05-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:13:44 user nova-compute[85141]: DEBUG nova.compute.manager [req-d10d45be-7c66-45b5-9fdb-826408ceb306 req-55d8d3b2-d056-4eda-95f1-3ddc7d026c97 service nova] [instance: f01dc8cf-1a69-4618-a15d-0c1075157f05] No waiting events found dispatching network-vif-plugged-52edc378-51f4-43c3-b9f3-2d0201ed125d {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:13:44 user nova-compute[85141]: WARNING nova.compute.manager [req-d10d45be-7c66-45b5-9fdb-826408ceb306 req-55d8d3b2-d056-4eda-95f1-3ddc7d026c97 service nova] [instance: f01dc8cf-1a69-4618-a15d-0c1075157f05] Received unexpected event network-vif-plugged-52edc378-51f4-43c3-b9f3-2d0201ed125d for instance with vm_state building and task_state spawning.
Nov 16 10:13:44 user nova-compute[85141]: DEBUG nova.compute.manager [req-d10d45be-7c66-45b5-9fdb-826408ceb306 req-55d8d3b2-d056-4eda-95f1-3ddc7d026c97 service nova] [instance: 059d6974-bd0c-4f73-91fc-8202ebda4238] Received event network-vif-plugged-89bf502f-593d-4c6e-aa83-a041e0ad7b28 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:13:44 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-d10d45be-7c66-45b5-9fdb-826408ceb306 req-55d8d3b2-d056-4eda-95f1-3ddc7d026c97 service nova] Acquiring lock "059d6974-bd0c-4f73-91fc-8202ebda4238-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:13:44 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-d10d45be-7c66-45b5-9fdb-826408ceb306 req-55d8d3b2-d056-4eda-95f1-3ddc7d026c97 service nova] Lock "059d6974-bd0c-4f73-91fc-8202ebda4238-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:13:44 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-d10d45be-7c66-45b5-9fdb-826408ceb306 req-55d8d3b2-d056-4eda-95f1-3ddc7d026c97 service nova] Lock "059d6974-bd0c-4f73-91fc-8202ebda4238-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:13:44 user nova-compute[85141]: DEBUG nova.compute.manager [req-d10d45be-7c66-45b5-9fdb-826408ceb306 req-55d8d3b2-d056-4eda-95f1-3ddc7d026c97 service nova] [instance: 059d6974-bd0c-4f73-91fc-8202ebda4238] No waiting events found dispatching network-vif-plugged-89bf502f-593d-4c6e-aa83-a041e0ad7b28 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:13:44 user nova-compute[85141]: WARNING nova.compute.manager [req-d10d45be-7c66-45b5-9fdb-826408ceb306 req-55d8d3b2-d056-4eda-95f1-3ddc7d026c97 service nova] [instance: 059d6974-bd0c-4f73-91fc-8202ebda4238] Received unexpected event network-vif-plugged-89bf502f-593d-4c6e-aa83-a041e0ad7b28 for instance with vm_state building and task_state spawning.
Nov 16 10:13:44 user nova-compute[85141]: DEBUG nova.compute.manager [req-d10d45be-7c66-45b5-9fdb-826408ceb306 req-55d8d3b2-d056-4eda-95f1-3ddc7d026c97 service nova] [instance: 059d6974-bd0c-4f73-91fc-8202ebda4238] Received event network-vif-plugged-89bf502f-593d-4c6e-aa83-a041e0ad7b28 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:13:44 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-d10d45be-7c66-45b5-9fdb-826408ceb306 req-55d8d3b2-d056-4eda-95f1-3ddc7d026c97 service nova] Acquiring lock "059d6974-bd0c-4f73-91fc-8202ebda4238-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:13:44 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-d10d45be-7c66-45b5-9fdb-826408ceb306 req-55d8d3b2-d056-4eda-95f1-3ddc7d026c97 service nova] Lock "059d6974-bd0c-4f73-91fc-8202ebda4238-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:13:44 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-d10d45be-7c66-45b5-9fdb-826408ceb306 req-55d8d3b2-d056-4eda-95f1-3ddc7d026c97 service nova] Lock "059d6974-bd0c-4f73-91fc-8202ebda4238-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:13:44 user nova-compute[85141]: DEBUG nova.compute.manager [req-d10d45be-7c66-45b5-9fdb-826408ceb306 req-55d8d3b2-d056-4eda-95f1-3ddc7d026c97 service nova] [instance: 059d6974-bd0c-4f73-91fc-8202ebda4238] No waiting events found dispatching network-vif-plugged-89bf502f-593d-4c6e-aa83-a041e0ad7b28 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:13:44 user nova-compute[85141]: WARNING nova.compute.manager [req-d10d45be-7c66-45b5-9fdb-826408ceb306 req-55d8d3b2-d056-4eda-95f1-3ddc7d026c97 service nova] [instance: 059d6974-bd0c-4f73-91fc-8202ebda4238] Received unexpected event network-vif-plugged-89bf502f-593d-4c6e-aa83-a041e0ad7b28 for instance with vm_state building and task_state spawning.
Nov 16 10:13:46 user nova-compute[85141]: DEBUG nova.compute.manager [None req-ec25c880-8b57-4476-b347-2eb498c7d5cf tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] [instance: f01dc8cf-1a69-4618-a15d-0c1075157f05] Instance event wait completed in 0 seconds for  {{(pid=85141) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 10:13:46 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-ec25c880-8b57-4476-b347-2eb498c7d5cf tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] [instance: f01dc8cf-1a69-4618-a15d-0c1075157f05] Guest created on hypervisor {{(pid=85141) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 10:13:46 user nova-compute[85141]: DEBUG nova.compute.manager [None req-d19fb610-8984-440d-9060-461ca2ae9388 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] [instance: 059d6974-bd0c-4f73-91fc-8202ebda4238] Instance event wait completed in 0 seconds for  {{(pid=85141) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 10:13:46 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-d19fb610-8984-440d-9060-461ca2ae9388 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] [instance: 059d6974-bd0c-4f73-91fc-8202ebda4238] Guest created on hypervisor {{(pid=85141) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 10:13:46 user nova-compute[85141]: INFO nova.virt.libvirt.driver [-] [instance: f01dc8cf-1a69-4618-a15d-0c1075157f05] Instance spawned successfully.
Nov 16 10:13:46 user nova-compute[85141]: INFO nova.virt.libvirt.driver [-] [instance: 059d6974-bd0c-4f73-91fc-8202ebda4238] Instance spawned successfully.
Nov 16 10:13:46 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-ec25c880-8b57-4476-b347-2eb498c7d5cf tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] [instance: f01dc8cf-1a69-4618-a15d-0c1075157f05] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 10:13:46 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-d19fb610-8984-440d-9060-461ca2ae9388 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] [instance: 059d6974-bd0c-4f73-91fc-8202ebda4238] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 10:13:46 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-ec25c880-8b57-4476-b347-2eb498c7d5cf tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] [instance: f01dc8cf-1a69-4618-a15d-0c1075157f05] Found default for hw_cdrom_bus of ide {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:13:46 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-ec25c880-8b57-4476-b347-2eb498c7d5cf tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] [instance: f01dc8cf-1a69-4618-a15d-0c1075157f05] Found default for hw_disk_bus of virtio {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:13:46 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-ec25c880-8b57-4476-b347-2eb498c7d5cf tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] [instance: f01dc8cf-1a69-4618-a15d-0c1075157f05] Found default for hw_input_bus of None {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:13:46 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-ec25c880-8b57-4476-b347-2eb498c7d5cf tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] [instance: f01dc8cf-1a69-4618-a15d-0c1075157f05] Found default for hw_pointer_model of None {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:13:46 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-ec25c880-8b57-4476-b347-2eb498c7d5cf tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] [instance: f01dc8cf-1a69-4618-a15d-0c1075157f05] Found default for hw_video_model of virtio {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:13:46 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-ec25c880-8b57-4476-b347-2eb498c7d5cf tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] [instance: f01dc8cf-1a69-4618-a15d-0c1075157f05] Found default for hw_vif_model of virtio {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:13:46 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-d19fb610-8984-440d-9060-461ca2ae9388 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] [instance: 059d6974-bd0c-4f73-91fc-8202ebda4238] Found default for hw_cdrom_bus of ide {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:13:46 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-d19fb610-8984-440d-9060-461ca2ae9388 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] [instance: 059d6974-bd0c-4f73-91fc-8202ebda4238] Found default for hw_disk_bus of virtio {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:13:46 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-d19fb610-8984-440d-9060-461ca2ae9388 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] [instance: 059d6974-bd0c-4f73-91fc-8202ebda4238] Found default for hw_input_bus of None {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:13:46 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-d19fb610-8984-440d-9060-461ca2ae9388 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] [instance: 059d6974-bd0c-4f73-91fc-8202ebda4238] Found default for hw_pointer_model of None {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:13:46 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-d19fb610-8984-440d-9060-461ca2ae9388 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] [instance: 059d6974-bd0c-4f73-91fc-8202ebda4238] Found default for hw_video_model of virtio {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:13:46 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-d19fb610-8984-440d-9060-461ca2ae9388 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] [instance: 059d6974-bd0c-4f73-91fc-8202ebda4238] Found default for hw_vif_model of virtio {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:13:46 user nova-compute[85141]: INFO nova.compute.manager [None req-ec25c880-8b57-4476-b347-2eb498c7d5cf tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] [instance: f01dc8cf-1a69-4618-a15d-0c1075157f05] Took 7.39 seconds to spawn the instance on the hypervisor.
Nov 16 10:13:46 user nova-compute[85141]: DEBUG nova.compute.manager [None req-ec25c880-8b57-4476-b347-2eb498c7d5cf tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] [instance: f01dc8cf-1a69-4618-a15d-0c1075157f05] Checking state {{(pid=85141) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 10:13:46 user nova-compute[85141]: INFO nova.compute.manager [None req-d19fb610-8984-440d-9060-461ca2ae9388 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] [instance: 059d6974-bd0c-4f73-91fc-8202ebda4238] Took 8.69 seconds to spawn the instance on the hypervisor.
Nov 16 10:13:46 user nova-compute[85141]: DEBUG nova.compute.manager [None req-d19fb610-8984-440d-9060-461ca2ae9388 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] [instance: 059d6974-bd0c-4f73-91fc-8202ebda4238] Checking state {{(pid=85141) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 10:13:46 user nova-compute[85141]: INFO nova.compute.manager [None req-ec25c880-8b57-4476-b347-2eb498c7d5cf tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] [instance: f01dc8cf-1a69-4618-a15d-0c1075157f05] Took 19.71 seconds to build instance.
Nov 16 10:13:46 user nova-compute[85141]: INFO nova.compute.manager [None req-d19fb610-8984-440d-9060-461ca2ae9388 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] [instance: 059d6974-bd0c-4f73-91fc-8202ebda4238] Took 9.93 seconds to build instance.
Nov 16 10:13:46 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-ec25c880-8b57-4476-b347-2eb498c7d5cf tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Lock "f01dc8cf-1a69-4618-a15d-0c1075157f05" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.807s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:13:46 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-d19fb610-8984-440d-9060-461ca2ae9388 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Lock "059d6974-bd0c-4f73-91fc-8202ebda4238" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.020s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:13:46 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:13:47 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:13:47 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-6bae5a19-8207-4e63-b6bb-3b55bde6ac07 tempest-TestVolumeSwap-1428287604 tempest-TestVolumeSwap-1428287604-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance ad1ace46-2e8e-42e1-a0f5-2384078fcf09 is timed out.
Nov 16 10:13:47 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-6bae5a19-8207-4e63-b6bb-3b55bde6ac07 tempest-TestVolumeSwap-1428287604 tempest-TestVolumeSwap-1428287604-project-member] Successfully detached device vdb from instance ad1ace46-2e8e-42e1-a0f5-2384078fcf09 from the live domain config.
Nov 16 10:13:47 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6bae5a19-8207-4e63-b6bb-3b55bde6ac07 tempest-TestVolumeSwap-1428287604 tempest-TestVolumeSwap-1428287604-project-member] [instance: ad1ace46-2e8e-42e1-a0f5-2384078fcf09] calling os-brick to detach iSCSI Volume {{(pid=85141) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 10:13:47 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bae5a19-8207-4e63-b6bb-3b55bde6ac07 tempest-TestVolumeSwap-1428287604 tempest-TestVolumeSwap-1428287604-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51806b6080>, {'target_iqn': 'iqn.2010-10.org.openstack:7e233047-dda3-4f2e-803c-7b69a57ac656', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UtNLBDJC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf', 'volume_id': '7e233047-dda3-4f2e-803c-7b69a57ac656'}, None), 'kwargs': False}}" {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 10:13:47 user nova-compute[85141]: WARNING os_brick.initiator.connectors.base [None req-6bae5a19-8207-4e63-b6bb-3b55bde6ac07 tempest-TestVolumeSwap-1428287604 tempest-TestVolumeSwap-1428287604-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 10:13:47 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-6bae5a19-8207-4e63-b6bb-3b55bde6ac07 tempest-TestVolumeSwap-1428287604 tempest-TestVolumeSwap-1428287604-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 10:13:47 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-6bae5a19-8207-4e63-b6bb-3b55bde6ac07 tempest-TestVolumeSwap-1428287604 tempest-TestVolumeSwap-1428287604-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 10:13:47 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:13:47 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:13:47 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[32e0da10-1e0c-4ddf-85c7-6469112e66b7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7e233047-dda3-4f2e-803c-7b69a57ac656\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:42c041ec-fa39-4035-b82b-867caf3565df\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:13:47 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bae5a19-8207-4e63-b6bb-3b55bde6ac07 tempest-TestVolumeSwap-1428287604 tempest-TestVolumeSwap-1428287604-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 10:13:47 user nova-compute[85141]: No targets found.
Nov 16 10:13:47 user nova-compute[85141]: iSNS:
Nov 16 10:13:47 user nova-compute[85141]: No targets found.
Nov 16 10:13:47 user nova-compute[85141]: STATIC:
Nov 16 10:13:47 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee
Nov 16 10:13:47 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:13:47 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:13:47 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:7e233047-dda3-4f2e-803c-7b69a57ac656
Nov 16 10:13:47 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:13:47 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:13:47 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:42c041ec-fa39-4035-b82b-867caf3565df
Nov 16 10:13:47 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:13:47 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:13:47 user nova-compute[85141]: FIRMWARE:
Nov 16 10:13:47 user nova-compute[85141]: No targets found.
Nov 16 10:13:47 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:13:47 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bae5a19-8207-4e63-b6bb-3b55bde6ac07 tempest-TestVolumeSwap-1428287604 tempest-TestVolumeSwap-1428287604-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 10:13:47 user nova-compute[85141]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 10:13:47 user nova-compute[85141]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=85141) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 10:13:47 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bae5a19-8207-4e63-b6bb-3b55bde6ac07 tempest-TestVolumeSwap-1428287604 tempest-TestVolumeSwap-1428287604-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7e233047-dda3-4f2e-803c-7b69a57ac656', 0)] {{(pid=85141) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 10:13:47 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:13:47 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:13:47 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9ce8b21-da45-42c7-af35-02c51294cc31]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:42c041ec-fa39-4035-b82b-867caf3565df\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7e233047-dda3-4f2e-803c-7b69a57ac656\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:13:47 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:13:47 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:13:47 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d677050-27ba-47ae-b67b-02074ca18c75]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42c041ec-fa39-4035-b82b-867caf3565df (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e233047-dda3-4f2e-803c-7b69a57ac656 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:13:47 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bae5a19-8207-4e63-b6bb-3b55bde6ac07 tempest-TestVolumeSwap-1428287604 tempest-TestVolumeSwap-1428287604-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42c041ec-fa39-4035-b82b-867caf3565df (non-flash)
Nov 16 10:13:47 user nova-compute[85141]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e233047-dda3-4f2e-803c-7b69a57ac656 (non-flash)
Nov 16 10:13:47 user nova-compute[85141]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)
Nov 16 10:13:47 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:13:47 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bae5a19-8207-4e63-b6bb-3b55bde6ac07 tempest-TestVolumeSwap-1428287604 tempest-TestVolumeSwap-1428287604-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42c041ec-fa39-4035-b82b-867caf3565df (non-flash)
Nov 16 10:13:47 user nova-compute[85141]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e233047-dda3-4f2e-803c-7b69a57ac656 (non-flash)
Nov 16 10:13:47 user nova-compute[85141]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)
Nov 16 10:13:47 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 10:13:47 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bae5a19-8207-4e63-b6bb-3b55bde6ac07 tempest-TestVolumeSwap-1428287604 tempest-TestVolumeSwap-1428287604-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f51802ab880>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7e233047-dda3-4f2e-803c-7b69a57ac656'): ({'sdf'}, set())}) {{(pid=85141) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 10:13:47 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-6bae5a19-8207-4e63-b6bb-3b55bde6ac07 tempest-TestVolumeSwap-1428287604 tempest-TestVolumeSwap-1428287604-project-member] Removing single pathed devices sdf {{(pid=85141) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 10:13:47 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:13:47 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:13:47 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[a82fc141-7af6-4646-bee3-fe70b74bf6d9]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:13:47 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:13:47 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:13:47 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[90315fa5-e5a3-478d-8d5d-a3e642f4c4c5]: (4, ('ok\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:13:47 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-6bae5a19-8207-4e63-b6bb-3b55bde6ac07 tempest-TestVolumeSwap-1428287604 tempest-TestVolumeSwap-1428287604-project-member] Flushing IO for device /dev/sdf {{(pid=85141) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 10:13:47 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:13:47 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:13:47 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4cd50ed-fded-4074-9163-78b58a8f8aa2]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:13:47 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-6bae5a19-8207-4e63-b6bb-3b55bde6ac07 tempest-TestVolumeSwap-1428287604 tempest-TestVolumeSwap-1428287604-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=85141) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 10:13:47 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:13:47 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.055s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:13:47 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4ef9f8f-2b6a-434b-a201-858b7387a4c6]: (4, ('1', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:13:47 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-6bae5a19-8207-4e63-b6bb-3b55bde6ac07 tempest-TestVolumeSwap-1428287604 tempest-TestVolumeSwap-1428287604-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=85141) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 10:13:47 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-6bae5a19-8207-4e63-b6bb-3b55bde6ac07 tempest-TestVolumeSwap-1428287604 tempest-TestVolumeSwap-1428287604-project-member] SCSI volumes sdf have been removed. {{(pid=85141) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 10:13:47 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bae5a19-8207-4e63-b6bb-3b55bde6ac07 tempest-TestVolumeSwap-1428287604 tempest-TestVolumeSwap-1428287604-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7e233047-dda3-4f2e-803c-7b69a57ac656')] {{(pid=85141) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 10:13:47 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e233047-dda3-4f2e-803c-7b69a57ac656 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:13:47 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e233047-dda3-4f2e-803c-7b69a57ac656 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:13:47 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[774da858-ee96-4146-a68f-3ee6de3bb769]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:13:47 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bae5a19-8207-4e63-b6bb-3b55bde6ac07 tempest-TestVolumeSwap-1428287604 tempest-TestVolumeSwap-1428287604-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:13:47 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e233047-dda3-4f2e-803c-7b69a57ac656 -p 172.16.0.220:3260 --logout {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:13:47 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e233047-dda3-4f2e-803c-7b69a57ac656 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:13:47 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b023206-9d20-4caa-ab09-0296442a25be]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:7e233047-dda3-4f2e-803c-7b69a57ac656, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:7e233047-dda3-4f2e-803c-7b69a57ac656, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:13:47 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bae5a19-8207-4e63-b6bb-3b55bde6ac07 tempest-TestVolumeSwap-1428287604 tempest-TestVolumeSwap-1428287604-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:7e233047-dda3-4f2e-803c-7b69a57ac656, portal: 172.16.0.220,3260]
Nov 16 10:13:47 user nova-compute[85141]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:7e233047-dda3-4f2e-803c-7b69a57ac656, portal: 172.16.0.220,3260] successful.
Nov 16 10:13:47 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:13:47 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e233047-dda3-4f2e-803c-7b69a57ac656 -p 172.16.0.220:3260 --op delete {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:13:47 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e233047-dda3-4f2e-803c-7b69a57ac656 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:13:47 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b57dbb6-404f-4c4e-b7ae-2e5e7cf0af30]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:13:47 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bae5a19-8207-4e63-b6bb-3b55bde6ac07 tempest-TestVolumeSwap-1428287604 tempest-TestVolumeSwap-1428287604-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:13:47 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-6bae5a19-8207-4e63-b6bb-3b55bde6ac07 tempest-TestVolumeSwap-1428287604 tempest-TestVolumeSwap-1428287604-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.331s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 10:13:47 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bae5a19-8207-4e63-b6bb-3b55bde6ac07 tempest-TestVolumeSwap-1428287604 tempest-TestVolumeSwap-1428287604-project-member] <== disconnect_volume: return (332ms) None {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 10:13:47 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6bae5a19-8207-4e63-b6bb-3b55bde6ac07 tempest-TestVolumeSwap-1428287604 tempest-TestVolumeSwap-1428287604-project-member] [instance: ad1ace46-2e8e-42e1-a0f5-2384078fcf09] Disconnected iSCSI Volume {{(pid=85141) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 10:13:48 user nova-compute[85141]: DEBUG nova.objects.instance [None req-6bae5a19-8207-4e63-b6bb-3b55bde6ac07 tempest-TestVolumeSwap-1428287604 tempest-TestVolumeSwap-1428287604-project-member] Lazy-loading 'flavor' on Instance uuid ad1ace46-2e8e-42e1-a0f5-2384078fcf09 {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:13:48 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-6bae5a19-8207-4e63-b6bb-3b55bde6ac07 tempest-TestVolumeSwap-1428287604 tempest-TestVolumeSwap-1428287604-project-member] Lock "ad1ace46-2e8e-42e1-a0f5-2384078fcf09" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.950s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:13:51 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:13:51 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-67958a81-2524-4b4a-b036-7822671f7735 tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] Acquiring lock "65168899-e7c2-4dea-9257-7490ab994939" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:13:51 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-67958a81-2524-4b4a-b036-7822671f7735 tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] Lock "65168899-e7c2-4dea-9257-7490ab994939" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:13:51 user nova-compute[85141]: DEBUG nova.compute.manager [None req-67958a81-2524-4b4a-b036-7822671f7735 tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] [instance: 65168899-e7c2-4dea-9257-7490ab994939] Starting instance... {{(pid=85141) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 10:13:51 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-67958a81-2524-4b4a-b036-7822671f7735 tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:13:51 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-67958a81-2524-4b4a-b036-7822671f7735 tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:13:51 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-67958a81-2524-4b4a-b036-7822671f7735 tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=85141) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 10:13:51 user nova-compute[85141]: INFO nova.compute.claims [None req-67958a81-2524-4b4a-b036-7822671f7735 tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] [instance: 65168899-e7c2-4dea-9257-7490ab994939] Claim successful on node user
Nov 16 10:13:52 user nova-compute[85141]: DEBUG nova.compute.provider_tree [None req-67958a81-2524-4b4a-b036-7822671f7735 tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] Inventory has not changed in ProviderTree for provider: bf8e0fa1-16b6-408f-9203-c4cd63916272 {{(pid=85141) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 10:13:52 user nova-compute[85141]: DEBUG nova.scheduler.client.report [None req-67958a81-2524-4b4a-b036-7822671f7735 tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] Inventory has not changed for provider bf8e0fa1-16b6-408f-9203-c4cd63916272 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=85141) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 10:13:52 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-67958a81-2524-4b4a-b036-7822671f7735 tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.454s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:13:52 user nova-compute[85141]: DEBUG nova.compute.manager [None req-67958a81-2524-4b4a-b036-7822671f7735 tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] [instance: 65168899-e7c2-4dea-9257-7490ab994939] Start building networks asynchronously for instance. {{(pid=85141) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 10:13:52 user nova-compute[85141]: DEBUG nova.compute.manager [None req-67958a81-2524-4b4a-b036-7822671f7735 tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] [instance: 65168899-e7c2-4dea-9257-7490ab994939] Allocating IP information in the background. {{(pid=85141) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 10:13:52 user nova-compute[85141]: DEBUG nova.network.neutron [None req-67958a81-2524-4b4a-b036-7822671f7735 tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] [instance: 65168899-e7c2-4dea-9257-7490ab994939] allocate_for_instance() {{(pid=85141) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 10:13:52 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-67958a81-2524-4b4a-b036-7822671f7735 tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] [instance: 65168899-e7c2-4dea-9257-7490ab994939] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 10:13:52 user nova-compute[85141]: DEBUG nova.compute.manager [None req-67958a81-2524-4b4a-b036-7822671f7735 tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] [instance: 65168899-e7c2-4dea-9257-7490ab994939] Start building block device mappings for instance. {{(pid=85141) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 10:13:52 user nova-compute[85141]: DEBUG nova.policy [None req-67958a81-2524-4b4a-b036-7822671f7735 tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3b83d10371214ba68a125f52df7e33ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35983b98d3c404d8cddce2894f97dba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85141) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 10:13:52 user nova-compute[85141]: DEBUG nova.compute.manager [None req-67958a81-2524-4b4a-b036-7822671f7735 tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] [instance: 65168899-e7c2-4dea-9257-7490ab994939] Start spawning the instance on the hypervisor. {{(pid=85141) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 10:13:52 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-67958a81-2524-4b4a-b036-7822671f7735 tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] [instance: 65168899-e7c2-4dea-9257-7490ab994939] Creating instance directory {{(pid=85141) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 10:13:52 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-67958a81-2524-4b4a-b036-7822671f7735 tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] [instance: 65168899-e7c2-4dea-9257-7490ab994939] Creating image(s)
Nov 16 10:13:52 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-67958a81-2524-4b4a-b036-7822671f7735 tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] Acquiring lock "/opt/stack/data/nova/instances/65168899-e7c2-4dea-9257-7490ab994939/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:13:52 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-67958a81-2524-4b4a-b036-7822671f7735 tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] Lock "/opt/stack/data/nova/instances/65168899-e7c2-4dea-9257-7490ab994939/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:13:52 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-67958a81-2524-4b4a-b036-7822671f7735 tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] Lock "/opt/stack/data/nova/instances/65168899-e7c2-4dea-9257-7490ab994939/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.010s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:13:52 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-67958a81-2524-4b4a-b036-7822671f7735 tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:13:53 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-67958a81-2524-4b4a-b036-7822671f7735 tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json" returned: 0 in 0.216s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:13:53 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-67958a81-2524-4b4a-b036-7822671f7735 tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] Acquiring lock "60a78556fb399ed4a41bc3ca4bccf77c96d8e811" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:13:53 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-67958a81-2524-4b4a-b036-7822671f7735 tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] Lock "60a78556fb399ed4a41bc3ca4bccf77c96d8e811" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:13:53 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-67958a81-2524-4b4a-b036-7822671f7735 tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:13:53 user nova-compute[85141]: DEBUG nova.network.neutron [None req-67958a81-2524-4b4a-b036-7822671f7735 tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] [instance: 65168899-e7c2-4dea-9257-7490ab994939] Successfully created port: 814b06ff-29a7-4402-92dd-e2a1b60b782a {{(pid=85141) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 10:13:53 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-67958a81-2524-4b4a-b036-7822671f7735 tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json" returned: 0 in 0.193s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:13:53 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-67958a81-2524-4b4a-b036-7822671f7735 tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811,backing_fmt=raw /opt/stack/data/nova/instances/65168899-e7c2-4dea-9257-7490ab994939/disk 1073741824 {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:13:53 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-67958a81-2524-4b4a-b036-7822671f7735 tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811,backing_fmt=raw /opt/stack/data/nova/instances/65168899-e7c2-4dea-9257-7490ab994939/disk 1073741824" returned: 0 in 0.053s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:13:53 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-67958a81-2524-4b4a-b036-7822671f7735 tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] Lock "60a78556fb399ed4a41bc3ca4bccf77c96d8e811" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.252s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:13:53 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-67958a81-2524-4b4a-b036-7822671f7735 tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:13:53 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-67958a81-2524-4b4a-b036-7822671f7735 tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json" returned: 0 in 0.167s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:13:53 user nova-compute[85141]: DEBUG nova.virt.disk.api [None req-67958a81-2524-4b4a-b036-7822671f7735 tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] Checking if we can resize image /opt/stack/data/nova/instances/65168899-e7c2-4dea-9257-7490ab994939/disk. size=1073741824 {{(pid=85141) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 10:13:53 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-67958a81-2524-4b4a-b036-7822671f7735 tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65168899-e7c2-4dea-9257-7490ab994939/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:13:53 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-67958a81-2524-4b4a-b036-7822671f7735 tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65168899-e7c2-4dea-9257-7490ab994939/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:13:53 user nova-compute[85141]: DEBUG nova.virt.disk.api [None req-67958a81-2524-4b4a-b036-7822671f7735 tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] Cannot resize image /opt/stack/data/nova/instances/65168899-e7c2-4dea-9257-7490ab994939/disk to a smaller size. {{(pid=85141) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 10:13:53 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-67958a81-2524-4b4a-b036-7822671f7735 tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] [instance: 65168899-e7c2-4dea-9257-7490ab994939] Created local disks {{(pid=85141) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 10:13:53 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-67958a81-2524-4b4a-b036-7822671f7735 tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] [instance: 65168899-e7c2-4dea-9257-7490ab994939] Ensure instance console log exists: /opt/stack/data/nova/instances/65168899-e7c2-4dea-9257-7490ab994939/console.log {{(pid=85141) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 10:13:53 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-67958a81-2524-4b4a-b036-7822671f7735 tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:13:53 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-67958a81-2524-4b4a-b036-7822671f7735 tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:13:53 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-67958a81-2524-4b4a-b036-7822671f7735 tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:13:53 user nova-compute[85141]: DEBUG nova.network.neutron [None req-67958a81-2524-4b4a-b036-7822671f7735 tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] [instance: 65168899-e7c2-4dea-9257-7490ab994939] Successfully updated port: 814b06ff-29a7-4402-92dd-e2a1b60b782a {{(pid=85141) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 10:13:53 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-67958a81-2524-4b4a-b036-7822671f7735 tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] Acquiring lock "refresh_cache-65168899-e7c2-4dea-9257-7490ab994939" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:13:53 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-67958a81-2524-4b4a-b036-7822671f7735 tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] Acquired lock "refresh_cache-65168899-e7c2-4dea-9257-7490ab994939" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:13:53 user nova-compute[85141]: DEBUG nova.network.neutron [None req-67958a81-2524-4b4a-b036-7822671f7735 tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] [instance: 65168899-e7c2-4dea-9257-7490ab994939] Building network info cache for instance {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 10:13:53 user nova-compute[85141]: DEBUG nova.compute.manager [req-c629679a-6b29-4b86-bdc3-d28b4f273274 req-5b0ccf73-c40f-46f1-bc6f-fd11679da577 service nova] [instance: 65168899-e7c2-4dea-9257-7490ab994939] Received event network-changed-814b06ff-29a7-4402-92dd-e2a1b60b782a {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:13:53 user nova-compute[85141]: DEBUG nova.compute.manager [req-c629679a-6b29-4b86-bdc3-d28b4f273274 req-5b0ccf73-c40f-46f1-bc6f-fd11679da577 service nova] [instance: 65168899-e7c2-4dea-9257-7490ab994939] Refreshing instance network info cache due to event network-changed-814b06ff-29a7-4402-92dd-e2a1b60b782a. {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 10:13:53 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-c629679a-6b29-4b86-bdc3-d28b4f273274 req-5b0ccf73-c40f-46f1-bc6f-fd11679da577 service nova] Acquiring lock "refresh_cache-65168899-e7c2-4dea-9257-7490ab994939" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:13:53 user nova-compute[85141]: DEBUG nova.network.neutron [None req-67958a81-2524-4b4a-b036-7822671f7735 tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] [instance: 65168899-e7c2-4dea-9257-7490ab994939] Instance cache missing network info. {{(pid=85141) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 10:13:54 user nova-compute[85141]: DEBUG nova.network.neutron [None req-67958a81-2524-4b4a-b036-7822671f7735 tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] [instance: 65168899-e7c2-4dea-9257-7490ab994939] Updating instance_info_cache with network_info: [{"id": "814b06ff-29a7-4402-92dd-e2a1b60b782a", "address": "fa:16:3e:f5:e3:cf", "network": {"id": "20b79aa8-c67e-4ab4-aa9f-659587f8bcb2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1635312124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b35983b98d3c404d8cddce2894f97dba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap814b06ff-29", "ovs_interfaceid": "814b06ff-29a7-4402-92dd-e2a1b60b782a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:13:54 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-67958a81-2524-4b4a-b036-7822671f7735 tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] Releasing lock "refresh_cache-65168899-e7c2-4dea-9257-7490ab994939" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:13:54 user nova-compute[85141]: DEBUG nova.compute.manager [None req-67958a81-2524-4b4a-b036-7822671f7735 tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] [instance: 65168899-e7c2-4dea-9257-7490ab994939] Instance network_info: |[{"id": "814b06ff-29a7-4402-92dd-e2a1b60b782a", "address": "fa:16:3e:f5:e3:cf", "network": {"id": "20b79aa8-c67e-4ab4-aa9f-659587f8bcb2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1635312124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b35983b98d3c404d8cddce2894f97dba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap814b06ff-29", "ovs_interfaceid": "814b06ff-29a7-4402-92dd-e2a1b60b782a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=85141) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 10:13:54 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-c629679a-6b29-4b86-bdc3-d28b4f273274 req-5b0ccf73-c40f-46f1-bc6f-fd11679da577 service nova] Acquired lock "refresh_cache-65168899-e7c2-4dea-9257-7490ab994939" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:13:54 user nova-compute[85141]: DEBUG nova.network.neutron [req-c629679a-6b29-4b86-bdc3-d28b4f273274 req-5b0ccf73-c40f-46f1-bc6f-fd11679da577 service nova] [instance: 65168899-e7c2-4dea-9257-7490ab994939] Refreshing network info cache for port 814b06ff-29a7-4402-92dd-e2a1b60b782a {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 10:13:54 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-67958a81-2524-4b4a-b036-7822671f7735 tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] [instance: 65168899-e7c2-4dea-9257-7490ab994939] Start _get_guest_xml network_info=[{"id": "814b06ff-29a7-4402-92dd-e2a1b60b782a", "address": "fa:16:3e:f5:e3:cf", "network": {"id": "20b79aa8-c67e-4ab4-aa9f-659587f8bcb2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1635312124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b35983b98d3c404d8cddce2894f97dba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap814b06ff-29", "ovs_interfaceid": "814b06ff-29a7-4402-92dd-e2a1b60b782a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T10:06:42Z,direct_url=<?>,disk_format='qcow2',id=bc4ca70f-a459-4d5c-a9e6-80f1948eb48b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1044631a5fe84ce8904864a7024049fa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T10:06:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_options': None, 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'image_id': 'bc4ca70f-a459-4d5c-a9e6-80f1948eb48b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=85141) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 10:13:54 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-67958a81-2524-4b4a-b036-7822671f7735 tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:13:54 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-67958a81-2524-4b4a-b036-7822671f7735 tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:13:54 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-67958a81-2524-4b4a-b036-7822671f7735 tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=85141) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 10:13:54 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-67958a81-2524-4b4a-b036-7822671f7735 tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] CPU controller missing on host. {{(pid=85141) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 10:13:54 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-67958a81-2524-4b4a-b036-7822671f7735 tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=85141) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 10:13:54 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-67958a81-2524-4b4a-b036-7822671f7735 tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] CPU controller found on host. {{(pid=85141) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 10:13:54 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-67958a81-2524-4b4a-b036-7822671f7735 tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=85141) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 10:13:54 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-67958a81-2524-4b4a-b036-7822671f7735 tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T10:06:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T10:06:42Z,direct_url=<?>,disk_format='qcow2',id=bc4ca70f-a459-4d5c-a9e6-80f1948eb48b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1044631a5fe84ce8904864a7024049fa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T10:06:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 10:13:54 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-67958a81-2524-4b4a-b036-7822671f7735 tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] Flavor limits 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 10:13:54 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-67958a81-2524-4b4a-b036-7822671f7735 tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] Image limits 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 10:13:54 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-67958a81-2524-4b4a-b036-7822671f7735 tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] Flavor pref 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 10:13:54 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-67958a81-2524-4b4a-b036-7822671f7735 tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] Image pref 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 10:13:54 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-67958a81-2524-4b4a-b036-7822671f7735 tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 10:13:54 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-67958a81-2524-4b4a-b036-7822671f7735 tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 10:13:54 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-67958a81-2524-4b4a-b036-7822671f7735 tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=85141) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 10:13:54 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-67958a81-2524-4b4a-b036-7822671f7735 tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] Got 1 possible topologies {{(pid=85141) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 10:13:54 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-67958a81-2524-4b4a-b036-7822671f7735 tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 10:13:54 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-67958a81-2524-4b4a-b036-7822671f7735 tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 10:13:54 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-67958a81-2524-4b4a-b036-7822671f7735 tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T10:13:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1721502885',display_name='tempest-VolumesActionsTest-instance-1721502885',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1721502885',id=16,image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b35983b98d3c404d8cddce2894f97dba',ramdisk_id='',reservation_id='r-ka3o6fwg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1337688058',owner_user_name='tempest-VolumesActionsTest-1337688058-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T10:13:53Z,user_data=None,user_id='3b83d10371214ba68a125f52df7e33ad',uuid=65168899-e7c2-4dea-9257-7490ab994939,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "814b06ff-29a7-4402-92dd-e2a1b60b782a", "address": "fa:16:3e:f5:e3:cf", "network": {"id": "20b79aa8-c67e-4ab4-aa9f-659587f8bcb2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1635312124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b35983b98d3c404d8cddce2894f97dba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap814b06ff-29", "ovs_interfaceid": "814b06ff-29a7-4402-92dd-e2a1b60b782a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=85141) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 10:13:54 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-67958a81-2524-4b4a-b036-7822671f7735 tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] Converting VIF {"id": "814b06ff-29a7-4402-92dd-e2a1b60b782a", "address": "fa:16:3e:f5:e3:cf", "network": {"id": "20b79aa8-c67e-4ab4-aa9f-659587f8bcb2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1635312124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b35983b98d3c404d8cddce2894f97dba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap814b06ff-29", "ovs_interfaceid": "814b06ff-29a7-4402-92dd-e2a1b60b782a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:13:54 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-67958a81-2524-4b4a-b036-7822671f7735 tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:e3:cf,bridge_name='br-int',has_traffic_filtering=True,id=814b06ff-29a7-4402-92dd-e2a1b60b782a,network=Network(20b79aa8-c67e-4ab4-aa9f-659587f8bcb2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap814b06ff-29') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:13:54 user nova-compute[85141]: DEBUG nova.objects.instance [None req-67958a81-2524-4b4a-b036-7822671f7735 tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] Lazy-loading 'pci_devices' on Instance uuid 65168899-e7c2-4dea-9257-7490ab994939 {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:13:54 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-67958a81-2524-4b4a-b036-7822671f7735 tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] [instance: 65168899-e7c2-4dea-9257-7490ab994939] End _get_guest_xml xml=<domain type="kvm">
Nov 16 10:13:54 user nova-compute[85141]:   <uuid>65168899-e7c2-4dea-9257-7490ab994939</uuid>
Nov 16 10:13:54 user nova-compute[85141]:   <name>instance-00000010</name>
Nov 16 10:13:54 user nova-compute[85141]:   <memory>524288</memory>
Nov 16 10:13:54 user nova-compute[85141]:   <vcpu>1</vcpu>
Nov 16 10:13:54 user nova-compute[85141]:   <metadata>
Nov 16 10:13:54 user nova-compute[85141]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 10:13:54 user nova-compute[85141]:       <nova:package version="0.0.0"/>
Nov 16 10:13:54 user nova-compute[85141]:       <nova:name>tempest-VolumesActionsTest-instance-1721502885</nova:name>
Nov 16 10:13:54 user nova-compute[85141]:       <nova:creationTime>2023-11-16 10:13:54</nova:creationTime>
Nov 16 10:13:54 user nova-compute[85141]:       <nova:flavor name="m1.tiny">
Nov 16 10:13:54 user nova-compute[85141]:         <nova:memory>512</nova:memory>
Nov 16 10:13:54 user nova-compute[85141]:         <nova:disk>1</nova:disk>
Nov 16 10:13:54 user nova-compute[85141]:         <nova:swap>0</nova:swap>
Nov 16 10:13:54 user nova-compute[85141]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 10:13:54 user nova-compute[85141]:         <nova:vcpus>1</nova:vcpus>
Nov 16 10:13:54 user nova-compute[85141]:       </nova:flavor>
Nov 16 10:13:54 user nova-compute[85141]:       <nova:owner>
Nov 16 10:13:54 user nova-compute[85141]:         <nova:user uuid="3b83d10371214ba68a125f52df7e33ad">tempest-VolumesActionsTest-1337688058-project-member</nova:user>
Nov 16 10:13:54 user nova-compute[85141]:         <nova:project uuid="b35983b98d3c404d8cddce2894f97dba">tempest-VolumesActionsTest-1337688058</nova:project>
Nov 16 10:13:54 user nova-compute[85141]:       </nova:owner>
Nov 16 10:13:54 user nova-compute[85141]:       <nova:root type="image" uuid="bc4ca70f-a459-4d5c-a9e6-80f1948eb48b"/>
Nov 16 10:13:54 user nova-compute[85141]:       <nova:ports>
Nov 16 10:13:54 user nova-compute[85141]:         <nova:port uuid="814b06ff-29a7-4402-92dd-e2a1b60b782a">
Nov 16 10:13:54 user nova-compute[85141]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 16 10:13:54 user nova-compute[85141]:         </nova:port>
Nov 16 10:13:54 user nova-compute[85141]:       </nova:ports>
Nov 16 10:13:54 user nova-compute[85141]:     </nova:instance>
Nov 16 10:13:54 user nova-compute[85141]:   </metadata>
Nov 16 10:13:54 user nova-compute[85141]:   <sysinfo type="smbios">
Nov 16 10:13:54 user nova-compute[85141]:     <system>
Nov 16 10:13:54 user nova-compute[85141]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 10:13:54 user nova-compute[85141]:       <entry name="product">OpenStack Nova</entry>
Nov 16 10:13:54 user nova-compute[85141]:       <entry name="version">0.0.0</entry>
Nov 16 10:13:54 user nova-compute[85141]:       <entry name="serial">65168899-e7c2-4dea-9257-7490ab994939</entry>
Nov 16 10:13:54 user nova-compute[85141]:       <entry name="uuid">65168899-e7c2-4dea-9257-7490ab994939</entry>
Nov 16 10:13:54 user nova-compute[85141]:       <entry name="family">Virtual Machine</entry>
Nov 16 10:13:54 user nova-compute[85141]:     </system>
Nov 16 10:13:54 user nova-compute[85141]:   </sysinfo>
Nov 16 10:13:54 user nova-compute[85141]:   <os>
Nov 16 10:13:54 user nova-compute[85141]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 10:13:54 user nova-compute[85141]:     <boot dev="hd"/>
Nov 16 10:13:54 user nova-compute[85141]:     <smbios mode="sysinfo"/>
Nov 16 10:13:54 user nova-compute[85141]:   </os>
Nov 16 10:13:54 user nova-compute[85141]:   <features>
Nov 16 10:13:54 user nova-compute[85141]:     <acpi/>
Nov 16 10:13:54 user nova-compute[85141]:     <apic/>
Nov 16 10:13:54 user nova-compute[85141]:     <vmcoreinfo/>
Nov 16 10:13:54 user nova-compute[85141]:   </features>
Nov 16 10:13:54 user nova-compute[85141]:   <clock offset="utc">
Nov 16 10:13:54 user nova-compute[85141]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 10:13:54 user nova-compute[85141]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 10:13:54 user nova-compute[85141]:     <timer name="hpet" present="no"/>
Nov 16 10:13:54 user nova-compute[85141]:   </clock>
Nov 16 10:13:54 user nova-compute[85141]:   <cpu mode="custom" match="exact">
Nov 16 10:13:54 user nova-compute[85141]:     <model>Nehalem</model>
Nov 16 10:13:54 user nova-compute[85141]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 10:13:54 user nova-compute[85141]:   </cpu>
Nov 16 10:13:54 user nova-compute[85141]:   <devices>
Nov 16 10:13:54 user nova-compute[85141]:     <disk type="file" device="disk">
Nov 16 10:13:54 user nova-compute[85141]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 10:13:54 user nova-compute[85141]:       <source file="/opt/stack/data/nova/instances/65168899-e7c2-4dea-9257-7490ab994939/disk"/>
Nov 16 10:13:54 user nova-compute[85141]:       <target dev="vda" bus="virtio"/>
Nov 16 10:13:54 user nova-compute[85141]:     </disk>
Nov 16 10:13:54 user nova-compute[85141]:     <interface type="ethernet">
Nov 16 10:13:54 user nova-compute[85141]:       <mac address="fa:16:3e:f5:e3:cf"/>
Nov 16 10:13:54 user nova-compute[85141]:       <model type="virtio"/>
Nov 16 10:13:54 user nova-compute[85141]:       <mtu size="1442"/>
Nov 16 10:13:54 user nova-compute[85141]:       <target dev="tap814b06ff-29"/>
Nov 16 10:13:54 user nova-compute[85141]:     </interface>
Nov 16 10:13:54 user nova-compute[85141]:     <serial type="pty">
Nov 16 10:13:54 user nova-compute[85141]:       <log file="/opt/stack/data/nova/instances/65168899-e7c2-4dea-9257-7490ab994939/console.log" append="off"/>
Nov 16 10:13:54 user nova-compute[85141]:     </serial>
Nov 16 10:13:54 user nova-compute[85141]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 10:13:54 user nova-compute[85141]:     <video>
Nov 16 10:13:54 user nova-compute[85141]:       <model type="virtio"/>
Nov 16 10:13:54 user nova-compute[85141]:     </video>
Nov 16 10:13:54 user nova-compute[85141]:     <rng model="virtio">
Nov 16 10:13:54 user nova-compute[85141]:       <backend model="random">/dev/urandom</backend>
Nov 16 10:13:54 user nova-compute[85141]:     </rng>
Nov 16 10:13:54 user nova-compute[85141]:     <controller type="usb" index="0" model="none"/>
Nov 16 10:13:54 user nova-compute[85141]:     <memballoon model="virtio">
Nov 16 10:13:54 user nova-compute[85141]:       <stats period="10"/>
Nov 16 10:13:54 user nova-compute[85141]:     </memballoon>
Nov 16 10:13:54 user nova-compute[85141]:   </devices>
Nov 16 10:13:54 user nova-compute[85141]: </domain>
Nov 16 10:13:54 user nova-compute[85141]:  {{(pid=85141) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 10:13:54 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-67958a81-2524-4b4a-b036-7822671f7735 tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T10:13:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1721502885',display_name='tempest-VolumesActionsTest-instance-1721502885',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1721502885',id=16,image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b35983b98d3c404d8cddce2894f97dba',ramdisk_id='',reservation_id='r-ka3o6fwg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1337688058',owner_user_name='tempest-VolumesActionsTest-1337688058-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T10:13:53Z,user_data=None,user_id='3b83d10371214ba68a125f52df7e33ad',uuid=65168899-e7c2-4dea-9257-7490ab994939,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "814b06ff-29a7-4402-92dd-e2a1b60b782a", "address": "fa:16:3e:f5:e3:cf", "network": {"id": "20b79aa8-c67e-4ab4-aa9f-659587f8bcb2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1635312124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b35983b98d3c404d8cddce2894f97dba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap814b06ff-29", "ovs_interfaceid": "814b06ff-29a7-4402-92dd-e2a1b60b782a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 10:13:54 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-67958a81-2524-4b4a-b036-7822671f7735 tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] Converting VIF {"id": "814b06ff-29a7-4402-92dd-e2a1b60b782a", "address": "fa:16:3e:f5:e3:cf", "network": {"id": "20b79aa8-c67e-4ab4-aa9f-659587f8bcb2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1635312124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b35983b98d3c404d8cddce2894f97dba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap814b06ff-29", "ovs_interfaceid": "814b06ff-29a7-4402-92dd-e2a1b60b782a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:13:54 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-67958a81-2524-4b4a-b036-7822671f7735 tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:e3:cf,bridge_name='br-int',has_traffic_filtering=True,id=814b06ff-29a7-4402-92dd-e2a1b60b782a,network=Network(20b79aa8-c67e-4ab4-aa9f-659587f8bcb2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap814b06ff-29') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:13:54 user nova-compute[85141]: DEBUG os_vif [None req-67958a81-2524-4b4a-b036-7822671f7735 tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:e3:cf,bridge_name='br-int',has_traffic_filtering=True,id=814b06ff-29a7-4402-92dd-e2a1b60b782a,network=Network(20b79aa8-c67e-4ab4-aa9f-659587f8bcb2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap814b06ff-29') {{(pid=85141) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 10:13:54 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:13:54 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:13:54 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 10:13:54 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:13:54 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2581e564-05b4-5b95-82cf-706b0f8ab624', '_type': 'linux-noop'}}, row=False) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:13:54 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:13:54 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:13:54 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:13:54 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap814b06ff-29, may_exist=True, interface_attrs={}) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:13:54 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap814b06ff-29, col_values=(('qos', UUID('f4a1564d-952a-4e1d-a87c-972f4dacc114')),), if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:13:54 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap814b06ff-29, col_values=(('external_ids', {'iface-id': '814b06ff-29a7-4402-92dd-e2a1b60b782a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f5:e3:cf', 'vm-uuid': '65168899-e7c2-4dea-9257-7490ab994939'}),), if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:13:54 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:13:54 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:13:54 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:13:54 user nova-compute[85141]: INFO os_vif [None req-67958a81-2524-4b4a-b036-7822671f7735 tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:e3:cf,bridge_name='br-int',has_traffic_filtering=True,id=814b06ff-29a7-4402-92dd-e2a1b60b782a,network=Network(20b79aa8-c67e-4ab4-aa9f-659587f8bcb2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap814b06ff-29')
Nov 16 10:13:54 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-67958a81-2524-4b4a-b036-7822671f7735 tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] No BDM found with device name vda, not building metadata. {{(pid=85141) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 10:13:54 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-67958a81-2524-4b4a-b036-7822671f7735 tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] No VIF found with MAC fa:16:3e:f5:e3:cf, not building metadata {{(pid=85141) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 10:13:54 user nova-compute[85141]: DEBUG nova.network.neutron [req-c629679a-6b29-4b86-bdc3-d28b4f273274 req-5b0ccf73-c40f-46f1-bc6f-fd11679da577 service nova] [instance: 65168899-e7c2-4dea-9257-7490ab994939] Updated VIF entry in instance network info cache for port 814b06ff-29a7-4402-92dd-e2a1b60b782a. {{(pid=85141) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 10:13:54 user nova-compute[85141]: DEBUG nova.network.neutron [req-c629679a-6b29-4b86-bdc3-d28b4f273274 req-5b0ccf73-c40f-46f1-bc6f-fd11679da577 service nova] [instance: 65168899-e7c2-4dea-9257-7490ab994939] Updating instance_info_cache with network_info: [{"id": "814b06ff-29a7-4402-92dd-e2a1b60b782a", "address": "fa:16:3e:f5:e3:cf", "network": {"id": "20b79aa8-c67e-4ab4-aa9f-659587f8bcb2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1635312124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b35983b98d3c404d8cddce2894f97dba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap814b06ff-29", "ovs_interfaceid": "814b06ff-29a7-4402-92dd-e2a1b60b782a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:13:54 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-c629679a-6b29-4b86-bdc3-d28b4f273274 req-5b0ccf73-c40f-46f1-bc6f-fd11679da577 service nova] Releasing lock "refresh_cache-65168899-e7c2-4dea-9257-7490ab994939" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:13:55 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:13:55 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:13:55 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:13:55 user nova-compute[85141]: DEBUG nova.compute.manager [req-1902e2e0-36fe-4fad-8f59-edd988264417 req-937761a8-7f6c-412a-82de-004334c01a00 service nova] [instance: 65168899-e7c2-4dea-9257-7490ab994939] Received event network-vif-plugged-814b06ff-29a7-4402-92dd-e2a1b60b782a {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:13:55 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-1902e2e0-36fe-4fad-8f59-edd988264417 req-937761a8-7f6c-412a-82de-004334c01a00 service nova] Acquiring lock "65168899-e7c2-4dea-9257-7490ab994939-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:13:55 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-1902e2e0-36fe-4fad-8f59-edd988264417 req-937761a8-7f6c-412a-82de-004334c01a00 service nova] Lock "65168899-e7c2-4dea-9257-7490ab994939-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:13:55 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-1902e2e0-36fe-4fad-8f59-edd988264417 req-937761a8-7f6c-412a-82de-004334c01a00 service nova] Lock "65168899-e7c2-4dea-9257-7490ab994939-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:13:55 user nova-compute[85141]: DEBUG nova.compute.manager [req-1902e2e0-36fe-4fad-8f59-edd988264417 req-937761a8-7f6c-412a-82de-004334c01a00 service nova] [instance: 65168899-e7c2-4dea-9257-7490ab994939] No waiting events found dispatching network-vif-plugged-814b06ff-29a7-4402-92dd-e2a1b60b782a {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:13:55 user nova-compute[85141]: WARNING nova.compute.manager [req-1902e2e0-36fe-4fad-8f59-edd988264417 req-937761a8-7f6c-412a-82de-004334c01a00 service nova] [instance: 65168899-e7c2-4dea-9257-7490ab994939] Received unexpected event network-vif-plugged-814b06ff-29a7-4402-92dd-e2a1b60b782a for instance with vm_state building and task_state spawning.
Nov 16 10:13:56 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:13:56 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:13:56 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:13:56 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:13:57 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:13:57 user nova-compute[85141]: DEBUG nova.compute.manager [None req-67958a81-2524-4b4a-b036-7822671f7735 tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] [instance: 65168899-e7c2-4dea-9257-7490ab994939] Instance event wait completed in 0 seconds for  {{(pid=85141) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 10:13:57 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-67958a81-2524-4b4a-b036-7822671f7735 tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] [instance: 65168899-e7c2-4dea-9257-7490ab994939] Guest created on hypervisor {{(pid=85141) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 10:13:57 user nova-compute[85141]: INFO nova.virt.libvirt.driver [-] [instance: 65168899-e7c2-4dea-9257-7490ab994939] Instance spawned successfully.
Nov 16 10:13:57 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-67958a81-2524-4b4a-b036-7822671f7735 tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] [instance: 65168899-e7c2-4dea-9257-7490ab994939] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 10:13:57 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-67958a81-2524-4b4a-b036-7822671f7735 tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] [instance: 65168899-e7c2-4dea-9257-7490ab994939] Found default for hw_cdrom_bus of ide {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:13:57 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-67958a81-2524-4b4a-b036-7822671f7735 tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] [instance: 65168899-e7c2-4dea-9257-7490ab994939] Found default for hw_disk_bus of virtio {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:13:57 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-67958a81-2524-4b4a-b036-7822671f7735 tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] [instance: 65168899-e7c2-4dea-9257-7490ab994939] Found default for hw_input_bus of None {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:13:57 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-67958a81-2524-4b4a-b036-7822671f7735 tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] [instance: 65168899-e7c2-4dea-9257-7490ab994939] Found default for hw_pointer_model of None {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:13:57 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-67958a81-2524-4b4a-b036-7822671f7735 tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] [instance: 65168899-e7c2-4dea-9257-7490ab994939] Found default for hw_video_model of virtio {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:13:57 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-67958a81-2524-4b4a-b036-7822671f7735 tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] [instance: 65168899-e7c2-4dea-9257-7490ab994939] Found default for hw_vif_model of virtio {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:13:57 user nova-compute[85141]: DEBUG nova.compute.manager [req-9096a5e1-ce09-4b49-9a94-121ec79c0e43 req-706020d2-7185-4af7-845c-e23d590db543 service nova] [instance: 65168899-e7c2-4dea-9257-7490ab994939] Received event network-vif-plugged-814b06ff-29a7-4402-92dd-e2a1b60b782a {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:13:57 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-9096a5e1-ce09-4b49-9a94-121ec79c0e43 req-706020d2-7185-4af7-845c-e23d590db543 service nova] Acquiring lock "65168899-e7c2-4dea-9257-7490ab994939-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:13:57 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-9096a5e1-ce09-4b49-9a94-121ec79c0e43 req-706020d2-7185-4af7-845c-e23d590db543 service nova] Lock "65168899-e7c2-4dea-9257-7490ab994939-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:13:57 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-9096a5e1-ce09-4b49-9a94-121ec79c0e43 req-706020d2-7185-4af7-845c-e23d590db543 service nova] Lock "65168899-e7c2-4dea-9257-7490ab994939-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:13:57 user nova-compute[85141]: DEBUG nova.compute.manager [req-9096a5e1-ce09-4b49-9a94-121ec79c0e43 req-706020d2-7185-4af7-845c-e23d590db543 service nova] [instance: 65168899-e7c2-4dea-9257-7490ab994939] No waiting events found dispatching network-vif-plugged-814b06ff-29a7-4402-92dd-e2a1b60b782a {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:13:57 user nova-compute[85141]: WARNING nova.compute.manager [req-9096a5e1-ce09-4b49-9a94-121ec79c0e43 req-706020d2-7185-4af7-845c-e23d590db543 service nova] [instance: 65168899-e7c2-4dea-9257-7490ab994939] Received unexpected event network-vif-plugged-814b06ff-29a7-4402-92dd-e2a1b60b782a for instance with vm_state building and task_state spawning.
Nov 16 10:13:58 user nova-compute[85141]: INFO nova.compute.manager [None req-67958a81-2524-4b4a-b036-7822671f7735 tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] [instance: 65168899-e7c2-4dea-9257-7490ab994939] Took 5.24 seconds to spawn the instance on the hypervisor.
Nov 16 10:13:58 user nova-compute[85141]: DEBUG nova.compute.manager [None req-67958a81-2524-4b4a-b036-7822671f7735 tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] [instance: 65168899-e7c2-4dea-9257-7490ab994939] Checking state {{(pid=85141) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 10:13:58 user nova-compute[85141]: INFO nova.compute.manager [None req-67958a81-2524-4b4a-b036-7822671f7735 tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] [instance: 65168899-e7c2-4dea-9257-7490ab994939] Took 6.24 seconds to build instance.
Nov 16 10:13:58 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-67958a81-2524-4b4a-b036-7822671f7735 tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] Lock "65168899-e7c2-4dea-9257-7490ab994939" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.343s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:13:59 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:14:00 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5324d302-dae4-4006-a326-9fd821f39dc3 tempest-VolumesAssistedSnapshotsTest-1194404756 tempest-VolumesAssistedSnapshotsTest-1194404756-project-member] Acquiring lock "7e2ae11f-161c-4d13-a1a5-37d0a8150e6b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:14:00 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5324d302-dae4-4006-a326-9fd821f39dc3 tempest-VolumesAssistedSnapshotsTest-1194404756 tempest-VolumesAssistedSnapshotsTest-1194404756-project-member] Lock "7e2ae11f-161c-4d13-a1a5-37d0a8150e6b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:14:00 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5324d302-dae4-4006-a326-9fd821f39dc3 tempest-VolumesAssistedSnapshotsTest-1194404756 tempest-VolumesAssistedSnapshotsTest-1194404756-project-member] Acquiring lock "7e2ae11f-161c-4d13-a1a5-37d0a8150e6b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:14:00 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5324d302-dae4-4006-a326-9fd821f39dc3 tempest-VolumesAssistedSnapshotsTest-1194404756 tempest-VolumesAssistedSnapshotsTest-1194404756-project-member] Lock "7e2ae11f-161c-4d13-a1a5-37d0a8150e6b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:14:00 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5324d302-dae4-4006-a326-9fd821f39dc3 tempest-VolumesAssistedSnapshotsTest-1194404756 tempest-VolumesAssistedSnapshotsTest-1194404756-project-member] Lock "7e2ae11f-161c-4d13-a1a5-37d0a8150e6b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:14:00 user nova-compute[85141]: INFO nova.compute.manager [None req-5324d302-dae4-4006-a326-9fd821f39dc3 tempest-VolumesAssistedSnapshotsTest-1194404756 tempest-VolumesAssistedSnapshotsTest-1194404756-project-member] [instance: 7e2ae11f-161c-4d13-a1a5-37d0a8150e6b] Terminating instance
Nov 16 10:14:00 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5324d302-dae4-4006-a326-9fd821f39dc3 tempest-VolumesAssistedSnapshotsTest-1194404756 tempest-VolumesAssistedSnapshotsTest-1194404756-project-member] [instance: 7e2ae11f-161c-4d13-a1a5-37d0a8150e6b] Start destroying the instance on the hypervisor. {{(pid=85141) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 10:14:00 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:14:00 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:14:00 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:14:01 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:14:01 user nova-compute[85141]: DEBUG nova.compute.manager [req-fa52298c-ed5a-44f6-b89c-2c822e446ee3 req-8bd63ad1-071d-42ba-bba2-f9a5f59f4efc service nova] [instance: 7e2ae11f-161c-4d13-a1a5-37d0a8150e6b] Received event network-vif-unplugged-f7b5e797-8f96-4f01-847a-4a5b4f208517 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:14:01 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-fa52298c-ed5a-44f6-b89c-2c822e446ee3 req-8bd63ad1-071d-42ba-bba2-f9a5f59f4efc service nova] Acquiring lock "7e2ae11f-161c-4d13-a1a5-37d0a8150e6b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:14:01 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-fa52298c-ed5a-44f6-b89c-2c822e446ee3 req-8bd63ad1-071d-42ba-bba2-f9a5f59f4efc service nova] Lock "7e2ae11f-161c-4d13-a1a5-37d0a8150e6b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:14:01 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-fa52298c-ed5a-44f6-b89c-2c822e446ee3 req-8bd63ad1-071d-42ba-bba2-f9a5f59f4efc service nova] Lock "7e2ae11f-161c-4d13-a1a5-37d0a8150e6b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:14:01 user nova-compute[85141]: DEBUG nova.compute.manager [req-fa52298c-ed5a-44f6-b89c-2c822e446ee3 req-8bd63ad1-071d-42ba-bba2-f9a5f59f4efc service nova] [instance: 7e2ae11f-161c-4d13-a1a5-37d0a8150e6b] No waiting events found dispatching network-vif-unplugged-f7b5e797-8f96-4f01-847a-4a5b4f208517 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:14:01 user nova-compute[85141]: DEBUG nova.compute.manager [req-fa52298c-ed5a-44f6-b89c-2c822e446ee3 req-8bd63ad1-071d-42ba-bba2-f9a5f59f4efc service nova] [instance: 7e2ae11f-161c-4d13-a1a5-37d0a8150e6b] Received event network-vif-unplugged-f7b5e797-8f96-4f01-847a-4a5b4f208517 for instance with task_state deleting. {{(pid=85141) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 10:14:01 user nova-compute[85141]: INFO nova.virt.libvirt.driver [-] [instance: 7e2ae11f-161c-4d13-a1a5-37d0a8150e6b] Instance destroyed successfully.
Nov 16 10:14:01 user nova-compute[85141]: DEBUG nova.objects.instance [None req-5324d302-dae4-4006-a326-9fd821f39dc3 tempest-VolumesAssistedSnapshotsTest-1194404756 tempest-VolumesAssistedSnapshotsTest-1194404756-project-member] Lazy-loading 'resources' on Instance uuid 7e2ae11f-161c-4d13-a1a5-37d0a8150e6b {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:14:01 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-5324d302-dae4-4006-a326-9fd821f39dc3 tempest-VolumesAssistedSnapshotsTest-1194404756 tempest-VolumesAssistedSnapshotsTest-1194404756-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T10:11:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1727033461',display_name='tempest-VolumesAssistedSnapshotsTest-server-1727033461',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1727033461',id=10,image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPJD5N2/p/YVuiEwS9IzLhhuaVrUAVb11B8xciFRiRrkU/71b5ORWId8A3/QMTsYQ3ond2lviwdEp8K1zjCYG9YkpItcxQIwIRhY1S69RYaXfYuOfCAaIotncX9ZJsmN5Q==',key_name='tempest-keypair-545798210',keypairs=<?>,launch_index=0,launched_at=2023-11-16T10:11:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2177d3304c7741efb82eca1323f27f92',ramdisk_id='',reservation_id='r-jkudhevx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1194404756',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1194404756-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T10:11:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eae4e8c6a7e442cb907448b29c07befb',uuid=7e2ae11f-161c-4d13-a1a5-37d0a8150e6b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f7b5e797-8f96-4f01-847a-4a5b4f208517", "address": "fa:16:3e:19:6f:78", "network": {"id": "11563c56-f3fc-41db-a612-aa4e06a845ec", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1298866398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2177d3304c7741efb82eca1323f27f92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7b5e797-8f", "ovs_interfaceid": "f7b5e797-8f96-4f01-847a-4a5b4f208517", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 10:14:01 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-5324d302-dae4-4006-a326-9fd821f39dc3 tempest-VolumesAssistedSnapshotsTest-1194404756 tempest-VolumesAssistedSnapshotsTest-1194404756-project-member] Converting VIF {"id": "f7b5e797-8f96-4f01-847a-4a5b4f208517", "address": "fa:16:3e:19:6f:78", "network": {"id": "11563c56-f3fc-41db-a612-aa4e06a845ec", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1298866398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2177d3304c7741efb82eca1323f27f92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7b5e797-8f", "ovs_interfaceid": "f7b5e797-8f96-4f01-847a-4a5b4f208517", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:14:01 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-5324d302-dae4-4006-a326-9fd821f39dc3 tempest-VolumesAssistedSnapshotsTest-1194404756 tempest-VolumesAssistedSnapshotsTest-1194404756-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:19:6f:78,bridge_name='br-int',has_traffic_filtering=True,id=f7b5e797-8f96-4f01-847a-4a5b4f208517,network=Network(11563c56-f3fc-41db-a612-aa4e06a845ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7b5e797-8f') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:14:01 user nova-compute[85141]: DEBUG os_vif [None req-5324d302-dae4-4006-a326-9fd821f39dc3 tempest-VolumesAssistedSnapshotsTest-1194404756 tempest-VolumesAssistedSnapshotsTest-1194404756-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:19:6f:78,bridge_name='br-int',has_traffic_filtering=True,id=f7b5e797-8f96-4f01-847a-4a5b4f208517,network=Network(11563c56-f3fc-41db-a612-aa4e06a845ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7b5e797-8f') {{(pid=85141) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 10:14:01 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:14:01 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf7b5e797-8f, bridge=br-int, if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:14:01 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:14:01 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:14:01 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:14:01 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=315d5f01-d8da-44d8-99ae-f77d35278d6a) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:14:01 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:14:01 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:14:01 user nova-compute[85141]: INFO os_vif [None req-5324d302-dae4-4006-a326-9fd821f39dc3 tempest-VolumesAssistedSnapshotsTest-1194404756 tempest-VolumesAssistedSnapshotsTest-1194404756-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:19:6f:78,bridge_name='br-int',has_traffic_filtering=True,id=f7b5e797-8f96-4f01-847a-4a5b4f208517,network=Network(11563c56-f3fc-41db-a612-aa4e06a845ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7b5e797-8f')
Nov 16 10:14:01 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-5324d302-dae4-4006-a326-9fd821f39dc3 tempest-VolumesAssistedSnapshotsTest-1194404756 tempest-VolumesAssistedSnapshotsTest-1194404756-project-member] [instance: 7e2ae11f-161c-4d13-a1a5-37d0a8150e6b] Deleting instance files /opt/stack/data/nova/instances/7e2ae11f-161c-4d13-a1a5-37d0a8150e6b_del
Nov 16 10:14:01 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-5324d302-dae4-4006-a326-9fd821f39dc3 tempest-VolumesAssistedSnapshotsTest-1194404756 tempest-VolumesAssistedSnapshotsTest-1194404756-project-member] [instance: 7e2ae11f-161c-4d13-a1a5-37d0a8150e6b] Deletion of /opt/stack/data/nova/instances/7e2ae11f-161c-4d13-a1a5-37d0a8150e6b_del complete
Nov 16 10:14:01 user nova-compute[85141]: INFO nova.compute.manager [None req-5324d302-dae4-4006-a326-9fd821f39dc3 tempest-VolumesAssistedSnapshotsTest-1194404756 tempest-VolumesAssistedSnapshotsTest-1194404756-project-member] [instance: 7e2ae11f-161c-4d13-a1a5-37d0a8150e6b] Took 0.91 seconds to destroy the instance on the hypervisor.
Nov 16 10:14:01 user nova-compute[85141]: DEBUG oslo.service.loopingcall [None req-5324d302-dae4-4006-a326-9fd821f39dc3 tempest-VolumesAssistedSnapshotsTest-1194404756 tempest-VolumesAssistedSnapshotsTest-1194404756-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=85141) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 10:14:01 user nova-compute[85141]: DEBUG nova.compute.manager [-] [instance: 7e2ae11f-161c-4d13-a1a5-37d0a8150e6b] Deallocating network for instance {{(pid=85141) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 10:14:01 user nova-compute[85141]: DEBUG nova.network.neutron [-] [instance: 7e2ae11f-161c-4d13-a1a5-37d0a8150e6b] deallocate_for_instance() {{(pid=85141) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 10:14:02 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:14:02 user nova-compute[85141]: DEBUG nova.network.neutron [-] [instance: 7e2ae11f-161c-4d13-a1a5-37d0a8150e6b] Updating instance_info_cache with network_info: [] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:14:02 user nova-compute[85141]: INFO nova.compute.manager [-] [instance: 7e2ae11f-161c-4d13-a1a5-37d0a8150e6b] Took 0.78 seconds to deallocate network for instance.
Nov 16 10:14:02 user nova-compute[85141]: DEBUG nova.compute.manager [req-bb253e32-9d7a-49ae-9929-aba9cf4bcbec req-bfea850a-fb65-49a3-8975-68d970f62161 service nova] [instance: 7e2ae11f-161c-4d13-a1a5-37d0a8150e6b] Received event network-vif-deleted-f7b5e797-8f96-4f01-847a-4a5b4f208517 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:14:02 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5324d302-dae4-4006-a326-9fd821f39dc3 tempest-VolumesAssistedSnapshotsTest-1194404756 tempest-VolumesAssistedSnapshotsTest-1194404756-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:14:02 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5324d302-dae4-4006-a326-9fd821f39dc3 tempest-VolumesAssistedSnapshotsTest-1194404756 tempest-VolumesAssistedSnapshotsTest-1194404756-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:14:02 user nova-compute[85141]: DEBUG nova.compute.provider_tree [None req-5324d302-dae4-4006-a326-9fd821f39dc3 tempest-VolumesAssistedSnapshotsTest-1194404756 tempest-VolumesAssistedSnapshotsTest-1194404756-project-member] Inventory has not changed in ProviderTree for provider: bf8e0fa1-16b6-408f-9203-c4cd63916272 {{(pid=85141) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 10:14:02 user nova-compute[85141]: DEBUG nova.scheduler.client.report [None req-5324d302-dae4-4006-a326-9fd821f39dc3 tempest-VolumesAssistedSnapshotsTest-1194404756 tempest-VolumesAssistedSnapshotsTest-1194404756-project-member] Inventory has not changed for provider bf8e0fa1-16b6-408f-9203-c4cd63916272 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=85141) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 10:14:02 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5324d302-dae4-4006-a326-9fd821f39dc3 tempest-VolumesAssistedSnapshotsTest-1194404756 tempest-VolumesAssistedSnapshotsTest-1194404756-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.385s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:14:03 user nova-compute[85141]: INFO nova.scheduler.client.report [None req-5324d302-dae4-4006-a326-9fd821f39dc3 tempest-VolumesAssistedSnapshotsTest-1194404756 tempest-VolumesAssistedSnapshotsTest-1194404756-project-member] Deleted allocations for instance 7e2ae11f-161c-4d13-a1a5-37d0a8150e6b
Nov 16 10:14:03 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5324d302-dae4-4006-a326-9fd821f39dc3 tempest-VolumesAssistedSnapshotsTest-1194404756 tempest-VolumesAssistedSnapshotsTest-1194404756-project-member] Lock "7e2ae11f-161c-4d13-a1a5-37d0a8150e6b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.259s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:14:03 user nova-compute[85141]: DEBUG nova.compute.manager [req-fb2dfc93-f8e7-4641-8501-35c06c2f24ca req-a481cc16-3aae-4d36-a2bc-0e4f8966fc17 service nova] [instance: 7e2ae11f-161c-4d13-a1a5-37d0a8150e6b] Received event network-vif-plugged-f7b5e797-8f96-4f01-847a-4a5b4f208517 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:14:03 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-fb2dfc93-f8e7-4641-8501-35c06c2f24ca req-a481cc16-3aae-4d36-a2bc-0e4f8966fc17 service nova] Acquiring lock "7e2ae11f-161c-4d13-a1a5-37d0a8150e6b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:14:03 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-fb2dfc93-f8e7-4641-8501-35c06c2f24ca req-a481cc16-3aae-4d36-a2bc-0e4f8966fc17 service nova] Lock "7e2ae11f-161c-4d13-a1a5-37d0a8150e6b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:14:03 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-fb2dfc93-f8e7-4641-8501-35c06c2f24ca req-a481cc16-3aae-4d36-a2bc-0e4f8966fc17 service nova] Lock "7e2ae11f-161c-4d13-a1a5-37d0a8150e6b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:14:03 user nova-compute[85141]: DEBUG nova.compute.manager [req-fb2dfc93-f8e7-4641-8501-35c06c2f24ca req-a481cc16-3aae-4d36-a2bc-0e4f8966fc17 service nova] [instance: 7e2ae11f-161c-4d13-a1a5-37d0a8150e6b] No waiting events found dispatching network-vif-plugged-f7b5e797-8f96-4f01-847a-4a5b4f208517 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:14:03 user nova-compute[85141]: WARNING nova.compute.manager [req-fb2dfc93-f8e7-4641-8501-35c06c2f24ca req-a481cc16-3aae-4d36-a2bc-0e4f8966fc17 service nova] [instance: 7e2ae11f-161c-4d13-a1a5-37d0a8150e6b] Received unexpected event network-vif-plugged-f7b5e797-8f96-4f01-847a-4a5b4f208517 for instance with vm_state deleted and task_state None.
Nov 16 10:14:06 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:14:07 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:14:11 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:14:12 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:14:12 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-c2b02df8-3943-4670-8481-0b5ab718b006 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] Acquiring lock "0ca61bd2-268e-4c49-ba04-a5cb39143a9b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:14:12 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-c2b02df8-3943-4670-8481-0b5ab718b006 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] Lock "0ca61bd2-268e-4c49-ba04-a5cb39143a9b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:14:12 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-c2b02df8-3943-4670-8481-0b5ab718b006 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] Acquiring lock "0ca61bd2-268e-4c49-ba04-a5cb39143a9b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:14:12 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-c2b02df8-3943-4670-8481-0b5ab718b006 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] Lock "0ca61bd2-268e-4c49-ba04-a5cb39143a9b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:14:12 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-c2b02df8-3943-4670-8481-0b5ab718b006 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] Lock "0ca61bd2-268e-4c49-ba04-a5cb39143a9b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:14:12 user nova-compute[85141]: INFO nova.compute.manager [None req-c2b02df8-3943-4670-8481-0b5ab718b006 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] [instance: 0ca61bd2-268e-4c49-ba04-a5cb39143a9b] Terminating instance
Nov 16 10:14:12 user nova-compute[85141]: DEBUG nova.compute.manager [None req-c2b02df8-3943-4670-8481-0b5ab718b006 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] [instance: 0ca61bd2-268e-4c49-ba04-a5cb39143a9b] Start destroying the instance on the hypervisor. {{(pid=85141) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 10:14:12 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:14:12 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:14:12 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:14:12 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:14:13 user nova-compute[85141]: DEBUG nova.compute.manager [req-568800aa-f67c-4ab6-9b64-9bf8f4fd13b6 req-7770b3d1-aa65-4092-9cc7-e84227d131d0 service nova] [instance: 0ca61bd2-268e-4c49-ba04-a5cb39143a9b] Received event network-vif-unplugged-56375501-2a9c-4821-8446-31156fc0f231 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:14:13 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-568800aa-f67c-4ab6-9b64-9bf8f4fd13b6 req-7770b3d1-aa65-4092-9cc7-e84227d131d0 service nova] Acquiring lock "0ca61bd2-268e-4c49-ba04-a5cb39143a9b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:14:13 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-568800aa-f67c-4ab6-9b64-9bf8f4fd13b6 req-7770b3d1-aa65-4092-9cc7-e84227d131d0 service nova] Lock "0ca61bd2-268e-4c49-ba04-a5cb39143a9b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:14:13 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-568800aa-f67c-4ab6-9b64-9bf8f4fd13b6 req-7770b3d1-aa65-4092-9cc7-e84227d131d0 service nova] Lock "0ca61bd2-268e-4c49-ba04-a5cb39143a9b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:14:13 user nova-compute[85141]: DEBUG nova.compute.manager [req-568800aa-f67c-4ab6-9b64-9bf8f4fd13b6 req-7770b3d1-aa65-4092-9cc7-e84227d131d0 service nova] [instance: 0ca61bd2-268e-4c49-ba04-a5cb39143a9b] No waiting events found dispatching network-vif-unplugged-56375501-2a9c-4821-8446-31156fc0f231 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:14:13 user nova-compute[85141]: DEBUG nova.compute.manager [req-568800aa-f67c-4ab6-9b64-9bf8f4fd13b6 req-7770b3d1-aa65-4092-9cc7-e84227d131d0 service nova] [instance: 0ca61bd2-268e-4c49-ba04-a5cb39143a9b] Received event network-vif-unplugged-56375501-2a9c-4821-8446-31156fc0f231 for instance with task_state deleting. {{(pid=85141) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 10:14:13 user nova-compute[85141]: INFO nova.virt.libvirt.driver [-] [instance: 0ca61bd2-268e-4c49-ba04-a5cb39143a9b] Instance destroyed successfully.
Nov 16 10:14:13 user nova-compute[85141]: DEBUG nova.objects.instance [None req-c2b02df8-3943-4670-8481-0b5ab718b006 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] Lazy-loading 'resources' on Instance uuid 0ca61bd2-268e-4c49-ba04-a5cb39143a9b {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:14:13 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-c2b02df8-3943-4670-8481-0b5ab718b006 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T10:10:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-716916570',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-716916570',id=8,image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLJjo671Ow+Mmgs0Sg26Qz/3lV+acwH0zhTjdI/jAzpHJeJFVSCAeG6lSBMe0VPCPV8jS6nF17VjHRJ+udtegobTbD+V4E/SBllDlIvaieW2o7QXUoKkfv8rtxZTi+1HzQ==',key_name='tempest-keypair-612763063',keypairs=<?>,launch_index=0,launched_at=2023-11-16T10:11:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b9317f5645af406c899fcc5df61362bb',ramdisk_id='',reservation_id='r-xpla73zu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1293058027',owner_user_name='tempest-TaggedAttachmentsTest-1293058027-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T10:11:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8734a61ff9fb4e14b1b542b8ecdfdeec',uuid=0ca61bd2-268e-4c49-ba04-a5cb39143a9b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "56375501-2a9c-4821-8446-31156fc0f231", "address": "fa:16:3e:12:0a:da", "network": {"id": "cd9a5383-79fc-4957-9a8e-30a18ac26969", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1797454995-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9317f5645af406c899fcc5df61362bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56375501-2a", "ovs_interfaceid": "56375501-2a9c-4821-8446-31156fc0f231", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 10:14:13 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-c2b02df8-3943-4670-8481-0b5ab718b006 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] Converting VIF {"id": "56375501-2a9c-4821-8446-31156fc0f231", "address": "fa:16:3e:12:0a:da", "network": {"id": "cd9a5383-79fc-4957-9a8e-30a18ac26969", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1797454995-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9317f5645af406c899fcc5df61362bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56375501-2a", "ovs_interfaceid": "56375501-2a9c-4821-8446-31156fc0f231", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:14:13 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-c2b02df8-3943-4670-8481-0b5ab718b006 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:12:0a:da,bridge_name='br-int',has_traffic_filtering=True,id=56375501-2a9c-4821-8446-31156fc0f231,network=Network(cd9a5383-79fc-4957-9a8e-30a18ac26969),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56375501-2a') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:14:13 user nova-compute[85141]: DEBUG os_vif [None req-c2b02df8-3943-4670-8481-0b5ab718b006 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:12:0a:da,bridge_name='br-int',has_traffic_filtering=True,id=56375501-2a9c-4821-8446-31156fc0f231,network=Network(cd9a5383-79fc-4957-9a8e-30a18ac26969),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56375501-2a') {{(pid=85141) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 10:14:13 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:14:13 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap56375501-2a, bridge=br-int, if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:14:13 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:14:13 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:14:13 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:14:13 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8596c49d-cb79-464d-86d6-2a0fcab7deba) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:14:13 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:14:13 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:14:13 user nova-compute[85141]: INFO os_vif [None req-c2b02df8-3943-4670-8481-0b5ab718b006 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:12:0a:da,bridge_name='br-int',has_traffic_filtering=True,id=56375501-2a9c-4821-8446-31156fc0f231,network=Network(cd9a5383-79fc-4957-9a8e-30a18ac26969),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56375501-2a')
Nov 16 10:14:13 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-c2b02df8-3943-4670-8481-0b5ab718b006 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] [instance: 0ca61bd2-268e-4c49-ba04-a5cb39143a9b] Deleting instance files /opt/stack/data/nova/instances/0ca61bd2-268e-4c49-ba04-a5cb39143a9b_del
Nov 16 10:14:13 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-c2b02df8-3943-4670-8481-0b5ab718b006 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] [instance: 0ca61bd2-268e-4c49-ba04-a5cb39143a9b] Deletion of /opt/stack/data/nova/instances/0ca61bd2-268e-4c49-ba04-a5cb39143a9b_del complete
Nov 16 10:14:13 user nova-compute[85141]: INFO nova.compute.manager [None req-c2b02df8-3943-4670-8481-0b5ab718b006 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] [instance: 0ca61bd2-268e-4c49-ba04-a5cb39143a9b] Took 1.07 seconds to destroy the instance on the hypervisor.
Nov 16 10:14:13 user nova-compute[85141]: DEBUG oslo.service.loopingcall [None req-c2b02df8-3943-4670-8481-0b5ab718b006 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=85141) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 10:14:13 user nova-compute[85141]: DEBUG nova.compute.manager [-] [instance: 0ca61bd2-268e-4c49-ba04-a5cb39143a9b] Deallocating network for instance {{(pid=85141) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 10:14:13 user nova-compute[85141]: DEBUG nova.network.neutron [-] [instance: 0ca61bd2-268e-4c49-ba04-a5cb39143a9b] deallocate_for_instance() {{(pid=85141) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 10:14:14 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-8c2d6146-e2e0-4a6d-9b74-efabd2b688bf tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Acquiring lock "e65ccf79-718d-4eeb-8914-f0db2e2c9ce2" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:14:14 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-8c2d6146-e2e0-4a6d-9b74-efabd2b688bf tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Lock "e65ccf79-718d-4eeb-8914-f0db2e2c9ce2" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:14:14 user nova-compute[85141]: DEBUG nova.objects.instance [None req-8c2d6146-e2e0-4a6d-9b74-efabd2b688bf tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Lazy-loading 'flavor' on Instance uuid e65ccf79-718d-4eeb-8914-f0db2e2c9ce2 {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:14:14 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-8c2d6146-e2e0-4a6d-9b74-efabd2b688bf tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Lock "e65ccf79-718d-4eeb-8914-f0db2e2c9ce2" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.073s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:14:14 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-ed8ee849-9f8b-4b00-a2c1-9551fad4909c tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Acquiring lock "9411843f-4e79-46c4-ae02-01f5e87b86eb" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:14:14 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-ed8ee849-9f8b-4b00-a2c1-9551fad4909c tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Lock "9411843f-4e79-46c4-ae02-01f5e87b86eb" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:14:14 user nova-compute[85141]: INFO nova.compute.manager [None req-ed8ee849-9f8b-4b00-a2c1-9551fad4909c tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] [instance: 9411843f-4e79-46c4-ae02-01f5e87b86eb] Unshelving
Nov 16 10:14:14 user nova-compute[85141]: DEBUG nova.network.neutron [-] [instance: 0ca61bd2-268e-4c49-ba04-a5cb39143a9b] Updating instance_info_cache with network_info: [] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:14:14 user nova-compute[85141]: INFO nova.compute.manager [-] [instance: 0ca61bd2-268e-4c49-ba04-a5cb39143a9b] Took 0.99 seconds to deallocate network for instance.
Nov 16 10:14:14 user nova-compute[85141]: DEBUG nova.compute.manager [req-bc28a2f1-a634-4d69-ad18-ddf8b79eb73b req-5e2712af-40c4-4241-ad5c-d06707be3923 service nova] [instance: 0ca61bd2-268e-4c49-ba04-a5cb39143a9b] Received event network-vif-deleted-56375501-2a9c-4821-8446-31156fc0f231 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:14:14 user nova-compute[85141]: INFO nova.compute.manager [req-bc28a2f1-a634-4d69-ad18-ddf8b79eb73b req-5e2712af-40c4-4241-ad5c-d06707be3923 service nova] [instance: 0ca61bd2-268e-4c49-ba04-a5cb39143a9b] Neutron deleted interface 56375501-2a9c-4821-8446-31156fc0f231; detaching it from the instance and deleting it from the info cache
Nov 16 10:14:14 user nova-compute[85141]: DEBUG nova.network.neutron [req-bc28a2f1-a634-4d69-ad18-ddf8b79eb73b req-5e2712af-40c4-4241-ad5c-d06707be3923 service nova] [instance: 0ca61bd2-268e-4c49-ba04-a5cb39143a9b] Updating instance_info_cache with network_info: [] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:14:14 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-8c2d6146-e2e0-4a6d-9b74-efabd2b688bf tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Acquiring lock "e65ccf79-718d-4eeb-8914-f0db2e2c9ce2" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:14:14 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-8c2d6146-e2e0-4a6d-9b74-efabd2b688bf tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Lock "e65ccf79-718d-4eeb-8914-f0db2e2c9ce2" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:14:14 user nova-compute[85141]: INFO nova.compute.manager [None req-8c2d6146-e2e0-4a6d-9b74-efabd2b688bf tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] [instance: e65ccf79-718d-4eeb-8914-f0db2e2c9ce2] Attaching volume abda547a-8d00-4a02-a6e4-d0670e47815a to /dev/vdb
Nov 16 10:14:14 user nova-compute[85141]: DEBUG nova.compute.manager [req-bc28a2f1-a634-4d69-ad18-ddf8b79eb73b req-5e2712af-40c4-4241-ad5c-d06707be3923 service nova] [instance: 0ca61bd2-268e-4c49-ba04-a5cb39143a9b] Detach interface failed, port_id=56375501-2a9c-4821-8446-31156fc0f231, reason: Instance 0ca61bd2-268e-4c49-ba04-a5cb39143a9b could not be found. {{(pid=85141) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 16 10:14:14 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-c2b02df8-3943-4670-8481-0b5ab718b006 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:14:14 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-c2b02df8-3943-4670-8481-0b5ab718b006 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:14:14 user nova-compute[85141]: INFO nova.virt.block_device [None req-ed8ee849-9f8b-4b00-a2c1-9551fad4909c tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] [instance: 9411843f-4e79-46c4-ae02-01f5e87b86eb] Booting with volume c94ff08f-badb-4203-b3af-e418025d1f0d at /dev/vdc
Nov 16 10:14:14 user nova-compute[85141]: DEBUG os_brick.utils [None req-8c2d6146-e2e0-4a6d-9b74-efabd2b688bf tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 10:14:14 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:14:14 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:14:14 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4e1746e-c320-48b4-b04f-d29d3447db8a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c7834de5c295\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:14:14 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:14:14 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:14:14 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[29fca90d-7127-4c8c-86d2-67303a3b8df8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:14:14 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:14:14 user nova-compute[85141]: DEBUG os_brick.utils [None req-ed8ee849-9f8b-4b00-a2c1-9551fad4909c tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 10:14:14 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:14:14 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceddfaa3-a132-4bcb-b328-c7180c78a4a7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:14:14 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:14:14 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[eac377f5-d4c7-4bce-ad89-ddb2ff31bc3c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:14:14 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-8c2d6146-e2e0-4a6d-9b74-efabd2b688bf tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Running cmd (subprocess): nvme version {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:14:14 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-8c2d6146-e2e0-4a6d-9b74-efabd2b688bf tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] 'nvme version' failed. Not Retrying. {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 10:14:14 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:14:14 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[da8a5cb4-9c38-461d-acd1-3a1d4a6af143]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c7834de5c295\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:14:14 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8c2d6146-e2e0-4a6d-9b74-efabd2b688bf tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] nvme not present on system {{(pid=85141) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 10:14:14 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:14:14 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:14:14 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 10:14:14 user nova-compute[85141]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 10:14:14 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[2db12557-f0f9-4a1a-9aa0-27ec3b13d208]: (4, '') {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:14:14 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.lightos [None req-8c2d6146-e2e0-4a6d-9b74-efabd2b688bf tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=85141) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 10:14:14 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.lightos [None req-8c2d6146-e2e0-4a6d-9b74-efabd2b688bf tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=85141) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 10:14:14 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.lightos [None req-8c2d6146-e2e0-4a6d-9b74-efabd2b688bf tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] LIGHTOS: no hostnqn found. {{(pid=85141) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 10:14:14 user nova-compute[85141]: DEBUG os_brick.utils [None req-8c2d6146-e2e0-4a6d-9b74-efabd2b688bf tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] <== get_connector_properties: return (167ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c7834de5c295', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 10:14:14 user nova-compute[85141]: DEBUG nova.virt.block_device [None req-8c2d6146-e2e0-4a6d-9b74-efabd2b688bf tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] [instance: e65ccf79-718d-4eeb-8914-f0db2e2c9ce2] Updating existing volume attachment record: 1403d2c8-7569-4388-bb04-db48451d45d6 {{(pid=85141) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 10:14:14 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:14:14 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1c8febd-f9fe-4055-b320-3cd88c73221a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:14:14 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:14:14 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:14:14 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6937cea-2704-485f-adc4-2efd17ee79b9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:14:14 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d74a14a-07f4-4355-86f0-e7ab8bde1ecb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:14:14 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-ed8ee849-9f8b-4b00-a2c1-9551fad4909c tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Running cmd (subprocess): nvme version {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:14:14 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-ed8ee849-9f8b-4b00-a2c1-9551fad4909c tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] 'nvme version' failed. Not Retrying. {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 10:14:14 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ed8ee849-9f8b-4b00-a2c1-9551fad4909c tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] nvme not present on system {{(pid=85141) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 10:14:14 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:14:14 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 10:14:14 user nova-compute[85141]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 10:14:14 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d419f12-e544-47ab-b16f-4b8d314414e4]: (4, '') {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:14:14 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.lightos [None req-ed8ee849-9f8b-4b00-a2c1-9551fad4909c tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=85141) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 10:14:14 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.lightos [None req-ed8ee849-9f8b-4b00-a2c1-9551fad4909c tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=85141) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 10:14:14 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.lightos [None req-ed8ee849-9f8b-4b00-a2c1-9551fad4909c tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] LIGHTOS: no hostnqn found. {{(pid=85141) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 10:14:14 user nova-compute[85141]: DEBUG os_brick.utils [None req-ed8ee849-9f8b-4b00-a2c1-9551fad4909c tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] <== get_connector_properties: return (228ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c7834de5c295', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 10:14:14 user nova-compute[85141]: DEBUG nova.virt.block_device [None req-ed8ee849-9f8b-4b00-a2c1-9551fad4909c tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] [instance: 9411843f-4e79-46c4-ae02-01f5e87b86eb] Updating existing volume attachment record: 38ffbcc2-251f-47f5-9502-07a25e078d7f {{(pid=85141) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 10:14:14 user nova-compute[85141]: DEBUG nova.compute.provider_tree [None req-c2b02df8-3943-4670-8481-0b5ab718b006 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] Inventory has not changed in ProviderTree for provider: bf8e0fa1-16b6-408f-9203-c4cd63916272 {{(pid=85141) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 10:14:14 user nova-compute[85141]: DEBUG nova.scheduler.client.report [None req-c2b02df8-3943-4670-8481-0b5ab718b006 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] Inventory has not changed for provider bf8e0fa1-16b6-408f-9203-c4cd63916272 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=85141) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 10:14:15 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-c2b02df8-3943-4670-8481-0b5ab718b006 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.543s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:14:15 user nova-compute[85141]: DEBUG nova.compute.manager [req-6cd1dfc3-55f5-48be-b200-861d82ab6123 req-31426e16-b91e-482e-afc9-98f819d9dba5 service nova] [instance: 0ca61bd2-268e-4c49-ba04-a5cb39143a9b] Received event network-vif-plugged-56375501-2a9c-4821-8446-31156fc0f231 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:14:15 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-6cd1dfc3-55f5-48be-b200-861d82ab6123 req-31426e16-b91e-482e-afc9-98f819d9dba5 service nova] Acquiring lock "0ca61bd2-268e-4c49-ba04-a5cb39143a9b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:14:15 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-6cd1dfc3-55f5-48be-b200-861d82ab6123 req-31426e16-b91e-482e-afc9-98f819d9dba5 service nova] Lock "0ca61bd2-268e-4c49-ba04-a5cb39143a9b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:14:15 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-6cd1dfc3-55f5-48be-b200-861d82ab6123 req-31426e16-b91e-482e-afc9-98f819d9dba5 service nova] Lock "0ca61bd2-268e-4c49-ba04-a5cb39143a9b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:14:15 user nova-compute[85141]: DEBUG nova.compute.manager [req-6cd1dfc3-55f5-48be-b200-861d82ab6123 req-31426e16-b91e-482e-afc9-98f819d9dba5 service nova] [instance: 0ca61bd2-268e-4c49-ba04-a5cb39143a9b] No waiting events found dispatching network-vif-plugged-56375501-2a9c-4821-8446-31156fc0f231 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:14:15 user nova-compute[85141]: WARNING nova.compute.manager [req-6cd1dfc3-55f5-48be-b200-861d82ab6123 req-31426e16-b91e-482e-afc9-98f819d9dba5 service nova] [instance: 0ca61bd2-268e-4c49-ba04-a5cb39143a9b] Received unexpected event network-vif-plugged-56375501-2a9c-4821-8446-31156fc0f231 for instance with vm_state deleted and task_state None.
Nov 16 10:14:15 user nova-compute[85141]: INFO nova.scheduler.client.report [None req-c2b02df8-3943-4670-8481-0b5ab718b006 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] Deleted allocations for instance 0ca61bd2-268e-4c49-ba04-a5cb39143a9b
Nov 16 10:14:15 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-c2b02df8-3943-4670-8481-0b5ab718b006 tempest-TaggedAttachmentsTest-1293058027 tempest-TaggedAttachmentsTest-1293058027-project-member] Lock "0ca61bd2-268e-4c49-ba04-a5cb39143a9b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.801s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:14:17 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-7eb146d5-10de-47ad-949d-c2c2a6b83415 tempest-TestVolumeSwap-1428287604 tempest-TestVolumeSwap-1428287604-project-member] Acquiring lock "ad1ace46-2e8e-42e1-a0f5-2384078fcf09" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:14:17 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-7eb146d5-10de-47ad-949d-c2c2a6b83415 tempest-TestVolumeSwap-1428287604 tempest-TestVolumeSwap-1428287604-project-member] Lock "ad1ace46-2e8e-42e1-a0f5-2384078fcf09" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:14:17 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-7eb146d5-10de-47ad-949d-c2c2a6b83415 tempest-TestVolumeSwap-1428287604 tempest-TestVolumeSwap-1428287604-project-member] Acquiring lock "ad1ace46-2e8e-42e1-a0f5-2384078fcf09-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:14:17 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-7eb146d5-10de-47ad-949d-c2c2a6b83415 tempest-TestVolumeSwap-1428287604 tempest-TestVolumeSwap-1428287604-project-member] Lock "ad1ace46-2e8e-42e1-a0f5-2384078fcf09-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:14:17 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-7eb146d5-10de-47ad-949d-c2c2a6b83415 tempest-TestVolumeSwap-1428287604 tempest-TestVolumeSwap-1428287604-project-member] Lock "ad1ace46-2e8e-42e1-a0f5-2384078fcf09-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:14:17 user nova-compute[85141]: INFO nova.compute.manager [None req-7eb146d5-10de-47ad-949d-c2c2a6b83415 tempest-TestVolumeSwap-1428287604 tempest-TestVolumeSwap-1428287604-project-member] [instance: ad1ace46-2e8e-42e1-a0f5-2384078fcf09] Terminating instance
Nov 16 10:14:17 user nova-compute[85141]: DEBUG nova.compute.manager [None req-7eb146d5-10de-47ad-949d-c2c2a6b83415 tempest-TestVolumeSwap-1428287604 tempest-TestVolumeSwap-1428287604-project-member] [instance: ad1ace46-2e8e-42e1-a0f5-2384078fcf09] Start destroying the instance on the hypervisor. {{(pid=85141) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 10:14:17 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:14:17 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:14:17 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:14:17 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:14:17 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:14:17 user nova-compute[85141]: DEBUG nova.compute.manager [req-4986276a-2955-4630-91d7-b7b719e32421 req-c24a9981-4ca1-440d-9ce9-4080a7b6ea9f service nova] [instance: ad1ace46-2e8e-42e1-a0f5-2384078fcf09] Received event network-vif-unplugged-2a895913-f200-44a4-b3bc-4a1c876e2714 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:14:17 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-4986276a-2955-4630-91d7-b7b719e32421 req-c24a9981-4ca1-440d-9ce9-4080a7b6ea9f service nova] Acquiring lock "ad1ace46-2e8e-42e1-a0f5-2384078fcf09-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:14:17 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-4986276a-2955-4630-91d7-b7b719e32421 req-c24a9981-4ca1-440d-9ce9-4080a7b6ea9f service nova] Lock "ad1ace46-2e8e-42e1-a0f5-2384078fcf09-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:14:17 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-4986276a-2955-4630-91d7-b7b719e32421 req-c24a9981-4ca1-440d-9ce9-4080a7b6ea9f service nova] Lock "ad1ace46-2e8e-42e1-a0f5-2384078fcf09-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:14:17 user nova-compute[85141]: DEBUG nova.compute.manager [req-4986276a-2955-4630-91d7-b7b719e32421 req-c24a9981-4ca1-440d-9ce9-4080a7b6ea9f service nova] [instance: ad1ace46-2e8e-42e1-a0f5-2384078fcf09] No waiting events found dispatching network-vif-unplugged-2a895913-f200-44a4-b3bc-4a1c876e2714 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:14:17 user nova-compute[85141]: DEBUG nova.compute.manager [req-4986276a-2955-4630-91d7-b7b719e32421 req-c24a9981-4ca1-440d-9ce9-4080a7b6ea9f service nova] [instance: ad1ace46-2e8e-42e1-a0f5-2384078fcf09] Received event network-vif-unplugged-2a895913-f200-44a4-b3bc-4a1c876e2714 for instance with task_state deleting. {{(pid=85141) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 10:14:17 user nova-compute[85141]: INFO nova.virt.libvirt.driver [-] [instance: ad1ace46-2e8e-42e1-a0f5-2384078fcf09] Instance destroyed successfully.
Nov 16 10:14:17 user nova-compute[85141]: DEBUG nova.objects.instance [None req-7eb146d5-10de-47ad-949d-c2c2a6b83415 tempest-TestVolumeSwap-1428287604 tempest-TestVolumeSwap-1428287604-project-member] Lazy-loading 'resources' on Instance uuid ad1ace46-2e8e-42e1-a0f5-2384078fcf09 {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:14:17 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-7eb146d5-10de-47ad-949d-c2c2a6b83415 tempest-TestVolumeSwap-1428287604 tempest-TestVolumeSwap-1428287604-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T10:10:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-917042974',display_name='tempest-TestVolumeSwap-server-917042974',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-917042974',id=6,image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCbOTuC8R0ay+56a2DZm6xoVifPSDvvnorlKE2TFT9WRtvik/dA/250cWRRzfN61nj1XMvFQ7VUGZ19CUPf5U5OqtC5l1xl0Gh43Tp9/rsw67JjTw7gwhRZXQvoVLRgvnw==',key_name='tempest-keypair-1476686046',keypairs=<?>,launch_index=0,launched_at=2023-11-16T10:11:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='466fcdf8030148ca8afbd0e8ffd24a11',ramdisk_id='',reservation_id='r-tpr6b5tw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-1428287604',owner_user_name='tempest-TestVolumeSwap-1428287604-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T10:11:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3b5ceb88a01f470ab7bd5c8bc6ac6c8b',uuid=ad1ace46-2e8e-42e1-a0f5-2384078fcf09,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2a895913-f200-44a4-b3bc-4a1c876e2714", "address": "fa:16:3e:dc:86:3e", "network": {"id": "cf5d3eb6-a02c-4169-8137-4f7b19a49a84", "bridge": "br-int", "label": "tempest-TestVolumeSwap-36902130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "466fcdf8030148ca8afbd0e8ffd24a11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a895913-f2", "ovs_interfaceid": "2a895913-f200-44a4-b3bc-4a1c876e2714", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 10:14:17 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-7eb146d5-10de-47ad-949d-c2c2a6b83415 tempest-TestVolumeSwap-1428287604 tempest-TestVolumeSwap-1428287604-project-member] Converting VIF {"id": "2a895913-f200-44a4-b3bc-4a1c876e2714", "address": "fa:16:3e:dc:86:3e", "network": {"id": "cf5d3eb6-a02c-4169-8137-4f7b19a49a84", "bridge": "br-int", "label": "tempest-TestVolumeSwap-36902130-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "466fcdf8030148ca8afbd0e8ffd24a11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a895913-f2", "ovs_interfaceid": "2a895913-f200-44a4-b3bc-4a1c876e2714", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:14:17 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-7eb146d5-10de-47ad-949d-c2c2a6b83415 tempest-TestVolumeSwap-1428287604 tempest-TestVolumeSwap-1428287604-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:dc:86:3e,bridge_name='br-int',has_traffic_filtering=True,id=2a895913-f200-44a4-b3bc-4a1c876e2714,network=Network(cf5d3eb6-a02c-4169-8137-4f7b19a49a84),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a895913-f2') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:14:17 user nova-compute[85141]: DEBUG os_vif [None req-7eb146d5-10de-47ad-949d-c2c2a6b83415 tempest-TestVolumeSwap-1428287604 tempest-TestVolumeSwap-1428287604-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:dc:86:3e,bridge_name='br-int',has_traffic_filtering=True,id=2a895913-f200-44a4-b3bc-4a1c876e2714,network=Network(cf5d3eb6-a02c-4169-8137-4f7b19a49a84),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a895913-f2') {{(pid=85141) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 10:14:17 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:14:17 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2a895913-f2, bridge=br-int, if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:14:17 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:14:17 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:14:17 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:14:17 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:14:17 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0cacfe1f-0fe2-49f4-94be-e397aa2008d2) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:14:17 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:14:17 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:14:17 user nova-compute[85141]: INFO os_vif [None req-7eb146d5-10de-47ad-949d-c2c2a6b83415 tempest-TestVolumeSwap-1428287604 tempest-TestVolumeSwap-1428287604-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:dc:86:3e,bridge_name='br-int',has_traffic_filtering=True,id=2a895913-f200-44a4-b3bc-4a1c876e2714,network=Network(cf5d3eb6-a02c-4169-8137-4f7b19a49a84),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a895913-f2')
Nov 16 10:14:17 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-7eb146d5-10de-47ad-949d-c2c2a6b83415 tempest-TestVolumeSwap-1428287604 tempest-TestVolumeSwap-1428287604-project-member] [instance: ad1ace46-2e8e-42e1-a0f5-2384078fcf09] Deleting instance files /opt/stack/data/nova/instances/ad1ace46-2e8e-42e1-a0f5-2384078fcf09_del
Nov 16 10:14:18 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-7eb146d5-10de-47ad-949d-c2c2a6b83415 tempest-TestVolumeSwap-1428287604 tempest-TestVolumeSwap-1428287604-project-member] [instance: ad1ace46-2e8e-42e1-a0f5-2384078fcf09] Deletion of /opt/stack/data/nova/instances/ad1ace46-2e8e-42e1-a0f5-2384078fcf09_del complete
Nov 16 10:14:18 user nova-compute[85141]: INFO nova.compute.manager [None req-7eb146d5-10de-47ad-949d-c2c2a6b83415 tempest-TestVolumeSwap-1428287604 tempest-TestVolumeSwap-1428287604-project-member] [instance: ad1ace46-2e8e-42e1-a0f5-2384078fcf09] Took 0.98 seconds to destroy the instance on the hypervisor.
Nov 16 10:14:18 user nova-compute[85141]: DEBUG oslo.service.loopingcall [None req-7eb146d5-10de-47ad-949d-c2c2a6b83415 tempest-TestVolumeSwap-1428287604 tempest-TestVolumeSwap-1428287604-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=85141) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 10:14:18 user nova-compute[85141]: DEBUG nova.compute.manager [-] [instance: ad1ace46-2e8e-42e1-a0f5-2384078fcf09] Deallocating network for instance {{(pid=85141) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 10:14:18 user nova-compute[85141]: DEBUG nova.network.neutron [-] [instance: ad1ace46-2e8e-42e1-a0f5-2384078fcf09] deallocate_for_instance() {{(pid=85141) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 10:14:18 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:14:19 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:14:19 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:14:19 user nova-compute[85141]: DEBUG nova.compute.manager [req-3dfe5937-a442-4e7c-8e0a-d1012179d1a7 req-1bc9efc1-dc72-419f-b5d6-b447566ee9d9 service nova] [instance: ad1ace46-2e8e-42e1-a0f5-2384078fcf09] Received event network-vif-plugged-2a895913-f200-44a4-b3bc-4a1c876e2714 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:14:19 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-3dfe5937-a442-4e7c-8e0a-d1012179d1a7 req-1bc9efc1-dc72-419f-b5d6-b447566ee9d9 service nova] Acquiring lock "ad1ace46-2e8e-42e1-a0f5-2384078fcf09-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:14:19 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-3dfe5937-a442-4e7c-8e0a-d1012179d1a7 req-1bc9efc1-dc72-419f-b5d6-b447566ee9d9 service nova] Lock "ad1ace46-2e8e-42e1-a0f5-2384078fcf09-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:14:19 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-3dfe5937-a442-4e7c-8e0a-d1012179d1a7 req-1bc9efc1-dc72-419f-b5d6-b447566ee9d9 service nova] Lock "ad1ace46-2e8e-42e1-a0f5-2384078fcf09-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:14:19 user nova-compute[85141]: DEBUG nova.compute.manager [req-3dfe5937-a442-4e7c-8e0a-d1012179d1a7 req-1bc9efc1-dc72-419f-b5d6-b447566ee9d9 service nova] [instance: ad1ace46-2e8e-42e1-a0f5-2384078fcf09] No waiting events found dispatching network-vif-plugged-2a895913-f200-44a4-b3bc-4a1c876e2714 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:14:19 user nova-compute[85141]: WARNING nova.compute.manager [req-3dfe5937-a442-4e7c-8e0a-d1012179d1a7 req-1bc9efc1-dc72-419f-b5d6-b447566ee9d9 service nova] [instance: ad1ace46-2e8e-42e1-a0f5-2384078fcf09] Received unexpected event network-vif-plugged-2a895913-f200-44a4-b3bc-4a1c876e2714 for instance with vm_state active and task_state deleting.
Nov 16 10:14:19 user nova-compute[85141]: DEBUG nova.network.neutron [-] [instance: ad1ace46-2e8e-42e1-a0f5-2384078fcf09] Updating instance_info_cache with network_info: [] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:14:19 user nova-compute[85141]: INFO nova.compute.manager [-] [instance: ad1ace46-2e8e-42e1-a0f5-2384078fcf09] Took 1.80 seconds to deallocate network for instance.
Nov 16 10:14:19 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-7eb146d5-10de-47ad-949d-c2c2a6b83415 tempest-TestVolumeSwap-1428287604 tempest-TestVolumeSwap-1428287604-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:14:19 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-7eb146d5-10de-47ad-949d-c2c2a6b83415 tempest-TestVolumeSwap-1428287604 tempest-TestVolumeSwap-1428287604-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:14:20 user nova-compute[85141]: DEBUG nova.compute.provider_tree [None req-7eb146d5-10de-47ad-949d-c2c2a6b83415 tempest-TestVolumeSwap-1428287604 tempest-TestVolumeSwap-1428287604-project-member] Inventory has not changed in ProviderTree for provider: bf8e0fa1-16b6-408f-9203-c4cd63916272 {{(pid=85141) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 10:14:20 user nova-compute[85141]: DEBUG nova.scheduler.client.report [None req-7eb146d5-10de-47ad-949d-c2c2a6b83415 tempest-TestVolumeSwap-1428287604 tempest-TestVolumeSwap-1428287604-project-member] Inventory has not changed for provider bf8e0fa1-16b6-408f-9203-c4cd63916272 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=85141) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 10:14:20 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-7eb146d5-10de-47ad-949d-c2c2a6b83415 tempest-TestVolumeSwap-1428287604 tempest-TestVolumeSwap-1428287604-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.374s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:14:20 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:14:20 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Starting heal instance info cache {{(pid=85141) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 10:14:20 user nova-compute[85141]: INFO nova.scheduler.client.report [None req-7eb146d5-10de-47ad-949d-c2c2a6b83415 tempest-TestVolumeSwap-1428287604 tempest-TestVolumeSwap-1428287604-project-member] Deleted allocations for instance ad1ace46-2e8e-42e1-a0f5-2384078fcf09
Nov 16 10:14:20 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-7eb146d5-10de-47ad-949d-c2c2a6b83415 tempest-TestVolumeSwap-1428287604 tempest-TestVolumeSwap-1428287604-project-member] Lock "ad1ace46-2e8e-42e1-a0f5-2384078fcf09" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.379s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:14:20 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Acquiring lock "refresh_cache-e65ccf79-718d-4eeb-8914-f0db2e2c9ce2" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:14:20 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Acquired lock "refresh_cache-e65ccf79-718d-4eeb-8914-f0db2e2c9ce2" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:14:20 user nova-compute[85141]: DEBUG nova.network.neutron [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] [instance: e65ccf79-718d-4eeb-8914-f0db2e2c9ce2] Forcefully refreshing network info cache for instance {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 10:14:21 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:14:21 user nova-compute[85141]: DEBUG nova.network.neutron [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] [instance: e65ccf79-718d-4eeb-8914-f0db2e2c9ce2] Updating instance_info_cache with network_info: [{"id": "9b681ac7-3246-4ff4-8691-f8e4f1d62061", "address": "fa:16:3e:ce:f3:cd", "network": {"id": "ac11f3ed-4c14-4051-aff5-44d400d6368c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-679726958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7044a386486d4426bcccfe0b7d225c80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b681ac7-32", "ovs_interfaceid": "9b681ac7-3246-4ff4-8691-f8e4f1d62061", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:14:21 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:14:21 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Releasing lock "refresh_cache-e65ccf79-718d-4eeb-8914-f0db2e2c9ce2" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:14:21 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] [instance: e65ccf79-718d-4eeb-8914-f0db2e2c9ce2] Updated the network info_cache for instance {{(pid=85141) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 10:14:21 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:14:21 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:14:21 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=85141) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 10:14:21 user nova-compute[85141]: DEBUG nova.compute.manager [req-e2e968b3-9000-4117-ac51-8fab2f2acddf req-6c79091c-a498-4cb7-8b29-7309289026df service nova] [instance: ad1ace46-2e8e-42e1-a0f5-2384078fcf09] Received event network-vif-deleted-2a895913-f200-44a4-b3bc-4a1c876e2714 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:14:22 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:14:22 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:14:22 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:14:23 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager.update_available_resource {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:14:23 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:14:23 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:14:23 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:14:23 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Auditing locally available compute resources for user (node: user) {{(pid=85141) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 10:14:23 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e65ccf79-718d-4eeb-8914-f0db2e2c9ce2/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:14:23 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:14:23 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e65ccf79-718d-4eeb-8914-f0db2e2c9ce2/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:14:23 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e65ccf79-718d-4eeb-8914-f0db2e2c9ce2/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:14:23 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e65ccf79-718d-4eeb-8914-f0db2e2c9ce2/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:14:23 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/361a2044-8fd0-4975-8a19-814bf7a6da41/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:14:24 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/361a2044-8fd0-4975-8a19-814bf7a6da41/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:14:24 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/361a2044-8fd0-4975-8a19-814bf7a6da41/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:14:24 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:14:24 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/361a2044-8fd0-4975-8a19-814bf7a6da41/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:14:24 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d842f90e-663b-4c95-9d7c-d092d2bac41f/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:14:24 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d842f90e-663b-4c95-9d7c-d092d2bac41f/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:14:24 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d842f90e-663b-4c95-9d7c-d092d2bac41f/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:14:24 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d842f90e-663b-4c95-9d7c-d092d2bac41f/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:14:24 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=85141) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 10:14:24 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65168899-e7c2-4dea-9257-7490ab994939/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:14:24 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65168899-e7c2-4dea-9257-7490ab994939/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:14:24 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65168899-e7c2-4dea-9257-7490ab994939/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:14:25 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65168899-e7c2-4dea-9257-7490ab994939/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:14:25 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=85141) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 10:14:25 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff05707-78c9-4f78-95e4-660f10636b7a/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:14:25 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff05707-78c9-4f78-95e4-660f10636b7a/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:14:25 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff05707-78c9-4f78-95e4-660f10636b7a/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:14:25 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff05707-78c9-4f78-95e4-660f10636b7a/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:14:25 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/059d6974-bd0c-4f73-91fc-8202ebda4238/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:14:25 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/059d6974-bd0c-4f73-91fc-8202ebda4238/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:14:25 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/059d6974-bd0c-4f73-91fc-8202ebda4238/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:14:25 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/059d6974-bd0c-4f73-91fc-8202ebda4238/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:14:26 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:14:26 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:14:26 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Hypervisor/Node resource view: name=user free_ram=7703MB free_disk=25.474964141845703GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=85141) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 10:14:26 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:14:26 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:14:26 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance d842f90e-663b-4c95-9d7c-d092d2bac41f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:14:26 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance e65ccf79-718d-4eeb-8914-f0db2e2c9ce2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:14:26 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance 361a2044-8fd0-4975-8a19-814bf7a6da41 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:14:26 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance 6caf3667-5613-4ef4-a597-1820e6c1c0ac actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:14:26 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance f01dc8cf-1a69-4618-a15d-0c1075157f05 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:14:26 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance 8ff05707-78c9-4f78-95e4-660f10636b7a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:14:26 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance 059d6974-bd0c-4f73-91fc-8202ebda4238 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:14:26 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance 65168899-e7c2-4dea-9257-7490ab994939 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:14:26 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance 9411843f-4e79-46c4-ae02-01f5e87b86eb has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 16 10:14:26 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=85141) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 10:14:26 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=85141) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 10:14:26 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8c2d6146-e2e0-4a6d-9b74-efabd2b688bf tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] [instance: e65ccf79-718d-4eeb-8914-f0db2e2c9ce2] Calling os-brick to attach iSCSI Volume {{(pid=85141) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 10:14:26 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c2d6146-e2e0-4a6d-9b74-efabd2b688bf tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51806b6080>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:abda547a-8d00-4a02-a6e4-d0670e47815a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RgkfZDbl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 10:14:26 user nova-compute[85141]: WARNING os_brick.initiator.connectors.base [None req-8c2d6146-e2e0-4a6d-9b74-efabd2b688bf tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 10:14:26 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-8c2d6146-e2e0-4a6d-9b74-efabd2b688bf tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 10:14:26 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-8c2d6146-e2e0-4a6d-9b74-efabd2b688bf tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 10:14:26 user nova-compute[85141]: WARNING os_brick.initiator.connectors.base [None req-8c2d6146-e2e0-4a6d-9b74-efabd2b688bf tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 10:14:26 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-8c2d6146-e2e0-4a6d-9b74-efabd2b688bf tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:abda547a-8d00-4a02-a6e4-d0670e47815a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 10:14:26 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-8c2d6146-e2e0-4a6d-9b74-efabd2b688bf tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:abda547a-8d00-4a02-a6e4-d0670e47815a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 10:14:26 user nova-compute[85141]: INFO os_brick.initiator.connectors.iscsi [None req-8c2d6146-e2e0-4a6d-9b74-efabd2b688bf tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 10:14:26 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abda547a-8d00-4a02-a6e4-d0670e47815a -p 172.16.0.220:3260 {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:14:26 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abda547a-8d00-4a02-a6e4-d0670e47815a -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:14:26 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e35a007-be86-4acb-b00e-d29529c25f8a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:14:26 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c2d6146-e2e0-4a6d-9b74-efabd2b688bf tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 10:14:26 user nova-compute[85141]:  {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:14:26 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abda547a-8d00-4a02-a6e4-d0670e47815a -p 172.16.0.220:3260 --interface default --op new {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:14:26 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abda547a-8d00-4a02-a6e4-d0670e47815a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:14:26 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6eaa4e3-944e-448f-b1b2-09c96dd27013]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:abda547a-8d00-4a02-a6e4-d0670e47815a] added\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:14:26 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c2d6146-e2e0-4a6d-9b74-efabd2b688bf tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:abda547a-8d00-4a02-a6e4-d0670e47815a] added
Nov 16 10:14:26 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:14:26 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abda547a-8d00-4a02-a6e4-d0670e47815a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:14:26 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abda547a-8d00-4a02-a6e4-d0670e47815a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:14:26 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[6159b050-5f11-47db-b7fc-ef61dcd0d970]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:14:26 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c2d6146-e2e0-4a6d-9b74-efabd2b688bf tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:14:26 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abda547a-8d00-4a02-a6e4-d0670e47815a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:14:26 user nova-compute[85141]: DEBUG nova.compute.provider_tree [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Inventory has not changed in ProviderTree for provider: bf8e0fa1-16b6-408f-9203-c4cd63916272 {{(pid=85141) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 10:14:26 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abda547a-8d00-4a02-a6e4-d0670e47815a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:14:26 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfde9c90-048d-4512-b3d6-842e64b977db]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:14:26 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c2d6146-e2e0-4a6d-9b74-efabd2b688bf tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:14:26 user nova-compute[85141]: DEBUG nova.scheduler.client.report [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Inventory has not changed for provider bf8e0fa1-16b6-408f-9203-c4cd63916272 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=85141) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 10:14:26 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abda547a-8d00-4a02-a6e4-d0670e47815a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RgkfZDbl {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:14:26 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abda547a-8d00-4a02-a6e4-d0670e47815a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RgkfZDbl" returned: 0 in 0.018s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:14:26 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b202388-6707-4d59-bae1-fb9e1a94f063]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:14:26 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c2d6146-e2e0-4a6d-9b74-efabd2b688bf tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RgkfZDbl'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:14:26 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abda547a-8d00-4a02-a6e4-d0670e47815a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:14:26 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abda547a-8d00-4a02-a6e4-d0670e47815a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:14:26 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bad4d25-e697-4da0-b607-0233b5f1ed70]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:14:26 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c2d6146-e2e0-4a6d-9b74-efabd2b688bf tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:14:26 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Compute_service record updated for user:user {{(pid=85141) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 10:14:26 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.541s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:14:26 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:14:26 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-ed8ee849-9f8b-4b00-a2c1-9551fad4909c tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:14:26 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-ed8ee849-9f8b-4b00-a2c1-9551fad4909c tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:14:26 user nova-compute[85141]: DEBUG nova.objects.instance [None req-ed8ee849-9f8b-4b00-a2c1-9551fad4909c tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Lazy-loading 'pci_requests' on Instance uuid 9411843f-4e79-46c4-ae02-01f5e87b86eb {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:14:26 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:14:26 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5404921-1059-4bbf-96d6-7d9061bc431c]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42c041ec-fa39-4035-b82b-867caf3565df (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:14:26 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c2d6146-e2e0-4a6d-9b74-efabd2b688bf tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42c041ec-fa39-4035-b82b-867caf3565df (non-flash)
Nov 16 10:14:26 user nova-compute[85141]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)
Nov 16 10:14:26 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:14:26 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c2d6146-e2e0-4a6d-9b74-efabd2b688bf tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42c041ec-fa39-4035-b82b-867caf3565df (non-flash)
Nov 16 10:14:26 user nova-compute[85141]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)
Nov 16 10:14:26 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 10:14:26 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abda547a-8d00-4a02-a6e4-d0670e47815a -p 172.16.0.220:3260 --login {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:14:26 user nova-compute[85141]: DEBUG nova.objects.instance [None req-ed8ee849-9f8b-4b00-a2c1-9551fad4909c tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Lazy-loading 'numa_topology' on Instance uuid 9411843f-4e79-46c4-ae02-01f5e87b86eb {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:14:26 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-ed8ee849-9f8b-4b00-a2c1-9551fad4909c tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=85141) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 10:14:26 user nova-compute[85141]: INFO nova.compute.claims [None req-ed8ee849-9f8b-4b00-a2c1-9551fad4909c tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] [instance: 9411843f-4e79-46c4-ae02-01f5e87b86eb] Claim successful on node user
Nov 16 10:14:26 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abda547a-8d00-4a02-a6e4-d0670e47815a -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:14:26 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea3a9c2e-332a-45d6-8145-7a3dbcf65e73]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:abda547a-8d00-4a02-a6e4-d0670e47815a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:abda547a-8d00-4a02-a6e4-d0670e47815a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:14:26 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c2d6146-e2e0-4a6d-9b74-efabd2b688bf tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:abda547a-8d00-4a02-a6e4-d0670e47815a, portal: 172.16.0.220,3260]
Nov 16 10:14:26 user nova-compute[85141]: Login to [iface: default, target: iqn.2010-10.org.openstack:abda547a-8d00-4a02-a6e4-d0670e47815a, portal: 172.16.0.220,3260] successful.
Nov 16 10:14:26 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:14:26 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abda547a-8d00-4a02-a6e4-d0670e47815a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:14:27 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abda547a-8d00-4a02-a6e4-d0670e47815a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:14:27 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc76bb4e-c9ee-48dd-ae0f-c415ec413167]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:14:27 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c2d6146-e2e0-4a6d-9b74-efabd2b688bf tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:14:27 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:14:27 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:14:27 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[73a68b52-7f13-4862-9eb1-36eea7626777]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42c041ec-fa39-4035-b82b-867caf3565df (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abda547a-8d00-4a02-a6e4-d0670e47815a (non-flash)\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:14:27 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c2d6146-e2e0-4a6d-9b74-efabd2b688bf tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42c041ec-fa39-4035-b82b-867caf3565df (non-flash)
Nov 16 10:14:27 user nova-compute[85141]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)
Nov 16 10:14:27 user nova-compute[85141]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abda547a-8d00-4a02-a6e4-d0670e47815a (non-flash)
Nov 16 10:14:27 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:14:27 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c2d6146-e2e0-4a6d-9b74-efabd2b688bf tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42c041ec-fa39-4035-b82b-867caf3565df (non-flash)
Nov 16 10:14:27 user nova-compute[85141]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)
Nov 16 10:14:27 user nova-compute[85141]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abda547a-8d00-4a02-a6e4-d0670e47815a (non-flash)
Nov 16 10:14:27 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 10:14:27 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-8c2d6146-e2e0-4a6d-9b74-efabd2b688bf tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:abda547a-8d00-4a02-a6e4-d0670e47815a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.305s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 10:14:27 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c2d6146-e2e0-4a6d-9b74-efabd2b688bf tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Connected to 172.16.0.220:3260 {{(pid=85141) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 10:14:27 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-8c2d6146-e2e0-4a6d-9b74-efabd2b688bf tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] HCTL ('35', '-', '-', 0) found on session 17 with lun 0 {{(pid=85141) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 10:14:27 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-8c2d6146-e2e0-4a6d-9b74-efabd2b688bf tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=85141) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 10:14:27 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:14:27 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.020s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:14:27 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eaeb144-919a-45df-b91a-e81c6ffd543b]: (4, ('- - 0', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:14:27 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-8c2d6146-e2e0-4a6d-9b74-efabd2b688bf tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Searching for a device in session 17 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=85141) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 10:14:27 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c2d6146-e2e0-4a6d-9b74-efabd2b688bf tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:abda547a-8d00-4a02-a6e4-d0670e47815a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RgkfZDbl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=85141) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 10:14:27 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:14:27 user nova-compute[85141]: DEBUG nova.compute.provider_tree [None req-ed8ee849-9f8b-4b00-a2c1-9551fad4909c tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Inventory has not changed in ProviderTree for provider: bf8e0fa1-16b6-408f-9203-c4cd63916272 {{(pid=85141) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 10:14:27 user nova-compute[85141]: DEBUG nova.scheduler.client.report [None req-ed8ee849-9f8b-4b00-a2c1-9551fad4909c tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Inventory has not changed for provider bf8e0fa1-16b6-408f-9203-c4cd63916272 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=85141) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 10:14:27 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-ed8ee849-9f8b-4b00-a2c1-9551fad4909c tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.423s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:14:27 user nova-compute[85141]: INFO nova.network.neutron [None req-ed8ee849-9f8b-4b00-a2c1-9551fad4909c tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] [instance: 9411843f-4e79-46c4-ae02-01f5e87b86eb] Updating port 1202aa6f-6442-4e95-bf51-66f977a23e01 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 16 10:14:27 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:14:27 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:14:27 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:14:28 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-ed8ee849-9f8b-4b00-a2c1-9551fad4909c tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Acquiring lock "refresh_cache-9411843f-4e79-46c4-ae02-01f5e87b86eb" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:14:28 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-ed8ee849-9f8b-4b00-a2c1-9551fad4909c tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Acquired lock "refresh_cache-9411843f-4e79-46c4-ae02-01f5e87b86eb" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:14:28 user nova-compute[85141]: DEBUG nova.network.neutron [None req-ed8ee849-9f8b-4b00-a2c1-9551fad4909c tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] [instance: 9411843f-4e79-46c4-ae02-01f5e87b86eb] Building network info cache for instance {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 10:14:28 user nova-compute[85141]: DEBUG nova.compute.manager [req-7900dbd2-2157-4456-8ba0-b674125194a8 req-1dd63f44-9a66-41ef-80f1-7b28eb3f85f6 service nova] [instance: 9411843f-4e79-46c4-ae02-01f5e87b86eb] Received event network-changed-1202aa6f-6442-4e95-bf51-66f977a23e01 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:14:28 user nova-compute[85141]: DEBUG nova.compute.manager [req-7900dbd2-2157-4456-8ba0-b674125194a8 req-1dd63f44-9a66-41ef-80f1-7b28eb3f85f6 service nova] [instance: 9411843f-4e79-46c4-ae02-01f5e87b86eb] Refreshing instance network info cache due to event network-changed-1202aa6f-6442-4e95-bf51-66f977a23e01. {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 10:14:28 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-7900dbd2-2157-4456-8ba0-b674125194a8 req-1dd63f44-9a66-41ef-80f1-7b28eb3f85f6 service nova] Acquiring lock "refresh_cache-9411843f-4e79-46c4-ae02-01f5e87b86eb" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:14:28 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-8c2d6146-e2e0-4a6d-9b74-efabd2b688bf tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.343s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 10:14:28 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c2d6146-e2e0-4a6d-9b74-efabd2b688bf tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] <== connect_volume: return (1344ms) {'type': 'block', 'scsi_wwn': '26131616434303532', 'path': '/dev/sdd'} {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 10:14:28 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8c2d6146-e2e0-4a6d-9b74-efabd2b688bf tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] [instance: e65ccf79-718d-4eeb-8914-f0db2e2c9ce2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26131616434303532', 'path': '/dev/sdd'} {{(pid=85141) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 10:14:28 user nova-compute[85141]: DEBUG nova.objects.instance [None req-8c2d6146-e2e0-4a6d-9b74-efabd2b688bf tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Lazy-loading 'flavor' on Instance uuid e65ccf79-718d-4eeb-8914-f0db2e2c9ce2 {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:14:28 user nova-compute[85141]: DEBUG nova.virt.libvirt.guest [None req-8c2d6146-e2e0-4a6d-9b74-efabd2b688bf tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 10:14:28 user nova-compute[85141]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 10:14:28 user nova-compute[85141]:   <source dev="/dev/sdd"/>
Nov 16 10:14:28 user nova-compute[85141]:   <target dev="vdb" bus="virtio"/>
Nov 16 10:14:28 user nova-compute[85141]:   <serial>abda547a-8d00-4a02-a6e4-d0670e47815a</serial>
Nov 16 10:14:28 user nova-compute[85141]: </disk>
Nov 16 10:14:28 user nova-compute[85141]:  {{(pid=85141) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 10:14:28 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-8c2d6146-e2e0-4a6d-9b74-efabd2b688bf tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] No BDM found with device name vda, not building metadata. {{(pid=85141) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 10:14:28 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-8c2d6146-e2e0-4a6d-9b74-efabd2b688bf tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] No BDM found with device name vdb, not building metadata. {{(pid=85141) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 10:14:28 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-8c2d6146-e2e0-4a6d-9b74-efabd2b688bf tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] No VIF found with MAC fa:16:3e:ce:f3:cd, not building metadata {{(pid=85141) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 10:14:28 user nova-compute[85141]: DEBUG nova.network.neutron [None req-ed8ee849-9f8b-4b00-a2c1-9551fad4909c tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] [instance: 9411843f-4e79-46c4-ae02-01f5e87b86eb] Updating instance_info_cache with network_info: [{"id": "1202aa6f-6442-4e95-bf51-66f977a23e01", "address": "fa:16:3e:d8:53:c3", "network": {"id": "4fb7c85e-c966-481d-b6f2-856a17ac8f7c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-81570496-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08ef12fb41a14ecd8abb84d4d69b7c27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1202aa6f-64", "ovs_interfaceid": "1202aa6f-6442-4e95-bf51-66f977a23e01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:14:28 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-ed8ee849-9f8b-4b00-a2c1-9551fad4909c tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Releasing lock "refresh_cache-9411843f-4e79-46c4-ae02-01f5e87b86eb" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:14:28 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-ed8ee849-9f8b-4b00-a2c1-9551fad4909c tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] [instance: 9411843f-4e79-46c4-ae02-01f5e87b86eb] Creating instance directory {{(pid=85141) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 10:14:28 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-ed8ee849-9f8b-4b00-a2c1-9551fad4909c tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] [instance: 9411843f-4e79-46c4-ae02-01f5e87b86eb] Creating image(s)
Nov 16 10:14:28 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-ed8ee849-9f8b-4b00-a2c1-9551fad4909c tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Acquiring lock "/opt/stack/data/nova/instances/9411843f-4e79-46c4-ae02-01f5e87b86eb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:14:28 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-ed8ee849-9f8b-4b00-a2c1-9551fad4909c tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Lock "/opt/stack/data/nova/instances/9411843f-4e79-46c4-ae02-01f5e87b86eb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:14:28 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-ed8ee849-9f8b-4b00-a2c1-9551fad4909c tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Lock "/opt/stack/data/nova/instances/9411843f-4e79-46c4-ae02-01f5e87b86eb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.076s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:14:28 user nova-compute[85141]: DEBUG nova.objects.instance [None req-ed8ee849-9f8b-4b00-a2c1-9551fad4909c tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Lazy-loading 'trusted_certs' on Instance uuid 9411843f-4e79-46c4-ae02-01f5e87b86eb {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:14:28 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-7900dbd2-2157-4456-8ba0-b674125194a8 req-1dd63f44-9a66-41ef-80f1-7b28eb3f85f6 service nova] Acquired lock "refresh_cache-9411843f-4e79-46c4-ae02-01f5e87b86eb" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:14:28 user nova-compute[85141]: DEBUG nova.network.neutron [req-7900dbd2-2157-4456-8ba0-b674125194a8 req-1dd63f44-9a66-41ef-80f1-7b28eb3f85f6 service nova] [instance: 9411843f-4e79-46c4-ae02-01f5e87b86eb] Refreshing network info cache for port 1202aa6f-6442-4e95-bf51-66f977a23e01 {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 10:14:28 user nova-compute[85141]: DEBUG nova.objects.base [None req-ed8ee849-9f8b-4b00-a2c1-9551fad4909c tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Object Instance<9411843f-4e79-46c4-ae02-01f5e87b86eb> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=85141) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 10:14:28 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-ed8ee849-9f8b-4b00-a2c1-9551fad4909c tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Acquiring lock "dc77d73b0ba3d56bbe713f554d19b4dc21dd2abc" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:14:28 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-ed8ee849-9f8b-4b00-a2c1-9551fad4909c tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Lock "dc77d73b0ba3d56bbe713f554d19b4dc21dd2abc" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:14:28 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-8c2d6146-e2e0-4a6d-9b74-efabd2b688bf tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Lock "e65ccf79-718d-4eeb-8914-f0db2e2c9ce2" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.438s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:14:29 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-ed8ee849-9f8b-4b00-a2c1-9551fad4909c tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dc77d73b0ba3d56bbe713f554d19b4dc21dd2abc.part --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:14:30 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-ed8ee849-9f8b-4b00-a2c1-9551fad4909c tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dc77d73b0ba3d56bbe713f554d19b4dc21dd2abc.part --force-share --output=json" returned: 0 in 0.264s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:14:30 user nova-compute[85141]: DEBUG nova.virt.images [None req-ed8ee849-9f8b-4b00-a2c1-9551fad4909c tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] eb1a1e14-2d41-493c-97e0-8c58cd709388 was qcow2, converting to raw {{(pid=85141) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 16 10:14:30 user nova-compute[85141]: DEBUG nova.privsep.utils [None req-ed8ee849-9f8b-4b00-a2c1-9551fad4909c tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=85141) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 16 10:14:30 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-ed8ee849-9f8b-4b00-a2c1-9551fad4909c tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/dc77d73b0ba3d56bbe713f554d19b4dc21dd2abc.part /opt/stack/data/nova/instances/_base/dc77d73b0ba3d56bbe713f554d19b4dc21dd2abc.converted {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:14:30 user nova-compute[85141]: DEBUG nova.network.neutron [req-7900dbd2-2157-4456-8ba0-b674125194a8 req-1dd63f44-9a66-41ef-80f1-7b28eb3f85f6 service nova] [instance: 9411843f-4e79-46c4-ae02-01f5e87b86eb] Updated VIF entry in instance network info cache for port 1202aa6f-6442-4e95-bf51-66f977a23e01. {{(pid=85141) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 10:14:30 user nova-compute[85141]: DEBUG nova.network.neutron [req-7900dbd2-2157-4456-8ba0-b674125194a8 req-1dd63f44-9a66-41ef-80f1-7b28eb3f85f6 service nova] [instance: 9411843f-4e79-46c4-ae02-01f5e87b86eb] Updating instance_info_cache with network_info: [{"id": "1202aa6f-6442-4e95-bf51-66f977a23e01", "address": "fa:16:3e:d8:53:c3", "network": {"id": "4fb7c85e-c966-481d-b6f2-856a17ac8f7c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-81570496-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08ef12fb41a14ecd8abb84d4d69b7c27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1202aa6f-64", "ovs_interfaceid": "1202aa6f-6442-4e95-bf51-66f977a23e01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:14:30 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-7900dbd2-2157-4456-8ba0-b674125194a8 req-1dd63f44-9a66-41ef-80f1-7b28eb3f85f6 service nova] Releasing lock "refresh_cache-9411843f-4e79-46c4-ae02-01f5e87b86eb" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:14:30 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-ed8ee849-9f8b-4b00-a2c1-9551fad4909c tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/dc77d73b0ba3d56bbe713f554d19b4dc21dd2abc.part /opt/stack/data/nova/instances/_base/dc77d73b0ba3d56bbe713f554d19b4dc21dd2abc.converted" returned: 0 in 0.304s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:14:30 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-ed8ee849-9f8b-4b00-a2c1-9551fad4909c tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dc77d73b0ba3d56bbe713f554d19b4dc21dd2abc.converted --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:14:30 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-ed8ee849-9f8b-4b00-a2c1-9551fad4909c tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dc77d73b0ba3d56bbe713f554d19b4dc21dd2abc.converted --force-share --output=json" returned: 0 in 0.200s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:14:30 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-ed8ee849-9f8b-4b00-a2c1-9551fad4909c tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Lock "dc77d73b0ba3d56bbe713f554d19b4dc21dd2abc" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.858s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:14:30 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-ed8ee849-9f8b-4b00-a2c1-9551fad4909c tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dc77d73b0ba3d56bbe713f554d19b4dc21dd2abc --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:14:30 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-ed8ee849-9f8b-4b00-a2c1-9551fad4909c tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dc77d73b0ba3d56bbe713f554d19b4dc21dd2abc --force-share --output=json" returned: 0 in 0.196s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:14:30 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-ed8ee849-9f8b-4b00-a2c1-9551fad4909c tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Acquiring lock "dc77d73b0ba3d56bbe713f554d19b4dc21dd2abc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:14:30 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-ed8ee849-9f8b-4b00-a2c1-9551fad4909c tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Lock "dc77d73b0ba3d56bbe713f554d19b4dc21dd2abc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:14:30 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-ed8ee849-9f8b-4b00-a2c1-9551fad4909c tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dc77d73b0ba3d56bbe713f554d19b4dc21dd2abc --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:14:31 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-ed8ee849-9f8b-4b00-a2c1-9551fad4909c tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dc77d73b0ba3d56bbe713f554d19b4dc21dd2abc --force-share --output=json" returned: 0 in 0.179s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:14:31 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-ed8ee849-9f8b-4b00-a2c1-9551fad4909c tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dc77d73b0ba3d56bbe713f554d19b4dc21dd2abc,backing_fmt=raw /opt/stack/data/nova/instances/9411843f-4e79-46c4-ae02-01f5e87b86eb/disk 1073741824 {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:14:31 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-ed8ee849-9f8b-4b00-a2c1-9551fad4909c tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dc77d73b0ba3d56bbe713f554d19b4dc21dd2abc,backing_fmt=raw /opt/stack/data/nova/instances/9411843f-4e79-46c4-ae02-01f5e87b86eb/disk 1073741824" returned: 0 in 0.049s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:14:31 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-ed8ee849-9f8b-4b00-a2c1-9551fad4909c tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Lock "dc77d73b0ba3d56bbe713f554d19b4dc21dd2abc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.235s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:14:31 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-ed8ee849-9f8b-4b00-a2c1-9551fad4909c tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dc77d73b0ba3d56bbe713f554d19b4dc21dd2abc --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:14:31 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-ed8ee849-9f8b-4b00-a2c1-9551fad4909c tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dc77d73b0ba3d56bbe713f554d19b4dc21dd2abc --force-share --output=json" returned: 0 in 0.190s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:14:31 user nova-compute[85141]: DEBUG nova.objects.instance [None req-ed8ee849-9f8b-4b00-a2c1-9551fad4909c tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Lazy-loading 'migration_context' on Instance uuid 9411843f-4e79-46c4-ae02-01f5e87b86eb {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:14:31 user nova-compute[85141]: DEBUG nova.objects.base [None req-ed8ee849-9f8b-4b00-a2c1-9551fad4909c tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Object Instance<9411843f-4e79-46c4-ae02-01f5e87b86eb> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=85141) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 10:14:31 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-ed8ee849-9f8b-4b00-a2c1-9551fad4909c tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] [instance: 9411843f-4e79-46c4-ae02-01f5e87b86eb] Rebasing disk image.
Nov 16 10:14:31 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-ed8ee849-9f8b-4b00-a2c1-9551fad4909c tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:14:31 user nova-compute[85141]: DEBUG nova.compute.manager [None req-a2b65aa3-d523-4d97-aff8-0239f3f16e9a tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] [instance: e65ccf79-718d-4eeb-8914-f0db2e2c9ce2] Stashing vm_state: active {{(pid=85141) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Nov 16 10:14:31 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-ed8ee849-9f8b-4b00-a2c1-9551fad4909c tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json" returned: 0 in 0.184s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:14:31 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-ed8ee849-9f8b-4b00-a2c1-9551fad4909c tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 -F raw /opt/stack/data/nova/instances/9411843f-4e79-46c4-ae02-01f5e87b86eb/disk {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:14:31 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-a2b65aa3-d523-4d97-aff8-0239f3f16e9a tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:14:31 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-a2b65aa3-d523-4d97-aff8-0239f3f16e9a tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.002s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:14:31 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-a2b65aa3-d523-4d97-aff8-0239f3f16e9a tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=85141) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 10:14:31 user nova-compute[85141]: INFO nova.compute.claims [None req-a2b65aa3-d523-4d97-aff8-0239f3f16e9a tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] [instance: e65ccf79-718d-4eeb-8914-f0db2e2c9ce2] Claim successful on node user
Nov 16 10:14:31 user nova-compute[85141]: INFO nova.compute.resource_tracker [None req-a2b65aa3-d523-4d97-aff8-0239f3f16e9a tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] [instance: e65ccf79-718d-4eeb-8914-f0db2e2c9ce2] Updating resource usage from migration fc337d89-3421-482f-93bf-c5f11b82f622
Nov 16 10:14:32 user nova-compute[85141]: DEBUG nova.compute.provider_tree [None req-a2b65aa3-d523-4d97-aff8-0239f3f16e9a tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Inventory has not changed in ProviderTree for provider: bf8e0fa1-16b6-408f-9203-c4cd63916272 {{(pid=85141) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 10:14:32 user nova-compute[85141]: DEBUG nova.scheduler.client.report [None req-a2b65aa3-d523-4d97-aff8-0239f3f16e9a tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Inventory has not changed for provider bf8e0fa1-16b6-408f-9203-c4cd63916272 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=85141) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 10:14:32 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-a2b65aa3-d523-4d97-aff8-0239f3f16e9a tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.540s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:14:32 user nova-compute[85141]: INFO nova.compute.manager [None req-a2b65aa3-d523-4d97-aff8-0239f3f16e9a tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] [instance: e65ccf79-718d-4eeb-8914-f0db2e2c9ce2] Migrating
Nov 16 10:14:32 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-a2b65aa3-d523-4d97-aff8-0239f3f16e9a tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:14:32 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-a2b65aa3-d523-4d97-aff8-0239f3f16e9a tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Acquired lock "compute-rpcapi-router" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:14:32 user nova-compute[85141]: INFO nova.compute.rpcapi [None req-a2b65aa3-d523-4d97-aff8-0239f3f16e9a tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Nov 16 10:14:32 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-a2b65aa3-d523-4d97-aff8-0239f3f16e9a tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Releasing lock "compute-rpcapi-router" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:14:32 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:14:32 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-a2b65aa3-d523-4d97-aff8-0239f3f16e9a tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Acquiring lock "refresh_cache-e65ccf79-718d-4eeb-8914-f0db2e2c9ce2" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:14:32 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-a2b65aa3-d523-4d97-aff8-0239f3f16e9a tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Acquired lock "refresh_cache-e65ccf79-718d-4eeb-8914-f0db2e2c9ce2" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:14:32 user nova-compute[85141]: DEBUG nova.network.neutron [None req-a2b65aa3-d523-4d97-aff8-0239f3f16e9a tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] [instance: e65ccf79-718d-4eeb-8914-f0db2e2c9ce2] Building network info cache for instance {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 10:14:32 user nova-compute[85141]: DEBUG nova.network.neutron [None req-a2b65aa3-d523-4d97-aff8-0239f3f16e9a tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] [instance: e65ccf79-718d-4eeb-8914-f0db2e2c9ce2] Updating instance_info_cache with network_info: [{"id": "9b681ac7-3246-4ff4-8691-f8e4f1d62061", "address": "fa:16:3e:ce:f3:cd", "network": {"id": "ac11f3ed-4c14-4051-aff5-44d400d6368c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-679726958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7044a386486d4426bcccfe0b7d225c80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b681ac7-32", "ovs_interfaceid": "9b681ac7-3246-4ff4-8691-f8e4f1d62061", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:14:32 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-a2b65aa3-d523-4d97-aff8-0239f3f16e9a tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Releasing lock "refresh_cache-e65ccf79-718d-4eeb-8914-f0db2e2c9ce2" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:14:32 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:14:33 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-a2b65aa3-d523-4d97-aff8-0239f3f16e9a tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] [instance: e65ccf79-718d-4eeb-8914-f0db2e2c9ce2] Starting migrate_disk_and_power_off {{(pid=85141) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Nov 16 10:14:33 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:14:33 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:14:33 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:14:33 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:14:33 user nova-compute[85141]: DEBUG nova.compute.manager [req-47f106bd-70ba-4a62-8f3e-4d4ecd0b2c2d req-0bbf5387-c660-43a7-a086-1073c364db4b service nova] [instance: e65ccf79-718d-4eeb-8914-f0db2e2c9ce2] Received event network-vif-unplugged-9b681ac7-3246-4ff4-8691-f8e4f1d62061 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:14:33 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-47f106bd-70ba-4a62-8f3e-4d4ecd0b2c2d req-0bbf5387-c660-43a7-a086-1073c364db4b service nova] Acquiring lock "e65ccf79-718d-4eeb-8914-f0db2e2c9ce2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:14:33 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-47f106bd-70ba-4a62-8f3e-4d4ecd0b2c2d req-0bbf5387-c660-43a7-a086-1073c364db4b service nova] Lock "e65ccf79-718d-4eeb-8914-f0db2e2c9ce2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:14:33 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-47f106bd-70ba-4a62-8f3e-4d4ecd0b2c2d req-0bbf5387-c660-43a7-a086-1073c364db4b service nova] Lock "e65ccf79-718d-4eeb-8914-f0db2e2c9ce2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:14:33 user nova-compute[85141]: DEBUG nova.compute.manager [req-47f106bd-70ba-4a62-8f3e-4d4ecd0b2c2d req-0bbf5387-c660-43a7-a086-1073c364db4b service nova] [instance: e65ccf79-718d-4eeb-8914-f0db2e2c9ce2] No waiting events found dispatching network-vif-unplugged-9b681ac7-3246-4ff4-8691-f8e4f1d62061 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:14:33 user nova-compute[85141]: WARNING nova.compute.manager [req-47f106bd-70ba-4a62-8f3e-4d4ecd0b2c2d req-0bbf5387-c660-43a7-a086-1073c364db4b service nova] [instance: e65ccf79-718d-4eeb-8914-f0db2e2c9ce2] Received unexpected event network-vif-unplugged-9b681ac7-3246-4ff4-8691-f8e4f1d62061 for instance with vm_state active and task_state resize_migrating.
Nov 16 10:14:34 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-ed8ee849-9f8b-4b00-a2c1-9551fad4909c tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 -F raw /opt/stack/data/nova/instances/9411843f-4e79-46c4-ae02-01f5e87b86eb/disk" returned: 0 in 2.521s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:14:34 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-ed8ee849-9f8b-4b00-a2c1-9551fad4909c tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] [instance: 9411843f-4e79-46c4-ae02-01f5e87b86eb] Created local disks {{(pid=85141) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 10:14:34 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-ed8ee849-9f8b-4b00-a2c1-9551fad4909c tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] [instance: 9411843f-4e79-46c4-ae02-01f5e87b86eb] Ensure instance console log exists: /opt/stack/data/nova/instances/9411843f-4e79-46c4-ae02-01f5e87b86eb/console.log {{(pid=85141) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 10:14:34 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-ed8ee849-9f8b-4b00-a2c1-9551fad4909c tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:14:34 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-ed8ee849-9f8b-4b00-a2c1-9551fad4909c tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:14:34 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-ed8ee849-9f8b-4b00-a2c1-9551fad4909c tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:14:34 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-ed8ee849-9f8b-4b00-a2c1-9551fad4909c tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] [instance: 9411843f-4e79-46c4-ae02-01f5e87b86eb] Start _get_guest_xml network_info=[{"id": "1202aa6f-6442-4e95-bf51-66f977a23e01", "address": "fa:16:3e:d8:53:c3", "network": {"id": "4fb7c85e-c966-481d-b6f2-856a17ac8f7c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-81570496-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08ef12fb41a14ecd8abb84d4d69b7c27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1202aa6f-64", "ovs_interfaceid": "1202aa6f-6442-4e95-bf51-66f977a23e01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='fd2997ca30cb02d0cd161a869c4f4cdc',container_format='bare',created_at=2023-11-16T10:12:21Z,direct_url=<?>,disk_format='qcow2',id=eb1a1e14-2d41-493c-97e0-8c58cd709388,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1837935474-shelved',owner='08ef12fb41a14ecd8abb84d4d69b7c27',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-16T10:12:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_options': None, 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'image_id': 'bc4ca70f-a459-4d5c-a9e6-80f1948eb48b'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c94ff08f-badb-4203-b3af-e418025d1f0d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pWXeluTL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': '9411843f-4e79-46c4-ae02-01f5e87b86eb', 'attached_at': '', 'detached_at': '', 'volume_id': 'c94ff08f-badb-4203-b3af-e418025d1f0d', 'serial': 'c94ff08f-badb-4203-b3af-e418025d1f0d'}, 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'boot_index': None, 'attachment_id': '38ffbcc2-251f-47f5-9502-07a25e078d7f', 'mount_device': '/dev/vdc', 'volume_type': None} {{(pid=85141) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 10:14:34 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-ed8ee849-9f8b-4b00-a2c1-9551fad4909c tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:14:34 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-ed8ee849-9f8b-4b00-a2c1-9551fad4909c tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:14:34 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-ed8ee849-9f8b-4b00-a2c1-9551fad4909c tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=85141) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 10:14:34 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-ed8ee849-9f8b-4b00-a2c1-9551fad4909c tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] CPU controller missing on host. {{(pid=85141) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 10:14:34 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-ed8ee849-9f8b-4b00-a2c1-9551fad4909c tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=85141) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 10:14:34 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-ed8ee849-9f8b-4b00-a2c1-9551fad4909c tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] CPU controller found on host. {{(pid=85141) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 10:14:34 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-ed8ee849-9f8b-4b00-a2c1-9551fad4909c tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=85141) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 10:14:34 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-ed8ee849-9f8b-4b00-a2c1-9551fad4909c tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T10:06:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='fd2997ca30cb02d0cd161a869c4f4cdc',container_format='bare',created_at=2023-11-16T10:12:21Z,direct_url=<?>,disk_format='qcow2',id=eb1a1e14-2d41-493c-97e0-8c58cd709388,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1837935474-shelved',owner='08ef12fb41a14ecd8abb84d4d69b7c27',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-16T10:12:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 10:14:34 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-ed8ee849-9f8b-4b00-a2c1-9551fad4909c tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Flavor limits 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 10:14:34 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-ed8ee849-9f8b-4b00-a2c1-9551fad4909c tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Image limits 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 10:14:34 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-ed8ee849-9f8b-4b00-a2c1-9551fad4909c tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Flavor pref 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 10:14:34 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-ed8ee849-9f8b-4b00-a2c1-9551fad4909c tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Image pref 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 10:14:34 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-ed8ee849-9f8b-4b00-a2c1-9551fad4909c tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 10:14:34 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-ed8ee849-9f8b-4b00-a2c1-9551fad4909c tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 10:14:34 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-ed8ee849-9f8b-4b00-a2c1-9551fad4909c tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=85141) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 10:14:34 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-ed8ee849-9f8b-4b00-a2c1-9551fad4909c tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Got 1 possible topologies {{(pid=85141) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 10:14:34 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-ed8ee849-9f8b-4b00-a2c1-9551fad4909c tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 10:14:34 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-ed8ee849-9f8b-4b00-a2c1-9551fad4909c tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 10:14:34 user nova-compute[85141]: DEBUG nova.objects.instance [None req-ed8ee849-9f8b-4b00-a2c1-9551fad4909c tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Lazy-loading 'vcpu_model' on Instance uuid 9411843f-4e79-46c4-ae02-01f5e87b86eb {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:14:34 user nova-compute[85141]: DEBUG nova.objects.base [None req-ed8ee849-9f8b-4b00-a2c1-9551fad4909c tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Object Instance<9411843f-4e79-46c4-ae02-01f5e87b86eb> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=85141) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 10:14:34 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ed8ee849-9f8b-4b00-a2c1-9551fad4909c tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] [instance: 9411843f-4e79-46c4-ae02-01f5e87b86eb] Calling os-brick to attach iSCSI Volume {{(pid=85141) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 10:14:34 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed8ee849-9f8b-4b00-a2c1-9551fad4909c tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51806b6080>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c94ff08f-badb-4203-b3af-e418025d1f0d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pWXeluTL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 10:14:34 user nova-compute[85141]: WARNING os_brick.initiator.connectors.base [None req-ed8ee849-9f8b-4b00-a2c1-9551fad4909c tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 10:14:34 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-ed8ee849-9f8b-4b00-a2c1-9551fad4909c tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 10:14:34 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-ed8ee849-9f8b-4b00-a2c1-9551fad4909c tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 10:14:34 user nova-compute[85141]: WARNING os_brick.initiator.connectors.base [None req-ed8ee849-9f8b-4b00-a2c1-9551fad4909c tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 10:14:34 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-ed8ee849-9f8b-4b00-a2c1-9551fad4909c tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c94ff08f-badb-4203-b3af-e418025d1f0d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 10:14:34 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-ed8ee849-9f8b-4b00-a2c1-9551fad4909c tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c94ff08f-badb-4203-b3af-e418025d1f0d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 10:14:34 user nova-compute[85141]: INFO os_brick.initiator.connectors.iscsi [None req-ed8ee849-9f8b-4b00-a2c1-9551fad4909c tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 10:14:34 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:14:34 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c94ff08f-badb-4203-b3af-e418025d1f0d -p 172.16.0.220:3260 {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:14:34 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c94ff08f-badb-4203-b3af-e418025d1f0d -p 172.16.0.220:3260" returned: 21 in 0.032s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:14:34 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[57945eb6-276d-4823-905c-1f39fd5483c9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:14:34 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed8ee849-9f8b-4b00-a2c1-9551fad4909c tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 10:14:34 user nova-compute[85141]:  {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:14:34 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c94ff08f-badb-4203-b3af-e418025d1f0d -p 172.16.0.220:3260 --interface default --op new {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:14:34 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c94ff08f-badb-4203-b3af-e418025d1f0d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:14:34 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd3b01ba-9730-4bfa-ac6d-b05eec0655a6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c94ff08f-badb-4203-b3af-e418025d1f0d] added\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:14:34 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed8ee849-9f8b-4b00-a2c1-9551fad4909c tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c94ff08f-badb-4203-b3af-e418025d1f0d] added
Nov 16 10:14:34 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:14:34 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c94ff08f-badb-4203-b3af-e418025d1f0d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:14:34 user nova-compute[85141]: INFO nova.virt.libvirt.driver [-] [instance: e65ccf79-718d-4eeb-8914-f0db2e2c9ce2] Instance destroyed successfully.
Nov 16 10:14:34 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-a2b65aa3-d523-4d97-aff8-0239f3f16e9a tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T10:10:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-2047998705',display_name='tempest-ServerActionsTestOtherB-server-2047998705',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-2047998705',id=4,image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHf5WUZHhTvllxOmAg72z1YtUbpT94pAZ2VioYM/1ZPcnLSsLgh6rPndkFT+8xfTCaDEevGxVERzODZXR4Exh9KNRXP3xfU1ZBhWrD+YWL3uQCHfG8ms6Vv5yEaXpnuCDg==',key_name='tempest-keypair-2137833999',keypairs=<?>,launch_index=0,launched_at=2023-11-16T10:10:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='7044a386486d4426bcccfe0b7d225c80',ramdisk_id='',reservation_id='r-2q3wdtbp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-876168065',owner_user_name='tempest-ServerActionsTestOtherB-876168065-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T10:14:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='776d4157be1a4e56a8821d50da998475',uuid=e65ccf79-718d-4eeb-8914-f0db2e2c9ce2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9b681ac7-3246-4ff4-8691-f8e4f1d62061", "address": "fa:16:3e:ce:f3:cd", "network": {"id": "ac11f3ed-4c14-4051-aff5-44d400d6368c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-679726958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-679726958-network", "vif_mac": "fa:16:3e:ce:f3:cd"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7044a386486d4426bcccfe0b7d225c80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b681ac7-32", "ovs_interfaceid": "9b681ac7-3246-4ff4-8691-f8e4f1d62061", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 10:14:34 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-a2b65aa3-d523-4d97-aff8-0239f3f16e9a tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Converting VIF {"id": "9b681ac7-3246-4ff4-8691-f8e4f1d62061", "address": "fa:16:3e:ce:f3:cd", "network": {"id": "ac11f3ed-4c14-4051-aff5-44d400d6368c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-679726958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-679726958-network", "vif_mac": "fa:16:3e:ce:f3:cd"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7044a386486d4426bcccfe0b7d225c80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b681ac7-32", "ovs_interfaceid": "9b681ac7-3246-4ff4-8691-f8e4f1d62061", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:14:34 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-a2b65aa3-d523-4d97-aff8-0239f3f16e9a tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ce:f3:cd,bridge_name='br-int',has_traffic_filtering=True,id=9b681ac7-3246-4ff4-8691-f8e4f1d62061,network=Network(ac11f3ed-4c14-4051-aff5-44d400d6368c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b681ac7-32') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:14:34 user nova-compute[85141]: DEBUG os_vif [None req-a2b65aa3-d523-4d97-aff8-0239f3f16e9a tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ce:f3:cd,bridge_name='br-int',has_traffic_filtering=True,id=9b681ac7-3246-4ff4-8691-f8e4f1d62061,network=Network(ac11f3ed-4c14-4051-aff5-44d400d6368c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b681ac7-32') {{(pid=85141) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 10:14:34 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:14:34 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9b681ac7-32, bridge=br-int, if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:14:34 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:14:34 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:14:34 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:14:34 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:14:34 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d3db7c5d-b342-4634-a0b6-c25cfdbb0731) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:14:34 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:14:34 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:14:34 user nova-compute[85141]: INFO os_vif [None req-a2b65aa3-d523-4d97-aff8-0239f3f16e9a tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ce:f3:cd,bridge_name='br-int',has_traffic_filtering=True,id=9b681ac7-3246-4ff4-8691-f8e4f1d62061,network=Network(ac11f3ed-4c14-4051-aff5-44d400d6368c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b681ac7-32')
Nov 16 10:14:34 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c94ff08f-badb-4203-b3af-e418025d1f0d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.049s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:14:34 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b151ece-2e08-430d-befc-965c45b0a03a]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:14:34 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed8ee849-9f8b-4b00-a2c1-9551fad4909c tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:14:34 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a2b65aa3-d523-4d97-aff8-0239f3f16e9a tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] [instance: e65ccf79-718d-4eeb-8914-f0db2e2c9ce2] calling os-brick to detach iSCSI Volume {{(pid=85141) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 10:14:34 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2b65aa3-d523-4d97-aff8-0239f3f16e9a tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51806b6080>, {'target_iqn': 'iqn.2010-10.org.openstack:abda547a-8d00-4a02-a6e4-d0670e47815a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RgkfZDbl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 10:14:34 user nova-compute[85141]: WARNING os_brick.initiator.connectors.base [None req-a2b65aa3-d523-4d97-aff8-0239f3f16e9a tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 10:14:34 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-a2b65aa3-d523-4d97-aff8-0239f3f16e9a tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 10:14:34 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c94ff08f-badb-4203-b3af-e418025d1f0d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:14:34 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c94ff08f-badb-4203-b3af-e418025d1f0d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:14:34 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0592a4c-c901-4b6b-9401-cc79025fd9ec]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:14:34 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed8ee849-9f8b-4b00-a2c1-9551fad4909c tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:14:34 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c94ff08f-badb-4203-b3af-e418025d1f0d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pWXeluTL {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:14:34 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c94ff08f-badb-4203-b3af-e418025d1f0d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pWXeluTL" returned: 0 in 0.021s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:14:34 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[7647566b-71ad-4858-94e1-a191ed912442]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:14:34 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed8ee849-9f8b-4b00-a2c1-9551fad4909c tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pWXeluTL'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:14:34 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c94ff08f-badb-4203-b3af-e418025d1f0d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:14:34 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c94ff08f-badb-4203-b3af-e418025d1f0d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:14:34 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[a30726f3-1230-426c-b96d-8e03909b5e6b]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:14:34 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed8ee849-9f8b-4b00-a2c1-9551fad4909c tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:14:34 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:14:34 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:14:34 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[cab0b50b-cc3a-4813-918a-106e30596c05]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42c041ec-fa39-4035-b82b-867caf3565df (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abda547a-8d00-4a02-a6e4-d0670e47815a (non-flash)\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:14:34 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed8ee849-9f8b-4b00-a2c1-9551fad4909c tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42c041ec-fa39-4035-b82b-867caf3565df (non-flash)
Nov 16 10:14:34 user nova-compute[85141]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)
Nov 16 10:14:34 user nova-compute[85141]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abda547a-8d00-4a02-a6e4-d0670e47815a (non-flash)
Nov 16 10:14:34 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:14:34 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed8ee849-9f8b-4b00-a2c1-9551fad4909c tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42c041ec-fa39-4035-b82b-867caf3565df (non-flash)
Nov 16 10:14:34 user nova-compute[85141]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)
Nov 16 10:14:34 user nova-compute[85141]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abda547a-8d00-4a02-a6e4-d0670e47815a (non-flash)
Nov 16 10:14:34 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 10:14:34 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c94ff08f-badb-4203-b3af-e418025d1f0d -p 172.16.0.220:3260 --login {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:14:34 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c94ff08f-badb-4203-b3af-e418025d1f0d -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:14:34 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfa062a8-b234-44fe-bff4-33dcc9c50b0f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c94ff08f-badb-4203-b3af-e418025d1f0d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c94ff08f-badb-4203-b3af-e418025d1f0d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:14:34 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed8ee849-9f8b-4b00-a2c1-9551fad4909c tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c94ff08f-badb-4203-b3af-e418025d1f0d, portal: 172.16.0.220,3260]
Nov 16 10:14:34 user nova-compute[85141]: Login to [iface: default, target: iqn.2010-10.org.openstack:c94ff08f-badb-4203-b3af-e418025d1f0d, portal: 172.16.0.220,3260] successful.
Nov 16 10:14:34 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:14:34 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c94ff08f-badb-4203-b3af-e418025d1f0d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:14:34 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c94ff08f-badb-4203-b3af-e418025d1f0d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:14:34 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[8320bce7-9233-475b-bd40-6a8bfe2d08d2]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:14:34 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed8ee849-9f8b-4b00-a2c1-9551fad4909c tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:14:34 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:14:34 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:14:34 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[c598f34b-486f-417d-8e37-09d149fe38a3]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42c041ec-fa39-4035-b82b-867caf3565df (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abda547a-8d00-4a02-a6e4-d0670e47815a (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c94ff08f-badb-4203-b3af-e418025d1f0d (non-flash)\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:14:34 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed8ee849-9f8b-4b00-a2c1-9551fad4909c tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42c041ec-fa39-4035-b82b-867caf3565df (non-flash)
Nov 16 10:14:34 user nova-compute[85141]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)
Nov 16 10:14:34 user nova-compute[85141]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abda547a-8d00-4a02-a6e4-d0670e47815a (non-flash)
Nov 16 10:14:34 user nova-compute[85141]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c94ff08f-badb-4203-b3af-e418025d1f0d (non-flash)
Nov 16 10:14:34 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:14:34 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed8ee849-9f8b-4b00-a2c1-9551fad4909c tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42c041ec-fa39-4035-b82b-867caf3565df (non-flash)
Nov 16 10:14:34 user nova-compute[85141]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)
Nov 16 10:14:34 user nova-compute[85141]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abda547a-8d00-4a02-a6e4-d0670e47815a (non-flash)
Nov 16 10:14:34 user nova-compute[85141]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c94ff08f-badb-4203-b3af-e418025d1f0d (non-flash)
Nov 16 10:14:34 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 10:14:34 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-ed8ee849-9f8b-4b00-a2c1-9551fad4909c tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c94ff08f-badb-4203-b3af-e418025d1f0d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.379s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 10:14:34 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed8ee849-9f8b-4b00-a2c1-9551fad4909c tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Connected to 172.16.0.220:3260 {{(pid=85141) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 10:14:34 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-ed8ee849-9f8b-4b00-a2c1-9551fad4909c tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] HCTL ('36', '-', '-', 0) found on session 18 with lun 0 {{(pid=85141) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 10:14:34 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-ed8ee849-9f8b-4b00-a2c1-9551fad4909c tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=85141) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 10:14:34 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:14:34 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.015s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:14:34 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7992483-c409-4007-a921-e975d996181a]: (4, ('- - 0', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:14:34 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-ed8ee849-9f8b-4b00-a2c1-9551fad4909c tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Searching for a device in session 18 and hctl ['36', '*', '*', 0] yield: sde {{(pid=85141) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 10:14:34 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed8ee849-9f8b-4b00-a2c1-9551fad4909c tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:c94ff08f-badb-4203-b3af-e418025d1f0d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pWXeluTL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=85141) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 10:14:35 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-ed8ee849-9f8b-4b00-a2c1-9551fad4909c tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.411s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 10:14:35 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed8ee849-9f8b-4b00-a2c1-9551fad4909c tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] <== connect_volume: return (1413ms) {'type': 'block', 'scsi_wwn': '23430633362386238', 'path': '/dev/sde'} {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 10:14:35 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ed8ee849-9f8b-4b00-a2c1-9551fad4909c tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] [instance: 9411843f-4e79-46c4-ae02-01f5e87b86eb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23430633362386238', 'path': '/dev/sde'} {{(pid=85141) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 10:14:35 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-a2b65aa3-d523-4d97-aff8-0239f3f16e9a tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.247s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 10:14:35 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:14:35 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:14:35 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[e02c2ce6-cde7-47d9-8b49-59fb181d303e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:42c041ec-fa39-4035-b82b-867caf3565df\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c94ff08f-badb-4203-b3af-e418025d1f0d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:abda547a-8d00-4a02-a6e4-d0670e47815a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:14:35 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2b65aa3-d523-4d97-aff8-0239f3f16e9a tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 10:14:35 user nova-compute[85141]: No targets found.
Nov 16 10:14:35 user nova-compute[85141]: iSNS:
Nov 16 10:14:35 user nova-compute[85141]: No targets found.
Nov 16 10:14:35 user nova-compute[85141]: STATIC:
Nov 16 10:14:35 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee
Nov 16 10:14:35 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:14:35 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:14:35 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:42c041ec-fa39-4035-b82b-867caf3565df
Nov 16 10:14:35 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:14:35 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:14:35 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:c94ff08f-badb-4203-b3af-e418025d1f0d
Nov 16 10:14:35 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:14:35 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:14:35 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:abda547a-8d00-4a02-a6e4-d0670e47815a
Nov 16 10:14:35 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:14:35 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:14:35 user nova-compute[85141]: FIRMWARE:
Nov 16 10:14:35 user nova-compute[85141]: No targets found.
Nov 16 10:14:35 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:14:35 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2b65aa3-d523-4d97-aff8-0239f3f16e9a tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 10:14:35 user nova-compute[85141]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 10:14:35 user nova-compute[85141]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=85141) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 10:14:35 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2b65aa3-d523-4d97-aff8-0239f3f16e9a tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:abda547a-8d00-4a02-a6e4-d0670e47815a', 0)] {{(pid=85141) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 10:14:35 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-ed8ee849-9f8b-4b00-a2c1-9551fad4909c tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-16T10:10:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1837935474',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1837935474',id=2,image_ref='eb1a1e14-2d41-493c-97e0-8c58cd709388',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1893617844',keypairs=<?>,launch_index=0,launched_at=2023-11-16T10:10:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='08ef12fb41a14ecd8abb84d4d69b7c27',ramdisk_id='',reservation_id='r-g9gqfs85',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-958501663',owner_user_name='tempest-AttachVolumeShelveTestJSON-958501663-project-member',shelved_at='2023-11-16T10:12:26.554640',shelved_host='user',shelved_image_id='eb1a1e14-2d41-493c-97e0-8c58cd709388'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T10:14:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='baec48c887ae4a418e0ea7b32b05bc59',uuid=9411843f-4e79-46c4-ae02-01f5e87b86eb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "1202aa6f-6442-4e95-bf51-66f977a23e01", "address": "fa:16:3e:d8:53:c3", "network": {"id": "4fb7c85e-c966-481d-b6f2-856a17ac8f7c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-81570496-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08ef12fb41a14ecd8abb84d4d69b7c27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1202aa6f-64", "ovs_interfaceid": "1202aa6f-6442-4e95-bf51-66f977a23e01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=85141) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 10:14:35 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-ed8ee849-9f8b-4b00-a2c1-9551fad4909c tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Converting VIF {"id": "1202aa6f-6442-4e95-bf51-66f977a23e01", "address": "fa:16:3e:d8:53:c3", "network": {"id": "4fb7c85e-c966-481d-b6f2-856a17ac8f7c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-81570496-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08ef12fb41a14ecd8abb84d4d69b7c27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1202aa6f-64", "ovs_interfaceid": "1202aa6f-6442-4e95-bf51-66f977a23e01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:14:35 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-ed8ee849-9f8b-4b00-a2c1-9551fad4909c tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d8:53:c3,bridge_name='br-int',has_traffic_filtering=True,id=1202aa6f-6442-4e95-bf51-66f977a23e01,network=Network(4fb7c85e-c966-481d-b6f2-856a17ac8f7c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1202aa6f-64') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:14:35 user nova-compute[85141]: DEBUG nova.objects.instance [None req-ed8ee849-9f8b-4b00-a2c1-9551fad4909c tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Lazy-loading 'pci_devices' on Instance uuid 9411843f-4e79-46c4-ae02-01f5e87b86eb {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:14:35 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:14:35 user nova-compute[85141]: DEBUG nova.objects.base [None req-ed8ee849-9f8b-4b00-a2c1-9551fad4909c tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Object Instance<9411843f-4e79-46c4-ae02-01f5e87b86eb> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=85141) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 10:14:35 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-ed8ee849-9f8b-4b00-a2c1-9551fad4909c tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] [instance: 9411843f-4e79-46c4-ae02-01f5e87b86eb] End _get_guest_xml xml=<domain type="kvm">
Nov 16 10:14:35 user nova-compute[85141]:   <uuid>9411843f-4e79-46c4-ae02-01f5e87b86eb</uuid>
Nov 16 10:14:35 user nova-compute[85141]:   <name>instance-00000002</name>
Nov 16 10:14:35 user nova-compute[85141]:   <memory>524288</memory>
Nov 16 10:14:35 user nova-compute[85141]:   <vcpu>1</vcpu>
Nov 16 10:14:35 user nova-compute[85141]:   <metadata>
Nov 16 10:14:35 user nova-compute[85141]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 10:14:35 user nova-compute[85141]:       <nova:package version="0.0.0"/>
Nov 16 10:14:35 user nova-compute[85141]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1837935474</nova:name>
Nov 16 10:14:35 user nova-compute[85141]:       <nova:creationTime>2023-11-16 10:14:34</nova:creationTime>
Nov 16 10:14:35 user nova-compute[85141]:       <nova:flavor name="m1.tiny">
Nov 16 10:14:35 user nova-compute[85141]:         <nova:memory>512</nova:memory>
Nov 16 10:14:35 user nova-compute[85141]:         <nova:disk>1</nova:disk>
Nov 16 10:14:35 user nova-compute[85141]:         <nova:swap>0</nova:swap>
Nov 16 10:14:35 user nova-compute[85141]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 10:14:35 user nova-compute[85141]:         <nova:vcpus>1</nova:vcpus>
Nov 16 10:14:35 user nova-compute[85141]:       </nova:flavor>
Nov 16 10:14:35 user nova-compute[85141]:       <nova:owner>
Nov 16 10:14:35 user nova-compute[85141]:         <nova:user uuid="baec48c887ae4a418e0ea7b32b05bc59">tempest-AttachVolumeShelveTestJSON-958501663-project-member</nova:user>
Nov 16 10:14:35 user nova-compute[85141]:         <nova:project uuid="08ef12fb41a14ecd8abb84d4d69b7c27">tempest-AttachVolumeShelveTestJSON-958501663</nova:project>
Nov 16 10:14:35 user nova-compute[85141]:       </nova:owner>
Nov 16 10:14:35 user nova-compute[85141]:       <nova:root type="image" uuid="eb1a1e14-2d41-493c-97e0-8c58cd709388"/>
Nov 16 10:14:35 user nova-compute[85141]:       <nova:ports>
Nov 16 10:14:35 user nova-compute[85141]:         <nova:port uuid="1202aa6f-6442-4e95-bf51-66f977a23e01">
Nov 16 10:14:35 user nova-compute[85141]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 16 10:14:35 user nova-compute[85141]:         </nova:port>
Nov 16 10:14:35 user nova-compute[85141]:       </nova:ports>
Nov 16 10:14:35 user nova-compute[85141]:     </nova:instance>
Nov 16 10:14:35 user nova-compute[85141]:   </metadata>
Nov 16 10:14:35 user nova-compute[85141]:   <sysinfo type="smbios">
Nov 16 10:14:35 user nova-compute[85141]:     <system>
Nov 16 10:14:35 user nova-compute[85141]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 10:14:35 user nova-compute[85141]:       <entry name="product">OpenStack Nova</entry>
Nov 16 10:14:35 user nova-compute[85141]:       <entry name="version">0.0.0</entry>
Nov 16 10:14:35 user nova-compute[85141]:       <entry name="serial">9411843f-4e79-46c4-ae02-01f5e87b86eb</entry>
Nov 16 10:14:35 user nova-compute[85141]:       <entry name="uuid">9411843f-4e79-46c4-ae02-01f5e87b86eb</entry>
Nov 16 10:14:35 user nova-compute[85141]:       <entry name="family">Virtual Machine</entry>
Nov 16 10:14:35 user nova-compute[85141]:     </system>
Nov 16 10:14:35 user nova-compute[85141]:   </sysinfo>
Nov 16 10:14:35 user nova-compute[85141]:   <os>
Nov 16 10:14:35 user nova-compute[85141]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 10:14:35 user nova-compute[85141]:     <boot dev="hd"/>
Nov 16 10:14:35 user nova-compute[85141]:     <smbios mode="sysinfo"/>
Nov 16 10:14:35 user nova-compute[85141]:   </os>
Nov 16 10:14:35 user nova-compute[85141]:   <features>
Nov 16 10:14:35 user nova-compute[85141]:     <acpi/>
Nov 16 10:14:35 user nova-compute[85141]:     <apic/>
Nov 16 10:14:35 user nova-compute[85141]:     <vmcoreinfo/>
Nov 16 10:14:35 user nova-compute[85141]:   </features>
Nov 16 10:14:35 user nova-compute[85141]:   <clock offset="utc">
Nov 16 10:14:35 user nova-compute[85141]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 10:14:35 user nova-compute[85141]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 10:14:35 user nova-compute[85141]:     <timer name="hpet" present="no"/>
Nov 16 10:14:35 user nova-compute[85141]:   </clock>
Nov 16 10:14:35 user nova-compute[85141]:   <cpu mode="custom" match="exact">
Nov 16 10:14:35 user nova-compute[85141]:     <model>Nehalem</model>
Nov 16 10:14:35 user nova-compute[85141]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 10:14:35 user nova-compute[85141]:   </cpu>
Nov 16 10:14:35 user nova-compute[85141]:   <devices>
Nov 16 10:14:35 user nova-compute[85141]:     <disk type="file" device="disk">
Nov 16 10:14:35 user nova-compute[85141]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 10:14:35 user nova-compute[85141]:       <source file="/opt/stack/data/nova/instances/9411843f-4e79-46c4-ae02-01f5e87b86eb/disk"/>
Nov 16 10:14:35 user nova-compute[85141]:       <target dev="vda" bus="virtio"/>
Nov 16 10:14:35 user nova-compute[85141]:     </disk>
Nov 16 10:14:35 user nova-compute[85141]:     <disk type="block" device="disk">
Nov 16 10:14:35 user nova-compute[85141]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 10:14:35 user nova-compute[85141]:       <source dev="/dev/sde"/>
Nov 16 10:14:35 user nova-compute[85141]:       <target dev="vdc" bus="virtio"/>
Nov 16 10:14:35 user nova-compute[85141]:       <serial>c94ff08f-badb-4203-b3af-e418025d1f0d</serial>
Nov 16 10:14:35 user nova-compute[85141]:     </disk>
Nov 16 10:14:35 user nova-compute[85141]:     <interface type="ethernet">
Nov 16 10:14:35 user nova-compute[85141]:       <mac address="fa:16:3e:d8:53:c3"/>
Nov 16 10:14:35 user nova-compute[85141]:       <model type="virtio"/>
Nov 16 10:14:35 user nova-compute[85141]:       <mtu size="1442"/>
Nov 16 10:14:35 user nova-compute[85141]:       <target dev="tap1202aa6f-64"/>
Nov 16 10:14:35 user nova-compute[85141]:     </interface>
Nov 16 10:14:35 user nova-compute[85141]:     <serial type="pty">
Nov 16 10:14:35 user nova-compute[85141]:       <log file="/opt/stack/data/nova/instances/9411843f-4e79-46c4-ae02-01f5e87b86eb/console.log" append="off"/>
Nov 16 10:14:35 user nova-compute[85141]:     </serial>
Nov 16 10:14:35 user nova-compute[85141]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 10:14:35 user nova-compute[85141]:     <video>
Nov 16 10:14:35 user nova-compute[85141]:       <model type="virtio"/>
Nov 16 10:14:35 user nova-compute[85141]:     </video>
Nov 16 10:14:35 user nova-compute[85141]:     <rng model="virtio">
Nov 16 10:14:35 user nova-compute[85141]:       <backend model="random">/dev/urandom</backend>
Nov 16 10:14:35 user nova-compute[85141]:     </rng>
Nov 16 10:14:35 user nova-compute[85141]:     <controller type="usb" index="0" model="none"/>
Nov 16 10:14:35 user nova-compute[85141]:     <memballoon model="virtio">
Nov 16 10:14:35 user nova-compute[85141]:       <stats period="10"/>
Nov 16 10:14:35 user nova-compute[85141]:     </memballoon>
Nov 16 10:14:35 user nova-compute[85141]:   </devices>
Nov 16 10:14:35 user nova-compute[85141]: </domain>
Nov 16 10:14:35 user nova-compute[85141]:  {{(pid=85141) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 10:14:35 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-ed8ee849-9f8b-4b00-a2c1-9551fad4909c tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-16T10:10:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1837935474',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1837935474',id=2,image_ref='eb1a1e14-2d41-493c-97e0-8c58cd709388',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1893617844',keypairs=<?>,launch_index=0,launched_at=2023-11-16T10:10:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='08ef12fb41a14ecd8abb84d4d69b7c27',ramdisk_id='',reservation_id='r-g9gqfs85',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-958501663',owner_user_name='tempest-AttachVolumeShelveTestJSON-958501663-project-member',shelved_at='2023-11-16T10:12:26.554640',shelved_host='user',shelved_image_id='eb1a1e14-2d41-493c-97e0-8c58cd709388'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T10:14:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='baec48c887ae4a418e0ea7b32b05bc59',uuid=9411843f-4e79-46c4-ae02-01f5e87b86eb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "1202aa6f-6442-4e95-bf51-66f977a23e01", "address": "fa:16:3e:d8:53:c3", "network": {"id": "4fb7c85e-c966-481d-b6f2-856a17ac8f7c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-81570496-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08ef12fb41a14ecd8abb84d4d69b7c27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1202aa6f-64", "ovs_interfaceid": "1202aa6f-6442-4e95-bf51-66f977a23e01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 10:14:35 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-ed8ee849-9f8b-4b00-a2c1-9551fad4909c tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Converting VIF {"id": "1202aa6f-6442-4e95-bf51-66f977a23e01", "address": "fa:16:3e:d8:53:c3", "network": {"id": "4fb7c85e-c966-481d-b6f2-856a17ac8f7c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-81570496-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08ef12fb41a14ecd8abb84d4d69b7c27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1202aa6f-64", "ovs_interfaceid": "1202aa6f-6442-4e95-bf51-66f977a23e01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:14:35 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-ed8ee849-9f8b-4b00-a2c1-9551fad4909c tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d8:53:c3,bridge_name='br-int',has_traffic_filtering=True,id=1202aa6f-6442-4e95-bf51-66f977a23e01,network=Network(4fb7c85e-c966-481d-b6f2-856a17ac8f7c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1202aa6f-64') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:14:35 user nova-compute[85141]: DEBUG os_vif [None req-ed8ee849-9f8b-4b00-a2c1-9551fad4909c tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:53:c3,bridge_name='br-int',has_traffic_filtering=True,id=1202aa6f-6442-4e95-bf51-66f977a23e01,network=Network(4fb7c85e-c966-481d-b6f2-856a17ac8f7c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1202aa6f-64') {{(pid=85141) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 10:14:35 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:14:35 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dec0035-fcc7-4b93-9f17-1c2f88dbb943]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:42c041ec-fa39-4035-b82b-867caf3565df\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:abda547a-8d00-4a02-a6e4-d0670e47815a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c94ff08f-badb-4203-b3af-e418025d1f0d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:14:35 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:14:35 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:14:35 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 10:14:35 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:14:35 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c61d0807-e43a-5cd0-b4aa-bc68b1fd8bab', '_type': 'linux-noop'}}, row=False) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:14:35 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:14:35 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:14:35 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:14:35 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:14:35 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1202aa6f-64, may_exist=True, interface_attrs={}) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:14:35 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1202aa6f-64, col_values=(('qos', UUID('bf0d1ddb-8a60-4f0c-96a5-c665c0a4d65d')),), if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:14:35 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1202aa6f-64, col_values=(('external_ids', {'iface-id': '1202aa6f-6442-4e95-bf51-66f977a23e01', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d8:53:c3', 'vm-uuid': '9411843f-4e79-46c4-ae02-01f5e87b86eb'}),), if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:14:35 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.048s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:14:35 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f4a9a4c-0ee6-47c0-84ec-4d84e3c64b51]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42c041ec-fa39-4035-b82b-867caf3565df (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abda547a-8d00-4a02-a6e4-d0670e47815a (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c94ff08f-badb-4203-b3af-e418025d1f0d (non-flash)\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:14:35 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2b65aa3-d523-4d97-aff8-0239f3f16e9a tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42c041ec-fa39-4035-b82b-867caf3565df (non-flash)
Nov 16 10:14:35 user nova-compute[85141]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)
Nov 16 10:14:35 user nova-compute[85141]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abda547a-8d00-4a02-a6e4-d0670e47815a (non-flash)
Nov 16 10:14:35 user nova-compute[85141]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c94ff08f-badb-4203-b3af-e418025d1f0d (non-flash)
Nov 16 10:14:35 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:14:35 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2b65aa3-d523-4d97-aff8-0239f3f16e9a tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42c041ec-fa39-4035-b82b-867caf3565df (non-flash)
Nov 16 10:14:35 user nova-compute[85141]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)
Nov 16 10:14:35 user nova-compute[85141]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abda547a-8d00-4a02-a6e4-d0670e47815a (non-flash)
Nov 16 10:14:35 user nova-compute[85141]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c94ff08f-badb-4203-b3af-e418025d1f0d (non-flash)
Nov 16 10:14:35 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 10:14:35 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2b65aa3-d523-4d97-aff8-0239f3f16e9a tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5198141000>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:abda547a-8d00-4a02-a6e4-d0670e47815a'): ({'sdd'}, set())}) {{(pid=85141) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 10:14:35 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-a2b65aa3-d523-4d97-aff8-0239f3f16e9a tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Removing single pathed devices sdd {{(pid=85141) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 10:14:35 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:14:35 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:14:35 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:14:35 user nova-compute[85141]: INFO os_vif [None req-ed8ee849-9f8b-4b00-a2c1-9551fad4909c tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:53:c3,bridge_name='br-int',has_traffic_filtering=True,id=1202aa6f-6442-4e95-bf51-66f977a23e01,network=Network(4fb7c85e-c966-481d-b6f2-856a17ac8f7c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1202aa6f-64')
Nov 16 10:14:35 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:14:35 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d7b0368-46e8-4ad0-86a5-f9eb8243a3d4]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:14:35 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:14:35 user nova-compute[85141]: DEBUG nova.compute.manager [req-73e82178-61bd-447e-8b33-e5cd899df372 req-cac7eb8b-eb92-4d4b-bcc2-2bad93ec1eba service nova] [instance: e65ccf79-718d-4eeb-8914-f0db2e2c9ce2] Received event network-vif-plugged-9b681ac7-3246-4ff4-8691-f8e4f1d62061 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:14:35 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-73e82178-61bd-447e-8b33-e5cd899df372 req-cac7eb8b-eb92-4d4b-bcc2-2bad93ec1eba service nova] Acquiring lock "e65ccf79-718d-4eeb-8914-f0db2e2c9ce2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:14:35 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-73e82178-61bd-447e-8b33-e5cd899df372 req-cac7eb8b-eb92-4d4b-bcc2-2bad93ec1eba service nova] Lock "e65ccf79-718d-4eeb-8914-f0db2e2c9ce2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:14:35 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-73e82178-61bd-447e-8b33-e5cd899df372 req-cac7eb8b-eb92-4d4b-bcc2-2bad93ec1eba service nova] Lock "e65ccf79-718d-4eeb-8914-f0db2e2c9ce2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:14:35 user nova-compute[85141]: DEBUG nova.compute.manager [req-73e82178-61bd-447e-8b33-e5cd899df372 req-cac7eb8b-eb92-4d4b-bcc2-2bad93ec1eba service nova] [instance: e65ccf79-718d-4eeb-8914-f0db2e2c9ce2] No waiting events found dispatching network-vif-plugged-9b681ac7-3246-4ff4-8691-f8e4f1d62061 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:14:35 user nova-compute[85141]: WARNING nova.compute.manager [req-73e82178-61bd-447e-8b33-e5cd899df372 req-cac7eb8b-eb92-4d4b-bcc2-2bad93ec1eba service nova] [instance: e65ccf79-718d-4eeb-8914-f0db2e2c9ce2] Received unexpected event network-vif-plugged-9b681ac7-3246-4ff4-8691-f8e4f1d62061 for instance with vm_state active and task_state resize_migrating.
Nov 16 10:14:35 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.027s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:14:35 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aa5f5ec-96d7-4a6c-aad2-ef81b49cdbdb]: (4, ('ok\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:14:35 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-a2b65aa3-d523-4d97-aff8-0239f3f16e9a tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Flushing IO for device /dev/sdd {{(pid=85141) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 10:14:35 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:14:35 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:14:35 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8b24884-c506-48e0-aa2e-806a50d9a2ac]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:14:35 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-a2b65aa3-d523-4d97-aff8-0239f3f16e9a tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=85141) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 10:14:35 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:14:35 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-ed8ee849-9f8b-4b00-a2c1-9551fad4909c tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] No BDM found with device name vda, not building metadata. {{(pid=85141) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 10:14:35 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-ed8ee849-9f8b-4b00-a2c1-9551fad4909c tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] No BDM found with device name vdc, not building metadata. {{(pid=85141) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 10:14:35 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-ed8ee849-9f8b-4b00-a2c1-9551fad4909c tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] No VIF found with MAC fa:16:3e:d8:53:c3, not building metadata {{(pid=85141) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 10:14:35 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.046s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:14:35 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[633dc712-b5b6-4156-b7b6-f66589c94c0a]: (4, ('1', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:14:35 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-a2b65aa3-d523-4d97-aff8-0239f3f16e9a tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=85141) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 10:14:35 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-a2b65aa3-d523-4d97-aff8-0239f3f16e9a tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] SCSI volumes sdd have been removed. {{(pid=85141) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 10:14:35 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2b65aa3-d523-4d97-aff8-0239f3f16e9a tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:abda547a-8d00-4a02-a6e4-d0670e47815a')] {{(pid=85141) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 10:14:35 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abda547a-8d00-4a02-a6e4-d0670e47815a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:14:35 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abda547a-8d00-4a02-a6e4-d0670e47815a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:14:35 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3b24947-aba6-4eda-96da-e22635ba4426]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:14:35 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2b65aa3-d523-4d97-aff8-0239f3f16e9a tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:14:35 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abda547a-8d00-4a02-a6e4-d0670e47815a -p 172.16.0.220:3260 --logout {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:14:35 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abda547a-8d00-4a02-a6e4-d0670e47815a -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:14:35 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[454e4edf-b068-42ea-ba7e-905091abe1e0]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:abda547a-8d00-4a02-a6e4-d0670e47815a, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:abda547a-8d00-4a02-a6e4-d0670e47815a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:14:35 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2b65aa3-d523-4d97-aff8-0239f3f16e9a tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:abda547a-8d00-4a02-a6e4-d0670e47815a, portal: 172.16.0.220,3260]
Nov 16 10:14:35 user nova-compute[85141]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:abda547a-8d00-4a02-a6e4-d0670e47815a, portal: 172.16.0.220,3260] successful.
Nov 16 10:14:35 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:14:35 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abda547a-8d00-4a02-a6e4-d0670e47815a -p 172.16.0.220:3260 --op delete {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:14:35 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abda547a-8d00-4a02-a6e4-d0670e47815a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:14:35 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[a697314b-a90b-44bb-b7dc-679ee5d4ee5b]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:14:35 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2b65aa3-d523-4d97-aff8-0239f3f16e9a tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:14:35 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-a2b65aa3-d523-4d97-aff8-0239f3f16e9a tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.376s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 10:14:35 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2b65aa3-d523-4d97-aff8-0239f3f16e9a tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] <== disconnect_volume: return (1623ms) None {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 10:14:35 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a2b65aa3-d523-4d97-aff8-0239f3f16e9a tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] [instance: e65ccf79-718d-4eeb-8914-f0db2e2c9ce2] Disconnected iSCSI Volume {{(pid=85141) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 10:14:35 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-a2b65aa3-d523-4d97-aff8-0239f3f16e9a tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e65ccf79-718d-4eeb-8914-f0db2e2c9ce2/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:14:36 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-a2b65aa3-d523-4d97-aff8-0239f3f16e9a tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e65ccf79-718d-4eeb-8914-f0db2e2c9ce2/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:14:36 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-a2b65aa3-d523-4d97-aff8-0239f3f16e9a tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e65ccf79-718d-4eeb-8914-f0db2e2c9ce2/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:14:36 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-a2b65aa3-d523-4d97-aff8-0239f3f16e9a tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e65ccf79-718d-4eeb-8914-f0db2e2c9ce2/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:14:36 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-a2b65aa3-d523-4d97-aff8-0239f3f16e9a tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=85141) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 10:14:36 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-a2b65aa3-d523-4d97-aff8-0239f3f16e9a tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/e65ccf79-718d-4eeb-8914-f0db2e2c9ce2_resize/disk /opt/stack/data/nova/instances/e65ccf79-718d-4eeb-8914-f0db2e2c9ce2/disk {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:14:37 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:14:37 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:14:37 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-a2b65aa3-d523-4d97-aff8-0239f3f16e9a tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] CMD "cp -r /opt/stack/data/nova/instances/e65ccf79-718d-4eeb-8914-f0db2e2c9ce2_resize/disk /opt/stack/data/nova/instances/e65ccf79-718d-4eeb-8914-f0db2e2c9ce2/disk" returned: 0 in 0.956s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:14:37 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-a2b65aa3-d523-4d97-aff8-0239f3f16e9a tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/e65ccf79-718d-4eeb-8914-f0db2e2c9ce2_resize/disk.info /opt/stack/data/nova/instances/e65ccf79-718d-4eeb-8914-f0db2e2c9ce2/disk.info {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:14:37 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-a2b65aa3-d523-4d97-aff8-0239f3f16e9a tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] CMD "cp -r /opt/stack/data/nova/instances/e65ccf79-718d-4eeb-8914-f0db2e2c9ce2_resize/disk.info /opt/stack/data/nova/instances/e65ccf79-718d-4eeb-8914-f0db2e2c9ce2/disk.info" returned: 0 in 0.049s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:14:37 user nova-compute[85141]: DEBUG nova.compute.manager [req-5f1ec531-1c62-42dc-a39b-fe3b8fdfb9f2 req-292c63c8-955f-4984-8db0-05a98244d3af service nova] [instance: 9411843f-4e79-46c4-ae02-01f5e87b86eb] Received event network-vif-plugged-1202aa6f-6442-4e95-bf51-66f977a23e01 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:14:37 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-5f1ec531-1c62-42dc-a39b-fe3b8fdfb9f2 req-292c63c8-955f-4984-8db0-05a98244d3af service nova] Acquiring lock "9411843f-4e79-46c4-ae02-01f5e87b86eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:14:37 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-5f1ec531-1c62-42dc-a39b-fe3b8fdfb9f2 req-292c63c8-955f-4984-8db0-05a98244d3af service nova] Lock "9411843f-4e79-46c4-ae02-01f5e87b86eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:14:37 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-5f1ec531-1c62-42dc-a39b-fe3b8fdfb9f2 req-292c63c8-955f-4984-8db0-05a98244d3af service nova] Lock "9411843f-4e79-46c4-ae02-01f5e87b86eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:14:37 user nova-compute[85141]: DEBUG nova.compute.manager [req-5f1ec531-1c62-42dc-a39b-fe3b8fdfb9f2 req-292c63c8-955f-4984-8db0-05a98244d3af service nova] [instance: 9411843f-4e79-46c4-ae02-01f5e87b86eb] No waiting events found dispatching network-vif-plugged-1202aa6f-6442-4e95-bf51-66f977a23e01 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:14:37 user nova-compute[85141]: WARNING nova.compute.manager [req-5f1ec531-1c62-42dc-a39b-fe3b8fdfb9f2 req-292c63c8-955f-4984-8db0-05a98244d3af service nova] [instance: 9411843f-4e79-46c4-ae02-01f5e87b86eb] Received unexpected event network-vif-plugged-1202aa6f-6442-4e95-bf51-66f977a23e01 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 16 10:14:37 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-3c6a1200-4c46-4b97-b3ab-974c44ee3d80 tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] Acquiring lock "6caf3667-5613-4ef4-a597-1820e6c1c0ac" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:14:37 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-3c6a1200-4c46-4b97-b3ab-974c44ee3d80 tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] Lock "6caf3667-5613-4ef4-a597-1820e6c1c0ac" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:14:37 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-3c6a1200-4c46-4b97-b3ab-974c44ee3d80 tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] Acquiring lock "6caf3667-5613-4ef4-a597-1820e6c1c0ac-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:14:37 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-3c6a1200-4c46-4b97-b3ab-974c44ee3d80 tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] Lock "6caf3667-5613-4ef4-a597-1820e6c1c0ac-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:14:37 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-3c6a1200-4c46-4b97-b3ab-974c44ee3d80 tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] Lock "6caf3667-5613-4ef4-a597-1820e6c1c0ac-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:14:37 user nova-compute[85141]: INFO nova.compute.manager [None req-3c6a1200-4c46-4b97-b3ab-974c44ee3d80 tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] [instance: 6caf3667-5613-4ef4-a597-1820e6c1c0ac] Terminating instance
Nov 16 10:14:37 user nova-compute[85141]: DEBUG nova.compute.manager [None req-3c6a1200-4c46-4b97-b3ab-974c44ee3d80 tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] [instance: 6caf3667-5613-4ef4-a597-1820e6c1c0ac] Start destroying the instance on the hypervisor. {{(pid=85141) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 10:14:37 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:14:37 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:14:37 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:14:37 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:14:37 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:14:37 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:14:37 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:14:38 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:14:38 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:14:38 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:14:38 user nova-compute[85141]: INFO nova.virt.libvirt.driver [-] [instance: 6caf3667-5613-4ef4-a597-1820e6c1c0ac] Instance destroyed successfully.
Nov 16 10:14:38 user nova-compute[85141]: DEBUG nova.objects.instance [None req-3c6a1200-4c46-4b97-b3ab-974c44ee3d80 tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] Lazy-loading 'resources' on Instance uuid 6caf3667-5613-4ef4-a597-1820e6c1c0ac {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:14:38 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-3c6a1200-4c46-4b97-b3ab-974c44ee3d80 tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-16T10:10:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1948154362',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1086260035',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPTxuc2pFbo8Kj1fpySyu2hi+5RREMihAI4J3BcHJNw6/EhxEylOLh1w3NMl0ucAMBcFIFr2hryAmkgpSqOT6RfhW0NUWmUq9zKgRAUTsN4Epu8nh4W95o4JP2jn8aOc3w==',key_name='tempest-keypair-731314932',keypairs=<?>,launch_index=0,launched_at=2023-11-16T10:13:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e017c305665f4a98a75d1d77701b6527',ramdisk_id='',reservation_id='r-4eesetti',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1581977623',owner_user_name='tempest-ServerActionsV293TestJSON-1581977623-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T10:13:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ae4bf3b050ed4cd7901541e9ce1c838f',uuid=6caf3667-5613-4ef4-a597-1820e6c1c0ac,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ad2b755f-6905-4256-be59-b64dae993293", "address": "fa:16:3e:fb:7c:00", "network": {"id": "9b5d58ef-109a-4ccb-90e4-a6b18c02f49c", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1619595955-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.67", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e017c305665f4a98a75d1d77701b6527", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad2b755f-69", "ovs_interfaceid": "ad2b755f-6905-4256-be59-b64dae993293", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 10:14:38 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-3c6a1200-4c46-4b97-b3ab-974c44ee3d80 tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] Converting VIF {"id": "ad2b755f-6905-4256-be59-b64dae993293", "address": "fa:16:3e:fb:7c:00", "network": {"id": "9b5d58ef-109a-4ccb-90e4-a6b18c02f49c", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1619595955-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.67", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e017c305665f4a98a75d1d77701b6527", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad2b755f-69", "ovs_interfaceid": "ad2b755f-6905-4256-be59-b64dae993293", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:14:38 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-3c6a1200-4c46-4b97-b3ab-974c44ee3d80 tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fb:7c:00,bridge_name='br-int',has_traffic_filtering=True,id=ad2b755f-6905-4256-be59-b64dae993293,network=Network(9b5d58ef-109a-4ccb-90e4-a6b18c02f49c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad2b755f-69') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:14:38 user nova-compute[85141]: DEBUG os_vif [None req-3c6a1200-4c46-4b97-b3ab-974c44ee3d80 tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fb:7c:00,bridge_name='br-int',has_traffic_filtering=True,id=ad2b755f-6905-4256-be59-b64dae993293,network=Network(9b5d58ef-109a-4ccb-90e4-a6b18c02f49c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad2b755f-69') {{(pid=85141) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 10:14:38 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:14:38 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapad2b755f-69, bridge=br-int, if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:14:38 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:14:38 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:14:38 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:14:38 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cf1df4c5-dd82-4185-b107-d9a311c3811c) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:14:38 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:14:38 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:14:38 user nova-compute[85141]: INFO os_vif [None req-3c6a1200-4c46-4b97-b3ab-974c44ee3d80 tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fb:7c:00,bridge_name='br-int',has_traffic_filtering=True,id=ad2b755f-6905-4256-be59-b64dae993293,network=Network(9b5d58ef-109a-4ccb-90e4-a6b18c02f49c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad2b755f-69')
Nov 16 10:14:38 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3c6a1200-4c46-4b97-b3ab-974c44ee3d80 tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] [instance: 6caf3667-5613-4ef4-a597-1820e6c1c0ac] calling os-brick to detach iSCSI Volume {{(pid=85141) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 10:14:38 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c6a1200-4c46-4b97-b3ab-974c44ee3d80 tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51806b6080>, {'target_iqn': 'iqn.2010-10.org.openstack:42c041ec-fa39-4035-b82b-867caf3565df', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CbSKnRJc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 10:14:38 user nova-compute[85141]: WARNING os_brick.initiator.connectors.base [None req-3c6a1200-4c46-4b97-b3ab-974c44ee3d80 tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 10:14:38 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-3c6a1200-4c46-4b97-b3ab-974c44ee3d80 tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 10:14:38 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-3c6a1200-4c46-4b97-b3ab-974c44ee3d80 tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 10:14:38 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:14:38 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:14:38 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[c88bbd27-a1c3-4581-992c-b3e8984dd3bf]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:42c041ec-fa39-4035-b82b-867caf3565df\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c94ff08f-badb-4203-b3af-e418025d1f0d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:14:38 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c6a1200-4c46-4b97-b3ab-974c44ee3d80 tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 10:14:38 user nova-compute[85141]: No targets found.
Nov 16 10:14:38 user nova-compute[85141]: iSNS:
Nov 16 10:14:38 user nova-compute[85141]: No targets found.
Nov 16 10:14:38 user nova-compute[85141]: STATIC:
Nov 16 10:14:38 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee
Nov 16 10:14:38 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:14:38 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:14:38 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:42c041ec-fa39-4035-b82b-867caf3565df
Nov 16 10:14:38 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:14:38 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:14:38 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:c94ff08f-badb-4203-b3af-e418025d1f0d
Nov 16 10:14:38 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:14:38 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:14:38 user nova-compute[85141]: FIRMWARE:
Nov 16 10:14:38 user nova-compute[85141]: No targets found.
Nov 16 10:14:38 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:14:38 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c6a1200-4c46-4b97-b3ab-974c44ee3d80 tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 10:14:38 user nova-compute[85141]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 10:14:38 user nova-compute[85141]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=85141) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 10:14:38 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c6a1200-4c46-4b97-b3ab-974c44ee3d80 tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:42c041ec-fa39-4035-b82b-867caf3565df', 0)] {{(pid=85141) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 10:14:38 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:14:38 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:14:38 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee3b7ff8-4696-42c1-8d70-a008b7c6dd8b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:42c041ec-fa39-4035-b82b-867caf3565df\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c94ff08f-badb-4203-b3af-e418025d1f0d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:14:38 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:14:38 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:14:38 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[515926a9-a4d1-4697-8dff-4e53d4863ee9]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42c041ec-fa39-4035-b82b-867caf3565df (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c94ff08f-badb-4203-b3af-e418025d1f0d (non-flash)\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:14:38 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c6a1200-4c46-4b97-b3ab-974c44ee3d80 tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42c041ec-fa39-4035-b82b-867caf3565df (non-flash)
Nov 16 10:14:38 user nova-compute[85141]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)
Nov 16 10:14:38 user nova-compute[85141]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c94ff08f-badb-4203-b3af-e418025d1f0d (non-flash)
Nov 16 10:14:38 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:14:38 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c6a1200-4c46-4b97-b3ab-974c44ee3d80 tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42c041ec-fa39-4035-b82b-867caf3565df (non-flash)
Nov 16 10:14:38 user nova-compute[85141]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)
Nov 16 10:14:38 user nova-compute[85141]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c94ff08f-badb-4203-b3af-e418025d1f0d (non-flash)
Nov 16 10:14:38 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 10:14:38 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c6a1200-4c46-4b97-b3ab-974c44ee3d80 tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f51a09b6b90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:42c041ec-fa39-4035-b82b-867caf3565df'): ({'sdb'}, set())}) {{(pid=85141) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 10:14:38 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-3c6a1200-4c46-4b97-b3ab-974c44ee3d80 tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] Removing single pathed devices sdb {{(pid=85141) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 10:14:38 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:14:38 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:14:38 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[c906fa6f-ab2e-4fad-ae04-44acdfe89ee3]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:14:38 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:14:38 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:14:38 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f643f44-20a0-423b-be32-4546fca1d5aa]: (4, ('ok\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:14:38 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-3c6a1200-4c46-4b97-b3ab-974c44ee3d80 tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] Flushing IO for device /dev/sdb {{(pid=85141) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 10:14:38 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:14:38 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:14:38 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b01cd6f-06c3-4ca9-b095-a4ae279af117]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:14:38 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-3c6a1200-4c46-4b97-b3ab-974c44ee3d80 tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=85141) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 10:14:38 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:14:38 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.061s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:14:38 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bb30d04-9413-43fa-9329-fce1399d860d]: (4, ('1', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:14:38 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-3c6a1200-4c46-4b97-b3ab-974c44ee3d80 tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=85141) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 10:14:38 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-3c6a1200-4c46-4b97-b3ab-974c44ee3d80 tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] SCSI volumes sdb have been removed. {{(pid=85141) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 10:14:38 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c6a1200-4c46-4b97-b3ab-974c44ee3d80 tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:42c041ec-fa39-4035-b82b-867caf3565df')] {{(pid=85141) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 10:14:38 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42c041ec-fa39-4035-b82b-867caf3565df -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:14:38 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42c041ec-fa39-4035-b82b-867caf3565df -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:14:38 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a6df383-8274-4e42-a9f0-aa7fd9208001]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:14:38 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c6a1200-4c46-4b97-b3ab-974c44ee3d80 tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:14:38 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42c041ec-fa39-4035-b82b-867caf3565df -p 172.16.0.220:3260 --logout {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:14:38 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42c041ec-fa39-4035-b82b-867caf3565df -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:14:38 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba9261ea-ffdc-4608-9c4f-03313e2dbb57]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:42c041ec-fa39-4035-b82b-867caf3565df, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:42c041ec-fa39-4035-b82b-867caf3565df, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:14:38 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c6a1200-4c46-4b97-b3ab-974c44ee3d80 tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:42c041ec-fa39-4035-b82b-867caf3565df, portal: 172.16.0.220,3260]
Nov 16 10:14:38 user nova-compute[85141]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:42c041ec-fa39-4035-b82b-867caf3565df, portal: 172.16.0.220,3260] successful.
Nov 16 10:14:38 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:14:39 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42c041ec-fa39-4035-b82b-867caf3565df -p 172.16.0.220:3260 --op delete {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:14:39 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42c041ec-fa39-4035-b82b-867caf3565df -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:14:39 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c993372-2bed-4307-90e4-74ddfb1ea2ed]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:14:39 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c6a1200-4c46-4b97-b3ab-974c44ee3d80 tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:14:39 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-3c6a1200-4c46-4b97-b3ab-974c44ee3d80 tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.345s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 10:14:39 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c6a1200-4c46-4b97-b3ab-974c44ee3d80 tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] <== disconnect_volume: return (347ms) None {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 10:14:39 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3c6a1200-4c46-4b97-b3ab-974c44ee3d80 tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] [instance: 6caf3667-5613-4ef4-a597-1820e6c1c0ac] Disconnected iSCSI Volume {{(pid=85141) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 10:14:39 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-3c6a1200-4c46-4b97-b3ab-974c44ee3d80 tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] [instance: 6caf3667-5613-4ef4-a597-1820e6c1c0ac] Deleting instance files /opt/stack/data/nova/instances/6caf3667-5613-4ef4-a597-1820e6c1c0ac_del
Nov 16 10:14:39 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-3c6a1200-4c46-4b97-b3ab-974c44ee3d80 tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] [instance: 6caf3667-5613-4ef4-a597-1820e6c1c0ac] Deletion of /opt/stack/data/nova/instances/6caf3667-5613-4ef4-a597-1820e6c1c0ac_del complete
Nov 16 10:14:39 user nova-compute[85141]: INFO nova.compute.manager [None req-3c6a1200-4c46-4b97-b3ab-974c44ee3d80 tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] [instance: 6caf3667-5613-4ef4-a597-1820e6c1c0ac] Took 1.39 seconds to destroy the instance on the hypervisor.
Nov 16 10:14:39 user nova-compute[85141]: DEBUG oslo.service.loopingcall [None req-3c6a1200-4c46-4b97-b3ab-974c44ee3d80 tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=85141) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 10:14:39 user nova-compute[85141]: DEBUG nova.compute.manager [-] [instance: 6caf3667-5613-4ef4-a597-1820e6c1c0ac] Deallocating network for instance {{(pid=85141) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 10:14:39 user nova-compute[85141]: DEBUG nova.network.neutron [-] [instance: 6caf3667-5613-4ef4-a597-1820e6c1c0ac] deallocate_for_instance() {{(pid=85141) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 10:14:39 user nova-compute[85141]: DEBUG nova.network.neutron [None req-a2b65aa3-d523-4d97-aff8-0239f3f16e9a tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] [instance: e65ccf79-718d-4eeb-8914-f0db2e2c9ce2] Port 9b681ac7-3246-4ff4-8691-f8e4f1d62061 binding to destination host user is already ACTIVE {{(pid=85141) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 16 10:14:39 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-a2b65aa3-d523-4d97-aff8-0239f3f16e9a tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Acquiring lock "e65ccf79-718d-4eeb-8914-f0db2e2c9ce2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:14:39 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-a2b65aa3-d523-4d97-aff8-0239f3f16e9a tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Lock "e65ccf79-718d-4eeb-8914-f0db2e2c9ce2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:14:39 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-a2b65aa3-d523-4d97-aff8-0239f3f16e9a tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Lock "e65ccf79-718d-4eeb-8914-f0db2e2c9ce2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:14:39 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-a2b65aa3-d523-4d97-aff8-0239f3f16e9a tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Acquiring lock "refresh_cache-e65ccf79-718d-4eeb-8914-f0db2e2c9ce2" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:14:39 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-a2b65aa3-d523-4d97-aff8-0239f3f16e9a tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Acquired lock "refresh_cache-e65ccf79-718d-4eeb-8914-f0db2e2c9ce2" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:14:39 user nova-compute[85141]: DEBUG nova.network.neutron [None req-a2b65aa3-d523-4d97-aff8-0239f3f16e9a tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] [instance: e65ccf79-718d-4eeb-8914-f0db2e2c9ce2] Building network info cache for instance {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 10:14:39 user nova-compute[85141]: DEBUG nova.compute.manager [req-d147b515-5937-40a9-9833-77e34433cf75 req-e30aeeab-7d7a-4d62-aada-9227505db4e2 service nova] [instance: 9411843f-4e79-46c4-ae02-01f5e87b86eb] Received event network-vif-plugged-1202aa6f-6442-4e95-bf51-66f977a23e01 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:14:39 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-d147b515-5937-40a9-9833-77e34433cf75 req-e30aeeab-7d7a-4d62-aada-9227505db4e2 service nova] Acquiring lock "9411843f-4e79-46c4-ae02-01f5e87b86eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:14:39 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-d147b515-5937-40a9-9833-77e34433cf75 req-e30aeeab-7d7a-4d62-aada-9227505db4e2 service nova] Lock "9411843f-4e79-46c4-ae02-01f5e87b86eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:14:39 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-d147b515-5937-40a9-9833-77e34433cf75 req-e30aeeab-7d7a-4d62-aada-9227505db4e2 service nova] Lock "9411843f-4e79-46c4-ae02-01f5e87b86eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:14:39 user nova-compute[85141]: DEBUG nova.compute.manager [req-d147b515-5937-40a9-9833-77e34433cf75 req-e30aeeab-7d7a-4d62-aada-9227505db4e2 service nova] [instance: 9411843f-4e79-46c4-ae02-01f5e87b86eb] No waiting events found dispatching network-vif-plugged-1202aa6f-6442-4e95-bf51-66f977a23e01 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:14:39 user nova-compute[85141]: WARNING nova.compute.manager [req-d147b515-5937-40a9-9833-77e34433cf75 req-e30aeeab-7d7a-4d62-aada-9227505db4e2 service nova] [instance: 9411843f-4e79-46c4-ae02-01f5e87b86eb] Received unexpected event network-vif-plugged-1202aa6f-6442-4e95-bf51-66f977a23e01 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 16 10:14:39 user nova-compute[85141]: DEBUG nova.compute.manager [req-d147b515-5937-40a9-9833-77e34433cf75 req-e30aeeab-7d7a-4d62-aada-9227505db4e2 service nova] [instance: 6caf3667-5613-4ef4-a597-1820e6c1c0ac] Received event network-vif-unplugged-ad2b755f-6905-4256-be59-b64dae993293 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:14:39 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-d147b515-5937-40a9-9833-77e34433cf75 req-e30aeeab-7d7a-4d62-aada-9227505db4e2 service nova] Acquiring lock "6caf3667-5613-4ef4-a597-1820e6c1c0ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:14:39 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-d147b515-5937-40a9-9833-77e34433cf75 req-e30aeeab-7d7a-4d62-aada-9227505db4e2 service nova] Lock "6caf3667-5613-4ef4-a597-1820e6c1c0ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:14:39 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-d147b515-5937-40a9-9833-77e34433cf75 req-e30aeeab-7d7a-4d62-aada-9227505db4e2 service nova] Lock "6caf3667-5613-4ef4-a597-1820e6c1c0ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:14:39 user nova-compute[85141]: DEBUG nova.compute.manager [req-d147b515-5937-40a9-9833-77e34433cf75 req-e30aeeab-7d7a-4d62-aada-9227505db4e2 service nova] [instance: 6caf3667-5613-4ef4-a597-1820e6c1c0ac] No waiting events found dispatching network-vif-unplugged-ad2b755f-6905-4256-be59-b64dae993293 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:14:39 user nova-compute[85141]: DEBUG nova.compute.manager [req-d147b515-5937-40a9-9833-77e34433cf75 req-e30aeeab-7d7a-4d62-aada-9227505db4e2 service nova] [instance: 6caf3667-5613-4ef4-a597-1820e6c1c0ac] Received event network-vif-unplugged-ad2b755f-6905-4256-be59-b64dae993293 for instance with task_state deleting. {{(pid=85141) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 10:14:39 user nova-compute[85141]: DEBUG nova.compute.manager [req-d147b515-5937-40a9-9833-77e34433cf75 req-e30aeeab-7d7a-4d62-aada-9227505db4e2 service nova] [instance: 6caf3667-5613-4ef4-a597-1820e6c1c0ac] Received event network-vif-plugged-ad2b755f-6905-4256-be59-b64dae993293 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:14:39 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-d147b515-5937-40a9-9833-77e34433cf75 req-e30aeeab-7d7a-4d62-aada-9227505db4e2 service nova] Acquiring lock "6caf3667-5613-4ef4-a597-1820e6c1c0ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:14:39 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-d147b515-5937-40a9-9833-77e34433cf75 req-e30aeeab-7d7a-4d62-aada-9227505db4e2 service nova] Lock "6caf3667-5613-4ef4-a597-1820e6c1c0ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:14:39 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-d147b515-5937-40a9-9833-77e34433cf75 req-e30aeeab-7d7a-4d62-aada-9227505db4e2 service nova] Lock "6caf3667-5613-4ef4-a597-1820e6c1c0ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:14:39 user nova-compute[85141]: DEBUG nova.compute.manager [req-d147b515-5937-40a9-9833-77e34433cf75 req-e30aeeab-7d7a-4d62-aada-9227505db4e2 service nova] [instance: 6caf3667-5613-4ef4-a597-1820e6c1c0ac] No waiting events found dispatching network-vif-plugged-ad2b755f-6905-4256-be59-b64dae993293 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:14:39 user nova-compute[85141]: WARNING nova.compute.manager [req-d147b515-5937-40a9-9833-77e34433cf75 req-e30aeeab-7d7a-4d62-aada-9227505db4e2 service nova] [instance: 6caf3667-5613-4ef4-a597-1820e6c1c0ac] Received unexpected event network-vif-plugged-ad2b755f-6905-4256-be59-b64dae993293 for instance with vm_state active and task_state deleting.
Nov 16 10:14:39 user nova-compute[85141]: DEBUG nova.compute.manager [None req-ed8ee849-9f8b-4b00-a2c1-9551fad4909c tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] [instance: 9411843f-4e79-46c4-ae02-01f5e87b86eb] Instance event wait completed in 0 seconds for  {{(pid=85141) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 10:14:39 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-ed8ee849-9f8b-4b00-a2c1-9551fad4909c tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] [instance: 9411843f-4e79-46c4-ae02-01f5e87b86eb] Guest created on hypervisor {{(pid=85141) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 10:14:39 user nova-compute[85141]: INFO nova.virt.libvirt.driver [-] [instance: 9411843f-4e79-46c4-ae02-01f5e87b86eb] Instance spawned successfully.
Nov 16 10:14:39 user nova-compute[85141]: DEBUG nova.compute.manager [None req-ed8ee849-9f8b-4b00-a2c1-9551fad4909c tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] [instance: 9411843f-4e79-46c4-ae02-01f5e87b86eb] Checking state {{(pid=85141) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 10:14:39 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-ed8ee849-9f8b-4b00-a2c1-9551fad4909c tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Lock "9411843f-4e79-46c4-ae02-01f5e87b86eb" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 25.531s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:14:40 user nova-compute[85141]: DEBUG nova.network.neutron [None req-a2b65aa3-d523-4d97-aff8-0239f3f16e9a tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] [instance: e65ccf79-718d-4eeb-8914-f0db2e2c9ce2] Updating instance_info_cache with network_info: [{"id": "9b681ac7-3246-4ff4-8691-f8e4f1d62061", "address": "fa:16:3e:ce:f3:cd", "network": {"id": "ac11f3ed-4c14-4051-aff5-44d400d6368c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-679726958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7044a386486d4426bcccfe0b7d225c80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b681ac7-32", "ovs_interfaceid": "9b681ac7-3246-4ff4-8691-f8e4f1d62061", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:14:40 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-a2b65aa3-d523-4d97-aff8-0239f3f16e9a tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Releasing lock "refresh_cache-e65ccf79-718d-4eeb-8914-f0db2e2c9ce2" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:14:40 user nova-compute[85141]: DEBUG nova.network.neutron [-] [instance: 6caf3667-5613-4ef4-a597-1820e6c1c0ac] Updating instance_info_cache with network_info: [] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:14:40 user nova-compute[85141]: DEBUG nova.compute.manager [req-8bba1ce0-c3c1-4da2-946c-51d5b65af70d req-a3dee832-39c2-4347-b14a-1a2928ab070d service nova] [instance: 6caf3667-5613-4ef4-a597-1820e6c1c0ac] Received event network-vif-deleted-ad2b755f-6905-4256-be59-b64dae993293 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:14:40 user nova-compute[85141]: INFO nova.compute.manager [req-8bba1ce0-c3c1-4da2-946c-51d5b65af70d req-a3dee832-39c2-4347-b14a-1a2928ab070d service nova] [instance: 6caf3667-5613-4ef4-a597-1820e6c1c0ac] Neutron deleted interface ad2b755f-6905-4256-be59-b64dae993293; detaching it from the instance and deleting it from the info cache
Nov 16 10:14:40 user nova-compute[85141]: DEBUG nova.network.neutron [req-8bba1ce0-c3c1-4da2-946c-51d5b65af70d req-a3dee832-39c2-4347-b14a-1a2928ab070d service nova] [instance: 6caf3667-5613-4ef4-a597-1820e6c1c0ac] Updating instance_info_cache with network_info: [] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:14:40 user nova-compute[85141]: INFO nova.compute.manager [-] [instance: 6caf3667-5613-4ef4-a597-1820e6c1c0ac] Took 1.18 seconds to deallocate network for instance.
Nov 16 10:14:40 user nova-compute[85141]: DEBUG nova.compute.manager [req-8bba1ce0-c3c1-4da2-946c-51d5b65af70d req-a3dee832-39c2-4347-b14a-1a2928ab070d service nova] [instance: 6caf3667-5613-4ef4-a597-1820e6c1c0ac] Detach interface failed, port_id=ad2b755f-6905-4256-be59-b64dae993293, reason: Instance 6caf3667-5613-4ef4-a597-1820e6c1c0ac could not be found. {{(pid=85141) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 16 10:14:40 user nova-compute[85141]: DEBUG os_brick.utils [None req-a2b65aa3-d523-4d97-aff8-0239f3f16e9a tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 10:14:40 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:14:40 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:14:40 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[13fc38d2-10d8-48b4-bc89-7858b35c6b1b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c7834de5c295\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:14:40 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:14:40 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:14:40 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[b608ba2f-30fa-4591-b14b-038578f4d3b9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:14:40 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:14:40 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.030s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:14:40 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[1af533e8-bca1-452a-a69c-9faa889abc03]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:14:40 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2f04f54-2372-45db-a02e-e07011d03f41]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:14:40 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-a2b65aa3-d523-4d97-aff8-0239f3f16e9a tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Running cmd (subprocess): nvme version {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:14:40 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-a2b65aa3-d523-4d97-aff8-0239f3f16e9a tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] 'nvme version' failed. Not Retrying. {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 10:14:40 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a2b65aa3-d523-4d97-aff8-0239f3f16e9a tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] nvme not present on system {{(pid=85141) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 10:14:40 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:14:40 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 10:14:40 user nova-compute[85141]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 10:14:40 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[db1f41b7-2fae-4275-ac70-c6e5a15c14fc]: (4, '') {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:14:40 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.lightos [None req-a2b65aa3-d523-4d97-aff8-0239f3f16e9a tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=85141) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 10:14:40 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.lightos [None req-a2b65aa3-d523-4d97-aff8-0239f3f16e9a tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=85141) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 10:14:40 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.lightos [None req-a2b65aa3-d523-4d97-aff8-0239f3f16e9a tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] LIGHTOS: no hostnqn found. {{(pid=85141) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 10:14:40 user nova-compute[85141]: DEBUG os_brick.utils [None req-a2b65aa3-d523-4d97-aff8-0239f3f16e9a tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c7834de5c295', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 10:14:41 user nova-compute[85141]: INFO nova.compute.manager [None req-3c6a1200-4c46-4b97-b3ab-974c44ee3d80 tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] [instance: 6caf3667-5613-4ef4-a597-1820e6c1c0ac] Took 1.09 seconds to detach 1 volumes for instance.
Nov 16 10:14:41 user nova-compute[85141]: DEBUG nova.compute.manager [None req-3c6a1200-4c46-4b97-b3ab-974c44ee3d80 tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] [instance: 6caf3667-5613-4ef4-a597-1820e6c1c0ac] Deleting volume: 42c041ec-fa39-4035-b82b-867caf3565df {{(pid=85141) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 16 10:14:41 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-3c6a1200-4c46-4b97-b3ab-974c44ee3d80 tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:14:41 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-3c6a1200-4c46-4b97-b3ab-974c44ee3d80 tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:14:41 user nova-compute[85141]: DEBUG nova.compute.provider_tree [None req-3c6a1200-4c46-4b97-b3ab-974c44ee3d80 tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] Inventory has not changed in ProviderTree for provider: bf8e0fa1-16b6-408f-9203-c4cd63916272 {{(pid=85141) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 10:14:41 user nova-compute[85141]: DEBUG nova.scheduler.client.report [None req-3c6a1200-4c46-4b97-b3ab-974c44ee3d80 tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] Inventory has not changed for provider bf8e0fa1-16b6-408f-9203-c4cd63916272 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=85141) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 10:14:41 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-3c6a1200-4c46-4b97-b3ab-974c44ee3d80 tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.383s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:14:41 user nova-compute[85141]: INFO nova.scheduler.client.report [None req-3c6a1200-4c46-4b97-b3ab-974c44ee3d80 tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] Deleted allocations for instance 6caf3667-5613-4ef4-a597-1820e6c1c0ac
Nov 16 10:14:42 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-3c6a1200-4c46-4b97-b3ab-974c44ee3d80 tempest-ServerActionsV293TestJSON-1581977623 tempest-ServerActionsV293TestJSON-1581977623-project-member] Lock "6caf3667-5613-4ef4-a597-1820e6c1c0ac" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.350s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:14:42 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:14:43 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:14:48 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:14:53 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-a2b65aa3-d523-4d97-aff8-0239f3f16e9a tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] [instance: e65ccf79-718d-4eeb-8914-f0db2e2c9ce2] Starting finish_migration {{(pid=85141) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Nov 16 10:14:53 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-a2b65aa3-d523-4d97-aff8-0239f3f16e9a tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] [instance: e65ccf79-718d-4eeb-8914-f0db2e2c9ce2] Instance directory exists: not creating {{(pid=85141) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 16 10:14:53 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-a2b65aa3-d523-4d97-aff8-0239f3f16e9a tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] [instance: e65ccf79-718d-4eeb-8914-f0db2e2c9ce2] Creating image(s)
Nov 16 10:14:53 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-a2b65aa3-d523-4d97-aff8-0239f3f16e9a tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:14:53 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:14:53 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-a2b65aa3-d523-4d97-aff8-0239f3f16e9a tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json" returned: 0 in 0.209s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:14:53 user nova-compute[85141]: DEBUG nova.virt.disk.api [None req-a2b65aa3-d523-4d97-aff8-0239f3f16e9a tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e65ccf79-718d-4eeb-8914-f0db2e2c9ce2/disk. size=21474836480 {{(pid=85141) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 10:14:53 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-a2b65aa3-d523-4d97-aff8-0239f3f16e9a tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e65ccf79-718d-4eeb-8914-f0db2e2c9ce2/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:14:53 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-a2b65aa3-d523-4d97-aff8-0239f3f16e9a tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e65ccf79-718d-4eeb-8914-f0db2e2c9ce2/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:14:53 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-a2b65aa3-d523-4d97-aff8-0239f3f16e9a tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/e65ccf79-718d-4eeb-8914-f0db2e2c9ce2/disk 21474836480 {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:14:54 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-a2b65aa3-d523-4d97-aff8-0239f3f16e9a tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/e65ccf79-718d-4eeb-8914-f0db2e2c9ce2/disk 21474836480" returned: 0 in 0.063s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:14:54 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-a2b65aa3-d523-4d97-aff8-0239f3f16e9a tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] [instance: e65ccf79-718d-4eeb-8914-f0db2e2c9ce2] Did not create local disks {{(pid=85141) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 16 10:14:54 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-a2b65aa3-d523-4d97-aff8-0239f3f16e9a tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] [instance: e65ccf79-718d-4eeb-8914-f0db2e2c9ce2] Ensure instance console log exists: /opt/stack/data/nova/instances/e65ccf79-718d-4eeb-8914-f0db2e2c9ce2/console.log {{(pid=85141) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 10:14:54 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-a2b65aa3-d523-4d97-aff8-0239f3f16e9a tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:14:54 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-a2b65aa3-d523-4d97-aff8-0239f3f16e9a tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:14:54 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-a2b65aa3-d523-4d97-aff8-0239f3f16e9a tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:14:54 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-a2b65aa3-d523-4d97-aff8-0239f3f16e9a tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] [instance: e65ccf79-718d-4eeb-8914-f0db2e2c9ce2] Start _get_guest_xml network_info=[{"id": "9b681ac7-3246-4ff4-8691-f8e4f1d62061", "address": "fa:16:3e:ce:f3:cd", "network": {"id": "ac11f3ed-4c14-4051-aff5-44d400d6368c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-679726958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-679726958-network", "vif_mac": "fa:16:3e:ce:f3:cd"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7044a386486d4426bcccfe0b7d225c80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b681ac7-32", "ovs_interfaceid": "9b681ac7-3246-4ff4-8691-f8e4f1d62061", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T10:06:42Z,direct_url=<?>,disk_format='qcow2',id=bc4ca70f-a459-4d5c-a9e6-80f1948eb48b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1044631a5fe84ce8904864a7024049fa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T10:06:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_options': None, 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'image_id': 'bc4ca70f-a459-4d5c-a9e6-80f1948eb48b'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:abda547a-8d00-4a02-a6e4-d0670e47815a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RgkfZDbl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'e65ccf79-718d-4eeb-8914-f0db2e2c9ce2', 'attached_at': '2023-11-16T10:14:53.000000', 'detached_at': '', 'volume_id': 'abda547a-8d00-4a02-a6e4-d0670e47815a', 'serial': 'abda547a-8d00-4a02-a6e4-d0670e47815a'}, 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'boot_index': None, 'attachment_id': '6d82220c-73c2-44fa-b26e-a5dd481de181', 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=85141) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 10:14:54 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-a2b65aa3-d523-4d97-aff8-0239f3f16e9a tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:14:54 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-a2b65aa3-d523-4d97-aff8-0239f3f16e9a tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:14:54 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-a2b65aa3-d523-4d97-aff8-0239f3f16e9a tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=85141) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 10:14:54 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-a2b65aa3-d523-4d97-aff8-0239f3f16e9a tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] CPU controller missing on host. {{(pid=85141) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 10:14:54 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-a2b65aa3-d523-4d97-aff8-0239f3f16e9a tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=85141) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 10:14:54 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-a2b65aa3-d523-4d97-aff8-0239f3f16e9a tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] CPU controller found on host. {{(pid=85141) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 10:14:54 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-a2b65aa3-d523-4d97-aff8-0239f3f16e9a tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=85141) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 10:14:54 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-a2b65aa3-d523-4d97-aff8-0239f3f16e9a tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T10:06:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T10:06:42Z,direct_url=<?>,disk_format='qcow2',id=bc4ca70f-a459-4d5c-a9e6-80f1948eb48b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1044631a5fe84ce8904864a7024049fa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T10:06:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 10:14:54 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-a2b65aa3-d523-4d97-aff8-0239f3f16e9a tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Flavor limits 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 10:14:54 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-a2b65aa3-d523-4d97-aff8-0239f3f16e9a tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Image limits 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 10:14:54 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-a2b65aa3-d523-4d97-aff8-0239f3f16e9a tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Flavor pref 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 10:14:54 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-a2b65aa3-d523-4d97-aff8-0239f3f16e9a tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Image pref 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 10:14:54 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-a2b65aa3-d523-4d97-aff8-0239f3f16e9a tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 10:14:54 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-a2b65aa3-d523-4d97-aff8-0239f3f16e9a tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 10:14:54 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-a2b65aa3-d523-4d97-aff8-0239f3f16e9a tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=85141) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 10:14:54 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-a2b65aa3-d523-4d97-aff8-0239f3f16e9a tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Got 1 possible topologies {{(pid=85141) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 10:14:54 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-a2b65aa3-d523-4d97-aff8-0239f3f16e9a tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 10:14:54 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-a2b65aa3-d523-4d97-aff8-0239f3f16e9a tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 10:14:54 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a2b65aa3-d523-4d97-aff8-0239f3f16e9a tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] [instance: e65ccf79-718d-4eeb-8914-f0db2e2c9ce2] Calling os-brick to attach iSCSI Volume {{(pid=85141) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 10:14:54 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2b65aa3-d523-4d97-aff8-0239f3f16e9a tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51806b6080>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:abda547a-8d00-4a02-a6e4-d0670e47815a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RgkfZDbl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 10:14:54 user nova-compute[85141]: WARNING os_brick.initiator.connectors.base [None req-a2b65aa3-d523-4d97-aff8-0239f3f16e9a tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 10:14:54 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-a2b65aa3-d523-4d97-aff8-0239f3f16e9a tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 10:14:54 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-a2b65aa3-d523-4d97-aff8-0239f3f16e9a tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 10:14:54 user nova-compute[85141]: WARNING os_brick.initiator.connectors.base [None req-a2b65aa3-d523-4d97-aff8-0239f3f16e9a tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 10:14:54 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-a2b65aa3-d523-4d97-aff8-0239f3f16e9a tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:abda547a-8d00-4a02-a6e4-d0670e47815a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 10:14:54 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-a2b65aa3-d523-4d97-aff8-0239f3f16e9a tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:abda547a-8d00-4a02-a6e4-d0670e47815a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 10:14:54 user nova-compute[85141]: INFO os_brick.initiator.connectors.iscsi [None req-a2b65aa3-d523-4d97-aff8-0239f3f16e9a tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 10:14:54 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abda547a-8d00-4a02-a6e4-d0670e47815a -p 172.16.0.220:3260 {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:14:54 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abda547a-8d00-4a02-a6e4-d0670e47815a -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:14:54 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[557962d9-cf19-4a50-8ddc-d40738d9c4f4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:14:54 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2b65aa3-d523-4d97-aff8-0239f3f16e9a tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 10:14:54 user nova-compute[85141]:  {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:14:54 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abda547a-8d00-4a02-a6e4-d0670e47815a -p 172.16.0.220:3260 --interface default --op new {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:14:54 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abda547a-8d00-4a02-a6e4-d0670e47815a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:14:54 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[888836b9-4010-44e5-8db5-069d428c69c6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:abda547a-8d00-4a02-a6e4-d0670e47815a] added\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:14:54 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2b65aa3-d523-4d97-aff8-0239f3f16e9a tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:abda547a-8d00-4a02-a6e4-d0670e47815a] added
Nov 16 10:14:54 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:14:54 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abda547a-8d00-4a02-a6e4-d0670e47815a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:14:54 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abda547a-8d00-4a02-a6e4-d0670e47815a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:14:54 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc14d0ea-1d30-4345-9a07-dee4ecfb89d1]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:14:54 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2b65aa3-d523-4d97-aff8-0239f3f16e9a tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:14:54 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abda547a-8d00-4a02-a6e4-d0670e47815a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:14:54 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abda547a-8d00-4a02-a6e4-d0670e47815a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:14:54 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[5186d410-7a53-4c22-833f-2395490e4bf8]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:14:54 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2b65aa3-d523-4d97-aff8-0239f3f16e9a tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:14:54 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abda547a-8d00-4a02-a6e4-d0670e47815a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RgkfZDbl {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:14:54 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abda547a-8d00-4a02-a6e4-d0670e47815a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RgkfZDbl" returned: 0 in 0.028s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:14:54 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cbef29c-15f6-42be-a3c3-22685aa4a675]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:14:54 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2b65aa3-d523-4d97-aff8-0239f3f16e9a tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RgkfZDbl'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:14:54 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abda547a-8d00-4a02-a6e4-d0670e47815a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:14:54 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abda547a-8d00-4a02-a6e4-d0670e47815a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:14:54 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f12d967-b774-4b91-9d4d-16316d1ef21c]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:14:54 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2b65aa3-d523-4d97-aff8-0239f3f16e9a tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:14:54 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:14:54 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:14:54 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d65f40a-9a5a-419a-980c-654a7bc72342]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c94ff08f-badb-4203-b3af-e418025d1f0d (non-flash)\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:14:54 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2b65aa3-d523-4d97-aff8-0239f3f16e9a tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)
Nov 16 10:14:54 user nova-compute[85141]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c94ff08f-badb-4203-b3af-e418025d1f0d (non-flash)
Nov 16 10:14:54 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:14:54 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2b65aa3-d523-4d97-aff8-0239f3f16e9a tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)
Nov 16 10:14:54 user nova-compute[85141]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c94ff08f-badb-4203-b3af-e418025d1f0d (non-flash)
Nov 16 10:14:54 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 10:14:54 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abda547a-8d00-4a02-a6e4-d0670e47815a -p 172.16.0.220:3260 --login {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:14:54 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abda547a-8d00-4a02-a6e4-d0670e47815a -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:14:54 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[4323fefd-1052-452d-88ea-36c721eb0c55]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:abda547a-8d00-4a02-a6e4-d0670e47815a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:abda547a-8d00-4a02-a6e4-d0670e47815a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:14:54 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2b65aa3-d523-4d97-aff8-0239f3f16e9a tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:abda547a-8d00-4a02-a6e4-d0670e47815a, portal: 172.16.0.220,3260]
Nov 16 10:14:54 user nova-compute[85141]: Login to [iface: default, target: iqn.2010-10.org.openstack:abda547a-8d00-4a02-a6e4-d0670e47815a, portal: 172.16.0.220,3260] successful.
Nov 16 10:14:54 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:14:54 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abda547a-8d00-4a02-a6e4-d0670e47815a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:14:54 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abda547a-8d00-4a02-a6e4-d0670e47815a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:14:54 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[835938b9-202b-42b8-afb5-f80063fcbaa8]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:14:54 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2b65aa3-d523-4d97-aff8-0239f3f16e9a tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:14:54 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:14:54 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:14:54 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5f77b35-e8af-468c-b3e0-08f5dc77a2e4]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c94ff08f-badb-4203-b3af-e418025d1f0d (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abda547a-8d00-4a02-a6e4-d0670e47815a (non-flash)\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:14:54 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2b65aa3-d523-4d97-aff8-0239f3f16e9a tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)
Nov 16 10:14:54 user nova-compute[85141]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c94ff08f-badb-4203-b3af-e418025d1f0d (non-flash)
Nov 16 10:14:54 user nova-compute[85141]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abda547a-8d00-4a02-a6e4-d0670e47815a (non-flash)
Nov 16 10:14:54 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:14:54 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2b65aa3-d523-4d97-aff8-0239f3f16e9a tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)
Nov 16 10:14:54 user nova-compute[85141]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c94ff08f-badb-4203-b3af-e418025d1f0d (non-flash)
Nov 16 10:14:54 user nova-compute[85141]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abda547a-8d00-4a02-a6e4-d0670e47815a (non-flash)
Nov 16 10:14:54 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 10:14:54 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-a2b65aa3-d523-4d97-aff8-0239f3f16e9a tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:abda547a-8d00-4a02-a6e4-d0670e47815a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.318s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 10:14:54 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2b65aa3-d523-4d97-aff8-0239f3f16e9a tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Connected to 172.16.0.220:3260 {{(pid=85141) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 10:14:54 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-a2b65aa3-d523-4d97-aff8-0239f3f16e9a tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] HCTL ('33', '-', '-', 0) found on session 19 with lun 0 {{(pid=85141) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 10:14:54 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-a2b65aa3-d523-4d97-aff8-0239f3f16e9a tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=85141) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 10:14:54 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:14:54 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:14:54 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3f6609a-04b4-4098-9cd9-fe0d6ec4e191]: (4, ('- - 0', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:14:54 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-a2b65aa3-d523-4d97-aff8-0239f3f16e9a tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Searching for a device in session 19 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=85141) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 10:14:54 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2b65aa3-d523-4d97-aff8-0239f3f16e9a tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:abda547a-8d00-4a02-a6e4-d0670e47815a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RgkfZDbl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=85141) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 10:14:55 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:14:55 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-a2b65aa3-d523-4d97-aff8-0239f3f16e9a tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.356s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 10:14:55 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2b65aa3-d523-4d97-aff8-0239f3f16e9a tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] <== connect_volume: return (1358ms) {'type': 'block', 'scsi_wwn': '26131616434303532', 'path': '/dev/sdb'} {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 10:14:55 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a2b65aa3-d523-4d97-aff8-0239f3f16e9a tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] [instance: e65ccf79-718d-4eeb-8914-f0db2e2c9ce2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26131616434303532', 'path': '/dev/sdb'} {{(pid=85141) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 10:14:55 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-a2b65aa3-d523-4d97-aff8-0239f3f16e9a tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T10:10:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-2047998705',display_name='tempest-ServerActionsTestOtherB-server-2047998705',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-2047998705',id=4,image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHf5WUZHhTvllxOmAg72z1YtUbpT94pAZ2VioYM/1ZPcnLSsLgh6rPndkFT+8xfTCaDEevGxVERzODZXR4Exh9KNRXP3xfU1ZBhWrD+YWL3uQCHfG8ms6Vv5yEaXpnuCDg==',key_name='tempest-keypair-2137833999',keypairs=<?>,launch_index=0,launched_at=2023-11-16T10:10:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='7044a386486d4426bcccfe0b7d225c80',ramdisk_id='',reservation_id='r-2q3wdtbp',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-876168065',owner_user_name='tempest-ServerActionsTestOtherB-876168065-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T10:14:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='776d4157be1a4e56a8821d50da998475',uuid=e65ccf79-718d-4eeb-8914-f0db2e2c9ce2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9b681ac7-3246-4ff4-8691-f8e4f1d62061", "address": "fa:16:3e:ce:f3:cd", "network": {"id": "ac11f3ed-4c14-4051-aff5-44d400d6368c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-679726958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-679726958-network", "vif_mac": "fa:16:3e:ce:f3:cd"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7044a386486d4426bcccfe0b7d225c80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b681ac7-32", "ovs_interfaceid": "9b681ac7-3246-4ff4-8691-f8e4f1d62061", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=85141) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 10:14:55 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-a2b65aa3-d523-4d97-aff8-0239f3f16e9a tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Converting VIF {"id": "9b681ac7-3246-4ff4-8691-f8e4f1d62061", "address": "fa:16:3e:ce:f3:cd", "network": {"id": "ac11f3ed-4c14-4051-aff5-44d400d6368c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-679726958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-679726958-network", "vif_mac": "fa:16:3e:ce:f3:cd"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7044a386486d4426bcccfe0b7d225c80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b681ac7-32", "ovs_interfaceid": "9b681ac7-3246-4ff4-8691-f8e4f1d62061", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:14:55 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-a2b65aa3-d523-4d97-aff8-0239f3f16e9a tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ce:f3:cd,bridge_name='br-int',has_traffic_filtering=True,id=9b681ac7-3246-4ff4-8691-f8e4f1d62061,network=Network(ac11f3ed-4c14-4051-aff5-44d400d6368c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b681ac7-32') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:14:55 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-a2b65aa3-d523-4d97-aff8-0239f3f16e9a tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] [instance: e65ccf79-718d-4eeb-8914-f0db2e2c9ce2] End _get_guest_xml xml=<domain type="kvm">
Nov 16 10:14:55 user nova-compute[85141]:   <uuid>e65ccf79-718d-4eeb-8914-f0db2e2c9ce2</uuid>
Nov 16 10:14:55 user nova-compute[85141]:   <name>instance-00000004</name>
Nov 16 10:14:55 user nova-compute[85141]:   <memory>2097152</memory>
Nov 16 10:14:55 user nova-compute[85141]:   <vcpu>1</vcpu>
Nov 16 10:14:55 user nova-compute[85141]:   <metadata>
Nov 16 10:14:55 user nova-compute[85141]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 10:14:55 user nova-compute[85141]:       <nova:package version="0.0.0"/>
Nov 16 10:14:55 user nova-compute[85141]:       <nova:name>tempest-ServerActionsTestOtherB-server-2047998705</nova:name>
Nov 16 10:14:55 user nova-compute[85141]:       <nova:creationTime>2023-11-16 10:14:54</nova:creationTime>
Nov 16 10:14:55 user nova-compute[85141]:       <nova:flavor name="m1.small">
Nov 16 10:14:55 user nova-compute[85141]:         <nova:memory>2048</nova:memory>
Nov 16 10:14:55 user nova-compute[85141]:         <nova:disk>20</nova:disk>
Nov 16 10:14:55 user nova-compute[85141]:         <nova:swap>0</nova:swap>
Nov 16 10:14:55 user nova-compute[85141]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 10:14:55 user nova-compute[85141]:         <nova:vcpus>1</nova:vcpus>
Nov 16 10:14:55 user nova-compute[85141]:       </nova:flavor>
Nov 16 10:14:55 user nova-compute[85141]:       <nova:owner>
Nov 16 10:14:55 user nova-compute[85141]:         <nova:user uuid="776d4157be1a4e56a8821d50da998475">tempest-ServerActionsTestOtherB-876168065-project-member</nova:user>
Nov 16 10:14:55 user nova-compute[85141]:         <nova:project uuid="7044a386486d4426bcccfe0b7d225c80">tempest-ServerActionsTestOtherB-876168065</nova:project>
Nov 16 10:14:55 user nova-compute[85141]:       </nova:owner>
Nov 16 10:14:55 user nova-compute[85141]:       <nova:root type="image" uuid="bc4ca70f-a459-4d5c-a9e6-80f1948eb48b"/>
Nov 16 10:14:55 user nova-compute[85141]:       <nova:ports>
Nov 16 10:14:55 user nova-compute[85141]:         <nova:port uuid="9b681ac7-3246-4ff4-8691-f8e4f1d62061">
Nov 16 10:14:55 user nova-compute[85141]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 16 10:14:55 user nova-compute[85141]:         </nova:port>
Nov 16 10:14:55 user nova-compute[85141]:       </nova:ports>
Nov 16 10:14:55 user nova-compute[85141]:     </nova:instance>
Nov 16 10:14:55 user nova-compute[85141]:   </metadata>
Nov 16 10:14:55 user nova-compute[85141]:   <sysinfo type="smbios">
Nov 16 10:14:55 user nova-compute[85141]:     <system>
Nov 16 10:14:55 user nova-compute[85141]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 10:14:55 user nova-compute[85141]:       <entry name="product">OpenStack Nova</entry>
Nov 16 10:14:55 user nova-compute[85141]:       <entry name="version">0.0.0</entry>
Nov 16 10:14:55 user nova-compute[85141]:       <entry name="serial">e65ccf79-718d-4eeb-8914-f0db2e2c9ce2</entry>
Nov 16 10:14:55 user nova-compute[85141]:       <entry name="uuid">e65ccf79-718d-4eeb-8914-f0db2e2c9ce2</entry>
Nov 16 10:14:55 user nova-compute[85141]:       <entry name="family">Virtual Machine</entry>
Nov 16 10:14:55 user nova-compute[85141]:     </system>
Nov 16 10:14:55 user nova-compute[85141]:   </sysinfo>
Nov 16 10:14:55 user nova-compute[85141]:   <os>
Nov 16 10:14:55 user nova-compute[85141]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 10:14:55 user nova-compute[85141]:     <boot dev="hd"/>
Nov 16 10:14:55 user nova-compute[85141]:     <smbios mode="sysinfo"/>
Nov 16 10:14:55 user nova-compute[85141]:   </os>
Nov 16 10:14:55 user nova-compute[85141]:   <features>
Nov 16 10:14:55 user nova-compute[85141]:     <acpi/>
Nov 16 10:14:55 user nova-compute[85141]:     <apic/>
Nov 16 10:14:55 user nova-compute[85141]:     <vmcoreinfo/>
Nov 16 10:14:55 user nova-compute[85141]:   </features>
Nov 16 10:14:55 user nova-compute[85141]:   <clock offset="utc">
Nov 16 10:14:55 user nova-compute[85141]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 10:14:55 user nova-compute[85141]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 10:14:55 user nova-compute[85141]:     <timer name="hpet" present="no"/>
Nov 16 10:14:55 user nova-compute[85141]:   </clock>
Nov 16 10:14:55 user nova-compute[85141]:   <cpu mode="custom" match="exact">
Nov 16 10:14:55 user nova-compute[85141]:     <model>Nehalem</model>
Nov 16 10:14:55 user nova-compute[85141]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 10:14:55 user nova-compute[85141]:   </cpu>
Nov 16 10:14:55 user nova-compute[85141]:   <devices>
Nov 16 10:14:55 user nova-compute[85141]:     <disk type="file" device="disk">
Nov 16 10:14:55 user nova-compute[85141]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 10:14:55 user nova-compute[85141]:       <source file="/opt/stack/data/nova/instances/e65ccf79-718d-4eeb-8914-f0db2e2c9ce2/disk"/>
Nov 16 10:14:55 user nova-compute[85141]:       <target dev="vda" bus="virtio"/>
Nov 16 10:14:55 user nova-compute[85141]:     </disk>
Nov 16 10:14:55 user nova-compute[85141]:     <disk type="block" device="disk">
Nov 16 10:14:55 user nova-compute[85141]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 10:14:55 user nova-compute[85141]:       <source dev="/dev/sdb"/>
Nov 16 10:14:55 user nova-compute[85141]:       <target dev="vdb" bus="virtio"/>
Nov 16 10:14:55 user nova-compute[85141]:       <serial>abda547a-8d00-4a02-a6e4-d0670e47815a</serial>
Nov 16 10:14:55 user nova-compute[85141]:     </disk>
Nov 16 10:14:55 user nova-compute[85141]:     <interface type="ethernet">
Nov 16 10:14:55 user nova-compute[85141]:       <mac address="fa:16:3e:ce:f3:cd"/>
Nov 16 10:14:55 user nova-compute[85141]:       <model type="virtio"/>
Nov 16 10:14:55 user nova-compute[85141]:       <mtu size="1442"/>
Nov 16 10:14:55 user nova-compute[85141]:       <target dev="tap9b681ac7-32"/>
Nov 16 10:14:55 user nova-compute[85141]:     </interface>
Nov 16 10:14:55 user nova-compute[85141]:     <serial type="pty">
Nov 16 10:14:55 user nova-compute[85141]:       <log file="/opt/stack/data/nova/instances/e65ccf79-718d-4eeb-8914-f0db2e2c9ce2/console.log" append="off"/>
Nov 16 10:14:55 user nova-compute[85141]:     </serial>
Nov 16 10:14:55 user nova-compute[85141]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 10:14:55 user nova-compute[85141]:     <video>
Nov 16 10:14:55 user nova-compute[85141]:       <model type="virtio"/>
Nov 16 10:14:55 user nova-compute[85141]:     </video>
Nov 16 10:14:55 user nova-compute[85141]:     <rng model="virtio">
Nov 16 10:14:55 user nova-compute[85141]:       <backend model="random">/dev/urandom</backend>
Nov 16 10:14:55 user nova-compute[85141]:     </rng>
Nov 16 10:14:55 user nova-compute[85141]:     <controller type="usb" index="0" model="none"/>
Nov 16 10:14:55 user nova-compute[85141]:     <memballoon model="virtio">
Nov 16 10:14:55 user nova-compute[85141]:       <stats period="10"/>
Nov 16 10:14:55 user nova-compute[85141]:     </memballoon>
Nov 16 10:14:55 user nova-compute[85141]:   </devices>
Nov 16 10:14:55 user nova-compute[85141]: </domain>
Nov 16 10:14:55 user nova-compute[85141]:  {{(pid=85141) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 10:14:55 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-a2b65aa3-d523-4d97-aff8-0239f3f16e9a tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T10:10:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-2047998705',display_name='tempest-ServerActionsTestOtherB-server-2047998705',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-2047998705',id=4,image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHf5WUZHhTvllxOmAg72z1YtUbpT94pAZ2VioYM/1ZPcnLSsLgh6rPndkFT+8xfTCaDEevGxVERzODZXR4Exh9KNRXP3xfU1ZBhWrD+YWL3uQCHfG8ms6Vv5yEaXpnuCDg==',key_name='tempest-keypair-2137833999',keypairs=<?>,launch_index=0,launched_at=2023-11-16T10:10:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='7044a386486d4426bcccfe0b7d225c80',ramdisk_id='',reservation_id='r-2q3wdtbp',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-876168065',owner_user_name='tempest-ServerActionsTestOtherB-876168065-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T10:14:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='776d4157be1a4e56a8821d50da998475',uuid=e65ccf79-718d-4eeb-8914-f0db2e2c9ce2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9b681ac7-3246-4ff4-8691-f8e4f1d62061", "address": "fa:16:3e:ce:f3:cd", "network": {"id": "ac11f3ed-4c14-4051-aff5-44d400d6368c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-679726958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-679726958-network", "vif_mac": "fa:16:3e:ce:f3:cd"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7044a386486d4426bcccfe0b7d225c80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b681ac7-32", "ovs_interfaceid": "9b681ac7-3246-4ff4-8691-f8e4f1d62061", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 10:14:55 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-a2b65aa3-d523-4d97-aff8-0239f3f16e9a tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Converting VIF {"id": "9b681ac7-3246-4ff4-8691-f8e4f1d62061", "address": "fa:16:3e:ce:f3:cd", "network": {"id": "ac11f3ed-4c14-4051-aff5-44d400d6368c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-679726958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-679726958-network", "vif_mac": "fa:16:3e:ce:f3:cd"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7044a386486d4426bcccfe0b7d225c80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b681ac7-32", "ovs_interfaceid": "9b681ac7-3246-4ff4-8691-f8e4f1d62061", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:14:55 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-a2b65aa3-d523-4d97-aff8-0239f3f16e9a tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ce:f3:cd,bridge_name='br-int',has_traffic_filtering=True,id=9b681ac7-3246-4ff4-8691-f8e4f1d62061,network=Network(ac11f3ed-4c14-4051-aff5-44d400d6368c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b681ac7-32') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:14:55 user nova-compute[85141]: DEBUG os_vif [None req-a2b65aa3-d523-4d97-aff8-0239f3f16e9a tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:f3:cd,bridge_name='br-int',has_traffic_filtering=True,id=9b681ac7-3246-4ff4-8691-f8e4f1d62061,network=Network(ac11f3ed-4c14-4051-aff5-44d400d6368c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b681ac7-32') {{(pid=85141) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 10:14:55 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:14:55 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:14:55 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 10:14:55 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:14:55 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '35f4821b-45c4-5ae4-a8ad-c144be9ebb20', '_type': 'linux-noop'}}, row=False) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:14:55 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:14:55 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:14:55 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:14:55 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9b681ac7-32, may_exist=True, interface_attrs={}) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:14:55 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9b681ac7-32, col_values=(('qos', UUID('27bd63f1-a26c-45cf-9c91-56902b29f2ea')),), if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:14:55 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9b681ac7-32, col_values=(('external_ids', {'iface-id': '9b681ac7-3246-4ff4-8691-f8e4f1d62061', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ce:f3:cd', 'vm-uuid': 'e65ccf79-718d-4eeb-8914-f0db2e2c9ce2'}),), if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:14:55 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:14:55 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:14:55 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:14:55 user nova-compute[85141]: INFO os_vif [None req-a2b65aa3-d523-4d97-aff8-0239f3f16e9a tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:f3:cd,bridge_name='br-int',has_traffic_filtering=True,id=9b681ac7-3246-4ff4-8691-f8e4f1d62061,network=Network(ac11f3ed-4c14-4051-aff5-44d400d6368c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b681ac7-32')
Nov 16 10:14:55 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-a2b65aa3-d523-4d97-aff8-0239f3f16e9a tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] No BDM found with device name vda, not building metadata. {{(pid=85141) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 10:14:55 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-a2b65aa3-d523-4d97-aff8-0239f3f16e9a tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] No BDM found with device name vdb, not building metadata. {{(pid=85141) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 10:14:55 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-a2b65aa3-d523-4d97-aff8-0239f3f16e9a tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] No VIF found with MAC fa:16:3e:ce:f3:cd, not building metadata {{(pid=85141) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 10:14:57 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:14:57 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:14:57 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:14:57 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:14:57 user nova-compute[85141]: DEBUG nova.compute.manager [req-c265f677-2acc-4e95-a89d-1ca5de3b82dc req-088d081a-bd12-427f-af01-3e88680b4893 service nova] [instance: e65ccf79-718d-4eeb-8914-f0db2e2c9ce2] Received event network-vif-plugged-9b681ac7-3246-4ff4-8691-f8e4f1d62061 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:14:57 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-c265f677-2acc-4e95-a89d-1ca5de3b82dc req-088d081a-bd12-427f-af01-3e88680b4893 service nova] Acquiring lock "e65ccf79-718d-4eeb-8914-f0db2e2c9ce2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:14:57 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-c265f677-2acc-4e95-a89d-1ca5de3b82dc req-088d081a-bd12-427f-af01-3e88680b4893 service nova] Lock "e65ccf79-718d-4eeb-8914-f0db2e2c9ce2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:14:57 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-c265f677-2acc-4e95-a89d-1ca5de3b82dc req-088d081a-bd12-427f-af01-3e88680b4893 service nova] Lock "e65ccf79-718d-4eeb-8914-f0db2e2c9ce2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:14:57 user nova-compute[85141]: DEBUG nova.compute.manager [req-c265f677-2acc-4e95-a89d-1ca5de3b82dc req-088d081a-bd12-427f-af01-3e88680b4893 service nova] [instance: e65ccf79-718d-4eeb-8914-f0db2e2c9ce2] No waiting events found dispatching network-vif-plugged-9b681ac7-3246-4ff4-8691-f8e4f1d62061 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:14:57 user nova-compute[85141]: WARNING nova.compute.manager [req-c265f677-2acc-4e95-a89d-1ca5de3b82dc req-088d081a-bd12-427f-af01-3e88680b4893 service nova] [instance: e65ccf79-718d-4eeb-8914-f0db2e2c9ce2] Received unexpected event network-vif-plugged-9b681ac7-3246-4ff4-8691-f8e4f1d62061 for instance with vm_state active and task_state resize_finish.
Nov 16 10:14:57 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:14:57 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:14:57 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:14:58 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:14:59 user nova-compute[85141]: DEBUG nova.compute.manager [None req-a2b65aa3-d523-4d97-aff8-0239f3f16e9a tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] [instance: e65ccf79-718d-4eeb-8914-f0db2e2c9ce2] Instance event wait completed in 0 seconds for  {{(pid=85141) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 10:14:59 user nova-compute[85141]: INFO nova.virt.libvirt.driver [-] [instance: e65ccf79-718d-4eeb-8914-f0db2e2c9ce2] Instance running successfully.
Nov 16 10:14:59 user nova-compute[85141]: DEBUG nova.virt.libvirt.guest [None req-a2b65aa3-d523-4d97-aff8-0239f3f16e9a tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] [instance: e65ccf79-718d-4eeb-8914-f0db2e2c9ce2] Failed to set time: agent not configured {{(pid=85141) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Nov 16 10:14:59 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-a2b65aa3-d523-4d97-aff8-0239f3f16e9a tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] [instance: e65ccf79-718d-4eeb-8914-f0db2e2c9ce2] finish_migration finished successfully. {{(pid=85141) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Nov 16 10:14:59 user nova-compute[85141]: DEBUG nova.compute.manager [req-d5bf9b8c-257c-426d-ad56-5e86b94ce26e req-6333ae48-5bfc-43eb-85e3-efe9792f42b4 service nova] [instance: e65ccf79-718d-4eeb-8914-f0db2e2c9ce2] Received event network-vif-plugged-9b681ac7-3246-4ff4-8691-f8e4f1d62061 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:14:59 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-d5bf9b8c-257c-426d-ad56-5e86b94ce26e req-6333ae48-5bfc-43eb-85e3-efe9792f42b4 service nova] Acquiring lock "e65ccf79-718d-4eeb-8914-f0db2e2c9ce2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:14:59 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-d5bf9b8c-257c-426d-ad56-5e86b94ce26e req-6333ae48-5bfc-43eb-85e3-efe9792f42b4 service nova] Lock "e65ccf79-718d-4eeb-8914-f0db2e2c9ce2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:14:59 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-d5bf9b8c-257c-426d-ad56-5e86b94ce26e req-6333ae48-5bfc-43eb-85e3-efe9792f42b4 service nova] Lock "e65ccf79-718d-4eeb-8914-f0db2e2c9ce2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:14:59 user nova-compute[85141]: DEBUG nova.compute.manager [req-d5bf9b8c-257c-426d-ad56-5e86b94ce26e req-6333ae48-5bfc-43eb-85e3-efe9792f42b4 service nova] [instance: e65ccf79-718d-4eeb-8914-f0db2e2c9ce2] No waiting events found dispatching network-vif-plugged-9b681ac7-3246-4ff4-8691-f8e4f1d62061 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:14:59 user nova-compute[85141]: WARNING nova.compute.manager [req-d5bf9b8c-257c-426d-ad56-5e86b94ce26e req-6333ae48-5bfc-43eb-85e3-efe9792f42b4 service nova] [instance: e65ccf79-718d-4eeb-8914-f0db2e2c9ce2] Received unexpected event network-vif-plugged-9b681ac7-3246-4ff4-8691-f8e4f1d62061 for instance with vm_state active and task_state resize_finish.
Nov 16 10:15:00 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:15:02 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:15:02 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:15:05 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:15:07 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:15:10 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:15:10 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:15:10 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:15:12 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:15:13 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:15:14 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-59b79eec-5327-4256-9e47-976c4421d1f8 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Acquiring lock "4e214bbb-5bbb-4e6f-ac09-9cb1412f068b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:15:14 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-59b79eec-5327-4256-9e47-976c4421d1f8 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Lock "4e214bbb-5bbb-4e6f-ac09-9cb1412f068b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:15:14 user nova-compute[85141]: DEBUG nova.compute.manager [None req-59b79eec-5327-4256-9e47-976c4421d1f8 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] [instance: 4e214bbb-5bbb-4e6f-ac09-9cb1412f068b] Starting instance... {{(pid=85141) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 10:15:14 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:15:14 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-59b79eec-5327-4256-9e47-976c4421d1f8 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:15:14 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-59b79eec-5327-4256-9e47-976c4421d1f8 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:15:14 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-59b79eec-5327-4256-9e47-976c4421d1f8 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=85141) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 10:15:14 user nova-compute[85141]: INFO nova.compute.claims [None req-59b79eec-5327-4256-9e47-976c4421d1f8 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] [instance: 4e214bbb-5bbb-4e6f-ac09-9cb1412f068b] Claim successful on node user
Nov 16 10:15:15 user nova-compute[85141]: DEBUG nova.compute.provider_tree [None req-59b79eec-5327-4256-9e47-976c4421d1f8 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Inventory has not changed in ProviderTree for provider: bf8e0fa1-16b6-408f-9203-c4cd63916272 {{(pid=85141) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 10:15:15 user nova-compute[85141]: DEBUG nova.scheduler.client.report [None req-59b79eec-5327-4256-9e47-976c4421d1f8 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Inventory has not changed for provider bf8e0fa1-16b6-408f-9203-c4cd63916272 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=85141) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 10:15:15 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-59b79eec-5327-4256-9e47-976c4421d1f8 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.445s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:15:15 user nova-compute[85141]: DEBUG nova.compute.manager [None req-59b79eec-5327-4256-9e47-976c4421d1f8 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] [instance: 4e214bbb-5bbb-4e6f-ac09-9cb1412f068b] Start building networks asynchronously for instance. {{(pid=85141) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 10:15:15 user nova-compute[85141]: DEBUG nova.compute.manager [None req-59b79eec-5327-4256-9e47-976c4421d1f8 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] [instance: 4e214bbb-5bbb-4e6f-ac09-9cb1412f068b] Allocating IP information in the background. {{(pid=85141) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 10:15:15 user nova-compute[85141]: DEBUG nova.network.neutron [None req-59b79eec-5327-4256-9e47-976c4421d1f8 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] [instance: 4e214bbb-5bbb-4e6f-ac09-9cb1412f068b] allocate_for_instance() {{(pid=85141) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 10:15:15 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-59b79eec-5327-4256-9e47-976c4421d1f8 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] [instance: 4e214bbb-5bbb-4e6f-ac09-9cb1412f068b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 10:15:15 user nova-compute[85141]: DEBUG nova.compute.manager [None req-59b79eec-5327-4256-9e47-976c4421d1f8 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] [instance: 4e214bbb-5bbb-4e6f-ac09-9cb1412f068b] Start building block device mappings for instance. {{(pid=85141) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 10:15:15 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:15:15 user nova-compute[85141]: DEBUG nova.policy [None req-59b79eec-5327-4256-9e47-976c4421d1f8 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '76d4eaf5cef745c3bf3ae07068338b1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b520de67ac4290a4b779f50afeb1a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85141) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 10:15:15 user nova-compute[85141]: DEBUG nova.compute.manager [None req-59b79eec-5327-4256-9e47-976c4421d1f8 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] [instance: 4e214bbb-5bbb-4e6f-ac09-9cb1412f068b] Start spawning the instance on the hypervisor. {{(pid=85141) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 10:15:15 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-59b79eec-5327-4256-9e47-976c4421d1f8 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] [instance: 4e214bbb-5bbb-4e6f-ac09-9cb1412f068b] Creating instance directory {{(pid=85141) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 10:15:15 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-59b79eec-5327-4256-9e47-976c4421d1f8 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] [instance: 4e214bbb-5bbb-4e6f-ac09-9cb1412f068b] Creating image(s)
Nov 16 10:15:15 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-59b79eec-5327-4256-9e47-976c4421d1f8 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Acquiring lock "/opt/stack/data/nova/instances/4e214bbb-5bbb-4e6f-ac09-9cb1412f068b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:15:15 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-59b79eec-5327-4256-9e47-976c4421d1f8 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Lock "/opt/stack/data/nova/instances/4e214bbb-5bbb-4e6f-ac09-9cb1412f068b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:15:15 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-59b79eec-5327-4256-9e47-976c4421d1f8 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Lock "/opt/stack/data/nova/instances/4e214bbb-5bbb-4e6f-ac09-9cb1412f068b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:15:15 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-59b79eec-5327-4256-9e47-976c4421d1f8 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:15:15 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-59b79eec-5327-4256-9e47-976c4421d1f8 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json" returned: 0 in 0.215s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:15:15 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-59b79eec-5327-4256-9e47-976c4421d1f8 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Acquiring lock "60a78556fb399ed4a41bc3ca4bccf77c96d8e811" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:15:15 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-59b79eec-5327-4256-9e47-976c4421d1f8 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Lock "60a78556fb399ed4a41bc3ca4bccf77c96d8e811" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:15:15 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-59b79eec-5327-4256-9e47-976c4421d1f8 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:15:16 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-59b79eec-5327-4256-9e47-976c4421d1f8 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json" returned: 0 in 0.239s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:15:16 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-a66bc243-b34f-484c-9566-4685c361c007 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Acquiring lock "b24c3954-06ff-4e15-9e43-c65d1dae7a5d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:15:16 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-a66bc243-b34f-484c-9566-4685c361c007 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Lock "b24c3954-06ff-4e15-9e43-c65d1dae7a5d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:15:16 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-59b79eec-5327-4256-9e47-976c4421d1f8 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811,backing_fmt=raw /opt/stack/data/nova/instances/4e214bbb-5bbb-4e6f-ac09-9cb1412f068b/disk 1073741824 {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:15:16 user nova-compute[85141]: DEBUG nova.compute.manager [None req-a66bc243-b34f-484c-9566-4685c361c007 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] [instance: b24c3954-06ff-4e15-9e43-c65d1dae7a5d] Starting instance... {{(pid=85141) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 10:15:16 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-59b79eec-5327-4256-9e47-976c4421d1f8 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811,backing_fmt=raw /opt/stack/data/nova/instances/4e214bbb-5bbb-4e6f-ac09-9cb1412f068b/disk 1073741824" returned: 0 in 0.061s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:15:16 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-59b79eec-5327-4256-9e47-976c4421d1f8 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Lock "60a78556fb399ed4a41bc3ca4bccf77c96d8e811" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.311s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:15:16 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-59b79eec-5327-4256-9e47-976c4421d1f8 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:15:16 user nova-compute[85141]: DEBUG nova.network.neutron [None req-59b79eec-5327-4256-9e47-976c4421d1f8 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] [instance: 4e214bbb-5bbb-4e6f-ac09-9cb1412f068b] Successfully created port: b0a1b07c-bdba-4ef8-893e-fb5dcdbac88c {{(pid=85141) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 10:15:16 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-a66bc243-b34f-484c-9566-4685c361c007 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:15:16 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-a66bc243-b34f-484c-9566-4685c361c007 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:15:16 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-a66bc243-b34f-484c-9566-4685c361c007 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=85141) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 10:15:16 user nova-compute[85141]: INFO nova.compute.claims [None req-a66bc243-b34f-484c-9566-4685c361c007 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] [instance: b24c3954-06ff-4e15-9e43-c65d1dae7a5d] Claim successful on node user
Nov 16 10:15:16 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-59b79eec-5327-4256-9e47-976c4421d1f8 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json" returned: 0 in 0.202s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:15:16 user nova-compute[85141]: DEBUG nova.virt.disk.api [None req-59b79eec-5327-4256-9e47-976c4421d1f8 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4e214bbb-5bbb-4e6f-ac09-9cb1412f068b/disk. size=1073741824 {{(pid=85141) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 10:15:16 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-59b79eec-5327-4256-9e47-976c4421d1f8 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e214bbb-5bbb-4e6f-ac09-9cb1412f068b/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:15:16 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-59b79eec-5327-4256-9e47-976c4421d1f8 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e214bbb-5bbb-4e6f-ac09-9cb1412f068b/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:15:16 user nova-compute[85141]: DEBUG nova.virt.disk.api [None req-59b79eec-5327-4256-9e47-976c4421d1f8 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Cannot resize image /opt/stack/data/nova/instances/4e214bbb-5bbb-4e6f-ac09-9cb1412f068b/disk to a smaller size. {{(pid=85141) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 10:15:16 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-59b79eec-5327-4256-9e47-976c4421d1f8 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] [instance: 4e214bbb-5bbb-4e6f-ac09-9cb1412f068b] Created local disks {{(pid=85141) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 10:15:16 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-59b79eec-5327-4256-9e47-976c4421d1f8 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] [instance: 4e214bbb-5bbb-4e6f-ac09-9cb1412f068b] Ensure instance console log exists: /opt/stack/data/nova/instances/4e214bbb-5bbb-4e6f-ac09-9cb1412f068b/console.log {{(pid=85141) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 10:15:16 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-59b79eec-5327-4256-9e47-976c4421d1f8 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:15:16 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-59b79eec-5327-4256-9e47-976c4421d1f8 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:15:16 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-59b79eec-5327-4256-9e47-976c4421d1f8 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:15:16 user nova-compute[85141]: DEBUG nova.compute.provider_tree [None req-a66bc243-b34f-484c-9566-4685c361c007 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Inventory has not changed in ProviderTree for provider: bf8e0fa1-16b6-408f-9203-c4cd63916272 {{(pid=85141) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 10:15:17 user nova-compute[85141]: DEBUG nova.scheduler.client.report [None req-a66bc243-b34f-484c-9566-4685c361c007 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Inventory has not changed for provider bf8e0fa1-16b6-408f-9203-c4cd63916272 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=85141) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 10:15:17 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-a66bc243-b34f-484c-9566-4685c361c007 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.711s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:15:17 user nova-compute[85141]: DEBUG nova.compute.manager [None req-a66bc243-b34f-484c-9566-4685c361c007 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] [instance: b24c3954-06ff-4e15-9e43-c65d1dae7a5d] Start building networks asynchronously for instance. {{(pid=85141) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 10:15:17 user nova-compute[85141]: DEBUG nova.compute.manager [None req-a66bc243-b34f-484c-9566-4685c361c007 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] [instance: b24c3954-06ff-4e15-9e43-c65d1dae7a5d] Allocating IP information in the background. {{(pid=85141) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 10:15:17 user nova-compute[85141]: DEBUG nova.network.neutron [None req-a66bc243-b34f-484c-9566-4685c361c007 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] [instance: b24c3954-06ff-4e15-9e43-c65d1dae7a5d] allocate_for_instance() {{(pid=85141) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 10:15:17 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-a66bc243-b34f-484c-9566-4685c361c007 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] [instance: b24c3954-06ff-4e15-9e43-c65d1dae7a5d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 10:15:17 user nova-compute[85141]: DEBUG nova.compute.manager [None req-a66bc243-b34f-484c-9566-4685c361c007 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] [instance: b24c3954-06ff-4e15-9e43-c65d1dae7a5d] Start building block device mappings for instance. {{(pid=85141) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 10:15:17 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:15:17 user nova-compute[85141]: DEBUG nova.compute.manager [None req-a66bc243-b34f-484c-9566-4685c361c007 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] [instance: b24c3954-06ff-4e15-9e43-c65d1dae7a5d] Start spawning the instance on the hypervisor. {{(pid=85141) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 10:15:17 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-a66bc243-b34f-484c-9566-4685c361c007 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] [instance: b24c3954-06ff-4e15-9e43-c65d1dae7a5d] Creating instance directory {{(pid=85141) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 10:15:17 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-a66bc243-b34f-484c-9566-4685c361c007 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] [instance: b24c3954-06ff-4e15-9e43-c65d1dae7a5d] Creating image(s)
Nov 16 10:15:17 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-a66bc243-b34f-484c-9566-4685c361c007 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Acquiring lock "/opt/stack/data/nova/instances/b24c3954-06ff-4e15-9e43-c65d1dae7a5d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:15:17 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-a66bc243-b34f-484c-9566-4685c361c007 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Lock "/opt/stack/data/nova/instances/b24c3954-06ff-4e15-9e43-c65d1dae7a5d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:15:17 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-a66bc243-b34f-484c-9566-4685c361c007 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Lock "/opt/stack/data/nova/instances/b24c3954-06ff-4e15-9e43-c65d1dae7a5d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:15:17 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-a66bc243-b34f-484c-9566-4685c361c007 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:15:17 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-a66bc243-b34f-484c-9566-4685c361c007 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json" returned: 0 in 0.192s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:15:17 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-a66bc243-b34f-484c-9566-4685c361c007 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Acquiring lock "60a78556fb399ed4a41bc3ca4bccf77c96d8e811" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:15:17 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-a66bc243-b34f-484c-9566-4685c361c007 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Lock "60a78556fb399ed4a41bc3ca4bccf77c96d8e811" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:15:17 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-a66bc243-b34f-484c-9566-4685c361c007 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:15:17 user nova-compute[85141]: DEBUG nova.policy [None req-a66bc243-b34f-484c-9566-4685c361c007 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '76d4eaf5cef745c3bf3ae07068338b1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b520de67ac4290a4b779f50afeb1a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85141) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 10:15:17 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-a66bc243-b34f-484c-9566-4685c361c007 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json" returned: 0 in 0.173s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:15:17 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-a66bc243-b34f-484c-9566-4685c361c007 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811,backing_fmt=raw /opt/stack/data/nova/instances/b24c3954-06ff-4e15-9e43-c65d1dae7a5d/disk 1073741824 {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:15:17 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-a66bc243-b34f-484c-9566-4685c361c007 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811,backing_fmt=raw /opt/stack/data/nova/instances/b24c3954-06ff-4e15-9e43-c65d1dae7a5d/disk 1073741824" returned: 0 in 0.073s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:15:17 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-a66bc243-b34f-484c-9566-4685c361c007 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Lock "60a78556fb399ed4a41bc3ca4bccf77c96d8e811" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.253s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:15:17 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-a66bc243-b34f-484c-9566-4685c361c007 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:15:17 user nova-compute[85141]: DEBUG nova.network.neutron [None req-59b79eec-5327-4256-9e47-976c4421d1f8 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] [instance: 4e214bbb-5bbb-4e6f-ac09-9cb1412f068b] Successfully updated port: b0a1b07c-bdba-4ef8-893e-fb5dcdbac88c {{(pid=85141) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 10:15:17 user nova-compute[85141]: DEBUG nova.compute.manager [req-17152406-ae41-4812-8820-bd2264d86cf8 req-ce7f09ab-4857-4ac3-91b7-6eba207c4118 service nova] [instance: 4e214bbb-5bbb-4e6f-ac09-9cb1412f068b] Received event network-changed-b0a1b07c-bdba-4ef8-893e-fb5dcdbac88c {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:15:17 user nova-compute[85141]: DEBUG nova.compute.manager [req-17152406-ae41-4812-8820-bd2264d86cf8 req-ce7f09ab-4857-4ac3-91b7-6eba207c4118 service nova] [instance: 4e214bbb-5bbb-4e6f-ac09-9cb1412f068b] Refreshing instance network info cache due to event network-changed-b0a1b07c-bdba-4ef8-893e-fb5dcdbac88c. {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 10:15:17 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-17152406-ae41-4812-8820-bd2264d86cf8 req-ce7f09ab-4857-4ac3-91b7-6eba207c4118 service nova] Acquiring lock "refresh_cache-4e214bbb-5bbb-4e6f-ac09-9cb1412f068b" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:15:17 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-17152406-ae41-4812-8820-bd2264d86cf8 req-ce7f09ab-4857-4ac3-91b7-6eba207c4118 service nova] Acquired lock "refresh_cache-4e214bbb-5bbb-4e6f-ac09-9cb1412f068b" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:15:17 user nova-compute[85141]: DEBUG nova.network.neutron [req-17152406-ae41-4812-8820-bd2264d86cf8 req-ce7f09ab-4857-4ac3-91b7-6eba207c4118 service nova] [instance: 4e214bbb-5bbb-4e6f-ac09-9cb1412f068b] Refreshing network info cache for port b0a1b07c-bdba-4ef8-893e-fb5dcdbac88c {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 10:15:17 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-59b79eec-5327-4256-9e47-976c4421d1f8 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Acquiring lock "refresh_cache-4e214bbb-5bbb-4e6f-ac09-9cb1412f068b" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:15:18 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-a66bc243-b34f-484c-9566-4685c361c007 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json" returned: 0 in 0.205s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:15:18 user nova-compute[85141]: DEBUG nova.virt.disk.api [None req-a66bc243-b34f-484c-9566-4685c361c007 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b24c3954-06ff-4e15-9e43-c65d1dae7a5d/disk. size=1073741824 {{(pid=85141) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 10:15:18 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-a66bc243-b34f-484c-9566-4685c361c007 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b24c3954-06ff-4e15-9e43-c65d1dae7a5d/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:15:18 user nova-compute[85141]: DEBUG nova.network.neutron [req-17152406-ae41-4812-8820-bd2264d86cf8 req-ce7f09ab-4857-4ac3-91b7-6eba207c4118 service nova] [instance: 4e214bbb-5bbb-4e6f-ac09-9cb1412f068b] Instance cache missing network info. {{(pid=85141) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 10:15:18 user nova-compute[85141]: INFO nova.compute.manager [None req-839bedb9-fdef-4f50-bc67-8a6a4f865f4b tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] [instance: f01dc8cf-1a69-4618-a15d-0c1075157f05] Rescuing
Nov 16 10:15:18 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-839bedb9-fdef-4f50-bc67-8a6a4f865f4b tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Acquiring lock "refresh_cache-f01dc8cf-1a69-4618-a15d-0c1075157f05" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:15:18 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-839bedb9-fdef-4f50-bc67-8a6a4f865f4b tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Acquired lock "refresh_cache-f01dc8cf-1a69-4618-a15d-0c1075157f05" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:15:18 user nova-compute[85141]: DEBUG nova.network.neutron [None req-839bedb9-fdef-4f50-bc67-8a6a4f865f4b tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] [instance: f01dc8cf-1a69-4618-a15d-0c1075157f05] Building network info cache for instance {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 10:15:18 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-a66bc243-b34f-484c-9566-4685c361c007 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b24c3954-06ff-4e15-9e43-c65d1dae7a5d/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:15:18 user nova-compute[85141]: DEBUG nova.virt.disk.api [None req-a66bc243-b34f-484c-9566-4685c361c007 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Cannot resize image /opt/stack/data/nova/instances/b24c3954-06ff-4e15-9e43-c65d1dae7a5d/disk to a smaller size. {{(pid=85141) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 10:15:18 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-a66bc243-b34f-484c-9566-4685c361c007 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] [instance: b24c3954-06ff-4e15-9e43-c65d1dae7a5d] Created local disks {{(pid=85141) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 10:15:18 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-a66bc243-b34f-484c-9566-4685c361c007 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] [instance: b24c3954-06ff-4e15-9e43-c65d1dae7a5d] Ensure instance console log exists: /opt/stack/data/nova/instances/b24c3954-06ff-4e15-9e43-c65d1dae7a5d/console.log {{(pid=85141) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 10:15:18 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-a66bc243-b34f-484c-9566-4685c361c007 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:15:18 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-a66bc243-b34f-484c-9566-4685c361c007 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:15:18 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-a66bc243-b34f-484c-9566-4685c361c007 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:15:18 user nova-compute[85141]: DEBUG nova.network.neutron [req-17152406-ae41-4812-8820-bd2264d86cf8 req-ce7f09ab-4857-4ac3-91b7-6eba207c4118 service nova] [instance: 4e214bbb-5bbb-4e6f-ac09-9cb1412f068b] Updating instance_info_cache with network_info: [] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:15:18 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-17152406-ae41-4812-8820-bd2264d86cf8 req-ce7f09ab-4857-4ac3-91b7-6eba207c4118 service nova] Releasing lock "refresh_cache-4e214bbb-5bbb-4e6f-ac09-9cb1412f068b" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:15:18 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-59b79eec-5327-4256-9e47-976c4421d1f8 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Acquired lock "refresh_cache-4e214bbb-5bbb-4e6f-ac09-9cb1412f068b" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:15:18 user nova-compute[85141]: DEBUG nova.network.neutron [None req-59b79eec-5327-4256-9e47-976c4421d1f8 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] [instance: 4e214bbb-5bbb-4e6f-ac09-9cb1412f068b] Building network info cache for instance {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 10:15:18 user nova-compute[85141]: DEBUG nova.network.neutron [None req-59b79eec-5327-4256-9e47-976c4421d1f8 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] [instance: 4e214bbb-5bbb-4e6f-ac09-9cb1412f068b] Instance cache missing network info. {{(pid=85141) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 10:15:18 user nova-compute[85141]: DEBUG nova.network.neutron [None req-839bedb9-fdef-4f50-bc67-8a6a4f865f4b tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] [instance: f01dc8cf-1a69-4618-a15d-0c1075157f05] Updating instance_info_cache with network_info: [{"id": "52edc378-51f4-43c3-b9f3-2d0201ed125d", "address": "fa:16:3e:38:1f:8f", "network": {"id": "e40e4bd2-4277-40b1-9451-1c8365ffa488", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1333036447-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "733b504d4dbe4f028963cf2c197f0064", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52edc378-51", "ovs_interfaceid": "52edc378-51f4-43c3-b9f3-2d0201ed125d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:15:18 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-839bedb9-fdef-4f50-bc67-8a6a4f865f4b tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Releasing lock "refresh_cache-f01dc8cf-1a69-4618-a15d-0c1075157f05" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:15:18 user nova-compute[85141]: DEBUG nova.network.neutron [None req-a66bc243-b34f-484c-9566-4685c361c007 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] [instance: b24c3954-06ff-4e15-9e43-c65d1dae7a5d] Successfully created port: 6becb779-bd08-4a40-bb56-3b8f03d1f844 {{(pid=85141) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 10:15:18 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:15:19 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:15:19 user nova-compute[85141]: DEBUG nova.network.neutron [None req-59b79eec-5327-4256-9e47-976c4421d1f8 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] [instance: 4e214bbb-5bbb-4e6f-ac09-9cb1412f068b] Updating instance_info_cache with network_info: [{"id": "b0a1b07c-bdba-4ef8-893e-fb5dcdbac88c", "address": "fa:16:3e:b9:03:60", "network": {"id": "5b67a3fd-ef1e-4f2c-b6e0-31766ef39d30", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2137186235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09b520de67ac4290a4b779f50afeb1a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0a1b07c-bd", "ovs_interfaceid": "b0a1b07c-bdba-4ef8-893e-fb5dcdbac88c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:15:19 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-59b79eec-5327-4256-9e47-976c4421d1f8 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Releasing lock "refresh_cache-4e214bbb-5bbb-4e6f-ac09-9cb1412f068b" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:15:19 user nova-compute[85141]: DEBUG nova.compute.manager [None req-59b79eec-5327-4256-9e47-976c4421d1f8 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] [instance: 4e214bbb-5bbb-4e6f-ac09-9cb1412f068b] Instance network_info: |[{"id": "b0a1b07c-bdba-4ef8-893e-fb5dcdbac88c", "address": "fa:16:3e:b9:03:60", "network": {"id": "5b67a3fd-ef1e-4f2c-b6e0-31766ef39d30", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2137186235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09b520de67ac4290a4b779f50afeb1a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0a1b07c-bd", "ovs_interfaceid": "b0a1b07c-bdba-4ef8-893e-fb5dcdbac88c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=85141) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 10:15:19 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-59b79eec-5327-4256-9e47-976c4421d1f8 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] [instance: 4e214bbb-5bbb-4e6f-ac09-9cb1412f068b] Start _get_guest_xml network_info=[{"id": "b0a1b07c-bdba-4ef8-893e-fb5dcdbac88c", "address": "fa:16:3e:b9:03:60", "network": {"id": "5b67a3fd-ef1e-4f2c-b6e0-31766ef39d30", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2137186235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09b520de67ac4290a4b779f50afeb1a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0a1b07c-bd", "ovs_interfaceid": "b0a1b07c-bdba-4ef8-893e-fb5dcdbac88c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T10:06:42Z,direct_url=<?>,disk_format='qcow2',id=bc4ca70f-a459-4d5c-a9e6-80f1948eb48b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1044631a5fe84ce8904864a7024049fa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T10:06:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_options': None, 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'image_id': 'bc4ca70f-a459-4d5c-a9e6-80f1948eb48b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=85141) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 10:15:19 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-59b79eec-5327-4256-9e47-976c4421d1f8 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:15:19 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-59b79eec-5327-4256-9e47-976c4421d1f8 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:15:19 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-59b79eec-5327-4256-9e47-976c4421d1f8 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=85141) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 10:15:19 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-59b79eec-5327-4256-9e47-976c4421d1f8 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] CPU controller missing on host. {{(pid=85141) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 10:15:19 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-59b79eec-5327-4256-9e47-976c4421d1f8 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=85141) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 10:15:19 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-59b79eec-5327-4256-9e47-976c4421d1f8 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] CPU controller found on host. {{(pid=85141) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 10:15:19 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-59b79eec-5327-4256-9e47-976c4421d1f8 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=85141) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 10:15:19 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-59b79eec-5327-4256-9e47-976c4421d1f8 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T10:06:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T10:06:42Z,direct_url=<?>,disk_format='qcow2',id=bc4ca70f-a459-4d5c-a9e6-80f1948eb48b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1044631a5fe84ce8904864a7024049fa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T10:06:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 10:15:19 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-59b79eec-5327-4256-9e47-976c4421d1f8 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Flavor limits 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 10:15:19 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-59b79eec-5327-4256-9e47-976c4421d1f8 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Image limits 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 10:15:19 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-59b79eec-5327-4256-9e47-976c4421d1f8 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Flavor pref 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 10:15:19 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-59b79eec-5327-4256-9e47-976c4421d1f8 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Image pref 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 10:15:19 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-59b79eec-5327-4256-9e47-976c4421d1f8 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 10:15:19 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-59b79eec-5327-4256-9e47-976c4421d1f8 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 10:15:19 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-59b79eec-5327-4256-9e47-976c4421d1f8 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=85141) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 10:15:19 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-59b79eec-5327-4256-9e47-976c4421d1f8 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Got 1 possible topologies {{(pid=85141) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 10:15:19 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-59b79eec-5327-4256-9e47-976c4421d1f8 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 10:15:19 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-59b79eec-5327-4256-9e47-976c4421d1f8 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 10:15:19 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-59b79eec-5327-4256-9e47-976c4421d1f8 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T10:15:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-936954893',display_name='tempest-ServerRescueNegativeTestJSON-server-936954893',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-936954893',id=17,image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='09b520de67ac4290a4b779f50afeb1a4',ramdisk_id='',reservation_id='r-xdeh19vp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-2068988845',owner_user_name='tempest-ServerRescueNegativeTestJSON-2068988845-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T10:15:16Z,user_data=None,user_id='76d4eaf5cef745c3bf3ae07068338b1a',uuid=4e214bbb-5bbb-4e6f-ac09-9cb1412f068b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b0a1b07c-bdba-4ef8-893e-fb5dcdbac88c", "address": "fa:16:3e:b9:03:60", "network": {"id": "5b67a3fd-ef1e-4f2c-b6e0-31766ef39d30", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2137186235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09b520de67ac4290a4b779f50afeb1a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0a1b07c-bd", "ovs_interfaceid": "b0a1b07c-bdba-4ef8-893e-fb5dcdbac88c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=85141) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 10:15:19 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-59b79eec-5327-4256-9e47-976c4421d1f8 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Converting VIF {"id": "b0a1b07c-bdba-4ef8-893e-fb5dcdbac88c", "address": "fa:16:3e:b9:03:60", "network": {"id": "5b67a3fd-ef1e-4f2c-b6e0-31766ef39d30", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2137186235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09b520de67ac4290a4b779f50afeb1a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0a1b07c-bd", "ovs_interfaceid": "b0a1b07c-bdba-4ef8-893e-fb5dcdbac88c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:15:19 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-59b79eec-5327-4256-9e47-976c4421d1f8 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:03:60,bridge_name='br-int',has_traffic_filtering=True,id=b0a1b07c-bdba-4ef8-893e-fb5dcdbac88c,network=Network(5b67a3fd-ef1e-4f2c-b6e0-31766ef39d30),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0a1b07c-bd') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:15:19 user nova-compute[85141]: DEBUG nova.objects.instance [None req-59b79eec-5327-4256-9e47-976c4421d1f8 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Lazy-loading 'pci_devices' on Instance uuid 4e214bbb-5bbb-4e6f-ac09-9cb1412f068b {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:15:19 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-59b79eec-5327-4256-9e47-976c4421d1f8 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] [instance: 4e214bbb-5bbb-4e6f-ac09-9cb1412f068b] End _get_guest_xml xml=<domain type="kvm">
Nov 16 10:15:19 user nova-compute[85141]:   <uuid>4e214bbb-5bbb-4e6f-ac09-9cb1412f068b</uuid>
Nov 16 10:15:19 user nova-compute[85141]:   <name>instance-00000011</name>
Nov 16 10:15:19 user nova-compute[85141]:   <memory>524288</memory>
Nov 16 10:15:19 user nova-compute[85141]:   <vcpu>1</vcpu>
Nov 16 10:15:19 user nova-compute[85141]:   <metadata>
Nov 16 10:15:19 user nova-compute[85141]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 10:15:19 user nova-compute[85141]:       <nova:package version="0.0.0"/>
Nov 16 10:15:19 user nova-compute[85141]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-936954893</nova:name>
Nov 16 10:15:19 user nova-compute[85141]:       <nova:creationTime>2023-11-16 10:15:19</nova:creationTime>
Nov 16 10:15:19 user nova-compute[85141]:       <nova:flavor name="m1.tiny">
Nov 16 10:15:19 user nova-compute[85141]:         <nova:memory>512</nova:memory>
Nov 16 10:15:19 user nova-compute[85141]:         <nova:disk>1</nova:disk>
Nov 16 10:15:19 user nova-compute[85141]:         <nova:swap>0</nova:swap>
Nov 16 10:15:19 user nova-compute[85141]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 10:15:19 user nova-compute[85141]:         <nova:vcpus>1</nova:vcpus>
Nov 16 10:15:19 user nova-compute[85141]:       </nova:flavor>
Nov 16 10:15:19 user nova-compute[85141]:       <nova:owner>
Nov 16 10:15:19 user nova-compute[85141]:         <nova:user uuid="76d4eaf5cef745c3bf3ae07068338b1a">tempest-ServerRescueNegativeTestJSON-2068988845-project-member</nova:user>
Nov 16 10:15:19 user nova-compute[85141]:         <nova:project uuid="09b520de67ac4290a4b779f50afeb1a4">tempest-ServerRescueNegativeTestJSON-2068988845</nova:project>
Nov 16 10:15:19 user nova-compute[85141]:       </nova:owner>
Nov 16 10:15:19 user nova-compute[85141]:       <nova:root type="image" uuid="bc4ca70f-a459-4d5c-a9e6-80f1948eb48b"/>
Nov 16 10:15:19 user nova-compute[85141]:       <nova:ports>
Nov 16 10:15:19 user nova-compute[85141]:         <nova:port uuid="b0a1b07c-bdba-4ef8-893e-fb5dcdbac88c">
Nov 16 10:15:19 user nova-compute[85141]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 16 10:15:19 user nova-compute[85141]:         </nova:port>
Nov 16 10:15:19 user nova-compute[85141]:       </nova:ports>
Nov 16 10:15:19 user nova-compute[85141]:     </nova:instance>
Nov 16 10:15:19 user nova-compute[85141]:   </metadata>
Nov 16 10:15:19 user nova-compute[85141]:   <sysinfo type="smbios">
Nov 16 10:15:19 user nova-compute[85141]:     <system>
Nov 16 10:15:19 user nova-compute[85141]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 10:15:19 user nova-compute[85141]:       <entry name="product">OpenStack Nova</entry>
Nov 16 10:15:19 user nova-compute[85141]:       <entry name="version">0.0.0</entry>
Nov 16 10:15:19 user nova-compute[85141]:       <entry name="serial">4e214bbb-5bbb-4e6f-ac09-9cb1412f068b</entry>
Nov 16 10:15:19 user nova-compute[85141]:       <entry name="uuid">4e214bbb-5bbb-4e6f-ac09-9cb1412f068b</entry>
Nov 16 10:15:19 user nova-compute[85141]:       <entry name="family">Virtual Machine</entry>
Nov 16 10:15:19 user nova-compute[85141]:     </system>
Nov 16 10:15:19 user nova-compute[85141]:   </sysinfo>
Nov 16 10:15:19 user nova-compute[85141]:   <os>
Nov 16 10:15:19 user nova-compute[85141]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 10:15:19 user nova-compute[85141]:     <boot dev="hd"/>
Nov 16 10:15:19 user nova-compute[85141]:     <smbios mode="sysinfo"/>
Nov 16 10:15:19 user nova-compute[85141]:   </os>
Nov 16 10:15:19 user nova-compute[85141]:   <features>
Nov 16 10:15:19 user nova-compute[85141]:     <acpi/>
Nov 16 10:15:19 user nova-compute[85141]:     <apic/>
Nov 16 10:15:19 user nova-compute[85141]:     <vmcoreinfo/>
Nov 16 10:15:19 user nova-compute[85141]:   </features>
Nov 16 10:15:19 user nova-compute[85141]:   <clock offset="utc">
Nov 16 10:15:19 user nova-compute[85141]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 10:15:19 user nova-compute[85141]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 10:15:19 user nova-compute[85141]:     <timer name="hpet" present="no"/>
Nov 16 10:15:19 user nova-compute[85141]:   </clock>
Nov 16 10:15:19 user nova-compute[85141]:   <cpu mode="custom" match="exact">
Nov 16 10:15:19 user nova-compute[85141]:     <model>Nehalem</model>
Nov 16 10:15:19 user nova-compute[85141]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 10:15:19 user nova-compute[85141]:   </cpu>
Nov 16 10:15:19 user nova-compute[85141]:   <devices>
Nov 16 10:15:19 user nova-compute[85141]:     <disk type="file" device="disk">
Nov 16 10:15:19 user nova-compute[85141]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 10:15:19 user nova-compute[85141]:       <source file="/opt/stack/data/nova/instances/4e214bbb-5bbb-4e6f-ac09-9cb1412f068b/disk"/>
Nov 16 10:15:19 user nova-compute[85141]:       <target dev="vda" bus="virtio"/>
Nov 16 10:15:19 user nova-compute[85141]:     </disk>
Nov 16 10:15:19 user nova-compute[85141]:     <interface type="ethernet">
Nov 16 10:15:19 user nova-compute[85141]:       <mac address="fa:16:3e:b9:03:60"/>
Nov 16 10:15:19 user nova-compute[85141]:       <model type="virtio"/>
Nov 16 10:15:19 user nova-compute[85141]:       <mtu size="1442"/>
Nov 16 10:15:19 user nova-compute[85141]:       <target dev="tapb0a1b07c-bd"/>
Nov 16 10:15:19 user nova-compute[85141]:     </interface>
Nov 16 10:15:19 user nova-compute[85141]:     <serial type="pty">
Nov 16 10:15:19 user nova-compute[85141]:       <log file="/opt/stack/data/nova/instances/4e214bbb-5bbb-4e6f-ac09-9cb1412f068b/console.log" append="off"/>
Nov 16 10:15:19 user nova-compute[85141]:     </serial>
Nov 16 10:15:19 user nova-compute[85141]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 10:15:19 user nova-compute[85141]:     <video>
Nov 16 10:15:19 user nova-compute[85141]:       <model type="virtio"/>
Nov 16 10:15:19 user nova-compute[85141]:     </video>
Nov 16 10:15:19 user nova-compute[85141]:     <rng model="virtio">
Nov 16 10:15:19 user nova-compute[85141]:       <backend model="random">/dev/urandom</backend>
Nov 16 10:15:19 user nova-compute[85141]:     </rng>
Nov 16 10:15:19 user nova-compute[85141]:     <controller type="usb" index="0" model="none"/>
Nov 16 10:15:19 user nova-compute[85141]:     <memballoon model="virtio">
Nov 16 10:15:19 user nova-compute[85141]:       <stats period="10"/>
Nov 16 10:15:19 user nova-compute[85141]:     </memballoon>
Nov 16 10:15:19 user nova-compute[85141]:   </devices>
Nov 16 10:15:19 user nova-compute[85141]: </domain>
Nov 16 10:15:19 user nova-compute[85141]:  {{(pid=85141) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 10:15:19 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-59b79eec-5327-4256-9e47-976c4421d1f8 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T10:15:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-936954893',display_name='tempest-ServerRescueNegativeTestJSON-server-936954893',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-936954893',id=17,image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='09b520de67ac4290a4b779f50afeb1a4',ramdisk_id='',reservation_id='r-xdeh19vp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-2068988845',owner_user_name='tempest-ServerRescueNegativeTestJSON-2068988845-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T10:15:16Z,user_data=None,user_id='76d4eaf5cef745c3bf3ae07068338b1a',uuid=4e214bbb-5bbb-4e6f-ac09-9cb1412f068b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b0a1b07c-bdba-4ef8-893e-fb5dcdbac88c", "address": "fa:16:3e:b9:03:60", "network": {"id": "5b67a3fd-ef1e-4f2c-b6e0-31766ef39d30", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2137186235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09b520de67ac4290a4b779f50afeb1a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0a1b07c-bd", "ovs_interfaceid": "b0a1b07c-bdba-4ef8-893e-fb5dcdbac88c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 10:15:19 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-59b79eec-5327-4256-9e47-976c4421d1f8 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Converting VIF {"id": "b0a1b07c-bdba-4ef8-893e-fb5dcdbac88c", "address": "fa:16:3e:b9:03:60", "network": {"id": "5b67a3fd-ef1e-4f2c-b6e0-31766ef39d30", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2137186235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09b520de67ac4290a4b779f50afeb1a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0a1b07c-bd", "ovs_interfaceid": "b0a1b07c-bdba-4ef8-893e-fb5dcdbac88c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:15:19 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-59b79eec-5327-4256-9e47-976c4421d1f8 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:03:60,bridge_name='br-int',has_traffic_filtering=True,id=b0a1b07c-bdba-4ef8-893e-fb5dcdbac88c,network=Network(5b67a3fd-ef1e-4f2c-b6e0-31766ef39d30),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0a1b07c-bd') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:15:19 user nova-compute[85141]: DEBUG os_vif [None req-59b79eec-5327-4256-9e47-976c4421d1f8 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:03:60,bridge_name='br-int',has_traffic_filtering=True,id=b0a1b07c-bdba-4ef8-893e-fb5dcdbac88c,network=Network(5b67a3fd-ef1e-4f2c-b6e0-31766ef39d30),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0a1b07c-bd') {{(pid=85141) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 10:15:19 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:15:19 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:15:19 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 10:15:19 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:15:19 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd7e90ff0-1893-5d42-a2d4-97ac52738a4c', '_type': 'linux-noop'}}, row=False) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:15:19 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:15:19 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:15:19 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:15:19 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:15:19 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb0a1b07c-bd, may_exist=True, interface_attrs={}) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:15:19 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb0a1b07c-bd, col_values=(('qos', UUID('1e1502b0-ea1d-4cc0-9a8b-3540b15362bb')),), if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:15:19 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb0a1b07c-bd, col_values=(('external_ids', {'iface-id': 'b0a1b07c-bdba-4ef8-893e-fb5dcdbac88c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b9:03:60', 'vm-uuid': '4e214bbb-5bbb-4e6f-ac09-9cb1412f068b'}),), if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:15:19 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:15:19 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:15:19 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:15:19 user nova-compute[85141]: INFO os_vif [None req-59b79eec-5327-4256-9e47-976c4421d1f8 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:03:60,bridge_name='br-int',has_traffic_filtering=True,id=b0a1b07c-bdba-4ef8-893e-fb5dcdbac88c,network=Network(5b67a3fd-ef1e-4f2c-b6e0-31766ef39d30),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0a1b07c-bd')
Nov 16 10:15:19 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-59b79eec-5327-4256-9e47-976c4421d1f8 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] No BDM found with device name vda, not building metadata. {{(pid=85141) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 10:15:19 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-59b79eec-5327-4256-9e47-976c4421d1f8 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] No VIF found with MAC fa:16:3e:b9:03:60, not building metadata {{(pid=85141) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 10:15:19 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:15:19 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:15:19 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:15:19 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:15:19 user nova-compute[85141]: DEBUG nova.compute.manager [req-3d4f0e11-99cb-459e-a596-bff9e377f450 req-2b773549-af53-488b-ab7f-7fedab60f74d service nova] [instance: f01dc8cf-1a69-4618-a15d-0c1075157f05] Received event network-vif-unplugged-52edc378-51f4-43c3-b9f3-2d0201ed125d {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:15:19 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-3d4f0e11-99cb-459e-a596-bff9e377f450 req-2b773549-af53-488b-ab7f-7fedab60f74d service nova] Acquiring lock "f01dc8cf-1a69-4618-a15d-0c1075157f05-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:15:19 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-3d4f0e11-99cb-459e-a596-bff9e377f450 req-2b773549-af53-488b-ab7f-7fedab60f74d service nova] Lock "f01dc8cf-1a69-4618-a15d-0c1075157f05-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:15:19 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-3d4f0e11-99cb-459e-a596-bff9e377f450 req-2b773549-af53-488b-ab7f-7fedab60f74d service nova] Lock "f01dc8cf-1a69-4618-a15d-0c1075157f05-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:15:19 user nova-compute[85141]: DEBUG nova.compute.manager [req-3d4f0e11-99cb-459e-a596-bff9e377f450 req-2b773549-af53-488b-ab7f-7fedab60f74d service nova] [instance: f01dc8cf-1a69-4618-a15d-0c1075157f05] No waiting events found dispatching network-vif-unplugged-52edc378-51f4-43c3-b9f3-2d0201ed125d {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:15:19 user nova-compute[85141]: WARNING nova.compute.manager [req-3d4f0e11-99cb-459e-a596-bff9e377f450 req-2b773549-af53-488b-ab7f-7fedab60f74d service nova] [instance: f01dc8cf-1a69-4618-a15d-0c1075157f05] Received unexpected event network-vif-unplugged-52edc378-51f4-43c3-b9f3-2d0201ed125d for instance with vm_state active and task_state rescuing.
Nov 16 10:15:19 user nova-compute[85141]: DEBUG nova.network.neutron [None req-a66bc243-b34f-484c-9566-4685c361c007 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] [instance: b24c3954-06ff-4e15-9e43-c65d1dae7a5d] Successfully updated port: 6becb779-bd08-4a40-bb56-3b8f03d1f844 {{(pid=85141) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 10:15:19 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-a66bc243-b34f-484c-9566-4685c361c007 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Acquiring lock "refresh_cache-b24c3954-06ff-4e15-9e43-c65d1dae7a5d" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:15:19 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-a66bc243-b34f-484c-9566-4685c361c007 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Acquired lock "refresh_cache-b24c3954-06ff-4e15-9e43-c65d1dae7a5d" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:15:19 user nova-compute[85141]: DEBUG nova.network.neutron [None req-a66bc243-b34f-484c-9566-4685c361c007 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] [instance: b24c3954-06ff-4e15-9e43-c65d1dae7a5d] Building network info cache for instance {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 10:15:19 user nova-compute[85141]: DEBUG nova.network.neutron [None req-a66bc243-b34f-484c-9566-4685c361c007 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] [instance: b24c3954-06ff-4e15-9e43-c65d1dae7a5d] Instance cache missing network info. {{(pid=85141) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 10:15:19 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:15:20 user nova-compute[85141]: DEBUG nova.compute.manager [req-73b8302e-8a99-4f1b-b2fd-571503006039 req-343b2cc9-45e4-426f-9c57-e5bd150da57e service nova] [instance: b24c3954-06ff-4e15-9e43-c65d1dae7a5d] Received event network-changed-6becb779-bd08-4a40-bb56-3b8f03d1f844 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:15:20 user nova-compute[85141]: DEBUG nova.compute.manager [req-73b8302e-8a99-4f1b-b2fd-571503006039 req-343b2cc9-45e4-426f-9c57-e5bd150da57e service nova] [instance: b24c3954-06ff-4e15-9e43-c65d1dae7a5d] Refreshing instance network info cache due to event network-changed-6becb779-bd08-4a40-bb56-3b8f03d1f844. {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 10:15:20 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-73b8302e-8a99-4f1b-b2fd-571503006039 req-343b2cc9-45e4-426f-9c57-e5bd150da57e service nova] Acquiring lock "refresh_cache-b24c3954-06ff-4e15-9e43-c65d1dae7a5d" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:15:20 user nova-compute[85141]: DEBUG nova.network.neutron [None req-a66bc243-b34f-484c-9566-4685c361c007 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] [instance: b24c3954-06ff-4e15-9e43-c65d1dae7a5d] Updating instance_info_cache with network_info: [{"id": "6becb779-bd08-4a40-bb56-3b8f03d1f844", "address": "fa:16:3e:ca:42:7f", "network": {"id": "5b67a3fd-ef1e-4f2c-b6e0-31766ef39d30", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2137186235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09b520de67ac4290a4b779f50afeb1a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6becb779-bd", "ovs_interfaceid": "6becb779-bd08-4a40-bb56-3b8f03d1f844", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:15:20 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-a66bc243-b34f-484c-9566-4685c361c007 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Releasing lock "refresh_cache-b24c3954-06ff-4e15-9e43-c65d1dae7a5d" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:15:20 user nova-compute[85141]: DEBUG nova.compute.manager [None req-a66bc243-b34f-484c-9566-4685c361c007 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] [instance: b24c3954-06ff-4e15-9e43-c65d1dae7a5d] Instance network_info: |[{"id": "6becb779-bd08-4a40-bb56-3b8f03d1f844", "address": "fa:16:3e:ca:42:7f", "network": {"id": "5b67a3fd-ef1e-4f2c-b6e0-31766ef39d30", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2137186235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09b520de67ac4290a4b779f50afeb1a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6becb779-bd", "ovs_interfaceid": "6becb779-bd08-4a40-bb56-3b8f03d1f844", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=85141) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 10:15:20 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-73b8302e-8a99-4f1b-b2fd-571503006039 req-343b2cc9-45e4-426f-9c57-e5bd150da57e service nova] Acquired lock "refresh_cache-b24c3954-06ff-4e15-9e43-c65d1dae7a5d" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:15:20 user nova-compute[85141]: DEBUG nova.network.neutron [req-73b8302e-8a99-4f1b-b2fd-571503006039 req-343b2cc9-45e4-426f-9c57-e5bd150da57e service nova] [instance: b24c3954-06ff-4e15-9e43-c65d1dae7a5d] Refreshing network info cache for port 6becb779-bd08-4a40-bb56-3b8f03d1f844 {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 10:15:20 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-a66bc243-b34f-484c-9566-4685c361c007 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] [instance: b24c3954-06ff-4e15-9e43-c65d1dae7a5d] Start _get_guest_xml network_info=[{"id": "6becb779-bd08-4a40-bb56-3b8f03d1f844", "address": "fa:16:3e:ca:42:7f", "network": {"id": "5b67a3fd-ef1e-4f2c-b6e0-31766ef39d30", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2137186235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09b520de67ac4290a4b779f50afeb1a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6becb779-bd", "ovs_interfaceid": "6becb779-bd08-4a40-bb56-3b8f03d1f844", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T10:06:42Z,direct_url=<?>,disk_format='qcow2',id=bc4ca70f-a459-4d5c-a9e6-80f1948eb48b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1044631a5fe84ce8904864a7024049fa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T10:06:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_options': None, 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'image_id': 'bc4ca70f-a459-4d5c-a9e6-80f1948eb48b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=85141) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 10:15:20 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-a66bc243-b34f-484c-9566-4685c361c007 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:15:20 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-a66bc243-b34f-484c-9566-4685c361c007 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:15:20 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-a66bc243-b34f-484c-9566-4685c361c007 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=85141) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 10:15:20 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-a66bc243-b34f-484c-9566-4685c361c007 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] CPU controller missing on host. {{(pid=85141) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 10:15:20 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-a66bc243-b34f-484c-9566-4685c361c007 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=85141) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 10:15:20 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-a66bc243-b34f-484c-9566-4685c361c007 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] CPU controller found on host. {{(pid=85141) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 10:15:20 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-a66bc243-b34f-484c-9566-4685c361c007 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=85141) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 10:15:20 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-a66bc243-b34f-484c-9566-4685c361c007 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T10:06:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T10:06:42Z,direct_url=<?>,disk_format='qcow2',id=bc4ca70f-a459-4d5c-a9e6-80f1948eb48b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1044631a5fe84ce8904864a7024049fa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T10:06:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 10:15:20 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-a66bc243-b34f-484c-9566-4685c361c007 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Flavor limits 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 10:15:20 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-a66bc243-b34f-484c-9566-4685c361c007 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Image limits 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 10:15:20 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-a66bc243-b34f-484c-9566-4685c361c007 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Flavor pref 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 10:15:20 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-a66bc243-b34f-484c-9566-4685c361c007 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Image pref 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 10:15:20 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-a66bc243-b34f-484c-9566-4685c361c007 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 10:15:20 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-a66bc243-b34f-484c-9566-4685c361c007 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 10:15:20 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-a66bc243-b34f-484c-9566-4685c361c007 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=85141) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 10:15:20 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-a66bc243-b34f-484c-9566-4685c361c007 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Got 1 possible topologies {{(pid=85141) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 10:15:20 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-a66bc243-b34f-484c-9566-4685c361c007 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 10:15:20 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-a66bc243-b34f-484c-9566-4685c361c007 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 10:15:20 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-a66bc243-b34f-484c-9566-4685c361c007 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T10:15:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1886603118',display_name='tempest-ServerRescueNegativeTestJSON-server-1886603118',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1886603118',id=18,image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='09b520de67ac4290a4b779f50afeb1a4',ramdisk_id='',reservation_id='r-uoz0yc00',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-2068988845',owner_user_name='tempest-ServerRescueNegativeTestJSON-2068988845-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T10:15:17Z,user_data=None,user_id='76d4eaf5cef745c3bf3ae07068338b1a',uuid=b24c3954-06ff-4e15-9e43-c65d1dae7a5d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6becb779-bd08-4a40-bb56-3b8f03d1f844", "address": "fa:16:3e:ca:42:7f", "network": {"id": "5b67a3fd-ef1e-4f2c-b6e0-31766ef39d30", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2137186235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09b520de67ac4290a4b779f50afeb1a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6becb779-bd", "ovs_interfaceid": "6becb779-bd08-4a40-bb56-3b8f03d1f844", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=85141) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 10:15:20 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-a66bc243-b34f-484c-9566-4685c361c007 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Converting VIF {"id": "6becb779-bd08-4a40-bb56-3b8f03d1f844", "address": "fa:16:3e:ca:42:7f", "network": {"id": "5b67a3fd-ef1e-4f2c-b6e0-31766ef39d30", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2137186235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09b520de67ac4290a4b779f50afeb1a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6becb779-bd", "ovs_interfaceid": "6becb779-bd08-4a40-bb56-3b8f03d1f844", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:15:20 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-a66bc243-b34f-484c-9566-4685c361c007 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ca:42:7f,bridge_name='br-int',has_traffic_filtering=True,id=6becb779-bd08-4a40-bb56-3b8f03d1f844,network=Network(5b67a3fd-ef1e-4f2c-b6e0-31766ef39d30),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6becb779-bd') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:15:20 user nova-compute[85141]: DEBUG nova.objects.instance [None req-a66bc243-b34f-484c-9566-4685c361c007 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Lazy-loading 'pci_devices' on Instance uuid b24c3954-06ff-4e15-9e43-c65d1dae7a5d {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:15:20 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-a66bc243-b34f-484c-9566-4685c361c007 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] [instance: b24c3954-06ff-4e15-9e43-c65d1dae7a5d] End _get_guest_xml xml=<domain type="kvm">
Nov 16 10:15:20 user nova-compute[85141]:   <uuid>b24c3954-06ff-4e15-9e43-c65d1dae7a5d</uuid>
Nov 16 10:15:20 user nova-compute[85141]:   <name>instance-00000012</name>
Nov 16 10:15:20 user nova-compute[85141]:   <memory>524288</memory>
Nov 16 10:15:20 user nova-compute[85141]:   <vcpu>1</vcpu>
Nov 16 10:15:20 user nova-compute[85141]:   <metadata>
Nov 16 10:15:20 user nova-compute[85141]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 10:15:20 user nova-compute[85141]:       <nova:package version="0.0.0"/>
Nov 16 10:15:20 user nova-compute[85141]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1886603118</nova:name>
Nov 16 10:15:20 user nova-compute[85141]:       <nova:creationTime>2023-11-16 10:15:20</nova:creationTime>
Nov 16 10:15:20 user nova-compute[85141]:       <nova:flavor name="m1.tiny">
Nov 16 10:15:20 user nova-compute[85141]:         <nova:memory>512</nova:memory>
Nov 16 10:15:20 user nova-compute[85141]:         <nova:disk>1</nova:disk>
Nov 16 10:15:20 user nova-compute[85141]:         <nova:swap>0</nova:swap>
Nov 16 10:15:20 user nova-compute[85141]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 10:15:20 user nova-compute[85141]:         <nova:vcpus>1</nova:vcpus>
Nov 16 10:15:20 user nova-compute[85141]:       </nova:flavor>
Nov 16 10:15:20 user nova-compute[85141]:       <nova:owner>
Nov 16 10:15:20 user nova-compute[85141]:         <nova:user uuid="76d4eaf5cef745c3bf3ae07068338b1a">tempest-ServerRescueNegativeTestJSON-2068988845-project-member</nova:user>
Nov 16 10:15:20 user nova-compute[85141]:         <nova:project uuid="09b520de67ac4290a4b779f50afeb1a4">tempest-ServerRescueNegativeTestJSON-2068988845</nova:project>
Nov 16 10:15:20 user nova-compute[85141]:       </nova:owner>
Nov 16 10:15:20 user nova-compute[85141]:       <nova:root type="image" uuid="bc4ca70f-a459-4d5c-a9e6-80f1948eb48b"/>
Nov 16 10:15:20 user nova-compute[85141]:       <nova:ports>
Nov 16 10:15:20 user nova-compute[85141]:         <nova:port uuid="6becb779-bd08-4a40-bb56-3b8f03d1f844">
Nov 16 10:15:20 user nova-compute[85141]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 16 10:15:20 user nova-compute[85141]:         </nova:port>
Nov 16 10:15:20 user nova-compute[85141]:       </nova:ports>
Nov 16 10:15:20 user nova-compute[85141]:     </nova:instance>
Nov 16 10:15:20 user nova-compute[85141]:   </metadata>
Nov 16 10:15:20 user nova-compute[85141]:   <sysinfo type="smbios">
Nov 16 10:15:20 user nova-compute[85141]:     <system>
Nov 16 10:15:20 user nova-compute[85141]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 10:15:20 user nova-compute[85141]:       <entry name="product">OpenStack Nova</entry>
Nov 16 10:15:20 user nova-compute[85141]:       <entry name="version">0.0.0</entry>
Nov 16 10:15:20 user nova-compute[85141]:       <entry name="serial">b24c3954-06ff-4e15-9e43-c65d1dae7a5d</entry>
Nov 16 10:15:20 user nova-compute[85141]:       <entry name="uuid">b24c3954-06ff-4e15-9e43-c65d1dae7a5d</entry>
Nov 16 10:15:20 user nova-compute[85141]:       <entry name="family">Virtual Machine</entry>
Nov 16 10:15:20 user nova-compute[85141]:     </system>
Nov 16 10:15:20 user nova-compute[85141]:   </sysinfo>
Nov 16 10:15:20 user nova-compute[85141]:   <os>
Nov 16 10:15:20 user nova-compute[85141]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 10:15:20 user nova-compute[85141]:     <boot dev="hd"/>
Nov 16 10:15:20 user nova-compute[85141]:     <smbios mode="sysinfo"/>
Nov 16 10:15:20 user nova-compute[85141]:   </os>
Nov 16 10:15:20 user nova-compute[85141]:   <features>
Nov 16 10:15:20 user nova-compute[85141]:     <acpi/>
Nov 16 10:15:20 user nova-compute[85141]:     <apic/>
Nov 16 10:15:20 user nova-compute[85141]:     <vmcoreinfo/>
Nov 16 10:15:20 user nova-compute[85141]:   </features>
Nov 16 10:15:20 user nova-compute[85141]:   <clock offset="utc">
Nov 16 10:15:20 user nova-compute[85141]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 10:15:20 user nova-compute[85141]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 10:15:20 user nova-compute[85141]:     <timer name="hpet" present="no"/>
Nov 16 10:15:20 user nova-compute[85141]:   </clock>
Nov 16 10:15:20 user nova-compute[85141]:   <cpu mode="custom" match="exact">
Nov 16 10:15:20 user nova-compute[85141]:     <model>Nehalem</model>
Nov 16 10:15:20 user nova-compute[85141]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 10:15:20 user nova-compute[85141]:   </cpu>
Nov 16 10:15:20 user nova-compute[85141]:   <devices>
Nov 16 10:15:20 user nova-compute[85141]:     <disk type="file" device="disk">
Nov 16 10:15:20 user nova-compute[85141]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 10:15:20 user nova-compute[85141]:       <source file="/opt/stack/data/nova/instances/b24c3954-06ff-4e15-9e43-c65d1dae7a5d/disk"/>
Nov 16 10:15:20 user nova-compute[85141]:       <target dev="vda" bus="virtio"/>
Nov 16 10:15:20 user nova-compute[85141]:     </disk>
Nov 16 10:15:20 user nova-compute[85141]:     <interface type="ethernet">
Nov 16 10:15:20 user nova-compute[85141]:       <mac address="fa:16:3e:ca:42:7f"/>
Nov 16 10:15:20 user nova-compute[85141]:       <model type="virtio"/>
Nov 16 10:15:20 user nova-compute[85141]:       <mtu size="1442"/>
Nov 16 10:15:20 user nova-compute[85141]:       <target dev="tap6becb779-bd"/>
Nov 16 10:15:20 user nova-compute[85141]:     </interface>
Nov 16 10:15:20 user nova-compute[85141]:     <serial type="pty">
Nov 16 10:15:20 user nova-compute[85141]:       <log file="/opt/stack/data/nova/instances/b24c3954-06ff-4e15-9e43-c65d1dae7a5d/console.log" append="off"/>
Nov 16 10:15:20 user nova-compute[85141]:     </serial>
Nov 16 10:15:20 user nova-compute[85141]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 10:15:20 user nova-compute[85141]:     <video>
Nov 16 10:15:20 user nova-compute[85141]:       <model type="virtio"/>
Nov 16 10:15:20 user nova-compute[85141]:     </video>
Nov 16 10:15:20 user nova-compute[85141]:     <rng model="virtio">
Nov 16 10:15:20 user nova-compute[85141]:       <backend model="random">/dev/urandom</backend>
Nov 16 10:15:20 user nova-compute[85141]:     </rng>
Nov 16 10:15:20 user nova-compute[85141]:     <controller type="usb" index="0" model="none"/>
Nov 16 10:15:20 user nova-compute[85141]:     <memballoon model="virtio">
Nov 16 10:15:20 user nova-compute[85141]:       <stats period="10"/>
Nov 16 10:15:20 user nova-compute[85141]:     </memballoon>
Nov 16 10:15:20 user nova-compute[85141]:   </devices>
Nov 16 10:15:20 user nova-compute[85141]: </domain>
Nov 16 10:15:20 user nova-compute[85141]:  {{(pid=85141) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 10:15:20 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-a66bc243-b34f-484c-9566-4685c361c007 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T10:15:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1886603118',display_name='tempest-ServerRescueNegativeTestJSON-server-1886603118',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1886603118',id=18,image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='09b520de67ac4290a4b779f50afeb1a4',ramdisk_id='',reservation_id='r-uoz0yc00',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-2068988845',owner_user_name='tempest-ServerRescueNegativeTestJSON-2068988845-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T10:15:17Z,user_data=None,user_id='76d4eaf5cef745c3bf3ae07068338b1a',uuid=b24c3954-06ff-4e15-9e43-c65d1dae7a5d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6becb779-bd08-4a40-bb56-3b8f03d1f844", "address": "fa:16:3e:ca:42:7f", "network": {"id": "5b67a3fd-ef1e-4f2c-b6e0-31766ef39d30", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2137186235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09b520de67ac4290a4b779f50afeb1a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6becb779-bd", "ovs_interfaceid": "6becb779-bd08-4a40-bb56-3b8f03d1f844", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 10:15:20 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-a66bc243-b34f-484c-9566-4685c361c007 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Converting VIF {"id": "6becb779-bd08-4a40-bb56-3b8f03d1f844", "address": "fa:16:3e:ca:42:7f", "network": {"id": "5b67a3fd-ef1e-4f2c-b6e0-31766ef39d30", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2137186235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09b520de67ac4290a4b779f50afeb1a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6becb779-bd", "ovs_interfaceid": "6becb779-bd08-4a40-bb56-3b8f03d1f844", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:15:20 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-a66bc243-b34f-484c-9566-4685c361c007 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ca:42:7f,bridge_name='br-int',has_traffic_filtering=True,id=6becb779-bd08-4a40-bb56-3b8f03d1f844,network=Network(5b67a3fd-ef1e-4f2c-b6e0-31766ef39d30),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6becb779-bd') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:15:20 user nova-compute[85141]: DEBUG os_vif [None req-a66bc243-b34f-484c-9566-4685c361c007 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:42:7f,bridge_name='br-int',has_traffic_filtering=True,id=6becb779-bd08-4a40-bb56-3b8f03d1f844,network=Network(5b67a3fd-ef1e-4f2c-b6e0-31766ef39d30),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6becb779-bd') {{(pid=85141) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 10:15:20 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:15:20 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:15:20 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 10:15:20 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:15:20 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '77d49c70-ecdc-5ccf-bd59-0b27fbdc8838', '_type': 'linux-noop'}}, row=False) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:15:20 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:15:20 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:15:20 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:15:20 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:15:20 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6becb779-bd, may_exist=True, interface_attrs={}) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:15:20 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6becb779-bd, col_values=(('qos', UUID('4d5e0616-56df-49dd-b7e5-9768745e7c65')),), if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:15:20 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6becb779-bd, col_values=(('external_ids', {'iface-id': '6becb779-bd08-4a40-bb56-3b8f03d1f844', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ca:42:7f', 'vm-uuid': 'b24c3954-06ff-4e15-9e43-c65d1dae7a5d'}),), if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:15:20 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:15:20 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:15:20 user nova-compute[85141]: INFO nova.virt.libvirt.driver [-] [instance: f01dc8cf-1a69-4618-a15d-0c1075157f05] Instance destroyed successfully.
Nov 16 10:15:20 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:15:20 user nova-compute[85141]: INFO os_vif [None req-a66bc243-b34f-484c-9566-4685c361c007 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:42:7f,bridge_name='br-int',has_traffic_filtering=True,id=6becb779-bd08-4a40-bb56-3b8f03d1f844,network=Network(5b67a3fd-ef1e-4f2c-b6e0-31766ef39d30),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6becb779-bd')
Nov 16 10:15:20 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-839bedb9-fdef-4f50-bc67-8a6a4f865f4b tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] [instance: f01dc8cf-1a69-4618-a15d-0c1075157f05] Attempting a stable device rescue
Nov 16 10:15:20 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-839bedb9-fdef-4f50-bc67-8a6a4f865f4b tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=85141) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 16 10:15:20 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-839bedb9-fdef-4f50-bc67-8a6a4f865f4b tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] [instance: f01dc8cf-1a69-4618-a15d-0c1075157f05] Instance directory exists: not creating {{(pid=85141) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 16 10:15:20 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-839bedb9-fdef-4f50-bc67-8a6a4f865f4b tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] [instance: f01dc8cf-1a69-4618-a15d-0c1075157f05] Creating image(s)
Nov 16 10:15:20 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-839bedb9-fdef-4f50-bc67-8a6a4f865f4b tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Acquiring lock "/opt/stack/data/nova/instances/f01dc8cf-1a69-4618-a15d-0c1075157f05/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:15:20 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-839bedb9-fdef-4f50-bc67-8a6a4f865f4b tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Lock "/opt/stack/data/nova/instances/f01dc8cf-1a69-4618-a15d-0c1075157f05/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:15:20 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-839bedb9-fdef-4f50-bc67-8a6a4f865f4b tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Lock "/opt/stack/data/nova/instances/f01dc8cf-1a69-4618-a15d-0c1075157f05/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:15:20 user nova-compute[85141]: DEBUG nova.objects.instance [None req-839bedb9-fdef-4f50-bc67-8a6a4f865f4b tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Lazy-loading 'trusted_certs' on Instance uuid f01dc8cf-1a69-4618-a15d-0c1075157f05 {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:15:20 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-a66bc243-b34f-484c-9566-4685c361c007 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] No BDM found with device name vda, not building metadata. {{(pid=85141) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 10:15:20 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-a66bc243-b34f-484c-9566-4685c361c007 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] No VIF found with MAC fa:16:3e:ca:42:7f, not building metadata {{(pid=85141) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 10:15:20 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-839bedb9-fdef-4f50-bc67-8a6a4f865f4b tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Acquiring lock "ce98b520d29727ceaf7abcf900132a6167127ac5" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:15:20 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-839bedb9-fdef-4f50-bc67-8a6a4f865f4b tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Lock "ce98b520d29727ceaf7abcf900132a6167127ac5" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:15:21 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-839bedb9-fdef-4f50-bc67-8a6a4f865f4b tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce98b520d29727ceaf7abcf900132a6167127ac5.part --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:15:21 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:15:21 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:15:21 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:15:21 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:15:21 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:15:21 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:15:21 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=85141) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 10:15:21 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-839bedb9-fdef-4f50-bc67-8a6a4f865f4b tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce98b520d29727ceaf7abcf900132a6167127ac5.part --force-share --output=json" returned: 0 in 0.177s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:15:21 user nova-compute[85141]: DEBUG nova.virt.images [None req-839bedb9-fdef-4f50-bc67-8a6a4f865f4b tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] 61d7370e-5054-425f-b1bd-70283e845704 was qcow2, converting to raw {{(pid=85141) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 16 10:15:21 user nova-compute[85141]: DEBUG nova.privsep.utils [None req-839bedb9-fdef-4f50-bc67-8a6a4f865f4b tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=85141) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 16 10:15:21 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-839bedb9-fdef-4f50-bc67-8a6a4f865f4b tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ce98b520d29727ceaf7abcf900132a6167127ac5.part /opt/stack/data/nova/instances/_base/ce98b520d29727ceaf7abcf900132a6167127ac5.converted {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:15:21 user nova-compute[85141]: DEBUG nova.network.neutron [req-73b8302e-8a99-4f1b-b2fd-571503006039 req-343b2cc9-45e4-426f-9c57-e5bd150da57e service nova] [instance: b24c3954-06ff-4e15-9e43-c65d1dae7a5d] Updated VIF entry in instance network info cache for port 6becb779-bd08-4a40-bb56-3b8f03d1f844. {{(pid=85141) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 10:15:21 user nova-compute[85141]: DEBUG nova.network.neutron [req-73b8302e-8a99-4f1b-b2fd-571503006039 req-343b2cc9-45e4-426f-9c57-e5bd150da57e service nova] [instance: b24c3954-06ff-4e15-9e43-c65d1dae7a5d] Updating instance_info_cache with network_info: [{"id": "6becb779-bd08-4a40-bb56-3b8f03d1f844", "address": "fa:16:3e:ca:42:7f", "network": {"id": "5b67a3fd-ef1e-4f2c-b6e0-31766ef39d30", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2137186235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09b520de67ac4290a4b779f50afeb1a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6becb779-bd", "ovs_interfaceid": "6becb779-bd08-4a40-bb56-3b8f03d1f844", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:15:21 user nova-compute[85141]: DEBUG nova.compute.manager [req-2ce57aba-8d48-4a2b-91ce-fc5e303ce4b5 req-343b2ed5-856d-40f6-823d-225ed8f65ff0 service nova] [instance: f01dc8cf-1a69-4618-a15d-0c1075157f05] Received event network-vif-plugged-52edc378-51f4-43c3-b9f3-2d0201ed125d {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:15:21 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-2ce57aba-8d48-4a2b-91ce-fc5e303ce4b5 req-343b2ed5-856d-40f6-823d-225ed8f65ff0 service nova] Acquiring lock "f01dc8cf-1a69-4618-a15d-0c1075157f05-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:15:21 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-2ce57aba-8d48-4a2b-91ce-fc5e303ce4b5 req-343b2ed5-856d-40f6-823d-225ed8f65ff0 service nova] Lock "f01dc8cf-1a69-4618-a15d-0c1075157f05-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:15:21 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-2ce57aba-8d48-4a2b-91ce-fc5e303ce4b5 req-343b2ed5-856d-40f6-823d-225ed8f65ff0 service nova] Lock "f01dc8cf-1a69-4618-a15d-0c1075157f05-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:15:21 user nova-compute[85141]: DEBUG nova.compute.manager [req-2ce57aba-8d48-4a2b-91ce-fc5e303ce4b5 req-343b2ed5-856d-40f6-823d-225ed8f65ff0 service nova] [instance: f01dc8cf-1a69-4618-a15d-0c1075157f05] No waiting events found dispatching network-vif-plugged-52edc378-51f4-43c3-b9f3-2d0201ed125d {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:15:21 user nova-compute[85141]: WARNING nova.compute.manager [req-2ce57aba-8d48-4a2b-91ce-fc5e303ce4b5 req-343b2ed5-856d-40f6-823d-225ed8f65ff0 service nova] [instance: f01dc8cf-1a69-4618-a15d-0c1075157f05] Received unexpected event network-vif-plugged-52edc378-51f4-43c3-b9f3-2d0201ed125d for instance with vm_state active and task_state rescuing.
Nov 16 10:15:21 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-73b8302e-8a99-4f1b-b2fd-571503006039 req-343b2cc9-45e4-426f-9c57-e5bd150da57e service nova] Releasing lock "refresh_cache-b24c3954-06ff-4e15-9e43-c65d1dae7a5d" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:15:21 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-839bedb9-fdef-4f50-bc67-8a6a4f865f4b tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ce98b520d29727ceaf7abcf900132a6167127ac5.part /opt/stack/data/nova/instances/_base/ce98b520d29727ceaf7abcf900132a6167127ac5.converted" returned: 0 in 0.476s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:15:21 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-839bedb9-fdef-4f50-bc67-8a6a4f865f4b tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce98b520d29727ceaf7abcf900132a6167127ac5.converted --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:15:22 user nova-compute[85141]: DEBUG nova.compute.manager [req-92b36d31-85f6-48cb-a9b0-4082e358add1 req-a531ab11-6184-43d0-acce-f7654fb6537a service nova] [instance: 4e214bbb-5bbb-4e6f-ac09-9cb1412f068b] Received event network-vif-plugged-b0a1b07c-bdba-4ef8-893e-fb5dcdbac88c {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:15:22 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-92b36d31-85f6-48cb-a9b0-4082e358add1 req-a531ab11-6184-43d0-acce-f7654fb6537a service nova] Acquiring lock "4e214bbb-5bbb-4e6f-ac09-9cb1412f068b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:15:22 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-92b36d31-85f6-48cb-a9b0-4082e358add1 req-a531ab11-6184-43d0-acce-f7654fb6537a service nova] Lock "4e214bbb-5bbb-4e6f-ac09-9cb1412f068b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:15:22 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-92b36d31-85f6-48cb-a9b0-4082e358add1 req-a531ab11-6184-43d0-acce-f7654fb6537a service nova] Lock "4e214bbb-5bbb-4e6f-ac09-9cb1412f068b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:15:22 user nova-compute[85141]: DEBUG nova.compute.manager [req-92b36d31-85f6-48cb-a9b0-4082e358add1 req-a531ab11-6184-43d0-acce-f7654fb6537a service nova] [instance: 4e214bbb-5bbb-4e6f-ac09-9cb1412f068b] No waiting events found dispatching network-vif-plugged-b0a1b07c-bdba-4ef8-893e-fb5dcdbac88c {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:15:22 user nova-compute[85141]: WARNING nova.compute.manager [req-92b36d31-85f6-48cb-a9b0-4082e358add1 req-a531ab11-6184-43d0-acce-f7654fb6537a service nova] [instance: 4e214bbb-5bbb-4e6f-ac09-9cb1412f068b] Received unexpected event network-vif-plugged-b0a1b07c-bdba-4ef8-893e-fb5dcdbac88c for instance with vm_state building and task_state spawning.
Nov 16 10:15:22 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:15:22 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:15:22 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:15:22 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-839bedb9-fdef-4f50-bc67-8a6a4f865f4b tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce98b520d29727ceaf7abcf900132a6167127ac5.converted --force-share --output=json" returned: 0 in 0.264s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:15:22 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-839bedb9-fdef-4f50-bc67-8a6a4f865f4b tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Lock "ce98b520d29727ceaf7abcf900132a6167127ac5" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.975s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:15:22 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:15:22 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:15:22 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Starting heal instance info cache {{(pid=85141) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 10:15:22 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-839bedb9-fdef-4f50-bc67-8a6a4f865f4b tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Acquiring lock "ce98b520d29727ceaf7abcf900132a6167127ac5" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:15:22 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-839bedb9-fdef-4f50-bc67-8a6a4f865f4b tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Lock "ce98b520d29727ceaf7abcf900132a6167127ac5" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:15:22 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-839bedb9-fdef-4f50-bc67-8a6a4f865f4b tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce98b520d29727ceaf7abcf900132a6167127ac5 --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:15:22 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-839bedb9-fdef-4f50-bc67-8a6a4f865f4b tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce98b520d29727ceaf7abcf900132a6167127ac5 --force-share --output=json" returned: 0 in 0.223s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:15:22 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-839bedb9-fdef-4f50-bc67-8a6a4f865f4b tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ce98b520d29727ceaf7abcf900132a6167127ac5,backing_fmt=raw /opt/stack/data/nova/instances/f01dc8cf-1a69-4618-a15d-0c1075157f05/disk.rescue {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:15:22 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Acquiring lock "refresh_cache-361a2044-8fd0-4975-8a19-814bf7a6da41" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:15:22 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Acquired lock "refresh_cache-361a2044-8fd0-4975-8a19-814bf7a6da41" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:15:22 user nova-compute[85141]: DEBUG nova.network.neutron [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] [instance: 361a2044-8fd0-4975-8a19-814bf7a6da41] Forcefully refreshing network info cache for instance {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 10:15:22 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-839bedb9-fdef-4f50-bc67-8a6a4f865f4b tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ce98b520d29727ceaf7abcf900132a6167127ac5,backing_fmt=raw /opt/stack/data/nova/instances/f01dc8cf-1a69-4618-a15d-0c1075157f05/disk.rescue" returned: 0 in 0.056s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:15:22 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-839bedb9-fdef-4f50-bc67-8a6a4f865f4b tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Lock "ce98b520d29727ceaf7abcf900132a6167127ac5" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.284s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:15:22 user nova-compute[85141]: DEBUG nova.objects.instance [None req-839bedb9-fdef-4f50-bc67-8a6a4f865f4b tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Lazy-loading 'migration_context' on Instance uuid f01dc8cf-1a69-4618-a15d-0c1075157f05 {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:15:22 user nova-compute[85141]: DEBUG nova.objects.base [None req-839bedb9-fdef-4f50-bc67-8a6a4f865f4b tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Object Instance<f01dc8cf-1a69-4618-a15d-0c1075157f05> lazy-loaded attributes: trusted_certs,migration_context {{(pid=85141) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 10:15:22 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-839bedb9-fdef-4f50-bc67-8a6a4f865f4b tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] [instance: f01dc8cf-1a69-4618-a15d-0c1075157f05] Created local disks {{(pid=85141) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 10:15:22 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-839bedb9-fdef-4f50-bc67-8a6a4f865f4b tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] [instance: f01dc8cf-1a69-4618-a15d-0c1075157f05] Start _get_guest_xml network_info=[{"id": "52edc378-51f4-43c3-b9f3-2d0201ed125d", "address": "fa:16:3e:38:1f:8f", "network": {"id": "e40e4bd2-4277-40b1-9451-1c8365ffa488", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1333036447-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1333036447-network", "vif_mac": "fa:16:3e:38:1f:8f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "733b504d4dbe4f028963cf2c197f0064", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52edc378-51", "ovs_interfaceid": "52edc378-51f4-43c3-b9f3-2d0201ed125d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T10:06:42Z,direct_url=<?>,disk_format='qcow2',id=bc4ca70f-a459-4d5c-a9e6-80f1948eb48b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1044631a5fe84ce8904864a7024049fa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T10:06:44Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '61d7370e-5054-425f-b1bd-70283e845704', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pHECSWij', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': 'f01dc8cf-1a69-4618-a15d-0c1075157f05', 'attached_at': '', 'detached_at': '', 'volume_id': 'f762b977-47ad-490c-a516-0216703bebee', 'serial': 'f762b977-47ad-490c-a516-0216703bebee'}, 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'attachment_id': '8fcd016e-544d-4236-9dc0-90fec00bb3d8', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=85141) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 10:15:22 user nova-compute[85141]: DEBUG nova.objects.instance [None req-839bedb9-fdef-4f50-bc67-8a6a4f865f4b tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Lazy-loading 'resources' on Instance uuid f01dc8cf-1a69-4618-a15d-0c1075157f05 {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:15:22 user nova-compute[85141]: DEBUG nova.objects.base [None req-839bedb9-fdef-4f50-bc67-8a6a4f865f4b tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Object Instance<f01dc8cf-1a69-4618-a15d-0c1075157f05> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=85141) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 10:15:22 user nova-compute[85141]: DEBUG nova.objects.instance [None req-839bedb9-fdef-4f50-bc67-8a6a4f865f4b tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Lazy-loading 'numa_topology' on Instance uuid f01dc8cf-1a69-4618-a15d-0c1075157f05 {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:15:22 user nova-compute[85141]: DEBUG nova.objects.base [None req-839bedb9-fdef-4f50-bc67-8a6a4f865f4b tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Object Instance<f01dc8cf-1a69-4618-a15d-0c1075157f05> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=85141) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 10:15:22 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-839bedb9-fdef-4f50-bc67-8a6a4f865f4b tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:15:22 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-839bedb9-fdef-4f50-bc67-8a6a4f865f4b tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:15:22 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-839bedb9-fdef-4f50-bc67-8a6a4f865f4b tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=85141) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 10:15:22 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-839bedb9-fdef-4f50-bc67-8a6a4f865f4b tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] CPU controller missing on host. {{(pid=85141) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 10:15:22 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-839bedb9-fdef-4f50-bc67-8a6a4f865f4b tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=85141) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 10:15:22 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-839bedb9-fdef-4f50-bc67-8a6a4f865f4b tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] CPU controller found on host. {{(pid=85141) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 10:15:22 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-839bedb9-fdef-4f50-bc67-8a6a4f865f4b tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=85141) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 10:15:22 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-839bedb9-fdef-4f50-bc67-8a6a4f865f4b tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T10:06:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T10:06:42Z,direct_url=<?>,disk_format='qcow2',id=bc4ca70f-a459-4d5c-a9e6-80f1948eb48b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1044631a5fe84ce8904864a7024049fa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T10:06:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 10:15:22 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-839bedb9-fdef-4f50-bc67-8a6a4f865f4b tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Flavor limits 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 10:15:22 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-839bedb9-fdef-4f50-bc67-8a6a4f865f4b tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Image limits 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 10:15:22 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-839bedb9-fdef-4f50-bc67-8a6a4f865f4b tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Flavor pref 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 10:15:22 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-839bedb9-fdef-4f50-bc67-8a6a4f865f4b tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Image pref 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 10:15:22 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-839bedb9-fdef-4f50-bc67-8a6a4f865f4b tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 10:15:22 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-839bedb9-fdef-4f50-bc67-8a6a4f865f4b tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 10:15:22 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-839bedb9-fdef-4f50-bc67-8a6a4f865f4b tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=85141) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 10:15:22 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-839bedb9-fdef-4f50-bc67-8a6a4f865f4b tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Got 1 possible topologies {{(pid=85141) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 10:15:22 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-839bedb9-fdef-4f50-bc67-8a6a4f865f4b tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 10:15:22 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-839bedb9-fdef-4f50-bc67-8a6a4f865f4b tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 10:15:22 user nova-compute[85141]: DEBUG nova.objects.instance [None req-839bedb9-fdef-4f50-bc67-8a6a4f865f4b tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Lazy-loading 'vcpu_model' on Instance uuid f01dc8cf-1a69-4618-a15d-0c1075157f05 {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:15:22 user nova-compute[85141]: DEBUG nova.objects.base [None req-839bedb9-fdef-4f50-bc67-8a6a4f865f4b tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Object Instance<f01dc8cf-1a69-4618-a15d-0c1075157f05> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=85141) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 10:15:22 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-839bedb9-fdef-4f50-bc67-8a6a4f865f4b tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] [instance: f01dc8cf-1a69-4618-a15d-0c1075157f05] Calling os-brick to attach iSCSI Volume {{(pid=85141) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 10:15:22 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-839bedb9-fdef-4f50-bc67-8a6a4f865f4b tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51806b6080>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pHECSWij', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 10:15:22 user nova-compute[85141]: WARNING os_brick.initiator.connectors.base [None req-839bedb9-fdef-4f50-bc67-8a6a4f865f4b tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 10:15:22 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-839bedb9-fdef-4f50-bc67-8a6a4f865f4b tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 10:15:22 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-839bedb9-fdef-4f50-bc67-8a6a4f865f4b tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 10:15:22 user nova-compute[85141]: WARNING os_brick.initiator.connectors.base [None req-839bedb9-fdef-4f50-bc67-8a6a4f865f4b tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 10:15:22 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-839bedb9-fdef-4f50-bc67-8a6a4f865f4b tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 10:15:22 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-839bedb9-fdef-4f50-bc67-8a6a4f865f4b tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 10:15:22 user nova-compute[85141]: INFO os_brick.initiator.connectors.iscsi [None req-839bedb9-fdef-4f50-bc67-8a6a4f865f4b tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 10:15:22 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee -p 172.16.0.220:3260 {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:15:22 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee -p 172.16.0.220:3260" returned: 0 in 0.017s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:15:22 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cde4e95-bf85-4a33-9c4f-a0f04cbe022b]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = pHECSWij\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:15:22 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-839bedb9-fdef-4f50-bc67-8a6a4f865f4b tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 16 10:15:22 user nova-compute[85141]: node.name = iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee
Nov 16 10:15:22 user nova-compute[85141]: node.tpgt = -1
Nov 16 10:15:22 user nova-compute[85141]: node.startup = automatic
Nov 16 10:15:22 user nova-compute[85141]: node.leading_login = No
Nov 16 10:15:22 user nova-compute[85141]: iface.iscsi_ifacename = default
Nov 16 10:15:22 user nova-compute[85141]: iface.net_ifacename = <empty>
Nov 16 10:15:22 user nova-compute[85141]: iface.ipaddress = <empty>
Nov 16 10:15:22 user nova-compute[85141]: iface.prefix_len = 0
Nov 16 10:15:22 user nova-compute[85141]: iface.hwaddress = <empty>
Nov 16 10:15:22 user nova-compute[85141]: iface.transport_name = tcp
Nov 16 10:15:22 user nova-compute[85141]: iface.initiatorname = <empty>
Nov 16 10:15:22 user nova-compute[85141]: iface.state = <empty>
Nov 16 10:15:22 user nova-compute[85141]: iface.vlan_id = 0
Nov 16 10:15:22 user nova-compute[85141]: iface.vlan_priority = 0
Nov 16 10:15:22 user nova-compute[85141]: iface.vlan_state = <empty>
Nov 16 10:15:22 user nova-compute[85141]: iface.iface_num = 0
Nov 16 10:15:22 user nova-compute[85141]: iface.mtu = 0
Nov 16 10:15:22 user nova-compute[85141]: iface.port = 0
Nov 16 10:15:22 user nova-compute[85141]: iface.bootproto = <empty>
Nov 16 10:15:22 user nova-compute[85141]: iface.subnet_mask = <empty>
Nov 16 10:15:22 user nova-compute[85141]: iface.gateway = <empty>
Nov 16 10:15:22 user nova-compute[85141]: iface.dhcp_alt_client_id_state = <empty>
Nov 16 10:15:22 user nova-compute[85141]: iface.dhcp_alt_client_id = <empty>
Nov 16 10:15:22 user nova-compute[85141]: iface.dhcp_dns = <empty>
Nov 16 10:15:22 user nova-compute[85141]: iface.dhcp_learn_iqn = <empty>
Nov 16 10:15:22 user nova-compute[85141]: iface.dhcp_req_vendor_id_state = <empty>
Nov 16 10:15:22 user nova-compute[85141]: iface.dhcp_vendor_id_state = <empty>
Nov 16 10:15:22 user nova-compute[85141]: iface.dhcp_vendor_id = <empty>
Nov 16 10:15:22 user nova-compute[85141]: iface.dhcp_slp_da = <empty>
Nov 16 10:15:22 user nova-compute[85141]: iface.fragmentation = <empty>
Nov 16 10:15:22 user nova-compute[85141]: iface.gratuitous_arp = <empty>
Nov 16 10:15:22 user nova-compute[85141]: iface.incoming_forwarding = <empty>
Nov 16 10:15:22 user nova-compute[85141]: iface.tos_state = <empty>
Nov 16 10:15:22 user nova-compute[85141]: iface.tos = 0
Nov 16 10:15:22 user nova-compute[85141]: iface.ttl = 0
Nov 16 10:15:22 user nova-compute[85141]: iface.delayed_ack = <empty>
Nov 16 10:15:22 user nova-compute[85141]: iface.tcp_nagle = <empty>
Nov 16 10:15:22 user nova-compute[85141]: iface.tcp_wsf_state = <empty>
Nov 16 10:15:22 user nova-compute[85141]: iface.tcp_wsf = 0
Nov 16 10:15:22 user nova-compute[85141]: iface.tcp_timer_scale = 0
Nov 16 10:15:22 user nova-compute[85141]: iface.tcp_timestamp = <empty>
Nov 16 10:15:22 user nova-compute[85141]: iface.redirect = <empty>
Nov 16 10:15:22 user nova-compute[85141]: iface.def_task_mgmt_timeout = 0
Nov 16 10:15:22 user nova-compute[85141]: iface.header_digest = <empty>
Nov 16 10:15:22 user nova-compute[85141]: iface.data_digest = <empty>
Nov 16 10:15:22 user nova-compute[85141]: iface.immediate_data = <empty>
Nov 16 10:15:22 user nova-compute[85141]: iface.initial_r2t = <empty>
Nov 16 10:15:22 user nova-compute[85141]: iface.data_seq_inorder = <empty>
Nov 16 10:15:22 user nova-compute[85141]: iface.data_pdu_inorder = <empty>
Nov 16 10:15:22 user nova-compute[85141]: iface.erl = 0
Nov 16 10:15:22 user nova-compute[85141]: iface.max_receive_data_len = 0
Nov 16 10:15:22 user nova-compute[85141]: iface.first_burst_len = 0
Nov 16 10:15:22 user nova-compute[85141]: iface.max_outstanding_r2t = 0
Nov 16 10:15:22 user nova-compute[85141]: iface.max_burst_len = 0
Nov 16 10:15:22 user nova-compute[85141]: iface.chap_auth = <empty>
Nov 16 10:15:22 user nova-compute[85141]: iface.bidi_chap = <empty>
Nov 16 10:15:22 user nova-compute[85141]: iface.strict_login_compliance = <empty>
Nov 16 10:15:22 user nova-compute[85141]: iface.discovery_auth = <empty>
Nov 16 10:15:22 user nova-compute[85141]: iface.discovery_logout = <empty>
Nov 16 10:15:22 user nova-compute[85141]: node.discovery_address = <empty>
Nov 16 10:15:22 user nova-compute[85141]: node.discovery_port = 0
Nov 16 10:15:22 user nova-compute[85141]: node.discovery_type = static
Nov 16 10:15:22 user nova-compute[85141]: node.session.initial_cmdsn = 0
Nov 16 10:15:22 user nova-compute[85141]: node.session.initial_login_retry_max = 8
Nov 16 10:15:22 user nova-compute[85141]: node.session.xmit_thread_priority = -20
Nov 16 10:15:22 user nova-compute[85141]: node.session.cmds_max = 128
Nov 16 10:15:22 user nova-compute[85141]: node.session.queue_depth = 32
Nov 16 10:15:22 user nova-compute[85141]: node.session.nr_sessions = 1
Nov 16 10:15:22 user nova-compute[85141]: node.session.auth.authmethod = CHAP
Nov 16 10:15:22 user nova-compute[85141]: node.session.auth.username = pHECSWij
Nov 16 10:15:22 user nova-compute[85141]: node.session.auth.password = ***
Nov 16 10:15:22 user nova-compute[85141]: node.session.auth.username_in = <empty>
Nov 16 10:15:22 user nova-compute[85141]: node.session.auth.password_in = <empty>
Nov 16 10:15:22 user nova-compute[85141]: node.session.auth.chap_algs = MD5
Nov 16 10:15:22 user nova-compute[85141]: node.session.timeo.replacement_timeout = 120
Nov 16 10:15:22 user nova-compute[85141]: node.session.err_timeo.abort_timeout = 15
Nov 16 10:15:22 user nova-compute[85141]: node.session.err_timeo.lu_reset_timeout = 30
Nov 16 10:15:22 user nova-compute[85141]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 16 10:15:22 user nova-compute[85141]: node.session.err_timeo.host_reset_timeout = 60
Nov 16 10:15:22 user nova-compute[85141]: node.session.iscsi.FastAbort = Yes
Nov 16 10:15:22 user nova-compute[85141]: node.session.iscsi.InitialR2T = No
Nov 16 10:15:22 user nova-compute[85141]: node.session.iscsi.ImmediateData = Yes
Nov 16 10:15:22 user nova-compute[85141]: node.session.iscsi.FirstBurstLength = 262144
Nov 16 10:15:22 user nova-compute[85141]: node.session.iscsi.MaxBurstLength = 16776192
Nov 16 10:15:22 user nova-compute[85141]: node.session.iscsi.DefaultTime2Retain = 0
Nov 16 10:15:22 user nova-compute[85141]: node.session.iscsi.DefaultTime2Wait = 2
Nov 16 10:15:22 user nova-compute[85141]: node.session.iscsi.MaxConnections = 1
Nov 16 10:15:22 user nova-compute[85141]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 16 10:15:22 user nova-compute[85141]: node.session.iscsi.ERL = 0
Nov 16 10:15:22 user nova-compute[85141]: node.session.scan = manual
Nov 16 10:15:22 user nova-compute[85141]: node.session.reopen_max = 0
Nov 16 10:15:22 user nova-compute[85141]: node.conn[0].address = 172.16.0.220
Nov 16 10:15:22 user nova-compute[85141]: node.conn[0].port = 3260
Nov 16 10:15:22 user nova-compute[85141]: node.conn[0].startup = manual
Nov 16 10:15:22 user nova-compute[85141]: node.conn[0].tcp.window_size = 524288
Nov 16 10:15:22 user nova-compute[85141]: node.conn[0].tcp.type_of_service = 0
Nov 16 10:15:22 user nova-compute[85141]: node.conn[0].timeo.logout_timeout = 15
Nov 16 10:15:22 user nova-compute[85141]: node.conn[0].timeo.login_timeout = 15
Nov 16 10:15:22 user nova-compute[85141]: node.conn[0].timeo.auth_timeout = 45
Nov 16 10:15:22 user nova-compute[85141]: node.conn[0].timeo.noop_out_interval = 5
Nov 16 10:15:22 user nova-compute[85141]: node.conn[0].timeo.noop_out_timeout = 5
Nov 16 10:15:22 user nova-compute[85141]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 16 10:15:22 user nova-compute[85141]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 16 10:15:22 user nova-compute[85141]: node.conn[0].iscsi.HeaderDigest = None
Nov 16 10:15:22 user nova-compute[85141]: node.conn[0].iscsi.DataDigest = None
Nov 16 10:15:22 user nova-compute[85141]: node.conn[0].iscsi.IFMarker = No
Nov 16 10:15:22 user nova-compute[85141]: node.conn[0].iscsi.OFMarker = No
Nov 16 10:15:22 user nova-compute[85141]: # END RECORD
Nov 16 10:15:22 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:15:22 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:15:22 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:15:22 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bc94543-bcb4-4e21-bab9-a8cb49b0ad3d]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:15:22 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-839bedb9-fdef-4f50-bc67-8a6a4f865f4b tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:15:22 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:15:22 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:15:22 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[221437bf-c095-46b5-9fd3-0f2a5270038d]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:15:22 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-839bedb9-fdef-4f50-bc67-8a6a4f865f4b tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:15:22 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pHECSWij {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:15:22 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pHECSWij" returned: 0 in 0.027s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:15:22 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd460cf7-38ca-4409-b9bc-07c4197be167]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:15:22 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-839bedb9-fdef-4f50-bc67-8a6a4f865f4b tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pHECSWij'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:15:22 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:15:22 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:15:22 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:15:22 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1c1055f-bfe0-4778-9766-a9b661e8fbc4]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:15:22 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-839bedb9-fdef-4f50-bc67-8a6a4f865f4b tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:15:22 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:15:22 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:15:22 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:15:22 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0e066a1-41b5-4b36-a302-a91c14fc41fd]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c94ff08f-badb-4203-b3af-e418025d1f0d (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abda547a-8d00-4a02-a6e4-d0670e47815a (non-flash)\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:15:22 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-839bedb9-fdef-4f50-bc67-8a6a4f865f4b tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)
Nov 16 10:15:22 user nova-compute[85141]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c94ff08f-badb-4203-b3af-e418025d1f0d (non-flash)
Nov 16 10:15:22 user nova-compute[85141]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abda547a-8d00-4a02-a6e4-d0670e47815a (non-flash)
Nov 16 10:15:22 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:15:22 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-839bedb9-fdef-4f50-bc67-8a6a4f865f4b tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)
Nov 16 10:15:22 user nova-compute[85141]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c94ff08f-badb-4203-b3af-e418025d1f0d (non-flash)
Nov 16 10:15:22 user nova-compute[85141]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abda547a-8d00-4a02-a6e4-d0670e47815a (non-flash)
Nov 16 10:15:22 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 10:15:22 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-839bedb9-fdef-4f50-bc67-8a6a4f865f4b tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.189s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 10:15:22 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-839bedb9-fdef-4f50-bc67-8a6a4f865f4b tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Connected to 172.16.0.220:3260 {{(pid=85141) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 10:15:22 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-839bedb9-fdef-4f50-bc67-8a6a4f865f4b tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] HCTL ('34', '0', '0', 0) found on session 16 with lun 0 {{(pid=85141) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 10:15:22 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-839bedb9-fdef-4f50-bc67-8a6a4f865f4b tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Scanning host 34 c: 0, t: 0, l: 0) {{(pid=85141) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 10:15:22 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:15:22 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.013s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:15:22 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[80e3e312-fefa-4ede-974c-e91db4766f90]: (4, ('0 0 0', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:15:22 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-839bedb9-fdef-4f50-bc67-8a6a4f865f4b tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Searching for a device in session 16 and hctl ('34', '0', '0', 0) yield: sdc {{(pid=85141) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 10:15:22 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-839bedb9-fdef-4f50-bc67-8a6a4f865f4b tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pHECSWij', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=85141) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 10:15:22 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-839bedb9-fdef-4f50-bc67-8a6a4f865f4b tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.214s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 10:15:22 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-839bedb9-fdef-4f50-bc67-8a6a4f865f4b tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] <== connect_volume: return (215ms) {'type': 'block', 'scsi_wwn': '23330333531646234', 'path': '/dev/sdc'} {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 10:15:22 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-839bedb9-fdef-4f50-bc67-8a6a4f865f4b tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] [instance: f01dc8cf-1a69-4618-a15d-0c1075157f05] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23330333531646234', 'path': '/dev/sdc'} {{(pid=85141) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 10:15:23 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-839bedb9-fdef-4f50-bc67-8a6a4f865f4b tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T10:13:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-979622720',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-979622720',id=13,image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-16T10:13:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='733b504d4dbe4f028963cf2c197f0064',ramdisk_id='',reservation_id='r-ag7dsbiu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-742384119',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T10:13:46Z,user_data=None,user_id='ffe6ceff3cc346b59b4fbf294b9fc1a3',uuid=f01dc8cf-1a69-4618-a15d-0c1075157f05,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "52edc378-51f4-43c3-b9f3-2d0201ed125d", "address": "fa:16:3e:38:1f:8f", "network": {"id": "e40e4bd2-4277-40b1-9451-1c8365ffa488", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1333036447-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1333036447-network", "vif_mac": "fa:16:3e:38:1f:8f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "733b504d4dbe4f028963cf2c197f0064", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52edc378-51", "ovs_interfaceid": "52edc378-51f4-43c3-b9f3-2d0201ed125d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=85141) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 10:15:23 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-839bedb9-fdef-4f50-bc67-8a6a4f865f4b tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Converting VIF {"id": "52edc378-51f4-43c3-b9f3-2d0201ed125d", "address": "fa:16:3e:38:1f:8f", "network": {"id": "e40e4bd2-4277-40b1-9451-1c8365ffa488", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1333036447-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1333036447-network", "vif_mac": "fa:16:3e:38:1f:8f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "733b504d4dbe4f028963cf2c197f0064", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52edc378-51", "ovs_interfaceid": "52edc378-51f4-43c3-b9f3-2d0201ed125d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:15:23 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-839bedb9-fdef-4f50-bc67-8a6a4f865f4b tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:38:1f:8f,bridge_name='br-int',has_traffic_filtering=True,id=52edc378-51f4-43c3-b9f3-2d0201ed125d,network=Network(e40e4bd2-4277-40b1-9451-1c8365ffa488),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52edc378-51') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:15:23 user nova-compute[85141]: DEBUG nova.objects.instance [None req-839bedb9-fdef-4f50-bc67-8a6a4f865f4b tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Lazy-loading 'pci_devices' on Instance uuid f01dc8cf-1a69-4618-a15d-0c1075157f05 {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:15:23 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:15:23 user nova-compute[85141]: DEBUG nova.objects.base [None req-839bedb9-fdef-4f50-bc67-8a6a4f865f4b tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Object Instance<f01dc8cf-1a69-4618-a15d-0c1075157f05> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=85141) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 10:15:23 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-839bedb9-fdef-4f50-bc67-8a6a4f865f4b tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] [instance: f01dc8cf-1a69-4618-a15d-0c1075157f05] End _get_guest_xml xml=<domain type="kvm">
Nov 16 10:15:23 user nova-compute[85141]:   <uuid>f01dc8cf-1a69-4618-a15d-0c1075157f05</uuid>
Nov 16 10:15:23 user nova-compute[85141]:   <name>instance-0000000d</name>
Nov 16 10:15:23 user nova-compute[85141]:   <memory>524288</memory>
Nov 16 10:15:23 user nova-compute[85141]:   <vcpu>1</vcpu>
Nov 16 10:15:23 user nova-compute[85141]:   <metadata>
Nov 16 10:15:23 user nova-compute[85141]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 10:15:23 user nova-compute[85141]:       <nova:package version="0.0.0"/>
Nov 16 10:15:23 user nova-compute[85141]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-979622720</nova:name>
Nov 16 10:15:23 user nova-compute[85141]:       <nova:creationTime>2023-11-16 10:15:22</nova:creationTime>
Nov 16 10:15:23 user nova-compute[85141]:       <nova:flavor name="m1.tiny">
Nov 16 10:15:23 user nova-compute[85141]:         <nova:memory>512</nova:memory>
Nov 16 10:15:23 user nova-compute[85141]:         <nova:disk>1</nova:disk>
Nov 16 10:15:23 user nova-compute[85141]:         <nova:swap>0</nova:swap>
Nov 16 10:15:23 user nova-compute[85141]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 10:15:23 user nova-compute[85141]:         <nova:vcpus>1</nova:vcpus>
Nov 16 10:15:23 user nova-compute[85141]:       </nova:flavor>
Nov 16 10:15:23 user nova-compute[85141]:       <nova:owner>
Nov 16 10:15:23 user nova-compute[85141]:         <nova:user uuid="ffe6ceff3cc346b59b4fbf294b9fc1a3">tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member</nova:user>
Nov 16 10:15:23 user nova-compute[85141]:         <nova:project uuid="733b504d4dbe4f028963cf2c197f0064">tempest-ServerBootFromVolumeStableRescueTest-742384119</nova:project>
Nov 16 10:15:23 user nova-compute[85141]:       </nova:owner>
Nov 16 10:15:23 user nova-compute[85141]:       <nova:root type="image" uuid="bc4ca70f-a459-4d5c-a9e6-80f1948eb48b"/>
Nov 16 10:15:23 user nova-compute[85141]:       <nova:ports>
Nov 16 10:15:23 user nova-compute[85141]:         <nova:port uuid="52edc378-51f4-43c3-b9f3-2d0201ed125d">
Nov 16 10:15:23 user nova-compute[85141]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 16 10:15:23 user nova-compute[85141]:         </nova:port>
Nov 16 10:15:23 user nova-compute[85141]:       </nova:ports>
Nov 16 10:15:23 user nova-compute[85141]:     </nova:instance>
Nov 16 10:15:23 user nova-compute[85141]:   </metadata>
Nov 16 10:15:23 user nova-compute[85141]:   <sysinfo type="smbios">
Nov 16 10:15:23 user nova-compute[85141]:     <system>
Nov 16 10:15:23 user nova-compute[85141]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 10:15:23 user nova-compute[85141]:       <entry name="product">OpenStack Nova</entry>
Nov 16 10:15:23 user nova-compute[85141]:       <entry name="version">0.0.0</entry>
Nov 16 10:15:23 user nova-compute[85141]:       <entry name="serial">f01dc8cf-1a69-4618-a15d-0c1075157f05</entry>
Nov 16 10:15:23 user nova-compute[85141]:       <entry name="uuid">f01dc8cf-1a69-4618-a15d-0c1075157f05</entry>
Nov 16 10:15:23 user nova-compute[85141]:       <entry name="family">Virtual Machine</entry>
Nov 16 10:15:23 user nova-compute[85141]:     </system>
Nov 16 10:15:23 user nova-compute[85141]:   </sysinfo>
Nov 16 10:15:23 user nova-compute[85141]:   <os>
Nov 16 10:15:23 user nova-compute[85141]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 10:15:23 user nova-compute[85141]:     <smbios mode="sysinfo"/>
Nov 16 10:15:23 user nova-compute[85141]:   </os>
Nov 16 10:15:23 user nova-compute[85141]:   <features>
Nov 16 10:15:23 user nova-compute[85141]:     <acpi/>
Nov 16 10:15:23 user nova-compute[85141]:     <apic/>
Nov 16 10:15:23 user nova-compute[85141]:     <vmcoreinfo/>
Nov 16 10:15:23 user nova-compute[85141]:   </features>
Nov 16 10:15:23 user nova-compute[85141]:   <clock offset="utc">
Nov 16 10:15:23 user nova-compute[85141]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 10:15:23 user nova-compute[85141]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 10:15:23 user nova-compute[85141]:     <timer name="hpet" present="no"/>
Nov 16 10:15:23 user nova-compute[85141]:   </clock>
Nov 16 10:15:23 user nova-compute[85141]:   <cpu mode="custom" match="exact">
Nov 16 10:15:23 user nova-compute[85141]:     <model>Nehalem</model>
Nov 16 10:15:23 user nova-compute[85141]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 10:15:23 user nova-compute[85141]:   </cpu>
Nov 16 10:15:23 user nova-compute[85141]:   <devices>
Nov 16 10:15:23 user nova-compute[85141]:     <disk type="block" device="disk">
Nov 16 10:15:23 user nova-compute[85141]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 10:15:23 user nova-compute[85141]:       <source dev="/dev/sdc"/>
Nov 16 10:15:23 user nova-compute[85141]:       <target dev="vda" bus="virtio"/>
Nov 16 10:15:23 user nova-compute[85141]:       <serial>f762b977-47ad-490c-a516-0216703bebee</serial>
Nov 16 10:15:23 user nova-compute[85141]:     </disk>
Nov 16 10:15:23 user nova-compute[85141]:     <disk type="file" device="disk">
Nov 16 10:15:23 user nova-compute[85141]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 10:15:23 user nova-compute[85141]:       <source file="/opt/stack/data/nova/instances/f01dc8cf-1a69-4618-a15d-0c1075157f05/disk.rescue"/>
Nov 16 10:15:23 user nova-compute[85141]:       <target dev="vdb" bus="virtio"/>
Nov 16 10:15:23 user nova-compute[85141]:       <boot order="1"/>
Nov 16 10:15:23 user nova-compute[85141]:     </disk>
Nov 16 10:15:23 user nova-compute[85141]:     <interface type="ethernet">
Nov 16 10:15:23 user nova-compute[85141]:       <mac address="fa:16:3e:38:1f:8f"/>
Nov 16 10:15:23 user nova-compute[85141]:       <model type="virtio"/>
Nov 16 10:15:23 user nova-compute[85141]:       <mtu size="1442"/>
Nov 16 10:15:23 user nova-compute[85141]:       <target dev="tap52edc378-51"/>
Nov 16 10:15:23 user nova-compute[85141]:     </interface>
Nov 16 10:15:23 user nova-compute[85141]:     <serial type="pty">
Nov 16 10:15:23 user nova-compute[85141]:       <log file="/opt/stack/data/nova/instances/f01dc8cf-1a69-4618-a15d-0c1075157f05/console.log" append="off"/>
Nov 16 10:15:23 user nova-compute[85141]:     </serial>
Nov 16 10:15:23 user nova-compute[85141]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 10:15:23 user nova-compute[85141]:     <video>
Nov 16 10:15:23 user nova-compute[85141]:       <model type="virtio"/>
Nov 16 10:15:23 user nova-compute[85141]:     </video>
Nov 16 10:15:23 user nova-compute[85141]:     <rng model="virtio">
Nov 16 10:15:23 user nova-compute[85141]:       <backend model="random">/dev/urandom</backend>
Nov 16 10:15:23 user nova-compute[85141]:     </rng>
Nov 16 10:15:23 user nova-compute[85141]:     <controller type="usb" index="0" model="none"/>
Nov 16 10:15:23 user nova-compute[85141]:     <memballoon model="virtio">
Nov 16 10:15:23 user nova-compute[85141]:       <stats period="10"/>
Nov 16 10:15:23 user nova-compute[85141]:     </memballoon>
Nov 16 10:15:23 user nova-compute[85141]:   </devices>
Nov 16 10:15:23 user nova-compute[85141]: </domain>
Nov 16 10:15:23 user nova-compute[85141]:  {{(pid=85141) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 10:15:23 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:15:23 user nova-compute[85141]: INFO nova.virt.libvirt.driver [-] [instance: f01dc8cf-1a69-4618-a15d-0c1075157f05] Instance destroyed successfully.
Nov 16 10:15:23 user nova-compute[85141]: DEBUG nova.network.neutron [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] [instance: 361a2044-8fd0-4975-8a19-814bf7a6da41] Updating instance_info_cache with network_info: [{"id": "dd85b227-3f3d-4f02-a323-661af6a9dc92", "address": "fa:16:3e:b7:94:48", "network": {"id": "1d55ecdc-2f77-4c38-b487-0099d658e0ec", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1226034564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b9e035160ba427c80e5668982136a49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd85b227-3f", "ovs_interfaceid": "dd85b227-3f3d-4f02-a323-661af6a9dc92", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:15:23 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-839bedb9-fdef-4f50-bc67-8a6a4f865f4b tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] No BDM found with device name vda, not building metadata. {{(pid=85141) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 10:15:23 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-839bedb9-fdef-4f50-bc67-8a6a4f865f4b tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] No BDM found with device name vdb, not building metadata. {{(pid=85141) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 10:15:23 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-839bedb9-fdef-4f50-bc67-8a6a4f865f4b tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] No VIF found with MAC fa:16:3e:38:1f:8f, not building metadata {{(pid=85141) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 10:15:23 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Releasing lock "refresh_cache-361a2044-8fd0-4975-8a19-814bf7a6da41" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:15:23 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] [instance: 361a2044-8fd0-4975-8a19-814bf7a6da41] Updated the network info_cache for instance {{(pid=85141) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 10:15:23 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:15:23 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:15:23 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager.update_available_resource {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:15:23 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:15:23 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:15:23 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:15:23 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Auditing locally available compute resources for user (node: user) {{(pid=85141) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 10:15:23 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:15:24 user nova-compute[85141]: DEBUG nova.compute.manager [req-01fa42be-bac3-47dd-86f2-7f45eed1d579 req-1d044fbb-4468-4232-9ce9-444321b0306d service nova] [instance: 4e214bbb-5bbb-4e6f-ac09-9cb1412f068b] Received event network-vif-plugged-b0a1b07c-bdba-4ef8-893e-fb5dcdbac88c {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:15:24 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-01fa42be-bac3-47dd-86f2-7f45eed1d579 req-1d044fbb-4468-4232-9ce9-444321b0306d service nova] Acquiring lock "4e214bbb-5bbb-4e6f-ac09-9cb1412f068b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:15:24 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-01fa42be-bac3-47dd-86f2-7f45eed1d579 req-1d044fbb-4468-4232-9ce9-444321b0306d service nova] Lock "4e214bbb-5bbb-4e6f-ac09-9cb1412f068b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:15:24 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-01fa42be-bac3-47dd-86f2-7f45eed1d579 req-1d044fbb-4468-4232-9ce9-444321b0306d service nova] Lock "4e214bbb-5bbb-4e6f-ac09-9cb1412f068b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:15:24 user nova-compute[85141]: DEBUG nova.compute.manager [req-01fa42be-bac3-47dd-86f2-7f45eed1d579 req-1d044fbb-4468-4232-9ce9-444321b0306d service nova] [instance: 4e214bbb-5bbb-4e6f-ac09-9cb1412f068b] No waiting events found dispatching network-vif-plugged-b0a1b07c-bdba-4ef8-893e-fb5dcdbac88c {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:15:24 user nova-compute[85141]: WARNING nova.compute.manager [req-01fa42be-bac3-47dd-86f2-7f45eed1d579 req-1d044fbb-4468-4232-9ce9-444321b0306d service nova] [instance: 4e214bbb-5bbb-4e6f-ac09-9cb1412f068b] Received unexpected event network-vif-plugged-b0a1b07c-bdba-4ef8-893e-fb5dcdbac88c for instance with vm_state building and task_state spawning.
Nov 16 10:15:24 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:15:24 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:15:24 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:15:24 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:15:24 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:15:24 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:15:24 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:15:24 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:15:25 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:15:25 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:15:25 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e65ccf79-718d-4eeb-8914-f0db2e2c9ce2/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:15:25 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e65ccf79-718d-4eeb-8914-f0db2e2c9ce2/disk --force-share --output=json" returned: 0 in 0.311s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:15:25 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e65ccf79-718d-4eeb-8914-f0db2e2c9ce2/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:15:25 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e65ccf79-718d-4eeb-8914-f0db2e2c9ce2/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:15:25 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=85141) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 10:15:25 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/361a2044-8fd0-4975-8a19-814bf7a6da41/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:15:26 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/361a2044-8fd0-4975-8a19-814bf7a6da41/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:15:26 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/361a2044-8fd0-4975-8a19-814bf7a6da41/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:15:26 user nova-compute[85141]: DEBUG nova.compute.manager [None req-59b79eec-5327-4256-9e47-976c4421d1f8 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] [instance: 4e214bbb-5bbb-4e6f-ac09-9cb1412f068b] Instance event wait completed in 0 seconds for  {{(pid=85141) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 10:15:26 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-59b79eec-5327-4256-9e47-976c4421d1f8 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] [instance: 4e214bbb-5bbb-4e6f-ac09-9cb1412f068b] Guest created on hypervisor {{(pid=85141) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 10:15:26 user nova-compute[85141]: INFO nova.virt.libvirt.driver [-] [instance: 4e214bbb-5bbb-4e6f-ac09-9cb1412f068b] Instance spawned successfully.
Nov 16 10:15:26 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-59b79eec-5327-4256-9e47-976c4421d1f8 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] [instance: 4e214bbb-5bbb-4e6f-ac09-9cb1412f068b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 10:15:26 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-59b79eec-5327-4256-9e47-976c4421d1f8 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] [instance: 4e214bbb-5bbb-4e6f-ac09-9cb1412f068b] Found default for hw_cdrom_bus of ide {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:15:26 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-59b79eec-5327-4256-9e47-976c4421d1f8 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] [instance: 4e214bbb-5bbb-4e6f-ac09-9cb1412f068b] Found default for hw_disk_bus of virtio {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:15:26 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-59b79eec-5327-4256-9e47-976c4421d1f8 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] [instance: 4e214bbb-5bbb-4e6f-ac09-9cb1412f068b] Found default for hw_input_bus of None {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:15:26 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-59b79eec-5327-4256-9e47-976c4421d1f8 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] [instance: 4e214bbb-5bbb-4e6f-ac09-9cb1412f068b] Found default for hw_pointer_model of None {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:15:26 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-59b79eec-5327-4256-9e47-976c4421d1f8 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] [instance: 4e214bbb-5bbb-4e6f-ac09-9cb1412f068b] Found default for hw_video_model of virtio {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:15:26 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-59b79eec-5327-4256-9e47-976c4421d1f8 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] [instance: 4e214bbb-5bbb-4e6f-ac09-9cb1412f068b] Found default for hw_vif_model of virtio {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:15:26 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/361a2044-8fd0-4975-8a19-814bf7a6da41/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:15:26 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d842f90e-663b-4c95-9d7c-d092d2bac41f/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:15:26 user nova-compute[85141]: DEBUG nova.compute.manager [req-a7ba50b4-e8c3-4305-8bf3-036c5dcdba66 req-bb5d1a69-b9c8-44e3-a259-f9bb5c41132c service nova] [instance: b24c3954-06ff-4e15-9e43-c65d1dae7a5d] Received event network-vif-plugged-6becb779-bd08-4a40-bb56-3b8f03d1f844 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:15:26 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-a7ba50b4-e8c3-4305-8bf3-036c5dcdba66 req-bb5d1a69-b9c8-44e3-a259-f9bb5c41132c service nova] Acquiring lock "b24c3954-06ff-4e15-9e43-c65d1dae7a5d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:15:26 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-a7ba50b4-e8c3-4305-8bf3-036c5dcdba66 req-bb5d1a69-b9c8-44e3-a259-f9bb5c41132c service nova] Lock "b24c3954-06ff-4e15-9e43-c65d1dae7a5d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:15:26 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-a7ba50b4-e8c3-4305-8bf3-036c5dcdba66 req-bb5d1a69-b9c8-44e3-a259-f9bb5c41132c service nova] Lock "b24c3954-06ff-4e15-9e43-c65d1dae7a5d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:15:26 user nova-compute[85141]: DEBUG nova.compute.manager [req-a7ba50b4-e8c3-4305-8bf3-036c5dcdba66 req-bb5d1a69-b9c8-44e3-a259-f9bb5c41132c service nova] [instance: b24c3954-06ff-4e15-9e43-c65d1dae7a5d] No waiting events found dispatching network-vif-plugged-6becb779-bd08-4a40-bb56-3b8f03d1f844 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:15:26 user nova-compute[85141]: WARNING nova.compute.manager [req-a7ba50b4-e8c3-4305-8bf3-036c5dcdba66 req-bb5d1a69-b9c8-44e3-a259-f9bb5c41132c service nova] [instance: b24c3954-06ff-4e15-9e43-c65d1dae7a5d] Received unexpected event network-vif-plugged-6becb779-bd08-4a40-bb56-3b8f03d1f844 for instance with vm_state building and task_state spawning.
Nov 16 10:15:26 user nova-compute[85141]: INFO nova.compute.manager [None req-59b79eec-5327-4256-9e47-976c4421d1f8 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] [instance: 4e214bbb-5bbb-4e6f-ac09-9cb1412f068b] Took 10.86 seconds to spawn the instance on the hypervisor.
Nov 16 10:15:26 user nova-compute[85141]: DEBUG nova.compute.manager [None req-59b79eec-5327-4256-9e47-976c4421d1f8 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] [instance: 4e214bbb-5bbb-4e6f-ac09-9cb1412f068b] Checking state {{(pid=85141) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 10:15:26 user nova-compute[85141]: DEBUG nova.compute.manager [None req-a66bc243-b34f-484c-9566-4685c361c007 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] [instance: b24c3954-06ff-4e15-9e43-c65d1dae7a5d] Instance event wait completed in 0 seconds for  {{(pid=85141) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 10:15:26 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-a66bc243-b34f-484c-9566-4685c361c007 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] [instance: b24c3954-06ff-4e15-9e43-c65d1dae7a5d] Guest created on hypervisor {{(pid=85141) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 10:15:26 user nova-compute[85141]: INFO nova.virt.libvirt.driver [-] [instance: b24c3954-06ff-4e15-9e43-c65d1dae7a5d] Instance spawned successfully.
Nov 16 10:15:26 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-a66bc243-b34f-484c-9566-4685c361c007 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] [instance: b24c3954-06ff-4e15-9e43-c65d1dae7a5d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 10:15:26 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-a66bc243-b34f-484c-9566-4685c361c007 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] [instance: b24c3954-06ff-4e15-9e43-c65d1dae7a5d] Found default for hw_cdrom_bus of ide {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:15:26 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-a66bc243-b34f-484c-9566-4685c361c007 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] [instance: b24c3954-06ff-4e15-9e43-c65d1dae7a5d] Found default for hw_disk_bus of virtio {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:15:26 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-a66bc243-b34f-484c-9566-4685c361c007 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] [instance: b24c3954-06ff-4e15-9e43-c65d1dae7a5d] Found default for hw_input_bus of None {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:15:26 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-a66bc243-b34f-484c-9566-4685c361c007 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] [instance: b24c3954-06ff-4e15-9e43-c65d1dae7a5d] Found default for hw_pointer_model of None {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:15:26 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-a66bc243-b34f-484c-9566-4685c361c007 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] [instance: b24c3954-06ff-4e15-9e43-c65d1dae7a5d] Found default for hw_video_model of virtio {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:15:26 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-a66bc243-b34f-484c-9566-4685c361c007 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] [instance: b24c3954-06ff-4e15-9e43-c65d1dae7a5d] Found default for hw_vif_model of virtio {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:15:26 user nova-compute[85141]: INFO nova.compute.manager [None req-59b79eec-5327-4256-9e47-976c4421d1f8 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] [instance: 4e214bbb-5bbb-4e6f-ac09-9cb1412f068b] Took 11.72 seconds to build instance.
Nov 16 10:15:26 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d842f90e-663b-4c95-9d7c-d092d2bac41f/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:15:26 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d842f90e-663b-4c95-9d7c-d092d2bac41f/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:15:26 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-59b79eec-5327-4256-9e47-976c4421d1f8 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Lock "4e214bbb-5bbb-4e6f-ac09-9cb1412f068b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.922s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:15:26 user nova-compute[85141]: INFO nova.compute.manager [None req-a66bc243-b34f-484c-9566-4685c361c007 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] [instance: b24c3954-06ff-4e15-9e43-c65d1dae7a5d] Took 9.40 seconds to spawn the instance on the hypervisor.
Nov 16 10:15:26 user nova-compute[85141]: DEBUG nova.compute.manager [None req-a66bc243-b34f-484c-9566-4685c361c007 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] [instance: b24c3954-06ff-4e15-9e43-c65d1dae7a5d] Checking state {{(pid=85141) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 10:15:26 user nova-compute[85141]: INFO nova.compute.manager [None req-a66bc243-b34f-484c-9566-4685c361c007 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] [instance: b24c3954-06ff-4e15-9e43-c65d1dae7a5d] Took 10.59 seconds to build instance.
Nov 16 10:15:26 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d842f90e-663b-4c95-9d7c-d092d2bac41f/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:15:26 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9411843f-4e79-46c4-ae02-01f5e87b86eb/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:15:26 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-a66bc243-b34f-484c-9566-4685c361c007 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Lock "b24c3954-06ff-4e15-9e43-c65d1dae7a5d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.830s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:15:27 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9411843f-4e79-46c4-ae02-01f5e87b86eb/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:15:27 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9411843f-4e79-46c4-ae02-01f5e87b86eb/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:15:27 user nova-compute[85141]: DEBUG nova.compute.manager [None req-839bedb9-fdef-4f50-bc67-8a6a4f865f4b tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] [instance: f01dc8cf-1a69-4618-a15d-0c1075157f05] Checking state {{(pid=85141) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 10:15:27 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:15:27 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9411843f-4e79-46c4-ae02-01f5e87b86eb/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:15:27 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=85141) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 10:15:27 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e214bbb-5bbb-4e6f-ac09-9cb1412f068b/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:15:27 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e214bbb-5bbb-4e6f-ac09-9cb1412f068b/disk --force-share --output=json" returned: 0 in 0.257s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:15:27 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e214bbb-5bbb-4e6f-ac09-9cb1412f068b/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:15:28 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e214bbb-5bbb-4e6f-ac09-9cb1412f068b/disk --force-share --output=json" returned: 0 in 0.286s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:15:28 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65168899-e7c2-4dea-9257-7490ab994939/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:15:28 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65168899-e7c2-4dea-9257-7490ab994939/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:15:28 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65168899-e7c2-4dea-9257-7490ab994939/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:15:28 user nova-compute[85141]: DEBUG nova.compute.manager [req-8dcf2665-92a0-4f3d-9273-caf87166f7c4 req-53bcbc90-680e-4ee7-bb1b-55d197398d74 service nova] [instance: b24c3954-06ff-4e15-9e43-c65d1dae7a5d] Received event network-vif-plugged-6becb779-bd08-4a40-bb56-3b8f03d1f844 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:15:28 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-8dcf2665-92a0-4f3d-9273-caf87166f7c4 req-53bcbc90-680e-4ee7-bb1b-55d197398d74 service nova] Acquiring lock "b24c3954-06ff-4e15-9e43-c65d1dae7a5d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:15:28 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-8dcf2665-92a0-4f3d-9273-caf87166f7c4 req-53bcbc90-680e-4ee7-bb1b-55d197398d74 service nova] Lock "b24c3954-06ff-4e15-9e43-c65d1dae7a5d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:15:28 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-8dcf2665-92a0-4f3d-9273-caf87166f7c4 req-53bcbc90-680e-4ee7-bb1b-55d197398d74 service nova] Lock "b24c3954-06ff-4e15-9e43-c65d1dae7a5d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:15:28 user nova-compute[85141]: DEBUG nova.compute.manager [req-8dcf2665-92a0-4f3d-9273-caf87166f7c4 req-53bcbc90-680e-4ee7-bb1b-55d197398d74 service nova] [instance: b24c3954-06ff-4e15-9e43-c65d1dae7a5d] No waiting events found dispatching network-vif-plugged-6becb779-bd08-4a40-bb56-3b8f03d1f844 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:15:28 user nova-compute[85141]: WARNING nova.compute.manager [req-8dcf2665-92a0-4f3d-9273-caf87166f7c4 req-53bcbc90-680e-4ee7-bb1b-55d197398d74 service nova] [instance: b24c3954-06ff-4e15-9e43-c65d1dae7a5d] Received unexpected event network-vif-plugged-6becb779-bd08-4a40-bb56-3b8f03d1f844 for instance with vm_state active and task_state None.
Nov 16 10:15:28 user nova-compute[85141]: DEBUG nova.compute.manager [req-8dcf2665-92a0-4f3d-9273-caf87166f7c4 req-53bcbc90-680e-4ee7-bb1b-55d197398d74 service nova] [instance: f01dc8cf-1a69-4618-a15d-0c1075157f05] Received event network-vif-plugged-52edc378-51f4-43c3-b9f3-2d0201ed125d {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:15:28 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-8dcf2665-92a0-4f3d-9273-caf87166f7c4 req-53bcbc90-680e-4ee7-bb1b-55d197398d74 service nova] Acquiring lock "f01dc8cf-1a69-4618-a15d-0c1075157f05-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:15:28 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-8dcf2665-92a0-4f3d-9273-caf87166f7c4 req-53bcbc90-680e-4ee7-bb1b-55d197398d74 service nova] Lock "f01dc8cf-1a69-4618-a15d-0c1075157f05-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:15:28 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-8dcf2665-92a0-4f3d-9273-caf87166f7c4 req-53bcbc90-680e-4ee7-bb1b-55d197398d74 service nova] Lock "f01dc8cf-1a69-4618-a15d-0c1075157f05-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:15:28 user nova-compute[85141]: DEBUG nova.compute.manager [req-8dcf2665-92a0-4f3d-9273-caf87166f7c4 req-53bcbc90-680e-4ee7-bb1b-55d197398d74 service nova] [instance: f01dc8cf-1a69-4618-a15d-0c1075157f05] No waiting events found dispatching network-vif-plugged-52edc378-51f4-43c3-b9f3-2d0201ed125d {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:15:28 user nova-compute[85141]: WARNING nova.compute.manager [req-8dcf2665-92a0-4f3d-9273-caf87166f7c4 req-53bcbc90-680e-4ee7-bb1b-55d197398d74 service nova] [instance: f01dc8cf-1a69-4618-a15d-0c1075157f05] Received unexpected event network-vif-plugged-52edc378-51f4-43c3-b9f3-2d0201ed125d for instance with vm_state rescued and task_state None.
Nov 16 10:15:28 user nova-compute[85141]: DEBUG nova.compute.manager [req-8dcf2665-92a0-4f3d-9273-caf87166f7c4 req-53bcbc90-680e-4ee7-bb1b-55d197398d74 service nova] [instance: f01dc8cf-1a69-4618-a15d-0c1075157f05] Received event network-vif-plugged-52edc378-51f4-43c3-b9f3-2d0201ed125d {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:15:28 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-8dcf2665-92a0-4f3d-9273-caf87166f7c4 req-53bcbc90-680e-4ee7-bb1b-55d197398d74 service nova] Acquiring lock "f01dc8cf-1a69-4618-a15d-0c1075157f05-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:15:28 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-8dcf2665-92a0-4f3d-9273-caf87166f7c4 req-53bcbc90-680e-4ee7-bb1b-55d197398d74 service nova] Lock "f01dc8cf-1a69-4618-a15d-0c1075157f05-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:15:28 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-8dcf2665-92a0-4f3d-9273-caf87166f7c4 req-53bcbc90-680e-4ee7-bb1b-55d197398d74 service nova] Lock "f01dc8cf-1a69-4618-a15d-0c1075157f05-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:15:28 user nova-compute[85141]: DEBUG nova.compute.manager [req-8dcf2665-92a0-4f3d-9273-caf87166f7c4 req-53bcbc90-680e-4ee7-bb1b-55d197398d74 service nova] [instance: f01dc8cf-1a69-4618-a15d-0c1075157f05] No waiting events found dispatching network-vif-plugged-52edc378-51f4-43c3-b9f3-2d0201ed125d {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:15:28 user nova-compute[85141]: WARNING nova.compute.manager [req-8dcf2665-92a0-4f3d-9273-caf87166f7c4 req-53bcbc90-680e-4ee7-bb1b-55d197398d74 service nova] [instance: f01dc8cf-1a69-4618-a15d-0c1075157f05] Received unexpected event network-vif-plugged-52edc378-51f4-43c3-b9f3-2d0201ed125d for instance with vm_state rescued and task_state None.
Nov 16 10:15:28 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65168899-e7c2-4dea-9257-7490ab994939/disk --force-share --output=json" returned: 0 in 0.266s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:15:28 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=85141) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 10:15:28 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f01dc8cf-1a69-4618-a15d-0c1075157f05/disk.rescue --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:15:28 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f01dc8cf-1a69-4618-a15d-0c1075157f05/disk.rescue --force-share --output=json" returned: 0 in 0.201s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:15:28 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f01dc8cf-1a69-4618-a15d-0c1075157f05/disk.rescue --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:15:28 user nova-compute[85141]: DEBUG nova.compute.manager [req-7b9ae45d-674f-4ff0-8788-07f74aabe049 req-90f8bbce-5d61-4fd6-a5d2-788d3354c600 service nova] [instance: 059d6974-bd0c-4f73-91fc-8202ebda4238] Received event network-changed-89bf502f-593d-4c6e-aa83-a041e0ad7b28 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:15:28 user nova-compute[85141]: DEBUG nova.compute.manager [req-7b9ae45d-674f-4ff0-8788-07f74aabe049 req-90f8bbce-5d61-4fd6-a5d2-788d3354c600 service nova] [instance: 059d6974-bd0c-4f73-91fc-8202ebda4238] Refreshing instance network info cache due to event network-changed-89bf502f-593d-4c6e-aa83-a041e0ad7b28. {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 10:15:28 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-7b9ae45d-674f-4ff0-8788-07f74aabe049 req-90f8bbce-5d61-4fd6-a5d2-788d3354c600 service nova] Acquiring lock "refresh_cache-059d6974-bd0c-4f73-91fc-8202ebda4238" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:15:28 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-7b9ae45d-674f-4ff0-8788-07f74aabe049 req-90f8bbce-5d61-4fd6-a5d2-788d3354c600 service nova] Acquired lock "refresh_cache-059d6974-bd0c-4f73-91fc-8202ebda4238" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:15:28 user nova-compute[85141]: DEBUG nova.network.neutron [req-7b9ae45d-674f-4ff0-8788-07f74aabe049 req-90f8bbce-5d61-4fd6-a5d2-788d3354c600 service nova] [instance: 059d6974-bd0c-4f73-91fc-8202ebda4238] Refreshing network info cache for port 89bf502f-593d-4c6e-aa83-a041e0ad7b28 {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 10:15:29 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f01dc8cf-1a69-4618-a15d-0c1075157f05/disk.rescue --force-share --output=json" returned: 0 in 0.253s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:15:29 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff05707-78c9-4f78-95e4-660f10636b7a/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:15:29 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff05707-78c9-4f78-95e4-660f10636b7a/disk --force-share --output=json" returned: 0 in 0.298s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:15:29 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff05707-78c9-4f78-95e4-660f10636b7a/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:15:29 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff05707-78c9-4f78-95e4-660f10636b7a/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:15:29 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b24c3954-06ff-4e15-9e43-c65d1dae7a5d/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:15:29 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b24c3954-06ff-4e15-9e43-c65d1dae7a5d/disk --force-share --output=json" returned: 0 in 0.285s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:15:29 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b24c3954-06ff-4e15-9e43-c65d1dae7a5d/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:15:30 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b24c3954-06ff-4e15-9e43-c65d1dae7a5d/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:15:30 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/059d6974-bd0c-4f73-91fc-8202ebda4238/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:15:30 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:15:30 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/059d6974-bd0c-4f73-91fc-8202ebda4238/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:15:30 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/059d6974-bd0c-4f73-91fc-8202ebda4238/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:15:30 user nova-compute[85141]: DEBUG nova.network.neutron [req-7b9ae45d-674f-4ff0-8788-07f74aabe049 req-90f8bbce-5d61-4fd6-a5d2-788d3354c600 service nova] [instance: 059d6974-bd0c-4f73-91fc-8202ebda4238] Updated VIF entry in instance network info cache for port 89bf502f-593d-4c6e-aa83-a041e0ad7b28. {{(pid=85141) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 10:15:30 user nova-compute[85141]: DEBUG nova.network.neutron [req-7b9ae45d-674f-4ff0-8788-07f74aabe049 req-90f8bbce-5d61-4fd6-a5d2-788d3354c600 service nova] [instance: 059d6974-bd0c-4f73-91fc-8202ebda4238] Updating instance_info_cache with network_info: [{"id": "89bf502f-593d-4c6e-aa83-a041e0ad7b28", "address": "fa:16:3e:40:09:f4", "network": {"id": "859d1f09-56c4-4c2b-b2c3-02b1938e8dbf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1562516834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "879fa3f4dfc34726b20149b8a7db22dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89bf502f-59", "ovs_interfaceid": "89bf502f-593d-4c6e-aa83-a041e0ad7b28", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:15:30 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/059d6974-bd0c-4f73-91fc-8202ebda4238/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:15:30 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-7b9ae45d-674f-4ff0-8788-07f74aabe049 req-90f8bbce-5d61-4fd6-a5d2-788d3354c600 service nova] Releasing lock "refresh_cache-059d6974-bd0c-4f73-91fc-8202ebda4238" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:15:31 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:15:31 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:15:31 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Hypervisor/Node resource view: name=user free_ram=7684MB free_disk=25.308982849121094GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=85141) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 10:15:31 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:15:31 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:15:31 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Applying migration context for instance e65ccf79-718d-4eeb-8914-f0db2e2c9ce2 as it has an incoming, in-progress migration fc337d89-3421-482f-93bf-c5f11b82f622. Migration status is finished {{(pid=85141) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 16 10:15:31 user nova-compute[85141]: INFO nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] [instance: e65ccf79-718d-4eeb-8914-f0db2e2c9ce2] Updating resource usage from migration fc337d89-3421-482f-93bf-c5f11b82f622
Nov 16 10:15:31 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance d842f90e-663b-4c95-9d7c-d092d2bac41f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:15:31 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance 361a2044-8fd0-4975-8a19-814bf7a6da41 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:15:31 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance f01dc8cf-1a69-4618-a15d-0c1075157f05 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:15:31 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance 8ff05707-78c9-4f78-95e4-660f10636b7a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:15:31 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance 059d6974-bd0c-4f73-91fc-8202ebda4238 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:15:31 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance 65168899-e7c2-4dea-9257-7490ab994939 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:15:31 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance 9411843f-4e79-46c4-ae02-01f5e87b86eb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:15:31 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Migration fc337d89-3421-482f-93bf-c5f11b82f622 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 16 10:15:31 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance e65ccf79-718d-4eeb-8914-f0db2e2c9ce2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:15:31 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance 4e214bbb-5bbb-4e6f-ac09-9cb1412f068b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:15:31 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance b24c3954-06ff-4e15-9e43-c65d1dae7a5d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:15:31 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=85141) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 10:15:31 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=29GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=85141) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 10:15:31 user nova-compute[85141]: DEBUG nova.compute.provider_tree [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Inventory has not changed in ProviderTree for provider: bf8e0fa1-16b6-408f-9203-c4cd63916272 {{(pid=85141) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 10:15:31 user nova-compute[85141]: DEBUG nova.scheduler.client.report [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Inventory has not changed for provider bf8e0fa1-16b6-408f-9203-c4cd63916272 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=85141) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 10:15:31 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Compute_service record updated for user:user {{(pid=85141) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 10:15:31 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.684s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:15:32 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:15:32 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-cf90547f-7aca-4477-ab3a-973a627c45e2 tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] Acquiring lock "8ff05707-78c9-4f78-95e4-660f10636b7a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:15:32 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-cf90547f-7aca-4477-ab3a-973a627c45e2 tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] Lock "8ff05707-78c9-4f78-95e4-660f10636b7a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:15:32 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-cf90547f-7aca-4477-ab3a-973a627c45e2 tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] Acquiring lock "8ff05707-78c9-4f78-95e4-660f10636b7a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:15:32 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-cf90547f-7aca-4477-ab3a-973a627c45e2 tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] Lock "8ff05707-78c9-4f78-95e4-660f10636b7a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:15:32 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-cf90547f-7aca-4477-ab3a-973a627c45e2 tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] Lock "8ff05707-78c9-4f78-95e4-660f10636b7a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:15:32 user nova-compute[85141]: INFO nova.compute.manager [None req-cf90547f-7aca-4477-ab3a-973a627c45e2 tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] [instance: 8ff05707-78c9-4f78-95e4-660f10636b7a] Terminating instance
Nov 16 10:15:32 user nova-compute[85141]: DEBUG nova.compute.manager [None req-cf90547f-7aca-4477-ab3a-973a627c45e2 tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] [instance: 8ff05707-78c9-4f78-95e4-660f10636b7a] Start destroying the instance on the hypervisor. {{(pid=85141) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 10:15:32 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:15:32 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:15:33 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:15:33 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:15:33 user nova-compute[85141]: INFO nova.virt.libvirt.driver [-] [instance: 8ff05707-78c9-4f78-95e4-660f10636b7a] Instance destroyed successfully.
Nov 16 10:15:33 user nova-compute[85141]: DEBUG nova.objects.instance [None req-cf90547f-7aca-4477-ab3a-973a627c45e2 tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] Lazy-loading 'resources' on Instance uuid 8ff05707-78c9-4f78-95e4-660f10636b7a {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:15:33 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-cf90547f-7aca-4477-ab3a-973a627c45e2 tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T10:13:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1565498532',display_name='tempest-VolumesAdminNegativeTest-server-1565498532',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1565498532',id=14,image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-16T10:13:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5b9e035160ba427c80e5668982136a49',ramdisk_id='',reservation_id='r-w8rilfip',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1984071326',owner_user_name='tempest-VolumesAdminNegativeTest-1984071326-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T10:13:45Z,user_data=None,user_id='cb1fde08d82e4eedb97f1501eafa3bd0',uuid=8ff05707-78c9-4f78-95e4-660f10636b7a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e4ce9608-d62c-4289-a5eb-ff3dc20be4fd", "address": "fa:16:3e:4e:f1:9b", "network": {"id": "1d55ecdc-2f77-4c38-b487-0099d658e0ec", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1226034564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b9e035160ba427c80e5668982136a49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4ce9608-d6", "ovs_interfaceid": "e4ce9608-d62c-4289-a5eb-ff3dc20be4fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 10:15:33 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-cf90547f-7aca-4477-ab3a-973a627c45e2 tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] Converting VIF {"id": "e4ce9608-d62c-4289-a5eb-ff3dc20be4fd", "address": "fa:16:3e:4e:f1:9b", "network": {"id": "1d55ecdc-2f77-4c38-b487-0099d658e0ec", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1226034564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b9e035160ba427c80e5668982136a49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4ce9608-d6", "ovs_interfaceid": "e4ce9608-d62c-4289-a5eb-ff3dc20be4fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:15:33 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-cf90547f-7aca-4477-ab3a-973a627c45e2 tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4e:f1:9b,bridge_name='br-int',has_traffic_filtering=True,id=e4ce9608-d62c-4289-a5eb-ff3dc20be4fd,network=Network(1d55ecdc-2f77-4c38-b487-0099d658e0ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4ce9608-d6') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:15:33 user nova-compute[85141]: DEBUG os_vif [None req-cf90547f-7aca-4477-ab3a-973a627c45e2 tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:f1:9b,bridge_name='br-int',has_traffic_filtering=True,id=e4ce9608-d62c-4289-a5eb-ff3dc20be4fd,network=Network(1d55ecdc-2f77-4c38-b487-0099d658e0ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4ce9608-d6') {{(pid=85141) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 10:15:33 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:15:33 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape4ce9608-d6, bridge=br-int, if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:15:33 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:15:33 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:15:33 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:15:33 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:15:33 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=22afe6c9-b083-4986-8138-e26322c33ba6) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:15:33 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:15:33 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:15:33 user nova-compute[85141]: INFO os_vif [None req-cf90547f-7aca-4477-ab3a-973a627c45e2 tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:f1:9b,bridge_name='br-int',has_traffic_filtering=True,id=e4ce9608-d62c-4289-a5eb-ff3dc20be4fd,network=Network(1d55ecdc-2f77-4c38-b487-0099d658e0ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4ce9608-d6')
Nov 16 10:15:33 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-cf90547f-7aca-4477-ab3a-973a627c45e2 tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] [instance: 8ff05707-78c9-4f78-95e4-660f10636b7a] Deleting instance files /opt/stack/data/nova/instances/8ff05707-78c9-4f78-95e4-660f10636b7a_del
Nov 16 10:15:33 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-cf90547f-7aca-4477-ab3a-973a627c45e2 tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] [instance: 8ff05707-78c9-4f78-95e4-660f10636b7a] Deletion of /opt/stack/data/nova/instances/8ff05707-78c9-4f78-95e4-660f10636b7a_del complete
Nov 16 10:15:33 user nova-compute[85141]: INFO nova.compute.manager [None req-cf90547f-7aca-4477-ab3a-973a627c45e2 tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] [instance: 8ff05707-78c9-4f78-95e4-660f10636b7a] Took 1.26 seconds to destroy the instance on the hypervisor.
Nov 16 10:15:33 user nova-compute[85141]: DEBUG oslo.service.loopingcall [None req-cf90547f-7aca-4477-ab3a-973a627c45e2 tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=85141) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 10:15:33 user nova-compute[85141]: DEBUG nova.compute.manager [-] [instance: 8ff05707-78c9-4f78-95e4-660f10636b7a] Deallocating network for instance {{(pid=85141) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 10:15:33 user nova-compute[85141]: DEBUG nova.network.neutron [-] [instance: 8ff05707-78c9-4f78-95e4-660f10636b7a] deallocate_for_instance() {{(pid=85141) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 10:15:34 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:15:34 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:15:34 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:15:35 user nova-compute[85141]: DEBUG nova.network.neutron [-] [instance: 8ff05707-78c9-4f78-95e4-660f10636b7a] Updating instance_info_cache with network_info: [] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:15:35 user nova-compute[85141]: INFO nova.compute.manager [-] [instance: 8ff05707-78c9-4f78-95e4-660f10636b7a] Took 1.45 seconds to deallocate network for instance.
Nov 16 10:15:35 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-cf90547f-7aca-4477-ab3a-973a627c45e2 tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:15:35 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-cf90547f-7aca-4477-ab3a-973a627c45e2 tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:15:35 user nova-compute[85141]: DEBUG nova.compute.manager [req-23ec602d-b564-4538-a516-28fc9eba6725 req-0449245d-090b-49f8-927a-76e4c60f8ce5 service nova] [instance: 8ff05707-78c9-4f78-95e4-660f10636b7a] Received event network-vif-deleted-e4ce9608-d62c-4289-a5eb-ff3dc20be4fd {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:15:35 user nova-compute[85141]: DEBUG nova.compute.provider_tree [None req-cf90547f-7aca-4477-ab3a-973a627c45e2 tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] Inventory has not changed in ProviderTree for provider: bf8e0fa1-16b6-408f-9203-c4cd63916272 {{(pid=85141) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 10:15:35 user nova-compute[85141]: DEBUG nova.scheduler.client.report [None req-cf90547f-7aca-4477-ab3a-973a627c45e2 tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] Inventory has not changed for provider bf8e0fa1-16b6-408f-9203-c4cd63916272 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=85141) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 10:15:35 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-cf90547f-7aca-4477-ab3a-973a627c45e2 tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.574s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:15:35 user nova-compute[85141]: INFO nova.scheduler.client.report [None req-cf90547f-7aca-4477-ab3a-973a627c45e2 tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] Deleted allocations for instance 8ff05707-78c9-4f78-95e4-660f10636b7a
Nov 16 10:15:36 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-cf90547f-7aca-4477-ab3a-973a627c45e2 tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] Lock "8ff05707-78c9-4f78-95e4-660f10636b7a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.552s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:15:36 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:15:37 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:15:37 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:15:38 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:15:39 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:15:42 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:15:42 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-02b8a0e9-ab92-46fd-8b24-4f69e8551b1c tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] Acquiring lock "fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:15:42 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-02b8a0e9-ab92-46fd-8b24-4f69e8551b1c tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] Lock "fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:15:42 user nova-compute[85141]: DEBUG nova.compute.manager [None req-02b8a0e9-ab92-46fd-8b24-4f69e8551b1c tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] [instance: fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f] Starting instance... {{(pid=85141) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 10:15:42 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-1c45e571-837c-4eda-8c87-b6e38dba2878 tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] Acquiring lock "65168899-e7c2-4dea-9257-7490ab994939" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:15:42 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-1c45e571-837c-4eda-8c87-b6e38dba2878 tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] Lock "65168899-e7c2-4dea-9257-7490ab994939" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:15:42 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-1c45e571-837c-4eda-8c87-b6e38dba2878 tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] Acquiring lock "65168899-e7c2-4dea-9257-7490ab994939-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:15:42 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-1c45e571-837c-4eda-8c87-b6e38dba2878 tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] Lock "65168899-e7c2-4dea-9257-7490ab994939-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:15:42 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-1c45e571-837c-4eda-8c87-b6e38dba2878 tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] Lock "65168899-e7c2-4dea-9257-7490ab994939-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:15:42 user nova-compute[85141]: INFO nova.compute.manager [None req-1c45e571-837c-4eda-8c87-b6e38dba2878 tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] [instance: 65168899-e7c2-4dea-9257-7490ab994939] Terminating instance
Nov 16 10:15:42 user nova-compute[85141]: DEBUG nova.compute.manager [None req-1c45e571-837c-4eda-8c87-b6e38dba2878 tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] [instance: 65168899-e7c2-4dea-9257-7490ab994939] Start destroying the instance on the hypervisor. {{(pid=85141) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 10:15:42 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-02b8a0e9-ab92-46fd-8b24-4f69e8551b1c tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:15:42 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-02b8a0e9-ab92-46fd-8b24-4f69e8551b1c tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:15:42 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-02b8a0e9-ab92-46fd-8b24-4f69e8551b1c tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=85141) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 10:15:42 user nova-compute[85141]: INFO nova.compute.claims [None req-02b8a0e9-ab92-46fd-8b24-4f69e8551b1c tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] [instance: fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f] Claim successful on node user
Nov 16 10:15:42 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:15:42 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:15:42 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:15:42 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:15:43 user nova-compute[85141]: DEBUG nova.compute.provider_tree [None req-02b8a0e9-ab92-46fd-8b24-4f69e8551b1c tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] Inventory has not changed in ProviderTree for provider: bf8e0fa1-16b6-408f-9203-c4cd63916272 {{(pid=85141) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 10:15:43 user nova-compute[85141]: DEBUG nova.scheduler.client.report [None req-02b8a0e9-ab92-46fd-8b24-4f69e8551b1c tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] Inventory has not changed for provider bf8e0fa1-16b6-408f-9203-c4cd63916272 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=85141) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 10:15:43 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-02b8a0e9-ab92-46fd-8b24-4f69e8551b1c tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.501s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:15:43 user nova-compute[85141]: DEBUG nova.compute.manager [None req-02b8a0e9-ab92-46fd-8b24-4f69e8551b1c tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] [instance: fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f] Start building networks asynchronously for instance. {{(pid=85141) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 10:15:43 user nova-compute[85141]: DEBUG nova.compute.manager [None req-02b8a0e9-ab92-46fd-8b24-4f69e8551b1c tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] [instance: fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f] Allocating IP information in the background. {{(pid=85141) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 10:15:43 user nova-compute[85141]: DEBUG nova.network.neutron [None req-02b8a0e9-ab92-46fd-8b24-4f69e8551b1c tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] [instance: fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f] allocate_for_instance() {{(pid=85141) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 10:15:43 user nova-compute[85141]: INFO nova.virt.libvirt.driver [-] [instance: 65168899-e7c2-4dea-9257-7490ab994939] Instance destroyed successfully.
Nov 16 10:15:43 user nova-compute[85141]: DEBUG nova.objects.instance [None req-1c45e571-837c-4eda-8c87-b6e38dba2878 tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] Lazy-loading 'resources' on Instance uuid 65168899-e7c2-4dea-9257-7490ab994939 {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:15:43 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-02b8a0e9-ab92-46fd-8b24-4f69e8551b1c tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] [instance: fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 10:15:43 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-1c45e571-837c-4eda-8c87-b6e38dba2878 tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T10:13:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1721502885',display_name='tempest-VolumesActionsTest-instance-1721502885',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1721502885',id=16,image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-16T10:13:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b35983b98d3c404d8cddce2894f97dba',ramdisk_id='',reservation_id='r-ka3o6fwg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1337688058',owner_user_name='tempest-VolumesActionsTest-1337688058-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T10:13:58Z,user_data=None,user_id='3b83d10371214ba68a125f52df7e33ad',uuid=65168899-e7c2-4dea-9257-7490ab994939,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "814b06ff-29a7-4402-92dd-e2a1b60b782a", "address": "fa:16:3e:f5:e3:cf", "network": {"id": "20b79aa8-c67e-4ab4-aa9f-659587f8bcb2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1635312124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b35983b98d3c404d8cddce2894f97dba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap814b06ff-29", "ovs_interfaceid": "814b06ff-29a7-4402-92dd-e2a1b60b782a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 10:15:43 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-1c45e571-837c-4eda-8c87-b6e38dba2878 tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] Converting VIF {"id": "814b06ff-29a7-4402-92dd-e2a1b60b782a", "address": "fa:16:3e:f5:e3:cf", "network": {"id": "20b79aa8-c67e-4ab4-aa9f-659587f8bcb2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1635312124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b35983b98d3c404d8cddce2894f97dba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap814b06ff-29", "ovs_interfaceid": "814b06ff-29a7-4402-92dd-e2a1b60b782a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:15:43 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-1c45e571-837c-4eda-8c87-b6e38dba2878 tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:e3:cf,bridge_name='br-int',has_traffic_filtering=True,id=814b06ff-29a7-4402-92dd-e2a1b60b782a,network=Network(20b79aa8-c67e-4ab4-aa9f-659587f8bcb2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap814b06ff-29') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:15:43 user nova-compute[85141]: DEBUG os_vif [None req-1c45e571-837c-4eda-8c87-b6e38dba2878 tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:e3:cf,bridge_name='br-int',has_traffic_filtering=True,id=814b06ff-29a7-4402-92dd-e2a1b60b782a,network=Network(20b79aa8-c67e-4ab4-aa9f-659587f8bcb2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap814b06ff-29') {{(pid=85141) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 10:15:43 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:15:43 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap814b06ff-29, bridge=br-int, if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:15:43 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:15:43 user nova-compute[85141]: DEBUG nova.compute.manager [None req-02b8a0e9-ab92-46fd-8b24-4f69e8551b1c tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] [instance: fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f] Start building block device mappings for instance. {{(pid=85141) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 10:15:43 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:15:43 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:15:43 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f4a1564d-952a-4e1d-a87c-972f4dacc114) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:15:43 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:15:43 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:15:43 user nova-compute[85141]: INFO os_vif [None req-1c45e571-837c-4eda-8c87-b6e38dba2878 tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:e3:cf,bridge_name='br-int',has_traffic_filtering=True,id=814b06ff-29a7-4402-92dd-e2a1b60b782a,network=Network(20b79aa8-c67e-4ab4-aa9f-659587f8bcb2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap814b06ff-29')
Nov 16 10:15:43 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-1c45e571-837c-4eda-8c87-b6e38dba2878 tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] [instance: 65168899-e7c2-4dea-9257-7490ab994939] Deleting instance files /opt/stack/data/nova/instances/65168899-e7c2-4dea-9257-7490ab994939_del
Nov 16 10:15:43 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-1c45e571-837c-4eda-8c87-b6e38dba2878 tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] [instance: 65168899-e7c2-4dea-9257-7490ab994939] Deletion of /opt/stack/data/nova/instances/65168899-e7c2-4dea-9257-7490ab994939_del complete
Nov 16 10:15:43 user nova-compute[85141]: DEBUG nova.policy [None req-02b8a0e9-ab92-46fd-8b24-4f69e8551b1c tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9e95eddbeebf4768bc04632d5a94003a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cdf22a86934481196276e29c2cdb48b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85141) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 10:15:43 user nova-compute[85141]: INFO nova.compute.manager [None req-1c45e571-837c-4eda-8c87-b6e38dba2878 tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] [instance: 65168899-e7c2-4dea-9257-7490ab994939] Took 0.77 seconds to destroy the instance on the hypervisor.
Nov 16 10:15:43 user nova-compute[85141]: DEBUG oslo.service.loopingcall [None req-1c45e571-837c-4eda-8c87-b6e38dba2878 tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=85141) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 10:15:43 user nova-compute[85141]: DEBUG nova.compute.manager [-] [instance: 65168899-e7c2-4dea-9257-7490ab994939] Deallocating network for instance {{(pid=85141) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 10:15:43 user nova-compute[85141]: DEBUG nova.network.neutron [-] [instance: 65168899-e7c2-4dea-9257-7490ab994939] deallocate_for_instance() {{(pid=85141) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 10:15:43 user nova-compute[85141]: DEBUG nova.compute.manager [None req-02b8a0e9-ab92-46fd-8b24-4f69e8551b1c tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] [instance: fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f] Start spawning the instance on the hypervisor. {{(pid=85141) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 10:15:43 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-02b8a0e9-ab92-46fd-8b24-4f69e8551b1c tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] [instance: fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f] Creating instance directory {{(pid=85141) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 10:15:43 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-02b8a0e9-ab92-46fd-8b24-4f69e8551b1c tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] [instance: fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f] Creating image(s)
Nov 16 10:15:43 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-02b8a0e9-ab92-46fd-8b24-4f69e8551b1c tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] Acquiring lock "/opt/stack/data/nova/instances/fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:15:43 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-02b8a0e9-ab92-46fd-8b24-4f69e8551b1c tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] Lock "/opt/stack/data/nova/instances/fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:15:43 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-02b8a0e9-ab92-46fd-8b24-4f69e8551b1c tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] Lock "/opt/stack/data/nova/instances/fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:15:43 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-02b8a0e9-ab92-46fd-8b24-4f69e8551b1c tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:15:43 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-02b8a0e9-ab92-46fd-8b24-4f69e8551b1c tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json" returned: 0 in 0.195s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:15:43 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-02b8a0e9-ab92-46fd-8b24-4f69e8551b1c tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] Acquiring lock "60a78556fb399ed4a41bc3ca4bccf77c96d8e811" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:15:43 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-02b8a0e9-ab92-46fd-8b24-4f69e8551b1c tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] Lock "60a78556fb399ed4a41bc3ca4bccf77c96d8e811" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:15:43 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-02b8a0e9-ab92-46fd-8b24-4f69e8551b1c tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:15:43 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-02b8a0e9-ab92-46fd-8b24-4f69e8551b1c tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json" returned: 0 in 0.176s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:15:43 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-02b8a0e9-ab92-46fd-8b24-4f69e8551b1c tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811,backing_fmt=raw /opt/stack/data/nova/instances/fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f/disk 1073741824 {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:15:43 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-02b8a0e9-ab92-46fd-8b24-4f69e8551b1c tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811,backing_fmt=raw /opt/stack/data/nova/instances/fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f/disk 1073741824" returned: 0 in 0.049s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:15:43 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-02b8a0e9-ab92-46fd-8b24-4f69e8551b1c tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] Lock "60a78556fb399ed4a41bc3ca4bccf77c96d8e811" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.239s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:15:43 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-02b8a0e9-ab92-46fd-8b24-4f69e8551b1c tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:15:44 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-02b8a0e9-ab92-46fd-8b24-4f69e8551b1c tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json" returned: 0 in 0.205s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:15:44 user nova-compute[85141]: DEBUG nova.virt.disk.api [None req-02b8a0e9-ab92-46fd-8b24-4f69e8551b1c tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f/disk. size=1073741824 {{(pid=85141) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 10:15:44 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-02b8a0e9-ab92-46fd-8b24-4f69e8551b1c tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:15:44 user nova-compute[85141]: DEBUG nova.network.neutron [-] [instance: 65168899-e7c2-4dea-9257-7490ab994939] Updating instance_info_cache with network_info: [] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:15:44 user nova-compute[85141]: DEBUG nova.compute.manager [req-4516496f-0580-4d3a-88df-04e67fa70758 req-12f17b2d-a9e6-4c3b-8327-653962fe8c32 service nova] [instance: 65168899-e7c2-4dea-9257-7490ab994939] Received event network-vif-deleted-814b06ff-29a7-4402-92dd-e2a1b60b782a {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:15:44 user nova-compute[85141]: INFO nova.compute.manager [req-4516496f-0580-4d3a-88df-04e67fa70758 req-12f17b2d-a9e6-4c3b-8327-653962fe8c32 service nova] [instance: 65168899-e7c2-4dea-9257-7490ab994939] Neutron deleted interface 814b06ff-29a7-4402-92dd-e2a1b60b782a; detaching it from the instance and deleting it from the info cache
Nov 16 10:15:44 user nova-compute[85141]: DEBUG nova.network.neutron [req-4516496f-0580-4d3a-88df-04e67fa70758 req-12f17b2d-a9e6-4c3b-8327-653962fe8c32 service nova] [instance: 65168899-e7c2-4dea-9257-7490ab994939] Updating instance_info_cache with network_info: [] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:15:44 user nova-compute[85141]: INFO nova.compute.manager [-] [instance: 65168899-e7c2-4dea-9257-7490ab994939] Took 0.78 seconds to deallocate network for instance.
Nov 16 10:15:44 user nova-compute[85141]: DEBUG nova.compute.manager [req-4516496f-0580-4d3a-88df-04e67fa70758 req-12f17b2d-a9e6-4c3b-8327-653962fe8c32 service nova] [instance: 65168899-e7c2-4dea-9257-7490ab994939] Detach interface failed, port_id=814b06ff-29a7-4402-92dd-e2a1b60b782a, reason: Instance 65168899-e7c2-4dea-9257-7490ab994939 could not be found. {{(pid=85141) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 16 10:15:44 user nova-compute[85141]: DEBUG nova.compute.manager [req-e46603aa-2365-4347-bef0-458dc65cb131 req-5d04bbca-241e-46f0-a7b1-0f1fe39e6328 service nova] [instance: 65168899-e7c2-4dea-9257-7490ab994939] Received event network-vif-plugged-814b06ff-29a7-4402-92dd-e2a1b60b782a {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:15:44 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-e46603aa-2365-4347-bef0-458dc65cb131 req-5d04bbca-241e-46f0-a7b1-0f1fe39e6328 service nova] Acquiring lock "65168899-e7c2-4dea-9257-7490ab994939-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:15:44 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-e46603aa-2365-4347-bef0-458dc65cb131 req-5d04bbca-241e-46f0-a7b1-0f1fe39e6328 service nova] Lock "65168899-e7c2-4dea-9257-7490ab994939-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:15:44 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-e46603aa-2365-4347-bef0-458dc65cb131 req-5d04bbca-241e-46f0-a7b1-0f1fe39e6328 service nova] Lock "65168899-e7c2-4dea-9257-7490ab994939-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:15:44 user nova-compute[85141]: DEBUG nova.compute.manager [req-e46603aa-2365-4347-bef0-458dc65cb131 req-5d04bbca-241e-46f0-a7b1-0f1fe39e6328 service nova] [instance: 65168899-e7c2-4dea-9257-7490ab994939] No waiting events found dispatching network-vif-plugged-814b06ff-29a7-4402-92dd-e2a1b60b782a {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:15:44 user nova-compute[85141]: WARNING nova.compute.manager [req-e46603aa-2365-4347-bef0-458dc65cb131 req-5d04bbca-241e-46f0-a7b1-0f1fe39e6328 service nova] [instance: 65168899-e7c2-4dea-9257-7490ab994939] Received unexpected event network-vif-plugged-814b06ff-29a7-4402-92dd-e2a1b60b782a for instance with vm_state active and task_state deleting.
Nov 16 10:15:44 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-1c45e571-837c-4eda-8c87-b6e38dba2878 tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:15:44 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-1c45e571-837c-4eda-8c87-b6e38dba2878 tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.005s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:15:44 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-02b8a0e9-ab92-46fd-8b24-4f69e8551b1c tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:15:44 user nova-compute[85141]: DEBUG nova.virt.disk.api [None req-02b8a0e9-ab92-46fd-8b24-4f69e8551b1c tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] Cannot resize image /opt/stack/data/nova/instances/fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f/disk to a smaller size. {{(pid=85141) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 10:15:44 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-02b8a0e9-ab92-46fd-8b24-4f69e8551b1c tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] [instance: fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f] Created local disks {{(pid=85141) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 10:15:44 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-02b8a0e9-ab92-46fd-8b24-4f69e8551b1c tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] [instance: fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f] Ensure instance console log exists: /opt/stack/data/nova/instances/fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f/console.log {{(pid=85141) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 10:15:44 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-02b8a0e9-ab92-46fd-8b24-4f69e8551b1c tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:15:44 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-02b8a0e9-ab92-46fd-8b24-4f69e8551b1c tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:15:44 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-02b8a0e9-ab92-46fd-8b24-4f69e8551b1c tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:15:44 user nova-compute[85141]: DEBUG nova.network.neutron [None req-02b8a0e9-ab92-46fd-8b24-4f69e8551b1c tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] [instance: fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f] Successfully created port: cc62aa76-c6d3-42a2-bf2a-7241919a5fc4 {{(pid=85141) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 10:15:44 user nova-compute[85141]: DEBUG nova.compute.provider_tree [None req-1c45e571-837c-4eda-8c87-b6e38dba2878 tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] Inventory has not changed in ProviderTree for provider: bf8e0fa1-16b6-408f-9203-c4cd63916272 {{(pid=85141) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 10:15:44 user nova-compute[85141]: DEBUG nova.scheduler.client.report [None req-1c45e571-837c-4eda-8c87-b6e38dba2878 tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] Inventory has not changed for provider bf8e0fa1-16b6-408f-9203-c4cd63916272 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=85141) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 10:15:44 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-1c45e571-837c-4eda-8c87-b6e38dba2878 tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.403s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:15:44 user nova-compute[85141]: INFO nova.scheduler.client.report [None req-1c45e571-837c-4eda-8c87-b6e38dba2878 tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] Deleted allocations for instance 65168899-e7c2-4dea-9257-7490ab994939
Nov 16 10:15:44 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-1c45e571-837c-4eda-8c87-b6e38dba2878 tempest-VolumesActionsTest-1337688058 tempest-VolumesActionsTest-1337688058-project-member] Lock "65168899-e7c2-4dea-9257-7490ab994939" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.191s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:15:45 user nova-compute[85141]: DEBUG nova.network.neutron [None req-02b8a0e9-ab92-46fd-8b24-4f69e8551b1c tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] [instance: fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f] Successfully updated port: cc62aa76-c6d3-42a2-bf2a-7241919a5fc4 {{(pid=85141) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 10:15:45 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-02b8a0e9-ab92-46fd-8b24-4f69e8551b1c tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] Acquiring lock "refresh_cache-fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:15:45 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-02b8a0e9-ab92-46fd-8b24-4f69e8551b1c tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] Acquired lock "refresh_cache-fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:15:45 user nova-compute[85141]: DEBUG nova.network.neutron [None req-02b8a0e9-ab92-46fd-8b24-4f69e8551b1c tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] [instance: fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f] Building network info cache for instance {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 10:15:45 user nova-compute[85141]: DEBUG nova.network.neutron [None req-02b8a0e9-ab92-46fd-8b24-4f69e8551b1c tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] [instance: fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f] Instance cache missing network info. {{(pid=85141) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 10:15:45 user nova-compute[85141]: DEBUG nova.network.neutron [None req-02b8a0e9-ab92-46fd-8b24-4f69e8551b1c tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] [instance: fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f] Updating instance_info_cache with network_info: [{"id": "cc62aa76-c6d3-42a2-bf2a-7241919a5fc4", "address": "fa:16:3e:3b:bc:05", "network": {"id": "434cf325-212a-4f85-9779-7791dc1c678f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-248496413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cdf22a86934481196276e29c2cdb48b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc62aa76-c6", "ovs_interfaceid": "cc62aa76-c6d3-42a2-bf2a-7241919a5fc4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:15:45 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-02b8a0e9-ab92-46fd-8b24-4f69e8551b1c tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] Releasing lock "refresh_cache-fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:15:45 user nova-compute[85141]: DEBUG nova.compute.manager [None req-02b8a0e9-ab92-46fd-8b24-4f69e8551b1c tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] [instance: fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f] Instance network_info: |[{"id": "cc62aa76-c6d3-42a2-bf2a-7241919a5fc4", "address": "fa:16:3e:3b:bc:05", "network": {"id": "434cf325-212a-4f85-9779-7791dc1c678f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-248496413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cdf22a86934481196276e29c2cdb48b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc62aa76-c6", "ovs_interfaceid": "cc62aa76-c6d3-42a2-bf2a-7241919a5fc4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=85141) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 10:15:45 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-02b8a0e9-ab92-46fd-8b24-4f69e8551b1c tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] [instance: fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f] Start _get_guest_xml network_info=[{"id": "cc62aa76-c6d3-42a2-bf2a-7241919a5fc4", "address": "fa:16:3e:3b:bc:05", "network": {"id": "434cf325-212a-4f85-9779-7791dc1c678f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-248496413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cdf22a86934481196276e29c2cdb48b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc62aa76-c6", "ovs_interfaceid": "cc62aa76-c6d3-42a2-bf2a-7241919a5fc4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T10:06:42Z,direct_url=<?>,disk_format='qcow2',id=bc4ca70f-a459-4d5c-a9e6-80f1948eb48b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1044631a5fe84ce8904864a7024049fa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T10:06:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_options': None, 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'image_id': 'bc4ca70f-a459-4d5c-a9e6-80f1948eb48b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=85141) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 10:15:45 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-02b8a0e9-ab92-46fd-8b24-4f69e8551b1c tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:15:45 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-02b8a0e9-ab92-46fd-8b24-4f69e8551b1c tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:15:45 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-02b8a0e9-ab92-46fd-8b24-4f69e8551b1c tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=85141) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 10:15:45 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-02b8a0e9-ab92-46fd-8b24-4f69e8551b1c tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] CPU controller missing on host. {{(pid=85141) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 10:15:45 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-02b8a0e9-ab92-46fd-8b24-4f69e8551b1c tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=85141) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 10:15:45 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-02b8a0e9-ab92-46fd-8b24-4f69e8551b1c tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] CPU controller found on host. {{(pid=85141) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 10:15:45 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-02b8a0e9-ab92-46fd-8b24-4f69e8551b1c tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=85141) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 10:15:45 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-02b8a0e9-ab92-46fd-8b24-4f69e8551b1c tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T10:06:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T10:06:42Z,direct_url=<?>,disk_format='qcow2',id=bc4ca70f-a459-4d5c-a9e6-80f1948eb48b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1044631a5fe84ce8904864a7024049fa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T10:06:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 10:15:45 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-02b8a0e9-ab92-46fd-8b24-4f69e8551b1c tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] Flavor limits 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 10:15:45 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-02b8a0e9-ab92-46fd-8b24-4f69e8551b1c tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] Image limits 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 10:15:45 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-02b8a0e9-ab92-46fd-8b24-4f69e8551b1c tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] Flavor pref 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 10:15:45 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-02b8a0e9-ab92-46fd-8b24-4f69e8551b1c tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] Image pref 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 10:15:45 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-02b8a0e9-ab92-46fd-8b24-4f69e8551b1c tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 10:15:45 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-02b8a0e9-ab92-46fd-8b24-4f69e8551b1c tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 10:15:45 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-02b8a0e9-ab92-46fd-8b24-4f69e8551b1c tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=85141) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 10:15:45 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-02b8a0e9-ab92-46fd-8b24-4f69e8551b1c tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] Got 1 possible topologies {{(pid=85141) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 10:15:45 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-02b8a0e9-ab92-46fd-8b24-4f69e8551b1c tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 10:15:45 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-02b8a0e9-ab92-46fd-8b24-4f69e8551b1c tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 10:15:46 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-02b8a0e9-ab92-46fd-8b24-4f69e8551b1c tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T10:15:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-675096085',display_name='tempest-ServerStableDeviceRescueTest-server-675096085',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-675096085',id=19,image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDy6W/eGM5RIOL9sRQS4LaKkBVIMYLDkobB3fvhz5SdWZrhWPoji+Lbru+de1gziqrO+W/0HhQiWO7dkjKIiUJZL6ldxRiGA5rCsMCcnOQwbGGZ5zFupHppDTFvdF4wPCw==',key_name='tempest-keypair-756270117',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0cdf22a86934481196276e29c2cdb48b',ramdisk_id='',reservation_id='r-4s0k8n8m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-692155468',owner_user_name='tempest-ServerStableDeviceRescueTest-692155468-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T10:15:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9e95eddbeebf4768bc04632d5a94003a',uuid=fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cc62aa76-c6d3-42a2-bf2a-7241919a5fc4", "address": "fa:16:3e:3b:bc:05", "network": {"id": "434cf325-212a-4f85-9779-7791dc1c678f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-248496413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cdf22a86934481196276e29c2cdb48b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc62aa76-c6", "ovs_interfaceid": "cc62aa76-c6d3-42a2-bf2a-7241919a5fc4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=85141) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 10:15:46 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-02b8a0e9-ab92-46fd-8b24-4f69e8551b1c tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] Converting VIF {"id": "cc62aa76-c6d3-42a2-bf2a-7241919a5fc4", "address": "fa:16:3e:3b:bc:05", "network": {"id": "434cf325-212a-4f85-9779-7791dc1c678f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-248496413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cdf22a86934481196276e29c2cdb48b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc62aa76-c6", "ovs_interfaceid": "cc62aa76-c6d3-42a2-bf2a-7241919a5fc4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:15:46 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-02b8a0e9-ab92-46fd-8b24-4f69e8551b1c tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3b:bc:05,bridge_name='br-int',has_traffic_filtering=True,id=cc62aa76-c6d3-42a2-bf2a-7241919a5fc4,network=Network(434cf325-212a-4f85-9779-7791dc1c678f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc62aa76-c6') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:15:46 user nova-compute[85141]: DEBUG nova.objects.instance [None req-02b8a0e9-ab92-46fd-8b24-4f69e8551b1c tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] Lazy-loading 'pci_devices' on Instance uuid fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:15:46 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-02b8a0e9-ab92-46fd-8b24-4f69e8551b1c tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] [instance: fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f] End _get_guest_xml xml=<domain type="kvm">
Nov 16 10:15:46 user nova-compute[85141]:   <uuid>fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f</uuid>
Nov 16 10:15:46 user nova-compute[85141]:   <name>instance-00000013</name>
Nov 16 10:15:46 user nova-compute[85141]:   <memory>524288</memory>
Nov 16 10:15:46 user nova-compute[85141]:   <vcpu>1</vcpu>
Nov 16 10:15:46 user nova-compute[85141]:   <metadata>
Nov 16 10:15:46 user nova-compute[85141]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 10:15:46 user nova-compute[85141]:       <nova:package version="0.0.0"/>
Nov 16 10:15:46 user nova-compute[85141]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-675096085</nova:name>
Nov 16 10:15:46 user nova-compute[85141]:       <nova:creationTime>2023-11-16 10:15:45</nova:creationTime>
Nov 16 10:15:46 user nova-compute[85141]:       <nova:flavor name="m1.tiny">
Nov 16 10:15:46 user nova-compute[85141]:         <nova:memory>512</nova:memory>
Nov 16 10:15:46 user nova-compute[85141]:         <nova:disk>1</nova:disk>
Nov 16 10:15:46 user nova-compute[85141]:         <nova:swap>0</nova:swap>
Nov 16 10:15:46 user nova-compute[85141]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 10:15:46 user nova-compute[85141]:         <nova:vcpus>1</nova:vcpus>
Nov 16 10:15:46 user nova-compute[85141]:       </nova:flavor>
Nov 16 10:15:46 user nova-compute[85141]:       <nova:owner>
Nov 16 10:15:46 user nova-compute[85141]:         <nova:user uuid="9e95eddbeebf4768bc04632d5a94003a">tempest-ServerStableDeviceRescueTest-692155468-project-member</nova:user>
Nov 16 10:15:46 user nova-compute[85141]:         <nova:project uuid="0cdf22a86934481196276e29c2cdb48b">tempest-ServerStableDeviceRescueTest-692155468</nova:project>
Nov 16 10:15:46 user nova-compute[85141]:       </nova:owner>
Nov 16 10:15:46 user nova-compute[85141]:       <nova:root type="image" uuid="bc4ca70f-a459-4d5c-a9e6-80f1948eb48b"/>
Nov 16 10:15:46 user nova-compute[85141]:       <nova:ports>
Nov 16 10:15:46 user nova-compute[85141]:         <nova:port uuid="cc62aa76-c6d3-42a2-bf2a-7241919a5fc4">
Nov 16 10:15:46 user nova-compute[85141]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 16 10:15:46 user nova-compute[85141]:         </nova:port>
Nov 16 10:15:46 user nova-compute[85141]:       </nova:ports>
Nov 16 10:15:46 user nova-compute[85141]:     </nova:instance>
Nov 16 10:15:46 user nova-compute[85141]:   </metadata>
Nov 16 10:15:46 user nova-compute[85141]:   <sysinfo type="smbios">
Nov 16 10:15:46 user nova-compute[85141]:     <system>
Nov 16 10:15:46 user nova-compute[85141]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 10:15:46 user nova-compute[85141]:       <entry name="product">OpenStack Nova</entry>
Nov 16 10:15:46 user nova-compute[85141]:       <entry name="version">0.0.0</entry>
Nov 16 10:15:46 user nova-compute[85141]:       <entry name="serial">fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f</entry>
Nov 16 10:15:46 user nova-compute[85141]:       <entry name="uuid">fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f</entry>
Nov 16 10:15:46 user nova-compute[85141]:       <entry name="family">Virtual Machine</entry>
Nov 16 10:15:46 user nova-compute[85141]:     </system>
Nov 16 10:15:46 user nova-compute[85141]:   </sysinfo>
Nov 16 10:15:46 user nova-compute[85141]:   <os>
Nov 16 10:15:46 user nova-compute[85141]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 10:15:46 user nova-compute[85141]:     <boot dev="hd"/>
Nov 16 10:15:46 user nova-compute[85141]:     <smbios mode="sysinfo"/>
Nov 16 10:15:46 user nova-compute[85141]:   </os>
Nov 16 10:15:46 user nova-compute[85141]:   <features>
Nov 16 10:15:46 user nova-compute[85141]:     <acpi/>
Nov 16 10:15:46 user nova-compute[85141]:     <apic/>
Nov 16 10:15:46 user nova-compute[85141]:     <vmcoreinfo/>
Nov 16 10:15:46 user nova-compute[85141]:   </features>
Nov 16 10:15:46 user nova-compute[85141]:   <clock offset="utc">
Nov 16 10:15:46 user nova-compute[85141]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 10:15:46 user nova-compute[85141]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 10:15:46 user nova-compute[85141]:     <timer name="hpet" present="no"/>
Nov 16 10:15:46 user nova-compute[85141]:   </clock>
Nov 16 10:15:46 user nova-compute[85141]:   <cpu mode="custom" match="exact">
Nov 16 10:15:46 user nova-compute[85141]:     <model>Nehalem</model>
Nov 16 10:15:46 user nova-compute[85141]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 10:15:46 user nova-compute[85141]:   </cpu>
Nov 16 10:15:46 user nova-compute[85141]:   <devices>
Nov 16 10:15:46 user nova-compute[85141]:     <disk type="file" device="disk">
Nov 16 10:15:46 user nova-compute[85141]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 10:15:46 user nova-compute[85141]:       <source file="/opt/stack/data/nova/instances/fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f/disk"/>
Nov 16 10:15:46 user nova-compute[85141]:       <target dev="vda" bus="virtio"/>
Nov 16 10:15:46 user nova-compute[85141]:     </disk>
Nov 16 10:15:46 user nova-compute[85141]:     <interface type="ethernet">
Nov 16 10:15:46 user nova-compute[85141]:       <mac address="fa:16:3e:3b:bc:05"/>
Nov 16 10:15:46 user nova-compute[85141]:       <model type="virtio"/>
Nov 16 10:15:46 user nova-compute[85141]:       <mtu size="1442"/>
Nov 16 10:15:46 user nova-compute[85141]:       <target dev="tapcc62aa76-c6"/>
Nov 16 10:15:46 user nova-compute[85141]:     </interface>
Nov 16 10:15:46 user nova-compute[85141]:     <serial type="pty">
Nov 16 10:15:46 user nova-compute[85141]:       <log file="/opt/stack/data/nova/instances/fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f/console.log" append="off"/>
Nov 16 10:15:46 user nova-compute[85141]:     </serial>
Nov 16 10:15:46 user nova-compute[85141]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 10:15:46 user nova-compute[85141]:     <video>
Nov 16 10:15:46 user nova-compute[85141]:       <model type="virtio"/>
Nov 16 10:15:46 user nova-compute[85141]:     </video>
Nov 16 10:15:46 user nova-compute[85141]:     <rng model="virtio">
Nov 16 10:15:46 user nova-compute[85141]:       <backend model="random">/dev/urandom</backend>
Nov 16 10:15:46 user nova-compute[85141]:     </rng>
Nov 16 10:15:46 user nova-compute[85141]:     <controller type="usb" index="0" model="none"/>
Nov 16 10:15:46 user nova-compute[85141]:     <memballoon model="virtio">
Nov 16 10:15:46 user nova-compute[85141]:       <stats period="10"/>
Nov 16 10:15:46 user nova-compute[85141]:     </memballoon>
Nov 16 10:15:46 user nova-compute[85141]:   </devices>
Nov 16 10:15:46 user nova-compute[85141]: </domain>
Nov 16 10:15:46 user nova-compute[85141]:  {{(pid=85141) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 10:15:46 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-02b8a0e9-ab92-46fd-8b24-4f69e8551b1c tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T10:15:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-675096085',display_name='tempest-ServerStableDeviceRescueTest-server-675096085',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-675096085',id=19,image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDy6W/eGM5RIOL9sRQS4LaKkBVIMYLDkobB3fvhz5SdWZrhWPoji+Lbru+de1gziqrO+W/0HhQiWO7dkjKIiUJZL6ldxRiGA5rCsMCcnOQwbGGZ5zFupHppDTFvdF4wPCw==',key_name='tempest-keypair-756270117',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0cdf22a86934481196276e29c2cdb48b',ramdisk_id='',reservation_id='r-4s0k8n8m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-692155468',owner_user_name='tempest-ServerStableDeviceRescueTest-692155468-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T10:15:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9e95eddbeebf4768bc04632d5a94003a',uuid=fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cc62aa76-c6d3-42a2-bf2a-7241919a5fc4", "address": "fa:16:3e:3b:bc:05", "network": {"id": "434cf325-212a-4f85-9779-7791dc1c678f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-248496413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cdf22a86934481196276e29c2cdb48b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc62aa76-c6", "ovs_interfaceid": "cc62aa76-c6d3-42a2-bf2a-7241919a5fc4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 10:15:46 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-02b8a0e9-ab92-46fd-8b24-4f69e8551b1c tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] Converting VIF {"id": "cc62aa76-c6d3-42a2-bf2a-7241919a5fc4", "address": "fa:16:3e:3b:bc:05", "network": {"id": "434cf325-212a-4f85-9779-7791dc1c678f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-248496413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cdf22a86934481196276e29c2cdb48b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc62aa76-c6", "ovs_interfaceid": "cc62aa76-c6d3-42a2-bf2a-7241919a5fc4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:15:46 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-02b8a0e9-ab92-46fd-8b24-4f69e8551b1c tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3b:bc:05,bridge_name='br-int',has_traffic_filtering=True,id=cc62aa76-c6d3-42a2-bf2a-7241919a5fc4,network=Network(434cf325-212a-4f85-9779-7791dc1c678f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc62aa76-c6') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:15:46 user nova-compute[85141]: DEBUG os_vif [None req-02b8a0e9-ab92-46fd-8b24-4f69e8551b1c tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:bc:05,bridge_name='br-int',has_traffic_filtering=True,id=cc62aa76-c6d3-42a2-bf2a-7241919a5fc4,network=Network(434cf325-212a-4f85-9779-7791dc1c678f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc62aa76-c6') {{(pid=85141) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 10:15:46 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:15:46 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:15:46 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 10:15:46 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:15:46 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5ba04034-2bbd-56e6-a872-1b04afa2500a', '_type': 'linux-noop'}}, row=False) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:15:46 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:15:46 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:15:46 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:15:46 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcc62aa76-c6, may_exist=True, interface_attrs={}) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:15:46 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcc62aa76-c6, col_values=(('qos', UUID('df249894-a335-4a6e-96fe-b816c9e0b667')),), if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:15:46 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcc62aa76-c6, col_values=(('external_ids', {'iface-id': 'cc62aa76-c6d3-42a2-bf2a-7241919a5fc4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3b:bc:05', 'vm-uuid': 'fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f'}),), if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:15:46 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:15:46 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:15:46 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:15:46 user nova-compute[85141]: INFO os_vif [None req-02b8a0e9-ab92-46fd-8b24-4f69e8551b1c tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:bc:05,bridge_name='br-int',has_traffic_filtering=True,id=cc62aa76-c6d3-42a2-bf2a-7241919a5fc4,network=Network(434cf325-212a-4f85-9779-7791dc1c678f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc62aa76-c6')
Nov 16 10:15:46 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-02b8a0e9-ab92-46fd-8b24-4f69e8551b1c tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] No BDM found with device name vda, not building metadata. {{(pid=85141) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 10:15:46 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-02b8a0e9-ab92-46fd-8b24-4f69e8551b1c tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] No VIF found with MAC fa:16:3e:3b:bc:05, not building metadata {{(pid=85141) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 10:15:46 user nova-compute[85141]: DEBUG nova.compute.manager [req-9678f6cf-2c10-4617-a2c1-131f4c0baf4a req-2b39c947-3b5b-4934-bf2b-6c5af87f7ed2 service nova] [instance: fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f] Received event network-changed-cc62aa76-c6d3-42a2-bf2a-7241919a5fc4 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:15:46 user nova-compute[85141]: DEBUG nova.compute.manager [req-9678f6cf-2c10-4617-a2c1-131f4c0baf4a req-2b39c947-3b5b-4934-bf2b-6c5af87f7ed2 service nova] [instance: fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f] Refreshing instance network info cache due to event network-changed-cc62aa76-c6d3-42a2-bf2a-7241919a5fc4. {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 10:15:46 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-9678f6cf-2c10-4617-a2c1-131f4c0baf4a req-2b39c947-3b5b-4934-bf2b-6c5af87f7ed2 service nova] Acquiring lock "refresh_cache-fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:15:46 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-9678f6cf-2c10-4617-a2c1-131f4c0baf4a req-2b39c947-3b5b-4934-bf2b-6c5af87f7ed2 service nova] Acquired lock "refresh_cache-fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:15:46 user nova-compute[85141]: DEBUG nova.network.neutron [req-9678f6cf-2c10-4617-a2c1-131f4c0baf4a req-2b39c947-3b5b-4934-bf2b-6c5af87f7ed2 service nova] [instance: fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f] Refreshing network info cache for port cc62aa76-c6d3-42a2-bf2a-7241919a5fc4 {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 10:15:46 user nova-compute[85141]: DEBUG nova.network.neutron [req-9678f6cf-2c10-4617-a2c1-131f4c0baf4a req-2b39c947-3b5b-4934-bf2b-6c5af87f7ed2 service nova] [instance: fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f] Updated VIF entry in instance network info cache for port cc62aa76-c6d3-42a2-bf2a-7241919a5fc4. {{(pid=85141) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 10:15:46 user nova-compute[85141]: DEBUG nova.network.neutron [req-9678f6cf-2c10-4617-a2c1-131f4c0baf4a req-2b39c947-3b5b-4934-bf2b-6c5af87f7ed2 service nova] [instance: fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f] Updating instance_info_cache with network_info: [{"id": "cc62aa76-c6d3-42a2-bf2a-7241919a5fc4", "address": "fa:16:3e:3b:bc:05", "network": {"id": "434cf325-212a-4f85-9779-7791dc1c678f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-248496413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cdf22a86934481196276e29c2cdb48b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc62aa76-c6", "ovs_interfaceid": "cc62aa76-c6d3-42a2-bf2a-7241919a5fc4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:15:46 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-9678f6cf-2c10-4617-a2c1-131f4c0baf4a req-2b39c947-3b5b-4934-bf2b-6c5af87f7ed2 service nova] Releasing lock "refresh_cache-fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:15:47 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:15:47 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:15:47 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:15:47 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:15:47 user nova-compute[85141]: DEBUG nova.compute.manager [req-b2bed3bb-bb9a-46e0-a74a-0fe415ba66eb req-20310e14-f906-4d91-9731-943435f9d5d4 service nova] [instance: fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f] Received event network-vif-plugged-cc62aa76-c6d3-42a2-bf2a-7241919a5fc4 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:15:47 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-b2bed3bb-bb9a-46e0-a74a-0fe415ba66eb req-20310e14-f906-4d91-9731-943435f9d5d4 service nova] Acquiring lock "fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:15:47 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-b2bed3bb-bb9a-46e0-a74a-0fe415ba66eb req-20310e14-f906-4d91-9731-943435f9d5d4 service nova] Lock "fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:15:47 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-b2bed3bb-bb9a-46e0-a74a-0fe415ba66eb req-20310e14-f906-4d91-9731-943435f9d5d4 service nova] Lock "fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:15:47 user nova-compute[85141]: DEBUG nova.compute.manager [req-b2bed3bb-bb9a-46e0-a74a-0fe415ba66eb req-20310e14-f906-4d91-9731-943435f9d5d4 service nova] [instance: fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f] No waiting events found dispatching network-vif-plugged-cc62aa76-c6d3-42a2-bf2a-7241919a5fc4 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:15:47 user nova-compute[85141]: WARNING nova.compute.manager [req-b2bed3bb-bb9a-46e0-a74a-0fe415ba66eb req-20310e14-f906-4d91-9731-943435f9d5d4 service nova] [instance: fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f] Received unexpected event network-vif-plugged-cc62aa76-c6d3-42a2-bf2a-7241919a5fc4 for instance with vm_state building and task_state spawning.
Nov 16 10:15:48 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:15:48 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:15:48 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:15:48 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:15:48 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:15:49 user nova-compute[85141]: DEBUG nova.compute.manager [req-d7f3b4d7-55e8-4080-ab66-7f5f895bd7ba req-80ea5675-e91a-4d3e-a065-478160624b84 service nova] [instance: fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f] Received event network-vif-plugged-cc62aa76-c6d3-42a2-bf2a-7241919a5fc4 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:15:49 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-d7f3b4d7-55e8-4080-ab66-7f5f895bd7ba req-80ea5675-e91a-4d3e-a065-478160624b84 service nova] Acquiring lock "fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:15:49 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-d7f3b4d7-55e8-4080-ab66-7f5f895bd7ba req-80ea5675-e91a-4d3e-a065-478160624b84 service nova] Lock "fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:15:49 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-d7f3b4d7-55e8-4080-ab66-7f5f895bd7ba req-80ea5675-e91a-4d3e-a065-478160624b84 service nova] Lock "fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:15:49 user nova-compute[85141]: DEBUG nova.compute.manager [req-d7f3b4d7-55e8-4080-ab66-7f5f895bd7ba req-80ea5675-e91a-4d3e-a065-478160624b84 service nova] [instance: fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f] No waiting events found dispatching network-vif-plugged-cc62aa76-c6d3-42a2-bf2a-7241919a5fc4 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:15:49 user nova-compute[85141]: WARNING nova.compute.manager [req-d7f3b4d7-55e8-4080-ab66-7f5f895bd7ba req-80ea5675-e91a-4d3e-a065-478160624b84 service nova] [instance: fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f] Received unexpected event network-vif-plugged-cc62aa76-c6d3-42a2-bf2a-7241919a5fc4 for instance with vm_state building and task_state spawning.
Nov 16 10:15:49 user nova-compute[85141]: DEBUG nova.compute.manager [None req-02b8a0e9-ab92-46fd-8b24-4f69e8551b1c tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] [instance: fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f] Instance event wait completed in 0 seconds for  {{(pid=85141) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 10:15:49 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-02b8a0e9-ab92-46fd-8b24-4f69e8551b1c tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] [instance: fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f] Guest created on hypervisor {{(pid=85141) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 10:15:49 user nova-compute[85141]: INFO nova.virt.libvirt.driver [-] [instance: fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f] Instance spawned successfully.
Nov 16 10:15:49 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-02b8a0e9-ab92-46fd-8b24-4f69e8551b1c tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] [instance: fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 10:15:50 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-02b8a0e9-ab92-46fd-8b24-4f69e8551b1c tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] [instance: fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f] Found default for hw_cdrom_bus of ide {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:15:50 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-02b8a0e9-ab92-46fd-8b24-4f69e8551b1c tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] [instance: fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f] Found default for hw_disk_bus of virtio {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:15:50 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-02b8a0e9-ab92-46fd-8b24-4f69e8551b1c tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] [instance: fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f] Found default for hw_input_bus of None {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:15:50 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-02b8a0e9-ab92-46fd-8b24-4f69e8551b1c tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] [instance: fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f] Found default for hw_pointer_model of None {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:15:50 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-02b8a0e9-ab92-46fd-8b24-4f69e8551b1c tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] [instance: fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f] Found default for hw_video_model of virtio {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:15:50 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-02b8a0e9-ab92-46fd-8b24-4f69e8551b1c tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] [instance: fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f] Found default for hw_vif_model of virtio {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:15:50 user nova-compute[85141]: INFO nova.compute.manager [None req-02b8a0e9-ab92-46fd-8b24-4f69e8551b1c tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] [instance: fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f] Took 6.63 seconds to spawn the instance on the hypervisor.
Nov 16 10:15:50 user nova-compute[85141]: DEBUG nova.compute.manager [None req-02b8a0e9-ab92-46fd-8b24-4f69e8551b1c tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] [instance: fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f] Checking state {{(pid=85141) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 10:15:50 user nova-compute[85141]: INFO nova.compute.manager [None req-02b8a0e9-ab92-46fd-8b24-4f69e8551b1c tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] [instance: fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f] Took 7.54 seconds to build instance.
Nov 16 10:15:50 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-02b8a0e9-ab92-46fd-8b24-4f69e8551b1c tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] Lock "fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.648s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:15:51 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:15:52 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:15:56 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:15:57 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:16:01 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:16:01 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] Acquiring lock "0c359f00-f4b7-43c3-8454-364842893779" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:16:01 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] Lock "0c359f00-f4b7-43c3-8454-364842893779" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:16:01 user nova-compute[85141]: DEBUG nova.compute.manager [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] [instance: 0c359f00-f4b7-43c3-8454-364842893779] Starting instance... {{(pid=85141) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 10:16:01 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:16:01 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:16:01 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=85141) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 10:16:01 user nova-compute[85141]: INFO nova.compute.claims [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] [instance: 0c359f00-f4b7-43c3-8454-364842893779] Claim successful on node user
Nov 16 10:16:02 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:16:02 user nova-compute[85141]: DEBUG nova.compute.provider_tree [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] Inventory has not changed in ProviderTree for provider: bf8e0fa1-16b6-408f-9203-c4cd63916272 {{(pid=85141) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 10:16:02 user nova-compute[85141]: DEBUG nova.scheduler.client.report [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] Inventory has not changed for provider bf8e0fa1-16b6-408f-9203-c4cd63916272 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=85141) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 10:16:02 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.540s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:16:02 user nova-compute[85141]: DEBUG nova.compute.manager [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] [instance: 0c359f00-f4b7-43c3-8454-364842893779] Start building networks asynchronously for instance. {{(pid=85141) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 10:16:02 user nova-compute[85141]: DEBUG nova.compute.manager [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] [instance: 0c359f00-f4b7-43c3-8454-364842893779] Allocating IP information in the background. {{(pid=85141) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 10:16:02 user nova-compute[85141]: DEBUG nova.network.neutron [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] [instance: 0c359f00-f4b7-43c3-8454-364842893779] allocate_for_instance() {{(pid=85141) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 10:16:02 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] [instance: 0c359f00-f4b7-43c3-8454-364842893779] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 10:16:02 user nova-compute[85141]: DEBUG nova.compute.manager [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] [instance: 0c359f00-f4b7-43c3-8454-364842893779] Start building block device mappings for instance. {{(pid=85141) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 10:16:02 user nova-compute[85141]: INFO nova.virt.block_device [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] [instance: 0c359f00-f4b7-43c3-8454-364842893779] Booting with volume 1fa41a79-b1fc-4047-9ae9-f674f348378f at /dev/vda
Nov 16 10:16:02 user nova-compute[85141]: DEBUG nova.policy [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9fd70ad0794943a7b93eced34e17aa4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92b768cf0f234b5da6d29450a58ce8e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85141) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 10:16:02 user nova-compute[85141]: DEBUG os_brick.utils [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 10:16:02 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:16:02 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:16:02 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f605a79-0372-48a2-952c-3e55d5df4b89]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c7834de5c295\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:16:02 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:16:02 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.034s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:16:02 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[aad4f18d-6b74-4ab0-a222-b159696f81ad]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:16:02 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:16:02 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:16:02 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[2108957f-02e9-45b2-98e2-780fd85d541f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:16:02 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[656424c2-eb97-4fd3-b837-5451311a6a68]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:16:02 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] Running cmd (subprocess): nvme version {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:16:02 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] 'nvme version' failed. Not Retrying. {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 10:16:02 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.nvmeof [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] nvme not present on system {{(pid=85141) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 10:16:02 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:16:02 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 10:16:02 user nova-compute[85141]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 10:16:02 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbbe8b2b-aea5-4489-8d55-f34822f96e41]: (4, '') {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:16:02 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.lightos [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=85141) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 10:16:02 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.lightos [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=85141) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 10:16:02 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.lightos [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] LIGHTOS: no hostnqn found. {{(pid=85141) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 10:16:02 user nova-compute[85141]: DEBUG os_brick.utils [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] <== get_connector_properties: return (145ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c7834de5c295', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 10:16:02 user nova-compute[85141]: DEBUG nova.virt.block_device [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] [instance: 0c359f00-f4b7-43c3-8454-364842893779] Updating existing volume attachment record: 3a007f16-f838-4bf8-a549-ce60a95b3a7d {{(pid=85141) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 10:16:03 user nova-compute[85141]: DEBUG nova.network.neutron [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] [instance: 0c359f00-f4b7-43c3-8454-364842893779] Successfully created port: 97833d7f-68d7-4a6a-a283-83744d5afd10 {{(pid=85141) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 10:16:03 user nova-compute[85141]: DEBUG nova.network.neutron [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] [instance: 0c359f00-f4b7-43c3-8454-364842893779] Successfully created port: 2243117f-44a8-4d51-8676-d67748b3c9aa {{(pid=85141) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 10:16:04 user nova-compute[85141]: DEBUG nova.network.neutron [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] [instance: 0c359f00-f4b7-43c3-8454-364842893779] Successfully created port: 6d48ae8e-004c-459d-ad7c-081cc9228fee {{(pid=85141) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 10:16:04 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-64a9f626-2227-4ec9-b638-3439b349b318 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Acquiring lock "9411843f-4e79-46c4-ae02-01f5e87b86eb" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:16:04 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-64a9f626-2227-4ec9-b638-3439b349b318 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Lock "9411843f-4e79-46c4-ae02-01f5e87b86eb" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:16:04 user nova-compute[85141]: INFO nova.compute.manager [None req-64a9f626-2227-4ec9-b638-3439b349b318 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] [instance: 9411843f-4e79-46c4-ae02-01f5e87b86eb] Detaching volume c94ff08f-badb-4203-b3af-e418025d1f0d
Nov 16 10:16:04 user nova-compute[85141]: INFO nova.virt.block_device [None req-64a9f626-2227-4ec9-b638-3439b349b318 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] [instance: 9411843f-4e79-46c4-ae02-01f5e87b86eb] Attempting to driver detach volume c94ff08f-badb-4203-b3af-e418025d1f0d from mountpoint /dev/vdc
Nov 16 10:16:04 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-64a9f626-2227-4ec9-b638-3439b349b318 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Attempting to detach device vdc from instance 9411843f-4e79-46c4-ae02-01f5e87b86eb from the persistent domain config. {{(pid=85141) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 10:16:04 user nova-compute[85141]: DEBUG nova.virt.libvirt.guest [None req-64a9f626-2227-4ec9-b638-3439b349b318 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 10:16:04 user nova-compute[85141]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 10:16:04 user nova-compute[85141]:   <source dev="/dev/sde"/>
Nov 16 10:16:04 user nova-compute[85141]:   <target dev="vdc" bus="virtio"/>
Nov 16 10:16:04 user nova-compute[85141]:   <serial>c94ff08f-badb-4203-b3af-e418025d1f0d</serial>
Nov 16 10:16:04 user nova-compute[85141]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 16 10:16:04 user nova-compute[85141]: </disk>
Nov 16 10:16:04 user nova-compute[85141]:  {{(pid=85141) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 10:16:04 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-64a9f626-2227-4ec9-b638-3439b349b318 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Successfully detached device vdc from instance 9411843f-4e79-46c4-ae02-01f5e87b86eb from the persistent domain config.
Nov 16 10:16:04 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-64a9f626-2227-4ec9-b638-3439b349b318 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 9411843f-4e79-46c4-ae02-01f5e87b86eb from the live domain config. {{(pid=85141) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 10:16:04 user nova-compute[85141]: DEBUG nova.virt.libvirt.guest [None req-64a9f626-2227-4ec9-b638-3439b349b318 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 10:16:04 user nova-compute[85141]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 10:16:04 user nova-compute[85141]:   <source dev="/dev/sde"/>
Nov 16 10:16:04 user nova-compute[85141]:   <target dev="vdc" bus="virtio"/>
Nov 16 10:16:04 user nova-compute[85141]:   <serial>c94ff08f-badb-4203-b3af-e418025d1f0d</serial>
Nov 16 10:16:04 user nova-compute[85141]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 16 10:16:04 user nova-compute[85141]: </disk>
Nov 16 10:16:04 user nova-compute[85141]:  {{(pid=85141) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 10:16:05 user nova-compute[85141]: DEBUG nova.network.neutron [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] [instance: 0c359f00-f4b7-43c3-8454-364842893779] Successfully created port: 8a0146a0-20fd-4879-be20-c8732bd6563c {{(pid=85141) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 10:16:05 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-64a9f626-2227-4ec9-b638-3439b349b318 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 9411843f-4e79-46c4-ae02-01f5e87b86eb {{(pid=85141) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 10:16:05 user nova-compute[85141]: DEBUG nova.network.neutron [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] [instance: 0c359f00-f4b7-43c3-8454-364842893779] Successfully created port: 450233b4-a16d-4b2d-bc6a-a87736db7ff4 {{(pid=85141) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 10:16:06 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:16:06 user nova-compute[85141]: DEBUG nova.network.neutron [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] [instance: 0c359f00-f4b7-43c3-8454-364842893779] Successfully updated port: 97833d7f-68d7-4a6a-a283-83744d5afd10 {{(pid=85141) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 10:16:06 user nova-compute[85141]: DEBUG nova.compute.manager [req-8808bc69-2641-496e-85c5-f305a322ec5a req-6bde2cf3-bc54-4519-8c73-41fb4a2e7165 service nova] [instance: 0c359f00-f4b7-43c3-8454-364842893779] Received event network-changed-97833d7f-68d7-4a6a-a283-83744d5afd10 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:16:06 user nova-compute[85141]: DEBUG nova.compute.manager [req-8808bc69-2641-496e-85c5-f305a322ec5a req-6bde2cf3-bc54-4519-8c73-41fb4a2e7165 service nova] [instance: 0c359f00-f4b7-43c3-8454-364842893779] Refreshing instance network info cache due to event network-changed-97833d7f-68d7-4a6a-a283-83744d5afd10. {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 10:16:06 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-8808bc69-2641-496e-85c5-f305a322ec5a req-6bde2cf3-bc54-4519-8c73-41fb4a2e7165 service nova] Acquiring lock "refresh_cache-0c359f00-f4b7-43c3-8454-364842893779" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:16:06 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-8808bc69-2641-496e-85c5-f305a322ec5a req-6bde2cf3-bc54-4519-8c73-41fb4a2e7165 service nova] Acquired lock "refresh_cache-0c359f00-f4b7-43c3-8454-364842893779" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:16:06 user nova-compute[85141]: DEBUG nova.network.neutron [req-8808bc69-2641-496e-85c5-f305a322ec5a req-6bde2cf3-bc54-4519-8c73-41fb4a2e7165 service nova] [instance: 0c359f00-f4b7-43c3-8454-364842893779] Refreshing network info cache for port 97833d7f-68d7-4a6a-a283-83744d5afd10 {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 10:16:06 user nova-compute[85141]: DEBUG nova.network.neutron [req-8808bc69-2641-496e-85c5-f305a322ec5a req-6bde2cf3-bc54-4519-8c73-41fb4a2e7165 service nova] [instance: 0c359f00-f4b7-43c3-8454-364842893779] Instance cache missing network info. {{(pid=85141) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 10:16:06 user nova-compute[85141]: DEBUG nova.network.neutron [req-8808bc69-2641-496e-85c5-f305a322ec5a req-6bde2cf3-bc54-4519-8c73-41fb4a2e7165 service nova] [instance: 0c359f00-f4b7-43c3-8454-364842893779] Updating instance_info_cache with network_info: [] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:16:06 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-8808bc69-2641-496e-85c5-f305a322ec5a req-6bde2cf3-bc54-4519-8c73-41fb4a2e7165 service nova] Releasing lock "refresh_cache-0c359f00-f4b7-43c3-8454-364842893779" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:16:07 user nova-compute[85141]: DEBUG nova.network.neutron [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] [instance: 0c359f00-f4b7-43c3-8454-364842893779] Successfully updated port: da46c331-8f37-4473-9c17-7bcb1c691b65 {{(pid=85141) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 10:16:07 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:16:08 user nova-compute[85141]: DEBUG nova.network.neutron [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] [instance: 0c359f00-f4b7-43c3-8454-364842893779] Successfully updated port: 5b1acf97-626c-4014-b463-5b4455f0f1e6 {{(pid=85141) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 10:16:08 user nova-compute[85141]: DEBUG nova.compute.manager [req-77daf448-759d-4d2c-8218-aee96ce725e0 req-98f04472-a585-4366-b1ed-27a7896fce18 service nova] [instance: 0c359f00-f4b7-43c3-8454-364842893779] Received event network-changed-da46c331-8f37-4473-9c17-7bcb1c691b65 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:16:08 user nova-compute[85141]: DEBUG nova.compute.manager [req-77daf448-759d-4d2c-8218-aee96ce725e0 req-98f04472-a585-4366-b1ed-27a7896fce18 service nova] [instance: 0c359f00-f4b7-43c3-8454-364842893779] Refreshing instance network info cache due to event network-changed-da46c331-8f37-4473-9c17-7bcb1c691b65. {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 10:16:08 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-77daf448-759d-4d2c-8218-aee96ce725e0 req-98f04472-a585-4366-b1ed-27a7896fce18 service nova] Acquiring lock "refresh_cache-0c359f00-f4b7-43c3-8454-364842893779" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:16:08 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-77daf448-759d-4d2c-8218-aee96ce725e0 req-98f04472-a585-4366-b1ed-27a7896fce18 service nova] Acquired lock "refresh_cache-0c359f00-f4b7-43c3-8454-364842893779" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:16:08 user nova-compute[85141]: DEBUG nova.network.neutron [req-77daf448-759d-4d2c-8218-aee96ce725e0 req-98f04472-a585-4366-b1ed-27a7896fce18 service nova] [instance: 0c359f00-f4b7-43c3-8454-364842893779] Refreshing network info cache for port da46c331-8f37-4473-9c17-7bcb1c691b65 {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 10:16:08 user nova-compute[85141]: DEBUG nova.network.neutron [req-77daf448-759d-4d2c-8218-aee96ce725e0 req-98f04472-a585-4366-b1ed-27a7896fce18 service nova] [instance: 0c359f00-f4b7-43c3-8454-364842893779] Instance cache missing network info. {{(pid=85141) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 10:16:08 user nova-compute[85141]: DEBUG nova.network.neutron [req-77daf448-759d-4d2c-8218-aee96ce725e0 req-98f04472-a585-4366-b1ed-27a7896fce18 service nova] [instance: 0c359f00-f4b7-43c3-8454-364842893779] Updating instance_info_cache with network_info: [] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:16:08 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-77daf448-759d-4d2c-8218-aee96ce725e0 req-98f04472-a585-4366-b1ed-27a7896fce18 service nova] Releasing lock "refresh_cache-0c359f00-f4b7-43c3-8454-364842893779" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:16:08 user nova-compute[85141]: DEBUG nova.compute.manager [req-77daf448-759d-4d2c-8218-aee96ce725e0 req-98f04472-a585-4366-b1ed-27a7896fce18 service nova] [instance: 0c359f00-f4b7-43c3-8454-364842893779] Received event network-changed-5b1acf97-626c-4014-b463-5b4455f0f1e6 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:16:08 user nova-compute[85141]: DEBUG nova.compute.manager [req-77daf448-759d-4d2c-8218-aee96ce725e0 req-98f04472-a585-4366-b1ed-27a7896fce18 service nova] [instance: 0c359f00-f4b7-43c3-8454-364842893779] Refreshing instance network info cache due to event network-changed-5b1acf97-626c-4014-b463-5b4455f0f1e6. {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 10:16:08 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-77daf448-759d-4d2c-8218-aee96ce725e0 req-98f04472-a585-4366-b1ed-27a7896fce18 service nova] Acquiring lock "refresh_cache-0c359f00-f4b7-43c3-8454-364842893779" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:16:08 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-77daf448-759d-4d2c-8218-aee96ce725e0 req-98f04472-a585-4366-b1ed-27a7896fce18 service nova] Acquired lock "refresh_cache-0c359f00-f4b7-43c3-8454-364842893779" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:16:08 user nova-compute[85141]: DEBUG nova.network.neutron [req-77daf448-759d-4d2c-8218-aee96ce725e0 req-98f04472-a585-4366-b1ed-27a7896fce18 service nova] [instance: 0c359f00-f4b7-43c3-8454-364842893779] Refreshing network info cache for port 5b1acf97-626c-4014-b463-5b4455f0f1e6 {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 10:16:09 user nova-compute[85141]: DEBUG nova.network.neutron [req-77daf448-759d-4d2c-8218-aee96ce725e0 req-98f04472-a585-4366-b1ed-27a7896fce18 service nova] [instance: 0c359f00-f4b7-43c3-8454-364842893779] Instance cache missing network info. {{(pid=85141) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 10:16:09 user nova-compute[85141]: DEBUG nova.network.neutron [req-77daf448-759d-4d2c-8218-aee96ce725e0 req-98f04472-a585-4366-b1ed-27a7896fce18 service nova] [instance: 0c359f00-f4b7-43c3-8454-364842893779] Updating instance_info_cache with network_info: [] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:16:09 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-77daf448-759d-4d2c-8218-aee96ce725e0 req-98f04472-a585-4366-b1ed-27a7896fce18 service nova] Releasing lock "refresh_cache-0c359f00-f4b7-43c3-8454-364842893779" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:16:09 user nova-compute[85141]: DEBUG nova.network.neutron [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] [instance: 0c359f00-f4b7-43c3-8454-364842893779] Successfully updated port: 2243117f-44a8-4d51-8676-d67748b3c9aa {{(pid=85141) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 10:16:09 user nova-compute[85141]: DEBUG nova.network.neutron [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] [instance: 0c359f00-f4b7-43c3-8454-364842893779] Successfully updated port: 6d48ae8e-004c-459d-ad7c-081cc9228fee {{(pid=85141) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 10:16:10 user nova-compute[85141]: DEBUG nova.compute.manager [req-b47fb67c-f776-4dfe-849c-10060271a176 req-34475590-7e03-43e8-8e1a-a3810079a313 service nova] [instance: 0c359f00-f4b7-43c3-8454-364842893779] Received event network-changed-2243117f-44a8-4d51-8676-d67748b3c9aa {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:16:10 user nova-compute[85141]: DEBUG nova.compute.manager [req-b47fb67c-f776-4dfe-849c-10060271a176 req-34475590-7e03-43e8-8e1a-a3810079a313 service nova] [instance: 0c359f00-f4b7-43c3-8454-364842893779] Refreshing instance network info cache due to event network-changed-2243117f-44a8-4d51-8676-d67748b3c9aa. {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 10:16:10 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-b47fb67c-f776-4dfe-849c-10060271a176 req-34475590-7e03-43e8-8e1a-a3810079a313 service nova] Acquiring lock "refresh_cache-0c359f00-f4b7-43c3-8454-364842893779" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:16:10 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-b47fb67c-f776-4dfe-849c-10060271a176 req-34475590-7e03-43e8-8e1a-a3810079a313 service nova] Acquired lock "refresh_cache-0c359f00-f4b7-43c3-8454-364842893779" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:16:10 user nova-compute[85141]: DEBUG nova.network.neutron [req-b47fb67c-f776-4dfe-849c-10060271a176 req-34475590-7e03-43e8-8e1a-a3810079a313 service nova] [instance: 0c359f00-f4b7-43c3-8454-364842893779] Refreshing network info cache for port 2243117f-44a8-4d51-8676-d67748b3c9aa {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 10:16:10 user nova-compute[85141]: DEBUG nova.network.neutron [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] [instance: 0c359f00-f4b7-43c3-8454-364842893779] Successfully updated port: 8a0146a0-20fd-4879-be20-c8732bd6563c {{(pid=85141) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 10:16:10 user nova-compute[85141]: DEBUG nova.network.neutron [req-b47fb67c-f776-4dfe-849c-10060271a176 req-34475590-7e03-43e8-8e1a-a3810079a313 service nova] [instance: 0c359f00-f4b7-43c3-8454-364842893779] Instance cache missing network info. {{(pid=85141) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 10:16:11 user nova-compute[85141]: DEBUG nova.network.neutron [req-b47fb67c-f776-4dfe-849c-10060271a176 req-34475590-7e03-43e8-8e1a-a3810079a313 service nova] [instance: 0c359f00-f4b7-43c3-8454-364842893779] Updating instance_info_cache with network_info: [] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:16:11 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-b47fb67c-f776-4dfe-849c-10060271a176 req-34475590-7e03-43e8-8e1a-a3810079a313 service nova] Releasing lock "refresh_cache-0c359f00-f4b7-43c3-8454-364842893779" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:16:11 user nova-compute[85141]: DEBUG nova.compute.manager [req-b47fb67c-f776-4dfe-849c-10060271a176 req-34475590-7e03-43e8-8e1a-a3810079a313 service nova] [instance: 0c359f00-f4b7-43c3-8454-364842893779] Received event network-changed-6d48ae8e-004c-459d-ad7c-081cc9228fee {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:16:11 user nova-compute[85141]: DEBUG nova.compute.manager [req-b47fb67c-f776-4dfe-849c-10060271a176 req-34475590-7e03-43e8-8e1a-a3810079a313 service nova] [instance: 0c359f00-f4b7-43c3-8454-364842893779] Refreshing instance network info cache due to event network-changed-6d48ae8e-004c-459d-ad7c-081cc9228fee. {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 10:16:11 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-b47fb67c-f776-4dfe-849c-10060271a176 req-34475590-7e03-43e8-8e1a-a3810079a313 service nova] Acquiring lock "refresh_cache-0c359f00-f4b7-43c3-8454-364842893779" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:16:11 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-b47fb67c-f776-4dfe-849c-10060271a176 req-34475590-7e03-43e8-8e1a-a3810079a313 service nova] Acquired lock "refresh_cache-0c359f00-f4b7-43c3-8454-364842893779" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:16:11 user nova-compute[85141]: DEBUG nova.network.neutron [req-b47fb67c-f776-4dfe-849c-10060271a176 req-34475590-7e03-43e8-8e1a-a3810079a313 service nova] [instance: 0c359f00-f4b7-43c3-8454-364842893779] Refreshing network info cache for port 6d48ae8e-004c-459d-ad7c-081cc9228fee {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 10:16:11 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:16:11 user nova-compute[85141]: DEBUG nova.network.neutron [req-b47fb67c-f776-4dfe-849c-10060271a176 req-34475590-7e03-43e8-8e1a-a3810079a313 service nova] [instance: 0c359f00-f4b7-43c3-8454-364842893779] Instance cache missing network info. {{(pid=85141) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 10:16:11 user nova-compute[85141]: DEBUG nova.network.neutron [req-b47fb67c-f776-4dfe-849c-10060271a176 req-34475590-7e03-43e8-8e1a-a3810079a313 service nova] [instance: 0c359f00-f4b7-43c3-8454-364842893779] Updating instance_info_cache with network_info: [] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:16:11 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-b47fb67c-f776-4dfe-849c-10060271a176 req-34475590-7e03-43e8-8e1a-a3810079a313 service nova] Releasing lock "refresh_cache-0c359f00-f4b7-43c3-8454-364842893779" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:16:11 user nova-compute[85141]: DEBUG nova.network.neutron [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] [instance: 0c359f00-f4b7-43c3-8454-364842893779] Successfully updated port: 450233b4-a16d-4b2d-bc6a-a87736db7ff4 {{(pid=85141) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 10:16:11 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] Acquiring lock "refresh_cache-0c359f00-f4b7-43c3-8454-364842893779" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:16:11 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] Acquired lock "refresh_cache-0c359f00-f4b7-43c3-8454-364842893779" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:16:11 user nova-compute[85141]: DEBUG nova.network.neutron [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] [instance: 0c359f00-f4b7-43c3-8454-364842893779] Building network info cache for instance {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 10:16:11 user nova-compute[85141]: DEBUG nova.network.neutron [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] [instance: 0c359f00-f4b7-43c3-8454-364842893779] Instance cache missing network info. {{(pid=85141) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 10:16:12 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:16:12 user nova-compute[85141]: INFO nova.virt.block_device [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] [instance: 0c359f00-f4b7-43c3-8454-364842893779] Booting with volume ef975afa-7705-454b-88d3-798b0a74dbb9 at /dev/vdb
Nov 16 10:16:12 user nova-compute[85141]: DEBUG os_brick.utils [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 10:16:12 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:16:12 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:16:12 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[5264083b-f549-44f9-8b74-bc2b7e8c4fc5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c7834de5c295\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:16:12 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:16:12 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:16:12 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[51c94605-6dd5-4a30-aaee-7b871fe5222c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:16:12 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:16:12 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:16:12 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dab8c69-cb81-42aa-a436-1952d99d6b31]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:16:12 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6773c9e-d58e-4541-b295-d75e2a76c49c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:16:12 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] Running cmd (subprocess): nvme version {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:16:12 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] 'nvme version' failed. Not Retrying. {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 10:16:12 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.nvmeof [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] nvme not present on system {{(pid=85141) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 10:16:12 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:16:12 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 10:16:12 user nova-compute[85141]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 10:16:12 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4870ea9-a86e-4540-a6d5-013d4378e0ae]: (4, '') {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:16:12 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.lightos [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=85141) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 10:16:12 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.lightos [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=85141) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 10:16:12 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.lightos [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] LIGHTOS: no hostnqn found. {{(pid=85141) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 10:16:12 user nova-compute[85141]: DEBUG os_brick.utils [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c7834de5c295', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 10:16:12 user nova-compute[85141]: DEBUG nova.virt.block_device [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] [instance: 0c359f00-f4b7-43c3-8454-364842893779] Updating existing volume attachment record: e6e59b69-d261-40b7-9c33-369c0f23d0f1 {{(pid=85141) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 10:16:12 user nova-compute[85141]: DEBUG nova.compute.manager [req-6f84e196-eaf4-4ab8-bdbe-2f46065e3de3 req-951c45dd-1085-4747-a569-4b712b62f33c service nova] [instance: 0c359f00-f4b7-43c3-8454-364842893779] Received event network-changed-8a0146a0-20fd-4879-be20-c8732bd6563c {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:16:12 user nova-compute[85141]: DEBUG nova.compute.manager [req-6f84e196-eaf4-4ab8-bdbe-2f46065e3de3 req-951c45dd-1085-4747-a569-4b712b62f33c service nova] [instance: 0c359f00-f4b7-43c3-8454-364842893779] Refreshing instance network info cache due to event network-changed-8a0146a0-20fd-4879-be20-c8732bd6563c. {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 10:16:12 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-6f84e196-eaf4-4ab8-bdbe-2f46065e3de3 req-951c45dd-1085-4747-a569-4b712b62f33c service nova] Acquiring lock "refresh_cache-0c359f00-f4b7-43c3-8454-364842893779" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:16:13 user nova-compute[85141]: DEBUG nova.network.neutron [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] [instance: 0c359f00-f4b7-43c3-8454-364842893779] Updating instance_info_cache with network_info: [{"id": "97833d7f-68d7-4a6a-a283-83744d5afd10", "address": "fa:16:3e:b6:30:ac", "network": {"id": "cfb2308f-7c88-4329-a72d-4253cbbaca17", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1320471327-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92b768cf0f234b5da6d29450a58ce8e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97833d7f-68", "ovs_interfaceid": "97833d7f-68d7-4a6a-a283-83744d5afd10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "da46c331-8f37-4473-9c17-7bcb1c691b65", "address": "fa:16:3e:c7:5e:17", "network": {"id": "90bcfce1-33ea-4029-aa72-93b729655e77", "bridge": "br-int", "label": "tempest-device-tagging-net1-660308139", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.209", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "92b768cf0f234b5da6d29450a58ce8e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda46c331-8f", "ovs_interfaceid": "da46c331-8f37-4473-9c17-7bcb1c691b65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5b1acf97-626c-4014-b463-5b4455f0f1e6", "address": "fa:16:3e:0b:c9:63", "network": {"id": "90bcfce1-33ea-4029-aa72-93b729655e77", "bridge": "br-int", "label": "tempest-device-tagging-net1-660308139", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.15", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "92b768cf0f234b5da6d29450a58ce8e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b1acf97-62", "ovs_interfaceid": "5b1acf97-626c-4014-b463-5b4455f0f1e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2243117f-44a8-4d51-8676-d67748b3c9aa", "address": "fa:16:3e:87:12:47", "network": {"id": "90bcfce1-33ea-4029-aa72-93b729655e77", "bridge": "br-int", "label": "tempest-device-tagging-net1-660308139", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.140", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "92b768cf0f234b5da6d29450a58ce8e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2243117f-44", "ovs_interfaceid": "2243117f-44a8-4d51-8676-d67748b3c9aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6d48ae8e-004c-459d-ad7c-081cc9228fee", "address": "fa:16:3e:49:c2:7d", "network": {"id": "90bcfce1-33ea-4029-aa72-93b729655e77", "bridge": "br-int", "label": "tempest-device-tagging-net1-660308139", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "92b768cf0f234b5da6d29450a58ce8e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d48ae8e-00", "ovs_interfaceid": "6d48ae8e-004c-459d-ad7c-081cc9228fee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8a0146a0-20fd-4879-be20-c8732bd6563c", "address": "fa:16:3e:6d:38:4b", "network": {"id": "054ba1f8-e55e-4af1-a668-c4e247430926", "bridge": "br-int", "label": "tempest-device-tagging-net2-1758238013", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "92b768cf0f234b5da6d29450a58ce8e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a0146a0-20", "ovs_interfaceid": "8a0146a0-20fd-4879-be20-c8732bd6563c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "450233b4-a16d-4b2d-bc6a-a87736db7ff4", "address": "fa:16:3e:fe:ae:28", "network": {"id": "054ba1f8-e55e-4af1-a668-c4e247430926", "bridge": "br-int", "label": "tempest-device-tagging-net2-1758238013", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "92b768cf0f234b5da6d29450a58ce8e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap450233b4-a1", "ovs_interfaceid": "450233b4-a16d-4b2d-bc6a-a87736db7ff4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:16:13 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] Releasing lock "refresh_cache-0c359f00-f4b7-43c3-8454-364842893779" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:16:13 user nova-compute[85141]: DEBUG nova.compute.manager [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] [instance: 0c359f00-f4b7-43c3-8454-364842893779] Instance network_info: |[{"id": "97833d7f-68d7-4a6a-a283-83744d5afd10", "address": "fa:16:3e:b6:30:ac", "network": {"id": "cfb2308f-7c88-4329-a72d-4253cbbaca17", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1320471327-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92b768cf0f234b5da6d29450a58ce8e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97833d7f-68", "ovs_interfaceid": "97833d7f-68d7-4a6a-a283-83744d5afd10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "da46c331-8f37-4473-9c17-7bcb1c691b65", "address": "fa:16:3e:c7:5e:17", "network": {"id": "90bcfce1-33ea-4029-aa72-93b729655e77", "bridge": "br-int", "label": "tempest-device-tagging-net1-660308139", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.209", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "92b768cf0f234b5da6d29450a58ce8e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda46c331-8f", "ovs_interfaceid": "da46c331-8f37-4473-9c17-7bcb1c691b65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5b1acf97-626c-4014-b463-5b4455f0f1e6", "address": "fa:16:3e:0b:c9:63", "network": {"id": "90bcfce1-33ea-4029-aa72-93b729655e77", "bridge": "br-int", "label": "tempest-device-tagging-net1-660308139", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.15", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "92b768cf0f234b5da6d29450a58ce8e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b1acf97-62", "ovs_interfaceid": "5b1acf97-626c-4014-b463-5b4455f0f1e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2243117f-44a8-4d51-8676-d67748b3c9aa", "address": "fa:16:3e:87:12:47", "network": {"id": "90bcfce1-33ea-4029-aa72-93b729655e77", "bridge": "br-int", "label": "tempest-device-tagging-net1-660308139", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.140", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "92b768cf0f234b5da6d29450a58ce8e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2243117f-44", "ovs_interfaceid": "2243117f-44a8-4d51-8676-d67748b3c9aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6d48ae8e-004c-459d-ad7c-081cc9228fee", "address": "fa:16:3e:49:c2:7d", "network": {"id": "90bcfce1-33ea-4029-aa72-93b729655e77", "bridge": "br-int", "label": "tempest-device-tagging-net1-660308139", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "92b768cf0f234b5da6d29450a58ce8e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d48ae8e-00", "ovs_interfaceid": "6d48ae8e-004c-459d-ad7c-081cc9228fee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8a0146a0-20fd-4879-be20-c8732bd6563c", "address": "fa:16:3e:6d:38:4b", "network": {"id": "054ba1f8-e55e-4af1-a668-c4e247430926", "bridge": "br-int", "label": "tempest-device-tagging-net2-1758238013", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "92b768cf0f234b5da6d29450a58ce8e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a0146a0-20", "ovs_interfaceid": "8a0146a0-20fd-4879-be20-c8732bd6563c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "450233b4-a16d-4b2d-bc6a-a87736db7ff4", "address": "fa:16:3e:fe:ae:28", "network": {"id": "054ba1f8-e55e-4af1-a668-c4e247430926", "bridge": "br-int", "label": "tempest-device-tagging-net2-1758238013", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "92b768cf0f234b5da6d29450a58ce8e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap450233b4-a1", "ovs_interfaceid": "450233b4-a16d-4b2d-bc6a-a87736db7ff4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=85141) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 10:16:13 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-6f84e196-eaf4-4ab8-bdbe-2f46065e3de3 req-951c45dd-1085-4747-a569-4b712b62f33c service nova] Acquired lock "refresh_cache-0c359f00-f4b7-43c3-8454-364842893779" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:16:13 user nova-compute[85141]: DEBUG nova.network.neutron [req-6f84e196-eaf4-4ab8-bdbe-2f46065e3de3 req-951c45dd-1085-4747-a569-4b712b62f33c service nova] [instance: 0c359f00-f4b7-43c3-8454-364842893779] Refreshing network info cache for port 8a0146a0-20fd-4879-be20-c8732bd6563c {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 10:16:14 user nova-compute[85141]: DEBUG nova.network.neutron [req-6f84e196-eaf4-4ab8-bdbe-2f46065e3de3 req-951c45dd-1085-4747-a569-4b712b62f33c service nova] [instance: 0c359f00-f4b7-43c3-8454-364842893779] Updated VIF entry in instance network info cache for port 8a0146a0-20fd-4879-be20-c8732bd6563c. {{(pid=85141) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 10:16:14 user nova-compute[85141]: DEBUG nova.network.neutron [req-6f84e196-eaf4-4ab8-bdbe-2f46065e3de3 req-951c45dd-1085-4747-a569-4b712b62f33c service nova] [instance: 0c359f00-f4b7-43c3-8454-364842893779] Updating instance_info_cache with network_info: [{"id": "97833d7f-68d7-4a6a-a283-83744d5afd10", "address": "fa:16:3e:b6:30:ac", "network": {"id": "cfb2308f-7c88-4329-a72d-4253cbbaca17", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1320471327-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92b768cf0f234b5da6d29450a58ce8e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97833d7f-68", "ovs_interfaceid": "97833d7f-68d7-4a6a-a283-83744d5afd10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "da46c331-8f37-4473-9c17-7bcb1c691b65", "address": "fa:16:3e:c7:5e:17", "network": {"id": "90bcfce1-33ea-4029-aa72-93b729655e77", "bridge": "br-int", "label": "tempest-device-tagging-net1-660308139", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.209", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "92b768cf0f234b5da6d29450a58ce8e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda46c331-8f", "ovs_interfaceid": "da46c331-8f37-4473-9c17-7bcb1c691b65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5b1acf97-626c-4014-b463-5b4455f0f1e6", "address": "fa:16:3e:0b:c9:63", "network": {"id": "90bcfce1-33ea-4029-aa72-93b729655e77", "bridge": "br-int", "label": "tempest-device-tagging-net1-660308139", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.15", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "92b768cf0f234b5da6d29450a58ce8e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b1acf97-62", "ovs_interfaceid": "5b1acf97-626c-4014-b463-5b4455f0f1e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2243117f-44a8-4d51-8676-d67748b3c9aa", "address": "fa:16:3e:87:12:47", "network": {"id": "90bcfce1-33ea-4029-aa72-93b729655e77", "bridge": "br-int", "label": "tempest-device-tagging-net1-660308139", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.140", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "92b768cf0f234b5da6d29450a58ce8e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2243117f-44", "ovs_interfaceid": "2243117f-44a8-4d51-8676-d67748b3c9aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6d48ae8e-004c-459d-ad7c-081cc9228fee", "address": "fa:16:3e:49:c2:7d", "network": {"id": "90bcfce1-33ea-4029-aa72-93b729655e77", "bridge": "br-int", "label": "tempest-device-tagging-net1-660308139", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "92b768cf0f234b5da6d29450a58ce8e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d48ae8e-00", "ovs_interfaceid": "6d48ae8e-004c-459d-ad7c-081cc9228fee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8a0146a0-20fd-4879-be20-c8732bd6563c", "address": "fa:16:3e:6d:38:4b", "network": {"id": "054ba1f8-e55e-4af1-a668-c4e247430926", "bridge": "br-int", "label": "tempest-device-tagging-net2-1758238013", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "92b768cf0f234b5da6d29450a58ce8e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a0146a0-20", "ovs_interfaceid": "8a0146a0-20fd-4879-be20-c8732bd6563c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "450233b4-a16d-4b2d-bc6a-a87736db7ff4", "address": "fa:16:3e:fe:ae:28", "network": {"id": "054ba1f8-e55e-4af1-a668-c4e247430926", "bridge": "br-int", "label": "tempest-device-tagging-net2-1758238013", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "92b768cf0f234b5da6d29450a58ce8e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap450233b4-a1", "ovs_interfaceid": "450233b4-a16d-4b2d-bc6a-a87736db7ff4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:16:14 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-6f84e196-eaf4-4ab8-bdbe-2f46065e3de3 req-951c45dd-1085-4747-a569-4b712b62f33c service nova] Releasing lock "refresh_cache-0c359f00-f4b7-43c3-8454-364842893779" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:16:14 user nova-compute[85141]: DEBUG nova.compute.manager [req-6f84e196-eaf4-4ab8-bdbe-2f46065e3de3 req-951c45dd-1085-4747-a569-4b712b62f33c service nova] [instance: 0c359f00-f4b7-43c3-8454-364842893779] Received event network-changed-450233b4-a16d-4b2d-bc6a-a87736db7ff4 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:16:14 user nova-compute[85141]: DEBUG nova.compute.manager [req-6f84e196-eaf4-4ab8-bdbe-2f46065e3de3 req-951c45dd-1085-4747-a569-4b712b62f33c service nova] [instance: 0c359f00-f4b7-43c3-8454-364842893779] Refreshing instance network info cache due to event network-changed-450233b4-a16d-4b2d-bc6a-a87736db7ff4. {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 10:16:14 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-6f84e196-eaf4-4ab8-bdbe-2f46065e3de3 req-951c45dd-1085-4747-a569-4b712b62f33c service nova] Acquiring lock "refresh_cache-0c359f00-f4b7-43c3-8454-364842893779" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:16:14 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-6f84e196-eaf4-4ab8-bdbe-2f46065e3de3 req-951c45dd-1085-4747-a569-4b712b62f33c service nova] Acquired lock "refresh_cache-0c359f00-f4b7-43c3-8454-364842893779" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:16:14 user nova-compute[85141]: DEBUG nova.network.neutron [req-6f84e196-eaf4-4ab8-bdbe-2f46065e3de3 req-951c45dd-1085-4747-a569-4b712b62f33c service nova] [instance: 0c359f00-f4b7-43c3-8454-364842893779] Refreshing network info cache for port 450233b4-a16d-4b2d-bc6a-a87736db7ff4 {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 10:16:14 user nova-compute[85141]: DEBUG nova.network.neutron [req-6f84e196-eaf4-4ab8-bdbe-2f46065e3de3 req-951c45dd-1085-4747-a569-4b712b62f33c service nova] [instance: 0c359f00-f4b7-43c3-8454-364842893779] Updated VIF entry in instance network info cache for port 450233b4-a16d-4b2d-bc6a-a87736db7ff4. {{(pid=85141) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 10:16:14 user nova-compute[85141]: DEBUG nova.network.neutron [req-6f84e196-eaf4-4ab8-bdbe-2f46065e3de3 req-951c45dd-1085-4747-a569-4b712b62f33c service nova] [instance: 0c359f00-f4b7-43c3-8454-364842893779] Updating instance_info_cache with network_info: [{"id": "97833d7f-68d7-4a6a-a283-83744d5afd10", "address": "fa:16:3e:b6:30:ac", "network": {"id": "cfb2308f-7c88-4329-a72d-4253cbbaca17", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1320471327-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92b768cf0f234b5da6d29450a58ce8e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97833d7f-68", "ovs_interfaceid": "97833d7f-68d7-4a6a-a283-83744d5afd10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "da46c331-8f37-4473-9c17-7bcb1c691b65", "address": "fa:16:3e:c7:5e:17", "network": {"id": "90bcfce1-33ea-4029-aa72-93b729655e77", "bridge": "br-int", "label": "tempest-device-tagging-net1-660308139", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.209", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "92b768cf0f234b5da6d29450a58ce8e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda46c331-8f", "ovs_interfaceid": "da46c331-8f37-4473-9c17-7bcb1c691b65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5b1acf97-626c-4014-b463-5b4455f0f1e6", "address": "fa:16:3e:0b:c9:63", "network": {"id": "90bcfce1-33ea-4029-aa72-93b729655e77", "bridge": "br-int", "label": "tempest-device-tagging-net1-660308139", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.15", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "92b768cf0f234b5da6d29450a58ce8e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b1acf97-62", "ovs_interfaceid": "5b1acf97-626c-4014-b463-5b4455f0f1e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2243117f-44a8-4d51-8676-d67748b3c9aa", "address": "fa:16:3e:87:12:47", "network": {"id": "90bcfce1-33ea-4029-aa72-93b729655e77", "bridge": "br-int", "label": "tempest-device-tagging-net1-660308139", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.140", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "92b768cf0f234b5da6d29450a58ce8e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2243117f-44", "ovs_interfaceid": "2243117f-44a8-4d51-8676-d67748b3c9aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6d48ae8e-004c-459d-ad7c-081cc9228fee", "address": "fa:16:3e:49:c2:7d", "network": {"id": "90bcfce1-33ea-4029-aa72-93b729655e77", "bridge": "br-int", "label": "tempest-device-tagging-net1-660308139", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "92b768cf0f234b5da6d29450a58ce8e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d48ae8e-00", "ovs_interfaceid": "6d48ae8e-004c-459d-ad7c-081cc9228fee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8a0146a0-20fd-4879-be20-c8732bd6563c", "address": "fa:16:3e:6d:38:4b", "network": {"id": "054ba1f8-e55e-4af1-a668-c4e247430926", "bridge": "br-int", "label": "tempest-device-tagging-net2-1758238013", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "92b768cf0f234b5da6d29450a58ce8e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a0146a0-20", "ovs_interfaceid": "8a0146a0-20fd-4879-be20-c8732bd6563c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "450233b4-a16d-4b2d-bc6a-a87736db7ff4", "address": "fa:16:3e:fe:ae:28", "network": {"id": "054ba1f8-e55e-4af1-a668-c4e247430926", "bridge": "br-int", "label": "tempest-device-tagging-net2-1758238013", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "92b768cf0f234b5da6d29450a58ce8e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap450233b4-a1", "ovs_interfaceid": "450233b4-a16d-4b2d-bc6a-a87736db7ff4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:16:14 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-6f84e196-eaf4-4ab8-bdbe-2f46065e3de3 req-951c45dd-1085-4747-a569-4b712b62f33c service nova] Releasing lock "refresh_cache-0c359f00-f4b7-43c3-8454-364842893779" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:16:16 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:16:16 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:16:16 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Cleaning up deleted instances with incomplete migration  {{(pid=85141) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 16 10:16:17 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:16:19 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:16:19 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:16:20 user nova-compute[85141]: INFO nova.virt.block_device [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] [instance: 0c359f00-f4b7-43c3-8454-364842893779] Booting with volume 030d6106-e7ec-4eb8-9642-b64a4685f6bb at /dev/vdc
Nov 16 10:16:20 user nova-compute[85141]: DEBUG os_brick.utils [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 10:16:20 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:16:20 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:16:20 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[52eef09d-d552-4240-abbe-4676fa547d82]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c7834de5c295\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:16:20 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:16:20 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:16:20 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4fc222b-ca87-48b1-856f-9f56e0422761]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:16:20 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:16:20 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:16:20 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[11b6cedd-a099-48e3-9021-acae4cd5dc85]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:16:20 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[a58ca199-3dad-4be7-9cea-d87c6a375f61]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:16:20 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] Running cmd (subprocess): nvme version {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:16:20 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] 'nvme version' failed. Not Retrying. {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 10:16:20 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.nvmeof [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] nvme not present on system {{(pid=85141) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 10:16:20 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:16:20 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 10:16:20 user nova-compute[85141]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 10:16:20 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[068a178e-ebf3-40cc-b3b6-51bef433b89d]: (4, '') {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:16:20 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.lightos [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=85141) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 10:16:20 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.lightos [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=85141) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 10:16:20 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.lightos [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] LIGHTOS: no hostnqn found. {{(pid=85141) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 10:16:20 user nova-compute[85141]: DEBUG os_brick.utils [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c7834de5c295', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 10:16:20 user nova-compute[85141]: DEBUG nova.virt.block_device [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] [instance: 0c359f00-f4b7-43c3-8454-364842893779] Updating existing volume attachment record: cf95db7b-82d0-4556-af01-37951d6b63c0 {{(pid=85141) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 10:16:21 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:16:21 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:16:21 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:16:21 user nova-compute[85141]: DEBUG nova.network.neutron [None req-cbfd3d6c-122b-4b36-89c6-bedb91efc016 tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] [instance: e65ccf79-718d-4eeb-8914-f0db2e2c9ce2] Port 9b681ac7-3246-4ff4-8691-f8e4f1d62061 binding to destination host user is already ACTIVE {{(pid=85141) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 16 10:16:21 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-cbfd3d6c-122b-4b36-89c6-bedb91efc016 tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Acquiring lock "refresh_cache-e65ccf79-718d-4eeb-8914-f0db2e2c9ce2" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:16:21 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-cbfd3d6c-122b-4b36-89c6-bedb91efc016 tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Acquired lock "refresh_cache-e65ccf79-718d-4eeb-8914-f0db2e2c9ce2" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:16:21 user nova-compute[85141]: DEBUG nova.network.neutron [None req-cbfd3d6c-122b-4b36-89c6-bedb91efc016 tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] [instance: e65ccf79-718d-4eeb-8914-f0db2e2c9ce2] Building network info cache for instance {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 10:16:22 user nova-compute[85141]: DEBUG nova.network.neutron [None req-cbfd3d6c-122b-4b36-89c6-bedb91efc016 tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] [instance: e65ccf79-718d-4eeb-8914-f0db2e2c9ce2] Updating instance_info_cache with network_info: [{"id": "9b681ac7-3246-4ff4-8691-f8e4f1d62061", "address": "fa:16:3e:ce:f3:cd", "network": {"id": "ac11f3ed-4c14-4051-aff5-44d400d6368c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-679726958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7044a386486d4426bcccfe0b7d225c80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b681ac7-32", "ovs_interfaceid": "9b681ac7-3246-4ff4-8691-f8e4f1d62061", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:16:22 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-cbfd3d6c-122b-4b36-89c6-bedb91efc016 tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Releasing lock "refresh_cache-e65ccf79-718d-4eeb-8914-f0db2e2c9ce2" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:16:22 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-cbfd3d6c-122b-4b36-89c6-bedb91efc016 tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] [instance: e65ccf79-718d-4eeb-8914-f0db2e2c9ce2] Creating tmpfile /opt/stack/data/nova/instances/e65ccf79-718d-4eeb-8914-f0db2e2c9ce2/tmpjzx1dwep to verify with other compute node that the instance is on the same shared storage. {{(pid=85141) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9628}}
Nov 16 10:16:22 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:16:22 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:16:22 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:16:22 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:16:22 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Starting heal instance info cache {{(pid=85141) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 10:16:22 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:16:22 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:16:22 user nova-compute[85141]: DEBUG nova.compute.manager [req-a1e27208-0c1f-4452-b525-a16031a3cb28 req-a0fdc061-71bc-4dec-b0c7-9c00e42db307 service nova] [instance: e65ccf79-718d-4eeb-8914-f0db2e2c9ce2] Received event network-vif-unplugged-9b681ac7-3246-4ff4-8691-f8e4f1d62061 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:16:22 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-a1e27208-0c1f-4452-b525-a16031a3cb28 req-a0fdc061-71bc-4dec-b0c7-9c00e42db307 service nova] Acquiring lock "e65ccf79-718d-4eeb-8914-f0db2e2c9ce2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:16:22 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-a1e27208-0c1f-4452-b525-a16031a3cb28 req-a0fdc061-71bc-4dec-b0c7-9c00e42db307 service nova] Lock "e65ccf79-718d-4eeb-8914-f0db2e2c9ce2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:16:22 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-a1e27208-0c1f-4452-b525-a16031a3cb28 req-a0fdc061-71bc-4dec-b0c7-9c00e42db307 service nova] Lock "e65ccf79-718d-4eeb-8914-f0db2e2c9ce2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:16:22 user nova-compute[85141]: DEBUG nova.compute.manager [req-a1e27208-0c1f-4452-b525-a16031a3cb28 req-a0fdc061-71bc-4dec-b0c7-9c00e42db307 service nova] [instance: e65ccf79-718d-4eeb-8914-f0db2e2c9ce2] No waiting events found dispatching network-vif-unplugged-9b681ac7-3246-4ff4-8691-f8e4f1d62061 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:16:22 user nova-compute[85141]: WARNING nova.compute.manager [req-a1e27208-0c1f-4452-b525-a16031a3cb28 req-a0fdc061-71bc-4dec-b0c7-9c00e42db307 service nova] [instance: e65ccf79-718d-4eeb-8914-f0db2e2c9ce2] Received unexpected event network-vif-unplugged-9b681ac7-3246-4ff4-8691-f8e4f1d62061 for instance with vm_state resized and task_state resize_reverting.
Nov 16 10:16:22 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Didn't find any instances for network info cache update. {{(pid=85141) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 16 10:16:22 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:16:22 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=85141) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 10:16:22 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:16:22 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Cleaning up deleted instances {{(pid=85141) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 16 10:16:22 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] There are 0 instances to clean {{(pid=85141) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 16 10:16:22 user nova-compute[85141]: INFO nova.virt.libvirt.driver [-] [instance: e65ccf79-718d-4eeb-8914-f0db2e2c9ce2] Instance destroyed successfully.
Nov 16 10:16:22 user nova-compute[85141]: DEBUG nova.objects.instance [None req-cbfd3d6c-122b-4b36-89c6-bedb91efc016 tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Lazy-loading 'resources' on Instance uuid e65ccf79-718d-4eeb-8914-f0db2e2c9ce2 {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:16:23 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-cbfd3d6c-122b-4b36-89c6-bedb91efc016 tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T10:10:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-2047998705',display_name='tempest-ServerActionsTestOtherB-server-2047998705',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-2047998705',id=4,image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHf5WUZHhTvllxOmAg72z1YtUbpT94pAZ2VioYM/1ZPcnLSsLgh6rPndkFT+8xfTCaDEevGxVERzODZXR4Exh9KNRXP3xfU1ZBhWrD+YWL3uQCHfG8ms6Vv5yEaXpnuCDg==',key_name='tempest-keypair-2137833999',keypairs=<?>,launch_index=0,launched_at=2023-11-16T10:14:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7044a386486d4426bcccfe0b7d225c80',ramdisk_id='',reservation_id='r-2q3wdtbp',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-876168065',owner_user_name='tempest-ServerActionsTestOtherB-876168065-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T10:15:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='776d4157be1a4e56a8821d50da998475',uuid=e65ccf79-718d-4eeb-8914-f0db2e2c9ce2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "9b681ac7-3246-4ff4-8691-f8e4f1d62061", "address": "fa:16:3e:ce:f3:cd", "network": {"id": "ac11f3ed-4c14-4051-aff5-44d400d6368c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-679726958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7044a386486d4426bcccfe0b7d225c80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b681ac7-32", "ovs_interfaceid": "9b681ac7-3246-4ff4-8691-f8e4f1d62061", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 10:16:23 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-cbfd3d6c-122b-4b36-89c6-bedb91efc016 tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Converting VIF {"id": "9b681ac7-3246-4ff4-8691-f8e4f1d62061", "address": "fa:16:3e:ce:f3:cd", "network": {"id": "ac11f3ed-4c14-4051-aff5-44d400d6368c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-679726958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7044a386486d4426bcccfe0b7d225c80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b681ac7-32", "ovs_interfaceid": "9b681ac7-3246-4ff4-8691-f8e4f1d62061", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:16:23 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-cbfd3d6c-122b-4b36-89c6-bedb91efc016 tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ce:f3:cd,bridge_name='br-int',has_traffic_filtering=True,id=9b681ac7-3246-4ff4-8691-f8e4f1d62061,network=Network(ac11f3ed-4c14-4051-aff5-44d400d6368c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b681ac7-32') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:16:23 user nova-compute[85141]: DEBUG os_vif [None req-cbfd3d6c-122b-4b36-89c6-bedb91efc016 tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ce:f3:cd,bridge_name='br-int',has_traffic_filtering=True,id=9b681ac7-3246-4ff4-8691-f8e4f1d62061,network=Network(ac11f3ed-4c14-4051-aff5-44d400d6368c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b681ac7-32') {{(pid=85141) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 10:16:23 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:16:23 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9b681ac7-32, bridge=br-int, if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:16:23 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:16:23 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:16:23 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:16:23 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=27bd63f1-a26c-45cf-9c91-56902b29f2ea) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:16:23 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:16:23 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:16:23 user nova-compute[85141]: INFO os_vif [None req-cbfd3d6c-122b-4b36-89c6-bedb91efc016 tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ce:f3:cd,bridge_name='br-int',has_traffic_filtering=True,id=9b681ac7-3246-4ff4-8691-f8e4f1d62061,network=Network(ac11f3ed-4c14-4051-aff5-44d400d6368c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b681ac7-32')
Nov 16 10:16:23 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cbfd3d6c-122b-4b36-89c6-bedb91efc016 tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] [instance: e65ccf79-718d-4eeb-8914-f0db2e2c9ce2] calling os-brick to detach iSCSI Volume {{(pid=85141) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 10:16:23 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbfd3d6c-122b-4b36-89c6-bedb91efc016 tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51806b6080>, {'target_iqn': 'iqn.2010-10.org.openstack:abda547a-8d00-4a02-a6e4-d0670e47815a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RgkfZDbl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 10:16:23 user nova-compute[85141]: WARNING os_brick.initiator.connectors.base [None req-cbfd3d6c-122b-4b36-89c6-bedb91efc016 tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 10:16:23 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-cbfd3d6c-122b-4b36-89c6-bedb91efc016 tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 10:16:23 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-cbfd3d6c-122b-4b36-89c6-bedb91efc016 tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 10:16:23 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:16:23 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:16:23 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dd8cfb3-29d3-46f5-b23f-0d5ce89502e2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c94ff08f-badb-4203-b3af-e418025d1f0d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:abda547a-8d00-4a02-a6e4-d0670e47815a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:16:23 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbfd3d6c-122b-4b36-89c6-bedb91efc016 tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 10:16:23 user nova-compute[85141]: No targets found.
Nov 16 10:16:23 user nova-compute[85141]: iSNS:
Nov 16 10:16:23 user nova-compute[85141]: No targets found.
Nov 16 10:16:23 user nova-compute[85141]: STATIC:
Nov 16 10:16:23 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee
Nov 16 10:16:23 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:16:23 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:16:23 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:c94ff08f-badb-4203-b3af-e418025d1f0d
Nov 16 10:16:23 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:16:23 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:16:23 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:abda547a-8d00-4a02-a6e4-d0670e47815a
Nov 16 10:16:23 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:16:23 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:16:23 user nova-compute[85141]: FIRMWARE:
Nov 16 10:16:23 user nova-compute[85141]: No targets found.
Nov 16 10:16:23 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:16:23 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbfd3d6c-122b-4b36-89c6-bedb91efc016 tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 10:16:23 user nova-compute[85141]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 10:16:23 user nova-compute[85141]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=85141) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 10:16:23 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbfd3d6c-122b-4b36-89c6-bedb91efc016 tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:abda547a-8d00-4a02-a6e4-d0670e47815a', 0)] {{(pid=85141) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 10:16:23 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:16:23 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:16:23 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[538c66f7-4f75-46de-a20a-9e540ab7fc30]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:abda547a-8d00-4a02-a6e4-d0670e47815a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c94ff08f-badb-4203-b3af-e418025d1f0d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:16:23 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:16:23 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:16:23 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b11846c-c26c-4760-83d7-060f2bbfe9bb]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c94ff08f-badb-4203-b3af-e418025d1f0d (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abda547a-8d00-4a02-a6e4-d0670e47815a (non-flash)\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:16:23 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbfd3d6c-122b-4b36-89c6-bedb91efc016 tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)
Nov 16 10:16:23 user nova-compute[85141]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c94ff08f-badb-4203-b3af-e418025d1f0d (non-flash)
Nov 16 10:16:23 user nova-compute[85141]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abda547a-8d00-4a02-a6e4-d0670e47815a (non-flash)
Nov 16 10:16:23 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:16:23 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbfd3d6c-122b-4b36-89c6-bedb91efc016 tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)
Nov 16 10:16:23 user nova-compute[85141]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c94ff08f-badb-4203-b3af-e418025d1f0d (non-flash)
Nov 16 10:16:23 user nova-compute[85141]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abda547a-8d00-4a02-a6e4-d0670e47815a (non-flash)
Nov 16 10:16:23 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 10:16:23 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbfd3d6c-122b-4b36-89c6-bedb91efc016 tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f51a38ddc60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:abda547a-8d00-4a02-a6e4-d0670e47815a'): ({'sdb'}, set())}) {{(pid=85141) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 10:16:23 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-cbfd3d6c-122b-4b36-89c6-bedb91efc016 tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Removing single pathed devices sdb {{(pid=85141) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 10:16:23 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:16:23 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:16:23 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bdc5377-b581-42ae-9ed7-6ec1326fdc08]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:16:23 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:16:23 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:16:23 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[25169dfb-a768-452d-aae5-aa17cc4d2c99]: (4, ('ok\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:16:23 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-cbfd3d6c-122b-4b36-89c6-bedb91efc016 tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Flushing IO for device /dev/sdb {{(pid=85141) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 10:16:23 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:16:23 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:16:23 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[9751c1ee-8dae-4fe9-9f21-b0d2428c67f0]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:16:23 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-cbfd3d6c-122b-4b36-89c6-bedb91efc016 tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=85141) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 10:16:23 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:16:23 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.037s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:16:23 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[671b51a2-e33a-4016-b7a7-f8aaab6835db]: (4, ('1', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:16:23 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-cbfd3d6c-122b-4b36-89c6-bedb91efc016 tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=85141) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 10:16:23 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-cbfd3d6c-122b-4b36-89c6-bedb91efc016 tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] SCSI volumes sdb have been removed. {{(pid=85141) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 10:16:23 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbfd3d6c-122b-4b36-89c6-bedb91efc016 tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:abda547a-8d00-4a02-a6e4-d0670e47815a')] {{(pid=85141) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 10:16:23 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abda547a-8d00-4a02-a6e4-d0670e47815a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:16:23 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:16:23 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abda547a-8d00-4a02-a6e4-d0670e47815a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.118s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:16:23 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[1106c27c-7d81-4b91-b0c8-c6dd55cd4129]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:16:23 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbfd3d6c-122b-4b36-89c6-bedb91efc016 tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:16:23 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abda547a-8d00-4a02-a6e4-d0670e47815a -p 172.16.0.220:3260 --logout {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:16:23 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abda547a-8d00-4a02-a6e4-d0670e47815a -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:16:23 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cebf1cb-d094-4ec1-aef2-db7ff65e430f]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:abda547a-8d00-4a02-a6e4-d0670e47815a, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:abda547a-8d00-4a02-a6e4-d0670e47815a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:16:23 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbfd3d6c-122b-4b36-89c6-bedb91efc016 tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:abda547a-8d00-4a02-a6e4-d0670e47815a, portal: 172.16.0.220,3260]
Nov 16 10:16:23 user nova-compute[85141]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:abda547a-8d00-4a02-a6e4-d0670e47815a, portal: 172.16.0.220,3260] successful.
Nov 16 10:16:23 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:16:23 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abda547a-8d00-4a02-a6e4-d0670e47815a -p 172.16.0.220:3260 --op delete {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:16:23 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abda547a-8d00-4a02-a6e4-d0670e47815a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:16:23 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[e32c4f8b-8d40-4263-bebe-bc6ac1f9de78]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:16:23 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbfd3d6c-122b-4b36-89c6-bedb91efc016 tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:16:23 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-cbfd3d6c-122b-4b36-89c6-bedb91efc016 tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.402s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 10:16:23 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbfd3d6c-122b-4b36-89c6-bedb91efc016 tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] <== disconnect_volume: return (403ms) None {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 10:16:23 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cbfd3d6c-122b-4b36-89c6-bedb91efc016 tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] [instance: e65ccf79-718d-4eeb-8914-f0db2e2c9ce2] Disconnected iSCSI Volume {{(pid=85141) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 10:16:24 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-cbfd3d6c-122b-4b36-89c6-bedb91efc016 tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:16:24 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-cbfd3d6c-122b-4b36-89c6-bedb91efc016 tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.002s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:16:24 user nova-compute[85141]: DEBUG nova.objects.instance [None req-cbfd3d6c-122b-4b36-89c6-bedb91efc016 tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Lazy-loading 'migration_context' on Instance uuid e65ccf79-718d-4eeb-8914-f0db2e2c9ce2 {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:16:24 user nova-compute[85141]: DEBUG nova.objects.base [None req-cbfd3d6c-122b-4b36-89c6-bedb91efc016 tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Object Instance<e65ccf79-718d-4eeb-8914-f0db2e2c9ce2> lazy-loaded attributes: resources,migration_context {{(pid=85141) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 10:16:24 user nova-compute[85141]: DEBUG nova.compute.manager [req-92565622-1e76-4485-a492-6b170a1aa3e3 req-6d0f6965-dc9e-471c-b8db-2be432366940 service nova] [instance: e65ccf79-718d-4eeb-8914-f0db2e2c9ce2] Received event network-vif-plugged-9b681ac7-3246-4ff4-8691-f8e4f1d62061 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:16:24 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-92565622-1e76-4485-a492-6b170a1aa3e3 req-6d0f6965-dc9e-471c-b8db-2be432366940 service nova] Acquiring lock "e65ccf79-718d-4eeb-8914-f0db2e2c9ce2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:16:24 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-92565622-1e76-4485-a492-6b170a1aa3e3 req-6d0f6965-dc9e-471c-b8db-2be432366940 service nova] Lock "e65ccf79-718d-4eeb-8914-f0db2e2c9ce2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:16:24 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-92565622-1e76-4485-a492-6b170a1aa3e3 req-6d0f6965-dc9e-471c-b8db-2be432366940 service nova] Lock "e65ccf79-718d-4eeb-8914-f0db2e2c9ce2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:16:24 user nova-compute[85141]: DEBUG nova.compute.manager [req-92565622-1e76-4485-a492-6b170a1aa3e3 req-6d0f6965-dc9e-471c-b8db-2be432366940 service nova] [instance: e65ccf79-718d-4eeb-8914-f0db2e2c9ce2] No waiting events found dispatching network-vif-plugged-9b681ac7-3246-4ff4-8691-f8e4f1d62061 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:16:25 user nova-compute[85141]: WARNING nova.compute.manager [req-92565622-1e76-4485-a492-6b170a1aa3e3 req-6d0f6965-dc9e-471c-b8db-2be432366940 service nova] [instance: e65ccf79-718d-4eeb-8914-f0db2e2c9ce2] Received unexpected event network-vif-plugged-9b681ac7-3246-4ff4-8691-f8e4f1d62061 for instance with vm_state resized and task_state resize_reverting.
Nov 16 10:16:25 user nova-compute[85141]: DEBUG nova.compute.provider_tree [None req-cbfd3d6c-122b-4b36-89c6-bedb91efc016 tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Inventory has not changed in ProviderTree for provider: bf8e0fa1-16b6-408f-9203-c4cd63916272 {{(pid=85141) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 10:16:25 user nova-compute[85141]: DEBUG nova.scheduler.client.report [None req-cbfd3d6c-122b-4b36-89c6-bedb91efc016 tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Inventory has not changed for provider bf8e0fa1-16b6-408f-9203-c4cd63916272 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=85141) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 10:16:25 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-64a9f626-2227-4ec9-b638-3439b349b318 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 9411843f-4e79-46c4-ae02-01f5e87b86eb is timed out.
Nov 16 10:16:25 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager.update_available_resource {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:16:25 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-64a9f626-2227-4ec9-b638-3439b349b318 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Successfully detached device vdc from instance 9411843f-4e79-46c4-ae02-01f5e87b86eb from the live domain config.
Nov 16 10:16:25 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-64a9f626-2227-4ec9-b638-3439b349b318 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] [instance: 9411843f-4e79-46c4-ae02-01f5e87b86eb] calling os-brick to detach iSCSI Volume {{(pid=85141) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 10:16:25 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-64a9f626-2227-4ec9-b638-3439b349b318 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51806b6080>, {'target_iqn': 'iqn.2010-10.org.openstack:c94ff08f-badb-4203-b3af-e418025d1f0d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pWXeluTL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 10:16:25 user nova-compute[85141]: WARNING os_brick.initiator.connectors.base [None req-64a9f626-2227-4ec9-b638-3439b349b318 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 10:16:25 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-64a9f626-2227-4ec9-b638-3439b349b318 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 10:16:25 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-64a9f626-2227-4ec9-b638-3439b349b318 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 10:16:25 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:16:25 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:16:25 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ee9da07-5fbe-4790-a93d-9cfdbd984e32]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c94ff08f-badb-4203-b3af-e418025d1f0d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:16:25 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-64a9f626-2227-4ec9-b638-3439b349b318 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 10:16:25 user nova-compute[85141]: No targets found.
Nov 16 10:16:25 user nova-compute[85141]: iSNS:
Nov 16 10:16:25 user nova-compute[85141]: No targets found.
Nov 16 10:16:25 user nova-compute[85141]: STATIC:
Nov 16 10:16:25 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee
Nov 16 10:16:25 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:16:25 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:16:25 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:c94ff08f-badb-4203-b3af-e418025d1f0d
Nov 16 10:16:25 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:16:25 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:16:25 user nova-compute[85141]: FIRMWARE:
Nov 16 10:16:25 user nova-compute[85141]: No targets found.
Nov 16 10:16:25 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:16:25 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-64a9f626-2227-4ec9-b638-3439b349b318 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 10:16:25 user nova-compute[85141]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 10:16:25 user nova-compute[85141]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=85141) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 10:16:25 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-64a9f626-2227-4ec9-b638-3439b349b318 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c94ff08f-badb-4203-b3af-e418025d1f0d', 0)] {{(pid=85141) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 10:16:25 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:16:25 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:16:25 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:16:25 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea725638-4d48-47a7-8418-32005731f14f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c94ff08f-badb-4203-b3af-e418025d1f0d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:16:25 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:16:25 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:16:25 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2920530-ab6d-4572-87c5-4974dadf7b13]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c94ff08f-badb-4203-b3af-e418025d1f0d (non-flash)\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:16:25 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-64a9f626-2227-4ec9-b638-3439b349b318 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)
Nov 16 10:16:25 user nova-compute[85141]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c94ff08f-badb-4203-b3af-e418025d1f0d (non-flash)
Nov 16 10:16:25 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:16:25 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-64a9f626-2227-4ec9-b638-3439b349b318 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)
Nov 16 10:16:25 user nova-compute[85141]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c94ff08f-badb-4203-b3af-e418025d1f0d (non-flash)
Nov 16 10:16:25 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 10:16:25 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-64a9f626-2227-4ec9-b638-3439b349b318 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f518029a3b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c94ff08f-badb-4203-b3af-e418025d1f0d'): ({'sde'}, set())}) {{(pid=85141) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 10:16:25 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-64a9f626-2227-4ec9-b638-3439b349b318 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Removing single pathed devices sde {{(pid=85141) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 10:16:25 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:16:25 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:16:25 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eba8379-43f2-401f-813a-88b12ca1b93c]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:16:25 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:16:25 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-cbfd3d6c-122b-4b36-89c6-bedb91efc016 tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 1.192s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:16:25 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:16:25 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7158af7-21d4-410d-a506-a634459b5256]: (4, ('ok\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:16:25 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.109s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:16:25 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:16:25 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Auditing locally available compute resources for user (node: user) {{(pid=85141) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 10:16:25 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-64a9f626-2227-4ec9-b638-3439b349b318 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Flushing IO for device /dev/sde {{(pid=85141) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 10:16:25 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:16:25 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.023s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:16:25 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[513b8419-7fce-4c6d-9bee-1672eb66c8de]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:16:25 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-64a9f626-2227-4ec9-b638-3439b349b318 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=85141) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 10:16:25 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:16:25 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.034s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:16:25 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a10c815-acdc-4375-b23c-e871a6f11326]: (4, ('1', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:16:25 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-64a9f626-2227-4ec9-b638-3439b349b318 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=85141) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 10:16:25 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-64a9f626-2227-4ec9-b638-3439b349b318 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] SCSI volumes sde have been removed. {{(pid=85141) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 10:16:25 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-64a9f626-2227-4ec9-b638-3439b349b318 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c94ff08f-badb-4203-b3af-e418025d1f0d')] {{(pid=85141) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 10:16:25 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c94ff08f-badb-4203-b3af-e418025d1f0d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:16:25 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c94ff08f-badb-4203-b3af-e418025d1f0d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.035s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:16:25 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[43da8f19-d205-4d1c-9239-807035119e09]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:16:25 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-64a9f626-2227-4ec9-b638-3439b349b318 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:16:25 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c94ff08f-badb-4203-b3af-e418025d1f0d -p 172.16.0.220:3260 --logout {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:16:25 user nova-compute[85141]: INFO nova.compute.manager [None req-cbfd3d6c-122b-4b36-89c6-bedb91efc016 tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] [instance: e65ccf79-718d-4eeb-8914-f0db2e2c9ce2] Swapping old allocation on dict_keys(['bf8e0fa1-16b6-408f-9203-c4cd63916272']) held by migration fc337d89-3421-482f-93bf-c5f11b82f622 for instance
Nov 16 10:16:25 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c94ff08f-badb-4203-b3af-e418025d1f0d -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:16:25 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[65aafbdd-c589-4136-b5a8-2db6947072b6]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:c94ff08f-badb-4203-b3af-e418025d1f0d, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:c94ff08f-badb-4203-b3af-e418025d1f0d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:16:25 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-64a9f626-2227-4ec9-b638-3439b349b318 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:c94ff08f-badb-4203-b3af-e418025d1f0d, portal: 172.16.0.220,3260]
Nov 16 10:16:25 user nova-compute[85141]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:c94ff08f-badb-4203-b3af-e418025d1f0d, portal: 172.16.0.220,3260] successful.
Nov 16 10:16:25 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:16:25 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c94ff08f-badb-4203-b3af-e418025d1f0d -p 172.16.0.220:3260 --op delete {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:16:25 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/361a2044-8fd0-4975-8a19-814bf7a6da41/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:16:25 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c94ff08f-badb-4203-b3af-e418025d1f0d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:16:25 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3f3003f-8a26-4607-bdf3-466d7b7fa40f]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:16:25 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-64a9f626-2227-4ec9-b638-3439b349b318 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:16:25 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-64a9f626-2227-4ec9-b638-3439b349b318 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.391s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 10:16:25 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-64a9f626-2227-4ec9-b638-3439b349b318 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] <== disconnect_volume: return (392ms) None {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 10:16:25 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-64a9f626-2227-4ec9-b638-3439b349b318 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] [instance: 9411843f-4e79-46c4-ae02-01f5e87b86eb] Disconnected iSCSI Volume {{(pid=85141) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 10:16:25 user nova-compute[85141]: DEBUG nova.scheduler.client.report [None req-cbfd3d6c-122b-4b36-89c6-bedb91efc016 tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Overwriting current allocation {'allocations': {'bf8e0fa1-16b6-408f-9203-c4cd63916272': {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}, 'generation': 25}}, 'project_id': '7044a386486d4426bcccfe0b7d225c80', 'user_id': '776d4157be1a4e56a8821d50da998475', 'consumer_generation': 1} on consumer e65ccf79-718d-4eeb-8914-f0db2e2c9ce2 {{(pid=85141) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Nov 16 10:16:25 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/361a2044-8fd0-4975-8a19-814bf7a6da41/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:16:25 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/361a2044-8fd0-4975-8a19-814bf7a6da41/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:16:26 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-cbfd3d6c-122b-4b36-89c6-bedb91efc016 tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Acquiring lock "refresh_cache-e65ccf79-718d-4eeb-8914-f0db2e2c9ce2" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:16:26 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-cbfd3d6c-122b-4b36-89c6-bedb91efc016 tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Acquired lock "refresh_cache-e65ccf79-718d-4eeb-8914-f0db2e2c9ce2" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:16:26 user nova-compute[85141]: DEBUG nova.network.neutron [None req-cbfd3d6c-122b-4b36-89c6-bedb91efc016 tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] [instance: e65ccf79-718d-4eeb-8914-f0db2e2c9ce2] Building network info cache for instance {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 10:16:26 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/361a2044-8fd0-4975-8a19-814bf7a6da41/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:16:26 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:16:26 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:16:26 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:16:26 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:16:26 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d842f90e-663b-4c95-9d7c-d092d2bac41f/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:16:26 user nova-compute[85141]: DEBUG nova.network.neutron [None req-cbfd3d6c-122b-4b36-89c6-bedb91efc016 tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] [instance: e65ccf79-718d-4eeb-8914-f0db2e2c9ce2] Updating instance_info_cache with network_info: [{"id": "9b681ac7-3246-4ff4-8691-f8e4f1d62061", "address": "fa:16:3e:ce:f3:cd", "network": {"id": "ac11f3ed-4c14-4051-aff5-44d400d6368c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-679726958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7044a386486d4426bcccfe0b7d225c80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b681ac7-32", "ovs_interfaceid": "9b681ac7-3246-4ff4-8691-f8e4f1d62061", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:16:26 user nova-compute[85141]: DEBUG nova.objects.instance [None req-64a9f626-2227-4ec9-b638-3439b349b318 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Lazy-loading 'flavor' on Instance uuid 9411843f-4e79-46c4-ae02-01f5e87b86eb {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:16:26 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-cbfd3d6c-122b-4b36-89c6-bedb91efc016 tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Releasing lock "refresh_cache-e65ccf79-718d-4eeb-8914-f0db2e2c9ce2" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:16:26 user nova-compute[85141]: DEBUG os_brick.utils [None req-cbfd3d6c-122b-4b36-89c6-bedb91efc016 tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 10:16:26 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:16:26 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:16:26 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf460d22-d8e2-4528-be68-f122d4b94622]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c7834de5c295\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:16:26 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:16:26 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-64a9f626-2227-4ec9-b638-3439b349b318 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Lock "9411843f-4e79-46c4-ae02-01f5e87b86eb" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.976s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:16:26 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:16:26 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d88175e-43ac-4305-ac61-9206cbb69404]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:16:26 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:16:26 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:16:26 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[5faf880e-dc14-41a1-b3ed-62aa8c295e4e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:16:26 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eb0bfbe-084a-45b3-bba5-5a975ae2871f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:16:26 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-cbfd3d6c-122b-4b36-89c6-bedb91efc016 tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Running cmd (subprocess): nvme version {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:16:26 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-cbfd3d6c-122b-4b36-89c6-bedb91efc016 tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] 'nvme version' failed. Not Retrying. {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 10:16:26 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cbfd3d6c-122b-4b36-89c6-bedb91efc016 tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] nvme not present on system {{(pid=85141) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 10:16:26 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:16:26 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d842f90e-663b-4c95-9d7c-d092d2bac41f/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:16:26 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d842f90e-663b-4c95-9d7c-d092d2bac41f/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:16:26 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 10:16:26 user nova-compute[85141]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 10:16:26 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[8692e61e-51cd-4c9b-a85b-5b680901f95b]: (4, '') {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:16:26 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.lightos [None req-cbfd3d6c-122b-4b36-89c6-bedb91efc016 tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=85141) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 10:16:26 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.lightos [None req-cbfd3d6c-122b-4b36-89c6-bedb91efc016 tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=85141) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 10:16:26 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.lightos [None req-cbfd3d6c-122b-4b36-89c6-bedb91efc016 tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] LIGHTOS: no hostnqn found. {{(pid=85141) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 10:16:26 user nova-compute[85141]: DEBUG os_brick.utils [None req-cbfd3d6c-122b-4b36-89c6-bedb91efc016 tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] <== get_connector_properties: return (199ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c7834de5c295', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 10:16:26 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d842f90e-663b-4c95-9d7c-d092d2bac41f/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:16:26 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9411843f-4e79-46c4-ae02-01f5e87b86eb/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:16:27 user nova-compute[85141]: DEBUG nova.compute.manager [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] [instance: 0c359f00-f4b7-43c3-8454-364842893779] Start spawning the instance on the hypervisor. {{(pid=85141) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 10:16:27 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] [instance: 0c359f00-f4b7-43c3-8454-364842893779] Creating instance directory {{(pid=85141) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 10:16:27 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] [instance: 0c359f00-f4b7-43c3-8454-364842893779] Creating image(s)
Nov 16 10:16:27 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] [instance: 0c359f00-f4b7-43c3-8454-364842893779] Did not create local disks {{(pid=85141) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 16 10:16:27 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] [instance: 0c359f00-f4b7-43c3-8454-364842893779] Ensure instance console log exists: /opt/stack/data/nova/instances/0c359f00-f4b7-43c3-8454-364842893779/console.log {{(pid=85141) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 10:16:27 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:16:27 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:16:27 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:16:27 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] [instance: 0c359f00-f4b7-43c3-8454-364842893779] Start _get_guest_xml network_info=[{"id": "97833d7f-68d7-4a6a-a283-83744d5afd10", "address": "fa:16:3e:b6:30:ac", "network": {"id": "cfb2308f-7c88-4329-a72d-4253cbbaca17", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1320471327-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92b768cf0f234b5da6d29450a58ce8e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97833d7f-68", "ovs_interfaceid": "97833d7f-68d7-4a6a-a283-83744d5afd10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "da46c331-8f37-4473-9c17-7bcb1c691b65", "address": "fa:16:3e:c7:5e:17", "network": {"id": "90bcfce1-33ea-4029-aa72-93b729655e77", "bridge": "br-int", "label": "tempest-device-tagging-net1-660308139", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.209", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "92b768cf0f234b5da6d29450a58ce8e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda46c331-8f", "ovs_interfaceid": "da46c331-8f37-4473-9c17-7bcb1c691b65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5b1acf97-626c-4014-b463-5b4455f0f1e6", "address": "fa:16:3e:0b:c9:63", "network": {"id": "90bcfce1-33ea-4029-aa72-93b729655e77", "bridge": "br-int", "label": "tempest-device-tagging-net1-660308139", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.15", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "92b768cf0f234b5da6d29450a58ce8e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b1acf97-62", "ovs_interfaceid": "5b1acf97-626c-4014-b463-5b4455f0f1e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2243117f-44a8-4d51-8676-d67748b3c9aa", "address": "fa:16:3e:87:12:47", "network": {"id": "90bcfce1-33ea-4029-aa72-93b729655e77", "bridge": "br-int", "label": "tempest-device-tagging-net1-660308139", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.140", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "92b768cf0f234b5da6d29450a58ce8e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2243117f-44", "ovs_interfaceid": "2243117f-44a8-4d51-8676-d67748b3c9aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6d48ae8e-004c-459d-ad7c-081cc9228fee", "address": "fa:16:3e:49:c2:7d", "network": {"id": "90bcfce1-33ea-4029-aa72-93b729655e77", "bridge": "br-int", "label": "tempest-device-tagging-net1-660308139", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "92b768cf0f234b5da6d29450a58ce8e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d48ae8e-00", "ovs_interfaceid": "6d48ae8e-004c-459d-ad7c-081cc9228fee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8a0146a0-20fd-4879-be20-c8732bd6563c", "address": "fa:16:3e:6d:38:4b", "network": {"id": "054ba1f8-e55e-4af1-a668-c4e247430926", "bridge": "br-int", "label": "tempest-device-tagging-net2-1758238013", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "92b768cf0f234b5da6d29450a58ce8e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a0146a0-20", "ovs_interfaceid": "8a0146a0-20fd-4879-be20-c8732bd6563c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "450233b4-a16d-4b2d-bc6a-a87736db7ff4", "address": "fa:16:3e:fe:ae:28", "network": {"id": "054ba1f8-e55e-4af1-a668-c4e247430926", "bridge": "br-int", "label": "tempest-device-tagging-net2-1758238013", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "92b768cf0f234b5da6d29450a58ce8e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap450233b4-a1", "ovs_interfaceid": "450233b4-a16d-4b2d-bc6a-a87736db7ff4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T10:06:42Z,direct_url=<?>,disk_format='qcow2',id=bc4ca70f-a459-4d5c-a9e6-80f1948eb48b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1044631a5fe84ce8904864a7024049fa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T10:06:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:1fa41a79-b1fc-4047-9ae9-f674f348378f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EgOvCfzd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '0c359f00-f4b7-43c3-8454-364842893779', 'attached_at': '', 'detached_at': '', 'volume_id': '1fa41a79-b1fc-4047-9ae9-f674f348378f', 'serial': '1fa41a79-b1fc-4047-9ae9-f674f348378f'}, 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'attachment_id': '3a007f16-f838-4bf8-a549-ce60a95b3a7d', 'mount_device': '/dev/vda', 'volume_type': None}, {'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ef975afa-7705-454b-88d3-798b0a74dbb9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KEWyzSCs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '0c359f00-f4b7-43c3-8454-364842893779', 'attached_at': '', 'detached_at': '', 'volume_id': 'ef975afa-7705-454b-88d3-798b0a74dbb9', 'serial': 'ef975afa-7705-454b-88d3-798b0a74dbb9'}, 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'boot_index': 1, 'attachment_id': 'e6e59b69-d261-40b7-9c33-369c0f23d0f1', 'mount_device': '/dev/vdb', 'volume_type': None}, {'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:030d6106-e7ec-4eb8-9642-b64a4685f6bb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vPKFhqwg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '0c359f00-f4b7-43c3-8454-364842893779', 'attached_at': '', 'detached_at': '', 'volume_id': '030d6106-e7ec-4eb8-9642-b64a4685f6bb', 'serial': '030d6106-e7ec-4eb8-9642-b64a4685f6bb'}, 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'boot_index': 2, 'attachment_id': 'cf95db7b-82d0-4556-af01-37951d6b63c0', 'mount_device': '/dev/vdc', 'volume_type': None} {{(pid=85141) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 10:16:27 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:16:27 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:16:27 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=85141) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 10:16:27 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] CPU controller missing on host. {{(pid=85141) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 10:16:27 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=85141) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 10:16:27 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] CPU controller found on host. {{(pid=85141) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 10:16:27 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=85141) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 10:16:27 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T10:06:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T10:06:42Z,direct_url=<?>,disk_format='qcow2',id=bc4ca70f-a459-4d5c-a9e6-80f1948eb48b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1044631a5fe84ce8904864a7024049fa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T10:06:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 10:16:27 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] Flavor limits 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 10:16:27 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] Image limits 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 10:16:27 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] Flavor pref 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 10:16:27 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] Image pref 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 10:16:27 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 10:16:27 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 10:16:27 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=85141) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 10:16:27 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] Got 1 possible topologies {{(pid=85141) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 10:16:27 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 10:16:27 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 10:16:27 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] [instance: 0c359f00-f4b7-43c3-8454-364842893779] Calling os-brick to attach iSCSI Volume {{(pid=85141) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 10:16:27 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51806b6080>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1fa41a79-b1fc-4047-9ae9-f674f348378f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EgOvCfzd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 10:16:27 user nova-compute[85141]: WARNING os_brick.initiator.connectors.base [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 10:16:27 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 10:16:27 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 10:16:27 user nova-compute[85141]: WARNING os_brick.initiator.connectors.base [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 10:16:27 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1fa41a79-b1fc-4047-9ae9-f674f348378f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 10:16:27 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1fa41a79-b1fc-4047-9ae9-f674f348378f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 10:16:27 user nova-compute[85141]: INFO os_brick.initiator.connectors.iscsi [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 10:16:27 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1fa41a79-b1fc-4047-9ae9-f674f348378f -p 172.16.0.220:3260 {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:16:27 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1fa41a79-b1fc-4047-9ae9-f674f348378f -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:16:27 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[518c611f-366e-4cac-93fc-3ff125238069]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:16:27 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 10:16:27 user nova-compute[85141]:  {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:16:27 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1fa41a79-b1fc-4047-9ae9-f674f348378f -p 172.16.0.220:3260 --interface default --op new {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:16:27 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1fa41a79-b1fc-4047-9ae9-f674f348378f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.029s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:16:27 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[004c5caa-affc-4254-9b88-58d1b48cd2f0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1fa41a79-b1fc-4047-9ae9-f674f348378f] added\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:16:27 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1fa41a79-b1fc-4047-9ae9-f674f348378f] added
Nov 16 10:16:27 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:16:27 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1fa41a79-b1fc-4047-9ae9-f674f348378f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:16:27 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1fa41a79-b1fc-4047-9ae9-f674f348378f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.039s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:16:27 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f35f2d8-de18-4cd2-9027-c9390e618381]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:16:27 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:16:27 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1fa41a79-b1fc-4047-9ae9-f674f348378f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:16:27 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9411843f-4e79-46c4-ae02-01f5e87b86eb/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:16:27 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9411843f-4e79-46c4-ae02-01f5e87b86eb/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:16:27 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1fa41a79-b1fc-4047-9ae9-f674f348378f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:16:27 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb4ec627-bd88-47cd-8478-e5a86271a3a7]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:16:27 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:16:27 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1fa41a79-b1fc-4047-9ae9-f674f348378f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EgOvCfzd {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:16:27 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1fa41a79-b1fc-4047-9ae9-f674f348378f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EgOvCfzd" returned: 0 in 0.023s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:16:27 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[d85664c1-9c3e-4c28-ba2b-a8f69160eb9c]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:16:27 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EgOvCfzd'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:16:27 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1fa41a79-b1fc-4047-9ae9-f674f348378f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:16:27 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1fa41a79-b1fc-4047-9ae9-f674f348378f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:16:27 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[a54e1dc5-213f-4c03-abcd-15b04ca39b58]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:16:27 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:16:27 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:16:27 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:16:27 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[a87c3e71-a7fe-436b-85ed-db0922c49e4c]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:16:27 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)
Nov 16 10:16:27 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:16:27 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)
Nov 16 10:16:27 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 10:16:27 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1fa41a79-b1fc-4047-9ae9-f674f348378f -p 172.16.0.220:3260 --login {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:16:27 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1fa41a79-b1fc-4047-9ae9-f674f348378f -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:16:27 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[18872729-08c4-4012-8c8a-cdd253420aeb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1fa41a79-b1fc-4047-9ae9-f674f348378f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1fa41a79-b1fc-4047-9ae9-f674f348378f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:16:27 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1fa41a79-b1fc-4047-9ae9-f674f348378f, portal: 172.16.0.220,3260]
Nov 16 10:16:27 user nova-compute[85141]: Login to [iface: default, target: iqn.2010-10.org.openstack:1fa41a79-b1fc-4047-9ae9-f674f348378f, portal: 172.16.0.220,3260] successful.
Nov 16 10:16:27 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:16:27 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1fa41a79-b1fc-4047-9ae9-f674f348378f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:16:27 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9411843f-4e79-46c4-ae02-01f5e87b86eb/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:16:27 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1fa41a79-b1fc-4047-9ae9-f674f348378f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:16:27 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[957c3a25-e0f3-4c27-b3aa-5010a341d091]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:16:27 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:16:27 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:16:27 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e214bbb-5bbb-4e6f-ac09-9cb1412f068b/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:16:27 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:16:27 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d42452a-ce8e-4f4b-820b-df8fd6ce4e3b]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fa41a79-b1fc-4047-9ae9-f674f348378f (non-flash)\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:16:27 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)
Nov 16 10:16:27 user nova-compute[85141]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fa41a79-b1fc-4047-9ae9-f674f348378f (non-flash)
Nov 16 10:16:27 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:16:27 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)
Nov 16 10:16:27 user nova-compute[85141]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fa41a79-b1fc-4047-9ae9-f674f348378f (non-flash)
Nov 16 10:16:27 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 10:16:27 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1fa41a79-b1fc-4047-9ae9-f674f348378f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.383s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 10:16:27 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] Connected to 172.16.0.220:3260 {{(pid=85141) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 10:16:27 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] HCTL ('33', '-', '-', 0) found on session 20 with lun 0 {{(pid=85141) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 10:16:27 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=85141) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 10:16:27 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:16:27 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:16:27 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[9966c020-38aa-4300-a6b9-9b7ae8396ad7]: (4, ('- - 0', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:16:27 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] Searching for a device in session 20 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=85141) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 10:16:27 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:1fa41a79-b1fc-4047-9ae9-f674f348378f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EgOvCfzd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=85141) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 10:16:27 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e214bbb-5bbb-4e6f-ac09-9cb1412f068b/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:16:27 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e214bbb-5bbb-4e6f-ac09-9cb1412f068b/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:16:27 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e214bbb-5bbb-4e6f-ac09-9cb1412f068b/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:16:27 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=85141) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 10:16:27 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f01dc8cf-1a69-4618-a15d-0c1075157f05/disk.rescue --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:16:28 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:16:28 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f01dc8cf-1a69-4618-a15d-0c1075157f05/disk.rescue --force-share --output=json" returned: 0 in 0.230s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:16:28 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f01dc8cf-1a69-4618-a15d-0c1075157f05/disk.rescue --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:16:28 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f01dc8cf-1a69-4618-a15d-0c1075157f05/disk.rescue --force-share --output=json" returned: 0 in 0.191s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:16:28 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b24c3954-06ff-4e15-9e43-c65d1dae7a5d/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:16:28 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b24c3954-06ff-4e15-9e43-c65d1dae7a5d/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:16:28 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b24c3954-06ff-4e15-9e43-c65d1dae7a5d/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:16:28 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.430s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 10:16:28 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] <== connect_volume: return (1433ms) {'type': 'block', 'scsi_wwn': '26439313663636361', 'path': '/dev/sdb'} {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 10:16:28 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] [instance: 0c359f00-f4b7-43c3-8454-364842893779] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26439313663636361', 'path': '/dev/sdb'} {{(pid=85141) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 10:16:28 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] [instance: 0c359f00-f4b7-43c3-8454-364842893779] Calling os-brick to attach iSCSI Volume {{(pid=85141) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 10:16:28 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51806b6080>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ef975afa-7705-454b-88d3-798b0a74dbb9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KEWyzSCs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 10:16:28 user nova-compute[85141]: WARNING os_brick.initiator.connectors.base [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 10:16:28 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 10:16:28 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 10:16:28 user nova-compute[85141]: WARNING os_brick.initiator.connectors.base [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 10:16:28 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ef975afa-7705-454b-88d3-798b0a74dbb9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 10:16:28 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ef975afa-7705-454b-88d3-798b0a74dbb9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 10:16:28 user nova-compute[85141]: INFO os_brick.initiator.connectors.iscsi [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 10:16:28 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef975afa-7705-454b-88d3-798b0a74dbb9 -p 172.16.0.220:3260 {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:16:28 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef975afa-7705-454b-88d3-798b0a74dbb9 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:16:28 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c675123-3ee7-4f80-b718-76d6cd261bf7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:16:28 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 10:16:28 user nova-compute[85141]:  {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:16:28 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef975afa-7705-454b-88d3-798b0a74dbb9 -p 172.16.0.220:3260 --interface default --op new {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:16:28 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef975afa-7705-454b-88d3-798b0a74dbb9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:16:28 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d9dd30c-477d-4c66-8cab-cdc54c46666f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ef975afa-7705-454b-88d3-798b0a74dbb9] added\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:16:28 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ef975afa-7705-454b-88d3-798b0a74dbb9] added
Nov 16 10:16:28 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:16:28 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef975afa-7705-454b-88d3-798b0a74dbb9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:16:28 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef975afa-7705-454b-88d3-798b0a74dbb9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:16:28 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1e6d26e-36c1-4b5d-a6dc-da604d7b935f]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:16:28 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:16:28 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef975afa-7705-454b-88d3-798b0a74dbb9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:16:28 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef975afa-7705-454b-88d3-798b0a74dbb9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:16:28 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[641f5fea-ddf3-416b-8fc6-16e04d98d92e]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:16:28 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:16:28 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef975afa-7705-454b-88d3-798b0a74dbb9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KEWyzSCs {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:16:28 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b24c3954-06ff-4e15-9e43-c65d1dae7a5d/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:16:28 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/059d6974-bd0c-4f73-91fc-8202ebda4238/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:16:28 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef975afa-7705-454b-88d3-798b0a74dbb9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KEWyzSCs" returned: 0 in 0.023s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:16:28 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[47060d32-c4ce-4405-8e91-d4956efb7cf2]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:16:28 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KEWyzSCs'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:16:28 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef975afa-7705-454b-88d3-798b0a74dbb9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:16:28 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef975afa-7705-454b-88d3-798b0a74dbb9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:16:28 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[693100b9-01da-4a05-9afd-bf08065c10fb]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:16:28 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:16:28 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:16:28 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:16:28 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1dda44f-1b2a-41e5-94c2-ca84a9301df4]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fa41a79-b1fc-4047-9ae9-f674f348378f (non-flash)\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:16:28 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)
Nov 16 10:16:28 user nova-compute[85141]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fa41a79-b1fc-4047-9ae9-f674f348378f (non-flash)
Nov 16 10:16:28 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:16:28 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)
Nov 16 10:16:28 user nova-compute[85141]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fa41a79-b1fc-4047-9ae9-f674f348378f (non-flash)
Nov 16 10:16:28 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 10:16:28 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef975afa-7705-454b-88d3-798b0a74dbb9 -p 172.16.0.220:3260 --login {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:16:28 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef975afa-7705-454b-88d3-798b0a74dbb9 -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:16:28 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[742580d6-e201-43ec-a40f-195c6756edb7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ef975afa-7705-454b-88d3-798b0a74dbb9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ef975afa-7705-454b-88d3-798b0a74dbb9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:16:28 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ef975afa-7705-454b-88d3-798b0a74dbb9, portal: 172.16.0.220,3260]
Nov 16 10:16:28 user nova-compute[85141]: Login to [iface: default, target: iqn.2010-10.org.openstack:ef975afa-7705-454b-88d3-798b0a74dbb9, portal: 172.16.0.220,3260] successful.
Nov 16 10:16:28 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:16:28 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef975afa-7705-454b-88d3-798b0a74dbb9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:16:28 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/059d6974-bd0c-4f73-91fc-8202ebda4238/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:16:28 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/059d6974-bd0c-4f73-91fc-8202ebda4238/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:16:28 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef975afa-7705-454b-88d3-798b0a74dbb9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:16:28 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[870c49e7-dba7-4bf5-86b0-a2d00c5fb4e6]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:16:28 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:16:28 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:16:28 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:16:28 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[9604b4c7-7176-47c6-ba7c-fea803af637d]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fa41a79-b1fc-4047-9ae9-f674f348378f (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef975afa-7705-454b-88d3-798b0a74dbb9 (non-flash)\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:16:28 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)
Nov 16 10:16:28 user nova-compute[85141]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fa41a79-b1fc-4047-9ae9-f674f348378f (non-flash)
Nov 16 10:16:28 user nova-compute[85141]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef975afa-7705-454b-88d3-798b0a74dbb9 (non-flash)
Nov 16 10:16:28 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:16:28 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)
Nov 16 10:16:28 user nova-compute[85141]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fa41a79-b1fc-4047-9ae9-f674f348378f (non-flash)
Nov 16 10:16:28 user nova-compute[85141]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef975afa-7705-454b-88d3-798b0a74dbb9 (non-flash)
Nov 16 10:16:28 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 10:16:28 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ef975afa-7705-454b-88d3-798b0a74dbb9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.354s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 10:16:28 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] Connected to 172.16.0.220:3260 {{(pid=85141) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 10:16:28 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] HCTL ('35', '-', '-', 0) found on session 21 with lun 0 {{(pid=85141) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 10:16:28 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=85141) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 10:16:28 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:16:28 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:16:28 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[209b7ce6-573b-43b0-b4dd-a7928058ad6b]: (4, ('- - 0', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:16:28 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] Searching for a device in session 21 and hctl ['35', '*', '*', 0] yield: None {{(pid=85141) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 10:16:29 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/059d6974-bd0c-4f73-91fc-8202ebda4238/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:16:29 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:16:29 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:16:29 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Hypervisor/Node resource view: name=user free_ram=7573MB free_disk=25.246746063232422GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=85141) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 10:16:29 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:16:29 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:16:29 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance d842f90e-663b-4c95-9d7c-d092d2bac41f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:16:29 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance 361a2044-8fd0-4975-8a19-814bf7a6da41 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:16:29 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance f01dc8cf-1a69-4618-a15d-0c1075157f05 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:16:29 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance 059d6974-bd0c-4f73-91fc-8202ebda4238 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:16:29 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance 9411843f-4e79-46c4-ae02-01f5e87b86eb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:16:29 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance e65ccf79-718d-4eeb-8914-f0db2e2c9ce2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:16:29 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance 4e214bbb-5bbb-4e6f-ac09-9cb1412f068b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:16:29 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance b24c3954-06ff-4e15-9e43-c65d1dae7a5d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:16:29 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:16:29 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance 0c359f00-f4b7-43c3-8454-364842893779 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:16:29 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=85141) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 10:16:29 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=85141) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 10:16:29 user nova-compute[85141]: DEBUG nova.scheduler.client.report [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Refreshing inventories for resource provider bf8e0fa1-16b6-408f-9203-c4cd63916272 {{(pid=85141) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 16 10:16:29 user nova-compute[85141]: DEBUG nova.scheduler.client.report [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Updating ProviderTree inventory for provider bf8e0fa1-16b6-408f-9203-c4cd63916272 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=85141) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 16 10:16:29 user nova-compute[85141]: DEBUG nova.compute.provider_tree [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Updating inventory in ProviderTree for provider bf8e0fa1-16b6-408f-9203-c4cd63916272 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=85141) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 16 10:16:29 user nova-compute[85141]: DEBUG nova.scheduler.client.report [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Refreshing aggregate associations for resource provider bf8e0fa1-16b6-408f-9203-c4cd63916272, aggregates: None {{(pid=85141) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 16 10:16:29 user nova-compute[85141]: DEBUG nova.scheduler.client.report [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Refreshing trait associations for resource provider bf8e0fa1-16b6-408f-9203-c4cd63916272, traits: COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE41,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_ACCELERATORS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_USB,COMPUTE_TRUSTED_CERTS,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_RESCUE_BFV,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VOLUME_ATTACH_WITH_TAG {{(pid=85141) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 16 10:16:29 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] Searching for a device in session 21 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=85141) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 10:16:29 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:ef975afa-7705-454b-88d3-798b0a74dbb9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KEWyzSCs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=85141) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 10:16:29 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.382s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 10:16:29 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] <== connect_volume: return (1383ms) {'type': 'block', 'scsi_wwn': '23033383739383931', 'path': '/dev/sdd'} {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 10:16:29 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] [instance: 0c359f00-f4b7-43c3-8454-364842893779] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23033383739383931', 'path': '/dev/sdd'} {{(pid=85141) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 10:16:29 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] [instance: 0c359f00-f4b7-43c3-8454-364842893779] Calling os-brick to attach iSCSI Volume {{(pid=85141) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 10:16:29 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51806b6080>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:030d6106-e7ec-4eb8-9642-b64a4685f6bb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vPKFhqwg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 10:16:29 user nova-compute[85141]: WARNING os_brick.initiator.connectors.base [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 10:16:29 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 10:16:29 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 10:16:29 user nova-compute[85141]: WARNING os_brick.initiator.connectors.base [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 10:16:29 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:030d6106-e7ec-4eb8-9642-b64a4685f6bb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 10:16:29 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:030d6106-e7ec-4eb8-9642-b64a4685f6bb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 10:16:29 user nova-compute[85141]: INFO os_brick.initiator.connectors.iscsi [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 10:16:29 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:030d6106-e7ec-4eb8-9642-b64a4685f6bb -p 172.16.0.220:3260 {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:16:30 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:030d6106-e7ec-4eb8-9642-b64a4685f6bb -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:16:30 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fb2eafa-fcf9-4511-a6c7-3ef2150117eb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:16:30 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 10:16:30 user nova-compute[85141]:  {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:16:30 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:030d6106-e7ec-4eb8-9642-b64a4685f6bb -p 172.16.0.220:3260 --interface default --op new {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:16:30 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:030d6106-e7ec-4eb8-9642-b64a4685f6bb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:16:30 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[b71258a9-4a5b-4ea3-9781-5f35862f8c45]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:030d6106-e7ec-4eb8-9642-b64a4685f6bb] added\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:16:30 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:030d6106-e7ec-4eb8-9642-b64a4685f6bb] added
Nov 16 10:16:30 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:16:30 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:030d6106-e7ec-4eb8-9642-b64a4685f6bb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:16:30 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:030d6106-e7ec-4eb8-9642-b64a4685f6bb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:16:30 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[50a90a0f-1e09-439e-9b6c-9cf4ca9625d6]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:16:30 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:16:30 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:030d6106-e7ec-4eb8-9642-b64a4685f6bb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:16:30 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:030d6106-e7ec-4eb8-9642-b64a4685f6bb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:16:30 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3f0c2d2-4974-49fe-9881-82bc580828e2]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:16:30 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:16:30 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:030d6106-e7ec-4eb8-9642-b64a4685f6bb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vPKFhqwg {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:16:30 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:030d6106-e7ec-4eb8-9642-b64a4685f6bb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vPKFhqwg" returned: 0 in 0.020s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:16:30 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[35620951-59ed-49e7-aea7-eaaedf213f2a]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:16:30 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vPKFhqwg'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:16:30 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:030d6106-e7ec-4eb8-9642-b64a4685f6bb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:16:30 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:030d6106-e7ec-4eb8-9642-b64a4685f6bb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:16:30 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0803829-c06a-474f-8844-2b4a6f486b1a]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:16:30 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:16:30 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:16:30 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:16:30 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ce2361b-be79-4ffe-af64-2b7c28fc417a]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fa41a79-b1fc-4047-9ae9-f674f348378f (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef975afa-7705-454b-88d3-798b0a74dbb9 (non-flash)\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:16:30 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)
Nov 16 10:16:30 user nova-compute[85141]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fa41a79-b1fc-4047-9ae9-f674f348378f (non-flash)
Nov 16 10:16:30 user nova-compute[85141]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef975afa-7705-454b-88d3-798b0a74dbb9 (non-flash)
Nov 16 10:16:30 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:16:30 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)
Nov 16 10:16:30 user nova-compute[85141]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fa41a79-b1fc-4047-9ae9-f674f348378f (non-flash)
Nov 16 10:16:30 user nova-compute[85141]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef975afa-7705-454b-88d3-798b0a74dbb9 (non-flash)
Nov 16 10:16:30 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 10:16:30 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:030d6106-e7ec-4eb8-9642-b64a4685f6bb -p 172.16.0.220:3260 --login {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:16:30 user nova-compute[85141]: DEBUG nova.compute.provider_tree [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Inventory has not changed in ProviderTree for provider: bf8e0fa1-16b6-408f-9203-c4cd63916272 {{(pid=85141) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 10:16:30 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:030d6106-e7ec-4eb8-9642-b64a4685f6bb -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:16:30 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc17ec62-44f8-4bdc-af11-c6aaa9310aa1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:030d6106-e7ec-4eb8-9642-b64a4685f6bb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:030d6106-e7ec-4eb8-9642-b64a4685f6bb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:16:30 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:030d6106-e7ec-4eb8-9642-b64a4685f6bb, portal: 172.16.0.220,3260]
Nov 16 10:16:30 user nova-compute[85141]: Login to [iface: default, target: iqn.2010-10.org.openstack:030d6106-e7ec-4eb8-9642-b64a4685f6bb, portal: 172.16.0.220,3260] successful.
Nov 16 10:16:30 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:16:30 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:030d6106-e7ec-4eb8-9642-b64a4685f6bb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:16:30 user nova-compute[85141]: DEBUG nova.scheduler.client.report [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Inventory has not changed for provider bf8e0fa1-16b6-408f-9203-c4cd63916272 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=85141) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 10:16:30 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:030d6106-e7ec-4eb8-9642-b64a4685f6bb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:16:30 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f30fe5f-e98d-4784-b422-5a8dc0712c72]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:16:30 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:16:30 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:16:30 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Compute_service record updated for user:user {{(pid=85141) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 10:16:30 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.766s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:16:30 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:16:30 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[facac5ca-2eae-44c9-9aa8-ba34d542818f]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fa41a79-b1fc-4047-9ae9-f674f348378f (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef975afa-7705-454b-88d3-798b0a74dbb9 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:030d6106-e7ec-4eb8-9642-b64a4685f6bb (non-flash)\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:16:30 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)
Nov 16 10:16:30 user nova-compute[85141]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fa41a79-b1fc-4047-9ae9-f674f348378f (non-flash)
Nov 16 10:16:30 user nova-compute[85141]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef975afa-7705-454b-88d3-798b0a74dbb9 (non-flash)
Nov 16 10:16:30 user nova-compute[85141]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:030d6106-e7ec-4eb8-9642-b64a4685f6bb (non-flash)
Nov 16 10:16:30 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:16:30 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)
Nov 16 10:16:30 user nova-compute[85141]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fa41a79-b1fc-4047-9ae9-f674f348378f (non-flash)
Nov 16 10:16:30 user nova-compute[85141]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef975afa-7705-454b-88d3-798b0a74dbb9 (non-flash)
Nov 16 10:16:30 user nova-compute[85141]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:030d6106-e7ec-4eb8-9642-b64a4685f6bb (non-flash)
Nov 16 10:16:30 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 10:16:30 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:030d6106-e7ec-4eb8-9642-b64a4685f6bb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.323s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 10:16:30 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] Connected to 172.16.0.220:3260 {{(pid=85141) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 10:16:30 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] HCTL ('36', '-', '-', 0) found on session 22 with lun 0 {{(pid=85141) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 10:16:30 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=85141) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 10:16:30 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:16:30 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:16:30 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4b7c8cf-ee84-42a8-85c1-14b1aca3dddd]: (4, ('- - 0', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:16:30 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] Searching for a device in session 22 and hctl ['36', '*', '*', 0] yield: None {{(pid=85141) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 10:16:31 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] Searching for a device in session 22 and hctl ['36', '*', '*', 0] yield: sde {{(pid=85141) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 10:16:31 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:030d6106-e7ec-4eb8-9642-b64a4685f6bb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vPKFhqwg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=85141) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 10:16:31 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.355s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 10:16:31 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] <== connect_volume: return (1356ms) {'type': 'block', 'scsi_wwn': '26638623666383062', 'path': '/dev/sde'} {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 10:16:31 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] [instance: 0c359f00-f4b7-43c3-8454-364842893779] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26638623666383062', 'path': '/dev/sde'} {{(pid=85141) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 10:16:31 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T10:16:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2082484665',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2082484665',id=20,image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKrh2Bof78f1GbJ8gbebS4oyTSP8WglgJTFEydBYPe1tDZFGM71mwkIVvhvKHeqCxlHAP/OJrMQQa+0/ZND/hwmjTMgKHnoGjCJWqCZRpPKiQjDx27A4g/dcEbVlvqH96g==',key_name='tempest-keypair-1313405448',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='92b768cf0f234b5da6d29450a58ce8e7',ramdisk_id='',reservation_id='r-lbhzqlsr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1698183890',owner_user_name='tempest-TaggedBootDevicesTest-1698183890-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T10:16:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9fd70ad0794943a7b93eced34e17aa4d',uuid=0c359f00-f4b7-43c3-8454-364842893779,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "97833d7f-68d7-4a6a-a283-83744d5afd10", "address": "fa:16:3e:b6:30:ac", "network": {"id": "cfb2308f-7c88-4329-a72d-4253cbbaca17", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1320471327-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92b768cf0f234b5da6d29450a58ce8e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97833d7f-68", "ovs_interfaceid": "97833d7f-68d7-4a6a-a283-83744d5afd10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=85141) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 10:16:31 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] Converting VIF {"id": "97833d7f-68d7-4a6a-a283-83744d5afd10", "address": "fa:16:3e:b6:30:ac", "network": {"id": "cfb2308f-7c88-4329-a72d-4253cbbaca17", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1320471327-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92b768cf0f234b5da6d29450a58ce8e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97833d7f-68", "ovs_interfaceid": "97833d7f-68d7-4a6a-a283-83744d5afd10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:16:31 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b6:30:ac,bridge_name='br-int',has_traffic_filtering=True,id=97833d7f-68d7-4a6a-a283-83744d5afd10,network=Network(cfb2308f-7c88-4329-a72d-4253cbbaca17),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97833d7f-68') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:16:31 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T10:16:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2082484665',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2082484665',id=20,image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKrh2Bof78f1GbJ8gbebS4oyTSP8WglgJTFEydBYPe1tDZFGM71mwkIVvhvKHeqCxlHAP/OJrMQQa+0/ZND/hwmjTMgKHnoGjCJWqCZRpPKiQjDx27A4g/dcEbVlvqH96g==',key_name='tempest-keypair-1313405448',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='92b768cf0f234b5da6d29450a58ce8e7',ramdisk_id='',reservation_id='r-lbhzqlsr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1698183890',owner_user_name='tempest-TaggedBootDevicesTest-1698183890-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T10:16:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9fd70ad0794943a7b93eced34e17aa4d',uuid=0c359f00-f4b7-43c3-8454-364842893779,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "da46c331-8f37-4473-9c17-7bcb1c691b65", "address": "fa:16:3e:c7:5e:17", "network": {"id": "90bcfce1-33ea-4029-aa72-93b729655e77", "bridge": "br-int", "label": "tempest-device-tagging-net1-660308139", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.209", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "92b768cf0f234b5da6d29450a58ce8e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda46c331-8f", "ovs_interfaceid": "da46c331-8f37-4473-9c17-7bcb1c691b65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=85141) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 10:16:31 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] Converting VIF {"id": "da46c331-8f37-4473-9c17-7bcb1c691b65", "address": "fa:16:3e:c7:5e:17", "network": {"id": "90bcfce1-33ea-4029-aa72-93b729655e77", "bridge": "br-int", "label": "tempest-device-tagging-net1-660308139", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.209", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "92b768cf0f234b5da6d29450a58ce8e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda46c331-8f", "ovs_interfaceid": "da46c331-8f37-4473-9c17-7bcb1c691b65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:16:31 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c7:5e:17,bridge_name='br-int',has_traffic_filtering=True,id=da46c331-8f37-4473-9c17-7bcb1c691b65,network=Network(90bcfce1-33ea-4029-aa72-93b729655e77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapda46c331-8f') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:16:31 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T10:16:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2082484665',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2082484665',id=20,image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKrh2Bof78f1GbJ8gbebS4oyTSP8WglgJTFEydBYPe1tDZFGM71mwkIVvhvKHeqCxlHAP/OJrMQQa+0/ZND/hwmjTMgKHnoGjCJWqCZRpPKiQjDx27A4g/dcEbVlvqH96g==',key_name='tempest-keypair-1313405448',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='92b768cf0f234b5da6d29450a58ce8e7',ramdisk_id='',reservation_id='r-lbhzqlsr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1698183890',owner_user_name='tempest-TaggedBootDevicesTest-1698183890-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T10:16:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9fd70ad0794943a7b93eced34e17aa4d',uuid=0c359f00-f4b7-43c3-8454-364842893779,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5b1acf97-626c-4014-b463-5b4455f0f1e6", "address": "fa:16:3e:0b:c9:63", "network": {"id": "90bcfce1-33ea-4029-aa72-93b729655e77", "bridge": "br-int", "label": "tempest-device-tagging-net1-660308139", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.15", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "92b768cf0f234b5da6d29450a58ce8e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b1acf97-62", "ovs_interfaceid": "5b1acf97-626c-4014-b463-5b4455f0f1e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=85141) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 10:16:31 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] Converting VIF {"id": "5b1acf97-626c-4014-b463-5b4455f0f1e6", "address": "fa:16:3e:0b:c9:63", "network": {"id": "90bcfce1-33ea-4029-aa72-93b729655e77", "bridge": "br-int", "label": "tempest-device-tagging-net1-660308139", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.15", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "92b768cf0f234b5da6d29450a58ce8e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b1acf97-62", "ovs_interfaceid": "5b1acf97-626c-4014-b463-5b4455f0f1e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:16:31 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0b:c9:63,bridge_name='br-int',has_traffic_filtering=True,id=5b1acf97-626c-4014-b463-5b4455f0f1e6,network=Network(90bcfce1-33ea-4029-aa72-93b729655e77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5b1acf97-62') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:16:31 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T10:16:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2082484665',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2082484665',id=20,image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKrh2Bof78f1GbJ8gbebS4oyTSP8WglgJTFEydBYPe1tDZFGM71mwkIVvhvKHeqCxlHAP/OJrMQQa+0/ZND/hwmjTMgKHnoGjCJWqCZRpPKiQjDx27A4g/dcEbVlvqH96g==',key_name='tempest-keypair-1313405448',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='92b768cf0f234b5da6d29450a58ce8e7',ramdisk_id='',reservation_id='r-lbhzqlsr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1698183890',owner_user_name='tempest-TaggedBootDevicesTest-1698183890-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T10:16:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9fd70ad0794943a7b93eced34e17aa4d',uuid=0c359f00-f4b7-43c3-8454-364842893779,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2243117f-44a8-4d51-8676-d67748b3c9aa", "address": "fa:16:3e:87:12:47", "network": {"id": "90bcfce1-33ea-4029-aa72-93b729655e77", "bridge": "br-int", "label": "tempest-device-tagging-net1-660308139", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.140", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "92b768cf0f234b5da6d29450a58ce8e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2243117f-44", "ovs_interfaceid": "2243117f-44a8-4d51-8676-d67748b3c9aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=85141) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 10:16:31 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] Converting VIF {"id": "2243117f-44a8-4d51-8676-d67748b3c9aa", "address": "fa:16:3e:87:12:47", "network": {"id": "90bcfce1-33ea-4029-aa72-93b729655e77", "bridge": "br-int", "label": "tempest-device-tagging-net1-660308139", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.140", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "92b768cf0f234b5da6d29450a58ce8e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2243117f-44", "ovs_interfaceid": "2243117f-44a8-4d51-8676-d67748b3c9aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:16:31 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:12:47,bridge_name='br-int',has_traffic_filtering=True,id=2243117f-44a8-4d51-8676-d67748b3c9aa,network=Network(90bcfce1-33ea-4029-aa72-93b729655e77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2243117f-44') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:16:31 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T10:16:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2082484665',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2082484665',id=20,image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKrh2Bof78f1GbJ8gbebS4oyTSP8WglgJTFEydBYPe1tDZFGM71mwkIVvhvKHeqCxlHAP/OJrMQQa+0/ZND/hwmjTMgKHnoGjCJWqCZRpPKiQjDx27A4g/dcEbVlvqH96g==',key_name='tempest-keypair-1313405448',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='92b768cf0f234b5da6d29450a58ce8e7',ramdisk_id='',reservation_id='r-lbhzqlsr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1698183890',owner_user_name='tempest-TaggedBootDevicesTest-1698183890-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T10:16:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9fd70ad0794943a7b93eced34e17aa4d',uuid=0c359f00-f4b7-43c3-8454-364842893779,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6d48ae8e-004c-459d-ad7c-081cc9228fee", "address": "fa:16:3e:49:c2:7d", "network": {"id": "90bcfce1-33ea-4029-aa72-93b729655e77", "bridge": "br-int", "label": "tempest-device-tagging-net1-660308139", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "92b768cf0f234b5da6d29450a58ce8e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d48ae8e-00", "ovs_interfaceid": "6d48ae8e-004c-459d-ad7c-081cc9228fee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=85141) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 10:16:31 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] Converting VIF {"id": "6d48ae8e-004c-459d-ad7c-081cc9228fee", "address": "fa:16:3e:49:c2:7d", "network": {"id": "90bcfce1-33ea-4029-aa72-93b729655e77", "bridge": "br-int", "label": "tempest-device-tagging-net1-660308139", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "92b768cf0f234b5da6d29450a58ce8e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d48ae8e-00", "ovs_interfaceid": "6d48ae8e-004c-459d-ad7c-081cc9228fee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:16:31 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:49:c2:7d,bridge_name='br-int',has_traffic_filtering=True,id=6d48ae8e-004c-459d-ad7c-081cc9228fee,network=Network(90bcfce1-33ea-4029-aa72-93b729655e77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d48ae8e-00') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:16:31 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T10:16:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2082484665',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2082484665',id=20,image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKrh2Bof78f1GbJ8gbebS4oyTSP8WglgJTFEydBYPe1tDZFGM71mwkIVvhvKHeqCxlHAP/OJrMQQa+0/ZND/hwmjTMgKHnoGjCJWqCZRpPKiQjDx27A4g/dcEbVlvqH96g==',key_name='tempest-keypair-1313405448',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='92b768cf0f234b5da6d29450a58ce8e7',ramdisk_id='',reservation_id='r-lbhzqlsr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1698183890',owner_user_name='tempest-TaggedBootDevicesTest-1698183890-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T10:16:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9fd70ad0794943a7b93eced34e17aa4d',uuid=0c359f00-f4b7-43c3-8454-364842893779,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8a0146a0-20fd-4879-be20-c8732bd6563c", "address": "fa:16:3e:6d:38:4b", "network": {"id": "054ba1f8-e55e-4af1-a668-c4e247430926", "bridge": "br-int", "label": "tempest-device-tagging-net2-1758238013", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "92b768cf0f234b5da6d29450a58ce8e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a0146a0-20", "ovs_interfaceid": "8a0146a0-20fd-4879-be20-c8732bd6563c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=85141) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 10:16:31 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] Converting VIF {"id": "8a0146a0-20fd-4879-be20-c8732bd6563c", "address": "fa:16:3e:6d:38:4b", "network": {"id": "054ba1f8-e55e-4af1-a668-c4e247430926", "bridge": "br-int", "label": "tempest-device-tagging-net2-1758238013", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "92b768cf0f234b5da6d29450a58ce8e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a0146a0-20", "ovs_interfaceid": "8a0146a0-20fd-4879-be20-c8732bd6563c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:16:31 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:38:4b,bridge_name='br-int',has_traffic_filtering=True,id=8a0146a0-20fd-4879-be20-c8732bd6563c,network=Network(054ba1f8-e55e-4af1-a668-c4e247430926),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a0146a0-20') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:16:31 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T10:16:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2082484665',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2082484665',id=20,image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKrh2Bof78f1GbJ8gbebS4oyTSP8WglgJTFEydBYPe1tDZFGM71mwkIVvhvKHeqCxlHAP/OJrMQQa+0/ZND/hwmjTMgKHnoGjCJWqCZRpPKiQjDx27A4g/dcEbVlvqH96g==',key_name='tempest-keypair-1313405448',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='92b768cf0f234b5da6d29450a58ce8e7',ramdisk_id='',reservation_id='r-lbhzqlsr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1698183890',owner_user_name='tempest-TaggedBootDevicesTest-1698183890-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T10:16:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9fd70ad0794943a7b93eced34e17aa4d',uuid=0c359f00-f4b7-43c3-8454-364842893779,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "450233b4-a16d-4b2d-bc6a-a87736db7ff4", "address": "fa:16:3e:fe:ae:28", "network": {"id": "054ba1f8-e55e-4af1-a668-c4e247430926", "bridge": "br-int", "label": "tempest-device-tagging-net2-1758238013", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "92b768cf0f234b5da6d29450a58ce8e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap450233b4-a1", "ovs_interfaceid": "450233b4-a16d-4b2d-bc6a-a87736db7ff4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=85141) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 10:16:31 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] Converting VIF {"id": "450233b4-a16d-4b2d-bc6a-a87736db7ff4", "address": "fa:16:3e:fe:ae:28", "network": {"id": "054ba1f8-e55e-4af1-a668-c4e247430926", "bridge": "br-int", "label": "tempest-device-tagging-net2-1758238013", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "92b768cf0f234b5da6d29450a58ce8e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap450233b4-a1", "ovs_interfaceid": "450233b4-a16d-4b2d-bc6a-a87736db7ff4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:16:31 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fe:ae:28,bridge_name='br-int',has_traffic_filtering=True,id=450233b4-a16d-4b2d-bc6a-a87736db7ff4,network=Network(054ba1f8-e55e-4af1-a668-c4e247430926),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap450233b4-a1') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:16:31 user nova-compute[85141]: DEBUG nova.objects.instance [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] Lazy-loading 'pci_devices' on Instance uuid 0c359f00-f4b7-43c3-8454-364842893779 {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:16:31 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] [instance: 0c359f00-f4b7-43c3-8454-364842893779] End _get_guest_xml xml=<domain type="kvm">
Nov 16 10:16:31 user nova-compute[85141]:   <uuid>0c359f00-f4b7-43c3-8454-364842893779</uuid>
Nov 16 10:16:31 user nova-compute[85141]:   <name>instance-00000014</name>
Nov 16 10:16:31 user nova-compute[85141]:   <memory>524288</memory>
Nov 16 10:16:31 user nova-compute[85141]:   <vcpu>1</vcpu>
Nov 16 10:16:31 user nova-compute[85141]:   <metadata>
Nov 16 10:16:31 user nova-compute[85141]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 10:16:31 user nova-compute[85141]:       <nova:package version="0.0.0"/>
Nov 16 10:16:31 user nova-compute[85141]:       <nova:name>tempest-device-tagging-server-2082484665</nova:name>
Nov 16 10:16:31 user nova-compute[85141]:       <nova:creationTime>2023-11-16 10:16:27</nova:creationTime>
Nov 16 10:16:31 user nova-compute[85141]:       <nova:flavor name="m1.tiny">
Nov 16 10:16:31 user nova-compute[85141]:         <nova:memory>512</nova:memory>
Nov 16 10:16:31 user nova-compute[85141]:         <nova:disk>1</nova:disk>
Nov 16 10:16:31 user nova-compute[85141]:         <nova:swap>0</nova:swap>
Nov 16 10:16:31 user nova-compute[85141]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 10:16:31 user nova-compute[85141]:         <nova:vcpus>1</nova:vcpus>
Nov 16 10:16:31 user nova-compute[85141]:       </nova:flavor>
Nov 16 10:16:31 user nova-compute[85141]:       <nova:owner>
Nov 16 10:16:31 user nova-compute[85141]:         <nova:user uuid="9fd70ad0794943a7b93eced34e17aa4d">tempest-TaggedBootDevicesTest-1698183890-project-member</nova:user>
Nov 16 10:16:31 user nova-compute[85141]:         <nova:project uuid="92b768cf0f234b5da6d29450a58ce8e7">tempest-TaggedBootDevicesTest-1698183890</nova:project>
Nov 16 10:16:31 user nova-compute[85141]:       </nova:owner>
Nov 16 10:16:31 user nova-compute[85141]:       <nova:root type="image" uuid="bc4ca70f-a459-4d5c-a9e6-80f1948eb48b"/>
Nov 16 10:16:31 user nova-compute[85141]:       <nova:ports>
Nov 16 10:16:31 user nova-compute[85141]:         <nova:port uuid="97833d7f-68d7-4a6a-a283-83744d5afd10">
Nov 16 10:16:31 user nova-compute[85141]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 16 10:16:31 user nova-compute[85141]:         </nova:port>
Nov 16 10:16:31 user nova-compute[85141]:         <nova:port uuid="da46c331-8f37-4473-9c17-7bcb1c691b65">
Nov 16 10:16:31 user nova-compute[85141]:           <nova:ip type="fixed" address="10.1.1.209" ipVersion="4"/>
Nov 16 10:16:31 user nova-compute[85141]:         </nova:port>
Nov 16 10:16:31 user nova-compute[85141]:         <nova:port uuid="5b1acf97-626c-4014-b463-5b4455f0f1e6">
Nov 16 10:16:31 user nova-compute[85141]:           <nova:ip type="fixed" address="10.1.1.15" ipVersion="4"/>
Nov 16 10:16:31 user nova-compute[85141]:         </nova:port>
Nov 16 10:16:31 user nova-compute[85141]:         <nova:port uuid="2243117f-44a8-4d51-8676-d67748b3c9aa">
Nov 16 10:16:31 user nova-compute[85141]:           <nova:ip type="fixed" address="10.1.1.140" ipVersion="4"/>
Nov 16 10:16:31 user nova-compute[85141]:         </nova:port>
Nov 16 10:16:31 user nova-compute[85141]:         <nova:port uuid="6d48ae8e-004c-459d-ad7c-081cc9228fee">
Nov 16 10:16:31 user nova-compute[85141]:           <nova:ip type="fixed" address="10.1.1.208" ipVersion="4"/>
Nov 16 10:16:31 user nova-compute[85141]:         </nova:port>
Nov 16 10:16:31 user nova-compute[85141]:         <nova:port uuid="8a0146a0-20fd-4879-be20-c8732bd6563c">
Nov 16 10:16:31 user nova-compute[85141]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Nov 16 10:16:31 user nova-compute[85141]:         </nova:port>
Nov 16 10:16:31 user nova-compute[85141]:         <nova:port uuid="450233b4-a16d-4b2d-bc6a-a87736db7ff4">
Nov 16 10:16:31 user nova-compute[85141]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Nov 16 10:16:31 user nova-compute[85141]:         </nova:port>
Nov 16 10:16:31 user nova-compute[85141]:       </nova:ports>
Nov 16 10:16:31 user nova-compute[85141]:     </nova:instance>
Nov 16 10:16:31 user nova-compute[85141]:   </metadata>
Nov 16 10:16:31 user nova-compute[85141]:   <sysinfo type="smbios">
Nov 16 10:16:31 user nova-compute[85141]:     <system>
Nov 16 10:16:31 user nova-compute[85141]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 10:16:31 user nova-compute[85141]:       <entry name="product">OpenStack Nova</entry>
Nov 16 10:16:31 user nova-compute[85141]:       <entry name="version">0.0.0</entry>
Nov 16 10:16:31 user nova-compute[85141]:       <entry name="serial">0c359f00-f4b7-43c3-8454-364842893779</entry>
Nov 16 10:16:31 user nova-compute[85141]:       <entry name="uuid">0c359f00-f4b7-43c3-8454-364842893779</entry>
Nov 16 10:16:31 user nova-compute[85141]:       <entry name="family">Virtual Machine</entry>
Nov 16 10:16:31 user nova-compute[85141]:     </system>
Nov 16 10:16:31 user nova-compute[85141]:   </sysinfo>
Nov 16 10:16:31 user nova-compute[85141]:   <os>
Nov 16 10:16:31 user nova-compute[85141]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 10:16:31 user nova-compute[85141]:     <boot dev="hd"/>
Nov 16 10:16:31 user nova-compute[85141]:     <smbios mode="sysinfo"/>
Nov 16 10:16:31 user nova-compute[85141]:   </os>
Nov 16 10:16:31 user nova-compute[85141]:   <features>
Nov 16 10:16:31 user nova-compute[85141]:     <acpi/>
Nov 16 10:16:31 user nova-compute[85141]:     <apic/>
Nov 16 10:16:31 user nova-compute[85141]:     <vmcoreinfo/>
Nov 16 10:16:31 user nova-compute[85141]:   </features>
Nov 16 10:16:31 user nova-compute[85141]:   <clock offset="utc">
Nov 16 10:16:31 user nova-compute[85141]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 10:16:31 user nova-compute[85141]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 10:16:31 user nova-compute[85141]:     <timer name="hpet" present="no"/>
Nov 16 10:16:31 user nova-compute[85141]:   </clock>
Nov 16 10:16:31 user nova-compute[85141]:   <cpu mode="custom" match="exact">
Nov 16 10:16:31 user nova-compute[85141]:     <model>Nehalem</model>
Nov 16 10:16:31 user nova-compute[85141]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 10:16:31 user nova-compute[85141]:   </cpu>
Nov 16 10:16:31 user nova-compute[85141]:   <devices>
Nov 16 10:16:31 user nova-compute[85141]:     <disk type="file" device="cdrom">
Nov 16 10:16:31 user nova-compute[85141]:       <driver name="qemu" type="raw" cache="none"/>
Nov 16 10:16:31 user nova-compute[85141]:       <source file="/opt/stack/data/nova/instances/0c359f00-f4b7-43c3-8454-364842893779/disk.config"/>
Nov 16 10:16:31 user nova-compute[85141]:       <target dev="hda" bus="ide"/>
Nov 16 10:16:31 user nova-compute[85141]:     </disk>
Nov 16 10:16:31 user nova-compute[85141]:     <disk type="block" device="disk">
Nov 16 10:16:31 user nova-compute[85141]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 10:16:31 user nova-compute[85141]:       <source dev="/dev/sdb"/>
Nov 16 10:16:31 user nova-compute[85141]:       <target dev="vda" bus="virtio"/>
Nov 16 10:16:31 user nova-compute[85141]:       <serial>1fa41a79-b1fc-4047-9ae9-f674f348378f</serial>
Nov 16 10:16:31 user nova-compute[85141]:     </disk>
Nov 16 10:16:31 user nova-compute[85141]:     <disk type="block" device="disk">
Nov 16 10:16:31 user nova-compute[85141]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 10:16:31 user nova-compute[85141]:       <source dev="/dev/sdd"/>
Nov 16 10:16:31 user nova-compute[85141]:       <target dev="vdb" bus="virtio"/>
Nov 16 10:16:31 user nova-compute[85141]:       <serial>ef975afa-7705-454b-88d3-798b0a74dbb9</serial>
Nov 16 10:16:31 user nova-compute[85141]:     </disk>
Nov 16 10:16:31 user nova-compute[85141]:     <disk type="block" device="disk">
Nov 16 10:16:31 user nova-compute[85141]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 10:16:31 user nova-compute[85141]:       <source dev="/dev/sde"/>
Nov 16 10:16:31 user nova-compute[85141]:       <target dev="vdc" bus="virtio"/>
Nov 16 10:16:31 user nova-compute[85141]:       <serial>030d6106-e7ec-4eb8-9642-b64a4685f6bb</serial>
Nov 16 10:16:31 user nova-compute[85141]:     </disk>
Nov 16 10:16:31 user nova-compute[85141]:     <interface type="ethernet">
Nov 16 10:16:31 user nova-compute[85141]:       <mac address="fa:16:3e:b6:30:ac"/>
Nov 16 10:16:31 user nova-compute[85141]:       <model type="virtio"/>
Nov 16 10:16:31 user nova-compute[85141]:       <mtu size="1442"/>
Nov 16 10:16:31 user nova-compute[85141]:       <target dev="tap97833d7f-68"/>
Nov 16 10:16:31 user nova-compute[85141]:     </interface>
Nov 16 10:16:31 user nova-compute[85141]:     <interface type="ethernet">
Nov 16 10:16:31 user nova-compute[85141]:       <mac address="fa:16:3e:c7:5e:17"/>
Nov 16 10:16:31 user nova-compute[85141]:       <model type="virtio"/>
Nov 16 10:16:31 user nova-compute[85141]:       <mtu size="1442"/>
Nov 16 10:16:31 user nova-compute[85141]:       <target dev="tapda46c331-8f"/>
Nov 16 10:16:31 user nova-compute[85141]:     </interface>
Nov 16 10:16:31 user nova-compute[85141]:     <interface type="ethernet">
Nov 16 10:16:31 user nova-compute[85141]:       <mac address="fa:16:3e:0b:c9:63"/>
Nov 16 10:16:31 user nova-compute[85141]:       <model type="virtio"/>
Nov 16 10:16:31 user nova-compute[85141]:       <mtu size="1442"/>
Nov 16 10:16:31 user nova-compute[85141]:       <target dev="tap5b1acf97-62"/>
Nov 16 10:16:31 user nova-compute[85141]:     </interface>
Nov 16 10:16:31 user nova-compute[85141]:     <interface type="ethernet">
Nov 16 10:16:31 user nova-compute[85141]:       <mac address="fa:16:3e:87:12:47"/>
Nov 16 10:16:31 user nova-compute[85141]:       <model type="virtio"/>
Nov 16 10:16:31 user nova-compute[85141]:       <mtu size="1442"/>
Nov 16 10:16:31 user nova-compute[85141]:       <target dev="tap2243117f-44"/>
Nov 16 10:16:31 user nova-compute[85141]:     </interface>
Nov 16 10:16:31 user nova-compute[85141]:     <interface type="ethernet">
Nov 16 10:16:31 user nova-compute[85141]:       <mac address="fa:16:3e:49:c2:7d"/>
Nov 16 10:16:31 user nova-compute[85141]:       <model type="virtio"/>
Nov 16 10:16:31 user nova-compute[85141]:       <mtu size="1442"/>
Nov 16 10:16:31 user nova-compute[85141]:       <target dev="tap6d48ae8e-00"/>
Nov 16 10:16:31 user nova-compute[85141]:     </interface>
Nov 16 10:16:31 user nova-compute[85141]:     <interface type="ethernet">
Nov 16 10:16:31 user nova-compute[85141]:       <mac address="fa:16:3e:6d:38:4b"/>
Nov 16 10:16:31 user nova-compute[85141]:       <model type="virtio"/>
Nov 16 10:16:31 user nova-compute[85141]:       <mtu size="1442"/>
Nov 16 10:16:31 user nova-compute[85141]:       <target dev="tap8a0146a0-20"/>
Nov 16 10:16:31 user nova-compute[85141]:     </interface>
Nov 16 10:16:31 user nova-compute[85141]:     <interface type="ethernet">
Nov 16 10:16:31 user nova-compute[85141]:       <mac address="fa:16:3e:fe:ae:28"/>
Nov 16 10:16:31 user nova-compute[85141]:       <model type="virtio"/>
Nov 16 10:16:31 user nova-compute[85141]:       <mtu size="1442"/>
Nov 16 10:16:31 user nova-compute[85141]:       <target dev="tap450233b4-a1"/>
Nov 16 10:16:31 user nova-compute[85141]:     </interface>
Nov 16 10:16:31 user nova-compute[85141]:     <serial type="pty">
Nov 16 10:16:31 user nova-compute[85141]:       <log file="/opt/stack/data/nova/instances/0c359f00-f4b7-43c3-8454-364842893779/console.log" append="off"/>
Nov 16 10:16:31 user nova-compute[85141]:     </serial>
Nov 16 10:16:31 user nova-compute[85141]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 10:16:31 user nova-compute[85141]:     <video>
Nov 16 10:16:31 user nova-compute[85141]:       <model type="virtio"/>
Nov 16 10:16:31 user nova-compute[85141]:     </video>
Nov 16 10:16:31 user nova-compute[85141]:     <rng model="virtio">
Nov 16 10:16:31 user nova-compute[85141]:       <backend model="random">/dev/urandom</backend>
Nov 16 10:16:31 user nova-compute[85141]:     </rng>
Nov 16 10:16:31 user nova-compute[85141]:     <controller type="usb" index="0" model="none"/>
Nov 16 10:16:31 user nova-compute[85141]:     <memballoon model="virtio">
Nov 16 10:16:31 user nova-compute[85141]:       <stats period="10"/>
Nov 16 10:16:31 user nova-compute[85141]:     </memballoon>
Nov 16 10:16:31 user nova-compute[85141]:   </devices>
Nov 16 10:16:31 user nova-compute[85141]: </domain>
Nov 16 10:16:31 user nova-compute[85141]:  {{(pid=85141) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 10:16:31 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T10:16:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2082484665',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2082484665',id=20,image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKrh2Bof78f1GbJ8gbebS4oyTSP8WglgJTFEydBYPe1tDZFGM71mwkIVvhvKHeqCxlHAP/OJrMQQa+0/ZND/hwmjTMgKHnoGjCJWqCZRpPKiQjDx27A4g/dcEbVlvqH96g==',key_name='tempest-keypair-1313405448',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='92b768cf0f234b5da6d29450a58ce8e7',ramdisk_id='',reservation_id='r-lbhzqlsr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1698183890',owner_user_name='tempest-TaggedBootDevicesTest-1698183890-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T10:16:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9fd70ad0794943a7b93eced34e17aa4d',uuid=0c359f00-f4b7-43c3-8454-364842893779,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "97833d7f-68d7-4a6a-a283-83744d5afd10", "address": "fa:16:3e:b6:30:ac", "network": {"id": "cfb2308f-7c88-4329-a72d-4253cbbaca17", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1320471327-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92b768cf0f234b5da6d29450a58ce8e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97833d7f-68", "ovs_interfaceid": "97833d7f-68d7-4a6a-a283-83744d5afd10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 10:16:31 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] Converting VIF {"id": "97833d7f-68d7-4a6a-a283-83744d5afd10", "address": "fa:16:3e:b6:30:ac", "network": {"id": "cfb2308f-7c88-4329-a72d-4253cbbaca17", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1320471327-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92b768cf0f234b5da6d29450a58ce8e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97833d7f-68", "ovs_interfaceid": "97833d7f-68d7-4a6a-a283-83744d5afd10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:16:31 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b6:30:ac,bridge_name='br-int',has_traffic_filtering=True,id=97833d7f-68d7-4a6a-a283-83744d5afd10,network=Network(cfb2308f-7c88-4329-a72d-4253cbbaca17),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97833d7f-68') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:16:31 user nova-compute[85141]: DEBUG os_vif [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:30:ac,bridge_name='br-int',has_traffic_filtering=True,id=97833d7f-68d7-4a6a-a283-83744d5afd10,network=Network(cfb2308f-7c88-4329-a72d-4253cbbaca17),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97833d7f-68') {{(pid=85141) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 10:16:31 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:16:31 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:16:31 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 10:16:31 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:16:31 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd95d855a-c2f8-5748-8c5f-8a69a1b895c6', '_type': 'linux-noop'}}, row=False) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:16:31 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:16:31 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:16:31 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:16:31 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap97833d7f-68, may_exist=True, interface_attrs={}) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:16:31 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap97833d7f-68, col_values=(('qos', UUID('f5b71170-f99d-486c-8ead-81b60fc92265')),), if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:16:31 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap97833d7f-68, col_values=(('external_ids', {'iface-id': '97833d7f-68d7-4a6a-a283-83744d5afd10', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b6:30:ac', 'vm-uuid': '0c359f00-f4b7-43c3-8454-364842893779'}),), if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:16:31 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:16:31 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:16:31 user nova-compute[85141]: INFO os_vif [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:30:ac,bridge_name='br-int',has_traffic_filtering=True,id=97833d7f-68d7-4a6a-a283-83744d5afd10,network=Network(cfb2308f-7c88-4329-a72d-4253cbbaca17),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97833d7f-68')
Nov 16 10:16:31 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T10:16:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2082484665',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2082484665',id=20,image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKrh2Bof78f1GbJ8gbebS4oyTSP8WglgJTFEydBYPe1tDZFGM71mwkIVvhvKHeqCxlHAP/OJrMQQa+0/ZND/hwmjTMgKHnoGjCJWqCZRpPKiQjDx27A4g/dcEbVlvqH96g==',key_name='tempest-keypair-1313405448',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='92b768cf0f234b5da6d29450a58ce8e7',ramdisk_id='',reservation_id='r-lbhzqlsr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1698183890',owner_user_name='tempest-TaggedBootDevicesTest-1698183890-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T10:16:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9fd70ad0794943a7b93eced34e17aa4d',uuid=0c359f00-f4b7-43c3-8454-364842893779,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "da46c331-8f37-4473-9c17-7bcb1c691b65", "address": "fa:16:3e:c7:5e:17", "network": {"id": "90bcfce1-33ea-4029-aa72-93b729655e77", "bridge": "br-int", "label": "tempest-device-tagging-net1-660308139", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.209", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "92b768cf0f234b5da6d29450a58ce8e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda46c331-8f", "ovs_interfaceid": "da46c331-8f37-4473-9c17-7bcb1c691b65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=85141) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 10:16:31 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] Converting VIF {"id": "da46c331-8f37-4473-9c17-7bcb1c691b65", "address": "fa:16:3e:c7:5e:17", "network": {"id": "90bcfce1-33ea-4029-aa72-93b729655e77", "bridge": "br-int", "label": "tempest-device-tagging-net1-660308139", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.209", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "92b768cf0f234b5da6d29450a58ce8e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda46c331-8f", "ovs_interfaceid": "da46c331-8f37-4473-9c17-7bcb1c691b65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:16:31 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c7:5e:17,bridge_name='br-int',has_traffic_filtering=True,id=da46c331-8f37-4473-9c17-7bcb1c691b65,network=Network(90bcfce1-33ea-4029-aa72-93b729655e77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapda46c331-8f') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:16:31 user nova-compute[85141]: DEBUG os_vif [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:5e:17,bridge_name='br-int',has_traffic_filtering=True,id=da46c331-8f37-4473-9c17-7bcb1c691b65,network=Network(90bcfce1-33ea-4029-aa72-93b729655e77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapda46c331-8f') {{(pid=85141) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 10:16:31 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:16:31 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:16:31 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 10:16:31 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:16:31 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '98816ec7-e9d7-50e0-b5c2-cc7b3838738e', '_type': 'linux-noop'}}, row=False) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:16:31 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:16:31 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:16:31 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:16:31 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:16:31 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapda46c331-8f, may_exist=True, interface_attrs={}) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:16:31 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapda46c331-8f, col_values=(('qos', UUID('d25c8c10-1b4e-4b08-8f3d-91e4add9ba15')),), if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:16:31 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapda46c331-8f, col_values=(('external_ids', {'iface-id': 'da46c331-8f37-4473-9c17-7bcb1c691b65', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c7:5e:17', 'vm-uuid': '0c359f00-f4b7-43c3-8454-364842893779'}),), if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:16:31 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:16:31 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:16:31 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:16:31 user nova-compute[85141]: INFO os_vif [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:5e:17,bridge_name='br-int',has_traffic_filtering=True,id=da46c331-8f37-4473-9c17-7bcb1c691b65,network=Network(90bcfce1-33ea-4029-aa72-93b729655e77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapda46c331-8f')
Nov 16 10:16:31 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T10:16:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2082484665',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2082484665',id=20,image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKrh2Bof78f1GbJ8gbebS4oyTSP8WglgJTFEydBYPe1tDZFGM71mwkIVvhvKHeqCxlHAP/OJrMQQa+0/ZND/hwmjTMgKHnoGjCJWqCZRpPKiQjDx27A4g/dcEbVlvqH96g==',key_name='tempest-keypair-1313405448',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='92b768cf0f234b5da6d29450a58ce8e7',ramdisk_id='',reservation_id='r-lbhzqlsr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1698183890',owner_user_name='tempest-TaggedBootDevicesTest-1698183890-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T10:16:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9fd70ad0794943a7b93eced34e17aa4d',uuid=0c359f00-f4b7-43c3-8454-364842893779,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5b1acf97-626c-4014-b463-5b4455f0f1e6", "address": "fa:16:3e:0b:c9:63", "network": {"id": "90bcfce1-33ea-4029-aa72-93b729655e77", "bridge": "br-int", "label": "tempest-device-tagging-net1-660308139", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.15", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "92b768cf0f234b5da6d29450a58ce8e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b1acf97-62", "ovs_interfaceid": "5b1acf97-626c-4014-b463-5b4455f0f1e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=85141) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 10:16:31 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] Converting VIF {"id": "5b1acf97-626c-4014-b463-5b4455f0f1e6", "address": "fa:16:3e:0b:c9:63", "network": {"id": "90bcfce1-33ea-4029-aa72-93b729655e77", "bridge": "br-int", "label": "tempest-device-tagging-net1-660308139", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.15", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "92b768cf0f234b5da6d29450a58ce8e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b1acf97-62", "ovs_interfaceid": "5b1acf97-626c-4014-b463-5b4455f0f1e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:16:31 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0b:c9:63,bridge_name='br-int',has_traffic_filtering=True,id=5b1acf97-626c-4014-b463-5b4455f0f1e6,network=Network(90bcfce1-33ea-4029-aa72-93b729655e77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5b1acf97-62') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:16:31 user nova-compute[85141]: DEBUG os_vif [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:c9:63,bridge_name='br-int',has_traffic_filtering=True,id=5b1acf97-626c-4014-b463-5b4455f0f1e6,network=Network(90bcfce1-33ea-4029-aa72-93b729655e77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5b1acf97-62') {{(pid=85141) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 10:16:31 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:16:31 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:16:31 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 10:16:31 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:16:31 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd3168ccd-b19a-560b-8e22-fb8242e7ce1e', '_type': 'linux-noop'}}, row=False) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:16:31 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:16:31 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:16:31 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-127e3e43-7166-4514-b043-b0787166f398 tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] Acquiring lock "361a2044-8fd0-4975-8a19-814bf7a6da41" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:16:31 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-127e3e43-7166-4514-b043-b0787166f398 tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] Lock "361a2044-8fd0-4975-8a19-814bf7a6da41" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:16:31 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-127e3e43-7166-4514-b043-b0787166f398 tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] Acquiring lock "361a2044-8fd0-4975-8a19-814bf7a6da41-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:16:31 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-127e3e43-7166-4514-b043-b0787166f398 tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] Lock "361a2044-8fd0-4975-8a19-814bf7a6da41-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:16:31 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-127e3e43-7166-4514-b043-b0787166f398 tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] Lock "361a2044-8fd0-4975-8a19-814bf7a6da41-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:16:31 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:16:31 user nova-compute[85141]: INFO nova.compute.manager [None req-127e3e43-7166-4514-b043-b0787166f398 tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] [instance: 361a2044-8fd0-4975-8a19-814bf7a6da41] Terminating instance
Nov 16 10:16:31 user nova-compute[85141]: DEBUG nova.compute.manager [None req-127e3e43-7166-4514-b043-b0787166f398 tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] [instance: 361a2044-8fd0-4975-8a19-814bf7a6da41] Start destroying the instance on the hypervisor. {{(pid=85141) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 10:16:31 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:16:31 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5b1acf97-62, may_exist=True, interface_attrs={}) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:16:31 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5b1acf97-62, col_values=(('qos', UUID('177396c6-6725-4fb3-bc93-e750e8686dea')),), if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:16:31 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5b1acf97-62, col_values=(('external_ids', {'iface-id': '5b1acf97-626c-4014-b463-5b4455f0f1e6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0b:c9:63', 'vm-uuid': '0c359f00-f4b7-43c3-8454-364842893779'}),), if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:16:31 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:16:31 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:16:31 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:16:31 user nova-compute[85141]: INFO os_vif [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:c9:63,bridge_name='br-int',has_traffic_filtering=True,id=5b1acf97-626c-4014-b463-5b4455f0f1e6,network=Network(90bcfce1-33ea-4029-aa72-93b729655e77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5b1acf97-62')
Nov 16 10:16:31 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T10:16:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2082484665',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2082484665',id=20,image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKrh2Bof78f1GbJ8gbebS4oyTSP8WglgJTFEydBYPe1tDZFGM71mwkIVvhvKHeqCxlHAP/OJrMQQa+0/ZND/hwmjTMgKHnoGjCJWqCZRpPKiQjDx27A4g/dcEbVlvqH96g==',key_name='tempest-keypair-1313405448',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='92b768cf0f234b5da6d29450a58ce8e7',ramdisk_id='',reservation_id='r-lbhzqlsr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1698183890',owner_user_name='tempest-TaggedBootDevicesTest-1698183890-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T10:16:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9fd70ad0794943a7b93eced34e17aa4d',uuid=0c359f00-f4b7-43c3-8454-364842893779,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2243117f-44a8-4d51-8676-d67748b3c9aa", "address": "fa:16:3e:87:12:47", "network": {"id": "90bcfce1-33ea-4029-aa72-93b729655e77", "bridge": "br-int", "label": "tempest-device-tagging-net1-660308139", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.140", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "92b768cf0f234b5da6d29450a58ce8e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2243117f-44", "ovs_interfaceid": "2243117f-44a8-4d51-8676-d67748b3c9aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 10:16:31 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] Converting VIF {"id": "2243117f-44a8-4d51-8676-d67748b3c9aa", "address": "fa:16:3e:87:12:47", "network": {"id": "90bcfce1-33ea-4029-aa72-93b729655e77", "bridge": "br-int", "label": "tempest-device-tagging-net1-660308139", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.140", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "92b768cf0f234b5da6d29450a58ce8e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2243117f-44", "ovs_interfaceid": "2243117f-44a8-4d51-8676-d67748b3c9aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:16:31 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:12:47,bridge_name='br-int',has_traffic_filtering=True,id=2243117f-44a8-4d51-8676-d67748b3c9aa,network=Network(90bcfce1-33ea-4029-aa72-93b729655e77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2243117f-44') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:16:31 user nova-compute[85141]: DEBUG os_vif [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:12:47,bridge_name='br-int',has_traffic_filtering=True,id=2243117f-44a8-4d51-8676-d67748b3c9aa,network=Network(90bcfce1-33ea-4029-aa72-93b729655e77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2243117f-44') {{(pid=85141) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 10:16:31 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:16:31 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:16:31 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 10:16:31 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:16:31 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '75f3681e-a3ef-54fe-af8f-fb908303e943', '_type': 'linux-noop'}}, row=False) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:16:31 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:16:31 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:16:31 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:16:31 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:16:31 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2243117f-44, may_exist=True, interface_attrs={}) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:16:31 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2243117f-44, col_values=(('qos', UUID('620825e4-653e-488a-932b-826ca13c085a')),), if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:16:31 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2243117f-44, col_values=(('external_ids', {'iface-id': '2243117f-44a8-4d51-8676-d67748b3c9aa', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:87:12:47', 'vm-uuid': '0c359f00-f4b7-43c3-8454-364842893779'}),), if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:16:31 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:16:31 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:16:31 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:16:31 user nova-compute[85141]: INFO os_vif [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:12:47,bridge_name='br-int',has_traffic_filtering=True,id=2243117f-44a8-4d51-8676-d67748b3c9aa,network=Network(90bcfce1-33ea-4029-aa72-93b729655e77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2243117f-44')
Nov 16 10:16:31 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T10:16:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2082484665',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2082484665',id=20,image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKrh2Bof78f1GbJ8gbebS4oyTSP8WglgJTFEydBYPe1tDZFGM71mwkIVvhvKHeqCxlHAP/OJrMQQa+0/ZND/hwmjTMgKHnoGjCJWqCZRpPKiQjDx27A4g/dcEbVlvqH96g==',key_name='tempest-keypair-1313405448',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='92b768cf0f234b5da6d29450a58ce8e7',ramdisk_id='',reservation_id='r-lbhzqlsr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1698183890',owner_user_name='tempest-TaggedBootDevicesTest-1698183890-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T10:16:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9fd70ad0794943a7b93eced34e17aa4d',uuid=0c359f00-f4b7-43c3-8454-364842893779,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6d48ae8e-004c-459d-ad7c-081cc9228fee", "address": "fa:16:3e:49:c2:7d", "network": {"id": "90bcfce1-33ea-4029-aa72-93b729655e77", "bridge": "br-int", "label": "tempest-device-tagging-net1-660308139", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "92b768cf0f234b5da6d29450a58ce8e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d48ae8e-00", "ovs_interfaceid": "6d48ae8e-004c-459d-ad7c-081cc9228fee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 10:16:31 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] Converting VIF {"id": "6d48ae8e-004c-459d-ad7c-081cc9228fee", "address": "fa:16:3e:49:c2:7d", "network": {"id": "90bcfce1-33ea-4029-aa72-93b729655e77", "bridge": "br-int", "label": "tempest-device-tagging-net1-660308139", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "92b768cf0f234b5da6d29450a58ce8e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d48ae8e-00", "ovs_interfaceid": "6d48ae8e-004c-459d-ad7c-081cc9228fee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:16:31 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:49:c2:7d,bridge_name='br-int',has_traffic_filtering=True,id=6d48ae8e-004c-459d-ad7c-081cc9228fee,network=Network(90bcfce1-33ea-4029-aa72-93b729655e77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d48ae8e-00') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:16:31 user nova-compute[85141]: DEBUG os_vif [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:c2:7d,bridge_name='br-int',has_traffic_filtering=True,id=6d48ae8e-004c-459d-ad7c-081cc9228fee,network=Network(90bcfce1-33ea-4029-aa72-93b729655e77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d48ae8e-00') {{(pid=85141) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 10:16:31 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:16:31 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:16:31 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 10:16:31 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:16:31 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a02d0cee-b7a5-58b8-9abf-1e9a8053a4dd', '_type': 'linux-noop'}}, row=False) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:16:31 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:16:31 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:16:31 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:16:31 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:16:31 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:16:31 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:16:31 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:16:31 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6d48ae8e-00, may_exist=True, interface_attrs={}) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:16:31 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6d48ae8e-00, col_values=(('qos', UUID('d277d787-19a2-4b42-bce5-2392609624d2')),), if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:16:31 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6d48ae8e-00, col_values=(('external_ids', {'iface-id': '6d48ae8e-004c-459d-ad7c-081cc9228fee', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:49:c2:7d', 'vm-uuid': '0c359f00-f4b7-43c3-8454-364842893779'}),), if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:16:31 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:16:31 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:16:32 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:16:32 user nova-compute[85141]: INFO os_vif [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:c2:7d,bridge_name='br-int',has_traffic_filtering=True,id=6d48ae8e-004c-459d-ad7c-081cc9228fee,network=Network(90bcfce1-33ea-4029-aa72-93b729655e77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d48ae8e-00')
Nov 16 10:16:32 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T10:16:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2082484665',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2082484665',id=20,image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKrh2Bof78f1GbJ8gbebS4oyTSP8WglgJTFEydBYPe1tDZFGM71mwkIVvhvKHeqCxlHAP/OJrMQQa+0/ZND/hwmjTMgKHnoGjCJWqCZRpPKiQjDx27A4g/dcEbVlvqH96g==',key_name='tempest-keypair-1313405448',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='92b768cf0f234b5da6d29450a58ce8e7',ramdisk_id='',reservation_id='r-lbhzqlsr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1698183890',owner_user_name='tempest-TaggedBootDevicesTest-1698183890-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T10:16:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9fd70ad0794943a7b93eced34e17aa4d',uuid=0c359f00-f4b7-43c3-8454-364842893779,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8a0146a0-20fd-4879-be20-c8732bd6563c", "address": "fa:16:3e:6d:38:4b", "network": {"id": "054ba1f8-e55e-4af1-a668-c4e247430926", "bridge": "br-int", "label": "tempest-device-tagging-net2-1758238013", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "92b768cf0f234b5da6d29450a58ce8e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a0146a0-20", "ovs_interfaceid": "8a0146a0-20fd-4879-be20-c8732bd6563c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 10:16:32 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] Converting VIF {"id": "8a0146a0-20fd-4879-be20-c8732bd6563c", "address": "fa:16:3e:6d:38:4b", "network": {"id": "054ba1f8-e55e-4af1-a668-c4e247430926", "bridge": "br-int", "label": "tempest-device-tagging-net2-1758238013", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "92b768cf0f234b5da6d29450a58ce8e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a0146a0-20", "ovs_interfaceid": "8a0146a0-20fd-4879-be20-c8732bd6563c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:16:32 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:38:4b,bridge_name='br-int',has_traffic_filtering=True,id=8a0146a0-20fd-4879-be20-c8732bd6563c,network=Network(054ba1f8-e55e-4af1-a668-c4e247430926),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a0146a0-20') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:16:32 user nova-compute[85141]: DEBUG os_vif [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:38:4b,bridge_name='br-int',has_traffic_filtering=True,id=8a0146a0-20fd-4879-be20-c8732bd6563c,network=Network(054ba1f8-e55e-4af1-a668-c4e247430926),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a0146a0-20') {{(pid=85141) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 10:16:32 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:16:32 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:16:32 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 10:16:32 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:16:32 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8bb0ea3b-e7c4-526e-bc8b-fe84718be9a6', '_type': 'linux-noop'}}, row=False) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:16:32 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:16:32 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:16:32 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:16:32 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:16:32 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8a0146a0-20, may_exist=True, interface_attrs={}) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:16:32 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8a0146a0-20, col_values=(('qos', UUID('caa885ef-e504-4821-82a8-9c24bfbd7078')),), if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:16:32 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8a0146a0-20, col_values=(('external_ids', {'iface-id': '8a0146a0-20fd-4879-be20-c8732bd6563c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6d:38:4b', 'vm-uuid': '0c359f00-f4b7-43c3-8454-364842893779'}),), if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:16:32 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:16:32 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:16:32 user nova-compute[85141]: DEBUG nova.compute.manager [req-b6aa4075-7345-43cb-8727-7ba5139fa8f9 req-8fa71a00-ff7e-45bb-9bf7-5d729ad495ce service nova] [instance: 361a2044-8fd0-4975-8a19-814bf7a6da41] Received event network-vif-unplugged-dd85b227-3f3d-4f02-a323-661af6a9dc92 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:16:32 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-b6aa4075-7345-43cb-8727-7ba5139fa8f9 req-8fa71a00-ff7e-45bb-9bf7-5d729ad495ce service nova] Acquiring lock "361a2044-8fd0-4975-8a19-814bf7a6da41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:16:32 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-b6aa4075-7345-43cb-8727-7ba5139fa8f9 req-8fa71a00-ff7e-45bb-9bf7-5d729ad495ce service nova] Lock "361a2044-8fd0-4975-8a19-814bf7a6da41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:16:32 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-b6aa4075-7345-43cb-8727-7ba5139fa8f9 req-8fa71a00-ff7e-45bb-9bf7-5d729ad495ce service nova] Lock "361a2044-8fd0-4975-8a19-814bf7a6da41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:16:32 user nova-compute[85141]: DEBUG nova.compute.manager [req-b6aa4075-7345-43cb-8727-7ba5139fa8f9 req-8fa71a00-ff7e-45bb-9bf7-5d729ad495ce service nova] [instance: 361a2044-8fd0-4975-8a19-814bf7a6da41] No waiting events found dispatching network-vif-unplugged-dd85b227-3f3d-4f02-a323-661af6a9dc92 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:16:32 user nova-compute[85141]: DEBUG nova.compute.manager [req-b6aa4075-7345-43cb-8727-7ba5139fa8f9 req-8fa71a00-ff7e-45bb-9bf7-5d729ad495ce service nova] [instance: 361a2044-8fd0-4975-8a19-814bf7a6da41] Received event network-vif-unplugged-dd85b227-3f3d-4f02-a323-661af6a9dc92 for instance with task_state deleting. {{(pid=85141) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 10:16:32 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:16:32 user nova-compute[85141]: INFO os_vif [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:38:4b,bridge_name='br-int',has_traffic_filtering=True,id=8a0146a0-20fd-4879-be20-c8732bd6563c,network=Network(054ba1f8-e55e-4af1-a668-c4e247430926),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a0146a0-20')
Nov 16 10:16:32 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T10:16:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2082484665',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2082484665',id=20,image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKrh2Bof78f1GbJ8gbebS4oyTSP8WglgJTFEydBYPe1tDZFGM71mwkIVvhvKHeqCxlHAP/OJrMQQa+0/ZND/hwmjTMgKHnoGjCJWqCZRpPKiQjDx27A4g/dcEbVlvqH96g==',key_name='tempest-keypair-1313405448',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='92b768cf0f234b5da6d29450a58ce8e7',ramdisk_id='',reservation_id='r-lbhzqlsr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1698183890',owner_user_name='tempest-TaggedBootDevicesTest-1698183890-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T10:16:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9fd70ad0794943a7b93eced34e17aa4d',uuid=0c359f00-f4b7-43c3-8454-364842893779,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "450233b4-a16d-4b2d-bc6a-a87736db7ff4", "address": "fa:16:3e:fe:ae:28", "network": {"id": "054ba1f8-e55e-4af1-a668-c4e247430926", "bridge": "br-int", "label": "tempest-device-tagging-net2-1758238013", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "92b768cf0f234b5da6d29450a58ce8e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap450233b4-a1", "ovs_interfaceid": "450233b4-a16d-4b2d-bc6a-a87736db7ff4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 10:16:32 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] Converting VIF {"id": "450233b4-a16d-4b2d-bc6a-a87736db7ff4", "address": "fa:16:3e:fe:ae:28", "network": {"id": "054ba1f8-e55e-4af1-a668-c4e247430926", "bridge": "br-int", "label": "tempest-device-tagging-net2-1758238013", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "92b768cf0f234b5da6d29450a58ce8e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap450233b4-a1", "ovs_interfaceid": "450233b4-a16d-4b2d-bc6a-a87736db7ff4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:16:32 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fe:ae:28,bridge_name='br-int',has_traffic_filtering=True,id=450233b4-a16d-4b2d-bc6a-a87736db7ff4,network=Network(054ba1f8-e55e-4af1-a668-c4e247430926),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap450233b4-a1') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:16:32 user nova-compute[85141]: DEBUG os_vif [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:ae:28,bridge_name='br-int',has_traffic_filtering=True,id=450233b4-a16d-4b2d-bc6a-a87736db7ff4,network=Network(054ba1f8-e55e-4af1-a668-c4e247430926),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap450233b4-a1') {{(pid=85141) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 10:16:32 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:16:32 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:16:32 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 10:16:32 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:16:32 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e0498128-eb11-50fe-9f0c-6e16dc920e0b', '_type': 'linux-noop'}}, row=False) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:16:32 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:16:32 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:16:32 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:16:32 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:16:32 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap450233b4-a1, may_exist=True, interface_attrs={}) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:16:32 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap450233b4-a1, col_values=(('qos', UUID('77d5fbb8-712b-4bed-ae1c-e5b0a22b4d66')),), if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:16:32 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap450233b4-a1, col_values=(('external_ids', {'iface-id': '450233b4-a16d-4b2d-bc6a-a87736db7ff4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fe:ae:28', 'vm-uuid': '0c359f00-f4b7-43c3-8454-364842893779'}),), if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:16:32 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:16:32 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:16:32 user nova-compute[85141]: INFO nova.virt.libvirt.driver [-] [instance: 361a2044-8fd0-4975-8a19-814bf7a6da41] Instance destroyed successfully.
Nov 16 10:16:32 user nova-compute[85141]: DEBUG nova.objects.instance [None req-127e3e43-7166-4514-b043-b0787166f398 tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] Lazy-loading 'resources' on Instance uuid 361a2044-8fd0-4975-8a19-814bf7a6da41 {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:16:32 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-127e3e43-7166-4514-b043-b0787166f398 tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T10:10:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-2008440718',display_name='tempest-VolumesAdminNegativeTest-server-2008440718',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-2008440718',id=5,image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKJJyX4jvmRDtlOvUnLR1NGaW9kz6H4S0MtEXv2bCkSkZLqTx/3BW23lpqhAop1R16CP/RydfOXYjWmrpc/7xsJ7ZHMyJYpv3BQB7lPO/9bqDmD3KCEWvylt59wIgPjNFA==',key_name='tempest-keypair-2010714520',keypairs=<?>,launch_index=0,launched_at=2023-11-16T10:10:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5b9e035160ba427c80e5668982136a49',ramdisk_id='',reservation_id='r-7p7wsvva',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1984071326',owner_user_name='tempest-VolumesAdminNegativeTest-1984071326-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T10:10:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cb1fde08d82e4eedb97f1501eafa3bd0',uuid=361a2044-8fd0-4975-8a19-814bf7a6da41,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dd85b227-3f3d-4f02-a323-661af6a9dc92", "address": "fa:16:3e:b7:94:48", "network": {"id": "1d55ecdc-2f77-4c38-b487-0099d658e0ec", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1226034564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b9e035160ba427c80e5668982136a49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd85b227-3f", "ovs_interfaceid": "dd85b227-3f3d-4f02-a323-661af6a9dc92", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 10:16:32 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-127e3e43-7166-4514-b043-b0787166f398 tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] Converting VIF {"id": "dd85b227-3f3d-4f02-a323-661af6a9dc92", "address": "fa:16:3e:b7:94:48", "network": {"id": "1d55ecdc-2f77-4c38-b487-0099d658e0ec", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1226034564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5b9e035160ba427c80e5668982136a49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd85b227-3f", "ovs_interfaceid": "dd85b227-3f3d-4f02-a323-661af6a9dc92", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:16:32 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-127e3e43-7166-4514-b043-b0787166f398 tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b7:94:48,bridge_name='br-int',has_traffic_filtering=True,id=dd85b227-3f3d-4f02-a323-661af6a9dc92,network=Network(1d55ecdc-2f77-4c38-b487-0099d658e0ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd85b227-3f') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:16:32 user nova-compute[85141]: DEBUG os_vif [None req-127e3e43-7166-4514-b043-b0787166f398 tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b7:94:48,bridge_name='br-int',has_traffic_filtering=True,id=dd85b227-3f3d-4f02-a323-661af6a9dc92,network=Network(1d55ecdc-2f77-4c38-b487-0099d658e0ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd85b227-3f') {{(pid=85141) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 10:16:32 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-cbfd3d6c-122b-4b36-89c6-bedb91efc016 tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] [instance: e65ccf79-718d-4eeb-8914-f0db2e2c9ce2] Starting finish_revert_migration {{(pid=85141) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11819}}
Nov 16 10:16:32 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-cbfd3d6c-122b-4b36-89c6-bedb91efc016 tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] [instance: e65ccf79-718d-4eeb-8914-f0db2e2c9ce2] Start _get_guest_xml network_info=[{"id": "9b681ac7-3246-4ff4-8691-f8e4f1d62061", "address": "fa:16:3e:ce:f3:cd", "network": {"id": "ac11f3ed-4c14-4051-aff5-44d400d6368c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-679726958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7044a386486d4426bcccfe0b7d225c80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b681ac7-32", "ovs_interfaceid": "9b681ac7-3246-4ff4-8691-f8e4f1d62061", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=bc4ca70f-a459-4d5c-a9e6-80f1948eb48b,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_options': None, 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'image_id': 'bc4ca70f-a459-4d5c-a9e6-80f1948eb48b'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:abda547a-8d00-4a02-a6e4-d0670e47815a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RgkfZDbl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'e65ccf79-718d-4eeb-8914-f0db2e2c9ce2', 'attached_at': '2023-11-16T10:16:32.000000', 'detached_at': '', 'volume_id': 'abda547a-8d00-4a02-a6e4-d0670e47815a', 'serial': 'abda547a-8d00-4a02-a6e4-d0670e47815a'}, 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'boot_index': None, 'attachment_id': '37ea0740-1dea-4eb5-bdcc-7e74ded4e8b1', 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=85141) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 10:16:32 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-cbfd3d6c-122b-4b36-89c6-bedb91efc016 tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:16:32 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-cbfd3d6c-122b-4b36-89c6-bedb91efc016 tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:16:32 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-cbfd3d6c-122b-4b36-89c6-bedb91efc016 tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=85141) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 10:16:32 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-cbfd3d6c-122b-4b36-89c6-bedb91efc016 tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] CPU controller missing on host. {{(pid=85141) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 10:16:32 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:16:32 user nova-compute[85141]: INFO os_vif [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:ae:28,bridge_name='br-int',has_traffic_filtering=True,id=450233b4-a16d-4b2d-bc6a-a87736db7ff4,network=Network(054ba1f8-e55e-4af1-a668-c4e247430926),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap450233b4-a1')
Nov 16 10:16:32 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-cbfd3d6c-122b-4b36-89c6-bedb91efc016 tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=85141) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 10:16:32 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-cbfd3d6c-122b-4b36-89c6-bedb91efc016 tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] CPU controller found on host. {{(pid=85141) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 10:16:32 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-cbfd3d6c-122b-4b36-89c6-bedb91efc016 tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=85141) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 10:16:32 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-cbfd3d6c-122b-4b36-89c6-bedb91efc016 tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T10:06:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=bc4ca70f-a459-4d5c-a9e6-80f1948eb48b,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 10:16:32 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-cbfd3d6c-122b-4b36-89c6-bedb91efc016 tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Flavor limits 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 10:16:32 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-cbfd3d6c-122b-4b36-89c6-bedb91efc016 tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Image limits 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 10:16:32 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-cbfd3d6c-122b-4b36-89c6-bedb91efc016 tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Flavor pref 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 10:16:32 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-cbfd3d6c-122b-4b36-89c6-bedb91efc016 tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Image pref 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 10:16:32 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-cbfd3d6c-122b-4b36-89c6-bedb91efc016 tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 10:16:32 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-cbfd3d6c-122b-4b36-89c6-bedb91efc016 tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 10:16:32 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-cbfd3d6c-122b-4b36-89c6-bedb91efc016 tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=85141) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 10:16:32 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-cbfd3d6c-122b-4b36-89c6-bedb91efc016 tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Got 1 possible topologies {{(pid=85141) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 10:16:32 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-cbfd3d6c-122b-4b36-89c6-bedb91efc016 tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 10:16:32 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-cbfd3d6c-122b-4b36-89c6-bedb91efc016 tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 10:16:32 user nova-compute[85141]: DEBUG nova.objects.instance [None req-cbfd3d6c-122b-4b36-89c6-bedb91efc016 tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Lazy-loading 'vcpu_model' on Instance uuid e65ccf79-718d-4eeb-8914-f0db2e2c9ce2 {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:16:32 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:16:32 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdd85b227-3f, bridge=br-int, if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:16:32 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:16:32 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:16:32 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cbfd3d6c-122b-4b36-89c6-bedb91efc016 tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] [instance: e65ccf79-718d-4eeb-8914-f0db2e2c9ce2] Calling os-brick to attach iSCSI Volume {{(pid=85141) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 10:16:32 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbfd3d6c-122b-4b36-89c6-bedb91efc016 tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51806b6080>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:abda547a-8d00-4a02-a6e4-d0670e47815a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RgkfZDbl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 10:16:32 user nova-compute[85141]: WARNING os_brick.initiator.connectors.base [None req-cbfd3d6c-122b-4b36-89c6-bedb91efc016 tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 10:16:32 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-cbfd3d6c-122b-4b36-89c6-bedb91efc016 tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 10:16:32 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-cbfd3d6c-122b-4b36-89c6-bedb91efc016 tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 10:16:32 user nova-compute[85141]: WARNING os_brick.initiator.connectors.base [None req-cbfd3d6c-122b-4b36-89c6-bedb91efc016 tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 10:16:32 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-cbfd3d6c-122b-4b36-89c6-bedb91efc016 tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:abda547a-8d00-4a02-a6e4-d0670e47815a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 10:16:32 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-cbfd3d6c-122b-4b36-89c6-bedb91efc016 tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:abda547a-8d00-4a02-a6e4-d0670e47815a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 10:16:32 user nova-compute[85141]: INFO os_brick.initiator.connectors.iscsi [None req-cbfd3d6c-122b-4b36-89c6-bedb91efc016 tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 10:16:32 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abda547a-8d00-4a02-a6e4-d0670e47815a -p 172.16.0.220:3260 {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:16:32 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:16:32 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abda547a-8d00-4a02-a6e4-d0670e47815a -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:16:32 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fec7501-3cee-465d-b388-0271fb87b1de]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:16:32 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbfd3d6c-122b-4b36-89c6-bedb91efc016 tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 10:16:32 user nova-compute[85141]:  {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:16:32 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abda547a-8d00-4a02-a6e4-d0670e47815a -p 172.16.0.220:3260 --interface default --op new {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:16:32 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:16:32 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:16:32 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9dea2fd6-5ba2-4c2f-b5e2-1430ffe94699) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:16:32 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:16:32 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:16:32 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abda547a-8d00-4a02-a6e4-d0670e47815a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:16:32 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c7be79f-1071-416e-82db-0681a17d5902]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:abda547a-8d00-4a02-a6e4-d0670e47815a] added\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:16:32 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbfd3d6c-122b-4b36-89c6-bedb91efc016 tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:abda547a-8d00-4a02-a6e4-d0670e47815a] added
Nov 16 10:16:32 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:16:32 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abda547a-8d00-4a02-a6e4-d0670e47815a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:16:32 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] No BDM found with device name hda, not building metadata. {{(pid=85141) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 10:16:32 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] No BDM found with device name vdc, not building metadata. {{(pid=85141) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 10:16:32 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] No VIF found with MAC fa:16:3e:b6:30:ac, not building metadata {{(pid=85141) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 10:16:32 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] No VIF found with MAC fa:16:3e:49:c2:7d, not building metadata {{(pid=85141) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 10:16:32 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] [instance: 0c359f00-f4b7-43c3-8454-364842893779] Using config drive
Nov 16 10:16:32 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abda547a-8d00-4a02-a6e4-d0670e47815a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:16:32 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[621126ea-51be-4cf6-8188-9ae9907b6535]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:16:32 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbfd3d6c-122b-4b36-89c6-bedb91efc016 tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:16:32 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abda547a-8d00-4a02-a6e4-d0670e47815a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:16:32 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:16:32 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abda547a-8d00-4a02-a6e4-d0670e47815a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:16:32 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[432822cd-0979-4a12-a9c6-cbb63ff781dd]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:16:32 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbfd3d6c-122b-4b36-89c6-bedb91efc016 tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:16:32 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abda547a-8d00-4a02-a6e4-d0670e47815a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RgkfZDbl {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:16:32 user nova-compute[85141]: INFO os_vif [None req-127e3e43-7166-4514-b043-b0787166f398 tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b7:94:48,bridge_name='br-int',has_traffic_filtering=True,id=dd85b227-3f3d-4f02-a323-661af6a9dc92,network=Network(1d55ecdc-2f77-4c38-b487-0099d658e0ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd85b227-3f')
Nov 16 10:16:32 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-127e3e43-7166-4514-b043-b0787166f398 tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] [instance: 361a2044-8fd0-4975-8a19-814bf7a6da41] Deleting instance files /opt/stack/data/nova/instances/361a2044-8fd0-4975-8a19-814bf7a6da41_del
Nov 16 10:16:32 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-127e3e43-7166-4514-b043-b0787166f398 tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] [instance: 361a2044-8fd0-4975-8a19-814bf7a6da41] Deletion of /opt/stack/data/nova/instances/361a2044-8fd0-4975-8a19-814bf7a6da41_del complete
Nov 16 10:16:32 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abda547a-8d00-4a02-a6e4-d0670e47815a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RgkfZDbl" returned: 0 in 0.027s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:16:32 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7e57133-a1a7-4925-8c06-4c98faf64537]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:16:32 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbfd3d6c-122b-4b36-89c6-bedb91efc016 tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RgkfZDbl'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:16:32 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abda547a-8d00-4a02-a6e4-d0670e47815a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:16:32 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abda547a-8d00-4a02-a6e4-d0670e47815a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.121s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:16:32 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[87c40398-dd98-46a8-bdf3-465bdc9718df]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:16:32 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbfd3d6c-122b-4b36-89c6-bedb91efc016 tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:16:32 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:16:32 user nova-compute[85141]: INFO nova.compute.manager [None req-127e3e43-7166-4514-b043-b0787166f398 tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] [instance: 361a2044-8fd0-4975-8a19-814bf7a6da41] Took 1.37 seconds to destroy the instance on the hypervisor.
Nov 16 10:16:32 user nova-compute[85141]: DEBUG oslo.service.loopingcall [None req-127e3e43-7166-4514-b043-b0787166f398 tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=85141) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 10:16:32 user nova-compute[85141]: DEBUG nova.compute.manager [-] [instance: 361a2044-8fd0-4975-8a19-814bf7a6da41] Deallocating network for instance {{(pid=85141) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 10:16:32 user nova-compute[85141]: DEBUG nova.network.neutron [-] [instance: 361a2044-8fd0-4975-8a19-814bf7a6da41] deallocate_for_instance() {{(pid=85141) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 10:16:32 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:16:32 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b404101-e481-4d53-a154-3cd51a3b6cd6]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fa41a79-b1fc-4047-9ae9-f674f348378f (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef975afa-7705-454b-88d3-798b0a74dbb9 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:030d6106-e7ec-4eb8-9642-b64a4685f6bb (non-flash)\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:16:32 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbfd3d6c-122b-4b36-89c6-bedb91efc016 tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)
Nov 16 10:16:32 user nova-compute[85141]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fa41a79-b1fc-4047-9ae9-f674f348378f (non-flash)
Nov 16 10:16:32 user nova-compute[85141]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef975afa-7705-454b-88d3-798b0a74dbb9 (non-flash)
Nov 16 10:16:32 user nova-compute[85141]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:030d6106-e7ec-4eb8-9642-b64a4685f6bb (non-flash)
Nov 16 10:16:32 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:16:32 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbfd3d6c-122b-4b36-89c6-bedb91efc016 tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)
Nov 16 10:16:32 user nova-compute[85141]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fa41a79-b1fc-4047-9ae9-f674f348378f (non-flash)
Nov 16 10:16:32 user nova-compute[85141]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef975afa-7705-454b-88d3-798b0a74dbb9 (non-flash)
Nov 16 10:16:32 user nova-compute[85141]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:030d6106-e7ec-4eb8-9642-b64a4685f6bb (non-flash)
Nov 16 10:16:32 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 10:16:32 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abda547a-8d00-4a02-a6e4-d0670e47815a -p 172.16.0.220:3260 --login {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:16:33 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abda547a-8d00-4a02-a6e4-d0670e47815a -p 172.16.0.220:3260 --login" returned: 0 in 0.089s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:16:33 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf24cb1a-5644-4d98-95a6-65bb127e0680]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:abda547a-8d00-4a02-a6e4-d0670e47815a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:abda547a-8d00-4a02-a6e4-d0670e47815a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:16:33 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbfd3d6c-122b-4b36-89c6-bedb91efc016 tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:abda547a-8d00-4a02-a6e4-d0670e47815a, portal: 172.16.0.220,3260]
Nov 16 10:16:33 user nova-compute[85141]: Login to [iface: default, target: iqn.2010-10.org.openstack:abda547a-8d00-4a02-a6e4-d0670e47815a, portal: 172.16.0.220,3260] successful.
Nov 16 10:16:33 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:16:33 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abda547a-8d00-4a02-a6e4-d0670e47815a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:16:33 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abda547a-8d00-4a02-a6e4-d0670e47815a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:16:33 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[e29b71fe-0e67-4fbe-b979-4d5c4f627eef]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:16:33 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbfd3d6c-122b-4b36-89c6-bedb91efc016 tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:16:33 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:16:33 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:16:33 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[fee3626e-f9cb-4113-986c-746584a5d552]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fa41a79-b1fc-4047-9ae9-f674f348378f (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef975afa-7705-454b-88d3-798b0a74dbb9 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:030d6106-e7ec-4eb8-9642-b64a4685f6bb (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abda547a-8d00-4a02-a6e4-d0670e47815a (non-flash)\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:16:33 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbfd3d6c-122b-4b36-89c6-bedb91efc016 tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)
Nov 16 10:16:33 user nova-compute[85141]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fa41a79-b1fc-4047-9ae9-f674f348378f (non-flash)
Nov 16 10:16:33 user nova-compute[85141]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef975afa-7705-454b-88d3-798b0a74dbb9 (non-flash)
Nov 16 10:16:33 user nova-compute[85141]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:030d6106-e7ec-4eb8-9642-b64a4685f6bb (non-flash)
Nov 16 10:16:33 user nova-compute[85141]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abda547a-8d00-4a02-a6e4-d0670e47815a (non-flash)
Nov 16 10:16:33 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:16:33 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbfd3d6c-122b-4b36-89c6-bedb91efc016 tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)
Nov 16 10:16:33 user nova-compute[85141]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fa41a79-b1fc-4047-9ae9-f674f348378f (non-flash)
Nov 16 10:16:33 user nova-compute[85141]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef975afa-7705-454b-88d3-798b0a74dbb9 (non-flash)
Nov 16 10:16:33 user nova-compute[85141]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:030d6106-e7ec-4eb8-9642-b64a4685f6bb (non-flash)
Nov 16 10:16:33 user nova-compute[85141]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abda547a-8d00-4a02-a6e4-d0670e47815a (non-flash)
Nov 16 10:16:33 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 10:16:33 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-cbfd3d6c-122b-4b36-89c6-bedb91efc016 tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:abda547a-8d00-4a02-a6e4-d0670e47815a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.483s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 10:16:33 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbfd3d6c-122b-4b36-89c6-bedb91efc016 tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Connected to 172.16.0.220:3260 {{(pid=85141) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 10:16:33 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-cbfd3d6c-122b-4b36-89c6-bedb91efc016 tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] HCTL ('37', '-', '-', 0) found on session 23 with lun 0 {{(pid=85141) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 10:16:33 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-cbfd3d6c-122b-4b36-89c6-bedb91efc016 tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=85141) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 10:16:33 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] [instance: 0c359f00-f4b7-43c3-8454-364842893779] Creating config drive at /opt/stack/data/nova/instances/0c359f00-f4b7-43c3-8454-364842893779/disk.config
Nov 16 10:16:33 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/0c359f00-f4b7-43c3-8454-364842893779/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpvq6v5qnh {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:16:33 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:16:33 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.016s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:16:33 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[8918ff7a-e8b8-49ef-a7b8-0a53decc7459]: (4, ('- - 0', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:16:33 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-cbfd3d6c-122b-4b36-89c6-bedb91efc016 tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Searching for a device in session 23 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=85141) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 10:16:33 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbfd3d6c-122b-4b36-89c6-bedb91efc016 tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:abda547a-8d00-4a02-a6e4-d0670e47815a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RgkfZDbl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=85141) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 10:16:33 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/0c359f00-f4b7-43c3-8454-364842893779/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpvq6v5qnh" returned: 0 in 0.061s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:16:33 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:16:33 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:16:34 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-cbfd3d6c-122b-4b36-89c6-bedb91efc016 tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.571s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 10:16:34 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbfd3d6c-122b-4b36-89c6-bedb91efc016 tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] <== connect_volume: return (1577ms) {'type': 'block', 'scsi_wwn': '26131616434303532', 'path': '/dev/sdf'} {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 10:16:34 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cbfd3d6c-122b-4b36-89c6-bedb91efc016 tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] [instance: e65ccf79-718d-4eeb-8914-f0db2e2c9ce2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26131616434303532', 'path': '/dev/sdf'} {{(pid=85141) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 10:16:34 user nova-compute[85141]: DEBUG nova.network.neutron [-] [instance: 361a2044-8fd0-4975-8a19-814bf7a6da41] Updating instance_info_cache with network_info: [] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:16:34 user nova-compute[85141]: INFO nova.compute.manager [-] [instance: 361a2044-8fd0-4975-8a19-814bf7a6da41] Took 1.31 seconds to deallocate network for instance.
Nov 16 10:16:34 user nova-compute[85141]: DEBUG nova.compute.manager [req-eebde58b-9076-46a9-b2d5-7f804f55fe67 req-e7ced2a6-2091-4d17-b4bf-fe3d7f1b233f service nova] [instance: 361a2044-8fd0-4975-8a19-814bf7a6da41] Received event network-vif-deleted-dd85b227-3f3d-4f02-a323-661af6a9dc92 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:16:34 user nova-compute[85141]: INFO nova.compute.manager [req-eebde58b-9076-46a9-b2d5-7f804f55fe67 req-e7ced2a6-2091-4d17-b4bf-fe3d7f1b233f service nova] [instance: 361a2044-8fd0-4975-8a19-814bf7a6da41] Neutron deleted interface dd85b227-3f3d-4f02-a323-661af6a9dc92; detaching it from the instance and deleting it from the info cache
Nov 16 10:16:34 user nova-compute[85141]: DEBUG nova.network.neutron [req-eebde58b-9076-46a9-b2d5-7f804f55fe67 req-e7ced2a6-2091-4d17-b4bf-fe3d7f1b233f service nova] [instance: 361a2044-8fd0-4975-8a19-814bf7a6da41] Updating instance_info_cache with network_info: [] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:16:34 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-cbfd3d6c-122b-4b36-89c6-bedb91efc016 tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T10:10:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-2047998705',display_name='tempest-ServerActionsTestOtherB-server-2047998705',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-2047998705',id=4,image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHf5WUZHhTvllxOmAg72z1YtUbpT94pAZ2VioYM/1ZPcnLSsLgh6rPndkFT+8xfTCaDEevGxVERzODZXR4Exh9KNRXP3xfU1ZBhWrD+YWL3uQCHfG8ms6Vv5yEaXpnuCDg==',key_name='tempest-keypair-2137833999',keypairs=<?>,launch_index=0,launched_at=2023-11-16T10:14:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='7044a386486d4426bcccfe0b7d225c80',ramdisk_id='',reservation_id='r-2q3wdtbp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-876168065',owner_user_name='tempest-ServerActionsTestOtherB-876168065-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T10:16:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='776d4157be1a4e56a8821d50da998475',uuid=e65ccf79-718d-4eeb-8914-f0db2e2c9ce2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "9b681ac7-3246-4ff4-8691-f8e4f1d62061", "address": "fa:16:3e:ce:f3:cd", "network": {"id": "ac11f3ed-4c14-4051-aff5-44d400d6368c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-679726958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7044a386486d4426bcccfe0b7d225c80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b681ac7-32", "ovs_interfaceid": "9b681ac7-3246-4ff4-8691-f8e4f1d62061", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=85141) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 10:16:34 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-cbfd3d6c-122b-4b36-89c6-bedb91efc016 tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Converting VIF {"id": "9b681ac7-3246-4ff4-8691-f8e4f1d62061", "address": "fa:16:3e:ce:f3:cd", "network": {"id": "ac11f3ed-4c14-4051-aff5-44d400d6368c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-679726958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7044a386486d4426bcccfe0b7d225c80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b681ac7-32", "ovs_interfaceid": "9b681ac7-3246-4ff4-8691-f8e4f1d62061", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:16:34 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-cbfd3d6c-122b-4b36-89c6-bedb91efc016 tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ce:f3:cd,bridge_name='br-int',has_traffic_filtering=True,id=9b681ac7-3246-4ff4-8691-f8e4f1d62061,network=Network(ac11f3ed-4c14-4051-aff5-44d400d6368c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b681ac7-32') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:16:34 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-cbfd3d6c-122b-4b36-89c6-bedb91efc016 tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] [instance: e65ccf79-718d-4eeb-8914-f0db2e2c9ce2] End _get_guest_xml xml=<domain type="kvm">
Nov 16 10:16:34 user nova-compute[85141]:   <uuid>e65ccf79-718d-4eeb-8914-f0db2e2c9ce2</uuid>
Nov 16 10:16:34 user nova-compute[85141]:   <name>instance-00000004</name>
Nov 16 10:16:34 user nova-compute[85141]:   <memory>524288</memory>
Nov 16 10:16:34 user nova-compute[85141]:   <vcpu>1</vcpu>
Nov 16 10:16:34 user nova-compute[85141]:   <metadata>
Nov 16 10:16:34 user nova-compute[85141]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 10:16:34 user nova-compute[85141]:       <nova:package version="0.0.0"/>
Nov 16 10:16:34 user nova-compute[85141]:       <nova:name>tempest-ServerActionsTestOtherB-server-2047998705</nova:name>
Nov 16 10:16:34 user nova-compute[85141]:       <nova:creationTime>2023-11-16 10:16:32</nova:creationTime>
Nov 16 10:16:34 user nova-compute[85141]:       <nova:flavor name="m1.tiny">
Nov 16 10:16:34 user nova-compute[85141]:         <nova:memory>512</nova:memory>
Nov 16 10:16:34 user nova-compute[85141]:         <nova:disk>1</nova:disk>
Nov 16 10:16:34 user nova-compute[85141]:         <nova:swap>0</nova:swap>
Nov 16 10:16:34 user nova-compute[85141]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 10:16:34 user nova-compute[85141]:         <nova:vcpus>1</nova:vcpus>
Nov 16 10:16:34 user nova-compute[85141]:       </nova:flavor>
Nov 16 10:16:34 user nova-compute[85141]:       <nova:owner>
Nov 16 10:16:34 user nova-compute[85141]:         <nova:user uuid="776d4157be1a4e56a8821d50da998475">tempest-ServerActionsTestOtherB-876168065-project-member</nova:user>
Nov 16 10:16:34 user nova-compute[85141]:         <nova:project uuid="7044a386486d4426bcccfe0b7d225c80">tempest-ServerActionsTestOtherB-876168065</nova:project>
Nov 16 10:16:34 user nova-compute[85141]:       </nova:owner>
Nov 16 10:16:34 user nova-compute[85141]:       <nova:root type="image" uuid="bc4ca70f-a459-4d5c-a9e6-80f1948eb48b"/>
Nov 16 10:16:34 user nova-compute[85141]:       <nova:ports>
Nov 16 10:16:34 user nova-compute[85141]:         <nova:port uuid="9b681ac7-3246-4ff4-8691-f8e4f1d62061">
Nov 16 10:16:34 user nova-compute[85141]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 16 10:16:34 user nova-compute[85141]:         </nova:port>
Nov 16 10:16:34 user nova-compute[85141]:       </nova:ports>
Nov 16 10:16:34 user nova-compute[85141]:     </nova:instance>
Nov 16 10:16:34 user nova-compute[85141]:   </metadata>
Nov 16 10:16:34 user nova-compute[85141]:   <sysinfo type="smbios">
Nov 16 10:16:34 user nova-compute[85141]:     <system>
Nov 16 10:16:34 user nova-compute[85141]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 10:16:34 user nova-compute[85141]:       <entry name="product">OpenStack Nova</entry>
Nov 16 10:16:34 user nova-compute[85141]:       <entry name="version">0.0.0</entry>
Nov 16 10:16:34 user nova-compute[85141]:       <entry name="serial">e65ccf79-718d-4eeb-8914-f0db2e2c9ce2</entry>
Nov 16 10:16:34 user nova-compute[85141]:       <entry name="uuid">e65ccf79-718d-4eeb-8914-f0db2e2c9ce2</entry>
Nov 16 10:16:34 user nova-compute[85141]:       <entry name="family">Virtual Machine</entry>
Nov 16 10:16:34 user nova-compute[85141]:     </system>
Nov 16 10:16:34 user nova-compute[85141]:   </sysinfo>
Nov 16 10:16:34 user nova-compute[85141]:   <os>
Nov 16 10:16:34 user nova-compute[85141]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 10:16:34 user nova-compute[85141]:     <boot dev="hd"/>
Nov 16 10:16:34 user nova-compute[85141]:     <smbios mode="sysinfo"/>
Nov 16 10:16:34 user nova-compute[85141]:   </os>
Nov 16 10:16:34 user nova-compute[85141]:   <features>
Nov 16 10:16:34 user nova-compute[85141]:     <acpi/>
Nov 16 10:16:34 user nova-compute[85141]:     <apic/>
Nov 16 10:16:34 user nova-compute[85141]:     <vmcoreinfo/>
Nov 16 10:16:34 user nova-compute[85141]:   </features>
Nov 16 10:16:34 user nova-compute[85141]:   <clock offset="utc">
Nov 16 10:16:34 user nova-compute[85141]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 10:16:34 user nova-compute[85141]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 10:16:34 user nova-compute[85141]:     <timer name="hpet" present="no"/>
Nov 16 10:16:34 user nova-compute[85141]:   </clock>
Nov 16 10:16:34 user nova-compute[85141]:   <cpu mode="custom" match="exact">
Nov 16 10:16:34 user nova-compute[85141]:     <model>Nehalem</model>
Nov 16 10:16:34 user nova-compute[85141]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 10:16:34 user nova-compute[85141]:   </cpu>
Nov 16 10:16:34 user nova-compute[85141]:   <devices>
Nov 16 10:16:34 user nova-compute[85141]:     <disk type="file" device="disk">
Nov 16 10:16:34 user nova-compute[85141]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 10:16:34 user nova-compute[85141]:       <source file="/opt/stack/data/nova/instances/e65ccf79-718d-4eeb-8914-f0db2e2c9ce2/disk"/>
Nov 16 10:16:34 user nova-compute[85141]:       <target dev="vda" bus="virtio"/>
Nov 16 10:16:34 user nova-compute[85141]:     </disk>
Nov 16 10:16:34 user nova-compute[85141]:     <disk type="block" device="disk">
Nov 16 10:16:34 user nova-compute[85141]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 10:16:34 user nova-compute[85141]:       <source dev="/dev/sdf"/>
Nov 16 10:16:34 user nova-compute[85141]:       <target dev="vdb" bus="virtio"/>
Nov 16 10:16:34 user nova-compute[85141]:       <serial>abda547a-8d00-4a02-a6e4-d0670e47815a</serial>
Nov 16 10:16:34 user nova-compute[85141]:     </disk>
Nov 16 10:16:34 user nova-compute[85141]:     <interface type="ethernet">
Nov 16 10:16:34 user nova-compute[85141]:       <mac address="fa:16:3e:ce:f3:cd"/>
Nov 16 10:16:34 user nova-compute[85141]:       <model type="virtio"/>
Nov 16 10:16:34 user nova-compute[85141]:       <mtu size="1442"/>
Nov 16 10:16:34 user nova-compute[85141]:       <target dev="tap9b681ac7-32"/>
Nov 16 10:16:34 user nova-compute[85141]:     </interface>
Nov 16 10:16:34 user nova-compute[85141]:     <serial type="pty">
Nov 16 10:16:34 user nova-compute[85141]:       <log file="/opt/stack/data/nova/instances/e65ccf79-718d-4eeb-8914-f0db2e2c9ce2/console.log" append="off"/>
Nov 16 10:16:34 user nova-compute[85141]:     </serial>
Nov 16 10:16:34 user nova-compute[85141]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 10:16:34 user nova-compute[85141]:     <video>
Nov 16 10:16:34 user nova-compute[85141]:       <model type="virtio"/>
Nov 16 10:16:34 user nova-compute[85141]:     </video>
Nov 16 10:16:34 user nova-compute[85141]:     <rng model="virtio">
Nov 16 10:16:34 user nova-compute[85141]:       <backend model="random">/dev/urandom</backend>
Nov 16 10:16:34 user nova-compute[85141]:     </rng>
Nov 16 10:16:34 user nova-compute[85141]:     <controller type="usb" index="0" model="none"/>
Nov 16 10:16:34 user nova-compute[85141]:     <memballoon model="virtio">
Nov 16 10:16:34 user nova-compute[85141]:       <stats period="10"/>
Nov 16 10:16:34 user nova-compute[85141]:     </memballoon>
Nov 16 10:16:34 user nova-compute[85141]:   </devices>
Nov 16 10:16:34 user nova-compute[85141]: </domain>
Nov 16 10:16:34 user nova-compute[85141]:  {{(pid=85141) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 10:16:34 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-cbfd3d6c-122b-4b36-89c6-bedb91efc016 tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T10:10:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-2047998705',display_name='tempest-ServerActionsTestOtherB-server-2047998705',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-2047998705',id=4,image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHf5WUZHhTvllxOmAg72z1YtUbpT94pAZ2VioYM/1ZPcnLSsLgh6rPndkFT+8xfTCaDEevGxVERzODZXR4Exh9KNRXP3xfU1ZBhWrD+YWL3uQCHfG8ms6Vv5yEaXpnuCDg==',key_name='tempest-keypair-2137833999',keypairs=<?>,launch_index=0,launched_at=2023-11-16T10:14:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='7044a386486d4426bcccfe0b7d225c80',ramdisk_id='',reservation_id='r-2q3wdtbp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-876168065',owner_user_name='tempest-ServerActionsTestOtherB-876168065-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T10:16:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='776d4157be1a4e56a8821d50da998475',uuid=e65ccf79-718d-4eeb-8914-f0db2e2c9ce2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "9b681ac7-3246-4ff4-8691-f8e4f1d62061", "address": "fa:16:3e:ce:f3:cd", "network": {"id": "ac11f3ed-4c14-4051-aff5-44d400d6368c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-679726958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7044a386486d4426bcccfe0b7d225c80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b681ac7-32", "ovs_interfaceid": "9b681ac7-3246-4ff4-8691-f8e4f1d62061", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 10:16:34 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-cbfd3d6c-122b-4b36-89c6-bedb91efc016 tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Converting VIF {"id": "9b681ac7-3246-4ff4-8691-f8e4f1d62061", "address": "fa:16:3e:ce:f3:cd", "network": {"id": "ac11f3ed-4c14-4051-aff5-44d400d6368c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-679726958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7044a386486d4426bcccfe0b7d225c80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b681ac7-32", "ovs_interfaceid": "9b681ac7-3246-4ff4-8691-f8e4f1d62061", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:16:34 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-cbfd3d6c-122b-4b36-89c6-bedb91efc016 tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ce:f3:cd,bridge_name='br-int',has_traffic_filtering=True,id=9b681ac7-3246-4ff4-8691-f8e4f1d62061,network=Network(ac11f3ed-4c14-4051-aff5-44d400d6368c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b681ac7-32') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:16:34 user nova-compute[85141]: DEBUG os_vif [None req-cbfd3d6c-122b-4b36-89c6-bedb91efc016 tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:f3:cd,bridge_name='br-int',has_traffic_filtering=True,id=9b681ac7-3246-4ff4-8691-f8e4f1d62061,network=Network(ac11f3ed-4c14-4051-aff5-44d400d6368c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b681ac7-32') {{(pid=85141) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 10:16:34 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:16:34 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:16:34 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 10:16:34 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:16:34 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '35f4821b-45c4-5ae4-a8ad-c144be9ebb20', '_type': 'linux-noop'}}, row=False) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:16:34 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:16:34 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:16:34 user nova-compute[85141]: DEBUG nova.compute.manager [req-eebde58b-9076-46a9-b2d5-7f804f55fe67 req-e7ced2a6-2091-4d17-b4bf-fe3d7f1b233f service nova] [instance: 361a2044-8fd0-4975-8a19-814bf7a6da41] Detach interface failed, port_id=dd85b227-3f3d-4f02-a323-661af6a9dc92, reason: Instance 361a2044-8fd0-4975-8a19-814bf7a6da41 could not be found. {{(pid=85141) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 16 10:16:34 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-127e3e43-7166-4514-b043-b0787166f398 tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:16:34 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-127e3e43-7166-4514-b043-b0787166f398 tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:16:34 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:16:34 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:16:34 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9b681ac7-32, may_exist=True, interface_attrs={}) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:16:34 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9b681ac7-32, col_values=(('qos', UUID('77accd01-11ce-40d2-9514-41e81b1f5698')),), if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:16:34 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9b681ac7-32, col_values=(('external_ids', {'iface-id': '9b681ac7-3246-4ff4-8691-f8e4f1d62061', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ce:f3:cd', 'vm-uuid': 'e65ccf79-718d-4eeb-8914-f0db2e2c9ce2'}),), if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:16:34 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:16:34 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:16:34 user nova-compute[85141]: DEBUG nova.compute.manager [req-033d460d-e846-4bd9-a198-517b72e22c94 req-3e9a95a8-f26f-44a9-bb95-9047a110a381 service nova] [instance: 361a2044-8fd0-4975-8a19-814bf7a6da41] Received event network-vif-plugged-dd85b227-3f3d-4f02-a323-661af6a9dc92 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:16:34 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-033d460d-e846-4bd9-a198-517b72e22c94 req-3e9a95a8-f26f-44a9-bb95-9047a110a381 service nova] Acquiring lock "361a2044-8fd0-4975-8a19-814bf7a6da41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:16:34 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-033d460d-e846-4bd9-a198-517b72e22c94 req-3e9a95a8-f26f-44a9-bb95-9047a110a381 service nova] Lock "361a2044-8fd0-4975-8a19-814bf7a6da41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:16:34 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-033d460d-e846-4bd9-a198-517b72e22c94 req-3e9a95a8-f26f-44a9-bb95-9047a110a381 service nova] Lock "361a2044-8fd0-4975-8a19-814bf7a6da41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:16:34 user nova-compute[85141]: DEBUG nova.compute.manager [req-033d460d-e846-4bd9-a198-517b72e22c94 req-3e9a95a8-f26f-44a9-bb95-9047a110a381 service nova] [instance: 361a2044-8fd0-4975-8a19-814bf7a6da41] No waiting events found dispatching network-vif-plugged-dd85b227-3f3d-4f02-a323-661af6a9dc92 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:16:34 user nova-compute[85141]: WARNING nova.compute.manager [req-033d460d-e846-4bd9-a198-517b72e22c94 req-3e9a95a8-f26f-44a9-bb95-9047a110a381 service nova] [instance: 361a2044-8fd0-4975-8a19-814bf7a6da41] Received unexpected event network-vif-plugged-dd85b227-3f3d-4f02-a323-661af6a9dc92 for instance with vm_state deleted and task_state None.
Nov 16 10:16:34 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:16:34 user nova-compute[85141]: INFO os_vif [None req-cbfd3d6c-122b-4b36-89c6-bedb91efc016 tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:f3:cd,bridge_name='br-int',has_traffic_filtering=True,id=9b681ac7-3246-4ff4-8691-f8e4f1d62061,network=Network(ac11f3ed-4c14-4051-aff5-44d400d6368c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b681ac7-32')
Nov 16 10:16:34 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:16:34 user nova-compute[85141]: DEBUG nova.compute.provider_tree [None req-127e3e43-7166-4514-b043-b0787166f398 tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] Inventory has not changed in ProviderTree for provider: bf8e0fa1-16b6-408f-9203-c4cd63916272 {{(pid=85141) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 10:16:34 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:16:34 user nova-compute[85141]: DEBUG nova.scheduler.client.report [None req-127e3e43-7166-4514-b043-b0787166f398 tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] Inventory has not changed for provider bf8e0fa1-16b6-408f-9203-c4cd63916272 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=85141) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 10:16:34 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:16:34 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:16:34 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-127e3e43-7166-4514-b043-b0787166f398 tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.465s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:16:34 user nova-compute[85141]: INFO nova.scheduler.client.report [None req-127e3e43-7166-4514-b043-b0787166f398 tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] Deleted allocations for instance 361a2044-8fd0-4975-8a19-814bf7a6da41
Nov 16 10:16:34 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-127e3e43-7166-4514-b043-b0787166f398 tempest-VolumesAdminNegativeTest-1984071326 tempest-VolumesAdminNegativeTest-1984071326-project-member] Lock "361a2044-8fd0-4975-8a19-814bf7a6da41" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.442s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:16:35 user nova-compute[85141]: DEBUG nova.compute.manager [req-94631d22-69f2-4380-9571-8770e9cb30d5 req-a59eb336-cc7d-4170-a86b-a88be1edee59 service nova] [instance: 0c359f00-f4b7-43c3-8454-364842893779] Received event network-vif-plugged-97833d7f-68d7-4a6a-a283-83744d5afd10 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:16:35 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-94631d22-69f2-4380-9571-8770e9cb30d5 req-a59eb336-cc7d-4170-a86b-a88be1edee59 service nova] Acquiring lock "0c359f00-f4b7-43c3-8454-364842893779-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:16:35 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-94631d22-69f2-4380-9571-8770e9cb30d5 req-a59eb336-cc7d-4170-a86b-a88be1edee59 service nova] Lock "0c359f00-f4b7-43c3-8454-364842893779-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:16:35 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-94631d22-69f2-4380-9571-8770e9cb30d5 req-a59eb336-cc7d-4170-a86b-a88be1edee59 service nova] Lock "0c359f00-f4b7-43c3-8454-364842893779-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:16:35 user nova-compute[85141]: DEBUG nova.compute.manager [req-94631d22-69f2-4380-9571-8770e9cb30d5 req-a59eb336-cc7d-4170-a86b-a88be1edee59 service nova] [instance: 0c359f00-f4b7-43c3-8454-364842893779] No waiting events found dispatching network-vif-plugged-97833d7f-68d7-4a6a-a283-83744d5afd10 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:16:35 user nova-compute[85141]: WARNING nova.compute.manager [req-94631d22-69f2-4380-9571-8770e9cb30d5 req-a59eb336-cc7d-4170-a86b-a88be1edee59 service nova] [instance: 0c359f00-f4b7-43c3-8454-364842893779] Received unexpected event network-vif-plugged-97833d7f-68d7-4a6a-a283-83744d5afd10 for instance with vm_state building and task_state spawning.
Nov 16 10:16:35 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:16:35 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:16:35 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:16:35 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:16:35 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:16:35 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:16:35 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:16:36 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:16:36 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:16:36 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:16:36 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:16:36 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:16:36 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:16:36 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:16:36 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:16:36 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:16:36 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:16:37 user nova-compute[85141]: DEBUG nova.compute.manager [req-6e673050-ecaa-439d-bc79-d0a735063921 req-3fac6089-1a85-42d8-907b-e0ebc715a6e6 service nova] [instance: 0c359f00-f4b7-43c3-8454-364842893779] Received event network-vif-plugged-2243117f-44a8-4d51-8676-d67748b3c9aa {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:16:37 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-6e673050-ecaa-439d-bc79-d0a735063921 req-3fac6089-1a85-42d8-907b-e0ebc715a6e6 service nova] Acquiring lock "0c359f00-f4b7-43c3-8454-364842893779-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:16:37 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-6e673050-ecaa-439d-bc79-d0a735063921 req-3fac6089-1a85-42d8-907b-e0ebc715a6e6 service nova] Lock "0c359f00-f4b7-43c3-8454-364842893779-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:16:37 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-6e673050-ecaa-439d-bc79-d0a735063921 req-3fac6089-1a85-42d8-907b-e0ebc715a6e6 service nova] Lock "0c359f00-f4b7-43c3-8454-364842893779-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:16:37 user nova-compute[85141]: DEBUG nova.compute.manager [req-6e673050-ecaa-439d-bc79-d0a735063921 req-3fac6089-1a85-42d8-907b-e0ebc715a6e6 service nova] [instance: 0c359f00-f4b7-43c3-8454-364842893779] No waiting events found dispatching network-vif-plugged-2243117f-44a8-4d51-8676-d67748b3c9aa {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:16:37 user nova-compute[85141]: WARNING nova.compute.manager [req-6e673050-ecaa-439d-bc79-d0a735063921 req-3fac6089-1a85-42d8-907b-e0ebc715a6e6 service nova] [instance: 0c359f00-f4b7-43c3-8454-364842893779] Received unexpected event network-vif-plugged-2243117f-44a8-4d51-8676-d67748b3c9aa for instance with vm_state building and task_state spawning.
Nov 16 10:16:37 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:16:37 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:16:37 user nova-compute[85141]: DEBUG nova.compute.manager [req-917f08b6-a8d4-49f8-8089-3fa9f7dbff50 req-c69d3282-93d9-4c95-b634-ca222cfca14a service nova] [instance: 0c359f00-f4b7-43c3-8454-364842893779] Received event network-vif-plugged-97833d7f-68d7-4a6a-a283-83744d5afd10 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:16:37 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-917f08b6-a8d4-49f8-8089-3fa9f7dbff50 req-c69d3282-93d9-4c95-b634-ca222cfca14a service nova] Acquiring lock "0c359f00-f4b7-43c3-8454-364842893779-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:16:37 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-917f08b6-a8d4-49f8-8089-3fa9f7dbff50 req-c69d3282-93d9-4c95-b634-ca222cfca14a service nova] Lock "0c359f00-f4b7-43c3-8454-364842893779-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:16:37 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-917f08b6-a8d4-49f8-8089-3fa9f7dbff50 req-c69d3282-93d9-4c95-b634-ca222cfca14a service nova] Lock "0c359f00-f4b7-43c3-8454-364842893779-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:16:37 user nova-compute[85141]: DEBUG nova.compute.manager [req-917f08b6-a8d4-49f8-8089-3fa9f7dbff50 req-c69d3282-93d9-4c95-b634-ca222cfca14a service nova] [instance: 0c359f00-f4b7-43c3-8454-364842893779] No waiting events found dispatching network-vif-plugged-97833d7f-68d7-4a6a-a283-83744d5afd10 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:16:37 user nova-compute[85141]: WARNING nova.compute.manager [req-917f08b6-a8d4-49f8-8089-3fa9f7dbff50 req-c69d3282-93d9-4c95-b634-ca222cfca14a service nova] [instance: 0c359f00-f4b7-43c3-8454-364842893779] Received unexpected event network-vif-plugged-97833d7f-68d7-4a6a-a283-83744d5afd10 for instance with vm_state building and task_state spawning.
Nov 16 10:16:37 user nova-compute[85141]: DEBUG nova.compute.manager [req-917f08b6-a8d4-49f8-8089-3fa9f7dbff50 req-c69d3282-93d9-4c95-b634-ca222cfca14a service nova] [instance: 0c359f00-f4b7-43c3-8454-364842893779] Received event network-vif-plugged-da46c331-8f37-4473-9c17-7bcb1c691b65 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:16:37 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-917f08b6-a8d4-49f8-8089-3fa9f7dbff50 req-c69d3282-93d9-4c95-b634-ca222cfca14a service nova] Acquiring lock "0c359f00-f4b7-43c3-8454-364842893779-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:16:37 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-917f08b6-a8d4-49f8-8089-3fa9f7dbff50 req-c69d3282-93d9-4c95-b634-ca222cfca14a service nova] Lock "0c359f00-f4b7-43c3-8454-364842893779-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:16:37 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-917f08b6-a8d4-49f8-8089-3fa9f7dbff50 req-c69d3282-93d9-4c95-b634-ca222cfca14a service nova] Lock "0c359f00-f4b7-43c3-8454-364842893779-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:16:37 user nova-compute[85141]: DEBUG nova.compute.manager [req-917f08b6-a8d4-49f8-8089-3fa9f7dbff50 req-c69d3282-93d9-4c95-b634-ca222cfca14a service nova] [instance: 0c359f00-f4b7-43c3-8454-364842893779] No waiting events found dispatching network-vif-plugged-da46c331-8f37-4473-9c17-7bcb1c691b65 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:16:37 user nova-compute[85141]: WARNING nova.compute.manager [req-917f08b6-a8d4-49f8-8089-3fa9f7dbff50 req-c69d3282-93d9-4c95-b634-ca222cfca14a service nova] [instance: 0c359f00-f4b7-43c3-8454-364842893779] Received unexpected event network-vif-plugged-da46c331-8f37-4473-9c17-7bcb1c691b65 for instance with vm_state building and task_state spawning.
Nov 16 10:16:37 user nova-compute[85141]: DEBUG nova.compute.manager [req-917f08b6-a8d4-49f8-8089-3fa9f7dbff50 req-c69d3282-93d9-4c95-b634-ca222cfca14a service nova] [instance: 0c359f00-f4b7-43c3-8454-364842893779] Received event network-vif-plugged-da46c331-8f37-4473-9c17-7bcb1c691b65 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:16:37 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-917f08b6-a8d4-49f8-8089-3fa9f7dbff50 req-c69d3282-93d9-4c95-b634-ca222cfca14a service nova] Acquiring lock "0c359f00-f4b7-43c3-8454-364842893779-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:16:37 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-917f08b6-a8d4-49f8-8089-3fa9f7dbff50 req-c69d3282-93d9-4c95-b634-ca222cfca14a service nova] Lock "0c359f00-f4b7-43c3-8454-364842893779-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:16:37 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-917f08b6-a8d4-49f8-8089-3fa9f7dbff50 req-c69d3282-93d9-4c95-b634-ca222cfca14a service nova] Lock "0c359f00-f4b7-43c3-8454-364842893779-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:16:37 user nova-compute[85141]: DEBUG nova.compute.manager [req-917f08b6-a8d4-49f8-8089-3fa9f7dbff50 req-c69d3282-93d9-4c95-b634-ca222cfca14a service nova] [instance: 0c359f00-f4b7-43c3-8454-364842893779] No waiting events found dispatching network-vif-plugged-da46c331-8f37-4473-9c17-7bcb1c691b65 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:16:37 user nova-compute[85141]: WARNING nova.compute.manager [req-917f08b6-a8d4-49f8-8089-3fa9f7dbff50 req-c69d3282-93d9-4c95-b634-ca222cfca14a service nova] [instance: 0c359f00-f4b7-43c3-8454-364842893779] Received unexpected event network-vif-plugged-da46c331-8f37-4473-9c17-7bcb1c691b65 for instance with vm_state building and task_state spawning.
Nov 16 10:16:37 user nova-compute[85141]: DEBUG nova.compute.manager [req-917f08b6-a8d4-49f8-8089-3fa9f7dbff50 req-c69d3282-93d9-4c95-b634-ca222cfca14a service nova] [instance: 0c359f00-f4b7-43c3-8454-364842893779] Received event network-vif-plugged-5b1acf97-626c-4014-b463-5b4455f0f1e6 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:16:37 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-917f08b6-a8d4-49f8-8089-3fa9f7dbff50 req-c69d3282-93d9-4c95-b634-ca222cfca14a service nova] Acquiring lock "0c359f00-f4b7-43c3-8454-364842893779-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:16:37 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-917f08b6-a8d4-49f8-8089-3fa9f7dbff50 req-c69d3282-93d9-4c95-b634-ca222cfca14a service nova] Lock "0c359f00-f4b7-43c3-8454-364842893779-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:16:37 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-917f08b6-a8d4-49f8-8089-3fa9f7dbff50 req-c69d3282-93d9-4c95-b634-ca222cfca14a service nova] Lock "0c359f00-f4b7-43c3-8454-364842893779-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:16:37 user nova-compute[85141]: DEBUG nova.compute.manager [req-917f08b6-a8d4-49f8-8089-3fa9f7dbff50 req-c69d3282-93d9-4c95-b634-ca222cfca14a service nova] [instance: 0c359f00-f4b7-43c3-8454-364842893779] No waiting events found dispatching network-vif-plugged-5b1acf97-626c-4014-b463-5b4455f0f1e6 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:16:37 user nova-compute[85141]: WARNING nova.compute.manager [req-917f08b6-a8d4-49f8-8089-3fa9f7dbff50 req-c69d3282-93d9-4c95-b634-ca222cfca14a service nova] [instance: 0c359f00-f4b7-43c3-8454-364842893779] Received unexpected event network-vif-plugged-5b1acf97-626c-4014-b463-5b4455f0f1e6 for instance with vm_state building and task_state spawning.
Nov 16 10:16:37 user nova-compute[85141]: DEBUG nova.compute.manager [req-917f08b6-a8d4-49f8-8089-3fa9f7dbff50 req-c69d3282-93d9-4c95-b634-ca222cfca14a service nova] [instance: 0c359f00-f4b7-43c3-8454-364842893779] Received event network-vif-plugged-5b1acf97-626c-4014-b463-5b4455f0f1e6 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:16:37 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-917f08b6-a8d4-49f8-8089-3fa9f7dbff50 req-c69d3282-93d9-4c95-b634-ca222cfca14a service nova] Acquiring lock "0c359f00-f4b7-43c3-8454-364842893779-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:16:37 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-917f08b6-a8d4-49f8-8089-3fa9f7dbff50 req-c69d3282-93d9-4c95-b634-ca222cfca14a service nova] Lock "0c359f00-f4b7-43c3-8454-364842893779-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:16:37 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-917f08b6-a8d4-49f8-8089-3fa9f7dbff50 req-c69d3282-93d9-4c95-b634-ca222cfca14a service nova] Lock "0c359f00-f4b7-43c3-8454-364842893779-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:16:37 user nova-compute[85141]: DEBUG nova.compute.manager [req-917f08b6-a8d4-49f8-8089-3fa9f7dbff50 req-c69d3282-93d9-4c95-b634-ca222cfca14a service nova] [instance: 0c359f00-f4b7-43c3-8454-364842893779] No waiting events found dispatching network-vif-plugged-5b1acf97-626c-4014-b463-5b4455f0f1e6 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:16:37 user nova-compute[85141]: WARNING nova.compute.manager [req-917f08b6-a8d4-49f8-8089-3fa9f7dbff50 req-c69d3282-93d9-4c95-b634-ca222cfca14a service nova] [instance: 0c359f00-f4b7-43c3-8454-364842893779] Received unexpected event network-vif-plugged-5b1acf97-626c-4014-b463-5b4455f0f1e6 for instance with vm_state building and task_state spawning.
Nov 16 10:16:37 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:16:37 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:16:37 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:16:37 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:16:37 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:16:37 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:16:37 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:16:37 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:16:37 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:16:38 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:16:38 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:16:38 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:16:38 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:16:38 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:16:38 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:16:39 user nova-compute[85141]: DEBUG nova.compute.manager [req-c302de1e-9b06-4976-b302-49c9d9371a11 req-08af64b3-ecb2-4507-bb30-b8305d99c36c service nova] [instance: 0c359f00-f4b7-43c3-8454-364842893779] Received event network-vif-plugged-2243117f-44a8-4d51-8676-d67748b3c9aa {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:16:39 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-c302de1e-9b06-4976-b302-49c9d9371a11 req-08af64b3-ecb2-4507-bb30-b8305d99c36c service nova] Acquiring lock "0c359f00-f4b7-43c3-8454-364842893779-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:16:39 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-c302de1e-9b06-4976-b302-49c9d9371a11 req-08af64b3-ecb2-4507-bb30-b8305d99c36c service nova] Lock "0c359f00-f4b7-43c3-8454-364842893779-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:16:39 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-c302de1e-9b06-4976-b302-49c9d9371a11 req-08af64b3-ecb2-4507-bb30-b8305d99c36c service nova] Lock "0c359f00-f4b7-43c3-8454-364842893779-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:16:39 user nova-compute[85141]: DEBUG nova.compute.manager [req-c302de1e-9b06-4976-b302-49c9d9371a11 req-08af64b3-ecb2-4507-bb30-b8305d99c36c service nova] [instance: 0c359f00-f4b7-43c3-8454-364842893779] No waiting events found dispatching network-vif-plugged-2243117f-44a8-4d51-8676-d67748b3c9aa {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:16:39 user nova-compute[85141]: WARNING nova.compute.manager [req-c302de1e-9b06-4976-b302-49c9d9371a11 req-08af64b3-ecb2-4507-bb30-b8305d99c36c service nova] [instance: 0c359f00-f4b7-43c3-8454-364842893779] Received unexpected event network-vif-plugged-2243117f-44a8-4d51-8676-d67748b3c9aa for instance with vm_state building and task_state spawning.
Nov 16 10:16:39 user nova-compute[85141]: DEBUG nova.compute.manager [req-c302de1e-9b06-4976-b302-49c9d9371a11 req-08af64b3-ecb2-4507-bb30-b8305d99c36c service nova] [instance: 0c359f00-f4b7-43c3-8454-364842893779] Received event network-vif-plugged-8a0146a0-20fd-4879-be20-c8732bd6563c {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:16:39 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-c302de1e-9b06-4976-b302-49c9d9371a11 req-08af64b3-ecb2-4507-bb30-b8305d99c36c service nova] Acquiring lock "0c359f00-f4b7-43c3-8454-364842893779-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:16:39 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-c302de1e-9b06-4976-b302-49c9d9371a11 req-08af64b3-ecb2-4507-bb30-b8305d99c36c service nova] Lock "0c359f00-f4b7-43c3-8454-364842893779-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:16:39 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-c302de1e-9b06-4976-b302-49c9d9371a11 req-08af64b3-ecb2-4507-bb30-b8305d99c36c service nova] Lock "0c359f00-f4b7-43c3-8454-364842893779-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:16:39 user nova-compute[85141]: DEBUG nova.compute.manager [req-c302de1e-9b06-4976-b302-49c9d9371a11 req-08af64b3-ecb2-4507-bb30-b8305d99c36c service nova] [instance: 0c359f00-f4b7-43c3-8454-364842893779] No waiting events found dispatching network-vif-plugged-8a0146a0-20fd-4879-be20-c8732bd6563c {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:16:39 user nova-compute[85141]: WARNING nova.compute.manager [req-c302de1e-9b06-4976-b302-49c9d9371a11 req-08af64b3-ecb2-4507-bb30-b8305d99c36c service nova] [instance: 0c359f00-f4b7-43c3-8454-364842893779] Received unexpected event network-vif-plugged-8a0146a0-20fd-4879-be20-c8732bd6563c for instance with vm_state building and task_state spawning.
Nov 16 10:16:39 user nova-compute[85141]: DEBUG nova.compute.manager [req-c302de1e-9b06-4976-b302-49c9d9371a11 req-08af64b3-ecb2-4507-bb30-b8305d99c36c service nova] [instance: 0c359f00-f4b7-43c3-8454-364842893779] Received event network-vif-plugged-8a0146a0-20fd-4879-be20-c8732bd6563c {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:16:39 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-c302de1e-9b06-4976-b302-49c9d9371a11 req-08af64b3-ecb2-4507-bb30-b8305d99c36c service nova] Acquiring lock "0c359f00-f4b7-43c3-8454-364842893779-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:16:39 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-c302de1e-9b06-4976-b302-49c9d9371a11 req-08af64b3-ecb2-4507-bb30-b8305d99c36c service nova] Lock "0c359f00-f4b7-43c3-8454-364842893779-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:16:39 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-c302de1e-9b06-4976-b302-49c9d9371a11 req-08af64b3-ecb2-4507-bb30-b8305d99c36c service nova] Lock "0c359f00-f4b7-43c3-8454-364842893779-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:16:39 user nova-compute[85141]: DEBUG nova.compute.manager [req-c302de1e-9b06-4976-b302-49c9d9371a11 req-08af64b3-ecb2-4507-bb30-b8305d99c36c service nova] [instance: 0c359f00-f4b7-43c3-8454-364842893779] No waiting events found dispatching network-vif-plugged-8a0146a0-20fd-4879-be20-c8732bd6563c {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:16:39 user nova-compute[85141]: WARNING nova.compute.manager [req-c302de1e-9b06-4976-b302-49c9d9371a11 req-08af64b3-ecb2-4507-bb30-b8305d99c36c service nova] [instance: 0c359f00-f4b7-43c3-8454-364842893779] Received unexpected event network-vif-plugged-8a0146a0-20fd-4879-be20-c8732bd6563c for instance with vm_state building and task_state spawning.
Nov 16 10:16:39 user nova-compute[85141]: DEBUG nova.compute.manager [req-19a29d8d-6716-4739-90f0-328747af2b65 req-ce132d4a-ebfb-477a-b88a-620c617592c1 service nova] [instance: 0c359f00-f4b7-43c3-8454-364842893779] Received event network-vif-plugged-6d48ae8e-004c-459d-ad7c-081cc9228fee {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:16:39 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-19a29d8d-6716-4739-90f0-328747af2b65 req-ce132d4a-ebfb-477a-b88a-620c617592c1 service nova] Acquiring lock "0c359f00-f4b7-43c3-8454-364842893779-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:16:39 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-19a29d8d-6716-4739-90f0-328747af2b65 req-ce132d4a-ebfb-477a-b88a-620c617592c1 service nova] Lock "0c359f00-f4b7-43c3-8454-364842893779-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:16:39 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-19a29d8d-6716-4739-90f0-328747af2b65 req-ce132d4a-ebfb-477a-b88a-620c617592c1 service nova] Lock "0c359f00-f4b7-43c3-8454-364842893779-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:16:39 user nova-compute[85141]: DEBUG nova.compute.manager [req-19a29d8d-6716-4739-90f0-328747af2b65 req-ce132d4a-ebfb-477a-b88a-620c617592c1 service nova] [instance: 0c359f00-f4b7-43c3-8454-364842893779] No waiting events found dispatching network-vif-plugged-6d48ae8e-004c-459d-ad7c-081cc9228fee {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:16:39 user nova-compute[85141]: WARNING nova.compute.manager [req-19a29d8d-6716-4739-90f0-328747af2b65 req-ce132d4a-ebfb-477a-b88a-620c617592c1 service nova] [instance: 0c359f00-f4b7-43c3-8454-364842893779] Received unexpected event network-vif-plugged-6d48ae8e-004c-459d-ad7c-081cc9228fee for instance with vm_state building and task_state spawning.
Nov 16 10:16:39 user nova-compute[85141]: DEBUG nova.compute.manager [req-19a29d8d-6716-4739-90f0-328747af2b65 req-ce132d4a-ebfb-477a-b88a-620c617592c1 service nova] [instance: 0c359f00-f4b7-43c3-8454-364842893779] Received event network-vif-plugged-6d48ae8e-004c-459d-ad7c-081cc9228fee {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:16:39 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-19a29d8d-6716-4739-90f0-328747af2b65 req-ce132d4a-ebfb-477a-b88a-620c617592c1 service nova] Acquiring lock "0c359f00-f4b7-43c3-8454-364842893779-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:16:39 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-19a29d8d-6716-4739-90f0-328747af2b65 req-ce132d4a-ebfb-477a-b88a-620c617592c1 service nova] Lock "0c359f00-f4b7-43c3-8454-364842893779-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:16:39 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-19a29d8d-6716-4739-90f0-328747af2b65 req-ce132d4a-ebfb-477a-b88a-620c617592c1 service nova] Lock "0c359f00-f4b7-43c3-8454-364842893779-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:16:39 user nova-compute[85141]: DEBUG nova.compute.manager [req-19a29d8d-6716-4739-90f0-328747af2b65 req-ce132d4a-ebfb-477a-b88a-620c617592c1 service nova] [instance: 0c359f00-f4b7-43c3-8454-364842893779] No waiting events found dispatching network-vif-plugged-6d48ae8e-004c-459d-ad7c-081cc9228fee {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:16:39 user nova-compute[85141]: WARNING nova.compute.manager [req-19a29d8d-6716-4739-90f0-328747af2b65 req-ce132d4a-ebfb-477a-b88a-620c617592c1 service nova] [instance: 0c359f00-f4b7-43c3-8454-364842893779] Received unexpected event network-vif-plugged-6d48ae8e-004c-459d-ad7c-081cc9228fee for instance with vm_state building and task_state spawning.
Nov 16 10:16:39 user nova-compute[85141]: DEBUG nova.compute.manager [req-19a29d8d-6716-4739-90f0-328747af2b65 req-ce132d4a-ebfb-477a-b88a-620c617592c1 service nova] [instance: e65ccf79-718d-4eeb-8914-f0db2e2c9ce2] Received event network-vif-plugged-9b681ac7-3246-4ff4-8691-f8e4f1d62061 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:16:39 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-19a29d8d-6716-4739-90f0-328747af2b65 req-ce132d4a-ebfb-477a-b88a-620c617592c1 service nova] Acquiring lock "e65ccf79-718d-4eeb-8914-f0db2e2c9ce2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:16:39 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-19a29d8d-6716-4739-90f0-328747af2b65 req-ce132d4a-ebfb-477a-b88a-620c617592c1 service nova] Lock "e65ccf79-718d-4eeb-8914-f0db2e2c9ce2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:16:39 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-19a29d8d-6716-4739-90f0-328747af2b65 req-ce132d4a-ebfb-477a-b88a-620c617592c1 service nova] Lock "e65ccf79-718d-4eeb-8914-f0db2e2c9ce2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:16:39 user nova-compute[85141]: DEBUG nova.compute.manager [req-19a29d8d-6716-4739-90f0-328747af2b65 req-ce132d4a-ebfb-477a-b88a-620c617592c1 service nova] [instance: e65ccf79-718d-4eeb-8914-f0db2e2c9ce2] No waiting events found dispatching network-vif-plugged-9b681ac7-3246-4ff4-8691-f8e4f1d62061 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:16:39 user nova-compute[85141]: WARNING nova.compute.manager [req-19a29d8d-6716-4739-90f0-328747af2b65 req-ce132d4a-ebfb-477a-b88a-620c617592c1 service nova] [instance: e65ccf79-718d-4eeb-8914-f0db2e2c9ce2] Received unexpected event network-vif-plugged-9b681ac7-3246-4ff4-8691-f8e4f1d62061 for instance with vm_state resized and task_state resize_reverting.
Nov 16 10:16:39 user nova-compute[85141]: DEBUG nova.compute.manager [req-19a29d8d-6716-4739-90f0-328747af2b65 req-ce132d4a-ebfb-477a-b88a-620c617592c1 service nova] [instance: e65ccf79-718d-4eeb-8914-f0db2e2c9ce2] Received event network-vif-plugged-9b681ac7-3246-4ff4-8691-f8e4f1d62061 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:16:39 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-19a29d8d-6716-4739-90f0-328747af2b65 req-ce132d4a-ebfb-477a-b88a-620c617592c1 service nova] Acquiring lock "e65ccf79-718d-4eeb-8914-f0db2e2c9ce2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:16:39 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-19a29d8d-6716-4739-90f0-328747af2b65 req-ce132d4a-ebfb-477a-b88a-620c617592c1 service nova] Lock "e65ccf79-718d-4eeb-8914-f0db2e2c9ce2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:16:39 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-19a29d8d-6716-4739-90f0-328747af2b65 req-ce132d4a-ebfb-477a-b88a-620c617592c1 service nova] Lock "e65ccf79-718d-4eeb-8914-f0db2e2c9ce2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:16:39 user nova-compute[85141]: DEBUG nova.compute.manager [req-19a29d8d-6716-4739-90f0-328747af2b65 req-ce132d4a-ebfb-477a-b88a-620c617592c1 service nova] [instance: e65ccf79-718d-4eeb-8914-f0db2e2c9ce2] No waiting events found dispatching network-vif-plugged-9b681ac7-3246-4ff4-8691-f8e4f1d62061 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:16:39 user nova-compute[85141]: WARNING nova.compute.manager [req-19a29d8d-6716-4739-90f0-328747af2b65 req-ce132d4a-ebfb-477a-b88a-620c617592c1 service nova] [instance: e65ccf79-718d-4eeb-8914-f0db2e2c9ce2] Received unexpected event network-vif-plugged-9b681ac7-3246-4ff4-8691-f8e4f1d62061 for instance with vm_state resized and task_state resize_reverting.
Nov 16 10:16:39 user nova-compute[85141]: DEBUG nova.compute.manager [req-19a29d8d-6716-4739-90f0-328747af2b65 req-ce132d4a-ebfb-477a-b88a-620c617592c1 service nova] [instance: 0c359f00-f4b7-43c3-8454-364842893779] Received event network-vif-plugged-450233b4-a16d-4b2d-bc6a-a87736db7ff4 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:16:39 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-19a29d8d-6716-4739-90f0-328747af2b65 req-ce132d4a-ebfb-477a-b88a-620c617592c1 service nova] Acquiring lock "0c359f00-f4b7-43c3-8454-364842893779-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:16:39 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-19a29d8d-6716-4739-90f0-328747af2b65 req-ce132d4a-ebfb-477a-b88a-620c617592c1 service nova] Lock "0c359f00-f4b7-43c3-8454-364842893779-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:16:39 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-19a29d8d-6716-4739-90f0-328747af2b65 req-ce132d4a-ebfb-477a-b88a-620c617592c1 service nova] Lock "0c359f00-f4b7-43c3-8454-364842893779-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:16:39 user nova-compute[85141]: DEBUG nova.compute.manager [req-19a29d8d-6716-4739-90f0-328747af2b65 req-ce132d4a-ebfb-477a-b88a-620c617592c1 service nova] [instance: 0c359f00-f4b7-43c3-8454-364842893779] No waiting events found dispatching network-vif-plugged-450233b4-a16d-4b2d-bc6a-a87736db7ff4 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:16:39 user nova-compute[85141]: WARNING nova.compute.manager [req-19a29d8d-6716-4739-90f0-328747af2b65 req-ce132d4a-ebfb-477a-b88a-620c617592c1 service nova] [instance: 0c359f00-f4b7-43c3-8454-364842893779] Received unexpected event network-vif-plugged-450233b4-a16d-4b2d-bc6a-a87736db7ff4 for instance with vm_state building and task_state spawning.
Nov 16 10:16:39 user nova-compute[85141]: DEBUG nova.compute.manager [req-19a29d8d-6716-4739-90f0-328747af2b65 req-ce132d4a-ebfb-477a-b88a-620c617592c1 service nova] [instance: 0c359f00-f4b7-43c3-8454-364842893779] Received event network-vif-plugged-450233b4-a16d-4b2d-bc6a-a87736db7ff4 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:16:39 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-19a29d8d-6716-4739-90f0-328747af2b65 req-ce132d4a-ebfb-477a-b88a-620c617592c1 service nova] Acquiring lock "0c359f00-f4b7-43c3-8454-364842893779-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:16:39 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-19a29d8d-6716-4739-90f0-328747af2b65 req-ce132d4a-ebfb-477a-b88a-620c617592c1 service nova] Lock "0c359f00-f4b7-43c3-8454-364842893779-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:16:39 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-19a29d8d-6716-4739-90f0-328747af2b65 req-ce132d4a-ebfb-477a-b88a-620c617592c1 service nova] Lock "0c359f00-f4b7-43c3-8454-364842893779-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:16:39 user nova-compute[85141]: DEBUG nova.compute.manager [req-19a29d8d-6716-4739-90f0-328747af2b65 req-ce132d4a-ebfb-477a-b88a-620c617592c1 service nova] [instance: 0c359f00-f4b7-43c3-8454-364842893779] No waiting events found dispatching network-vif-plugged-450233b4-a16d-4b2d-bc6a-a87736db7ff4 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:16:39 user nova-compute[85141]: WARNING nova.compute.manager [req-19a29d8d-6716-4739-90f0-328747af2b65 req-ce132d4a-ebfb-477a-b88a-620c617592c1 service nova] [instance: 0c359f00-f4b7-43c3-8454-364842893779] Received unexpected event network-vif-plugged-450233b4-a16d-4b2d-bc6a-a87736db7ff4 for instance with vm_state building and task_state spawning.
Nov 16 10:16:39 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:16:39 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:16:39 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:16:39 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:16:39 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:16:39 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:16:40 user nova-compute[85141]: DEBUG nova.compute.manager [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] [instance: 0c359f00-f4b7-43c3-8454-364842893779] Instance event wait completed in 0 seconds for  {{(pid=85141) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 10:16:40 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] [instance: 0c359f00-f4b7-43c3-8454-364842893779] Guest created on hypervisor {{(pid=85141) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 10:16:40 user nova-compute[85141]: INFO nova.virt.libvirt.driver [-] [instance: 0c359f00-f4b7-43c3-8454-364842893779] Instance spawned successfully.
Nov 16 10:16:40 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] [instance: 0c359f00-f4b7-43c3-8454-364842893779] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 10:16:40 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] [instance: 0c359f00-f4b7-43c3-8454-364842893779] Found default for hw_cdrom_bus of ide {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:16:40 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] [instance: 0c359f00-f4b7-43c3-8454-364842893779] Found default for hw_disk_bus of virtio {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:16:40 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] [instance: 0c359f00-f4b7-43c3-8454-364842893779] Found default for hw_input_bus of None {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:16:40 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] [instance: 0c359f00-f4b7-43c3-8454-364842893779] Found default for hw_pointer_model of None {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:16:40 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] [instance: 0c359f00-f4b7-43c3-8454-364842893779] Found default for hw_video_model of virtio {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:16:40 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] [instance: 0c359f00-f4b7-43c3-8454-364842893779] Found default for hw_vif_model of virtio {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:16:40 user nova-compute[85141]: DEBUG nova.compute.manager [None req-cbfd3d6c-122b-4b36-89c6-bedb91efc016 tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] [instance: e65ccf79-718d-4eeb-8914-f0db2e2c9ce2] Instance event wait completed in 0 seconds for  {{(pid=85141) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 10:16:40 user nova-compute[85141]: INFO nova.virt.libvirt.driver [-] [instance: e65ccf79-718d-4eeb-8914-f0db2e2c9ce2] Instance running successfully.
Nov 16 10:16:40 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-cbfd3d6c-122b-4b36-89c6-bedb91efc016 tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] [instance: e65ccf79-718d-4eeb-8914-f0db2e2c9ce2] finish_revert_migration finished successfully. {{(pid=85141) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11863}}
Nov 16 10:16:40 user nova-compute[85141]: INFO nova.compute.manager [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] [instance: 0c359f00-f4b7-43c3-8454-364842893779] Took 13.83 seconds to spawn the instance on the hypervisor.
Nov 16 10:16:40 user nova-compute[85141]: DEBUG nova.compute.manager [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] [instance: 0c359f00-f4b7-43c3-8454-364842893779] Checking state {{(pid=85141) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 10:16:40 user nova-compute[85141]: INFO nova.compute.manager [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] [instance: 0c359f00-f4b7-43c3-8454-364842893779] Took 39.16 seconds to build instance.
Nov 16 10:16:41 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-82be9e6e-10f4-4bb8-9866-9bfd38718854 tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] Lock "0c359f00-f4b7-43c3-8454-364842893779" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 39.277s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:16:41 user nova-compute[85141]: INFO nova.compute.manager [None req-cbfd3d6c-122b-4b36-89c6-bedb91efc016 tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] [instance: e65ccf79-718d-4eeb-8914-f0db2e2c9ce2] Updating instance to original state: 'active'
Nov 16 10:16:42 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:16:44 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:16:49 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._sync_power_states {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:16:49 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:16:49 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Triggering sync for uuid d842f90e-663b-4c95-9d7c-d092d2bac41f {{(pid=85141) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 16 10:16:49 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Triggering sync for uuid e65ccf79-718d-4eeb-8914-f0db2e2c9ce2 {{(pid=85141) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 16 10:16:49 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Triggering sync for uuid f01dc8cf-1a69-4618-a15d-0c1075157f05 {{(pid=85141) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 16 10:16:49 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Triggering sync for uuid 059d6974-bd0c-4f73-91fc-8202ebda4238 {{(pid=85141) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 16 10:16:49 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Triggering sync for uuid 4e214bbb-5bbb-4e6f-ac09-9cb1412f068b {{(pid=85141) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 16 10:16:49 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Triggering sync for uuid b24c3954-06ff-4e15-9e43-c65d1dae7a5d {{(pid=85141) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 16 10:16:49 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Triggering sync for uuid fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f {{(pid=85141) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 16 10:16:49 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Triggering sync for uuid 0c359f00-f4b7-43c3-8454-364842893779 {{(pid=85141) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 16 10:16:49 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Triggering sync for uuid 9411843f-4e79-46c4-ae02-01f5e87b86eb {{(pid=85141) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 16 10:16:49 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Acquiring lock "d842f90e-663b-4c95-9d7c-d092d2bac41f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:16:49 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "d842f90e-663b-4c95-9d7c-d092d2bac41f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:16:49 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Acquiring lock "e65ccf79-718d-4eeb-8914-f0db2e2c9ce2" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:16:49 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "e65ccf79-718d-4eeb-8914-f0db2e2c9ce2" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:16:49 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Acquiring lock "f01dc8cf-1a69-4618-a15d-0c1075157f05" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:16:49 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "f01dc8cf-1a69-4618-a15d-0c1075157f05" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:16:49 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Acquiring lock "059d6974-bd0c-4f73-91fc-8202ebda4238" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:16:49 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "059d6974-bd0c-4f73-91fc-8202ebda4238" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:16:49 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Acquiring lock "4e214bbb-5bbb-4e6f-ac09-9cb1412f068b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:16:49 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "4e214bbb-5bbb-4e6f-ac09-9cb1412f068b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:16:49 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Acquiring lock "b24c3954-06ff-4e15-9e43-c65d1dae7a5d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:16:49 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "b24c3954-06ff-4e15-9e43-c65d1dae7a5d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:16:49 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Acquiring lock "fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:16:49 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:16:49 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Acquiring lock "0c359f00-f4b7-43c3-8454-364842893779" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:16:49 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "0c359f00-f4b7-43c3-8454-364842893779" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:16:49 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Acquiring lock "9411843f-4e79-46c4-ae02-01f5e87b86eb" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:16:49 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "9411843f-4e79-46c4-ae02-01f5e87b86eb" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:16:49 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "e65ccf79-718d-4eeb-8914-f0db2e2c9ce2" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.083s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:16:49 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "b24c3954-06ff-4e15-9e43-c65d1dae7a5d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.088s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:16:49 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "4e214bbb-5bbb-4e6f-ac09-9cb1412f068b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.090s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:16:49 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "9411843f-4e79-46c4-ae02-01f5e87b86eb" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.096s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:16:49 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "f01dc8cf-1a69-4618-a15d-0c1075157f05" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.112s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:16:49 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "0c359f00-f4b7-43c3-8454-364842893779" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.109s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:16:49 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "d842f90e-663b-4c95-9d7c-d092d2bac41f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.131s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:16:49 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "059d6974-bd0c-4f73-91fc-8202ebda4238" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.135s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:16:49 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.157s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:16:54 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:16:54 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:16:54 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=85141) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 10:16:54 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=85141) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 10:16:54 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=85141) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 10:16:54 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:16:55 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-c8718137-e210-4b36-b323-8b6a0c528db2 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Acquiring lock "9411843f-4e79-46c4-ae02-01f5e87b86eb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:16:55 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-c8718137-e210-4b36-b323-8b6a0c528db2 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Lock "9411843f-4e79-46c4-ae02-01f5e87b86eb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:16:55 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-c8718137-e210-4b36-b323-8b6a0c528db2 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Acquiring lock "9411843f-4e79-46c4-ae02-01f5e87b86eb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:16:55 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-c8718137-e210-4b36-b323-8b6a0c528db2 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Lock "9411843f-4e79-46c4-ae02-01f5e87b86eb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:16:55 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-c8718137-e210-4b36-b323-8b6a0c528db2 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Lock "9411843f-4e79-46c4-ae02-01f5e87b86eb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:16:55 user nova-compute[85141]: INFO nova.compute.manager [None req-c8718137-e210-4b36-b323-8b6a0c528db2 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] [instance: 9411843f-4e79-46c4-ae02-01f5e87b86eb] Terminating instance
Nov 16 10:16:55 user nova-compute[85141]: DEBUG nova.compute.manager [None req-c8718137-e210-4b36-b323-8b6a0c528db2 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] [instance: 9411843f-4e79-46c4-ae02-01f5e87b86eb] Start destroying the instance on the hypervisor. {{(pid=85141) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 10:16:56 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:16:56 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:16:56 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:16:56 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:16:56 user nova-compute[85141]: DEBUG nova.compute.manager [req-0a8423b6-7140-4934-aec9-0e1855ec902f req-abca3db0-b600-4c78-9273-9a7c3255ae3a service nova] [instance: 9411843f-4e79-46c4-ae02-01f5e87b86eb] Received event network-vif-unplugged-1202aa6f-6442-4e95-bf51-66f977a23e01 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:16:56 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-0a8423b6-7140-4934-aec9-0e1855ec902f req-abca3db0-b600-4c78-9273-9a7c3255ae3a service nova] Acquiring lock "9411843f-4e79-46c4-ae02-01f5e87b86eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:16:56 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-0a8423b6-7140-4934-aec9-0e1855ec902f req-abca3db0-b600-4c78-9273-9a7c3255ae3a service nova] Lock "9411843f-4e79-46c4-ae02-01f5e87b86eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:16:56 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-0a8423b6-7140-4934-aec9-0e1855ec902f req-abca3db0-b600-4c78-9273-9a7c3255ae3a service nova] Lock "9411843f-4e79-46c4-ae02-01f5e87b86eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:16:56 user nova-compute[85141]: DEBUG nova.compute.manager [req-0a8423b6-7140-4934-aec9-0e1855ec902f req-abca3db0-b600-4c78-9273-9a7c3255ae3a service nova] [instance: 9411843f-4e79-46c4-ae02-01f5e87b86eb] No waiting events found dispatching network-vif-unplugged-1202aa6f-6442-4e95-bf51-66f977a23e01 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:16:56 user nova-compute[85141]: DEBUG nova.compute.manager [req-0a8423b6-7140-4934-aec9-0e1855ec902f req-abca3db0-b600-4c78-9273-9a7c3255ae3a service nova] [instance: 9411843f-4e79-46c4-ae02-01f5e87b86eb] Received event network-vif-unplugged-1202aa6f-6442-4e95-bf51-66f977a23e01 for instance with task_state deleting. {{(pid=85141) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 10:16:57 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:16:57 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:16:58 user nova-compute[85141]: INFO nova.virt.libvirt.driver [-] [instance: 9411843f-4e79-46c4-ae02-01f5e87b86eb] Instance destroyed successfully.
Nov 16 10:16:58 user nova-compute[85141]: DEBUG nova.objects.instance [None req-c8718137-e210-4b36-b323-8b6a0c528db2 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Lazy-loading 'resources' on Instance uuid 9411843f-4e79-46c4-ae02-01f5e87b86eb {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:16:58 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-c8718137-e210-4b36-b323-8b6a0c528db2 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-16T10:10:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1837935474',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1837935474',id=2,image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDZ6OQWFvlLe2wQphLZxkaPqNwOm4LuvszQn47QWt1pnsQT48lGZZPuN+vNqHjXg4YMzV5iYuL9EDBblOYEFH3rsRxMRAcwHPoeiCg27oMofk7nAiSjMmEYKp5XhsvlmDA==',key_name='tempest-keypair-1893617844',keypairs=<?>,launch_index=0,launched_at=2023-11-16T10:14:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='08ef12fb41a14ecd8abb84d4d69b7c27',ramdisk_id='',reservation_id='r-g9gqfs85',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-958501663',owner_user_name='tempest-AttachVolumeShelveTestJSON-958501663-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T10:14:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='baec48c887ae4a418e0ea7b32b05bc59',uuid=9411843f-4e79-46c4-ae02-01f5e87b86eb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1202aa6f-6442-4e95-bf51-66f977a23e01", "address": "fa:16:3e:d8:53:c3", "network": {"id": "4fb7c85e-c966-481d-b6f2-856a17ac8f7c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-81570496-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08ef12fb41a14ecd8abb84d4d69b7c27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1202aa6f-64", "ovs_interfaceid": "1202aa6f-6442-4e95-bf51-66f977a23e01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 10:16:58 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-c8718137-e210-4b36-b323-8b6a0c528db2 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Converting VIF {"id": "1202aa6f-6442-4e95-bf51-66f977a23e01", "address": "fa:16:3e:d8:53:c3", "network": {"id": "4fb7c85e-c966-481d-b6f2-856a17ac8f7c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-81570496-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08ef12fb41a14ecd8abb84d4d69b7c27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1202aa6f-64", "ovs_interfaceid": "1202aa6f-6442-4e95-bf51-66f977a23e01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:16:58 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-c8718137-e210-4b36-b323-8b6a0c528db2 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d8:53:c3,bridge_name='br-int',has_traffic_filtering=True,id=1202aa6f-6442-4e95-bf51-66f977a23e01,network=Network(4fb7c85e-c966-481d-b6f2-856a17ac8f7c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1202aa6f-64') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:16:58 user nova-compute[85141]: DEBUG os_vif [None req-c8718137-e210-4b36-b323-8b6a0c528db2 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:53:c3,bridge_name='br-int',has_traffic_filtering=True,id=1202aa6f-6442-4e95-bf51-66f977a23e01,network=Network(4fb7c85e-c966-481d-b6f2-856a17ac8f7c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1202aa6f-64') {{(pid=85141) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 10:16:58 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:16:58 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1202aa6f-64, bridge=br-int, if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:16:58 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:16:58 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:16:58 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:16:58 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bf0d1ddb-8a60-4f0c-96a5-c665c0a4d65d) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:16:58 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:16:58 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:16:58 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:16:58 user nova-compute[85141]: INFO os_vif [None req-c8718137-e210-4b36-b323-8b6a0c528db2 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:53:c3,bridge_name='br-int',has_traffic_filtering=True,id=1202aa6f-6442-4e95-bf51-66f977a23e01,network=Network(4fb7c85e-c966-481d-b6f2-856a17ac8f7c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1202aa6f-64')
Nov 16 10:16:58 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-c8718137-e210-4b36-b323-8b6a0c528db2 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] [instance: 9411843f-4e79-46c4-ae02-01f5e87b86eb] Deleting instance files /opt/stack/data/nova/instances/9411843f-4e79-46c4-ae02-01f5e87b86eb_del
Nov 16 10:16:58 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-c8718137-e210-4b36-b323-8b6a0c528db2 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] [instance: 9411843f-4e79-46c4-ae02-01f5e87b86eb] Deletion of /opt/stack/data/nova/instances/9411843f-4e79-46c4-ae02-01f5e87b86eb_del complete
Nov 16 10:16:58 user nova-compute[85141]: INFO nova.compute.manager [None req-c8718137-e210-4b36-b323-8b6a0c528db2 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] [instance: 9411843f-4e79-46c4-ae02-01f5e87b86eb] Took 2.73 seconds to destroy the instance on the hypervisor.
Nov 16 10:16:58 user nova-compute[85141]: DEBUG oslo.service.loopingcall [None req-c8718137-e210-4b36-b323-8b6a0c528db2 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=85141) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 10:16:58 user nova-compute[85141]: DEBUG nova.compute.manager [-] [instance: 9411843f-4e79-46c4-ae02-01f5e87b86eb] Deallocating network for instance {{(pid=85141) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 10:16:58 user nova-compute[85141]: DEBUG nova.network.neutron [-] [instance: 9411843f-4e79-46c4-ae02-01f5e87b86eb] deallocate_for_instance() {{(pid=85141) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 10:16:58 user nova-compute[85141]: DEBUG nova.compute.manager [req-46c2b14f-df28-40f2-85a6-c81dd5bbbbbc req-6162f487-de53-4b1f-be24-508f99dcaa83 service nova] [instance: 9411843f-4e79-46c4-ae02-01f5e87b86eb] Received event network-vif-plugged-1202aa6f-6442-4e95-bf51-66f977a23e01 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:16:58 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-46c2b14f-df28-40f2-85a6-c81dd5bbbbbc req-6162f487-de53-4b1f-be24-508f99dcaa83 service nova] Acquiring lock "9411843f-4e79-46c4-ae02-01f5e87b86eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:16:58 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-46c2b14f-df28-40f2-85a6-c81dd5bbbbbc req-6162f487-de53-4b1f-be24-508f99dcaa83 service nova] Lock "9411843f-4e79-46c4-ae02-01f5e87b86eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:16:58 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-46c2b14f-df28-40f2-85a6-c81dd5bbbbbc req-6162f487-de53-4b1f-be24-508f99dcaa83 service nova] Lock "9411843f-4e79-46c4-ae02-01f5e87b86eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:16:58 user nova-compute[85141]: DEBUG nova.compute.manager [req-46c2b14f-df28-40f2-85a6-c81dd5bbbbbc req-6162f487-de53-4b1f-be24-508f99dcaa83 service nova] [instance: 9411843f-4e79-46c4-ae02-01f5e87b86eb] No waiting events found dispatching network-vif-plugged-1202aa6f-6442-4e95-bf51-66f977a23e01 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:16:58 user nova-compute[85141]: WARNING nova.compute.manager [req-46c2b14f-df28-40f2-85a6-c81dd5bbbbbc req-6162f487-de53-4b1f-be24-508f99dcaa83 service nova] [instance: 9411843f-4e79-46c4-ae02-01f5e87b86eb] Received unexpected event network-vif-plugged-1202aa6f-6442-4e95-bf51-66f977a23e01 for instance with vm_state active and task_state deleting.
Nov 16 10:16:59 user nova-compute[85141]: DEBUG nova.network.neutron [-] [instance: 9411843f-4e79-46c4-ae02-01f5e87b86eb] Updating instance_info_cache with network_info: [] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:16:59 user nova-compute[85141]: INFO nova.compute.manager [-] [instance: 9411843f-4e79-46c4-ae02-01f5e87b86eb] Took 0.84 seconds to deallocate network for instance.
Nov 16 10:16:59 user nova-compute[85141]: DEBUG nova.compute.manager [req-05a72106-c68b-4a16-bd65-4a238c29dae8 req-3262aafd-b3cb-4a0f-8400-cbc82ff7800a service nova] [instance: 9411843f-4e79-46c4-ae02-01f5e87b86eb] Received event network-vif-deleted-1202aa6f-6442-4e95-bf51-66f977a23e01 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:16:59 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-c8718137-e210-4b36-b323-8b6a0c528db2 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:16:59 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-c8718137-e210-4b36-b323-8b6a0c528db2 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:16:59 user nova-compute[85141]: DEBUG nova.compute.provider_tree [None req-c8718137-e210-4b36-b323-8b6a0c528db2 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Inventory has not changed in ProviderTree for provider: bf8e0fa1-16b6-408f-9203-c4cd63916272 {{(pid=85141) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 10:16:59 user nova-compute[85141]: DEBUG nova.scheduler.client.report [None req-c8718137-e210-4b36-b323-8b6a0c528db2 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Inventory has not changed for provider bf8e0fa1-16b6-408f-9203-c4cd63916272 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=85141) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 10:16:59 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-c8718137-e210-4b36-b323-8b6a0c528db2 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.384s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:16:59 user nova-compute[85141]: INFO nova.scheduler.client.report [None req-c8718137-e210-4b36-b323-8b6a0c528db2 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Deleted allocations for instance 9411843f-4e79-46c4-ae02-01f5e87b86eb
Nov 16 10:17:00 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-c8718137-e210-4b36-b323-8b6a0c528db2 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Lock "9411843f-4e79-46c4-ae02-01f5e87b86eb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.270s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:17:02 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:17:03 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:17:06 user nova-compute[85141]: INFO nova.compute.manager [None req-d1b4c9fe-9abe-4a10-9905-1f8640d073ec tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] [instance: b24c3954-06ff-4e15-9e43-c65d1dae7a5d] Rescuing
Nov 16 10:17:06 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-d1b4c9fe-9abe-4a10-9905-1f8640d073ec tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Acquiring lock "refresh_cache-b24c3954-06ff-4e15-9e43-c65d1dae7a5d" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:17:06 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-d1b4c9fe-9abe-4a10-9905-1f8640d073ec tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Acquired lock "refresh_cache-b24c3954-06ff-4e15-9e43-c65d1dae7a5d" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:17:06 user nova-compute[85141]: DEBUG nova.network.neutron [None req-d1b4c9fe-9abe-4a10-9905-1f8640d073ec tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] [instance: b24c3954-06ff-4e15-9e43-c65d1dae7a5d] Building network info cache for instance {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 10:17:06 user nova-compute[85141]: DEBUG nova.network.neutron [None req-d1b4c9fe-9abe-4a10-9905-1f8640d073ec tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] [instance: b24c3954-06ff-4e15-9e43-c65d1dae7a5d] Updating instance_info_cache with network_info: [{"id": "6becb779-bd08-4a40-bb56-3b8f03d1f844", "address": "fa:16:3e:ca:42:7f", "network": {"id": "5b67a3fd-ef1e-4f2c-b6e0-31766ef39d30", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2137186235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09b520de67ac4290a4b779f50afeb1a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6becb779-bd", "ovs_interfaceid": "6becb779-bd08-4a40-bb56-3b8f03d1f844", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:17:06 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-d1b4c9fe-9abe-4a10-9905-1f8640d073ec tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Releasing lock "refresh_cache-b24c3954-06ff-4e15-9e43-c65d1dae7a5d" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:17:07 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:17:07 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:17:07 user nova-compute[85141]: DEBUG nova.compute.manager [req-e7a7211b-bc41-4513-a178-b12f9c1d27c3 req-84895cc0-a45e-4d97-ae60-f1ce098d3caa service nova] [instance: b24c3954-06ff-4e15-9e43-c65d1dae7a5d] Received event network-vif-unplugged-6becb779-bd08-4a40-bb56-3b8f03d1f844 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:17:07 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-e7a7211b-bc41-4513-a178-b12f9c1d27c3 req-84895cc0-a45e-4d97-ae60-f1ce098d3caa service nova] Acquiring lock "b24c3954-06ff-4e15-9e43-c65d1dae7a5d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:17:07 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-e7a7211b-bc41-4513-a178-b12f9c1d27c3 req-84895cc0-a45e-4d97-ae60-f1ce098d3caa service nova] Lock "b24c3954-06ff-4e15-9e43-c65d1dae7a5d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:17:07 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-e7a7211b-bc41-4513-a178-b12f9c1d27c3 req-84895cc0-a45e-4d97-ae60-f1ce098d3caa service nova] Lock "b24c3954-06ff-4e15-9e43-c65d1dae7a5d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:17:07 user nova-compute[85141]: DEBUG nova.compute.manager [req-e7a7211b-bc41-4513-a178-b12f9c1d27c3 req-84895cc0-a45e-4d97-ae60-f1ce098d3caa service nova] [instance: b24c3954-06ff-4e15-9e43-c65d1dae7a5d] No waiting events found dispatching network-vif-unplugged-6becb779-bd08-4a40-bb56-3b8f03d1f844 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:17:07 user nova-compute[85141]: WARNING nova.compute.manager [req-e7a7211b-bc41-4513-a178-b12f9c1d27c3 req-84895cc0-a45e-4d97-ae60-f1ce098d3caa service nova] [instance: b24c3954-06ff-4e15-9e43-c65d1dae7a5d] Received unexpected event network-vif-unplugged-6becb779-bd08-4a40-bb56-3b8f03d1f844 for instance with vm_state active and task_state rescuing.
Nov 16 10:17:07 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:17:07 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:17:07 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:17:07 user nova-compute[85141]: INFO nova.virt.libvirt.driver [-] [instance: b24c3954-06ff-4e15-9e43-c65d1dae7a5d] Instance destroyed successfully.
Nov 16 10:17:07 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-d1b4c9fe-9abe-4a10-9905-1f8640d073ec tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] [instance: b24c3954-06ff-4e15-9e43-c65d1dae7a5d] Attempting rescue
Nov 16 10:17:07 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-d1b4c9fe-9abe-4a10-9905-1f8640d073ec tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=85141) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 16 10:17:07 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-d1b4c9fe-9abe-4a10-9905-1f8640d073ec tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] [instance: b24c3954-06ff-4e15-9e43-c65d1dae7a5d] Instance directory exists: not creating {{(pid=85141) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 16 10:17:07 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-d1b4c9fe-9abe-4a10-9905-1f8640d073ec tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] [instance: b24c3954-06ff-4e15-9e43-c65d1dae7a5d] Creating image(s)
Nov 16 10:17:07 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-d1b4c9fe-9abe-4a10-9905-1f8640d073ec tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Acquiring lock "/opt/stack/data/nova/instances/b24c3954-06ff-4e15-9e43-c65d1dae7a5d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:17:07 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-d1b4c9fe-9abe-4a10-9905-1f8640d073ec tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Lock "/opt/stack/data/nova/instances/b24c3954-06ff-4e15-9e43-c65d1dae7a5d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:17:07 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-d1b4c9fe-9abe-4a10-9905-1f8640d073ec tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Lock "/opt/stack/data/nova/instances/b24c3954-06ff-4e15-9e43-c65d1dae7a5d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:17:07 user nova-compute[85141]: DEBUG nova.objects.instance [None req-d1b4c9fe-9abe-4a10-9905-1f8640d073ec tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Lazy-loading 'trusted_certs' on Instance uuid b24c3954-06ff-4e15-9e43-c65d1dae7a5d {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:17:07 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-d1b4c9fe-9abe-4a10-9905-1f8640d073ec tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Acquiring lock "60a78556fb399ed4a41bc3ca4bccf77c96d8e811" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:17:07 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-d1b4c9fe-9abe-4a10-9905-1f8640d073ec tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Lock "60a78556fb399ed4a41bc3ca4bccf77c96d8e811" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:17:07 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-d1b4c9fe-9abe-4a10-9905-1f8640d073ec tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:17:07 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-d1b4c9fe-9abe-4a10-9905-1f8640d073ec tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json" returned: 0 in 0.205s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:17:07 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-d1b4c9fe-9abe-4a10-9905-1f8640d073ec tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811,backing_fmt=raw /opt/stack/data/nova/instances/b24c3954-06ff-4e15-9e43-c65d1dae7a5d/disk.rescue {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:17:07 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-d1b4c9fe-9abe-4a10-9905-1f8640d073ec tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811,backing_fmt=raw /opt/stack/data/nova/instances/b24c3954-06ff-4e15-9e43-c65d1dae7a5d/disk.rescue" returned: 0 in 0.058s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:17:07 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-d1b4c9fe-9abe-4a10-9905-1f8640d073ec tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Lock "60a78556fb399ed4a41bc3ca4bccf77c96d8e811" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.272s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:17:07 user nova-compute[85141]: DEBUG nova.objects.instance [None req-d1b4c9fe-9abe-4a10-9905-1f8640d073ec tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Lazy-loading 'migration_context' on Instance uuid b24c3954-06ff-4e15-9e43-c65d1dae7a5d {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:17:07 user nova-compute[85141]: DEBUG nova.objects.base [None req-d1b4c9fe-9abe-4a10-9905-1f8640d073ec tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Object Instance<b24c3954-06ff-4e15-9e43-c65d1dae7a5d> lazy-loaded attributes: trusted_certs,migration_context {{(pid=85141) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 10:17:07 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-d1b4c9fe-9abe-4a10-9905-1f8640d073ec tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] [instance: b24c3954-06ff-4e15-9e43-c65d1dae7a5d] Created local disks {{(pid=85141) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 10:17:07 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-d1b4c9fe-9abe-4a10-9905-1f8640d073ec tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] [instance: b24c3954-06ff-4e15-9e43-c65d1dae7a5d] Start _get_guest_xml network_info=[{"id": "6becb779-bd08-4a40-bb56-3b8f03d1f844", "address": "fa:16:3e:ca:42:7f", "network": {"id": "5b67a3fd-ef1e-4f2c-b6e0-31766ef39d30", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2137186235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-2137186235-network", "vif_mac": "fa:16:3e:ca:42:7f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09b520de67ac4290a4b779f50afeb1a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6becb779-bd", "ovs_interfaceid": "6becb779-bd08-4a40-bb56-3b8f03d1f844", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T10:06:42Z,direct_url=<?>,disk_format='qcow2',id=bc4ca70f-a459-4d5c-a9e6-80f1948eb48b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1044631a5fe84ce8904864a7024049fa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T10:06:44Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'bc4ca70f-a459-4d5c-a9e6-80f1948eb48b', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=85141) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 10:17:07 user nova-compute[85141]: DEBUG nova.objects.instance [None req-d1b4c9fe-9abe-4a10-9905-1f8640d073ec tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Lazy-loading 'resources' on Instance uuid b24c3954-06ff-4e15-9e43-c65d1dae7a5d {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:17:07 user nova-compute[85141]: DEBUG nova.objects.base [None req-d1b4c9fe-9abe-4a10-9905-1f8640d073ec tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Object Instance<b24c3954-06ff-4e15-9e43-c65d1dae7a5d> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=85141) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 10:17:07 user nova-compute[85141]: DEBUG nova.objects.instance [None req-d1b4c9fe-9abe-4a10-9905-1f8640d073ec tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Lazy-loading 'numa_topology' on Instance uuid b24c3954-06ff-4e15-9e43-c65d1dae7a5d {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:17:07 user nova-compute[85141]: DEBUG nova.objects.base [None req-d1b4c9fe-9abe-4a10-9905-1f8640d073ec tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Object Instance<b24c3954-06ff-4e15-9e43-c65d1dae7a5d> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=85141) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 10:17:07 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-d1b4c9fe-9abe-4a10-9905-1f8640d073ec tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:17:07 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-d1b4c9fe-9abe-4a10-9905-1f8640d073ec tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:17:07 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-d1b4c9fe-9abe-4a10-9905-1f8640d073ec tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=85141) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 10:17:07 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-d1b4c9fe-9abe-4a10-9905-1f8640d073ec tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] CPU controller missing on host. {{(pid=85141) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 10:17:07 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-d1b4c9fe-9abe-4a10-9905-1f8640d073ec tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=85141) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 10:17:07 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-d1b4c9fe-9abe-4a10-9905-1f8640d073ec tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] CPU controller found on host. {{(pid=85141) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 10:17:07 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-d1b4c9fe-9abe-4a10-9905-1f8640d073ec tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=85141) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 10:17:07 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-d1b4c9fe-9abe-4a10-9905-1f8640d073ec tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T10:06:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T10:06:42Z,direct_url=<?>,disk_format='qcow2',id=bc4ca70f-a459-4d5c-a9e6-80f1948eb48b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1044631a5fe84ce8904864a7024049fa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T10:06:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 10:17:07 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-d1b4c9fe-9abe-4a10-9905-1f8640d073ec tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Flavor limits 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 10:17:07 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-d1b4c9fe-9abe-4a10-9905-1f8640d073ec tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Image limits 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 10:17:07 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-d1b4c9fe-9abe-4a10-9905-1f8640d073ec tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Flavor pref 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 10:17:07 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-d1b4c9fe-9abe-4a10-9905-1f8640d073ec tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Image pref 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 10:17:07 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-d1b4c9fe-9abe-4a10-9905-1f8640d073ec tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 10:17:07 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-d1b4c9fe-9abe-4a10-9905-1f8640d073ec tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 10:17:07 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-d1b4c9fe-9abe-4a10-9905-1f8640d073ec tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=85141) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 10:17:07 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-d1b4c9fe-9abe-4a10-9905-1f8640d073ec tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Got 1 possible topologies {{(pid=85141) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 10:17:07 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-d1b4c9fe-9abe-4a10-9905-1f8640d073ec tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 10:17:07 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-d1b4c9fe-9abe-4a10-9905-1f8640d073ec tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 10:17:07 user nova-compute[85141]: DEBUG nova.objects.instance [None req-d1b4c9fe-9abe-4a10-9905-1f8640d073ec tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Lazy-loading 'vcpu_model' on Instance uuid b24c3954-06ff-4e15-9e43-c65d1dae7a5d {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:17:08 user nova-compute[85141]: DEBUG nova.objects.base [None req-d1b4c9fe-9abe-4a10-9905-1f8640d073ec tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Object Instance<b24c3954-06ff-4e15-9e43-c65d1dae7a5d> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=85141) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 10:17:08 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-d1b4c9fe-9abe-4a10-9905-1f8640d073ec tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T10:15:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1886603118',display_name='tempest-ServerRescueNegativeTestJSON-server-1886603118',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1886603118',id=18,image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-16T10:15:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='09b520de67ac4290a4b779f50afeb1a4',ramdisk_id='',reservation_id='r-uoz0yc00',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-2068988845',owner_user_name='tempest-ServerRescueNegativeTestJSON-2068988845-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T10:15:27Z,user_data=None,user_id='76d4eaf5cef745c3bf3ae07068338b1a',uuid=b24c3954-06ff-4e15-9e43-c65d1dae7a5d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6becb779-bd08-4a40-bb56-3b8f03d1f844", "address": "fa:16:3e:ca:42:7f", "network": {"id": "5b67a3fd-ef1e-4f2c-b6e0-31766ef39d30", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2137186235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-2137186235-network", "vif_mac": "fa:16:3e:ca:42:7f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09b520de67ac4290a4b779f50afeb1a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6becb779-bd", "ovs_interfaceid": "6becb779-bd08-4a40-bb56-3b8f03d1f844", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=85141) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 10:17:08 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-d1b4c9fe-9abe-4a10-9905-1f8640d073ec tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Converting VIF {"id": "6becb779-bd08-4a40-bb56-3b8f03d1f844", "address": "fa:16:3e:ca:42:7f", "network": {"id": "5b67a3fd-ef1e-4f2c-b6e0-31766ef39d30", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2137186235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-2137186235-network", "vif_mac": "fa:16:3e:ca:42:7f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09b520de67ac4290a4b779f50afeb1a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6becb779-bd", "ovs_interfaceid": "6becb779-bd08-4a40-bb56-3b8f03d1f844", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:17:08 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-d1b4c9fe-9abe-4a10-9905-1f8640d073ec tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ca:42:7f,bridge_name='br-int',has_traffic_filtering=True,id=6becb779-bd08-4a40-bb56-3b8f03d1f844,network=Network(5b67a3fd-ef1e-4f2c-b6e0-31766ef39d30),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6becb779-bd') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:17:08 user nova-compute[85141]: DEBUG nova.objects.instance [None req-d1b4c9fe-9abe-4a10-9905-1f8640d073ec tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Lazy-loading 'pci_devices' on Instance uuid b24c3954-06ff-4e15-9e43-c65d1dae7a5d {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:17:08 user nova-compute[85141]: DEBUG nova.objects.base [None req-d1b4c9fe-9abe-4a10-9905-1f8640d073ec tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Object Instance<b24c3954-06ff-4e15-9e43-c65d1dae7a5d> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=85141) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 10:17:08 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-d1b4c9fe-9abe-4a10-9905-1f8640d073ec tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] [instance: b24c3954-06ff-4e15-9e43-c65d1dae7a5d] End _get_guest_xml xml=<domain type="kvm">
Nov 16 10:17:08 user nova-compute[85141]:   <uuid>b24c3954-06ff-4e15-9e43-c65d1dae7a5d</uuid>
Nov 16 10:17:08 user nova-compute[85141]:   <name>instance-00000012</name>
Nov 16 10:17:08 user nova-compute[85141]:   <memory>524288</memory>
Nov 16 10:17:08 user nova-compute[85141]:   <vcpu>1</vcpu>
Nov 16 10:17:08 user nova-compute[85141]:   <metadata>
Nov 16 10:17:08 user nova-compute[85141]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 10:17:08 user nova-compute[85141]:       <nova:package version="0.0.0"/>
Nov 16 10:17:08 user nova-compute[85141]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1886603118</nova:name>
Nov 16 10:17:08 user nova-compute[85141]:       <nova:creationTime>2023-11-16 10:17:07</nova:creationTime>
Nov 16 10:17:08 user nova-compute[85141]:       <nova:flavor name="m1.tiny">
Nov 16 10:17:08 user nova-compute[85141]:         <nova:memory>512</nova:memory>
Nov 16 10:17:08 user nova-compute[85141]:         <nova:disk>1</nova:disk>
Nov 16 10:17:08 user nova-compute[85141]:         <nova:swap>0</nova:swap>
Nov 16 10:17:08 user nova-compute[85141]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 10:17:08 user nova-compute[85141]:         <nova:vcpus>1</nova:vcpus>
Nov 16 10:17:08 user nova-compute[85141]:       </nova:flavor>
Nov 16 10:17:08 user nova-compute[85141]:       <nova:owner>
Nov 16 10:17:08 user nova-compute[85141]:         <nova:user uuid="76d4eaf5cef745c3bf3ae07068338b1a">tempest-ServerRescueNegativeTestJSON-2068988845-project-member</nova:user>
Nov 16 10:17:08 user nova-compute[85141]:         <nova:project uuid="09b520de67ac4290a4b779f50afeb1a4">tempest-ServerRescueNegativeTestJSON-2068988845</nova:project>
Nov 16 10:17:08 user nova-compute[85141]:       </nova:owner>
Nov 16 10:17:08 user nova-compute[85141]:       <nova:root type="image" uuid="bc4ca70f-a459-4d5c-a9e6-80f1948eb48b"/>
Nov 16 10:17:08 user nova-compute[85141]:       <nova:ports>
Nov 16 10:17:08 user nova-compute[85141]:         <nova:port uuid="6becb779-bd08-4a40-bb56-3b8f03d1f844">
Nov 16 10:17:08 user nova-compute[85141]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 16 10:17:08 user nova-compute[85141]:         </nova:port>
Nov 16 10:17:08 user nova-compute[85141]:       </nova:ports>
Nov 16 10:17:08 user nova-compute[85141]:     </nova:instance>
Nov 16 10:17:08 user nova-compute[85141]:   </metadata>
Nov 16 10:17:08 user nova-compute[85141]:   <sysinfo type="smbios">
Nov 16 10:17:08 user nova-compute[85141]:     <system>
Nov 16 10:17:08 user nova-compute[85141]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 10:17:08 user nova-compute[85141]:       <entry name="product">OpenStack Nova</entry>
Nov 16 10:17:08 user nova-compute[85141]:       <entry name="version">0.0.0</entry>
Nov 16 10:17:08 user nova-compute[85141]:       <entry name="serial">b24c3954-06ff-4e15-9e43-c65d1dae7a5d</entry>
Nov 16 10:17:08 user nova-compute[85141]:       <entry name="uuid">b24c3954-06ff-4e15-9e43-c65d1dae7a5d</entry>
Nov 16 10:17:08 user nova-compute[85141]:       <entry name="family">Virtual Machine</entry>
Nov 16 10:17:08 user nova-compute[85141]:     </system>
Nov 16 10:17:08 user nova-compute[85141]:   </sysinfo>
Nov 16 10:17:08 user nova-compute[85141]:   <os>
Nov 16 10:17:08 user nova-compute[85141]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 10:17:08 user nova-compute[85141]:     <smbios mode="sysinfo"/>
Nov 16 10:17:08 user nova-compute[85141]:   </os>
Nov 16 10:17:08 user nova-compute[85141]:   <features>
Nov 16 10:17:08 user nova-compute[85141]:     <acpi/>
Nov 16 10:17:08 user nova-compute[85141]:     <apic/>
Nov 16 10:17:08 user nova-compute[85141]:     <vmcoreinfo/>
Nov 16 10:17:08 user nova-compute[85141]:   </features>
Nov 16 10:17:08 user nova-compute[85141]:   <clock offset="utc">
Nov 16 10:17:08 user nova-compute[85141]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 10:17:08 user nova-compute[85141]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 10:17:08 user nova-compute[85141]:     <timer name="hpet" present="no"/>
Nov 16 10:17:08 user nova-compute[85141]:   </clock>
Nov 16 10:17:08 user nova-compute[85141]:   <cpu mode="custom" match="exact">
Nov 16 10:17:08 user nova-compute[85141]:     <model>Nehalem</model>
Nov 16 10:17:08 user nova-compute[85141]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 10:17:08 user nova-compute[85141]:   </cpu>
Nov 16 10:17:08 user nova-compute[85141]:   <devices>
Nov 16 10:17:08 user nova-compute[85141]:     <disk type="file" device="disk">
Nov 16 10:17:08 user nova-compute[85141]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 10:17:08 user nova-compute[85141]:       <source file="/opt/stack/data/nova/instances/b24c3954-06ff-4e15-9e43-c65d1dae7a5d/disk.rescue"/>
Nov 16 10:17:08 user nova-compute[85141]:       <target dev="vda" bus="virtio"/>
Nov 16 10:17:08 user nova-compute[85141]:     </disk>
Nov 16 10:17:08 user nova-compute[85141]:     <disk type="file" device="disk">
Nov 16 10:17:08 user nova-compute[85141]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 10:17:08 user nova-compute[85141]:       <source file="/opt/stack/data/nova/instances/b24c3954-06ff-4e15-9e43-c65d1dae7a5d/disk"/>
Nov 16 10:17:08 user nova-compute[85141]:       <target dev="vdb" bus="virtio"/>
Nov 16 10:17:08 user nova-compute[85141]:     </disk>
Nov 16 10:17:08 user nova-compute[85141]:     <interface type="ethernet">
Nov 16 10:17:08 user nova-compute[85141]:       <mac address="fa:16:3e:ca:42:7f"/>
Nov 16 10:17:08 user nova-compute[85141]:       <model type="virtio"/>
Nov 16 10:17:08 user nova-compute[85141]:       <mtu size="1442"/>
Nov 16 10:17:08 user nova-compute[85141]:       <target dev="tap6becb779-bd"/>
Nov 16 10:17:08 user nova-compute[85141]:     </interface>
Nov 16 10:17:08 user nova-compute[85141]:     <serial type="pty">
Nov 16 10:17:08 user nova-compute[85141]:       <log file="/opt/stack/data/nova/instances/b24c3954-06ff-4e15-9e43-c65d1dae7a5d/console.log" append="off"/>
Nov 16 10:17:08 user nova-compute[85141]:     </serial>
Nov 16 10:17:08 user nova-compute[85141]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 10:17:08 user nova-compute[85141]:     <video>
Nov 16 10:17:08 user nova-compute[85141]:       <model type="virtio"/>
Nov 16 10:17:08 user nova-compute[85141]:     </video>
Nov 16 10:17:08 user nova-compute[85141]:     <rng model="virtio">
Nov 16 10:17:08 user nova-compute[85141]:       <backend model="random">/dev/urandom</backend>
Nov 16 10:17:08 user nova-compute[85141]:     </rng>
Nov 16 10:17:08 user nova-compute[85141]:     <controller type="usb" index="0" model="none"/>
Nov 16 10:17:08 user nova-compute[85141]:     <memballoon model="virtio">
Nov 16 10:17:08 user nova-compute[85141]:       <stats period="10"/>
Nov 16 10:17:08 user nova-compute[85141]:     </memballoon>
Nov 16 10:17:08 user nova-compute[85141]:   </devices>
Nov 16 10:17:08 user nova-compute[85141]: </domain>
Nov 16 10:17:08 user nova-compute[85141]:  {{(pid=85141) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 10:17:08 user nova-compute[85141]: INFO nova.virt.libvirt.driver [-] [instance: b24c3954-06ff-4e15-9e43-c65d1dae7a5d] Instance destroyed successfully.
Nov 16 10:17:08 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-d1b4c9fe-9abe-4a10-9905-1f8640d073ec tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] No BDM found with device name vda, not building metadata. {{(pid=85141) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 10:17:08 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-d1b4c9fe-9abe-4a10-9905-1f8640d073ec tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] No BDM found with device name vdb, not building metadata. {{(pid=85141) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 10:17:08 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-d1b4c9fe-9abe-4a10-9905-1f8640d073ec tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] No VIF found with MAC fa:16:3e:ca:42:7f, not building metadata {{(pid=85141) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 10:17:08 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:17:09 user nova-compute[85141]: INFO nova.compute.manager [None req-df7f154d-312b-49ea-8b41-cbc18613d9b2 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] [instance: f01dc8cf-1a69-4618-a15d-0c1075157f05] Unrescuing
Nov 16 10:17:09 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-df7f154d-312b-49ea-8b41-cbc18613d9b2 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Acquiring lock "refresh_cache-f01dc8cf-1a69-4618-a15d-0c1075157f05" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:17:09 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-df7f154d-312b-49ea-8b41-cbc18613d9b2 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Acquired lock "refresh_cache-f01dc8cf-1a69-4618-a15d-0c1075157f05" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:17:09 user nova-compute[85141]: DEBUG nova.network.neutron [None req-df7f154d-312b-49ea-8b41-cbc18613d9b2 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] [instance: f01dc8cf-1a69-4618-a15d-0c1075157f05] Building network info cache for instance {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 10:17:09 user nova-compute[85141]: DEBUG nova.compute.manager [req-ef8d0f1c-35c2-418f-a625-ecdb9b5b1197 req-b072ccb3-143b-4800-a2aa-cd0c7aefa1d2 service nova] [instance: b24c3954-06ff-4e15-9e43-c65d1dae7a5d] Received event network-vif-plugged-6becb779-bd08-4a40-bb56-3b8f03d1f844 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:17:09 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-ef8d0f1c-35c2-418f-a625-ecdb9b5b1197 req-b072ccb3-143b-4800-a2aa-cd0c7aefa1d2 service nova] Acquiring lock "b24c3954-06ff-4e15-9e43-c65d1dae7a5d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:17:09 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-ef8d0f1c-35c2-418f-a625-ecdb9b5b1197 req-b072ccb3-143b-4800-a2aa-cd0c7aefa1d2 service nova] Lock "b24c3954-06ff-4e15-9e43-c65d1dae7a5d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:17:09 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-ef8d0f1c-35c2-418f-a625-ecdb9b5b1197 req-b072ccb3-143b-4800-a2aa-cd0c7aefa1d2 service nova] Lock "b24c3954-06ff-4e15-9e43-c65d1dae7a5d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:17:09 user nova-compute[85141]: DEBUG nova.compute.manager [req-ef8d0f1c-35c2-418f-a625-ecdb9b5b1197 req-b072ccb3-143b-4800-a2aa-cd0c7aefa1d2 service nova] [instance: b24c3954-06ff-4e15-9e43-c65d1dae7a5d] No waiting events found dispatching network-vif-plugged-6becb779-bd08-4a40-bb56-3b8f03d1f844 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:17:09 user nova-compute[85141]: WARNING nova.compute.manager [req-ef8d0f1c-35c2-418f-a625-ecdb9b5b1197 req-b072ccb3-143b-4800-a2aa-cd0c7aefa1d2 service nova] [instance: b24c3954-06ff-4e15-9e43-c65d1dae7a5d] Received unexpected event network-vif-plugged-6becb779-bd08-4a40-bb56-3b8f03d1f844 for instance with vm_state active and task_state rescuing.
Nov 16 10:17:09 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:17:09 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:17:09 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:17:09 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:17:09 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:17:09 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:17:10 user nova-compute[85141]: DEBUG nova.network.neutron [None req-df7f154d-312b-49ea-8b41-cbc18613d9b2 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] [instance: f01dc8cf-1a69-4618-a15d-0c1075157f05] Updating instance_info_cache with network_info: [{"id": "52edc378-51f4-43c3-b9f3-2d0201ed125d", "address": "fa:16:3e:38:1f:8f", "network": {"id": "e40e4bd2-4277-40b1-9451-1c8365ffa488", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1333036447-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "733b504d4dbe4f028963cf2c197f0064", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52edc378-51", "ovs_interfaceid": "52edc378-51f4-43c3-b9f3-2d0201ed125d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:17:10 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-df7f154d-312b-49ea-8b41-cbc18613d9b2 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Releasing lock "refresh_cache-f01dc8cf-1a69-4618-a15d-0c1075157f05" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:17:10 user nova-compute[85141]: DEBUG nova.objects.instance [None req-df7f154d-312b-49ea-8b41-cbc18613d9b2 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Lazy-loading 'flavor' on Instance uuid f01dc8cf-1a69-4618-a15d-0c1075157f05 {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:17:10 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:17:10 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:17:10 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:17:10 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:17:11 user nova-compute[85141]: INFO nova.virt.libvirt.driver [-] [instance: f01dc8cf-1a69-4618-a15d-0c1075157f05] Instance destroyed successfully.
Nov 16 10:17:11 user nova-compute[85141]: DEBUG nova.compute.manager [req-6c8b0820-a26f-4eb8-ab9c-39d81f498765 req-edb746c7-10fc-4a31-ae2a-d2a35da82308 service nova] [instance: b24c3954-06ff-4e15-9e43-c65d1dae7a5d] Received event network-vif-plugged-6becb779-bd08-4a40-bb56-3b8f03d1f844 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:17:11 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-6c8b0820-a26f-4eb8-ab9c-39d81f498765 req-edb746c7-10fc-4a31-ae2a-d2a35da82308 service nova] Acquiring lock "b24c3954-06ff-4e15-9e43-c65d1dae7a5d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:17:11 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-6c8b0820-a26f-4eb8-ab9c-39d81f498765 req-edb746c7-10fc-4a31-ae2a-d2a35da82308 service nova] Lock "b24c3954-06ff-4e15-9e43-c65d1dae7a5d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:17:11 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-6c8b0820-a26f-4eb8-ab9c-39d81f498765 req-edb746c7-10fc-4a31-ae2a-d2a35da82308 service nova] Lock "b24c3954-06ff-4e15-9e43-c65d1dae7a5d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:17:11 user nova-compute[85141]: DEBUG nova.compute.manager [req-6c8b0820-a26f-4eb8-ab9c-39d81f498765 req-edb746c7-10fc-4a31-ae2a-d2a35da82308 service nova] [instance: b24c3954-06ff-4e15-9e43-c65d1dae7a5d] No waiting events found dispatching network-vif-plugged-6becb779-bd08-4a40-bb56-3b8f03d1f844 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:17:11 user nova-compute[85141]: WARNING nova.compute.manager [req-6c8b0820-a26f-4eb8-ab9c-39d81f498765 req-edb746c7-10fc-4a31-ae2a-d2a35da82308 service nova] [instance: b24c3954-06ff-4e15-9e43-c65d1dae7a5d] Received unexpected event network-vif-plugged-6becb779-bd08-4a40-bb56-3b8f03d1f844 for instance with vm_state active and task_state rescuing.
Nov 16 10:17:11 user nova-compute[85141]: DEBUG nova.compute.manager [req-6c8b0820-a26f-4eb8-ab9c-39d81f498765 req-edb746c7-10fc-4a31-ae2a-d2a35da82308 service nova] [instance: b24c3954-06ff-4e15-9e43-c65d1dae7a5d] Received event network-vif-plugged-6becb779-bd08-4a40-bb56-3b8f03d1f844 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:17:11 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-6c8b0820-a26f-4eb8-ab9c-39d81f498765 req-edb746c7-10fc-4a31-ae2a-d2a35da82308 service nova] Acquiring lock "b24c3954-06ff-4e15-9e43-c65d1dae7a5d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:17:11 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-6c8b0820-a26f-4eb8-ab9c-39d81f498765 req-edb746c7-10fc-4a31-ae2a-d2a35da82308 service nova] Lock "b24c3954-06ff-4e15-9e43-c65d1dae7a5d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:17:11 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-6c8b0820-a26f-4eb8-ab9c-39d81f498765 req-edb746c7-10fc-4a31-ae2a-d2a35da82308 service nova] Lock "b24c3954-06ff-4e15-9e43-c65d1dae7a5d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:17:11 user nova-compute[85141]: DEBUG nova.compute.manager [req-6c8b0820-a26f-4eb8-ab9c-39d81f498765 req-edb746c7-10fc-4a31-ae2a-d2a35da82308 service nova] [instance: b24c3954-06ff-4e15-9e43-c65d1dae7a5d] No waiting events found dispatching network-vif-plugged-6becb779-bd08-4a40-bb56-3b8f03d1f844 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:17:11 user nova-compute[85141]: WARNING nova.compute.manager [req-6c8b0820-a26f-4eb8-ab9c-39d81f498765 req-edb746c7-10fc-4a31-ae2a-d2a35da82308 service nova] [instance: b24c3954-06ff-4e15-9e43-c65d1dae7a5d] Received unexpected event network-vif-plugged-6becb779-bd08-4a40-bb56-3b8f03d1f844 for instance with vm_state active and task_state rescuing.
Nov 16 10:17:11 user nova-compute[85141]: DEBUG nova.compute.manager [req-6c8b0820-a26f-4eb8-ab9c-39d81f498765 req-edb746c7-10fc-4a31-ae2a-d2a35da82308 service nova] [instance: f01dc8cf-1a69-4618-a15d-0c1075157f05] Received event network-vif-unplugged-52edc378-51f4-43c3-b9f3-2d0201ed125d {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:17:11 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-6c8b0820-a26f-4eb8-ab9c-39d81f498765 req-edb746c7-10fc-4a31-ae2a-d2a35da82308 service nova] Acquiring lock "f01dc8cf-1a69-4618-a15d-0c1075157f05-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:17:11 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-6c8b0820-a26f-4eb8-ab9c-39d81f498765 req-edb746c7-10fc-4a31-ae2a-d2a35da82308 service nova] Lock "f01dc8cf-1a69-4618-a15d-0c1075157f05-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:17:11 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-6c8b0820-a26f-4eb8-ab9c-39d81f498765 req-edb746c7-10fc-4a31-ae2a-d2a35da82308 service nova] Lock "f01dc8cf-1a69-4618-a15d-0c1075157f05-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:17:11 user nova-compute[85141]: DEBUG nova.compute.manager [req-6c8b0820-a26f-4eb8-ab9c-39d81f498765 req-edb746c7-10fc-4a31-ae2a-d2a35da82308 service nova] [instance: f01dc8cf-1a69-4618-a15d-0c1075157f05] No waiting events found dispatching network-vif-unplugged-52edc378-51f4-43c3-b9f3-2d0201ed125d {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:17:11 user nova-compute[85141]: WARNING nova.compute.manager [req-6c8b0820-a26f-4eb8-ab9c-39d81f498765 req-edb746c7-10fc-4a31-ae2a-d2a35da82308 service nova] [instance: f01dc8cf-1a69-4618-a15d-0c1075157f05] Received unexpected event network-vif-unplugged-52edc378-51f4-43c3-b9f3-2d0201ed125d for instance with vm_state rescued and task_state unrescuing.
Nov 16 10:17:11 user nova-compute[85141]: DEBUG nova.compute.manager [req-6c8b0820-a26f-4eb8-ab9c-39d81f498765 req-edb746c7-10fc-4a31-ae2a-d2a35da82308 service nova] [instance: f01dc8cf-1a69-4618-a15d-0c1075157f05] Received event network-vif-plugged-52edc378-51f4-43c3-b9f3-2d0201ed125d {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:17:11 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-6c8b0820-a26f-4eb8-ab9c-39d81f498765 req-edb746c7-10fc-4a31-ae2a-d2a35da82308 service nova] Acquiring lock "f01dc8cf-1a69-4618-a15d-0c1075157f05-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:17:11 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-6c8b0820-a26f-4eb8-ab9c-39d81f498765 req-edb746c7-10fc-4a31-ae2a-d2a35da82308 service nova] Lock "f01dc8cf-1a69-4618-a15d-0c1075157f05-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:17:11 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-6c8b0820-a26f-4eb8-ab9c-39d81f498765 req-edb746c7-10fc-4a31-ae2a-d2a35da82308 service nova] Lock "f01dc8cf-1a69-4618-a15d-0c1075157f05-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:17:11 user nova-compute[85141]: DEBUG nova.compute.manager [req-6c8b0820-a26f-4eb8-ab9c-39d81f498765 req-edb746c7-10fc-4a31-ae2a-d2a35da82308 service nova] [instance: f01dc8cf-1a69-4618-a15d-0c1075157f05] No waiting events found dispatching network-vif-plugged-52edc378-51f4-43c3-b9f3-2d0201ed125d {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:17:11 user nova-compute[85141]: WARNING nova.compute.manager [req-6c8b0820-a26f-4eb8-ab9c-39d81f498765 req-edb746c7-10fc-4a31-ae2a-d2a35da82308 service nova] [instance: f01dc8cf-1a69-4618-a15d-0c1075157f05] Received unexpected event network-vif-plugged-52edc378-51f4-43c3-b9f3-2d0201ed125d for instance with vm_state rescued and task_state unrescuing.
Nov 16 10:17:12 user nova-compute[85141]: DEBUG nova.compute.manager [None req-d1b4c9fe-9abe-4a10-9905-1f8640d073ec tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] [instance: b24c3954-06ff-4e15-9e43-c65d1dae7a5d] Checking state {{(pid=85141) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 10:17:12 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:17:12 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:17:12 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:17:12 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:17:12 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:17:12 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:17:12 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:17:13 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:17:13 user nova-compute[85141]: DEBUG nova.compute.manager [req-a5b431a6-e795-4f06-912c-f9ba9c3fb5e4 req-2229aad8-37c4-4231-b0a1-af6268a3ce35 service nova] [instance: f01dc8cf-1a69-4618-a15d-0c1075157f05] Received event network-vif-plugged-52edc378-51f4-43c3-b9f3-2d0201ed125d {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:17:13 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-a5b431a6-e795-4f06-912c-f9ba9c3fb5e4 req-2229aad8-37c4-4231-b0a1-af6268a3ce35 service nova] Acquiring lock "f01dc8cf-1a69-4618-a15d-0c1075157f05-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:17:13 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-a5b431a6-e795-4f06-912c-f9ba9c3fb5e4 req-2229aad8-37c4-4231-b0a1-af6268a3ce35 service nova] Lock "f01dc8cf-1a69-4618-a15d-0c1075157f05-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:17:13 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-a5b431a6-e795-4f06-912c-f9ba9c3fb5e4 req-2229aad8-37c4-4231-b0a1-af6268a3ce35 service nova] Lock "f01dc8cf-1a69-4618-a15d-0c1075157f05-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:17:13 user nova-compute[85141]: DEBUG nova.compute.manager [req-a5b431a6-e795-4f06-912c-f9ba9c3fb5e4 req-2229aad8-37c4-4231-b0a1-af6268a3ce35 service nova] [instance: f01dc8cf-1a69-4618-a15d-0c1075157f05] No waiting events found dispatching network-vif-plugged-52edc378-51f4-43c3-b9f3-2d0201ed125d {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:17:13 user nova-compute[85141]: WARNING nova.compute.manager [req-a5b431a6-e795-4f06-912c-f9ba9c3fb5e4 req-2229aad8-37c4-4231-b0a1-af6268a3ce35 service nova] [instance: f01dc8cf-1a69-4618-a15d-0c1075157f05] Received unexpected event network-vif-plugged-52edc378-51f4-43c3-b9f3-2d0201ed125d for instance with vm_state rescued and task_state unrescuing.
Nov 16 10:17:13 user nova-compute[85141]: DEBUG nova.compute.manager [req-a5b431a6-e795-4f06-912c-f9ba9c3fb5e4 req-2229aad8-37c4-4231-b0a1-af6268a3ce35 service nova] [instance: f01dc8cf-1a69-4618-a15d-0c1075157f05] Received event network-vif-plugged-52edc378-51f4-43c3-b9f3-2d0201ed125d {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:17:13 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-a5b431a6-e795-4f06-912c-f9ba9c3fb5e4 req-2229aad8-37c4-4231-b0a1-af6268a3ce35 service nova] Acquiring lock "f01dc8cf-1a69-4618-a15d-0c1075157f05-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:17:13 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-a5b431a6-e795-4f06-912c-f9ba9c3fb5e4 req-2229aad8-37c4-4231-b0a1-af6268a3ce35 service nova] Lock "f01dc8cf-1a69-4618-a15d-0c1075157f05-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:17:13 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-a5b431a6-e795-4f06-912c-f9ba9c3fb5e4 req-2229aad8-37c4-4231-b0a1-af6268a3ce35 service nova] Lock "f01dc8cf-1a69-4618-a15d-0c1075157f05-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:17:13 user nova-compute[85141]: DEBUG nova.compute.manager [req-a5b431a6-e795-4f06-912c-f9ba9c3fb5e4 req-2229aad8-37c4-4231-b0a1-af6268a3ce35 service nova] [instance: f01dc8cf-1a69-4618-a15d-0c1075157f05] No waiting events found dispatching network-vif-plugged-52edc378-51f4-43c3-b9f3-2d0201ed125d {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:17:13 user nova-compute[85141]: WARNING nova.compute.manager [req-a5b431a6-e795-4f06-912c-f9ba9c3fb5e4 req-2229aad8-37c4-4231-b0a1-af6268a3ce35 service nova] [instance: f01dc8cf-1a69-4618-a15d-0c1075157f05] Received unexpected event network-vif-plugged-52edc378-51f4-43c3-b9f3-2d0201ed125d for instance with vm_state rescued and task_state unrescuing.
Nov 16 10:17:14 user nova-compute[85141]: DEBUG nova.compute.manager [None req-df7f154d-312b-49ea-8b41-cbc18613d9b2 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] [instance: f01dc8cf-1a69-4618-a15d-0c1075157f05] Checking state {{(pid=85141) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 10:17:15 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:17:17 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:17:18 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:17:18 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:17:19 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:17:21 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:17:22 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:17:22 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:17:22 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=85141) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 10:17:22 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:17:23 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:17:23 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:17:23 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Starting heal instance info cache {{(pid=85141) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 10:17:23 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Rebuilding the list of instances to heal {{(pid=85141) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 10:17:23 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Acquiring lock "refresh_cache-d842f90e-663b-4c95-9d7c-d092d2bac41f" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:17:23 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Acquired lock "refresh_cache-d842f90e-663b-4c95-9d7c-d092d2bac41f" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:17:23 user nova-compute[85141]: DEBUG nova.network.neutron [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] [instance: d842f90e-663b-4c95-9d7c-d092d2bac41f] Forcefully refreshing network info cache for instance {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 10:17:23 user nova-compute[85141]: DEBUG nova.objects.instance [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lazy-loading 'info_cache' on Instance uuid d842f90e-663b-4c95-9d7c-d092d2bac41f {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:17:24 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-88ec0eae-d74d-403d-9f7c-0399dbb66fa4 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Acquiring lock "9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:17:24 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-88ec0eae-d74d-403d-9f7c-0399dbb66fa4 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Lock "9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:17:24 user nova-compute[85141]: DEBUG nova.compute.manager [None req-88ec0eae-d74d-403d-9f7c-0399dbb66fa4 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] [instance: 9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008] Starting instance... {{(pid=85141) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 10:17:24 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-88ec0eae-d74d-403d-9f7c-0399dbb66fa4 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:17:24 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-88ec0eae-d74d-403d-9f7c-0399dbb66fa4 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:17:24 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-88ec0eae-d74d-403d-9f7c-0399dbb66fa4 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=85141) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 10:17:24 user nova-compute[85141]: INFO nova.compute.claims [None req-88ec0eae-d74d-403d-9f7c-0399dbb66fa4 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] [instance: 9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008] Claim successful on node user
Nov 16 10:17:24 user nova-compute[85141]: DEBUG nova.network.neutron [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] [instance: d842f90e-663b-4c95-9d7c-d092d2bac41f] Updating instance_info_cache with network_info: [{"id": "6ce8849e-50a1-4b8a-bf75-1016ef3c2315", "address": "fa:16:3e:a2:a8:01", "network": {"id": "e40e4bd2-4277-40b1-9451-1c8365ffa488", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1333036447-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "733b504d4dbe4f028963cf2c197f0064", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ce8849e-50", "ovs_interfaceid": "6ce8849e-50a1-4b8a-bf75-1016ef3c2315", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:17:24 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Releasing lock "refresh_cache-d842f90e-663b-4c95-9d7c-d092d2bac41f" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:17:24 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] [instance: d842f90e-663b-4c95-9d7c-d092d2bac41f] Updated the network info_cache for instance {{(pid=85141) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 10:17:24 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:17:24 user nova-compute[85141]: DEBUG nova.compute.provider_tree [None req-88ec0eae-d74d-403d-9f7c-0399dbb66fa4 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Inventory has not changed in ProviderTree for provider: bf8e0fa1-16b6-408f-9203-c4cd63916272 {{(pid=85141) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 10:17:24 user nova-compute[85141]: DEBUG nova.scheduler.client.report [None req-88ec0eae-d74d-403d-9f7c-0399dbb66fa4 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Inventory has not changed for provider bf8e0fa1-16b6-408f-9203-c4cd63916272 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=85141) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 10:17:24 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-88ec0eae-d74d-403d-9f7c-0399dbb66fa4 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.399s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:17:24 user nova-compute[85141]: DEBUG nova.compute.manager [None req-88ec0eae-d74d-403d-9f7c-0399dbb66fa4 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] [instance: 9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008] Start building networks asynchronously for instance. {{(pid=85141) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 10:17:24 user nova-compute[85141]: DEBUG nova.compute.manager [None req-88ec0eae-d74d-403d-9f7c-0399dbb66fa4 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] [instance: 9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008] Allocating IP information in the background. {{(pid=85141) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 10:17:24 user nova-compute[85141]: DEBUG nova.network.neutron [None req-88ec0eae-d74d-403d-9f7c-0399dbb66fa4 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] [instance: 9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008] allocate_for_instance() {{(pid=85141) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 10:17:24 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-88ec0eae-d74d-403d-9f7c-0399dbb66fa4 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] [instance: 9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 10:17:24 user nova-compute[85141]: DEBUG nova.compute.manager [None req-88ec0eae-d74d-403d-9f7c-0399dbb66fa4 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] [instance: 9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008] Start building block device mappings for instance. {{(pid=85141) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 10:17:24 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:17:24 user nova-compute[85141]: DEBUG nova.policy [None req-88ec0eae-d74d-403d-9f7c-0399dbb66fa4 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e95802a919de4345add493a8d7873e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '879fa3f4dfc34726b20149b8a7db22dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85141) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 10:17:25 user nova-compute[85141]: DEBUG nova.compute.manager [None req-88ec0eae-d74d-403d-9f7c-0399dbb66fa4 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] [instance: 9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008] Start spawning the instance on the hypervisor. {{(pid=85141) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 10:17:25 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-88ec0eae-d74d-403d-9f7c-0399dbb66fa4 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] [instance: 9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008] Creating instance directory {{(pid=85141) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 10:17:25 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-88ec0eae-d74d-403d-9f7c-0399dbb66fa4 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] [instance: 9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008] Creating image(s)
Nov 16 10:17:25 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-88ec0eae-d74d-403d-9f7c-0399dbb66fa4 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Acquiring lock "/opt/stack/data/nova/instances/9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:17:25 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-88ec0eae-d74d-403d-9f7c-0399dbb66fa4 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Lock "/opt/stack/data/nova/instances/9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:17:25 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-88ec0eae-d74d-403d-9f7c-0399dbb66fa4 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Lock "/opt/stack/data/nova/instances/9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:17:25 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-88ec0eae-d74d-403d-9f7c-0399dbb66fa4 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:17:25 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-88ec0eae-d74d-403d-9f7c-0399dbb66fa4 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json" returned: 0 in 0.195s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:17:25 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-88ec0eae-d74d-403d-9f7c-0399dbb66fa4 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Acquiring lock "60a78556fb399ed4a41bc3ca4bccf77c96d8e811" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:17:25 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-88ec0eae-d74d-403d-9f7c-0399dbb66fa4 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Lock "60a78556fb399ed4a41bc3ca4bccf77c96d8e811" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:17:25 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-88ec0eae-d74d-403d-9f7c-0399dbb66fa4 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:17:25 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:17:25 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-88ec0eae-d74d-403d-9f7c-0399dbb66fa4 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json" returned: 0 in 0.224s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:17:25 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-88ec0eae-d74d-403d-9f7c-0399dbb66fa4 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811,backing_fmt=raw /opt/stack/data/nova/instances/9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008/disk 1073741824 {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:17:25 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-88ec0eae-d74d-403d-9f7c-0399dbb66fa4 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811,backing_fmt=raw /opt/stack/data/nova/instances/9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008/disk 1073741824" returned: 0 in 0.076s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:17:25 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-88ec0eae-d74d-403d-9f7c-0399dbb66fa4 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Lock "60a78556fb399ed4a41bc3ca4bccf77c96d8e811" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.307s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:17:25 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-88ec0eae-d74d-403d-9f7c-0399dbb66fa4 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:17:25 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-88ec0eae-d74d-403d-9f7c-0399dbb66fa4 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json" returned: 0 in 0.199s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:17:25 user nova-compute[85141]: DEBUG nova.virt.disk.api [None req-88ec0eae-d74d-403d-9f7c-0399dbb66fa4 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008/disk. size=1073741824 {{(pid=85141) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 10:17:25 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-88ec0eae-d74d-403d-9f7c-0399dbb66fa4 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:17:25 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-88ec0eae-d74d-403d-9f7c-0399dbb66fa4 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:17:25 user nova-compute[85141]: DEBUG nova.virt.disk.api [None req-88ec0eae-d74d-403d-9f7c-0399dbb66fa4 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Cannot resize image /opt/stack/data/nova/instances/9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008/disk to a smaller size. {{(pid=85141) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 10:17:25 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-88ec0eae-d74d-403d-9f7c-0399dbb66fa4 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] [instance: 9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008] Created local disks {{(pid=85141) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 10:17:25 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-88ec0eae-d74d-403d-9f7c-0399dbb66fa4 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] [instance: 9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008] Ensure instance console log exists: /opt/stack/data/nova/instances/9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008/console.log {{(pid=85141) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 10:17:25 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-88ec0eae-d74d-403d-9f7c-0399dbb66fa4 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:17:25 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-88ec0eae-d74d-403d-9f7c-0399dbb66fa4 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:17:25 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-88ec0eae-d74d-403d-9f7c-0399dbb66fa4 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:17:26 user nova-compute[85141]: DEBUG nova.network.neutron [None req-88ec0eae-d74d-403d-9f7c-0399dbb66fa4 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] [instance: 9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008] Successfully created port: 6e352298-a803-4a3c-8f40-dc88ee03687f {{(pid=85141) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 10:17:26 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:17:26 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:17:26 user nova-compute[85141]: DEBUG nova.network.neutron [None req-88ec0eae-d74d-403d-9f7c-0399dbb66fa4 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] [instance: 9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008] Successfully updated port: 6e352298-a803-4a3c-8f40-dc88ee03687f {{(pid=85141) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 10:17:26 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-88ec0eae-d74d-403d-9f7c-0399dbb66fa4 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Acquiring lock "refresh_cache-9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:17:26 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-88ec0eae-d74d-403d-9f7c-0399dbb66fa4 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Acquired lock "refresh_cache-9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:17:26 user nova-compute[85141]: DEBUG nova.network.neutron [None req-88ec0eae-d74d-403d-9f7c-0399dbb66fa4 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] [instance: 9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008] Building network info cache for instance {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 10:17:26 user nova-compute[85141]: DEBUG nova.compute.manager [req-b5ce0ef3-5cfc-4817-a1cc-4e15567bd6a5 req-a3790b76-4a3f-4437-8fd1-25e9cde32623 service nova] [instance: 9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008] Received event network-changed-6e352298-a803-4a3c-8f40-dc88ee03687f {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:17:26 user nova-compute[85141]: DEBUG nova.compute.manager [req-b5ce0ef3-5cfc-4817-a1cc-4e15567bd6a5 req-a3790b76-4a3f-4437-8fd1-25e9cde32623 service nova] [instance: 9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008] Refreshing instance network info cache due to event network-changed-6e352298-a803-4a3c-8f40-dc88ee03687f. {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 10:17:26 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-b5ce0ef3-5cfc-4817-a1cc-4e15567bd6a5 req-a3790b76-4a3f-4437-8fd1-25e9cde32623 service nova] Acquiring lock "refresh_cache-9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:17:26 user nova-compute[85141]: DEBUG nova.network.neutron [None req-88ec0eae-d74d-403d-9f7c-0399dbb66fa4 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] [instance: 9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008] Instance cache missing network info. {{(pid=85141) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 10:17:27 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager.update_available_resource {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:17:27 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:17:27 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:17:27 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:17:27 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Auditing locally available compute resources for user (node: user) {{(pid=85141) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 10:17:27 user nova-compute[85141]: DEBUG nova.network.neutron [None req-88ec0eae-d74d-403d-9f7c-0399dbb66fa4 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] [instance: 9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008] Updating instance_info_cache with network_info: [{"id": "6e352298-a803-4a3c-8f40-dc88ee03687f", "address": "fa:16:3e:ab:ca:9e", "network": {"id": "859d1f09-56c4-4c2b-b2c3-02b1938e8dbf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1562516834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "879fa3f4dfc34726b20149b8a7db22dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e352298-a8", "ovs_interfaceid": "6e352298-a803-4a3c-8f40-dc88ee03687f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:17:27 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-88ec0eae-d74d-403d-9f7c-0399dbb66fa4 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Releasing lock "refresh_cache-9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:17:27 user nova-compute[85141]: DEBUG nova.compute.manager [None req-88ec0eae-d74d-403d-9f7c-0399dbb66fa4 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] [instance: 9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008] Instance network_info: |[{"id": "6e352298-a803-4a3c-8f40-dc88ee03687f", "address": "fa:16:3e:ab:ca:9e", "network": {"id": "859d1f09-56c4-4c2b-b2c3-02b1938e8dbf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1562516834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "879fa3f4dfc34726b20149b8a7db22dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e352298-a8", "ovs_interfaceid": "6e352298-a803-4a3c-8f40-dc88ee03687f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=85141) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 10:17:27 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-b5ce0ef3-5cfc-4817-a1cc-4e15567bd6a5 req-a3790b76-4a3f-4437-8fd1-25e9cde32623 service nova] Acquired lock "refresh_cache-9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:17:27 user nova-compute[85141]: DEBUG nova.network.neutron [req-b5ce0ef3-5cfc-4817-a1cc-4e15567bd6a5 req-a3790b76-4a3f-4437-8fd1-25e9cde32623 service nova] [instance: 9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008] Refreshing network info cache for port 6e352298-a803-4a3c-8f40-dc88ee03687f {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 10:17:27 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-88ec0eae-d74d-403d-9f7c-0399dbb66fa4 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] [instance: 9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008] Start _get_guest_xml network_info=[{"id": "6e352298-a803-4a3c-8f40-dc88ee03687f", "address": "fa:16:3e:ab:ca:9e", "network": {"id": "859d1f09-56c4-4c2b-b2c3-02b1938e8dbf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1562516834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "879fa3f4dfc34726b20149b8a7db22dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e352298-a8", "ovs_interfaceid": "6e352298-a803-4a3c-8f40-dc88ee03687f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T10:06:42Z,direct_url=<?>,disk_format='qcow2',id=bc4ca70f-a459-4d5c-a9e6-80f1948eb48b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1044631a5fe84ce8904864a7024049fa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T10:06:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_options': None, 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'image_id': 'bc4ca70f-a459-4d5c-a9e6-80f1948eb48b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=85141) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 10:17:27 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:17:27 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-88ec0eae-d74d-403d-9f7c-0399dbb66fa4 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:17:27 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-88ec0eae-d74d-403d-9f7c-0399dbb66fa4 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:17:27 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-88ec0eae-d74d-403d-9f7c-0399dbb66fa4 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=85141) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 10:17:27 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-88ec0eae-d74d-403d-9f7c-0399dbb66fa4 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] CPU controller missing on host. {{(pid=85141) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 10:17:27 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-88ec0eae-d74d-403d-9f7c-0399dbb66fa4 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=85141) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 10:17:27 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-88ec0eae-d74d-403d-9f7c-0399dbb66fa4 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] CPU controller found on host. {{(pid=85141) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 10:17:27 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-88ec0eae-d74d-403d-9f7c-0399dbb66fa4 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=85141) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 10:17:27 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-88ec0eae-d74d-403d-9f7c-0399dbb66fa4 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T10:06:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T10:06:42Z,direct_url=<?>,disk_format='qcow2',id=bc4ca70f-a459-4d5c-a9e6-80f1948eb48b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1044631a5fe84ce8904864a7024049fa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T10:06:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 10:17:27 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-88ec0eae-d74d-403d-9f7c-0399dbb66fa4 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Flavor limits 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 10:17:27 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-88ec0eae-d74d-403d-9f7c-0399dbb66fa4 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Image limits 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 10:17:27 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-88ec0eae-d74d-403d-9f7c-0399dbb66fa4 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Flavor pref 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 10:17:27 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-88ec0eae-d74d-403d-9f7c-0399dbb66fa4 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Image pref 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 10:17:27 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-88ec0eae-d74d-403d-9f7c-0399dbb66fa4 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 10:17:27 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-88ec0eae-d74d-403d-9f7c-0399dbb66fa4 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 10:17:27 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-88ec0eae-d74d-403d-9f7c-0399dbb66fa4 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=85141) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 10:17:27 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-88ec0eae-d74d-403d-9f7c-0399dbb66fa4 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Got 1 possible topologies {{(pid=85141) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 10:17:27 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-88ec0eae-d74d-403d-9f7c-0399dbb66fa4 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 10:17:27 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-88ec0eae-d74d-403d-9f7c-0399dbb66fa4 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 10:17:27 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-88ec0eae-d74d-403d-9f7c-0399dbb66fa4 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T10:17:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1065707614',display_name='tempest-tempest.common.compute-instance-1065707614',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1065707614',id=21,image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLYW31ovczNyLDED4yKs9dsdr/XSErfr1XRe8heGwagMSLKlZc0gAr6TCWuL5DKCAIkQKMPHxCnrx6sG+CmW97Y7nMFFBSlsHjdgZoOxsnNiaYYiicSNNLBDSCW1u0DNWw==',key_name='tempest-keypair-1951575816',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='879fa3f4dfc34726b20149b8a7db22dc',ramdisk_id='',reservation_id='r-0bhqn0jn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1137992555',owner_user_name='tempest-ServerActionsTestOtherA-1137992555-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T10:17:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e95802a919de4345add493a8d7873e48',uuid=9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6e352298-a803-4a3c-8f40-dc88ee03687f", "address": "fa:16:3e:ab:ca:9e", "network": {"id": "859d1f09-56c4-4c2b-b2c3-02b1938e8dbf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1562516834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "879fa3f4dfc34726b20149b8a7db22dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e352298-a8", "ovs_interfaceid": "6e352298-a803-4a3c-8f40-dc88ee03687f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=85141) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 10:17:27 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-88ec0eae-d74d-403d-9f7c-0399dbb66fa4 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Converting VIF {"id": "6e352298-a803-4a3c-8f40-dc88ee03687f", "address": "fa:16:3e:ab:ca:9e", "network": {"id": "859d1f09-56c4-4c2b-b2c3-02b1938e8dbf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1562516834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "879fa3f4dfc34726b20149b8a7db22dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e352298-a8", "ovs_interfaceid": "6e352298-a803-4a3c-8f40-dc88ee03687f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:17:27 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-88ec0eae-d74d-403d-9f7c-0399dbb66fa4 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ab:ca:9e,bridge_name='br-int',has_traffic_filtering=True,id=6e352298-a803-4a3c-8f40-dc88ee03687f,network=Network(859d1f09-56c4-4c2b-b2c3-02b1938e8dbf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e352298-a8') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:17:27 user nova-compute[85141]: DEBUG nova.objects.instance [None req-88ec0eae-d74d-403d-9f7c-0399dbb66fa4 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Lazy-loading 'pci_devices' on Instance uuid 9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008 {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:17:27 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-88ec0eae-d74d-403d-9f7c-0399dbb66fa4 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] [instance: 9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008] End _get_guest_xml xml=<domain type="kvm">
Nov 16 10:17:27 user nova-compute[85141]:   <uuid>9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008</uuid>
Nov 16 10:17:27 user nova-compute[85141]:   <name>instance-00000015</name>
Nov 16 10:17:27 user nova-compute[85141]:   <memory>524288</memory>
Nov 16 10:17:27 user nova-compute[85141]:   <vcpu>1</vcpu>
Nov 16 10:17:27 user nova-compute[85141]:   <metadata>
Nov 16 10:17:27 user nova-compute[85141]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 10:17:27 user nova-compute[85141]:       <nova:package version="0.0.0"/>
Nov 16 10:17:27 user nova-compute[85141]:       <nova:name>tempest-tempest.common.compute-instance-1065707614</nova:name>
Nov 16 10:17:27 user nova-compute[85141]:       <nova:creationTime>2023-11-16 10:17:27</nova:creationTime>
Nov 16 10:17:27 user nova-compute[85141]:       <nova:flavor name="m1.tiny">
Nov 16 10:17:27 user nova-compute[85141]:         <nova:memory>512</nova:memory>
Nov 16 10:17:27 user nova-compute[85141]:         <nova:disk>1</nova:disk>
Nov 16 10:17:27 user nova-compute[85141]:         <nova:swap>0</nova:swap>
Nov 16 10:17:27 user nova-compute[85141]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 10:17:27 user nova-compute[85141]:         <nova:vcpus>1</nova:vcpus>
Nov 16 10:17:27 user nova-compute[85141]:       </nova:flavor>
Nov 16 10:17:27 user nova-compute[85141]:       <nova:owner>
Nov 16 10:17:27 user nova-compute[85141]:         <nova:user uuid="e95802a919de4345add493a8d7873e48">tempest-ServerActionsTestOtherA-1137992555-project-member</nova:user>
Nov 16 10:17:27 user nova-compute[85141]:         <nova:project uuid="879fa3f4dfc34726b20149b8a7db22dc">tempest-ServerActionsTestOtherA-1137992555</nova:project>
Nov 16 10:17:27 user nova-compute[85141]:       </nova:owner>
Nov 16 10:17:27 user nova-compute[85141]:       <nova:root type="image" uuid="bc4ca70f-a459-4d5c-a9e6-80f1948eb48b"/>
Nov 16 10:17:27 user nova-compute[85141]:       <nova:ports>
Nov 16 10:17:27 user nova-compute[85141]:         <nova:port uuid="6e352298-a803-4a3c-8f40-dc88ee03687f">
Nov 16 10:17:27 user nova-compute[85141]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 16 10:17:27 user nova-compute[85141]:         </nova:port>
Nov 16 10:17:27 user nova-compute[85141]:       </nova:ports>
Nov 16 10:17:27 user nova-compute[85141]:     </nova:instance>
Nov 16 10:17:27 user nova-compute[85141]:   </metadata>
Nov 16 10:17:27 user nova-compute[85141]:   <sysinfo type="smbios">
Nov 16 10:17:27 user nova-compute[85141]:     <system>
Nov 16 10:17:27 user nova-compute[85141]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 10:17:27 user nova-compute[85141]:       <entry name="product">OpenStack Nova</entry>
Nov 16 10:17:27 user nova-compute[85141]:       <entry name="version">0.0.0</entry>
Nov 16 10:17:27 user nova-compute[85141]:       <entry name="serial">9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008</entry>
Nov 16 10:17:27 user nova-compute[85141]:       <entry name="uuid">9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008</entry>
Nov 16 10:17:27 user nova-compute[85141]:       <entry name="family">Virtual Machine</entry>
Nov 16 10:17:27 user nova-compute[85141]:     </system>
Nov 16 10:17:27 user nova-compute[85141]:   </sysinfo>
Nov 16 10:17:27 user nova-compute[85141]:   <os>
Nov 16 10:17:27 user nova-compute[85141]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 10:17:27 user nova-compute[85141]:     <boot dev="hd"/>
Nov 16 10:17:27 user nova-compute[85141]:     <smbios mode="sysinfo"/>
Nov 16 10:17:27 user nova-compute[85141]:   </os>
Nov 16 10:17:27 user nova-compute[85141]:   <features>
Nov 16 10:17:27 user nova-compute[85141]:     <acpi/>
Nov 16 10:17:27 user nova-compute[85141]:     <apic/>
Nov 16 10:17:27 user nova-compute[85141]:     <vmcoreinfo/>
Nov 16 10:17:27 user nova-compute[85141]:   </features>
Nov 16 10:17:27 user nova-compute[85141]:   <clock offset="utc">
Nov 16 10:17:27 user nova-compute[85141]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 10:17:27 user nova-compute[85141]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 10:17:27 user nova-compute[85141]:     <timer name="hpet" present="no"/>
Nov 16 10:17:27 user nova-compute[85141]:   </clock>
Nov 16 10:17:27 user nova-compute[85141]:   <cpu mode="custom" match="exact">
Nov 16 10:17:27 user nova-compute[85141]:     <model>Nehalem</model>
Nov 16 10:17:27 user nova-compute[85141]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 10:17:27 user nova-compute[85141]:   </cpu>
Nov 16 10:17:27 user nova-compute[85141]:   <devices>
Nov 16 10:17:27 user nova-compute[85141]:     <disk type="file" device="disk">
Nov 16 10:17:27 user nova-compute[85141]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 10:17:27 user nova-compute[85141]:       <source file="/opt/stack/data/nova/instances/9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008/disk"/>
Nov 16 10:17:27 user nova-compute[85141]:       <target dev="vda" bus="virtio"/>
Nov 16 10:17:27 user nova-compute[85141]:     </disk>
Nov 16 10:17:27 user nova-compute[85141]:     <interface type="ethernet">
Nov 16 10:17:27 user nova-compute[85141]:       <mac address="fa:16:3e:ab:ca:9e"/>
Nov 16 10:17:27 user nova-compute[85141]:       <model type="virtio"/>
Nov 16 10:17:27 user nova-compute[85141]:       <mtu size="1442"/>
Nov 16 10:17:27 user nova-compute[85141]:       <target dev="tap6e352298-a8"/>
Nov 16 10:17:27 user nova-compute[85141]:     </interface>
Nov 16 10:17:27 user nova-compute[85141]:     <serial type="pty">
Nov 16 10:17:27 user nova-compute[85141]:       <log file="/opt/stack/data/nova/instances/9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008/console.log" append="off"/>
Nov 16 10:17:27 user nova-compute[85141]:     </serial>
Nov 16 10:17:27 user nova-compute[85141]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 10:17:27 user nova-compute[85141]:     <video>
Nov 16 10:17:27 user nova-compute[85141]:       <model type="virtio"/>
Nov 16 10:17:27 user nova-compute[85141]:     </video>
Nov 16 10:17:27 user nova-compute[85141]:     <rng model="virtio">
Nov 16 10:17:27 user nova-compute[85141]:       <backend model="random">/dev/urandom</backend>
Nov 16 10:17:27 user nova-compute[85141]:     </rng>
Nov 16 10:17:27 user nova-compute[85141]:     <controller type="usb" index="0" model="none"/>
Nov 16 10:17:27 user nova-compute[85141]:     <memballoon model="virtio">
Nov 16 10:17:27 user nova-compute[85141]:       <stats period="10"/>
Nov 16 10:17:27 user nova-compute[85141]:     </memballoon>
Nov 16 10:17:27 user nova-compute[85141]:   </devices>
Nov 16 10:17:27 user nova-compute[85141]: </domain>
Nov 16 10:17:27 user nova-compute[85141]:  {{(pid=85141) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 10:17:27 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-88ec0eae-d74d-403d-9f7c-0399dbb66fa4 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T10:17:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1065707614',display_name='tempest-tempest.common.compute-instance-1065707614',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1065707614',id=21,image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLYW31ovczNyLDED4yKs9dsdr/XSErfr1XRe8heGwagMSLKlZc0gAr6TCWuL5DKCAIkQKMPHxCnrx6sG+CmW97Y7nMFFBSlsHjdgZoOxsnNiaYYiicSNNLBDSCW1u0DNWw==',key_name='tempest-keypair-1951575816',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='879fa3f4dfc34726b20149b8a7db22dc',ramdisk_id='',reservation_id='r-0bhqn0jn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1137992555',owner_user_name='tempest-ServerActionsTestOtherA-1137992555-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T10:17:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e95802a919de4345add493a8d7873e48',uuid=9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6e352298-a803-4a3c-8f40-dc88ee03687f", "address": "fa:16:3e:ab:ca:9e", "network": {"id": "859d1f09-56c4-4c2b-b2c3-02b1938e8dbf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1562516834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "879fa3f4dfc34726b20149b8a7db22dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e352298-a8", "ovs_interfaceid": "6e352298-a803-4a3c-8f40-dc88ee03687f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 10:17:27 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-88ec0eae-d74d-403d-9f7c-0399dbb66fa4 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Converting VIF {"id": "6e352298-a803-4a3c-8f40-dc88ee03687f", "address": "fa:16:3e:ab:ca:9e", "network": {"id": "859d1f09-56c4-4c2b-b2c3-02b1938e8dbf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1562516834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "879fa3f4dfc34726b20149b8a7db22dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e352298-a8", "ovs_interfaceid": "6e352298-a803-4a3c-8f40-dc88ee03687f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:17:27 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-88ec0eae-d74d-403d-9f7c-0399dbb66fa4 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ab:ca:9e,bridge_name='br-int',has_traffic_filtering=True,id=6e352298-a803-4a3c-8f40-dc88ee03687f,network=Network(859d1f09-56c4-4c2b-b2c3-02b1938e8dbf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e352298-a8') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:17:27 user nova-compute[85141]: DEBUG os_vif [None req-88ec0eae-d74d-403d-9f7c-0399dbb66fa4 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ab:ca:9e,bridge_name='br-int',has_traffic_filtering=True,id=6e352298-a803-4a3c-8f40-dc88ee03687f,network=Network(859d1f09-56c4-4c2b-b2c3-02b1938e8dbf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e352298-a8') {{(pid=85141) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 10:17:27 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:17:27 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:17:27 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 10:17:27 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:17:27 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7a371930-7a40-52eb-9879-c7e9d9a8cabb', '_type': 'linux-noop'}}, row=False) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:17:27 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:17:27 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:17:27 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e65ccf79-718d-4eeb-8914-f0db2e2c9ce2/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:17:27 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:17:27 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6e352298-a8, may_exist=True, interface_attrs={}) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:17:27 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6e352298-a8, col_values=(('qos', UUID('8f02f0e2-ffa8-48ec-beca-f5c137ab67c6')),), if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:17:27 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6e352298-a8, col_values=(('external_ids', {'iface-id': '6e352298-a803-4a3c-8f40-dc88ee03687f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ab:ca:9e', 'vm-uuid': '9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008'}),), if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:17:27 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:17:27 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:17:27 user nova-compute[85141]: INFO os_vif [None req-88ec0eae-d74d-403d-9f7c-0399dbb66fa4 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ab:ca:9e,bridge_name='br-int',has_traffic_filtering=True,id=6e352298-a803-4a3c-8f40-dc88ee03687f,network=Network(859d1f09-56c4-4c2b-b2c3-02b1938e8dbf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e352298-a8')
Nov 16 10:17:27 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-88ec0eae-d74d-403d-9f7c-0399dbb66fa4 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] No BDM found with device name vda, not building metadata. {{(pid=85141) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 10:17:27 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-88ec0eae-d74d-403d-9f7c-0399dbb66fa4 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] No VIF found with MAC fa:16:3e:ab:ca:9e, not building metadata {{(pid=85141) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 10:17:27 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e65ccf79-718d-4eeb-8914-f0db2e2c9ce2/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:17:27 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e65ccf79-718d-4eeb-8914-f0db2e2c9ce2/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:17:28 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:17:28 user nova-compute[85141]: DEBUG nova.network.neutron [req-b5ce0ef3-5cfc-4817-a1cc-4e15567bd6a5 req-a3790b76-4a3f-4437-8fd1-25e9cde32623 service nova] [instance: 9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008] Updated VIF entry in instance network info cache for port 6e352298-a803-4a3c-8f40-dc88ee03687f. {{(pid=85141) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 10:17:28 user nova-compute[85141]: DEBUG nova.network.neutron [req-b5ce0ef3-5cfc-4817-a1cc-4e15567bd6a5 req-a3790b76-4a3f-4437-8fd1-25e9cde32623 service nova] [instance: 9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008] Updating instance_info_cache with network_info: [{"id": "6e352298-a803-4a3c-8f40-dc88ee03687f", "address": "fa:16:3e:ab:ca:9e", "network": {"id": "859d1f09-56c4-4c2b-b2c3-02b1938e8dbf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1562516834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "879fa3f4dfc34726b20149b8a7db22dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e352298-a8", "ovs_interfaceid": "6e352298-a803-4a3c-8f40-dc88ee03687f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:17:28 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e65ccf79-718d-4eeb-8914-f0db2e2c9ce2/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:17:28 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=85141) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 10:17:28 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-b5ce0ef3-5cfc-4817-a1cc-4e15567bd6a5 req-a3790b76-4a3f-4437-8fd1-25e9cde32623 service nova] Releasing lock "refresh_cache-9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:17:28 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:17:28 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:17:28 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:17:28 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:17:28 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d842f90e-663b-4c95-9d7c-d092d2bac41f/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:17:28 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d842f90e-663b-4c95-9d7c-d092d2bac41f/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:17:28 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d842f90e-663b-4c95-9d7c-d092d2bac41f/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:17:28 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d842f90e-663b-4c95-9d7c-d092d2bac41f/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:17:28 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e214bbb-5bbb-4e6f-ac09-9cb1412f068b/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:17:28 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:17:28 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e214bbb-5bbb-4e6f-ac09-9cb1412f068b/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:17:29 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e214bbb-5bbb-4e6f-ac09-9cb1412f068b/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:17:29 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:17:29 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e214bbb-5bbb-4e6f-ac09-9cb1412f068b/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:17:29 user nova-compute[85141]: DEBUG nova.compute.manager [req-95a1df14-944c-4cc5-849f-b078cfc90d55 req-56b0bbaa-8481-42aa-afbf-5eb9017f6b5d service nova] [instance: 9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008] Received event network-vif-plugged-6e352298-a803-4a3c-8f40-dc88ee03687f {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:17:29 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-95a1df14-944c-4cc5-849f-b078cfc90d55 req-56b0bbaa-8481-42aa-afbf-5eb9017f6b5d service nova] Acquiring lock "9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:17:29 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-95a1df14-944c-4cc5-849f-b078cfc90d55 req-56b0bbaa-8481-42aa-afbf-5eb9017f6b5d service nova] Lock "9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.005s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:17:29 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-95a1df14-944c-4cc5-849f-b078cfc90d55 req-56b0bbaa-8481-42aa-afbf-5eb9017f6b5d service nova] Lock "9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:17:29 user nova-compute[85141]: DEBUG nova.compute.manager [req-95a1df14-944c-4cc5-849f-b078cfc90d55 req-56b0bbaa-8481-42aa-afbf-5eb9017f6b5d service nova] [instance: 9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008] No waiting events found dispatching network-vif-plugged-6e352298-a803-4a3c-8f40-dc88ee03687f {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:17:29 user nova-compute[85141]: WARNING nova.compute.manager [req-95a1df14-944c-4cc5-849f-b078cfc90d55 req-56b0bbaa-8481-42aa-afbf-5eb9017f6b5d service nova] [instance: 9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008] Received unexpected event network-vif-plugged-6e352298-a803-4a3c-8f40-dc88ee03687f for instance with vm_state building and task_state spawning.
Nov 16 10:17:29 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=85141) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 10:17:29 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=85141) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 10:17:29 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=85141) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 10:17:29 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=85141) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 10:17:29 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b24c3954-06ff-4e15-9e43-c65d1dae7a5d/disk.rescue --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:17:29 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:17:29 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b24c3954-06ff-4e15-9e43-c65d1dae7a5d/disk.rescue --force-share --output=json" returned: 0 in 0.210s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:17:29 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b24c3954-06ff-4e15-9e43-c65d1dae7a5d/disk.rescue --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:17:29 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b24c3954-06ff-4e15-9e43-c65d1dae7a5d/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:17:29 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b24c3954-06ff-4e15-9e43-c65d1dae7a5d/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:17:29 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b24c3954-06ff-4e15-9e43-c65d1dae7a5d/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:17:29 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b24c3954-06ff-4e15-9e43-c65d1dae7a5d/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:17:30 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b24c3954-06ff-4e15-9e43-c65d1dae7a5d/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:17:30 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:17:30 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/059d6974-bd0c-4f73-91fc-8202ebda4238/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:17:30 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/059d6974-bd0c-4f73-91fc-8202ebda4238/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:17:30 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/059d6974-bd0c-4f73-91fc-8202ebda4238/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:17:30 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/059d6974-bd0c-4f73-91fc-8202ebda4238/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:17:31 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-affecd51-40bd-4f74-bdd5-ea8b6633a300 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Acquiring lock "2d7787a2-b8da-4d39-9b16-4c7bcb275f85" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:17:31 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-affecd51-40bd-4f74-bdd5-ea8b6633a300 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Lock "2d7787a2-b8da-4d39-9b16-4c7bcb275f85" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:17:31 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:17:31 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:17:31 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Hypervisor/Node resource view: name=user free_ram=7700MB free_disk=25.314598083496094GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=85141) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 10:17:31 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:17:31 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:17:31 user nova-compute[85141]: DEBUG nova.compute.manager [None req-affecd51-40bd-4f74-bdd5-ea8b6633a300 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] [instance: 2d7787a2-b8da-4d39-9b16-4c7bcb275f85] Starting instance... {{(pid=85141) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 10:17:31 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-affecd51-40bd-4f74-bdd5-ea8b6633a300 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:17:31 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance d842f90e-663b-4c95-9d7c-d092d2bac41f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:17:31 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance f01dc8cf-1a69-4618-a15d-0c1075157f05 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:17:31 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance 059d6974-bd0c-4f73-91fc-8202ebda4238 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:17:31 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance e65ccf79-718d-4eeb-8914-f0db2e2c9ce2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:17:31 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance 4e214bbb-5bbb-4e6f-ac09-9cb1412f068b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:17:31 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance b24c3954-06ff-4e15-9e43-c65d1dae7a5d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:17:31 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:17:31 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance 0c359f00-f4b7-43c3-8454-364842893779 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:17:31 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance 9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:17:31 user nova-compute[85141]: DEBUG nova.compute.manager [None req-88ec0eae-d74d-403d-9f7c-0399dbb66fa4 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] [instance: 9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008] Instance event wait completed in 0 seconds for  {{(pid=85141) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 10:17:31 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-88ec0eae-d74d-403d-9f7c-0399dbb66fa4 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] [instance: 9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008] Guest created on hypervisor {{(pid=85141) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 10:17:31 user nova-compute[85141]: INFO nova.virt.libvirt.driver [-] [instance: 9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008] Instance spawned successfully.
Nov 16 10:17:31 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-88ec0eae-d74d-403d-9f7c-0399dbb66fa4 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] [instance: 9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 10:17:31 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance 2d7787a2-b8da-4d39-9b16-4c7bcb275f85 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 16 10:17:31 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=85141) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 10:17:31 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=85141) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 10:17:31 user nova-compute[85141]: DEBUG nova.compute.manager [req-778b70a5-2439-42bf-82c7-e30cc97b4a3b req-f83f83c0-e487-4e98-8c44-b8f289924eda service nova] [instance: 9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008] Received event network-vif-plugged-6e352298-a803-4a3c-8f40-dc88ee03687f {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:17:31 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-778b70a5-2439-42bf-82c7-e30cc97b4a3b req-f83f83c0-e487-4e98-8c44-b8f289924eda service nova] Acquiring lock "9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:17:31 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-778b70a5-2439-42bf-82c7-e30cc97b4a3b req-f83f83c0-e487-4e98-8c44-b8f289924eda service nova] Lock "9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:17:31 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-778b70a5-2439-42bf-82c7-e30cc97b4a3b req-f83f83c0-e487-4e98-8c44-b8f289924eda service nova] Lock "9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:17:31 user nova-compute[85141]: DEBUG nova.compute.manager [req-778b70a5-2439-42bf-82c7-e30cc97b4a3b req-f83f83c0-e487-4e98-8c44-b8f289924eda service nova] [instance: 9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008] No waiting events found dispatching network-vif-plugged-6e352298-a803-4a3c-8f40-dc88ee03687f {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:17:31 user nova-compute[85141]: WARNING nova.compute.manager [req-778b70a5-2439-42bf-82c7-e30cc97b4a3b req-f83f83c0-e487-4e98-8c44-b8f289924eda service nova] [instance: 9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008] Received unexpected event network-vif-plugged-6e352298-a803-4a3c-8f40-dc88ee03687f for instance with vm_state building and task_state spawning.
Nov 16 10:17:31 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-88ec0eae-d74d-403d-9f7c-0399dbb66fa4 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] [instance: 9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008] Found default for hw_cdrom_bus of ide {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:17:31 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-88ec0eae-d74d-403d-9f7c-0399dbb66fa4 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] [instance: 9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008] Found default for hw_disk_bus of virtio {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:17:31 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-88ec0eae-d74d-403d-9f7c-0399dbb66fa4 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] [instance: 9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008] Found default for hw_input_bus of None {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:17:31 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-88ec0eae-d74d-403d-9f7c-0399dbb66fa4 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] [instance: 9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008] Found default for hw_pointer_model of None {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:17:31 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-88ec0eae-d74d-403d-9f7c-0399dbb66fa4 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] [instance: 9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008] Found default for hw_video_model of virtio {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:17:31 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-88ec0eae-d74d-403d-9f7c-0399dbb66fa4 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] [instance: 9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008] Found default for hw_vif_model of virtio {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:17:31 user nova-compute[85141]: INFO nova.compute.manager [None req-88ec0eae-d74d-403d-9f7c-0399dbb66fa4 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] [instance: 9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008] Took 6.36 seconds to spawn the instance on the hypervisor.
Nov 16 10:17:31 user nova-compute[85141]: DEBUG nova.compute.manager [None req-88ec0eae-d74d-403d-9f7c-0399dbb66fa4 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] [instance: 9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008] Checking state {{(pid=85141) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 10:17:31 user nova-compute[85141]: INFO nova.compute.manager [None req-88ec0eae-d74d-403d-9f7c-0399dbb66fa4 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] [instance: 9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008] Took 7.15 seconds to build instance.
Nov 16 10:17:31 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-88ec0eae-d74d-403d-9f7c-0399dbb66fa4 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Lock "9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.250s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:17:31 user nova-compute[85141]: DEBUG nova.compute.provider_tree [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Inventory has not changed in ProviderTree for provider: bf8e0fa1-16b6-408f-9203-c4cd63916272 {{(pid=85141) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 10:17:31 user nova-compute[85141]: DEBUG nova.scheduler.client.report [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Inventory has not changed for provider bf8e0fa1-16b6-408f-9203-c4cd63916272 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=85141) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 10:17:31 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Compute_service record updated for user:user {{(pid=85141) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 10:17:31 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.481s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:17:31 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-affecd51-40bd-4f74-bdd5-ea8b6633a300 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.375s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:17:31 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-affecd51-40bd-4f74-bdd5-ea8b6633a300 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=85141) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 10:17:31 user nova-compute[85141]: INFO nova.compute.claims [None req-affecd51-40bd-4f74-bdd5-ea8b6633a300 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] [instance: 2d7787a2-b8da-4d39-9b16-4c7bcb275f85] Claim successful on node user
Nov 16 10:17:31 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:17:32 user nova-compute[85141]: DEBUG nova.compute.provider_tree [None req-affecd51-40bd-4f74-bdd5-ea8b6633a300 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Inventory has not changed in ProviderTree for provider: bf8e0fa1-16b6-408f-9203-c4cd63916272 {{(pid=85141) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 10:17:32 user nova-compute[85141]: DEBUG nova.scheduler.client.report [None req-affecd51-40bd-4f74-bdd5-ea8b6633a300 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Inventory has not changed for provider bf8e0fa1-16b6-408f-9203-c4cd63916272 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=85141) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 10:17:32 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-affecd51-40bd-4f74-bdd5-ea8b6633a300 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.539s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:17:32 user nova-compute[85141]: DEBUG nova.compute.manager [None req-affecd51-40bd-4f74-bdd5-ea8b6633a300 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] [instance: 2d7787a2-b8da-4d39-9b16-4c7bcb275f85] Start building networks asynchronously for instance. {{(pid=85141) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 10:17:32 user nova-compute[85141]: DEBUG nova.compute.manager [None req-affecd51-40bd-4f74-bdd5-ea8b6633a300 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] [instance: 2d7787a2-b8da-4d39-9b16-4c7bcb275f85] Allocating IP information in the background. {{(pid=85141) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 10:17:32 user nova-compute[85141]: DEBUG nova.network.neutron [None req-affecd51-40bd-4f74-bdd5-ea8b6633a300 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] [instance: 2d7787a2-b8da-4d39-9b16-4c7bcb275f85] allocate_for_instance() {{(pid=85141) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 10:17:32 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-affecd51-40bd-4f74-bdd5-ea8b6633a300 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] [instance: 2d7787a2-b8da-4d39-9b16-4c7bcb275f85] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 10:17:32 user nova-compute[85141]: DEBUG nova.compute.manager [None req-affecd51-40bd-4f74-bdd5-ea8b6633a300 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] [instance: 2d7787a2-b8da-4d39-9b16-4c7bcb275f85] Start building block device mappings for instance. {{(pid=85141) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 10:17:32 user nova-compute[85141]: DEBUG nova.compute.manager [None req-affecd51-40bd-4f74-bdd5-ea8b6633a300 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] [instance: 2d7787a2-b8da-4d39-9b16-4c7bcb275f85] Start spawning the instance on the hypervisor. {{(pid=85141) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 10:17:32 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-affecd51-40bd-4f74-bdd5-ea8b6633a300 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] [instance: 2d7787a2-b8da-4d39-9b16-4c7bcb275f85] Creating instance directory {{(pid=85141) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 10:17:32 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-affecd51-40bd-4f74-bdd5-ea8b6633a300 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] [instance: 2d7787a2-b8da-4d39-9b16-4c7bcb275f85] Creating image(s)
Nov 16 10:17:32 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-affecd51-40bd-4f74-bdd5-ea8b6633a300 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Acquiring lock "/opt/stack/data/nova/instances/2d7787a2-b8da-4d39-9b16-4c7bcb275f85/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:17:32 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-affecd51-40bd-4f74-bdd5-ea8b6633a300 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Lock "/opt/stack/data/nova/instances/2d7787a2-b8da-4d39-9b16-4c7bcb275f85/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:17:32 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-affecd51-40bd-4f74-bdd5-ea8b6633a300 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Lock "/opt/stack/data/nova/instances/2d7787a2-b8da-4d39-9b16-4c7bcb275f85/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:17:32 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-affecd51-40bd-4f74-bdd5-ea8b6633a300 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Acquiring lock "a1f7888919bcf90b1a285400ac888d0a386989df" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:17:32 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-affecd51-40bd-4f74-bdd5-ea8b6633a300 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Lock "a1f7888919bcf90b1a285400ac888d0a386989df" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:17:32 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:17:32 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:17:32 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:17:33 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-affecd51-40bd-4f74-bdd5-ea8b6633a300 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a1f7888919bcf90b1a285400ac888d0a386989df.part --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:17:33 user nova-compute[85141]: DEBUG nova.policy [None req-affecd51-40bd-4f74-bdd5-ea8b6633a300 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f8792b5cbd0845299dc396f922399980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e4f57f79564d2fbcb8080bf8f1c5c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85141) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 10:17:33 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:17:33 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:17:33 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-affecd51-40bd-4f74-bdd5-ea8b6633a300 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a1f7888919bcf90b1a285400ac888d0a386989df.part --force-share --output=json" returned: 0 in 0.267s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:17:33 user nova-compute[85141]: DEBUG nova.virt.images [None req-affecd51-40bd-4f74-bdd5-ea8b6633a300 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] e960df59-53b9-475b-b762-72c61c99e0eb was qcow2, converting to raw {{(pid=85141) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 16 10:17:33 user nova-compute[85141]: DEBUG nova.privsep.utils [None req-affecd51-40bd-4f74-bdd5-ea8b6633a300 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=85141) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 16 10:17:33 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-affecd51-40bd-4f74-bdd5-ea8b6633a300 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a1f7888919bcf90b1a285400ac888d0a386989df.part /opt/stack/data/nova/instances/_base/a1f7888919bcf90b1a285400ac888d0a386989df.converted {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:17:33 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-affecd51-40bd-4f74-bdd5-ea8b6633a300 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a1f7888919bcf90b1a285400ac888d0a386989df.part /opt/stack/data/nova/instances/_base/a1f7888919bcf90b1a285400ac888d0a386989df.converted" returned: 0 in 0.439s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:17:33 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-affecd51-40bd-4f74-bdd5-ea8b6633a300 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a1f7888919bcf90b1a285400ac888d0a386989df.converted --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:17:34 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-affecd51-40bd-4f74-bdd5-ea8b6633a300 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a1f7888919bcf90b1a285400ac888d0a386989df.converted --force-share --output=json" returned: 0 in 0.233s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:17:34 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-affecd51-40bd-4f74-bdd5-ea8b6633a300 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Lock "a1f7888919bcf90b1a285400ac888d0a386989df" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.648s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:17:34 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-affecd51-40bd-4f74-bdd5-ea8b6633a300 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a1f7888919bcf90b1a285400ac888d0a386989df --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:17:34 user nova-compute[85141]: DEBUG nova.network.neutron [None req-affecd51-40bd-4f74-bdd5-ea8b6633a300 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] [instance: 2d7787a2-b8da-4d39-9b16-4c7bcb275f85] Successfully created port: 3f553883-eaa0-4a7e-8e31-1170241a0236 {{(pid=85141) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 10:17:34 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-affecd51-40bd-4f74-bdd5-ea8b6633a300 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a1f7888919bcf90b1a285400ac888d0a386989df --force-share --output=json" returned: 0 in 0.195s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:17:34 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-affecd51-40bd-4f74-bdd5-ea8b6633a300 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Acquiring lock "a1f7888919bcf90b1a285400ac888d0a386989df" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:17:34 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-affecd51-40bd-4f74-bdd5-ea8b6633a300 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Lock "a1f7888919bcf90b1a285400ac888d0a386989df" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:17:34 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-affecd51-40bd-4f74-bdd5-ea8b6633a300 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a1f7888919bcf90b1a285400ac888d0a386989df --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:17:34 user nova-compute[85141]: DEBUG nova.compute.manager [req-12547478-a24c-47bb-af83-c57f66893194 req-8d24deae-7180-4ff2-894c-2675b33bf5e3 service nova] [instance: fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f] Received event network-changed-cc62aa76-c6d3-42a2-bf2a-7241919a5fc4 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:17:34 user nova-compute[85141]: DEBUG nova.compute.manager [req-12547478-a24c-47bb-af83-c57f66893194 req-8d24deae-7180-4ff2-894c-2675b33bf5e3 service nova] [instance: fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f] Refreshing instance network info cache due to event network-changed-cc62aa76-c6d3-42a2-bf2a-7241919a5fc4. {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 10:17:34 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-12547478-a24c-47bb-af83-c57f66893194 req-8d24deae-7180-4ff2-894c-2675b33bf5e3 service nova] Acquiring lock "refresh_cache-fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:17:34 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-12547478-a24c-47bb-af83-c57f66893194 req-8d24deae-7180-4ff2-894c-2675b33bf5e3 service nova] Acquired lock "refresh_cache-fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:17:34 user nova-compute[85141]: DEBUG nova.network.neutron [req-12547478-a24c-47bb-af83-c57f66893194 req-8d24deae-7180-4ff2-894c-2675b33bf5e3 service nova] [instance: fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f] Refreshing network info cache for port cc62aa76-c6d3-42a2-bf2a-7241919a5fc4 {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 10:17:34 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-affecd51-40bd-4f74-bdd5-ea8b6633a300 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a1f7888919bcf90b1a285400ac888d0a386989df --force-share --output=json" returned: 0 in 0.194s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:17:34 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-affecd51-40bd-4f74-bdd5-ea8b6633a300 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a1f7888919bcf90b1a285400ac888d0a386989df,backing_fmt=raw /opt/stack/data/nova/instances/2d7787a2-b8da-4d39-9b16-4c7bcb275f85/disk 1073741824 {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:17:34 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-affecd51-40bd-4f74-bdd5-ea8b6633a300 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a1f7888919bcf90b1a285400ac888d0a386989df,backing_fmt=raw /opt/stack/data/nova/instances/2d7787a2-b8da-4d39-9b16-4c7bcb275f85/disk 1073741824" returned: 0 in 0.063s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:17:34 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-affecd51-40bd-4f74-bdd5-ea8b6633a300 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Lock "a1f7888919bcf90b1a285400ac888d0a386989df" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.265s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:17:34 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-affecd51-40bd-4f74-bdd5-ea8b6633a300 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a1f7888919bcf90b1a285400ac888d0a386989df --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:17:34 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-affecd51-40bd-4f74-bdd5-ea8b6633a300 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a1f7888919bcf90b1a285400ac888d0a386989df --force-share --output=json" returned: 0 in 0.211s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:17:34 user nova-compute[85141]: DEBUG nova.virt.disk.api [None req-affecd51-40bd-4f74-bdd5-ea8b6633a300 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2d7787a2-b8da-4d39-9b16-4c7bcb275f85/disk. size=1073741824 {{(pid=85141) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 10:17:34 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-affecd51-40bd-4f74-bdd5-ea8b6633a300 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d7787a2-b8da-4d39-9b16-4c7bcb275f85/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:17:35 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-affecd51-40bd-4f74-bdd5-ea8b6633a300 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d7787a2-b8da-4d39-9b16-4c7bcb275f85/disk --force-share --output=json" returned: 0 in 0.263s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:17:35 user nova-compute[85141]: DEBUG nova.virt.disk.api [None req-affecd51-40bd-4f74-bdd5-ea8b6633a300 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Cannot resize image /opt/stack/data/nova/instances/2d7787a2-b8da-4d39-9b16-4c7bcb275f85/disk to a smaller size. {{(pid=85141) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 10:17:35 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-affecd51-40bd-4f74-bdd5-ea8b6633a300 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] [instance: 2d7787a2-b8da-4d39-9b16-4c7bcb275f85] Created local disks {{(pid=85141) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 10:17:35 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-affecd51-40bd-4f74-bdd5-ea8b6633a300 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] [instance: 2d7787a2-b8da-4d39-9b16-4c7bcb275f85] Ensure instance console log exists: /opt/stack/data/nova/instances/2d7787a2-b8da-4d39-9b16-4c7bcb275f85/console.log {{(pid=85141) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 10:17:35 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-affecd51-40bd-4f74-bdd5-ea8b6633a300 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:17:35 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-affecd51-40bd-4f74-bdd5-ea8b6633a300 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:17:35 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-affecd51-40bd-4f74-bdd5-ea8b6633a300 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:17:35 user nova-compute[85141]: DEBUG nova.network.neutron [req-12547478-a24c-47bb-af83-c57f66893194 req-8d24deae-7180-4ff2-894c-2675b33bf5e3 service nova] [instance: fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f] Updated VIF entry in instance network info cache for port cc62aa76-c6d3-42a2-bf2a-7241919a5fc4. {{(pid=85141) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 10:17:35 user nova-compute[85141]: DEBUG nova.network.neutron [req-12547478-a24c-47bb-af83-c57f66893194 req-8d24deae-7180-4ff2-894c-2675b33bf5e3 service nova] [instance: fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f] Updating instance_info_cache with network_info: [{"id": "cc62aa76-c6d3-42a2-bf2a-7241919a5fc4", "address": "fa:16:3e:3b:bc:05", "network": {"id": "434cf325-212a-4f85-9779-7791dc1c678f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-248496413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cdf22a86934481196276e29c2cdb48b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc62aa76-c6", "ovs_interfaceid": "cc62aa76-c6d3-42a2-bf2a-7241919a5fc4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:17:35 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-12547478-a24c-47bb-af83-c57f66893194 req-8d24deae-7180-4ff2-894c-2675b33bf5e3 service nova] Releasing lock "refresh_cache-fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:17:35 user nova-compute[85141]: DEBUG nova.compute.manager [None req-f7318c46-eb4e-47c5-a9a4-5c9360f09ee8 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] [instance: fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f] Checking state {{(pid=85141) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 10:17:35 user nova-compute[85141]: INFO nova.compute.manager [None req-f7318c46-eb4e-47c5-a9a4-5c9360f09ee8 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] [instance: fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f] instance snapshotting
Nov 16 10:17:35 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-f7318c46-eb4e-47c5-a9a4-5c9360f09ee8 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] [instance: fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f] Beginning live snapshot process
Nov 16 10:17:36 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:17:36 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-f7318c46-eb4e-47c5-a9a4-5c9360f09ee8 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f/disk --force-share --output=json -f qcow2 {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:17:36 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-f7318c46-eb4e-47c5-a9a4-5c9360f09ee8 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f/disk --force-share --output=json -f qcow2" returned: 0 in 0.192s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:17:36 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-f7318c46-eb4e-47c5-a9a4-5c9360f09ee8 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f/disk --force-share --output=json -f qcow2 {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:17:36 user nova-compute[85141]: DEBUG nova.network.neutron [None req-affecd51-40bd-4f74-bdd5-ea8b6633a300 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] [instance: 2d7787a2-b8da-4d39-9b16-4c7bcb275f85] Successfully updated port: 3f553883-eaa0-4a7e-8e31-1170241a0236 {{(pid=85141) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 10:17:36 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-affecd51-40bd-4f74-bdd5-ea8b6633a300 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Acquiring lock "refresh_cache-2d7787a2-b8da-4d39-9b16-4c7bcb275f85" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:17:36 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-affecd51-40bd-4f74-bdd5-ea8b6633a300 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Acquired lock "refresh_cache-2d7787a2-b8da-4d39-9b16-4c7bcb275f85" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:17:36 user nova-compute[85141]: DEBUG nova.network.neutron [None req-affecd51-40bd-4f74-bdd5-ea8b6633a300 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] [instance: 2d7787a2-b8da-4d39-9b16-4c7bcb275f85] Building network info cache for instance {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 10:17:36 user nova-compute[85141]: DEBUG nova.compute.manager [req-5288a564-f878-4868-b924-29d18a773451 req-91a1fff6-37b8-4efc-b214-b1ce6db672b3 service nova] [instance: 2d7787a2-b8da-4d39-9b16-4c7bcb275f85] Received event network-changed-3f553883-eaa0-4a7e-8e31-1170241a0236 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:17:36 user nova-compute[85141]: DEBUG nova.compute.manager [req-5288a564-f878-4868-b924-29d18a773451 req-91a1fff6-37b8-4efc-b214-b1ce6db672b3 service nova] [instance: 2d7787a2-b8da-4d39-9b16-4c7bcb275f85] Refreshing instance network info cache due to event network-changed-3f553883-eaa0-4a7e-8e31-1170241a0236. {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 10:17:36 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-5288a564-f878-4868-b924-29d18a773451 req-91a1fff6-37b8-4efc-b214-b1ce6db672b3 service nova] Acquiring lock "refresh_cache-2d7787a2-b8da-4d39-9b16-4c7bcb275f85" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:17:36 user nova-compute[85141]: DEBUG nova.network.neutron [None req-affecd51-40bd-4f74-bdd5-ea8b6633a300 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] [instance: 2d7787a2-b8da-4d39-9b16-4c7bcb275f85] Instance cache missing network info. {{(pid=85141) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 10:17:36 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-f7318c46-eb4e-47c5-a9a4-5c9360f09ee8 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f/disk --force-share --output=json -f qcow2" returned: 0 in 0.198s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:17:36 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-f7318c46-eb4e-47c5-a9a4-5c9360f09ee8 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:17:36 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-f7318c46-eb4e-47c5-a9a4-5c9360f09ee8 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json" returned: 0 in 0.193s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:17:36 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-f7318c46-eb4e-47c5-a9a4-5c9360f09ee8 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpi1ar0ay1/463e40821b02435eb1b6ecd1d02c4846.delta 1073741824 {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:17:36 user nova-compute[85141]: DEBUG nova.network.neutron [None req-affecd51-40bd-4f74-bdd5-ea8b6633a300 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] [instance: 2d7787a2-b8da-4d39-9b16-4c7bcb275f85] Updating instance_info_cache with network_info: [{"id": "3f553883-eaa0-4a7e-8e31-1170241a0236", "address": "fa:16:3e:1c:29:6f", "network": {"id": "436477fd-9294-4297-bfb3-405564823fa0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1068749207-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4e4f57f79564d2fbcb8080bf8f1c5c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f553883-ea", "ovs_interfaceid": "3f553883-eaa0-4a7e-8e31-1170241a0236", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:17:36 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-f7318c46-eb4e-47c5-a9a4-5c9360f09ee8 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpi1ar0ay1/463e40821b02435eb1b6ecd1d02c4846.delta 1073741824" returned: 0 in 0.056s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:17:36 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-f7318c46-eb4e-47c5-a9a4-5c9360f09ee8 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] [instance: fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 16 10:17:36 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-affecd51-40bd-4f74-bdd5-ea8b6633a300 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Releasing lock "refresh_cache-2d7787a2-b8da-4d39-9b16-4c7bcb275f85" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:17:36 user nova-compute[85141]: DEBUG nova.compute.manager [None req-affecd51-40bd-4f74-bdd5-ea8b6633a300 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] [instance: 2d7787a2-b8da-4d39-9b16-4c7bcb275f85] Instance network_info: |[{"id": "3f553883-eaa0-4a7e-8e31-1170241a0236", "address": "fa:16:3e:1c:29:6f", "network": {"id": "436477fd-9294-4297-bfb3-405564823fa0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1068749207-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4e4f57f79564d2fbcb8080bf8f1c5c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f553883-ea", "ovs_interfaceid": "3f553883-eaa0-4a7e-8e31-1170241a0236", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=85141) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 10:17:36 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-5288a564-f878-4868-b924-29d18a773451 req-91a1fff6-37b8-4efc-b214-b1ce6db672b3 service nova] Acquired lock "refresh_cache-2d7787a2-b8da-4d39-9b16-4c7bcb275f85" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:17:36 user nova-compute[85141]: DEBUG nova.network.neutron [req-5288a564-f878-4868-b924-29d18a773451 req-91a1fff6-37b8-4efc-b214-b1ce6db672b3 service nova] [instance: 2d7787a2-b8da-4d39-9b16-4c7bcb275f85] Refreshing network info cache for port 3f553883-eaa0-4a7e-8e31-1170241a0236 {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 10:17:36 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-affecd51-40bd-4f74-bdd5-ea8b6633a300 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] [instance: 2d7787a2-b8da-4d39-9b16-4c7bcb275f85] Start _get_guest_xml network_info=[{"id": "3f553883-eaa0-4a7e-8e31-1170241a0236", "address": "fa:16:3e:1c:29:6f", "network": {"id": "436477fd-9294-4297-bfb3-405564823fa0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1068749207-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4e4f57f79564d2fbcb8080bf8f1c5c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f553883-ea", "ovs_interfaceid": "3f553883-eaa0-4a7e-8e31-1170241a0236", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T10:17:27Z,direct_url=<?>,disk_format='qcow2',id=e960df59-53b9-475b-b762-72c61c99e0eb,min_disk=0,min_ram=0,name='tempest-scenario-img--1007059709',owner='b4e4f57f79564d2fbcb8080bf8f1c5c0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T10:17:29Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_options': None, 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'image_id': 'e960df59-53b9-475b-b762-72c61c99e0eb'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=85141) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 10:17:36 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-affecd51-40bd-4f74-bdd5-ea8b6633a300 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:17:36 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-affecd51-40bd-4f74-bdd5-ea8b6633a300 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:17:36 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-affecd51-40bd-4f74-bdd5-ea8b6633a300 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=85141) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 10:17:36 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-affecd51-40bd-4f74-bdd5-ea8b6633a300 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] CPU controller missing on host. {{(pid=85141) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 10:17:36 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-affecd51-40bd-4f74-bdd5-ea8b6633a300 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=85141) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 10:17:36 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-affecd51-40bd-4f74-bdd5-ea8b6633a300 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] CPU controller found on host. {{(pid=85141) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 10:17:36 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-affecd51-40bd-4f74-bdd5-ea8b6633a300 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=85141) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 10:17:36 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-affecd51-40bd-4f74-bdd5-ea8b6633a300 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T10:06:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T10:17:27Z,direct_url=<?>,disk_format='qcow2',id=e960df59-53b9-475b-b762-72c61c99e0eb,min_disk=0,min_ram=0,name='tempest-scenario-img--1007059709',owner='b4e4f57f79564d2fbcb8080bf8f1c5c0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T10:17:29Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 10:17:36 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-affecd51-40bd-4f74-bdd5-ea8b6633a300 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Flavor limits 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 10:17:36 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-affecd51-40bd-4f74-bdd5-ea8b6633a300 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Image limits 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 10:17:36 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-affecd51-40bd-4f74-bdd5-ea8b6633a300 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Flavor pref 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 10:17:36 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-affecd51-40bd-4f74-bdd5-ea8b6633a300 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Image pref 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 10:17:36 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-affecd51-40bd-4f74-bdd5-ea8b6633a300 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 10:17:36 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-affecd51-40bd-4f74-bdd5-ea8b6633a300 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 10:17:36 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-affecd51-40bd-4f74-bdd5-ea8b6633a300 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=85141) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 10:17:36 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-affecd51-40bd-4f74-bdd5-ea8b6633a300 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Got 1 possible topologies {{(pid=85141) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 10:17:36 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-affecd51-40bd-4f74-bdd5-ea8b6633a300 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 10:17:36 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-affecd51-40bd-4f74-bdd5-ea8b6633a300 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 10:17:36 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-affecd51-40bd-4f74-bdd5-ea8b6633a300 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T10:17:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1258419633',display_name='tempest-TestMinimumBasicScenario-server-1258419633',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1258419633',id=22,image_ref='e960df59-53b9-475b-b762-72c61c99e0eb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBItDkOA9C0uJPf9LijOMkhRvGGhUREdg5zYTmAP8Jr2q5TskNTHRCZQqwtHRWI5QTrlnhI5kKcYXRZFhe3aqQnbfNkSahjTY0HHASfhQQbujcaJQTG8nSUyM5nxOwF6+5g==',key_name='tempest-TestMinimumBasicScenario-2119154314',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b4e4f57f79564d2fbcb8080bf8f1c5c0',ramdisk_id='',reservation_id='r-3bxzxj23',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e960df59-53b9-475b-b762-72c61c99e0eb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-766472507',owner_user_name='tempest-TestMinimumBasicScenario-766472507-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T10:17:32Z,user_data=None,user_id='f8792b5cbd0845299dc396f922399980',uuid=2d7787a2-b8da-4d39-9b16-4c7bcb275f85,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3f553883-eaa0-4a7e-8e31-1170241a0236", "address": "fa:16:3e:1c:29:6f", "network": {"id": "436477fd-9294-4297-bfb3-405564823fa0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1068749207-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4e4f57f79564d2fbcb8080bf8f1c5c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f553883-ea", "ovs_interfaceid": "3f553883-eaa0-4a7e-8e31-1170241a0236", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=85141) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 10:17:36 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-affecd51-40bd-4f74-bdd5-ea8b6633a300 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Converting VIF {"id": "3f553883-eaa0-4a7e-8e31-1170241a0236", "address": "fa:16:3e:1c:29:6f", "network": {"id": "436477fd-9294-4297-bfb3-405564823fa0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1068749207-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4e4f57f79564d2fbcb8080bf8f1c5c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f553883-ea", "ovs_interfaceid": "3f553883-eaa0-4a7e-8e31-1170241a0236", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:17:36 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-affecd51-40bd-4f74-bdd5-ea8b6633a300 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1c:29:6f,bridge_name='br-int',has_traffic_filtering=True,id=3f553883-eaa0-4a7e-8e31-1170241a0236,network=Network(436477fd-9294-4297-bfb3-405564823fa0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f553883-ea') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:17:36 user nova-compute[85141]: DEBUG nova.objects.instance [None req-affecd51-40bd-4f74-bdd5-ea8b6633a300 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Lazy-loading 'pci_devices' on Instance uuid 2d7787a2-b8da-4d39-9b16-4c7bcb275f85 {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:17:36 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-affecd51-40bd-4f74-bdd5-ea8b6633a300 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] [instance: 2d7787a2-b8da-4d39-9b16-4c7bcb275f85] End _get_guest_xml xml=<domain type="kvm">
Nov 16 10:17:36 user nova-compute[85141]:   <uuid>2d7787a2-b8da-4d39-9b16-4c7bcb275f85</uuid>
Nov 16 10:17:36 user nova-compute[85141]:   <name>instance-00000016</name>
Nov 16 10:17:36 user nova-compute[85141]:   <memory>524288</memory>
Nov 16 10:17:36 user nova-compute[85141]:   <vcpu>1</vcpu>
Nov 16 10:17:36 user nova-compute[85141]:   <metadata>
Nov 16 10:17:36 user nova-compute[85141]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 10:17:36 user nova-compute[85141]:       <nova:package version="0.0.0"/>
Nov 16 10:17:36 user nova-compute[85141]:       <nova:name>tempest-TestMinimumBasicScenario-server-1258419633</nova:name>
Nov 16 10:17:36 user nova-compute[85141]:       <nova:creationTime>2023-11-16 10:17:36</nova:creationTime>
Nov 16 10:17:36 user nova-compute[85141]:       <nova:flavor name="m1.tiny">
Nov 16 10:17:36 user nova-compute[85141]:         <nova:memory>512</nova:memory>
Nov 16 10:17:36 user nova-compute[85141]:         <nova:disk>1</nova:disk>
Nov 16 10:17:36 user nova-compute[85141]:         <nova:swap>0</nova:swap>
Nov 16 10:17:36 user nova-compute[85141]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 10:17:36 user nova-compute[85141]:         <nova:vcpus>1</nova:vcpus>
Nov 16 10:17:36 user nova-compute[85141]:       </nova:flavor>
Nov 16 10:17:36 user nova-compute[85141]:       <nova:owner>
Nov 16 10:17:36 user nova-compute[85141]:         <nova:user uuid="f8792b5cbd0845299dc396f922399980">tempest-TestMinimumBasicScenario-766472507-project-member</nova:user>
Nov 16 10:17:36 user nova-compute[85141]:         <nova:project uuid="b4e4f57f79564d2fbcb8080bf8f1c5c0">tempest-TestMinimumBasicScenario-766472507</nova:project>
Nov 16 10:17:36 user nova-compute[85141]:       </nova:owner>
Nov 16 10:17:36 user nova-compute[85141]:       <nova:root type="image" uuid="e960df59-53b9-475b-b762-72c61c99e0eb"/>
Nov 16 10:17:36 user nova-compute[85141]:       <nova:ports>
Nov 16 10:17:36 user nova-compute[85141]:         <nova:port uuid="3f553883-eaa0-4a7e-8e31-1170241a0236">
Nov 16 10:17:36 user nova-compute[85141]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 16 10:17:36 user nova-compute[85141]:         </nova:port>
Nov 16 10:17:36 user nova-compute[85141]:       </nova:ports>
Nov 16 10:17:36 user nova-compute[85141]:     </nova:instance>
Nov 16 10:17:36 user nova-compute[85141]:   </metadata>
Nov 16 10:17:36 user nova-compute[85141]:   <sysinfo type="smbios">
Nov 16 10:17:36 user nova-compute[85141]:     <system>
Nov 16 10:17:36 user nova-compute[85141]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 10:17:36 user nova-compute[85141]:       <entry name="product">OpenStack Nova</entry>
Nov 16 10:17:36 user nova-compute[85141]:       <entry name="version">0.0.0</entry>
Nov 16 10:17:36 user nova-compute[85141]:       <entry name="serial">2d7787a2-b8da-4d39-9b16-4c7bcb275f85</entry>
Nov 16 10:17:36 user nova-compute[85141]:       <entry name="uuid">2d7787a2-b8da-4d39-9b16-4c7bcb275f85</entry>
Nov 16 10:17:36 user nova-compute[85141]:       <entry name="family">Virtual Machine</entry>
Nov 16 10:17:36 user nova-compute[85141]:     </system>
Nov 16 10:17:36 user nova-compute[85141]:   </sysinfo>
Nov 16 10:17:36 user nova-compute[85141]:   <os>
Nov 16 10:17:36 user nova-compute[85141]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 10:17:36 user nova-compute[85141]:     <boot dev="hd"/>
Nov 16 10:17:36 user nova-compute[85141]:     <smbios mode="sysinfo"/>
Nov 16 10:17:36 user nova-compute[85141]:   </os>
Nov 16 10:17:36 user nova-compute[85141]:   <features>
Nov 16 10:17:36 user nova-compute[85141]:     <acpi/>
Nov 16 10:17:36 user nova-compute[85141]:     <apic/>
Nov 16 10:17:36 user nova-compute[85141]:     <vmcoreinfo/>
Nov 16 10:17:36 user nova-compute[85141]:   </features>
Nov 16 10:17:36 user nova-compute[85141]:   <clock offset="utc">
Nov 16 10:17:36 user nova-compute[85141]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 10:17:36 user nova-compute[85141]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 10:17:36 user nova-compute[85141]:     <timer name="hpet" present="no"/>
Nov 16 10:17:36 user nova-compute[85141]:   </clock>
Nov 16 10:17:36 user nova-compute[85141]:   <cpu mode="custom" match="exact">
Nov 16 10:17:36 user nova-compute[85141]:     <model>Nehalem</model>
Nov 16 10:17:36 user nova-compute[85141]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 10:17:36 user nova-compute[85141]:   </cpu>
Nov 16 10:17:36 user nova-compute[85141]:   <devices>
Nov 16 10:17:36 user nova-compute[85141]:     <disk type="file" device="disk">
Nov 16 10:17:36 user nova-compute[85141]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 10:17:36 user nova-compute[85141]:       <source file="/opt/stack/data/nova/instances/2d7787a2-b8da-4d39-9b16-4c7bcb275f85/disk"/>
Nov 16 10:17:36 user nova-compute[85141]:       <target dev="vda" bus="virtio"/>
Nov 16 10:17:36 user nova-compute[85141]:     </disk>
Nov 16 10:17:36 user nova-compute[85141]:     <interface type="ethernet">
Nov 16 10:17:36 user nova-compute[85141]:       <mac address="fa:16:3e:1c:29:6f"/>
Nov 16 10:17:36 user nova-compute[85141]:       <model type="virtio"/>
Nov 16 10:17:36 user nova-compute[85141]:       <mtu size="1442"/>
Nov 16 10:17:36 user nova-compute[85141]:       <target dev="tap3f553883-ea"/>
Nov 16 10:17:36 user nova-compute[85141]:     </interface>
Nov 16 10:17:36 user nova-compute[85141]:     <serial type="pty">
Nov 16 10:17:36 user nova-compute[85141]:       <log file="/opt/stack/data/nova/instances/2d7787a2-b8da-4d39-9b16-4c7bcb275f85/console.log" append="off"/>
Nov 16 10:17:36 user nova-compute[85141]:     </serial>
Nov 16 10:17:36 user nova-compute[85141]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 10:17:36 user nova-compute[85141]:     <video>
Nov 16 10:17:36 user nova-compute[85141]:       <model type="virtio"/>
Nov 16 10:17:36 user nova-compute[85141]:     </video>
Nov 16 10:17:36 user nova-compute[85141]:     <rng model="virtio">
Nov 16 10:17:36 user nova-compute[85141]:       <backend model="random">/dev/urandom</backend>
Nov 16 10:17:36 user nova-compute[85141]:     </rng>
Nov 16 10:17:36 user nova-compute[85141]:     <controller type="usb" index="0" model="none"/>
Nov 16 10:17:36 user nova-compute[85141]:     <memballoon model="virtio">
Nov 16 10:17:36 user nova-compute[85141]:       <stats period="10"/>
Nov 16 10:17:36 user nova-compute[85141]:     </memballoon>
Nov 16 10:17:36 user nova-compute[85141]:   </devices>
Nov 16 10:17:36 user nova-compute[85141]: </domain>
Nov 16 10:17:36 user nova-compute[85141]:  {{(pid=85141) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 10:17:36 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-affecd51-40bd-4f74-bdd5-ea8b6633a300 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T10:17:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1258419633',display_name='tempest-TestMinimumBasicScenario-server-1258419633',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1258419633',id=22,image_ref='e960df59-53b9-475b-b762-72c61c99e0eb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBItDkOA9C0uJPf9LijOMkhRvGGhUREdg5zYTmAP8Jr2q5TskNTHRCZQqwtHRWI5QTrlnhI5kKcYXRZFhe3aqQnbfNkSahjTY0HHASfhQQbujcaJQTG8nSUyM5nxOwF6+5g==',key_name='tempest-TestMinimumBasicScenario-2119154314',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b4e4f57f79564d2fbcb8080bf8f1c5c0',ramdisk_id='',reservation_id='r-3bxzxj23',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e960df59-53b9-475b-b762-72c61c99e0eb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-766472507',owner_user_name='tempest-TestMinimumBasicScenario-766472507-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T10:17:32Z,user_data=None,user_id='f8792b5cbd0845299dc396f922399980',uuid=2d7787a2-b8da-4d39-9b16-4c7bcb275f85,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3f553883-eaa0-4a7e-8e31-1170241a0236", "address": "fa:16:3e:1c:29:6f", "network": {"id": "436477fd-9294-4297-bfb3-405564823fa0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1068749207-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4e4f57f79564d2fbcb8080bf8f1c5c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f553883-ea", "ovs_interfaceid": "3f553883-eaa0-4a7e-8e31-1170241a0236", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 10:17:36 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-affecd51-40bd-4f74-bdd5-ea8b6633a300 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Converting VIF {"id": "3f553883-eaa0-4a7e-8e31-1170241a0236", "address": "fa:16:3e:1c:29:6f", "network": {"id": "436477fd-9294-4297-bfb3-405564823fa0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1068749207-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4e4f57f79564d2fbcb8080bf8f1c5c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f553883-ea", "ovs_interfaceid": "3f553883-eaa0-4a7e-8e31-1170241a0236", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:17:36 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-affecd51-40bd-4f74-bdd5-ea8b6633a300 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1c:29:6f,bridge_name='br-int',has_traffic_filtering=True,id=3f553883-eaa0-4a7e-8e31-1170241a0236,network=Network(436477fd-9294-4297-bfb3-405564823fa0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f553883-ea') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:17:36 user nova-compute[85141]: DEBUG os_vif [None req-affecd51-40bd-4f74-bdd5-ea8b6633a300 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:29:6f,bridge_name='br-int',has_traffic_filtering=True,id=3f553883-eaa0-4a7e-8e31-1170241a0236,network=Network(436477fd-9294-4297-bfb3-405564823fa0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f553883-ea') {{(pid=85141) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 10:17:36 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:17:36 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:17:36 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 10:17:36 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:17:36 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '04508027-90b5-5ace-a385-e821f61d5f0e', '_type': 'linux-noop'}}, row=False) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:17:36 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:17:36 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:17:36 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:17:36 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3f553883-ea, may_exist=True, interface_attrs={}) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:17:36 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3f553883-ea, col_values=(('qos', UUID('5c718ede-062e-435b-b9a4-156f87fe1d6a')),), if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:17:36 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3f553883-ea, col_values=(('external_ids', {'iface-id': '3f553883-eaa0-4a7e-8e31-1170241a0236', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1c:29:6f', 'vm-uuid': '2d7787a2-b8da-4d39-9b16-4c7bcb275f85'}),), if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:17:36 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:17:36 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:17:36 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:17:36 user nova-compute[85141]: INFO os_vif [None req-affecd51-40bd-4f74-bdd5-ea8b6633a300 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:29:6f,bridge_name='br-int',has_traffic_filtering=True,id=3f553883-eaa0-4a7e-8e31-1170241a0236,network=Network(436477fd-9294-4297-bfb3-405564823fa0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f553883-ea')
Nov 16 10:17:37 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-affecd51-40bd-4f74-bdd5-ea8b6633a300 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] No BDM found with device name vda, not building metadata. {{(pid=85141) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 10:17:37 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-affecd51-40bd-4f74-bdd5-ea8b6633a300 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] No VIF found with MAC fa:16:3e:1c:29:6f, not building metadata {{(pid=85141) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 10:17:37 user nova-compute[85141]: DEBUG nova.network.neutron [req-5288a564-f878-4868-b924-29d18a773451 req-91a1fff6-37b8-4efc-b214-b1ce6db672b3 service nova] [instance: 2d7787a2-b8da-4d39-9b16-4c7bcb275f85] Updated VIF entry in instance network info cache for port 3f553883-eaa0-4a7e-8e31-1170241a0236. {{(pid=85141) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 10:17:37 user nova-compute[85141]: DEBUG nova.network.neutron [req-5288a564-f878-4868-b924-29d18a773451 req-91a1fff6-37b8-4efc-b214-b1ce6db672b3 service nova] [instance: 2d7787a2-b8da-4d39-9b16-4c7bcb275f85] Updating instance_info_cache with network_info: [{"id": "3f553883-eaa0-4a7e-8e31-1170241a0236", "address": "fa:16:3e:1c:29:6f", "network": {"id": "436477fd-9294-4297-bfb3-405564823fa0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1068749207-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4e4f57f79564d2fbcb8080bf8f1c5c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f553883-ea", "ovs_interfaceid": "3f553883-eaa0-4a7e-8e31-1170241a0236", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:17:37 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-5288a564-f878-4868-b924-29d18a773451 req-91a1fff6-37b8-4efc-b214-b1ce6db672b3 service nova] Releasing lock "refresh_cache-2d7787a2-b8da-4d39-9b16-4c7bcb275f85" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:17:37 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:17:37 user nova-compute[85141]: DEBUG nova.virt.libvirt.guest [None req-f7318c46-eb4e-47c5-a9a4-5c9360f09ee8 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=85141) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 10:17:37 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:17:38 user nova-compute[85141]: DEBUG nova.virt.libvirt.guest [None req-f7318c46-eb4e-47c5-a9a4-5c9360f09ee8 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=85141) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 10:17:38 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-f7318c46-eb4e-47c5-a9a4-5c9360f09ee8 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] [instance: fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 16 10:17:38 user nova-compute[85141]: DEBUG nova.privsep.utils [None req-f7318c46-eb4e-47c5-a9a4-5c9360f09ee8 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=85141) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 16 10:17:38 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-f7318c46-eb4e-47c5-a9a4-5c9360f09ee8 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpi1ar0ay1/463e40821b02435eb1b6ecd1d02c4846.delta /opt/stack/data/nova/instances/snapshots/tmpi1ar0ay1/463e40821b02435eb1b6ecd1d02c4846 {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:17:38 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-f7318c46-eb4e-47c5-a9a4-5c9360f09ee8 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpi1ar0ay1/463e40821b02435eb1b6ecd1d02c4846.delta /opt/stack/data/nova/instances/snapshots/tmpi1ar0ay1/463e40821b02435eb1b6ecd1d02c4846" returned: 0 in 0.496s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:17:38 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-f7318c46-eb4e-47c5-a9a4-5c9360f09ee8 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] [instance: fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f] Snapshot extracted, beginning image upload
Nov 16 10:17:39 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:17:39 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:17:39 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:17:39 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:17:39 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:17:39 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:17:40 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:17:40 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:17:40 user nova-compute[85141]: DEBUG nova.compute.manager [req-71aa1c8d-29bf-4e70-a7ce-84432abcd437 req-42e711fd-a882-4aca-a623-8730c43746c2 service nova] [instance: 2d7787a2-b8da-4d39-9b16-4c7bcb275f85] Received event network-vif-plugged-3f553883-eaa0-4a7e-8e31-1170241a0236 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:17:40 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-71aa1c8d-29bf-4e70-a7ce-84432abcd437 req-42e711fd-a882-4aca-a623-8730c43746c2 service nova] Acquiring lock "2d7787a2-b8da-4d39-9b16-4c7bcb275f85-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:17:40 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-71aa1c8d-29bf-4e70-a7ce-84432abcd437 req-42e711fd-a882-4aca-a623-8730c43746c2 service nova] Lock "2d7787a2-b8da-4d39-9b16-4c7bcb275f85-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:17:40 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-71aa1c8d-29bf-4e70-a7ce-84432abcd437 req-42e711fd-a882-4aca-a623-8730c43746c2 service nova] Lock "2d7787a2-b8da-4d39-9b16-4c7bcb275f85-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:17:40 user nova-compute[85141]: DEBUG nova.compute.manager [req-71aa1c8d-29bf-4e70-a7ce-84432abcd437 req-42e711fd-a882-4aca-a623-8730c43746c2 service nova] [instance: 2d7787a2-b8da-4d39-9b16-4c7bcb275f85] No waiting events found dispatching network-vif-plugged-3f553883-eaa0-4a7e-8e31-1170241a0236 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:17:40 user nova-compute[85141]: WARNING nova.compute.manager [req-71aa1c8d-29bf-4e70-a7ce-84432abcd437 req-42e711fd-a882-4aca-a623-8730c43746c2 service nova] [instance: 2d7787a2-b8da-4d39-9b16-4c7bcb275f85] Received unexpected event network-vif-plugged-3f553883-eaa0-4a7e-8e31-1170241a0236 for instance with vm_state building and task_state spawning.
Nov 16 10:17:41 user nova-compute[85141]: DEBUG nova.compute.manager [None req-affecd51-40bd-4f74-bdd5-ea8b6633a300 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] [instance: 2d7787a2-b8da-4d39-9b16-4c7bcb275f85] Instance event wait completed in 0 seconds for  {{(pid=85141) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 10:17:41 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-affecd51-40bd-4f74-bdd5-ea8b6633a300 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] [instance: 2d7787a2-b8da-4d39-9b16-4c7bcb275f85] Guest created on hypervisor {{(pid=85141) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 10:17:41 user nova-compute[85141]: INFO nova.virt.libvirt.driver [-] [instance: 2d7787a2-b8da-4d39-9b16-4c7bcb275f85] Instance spawned successfully.
Nov 16 10:17:41 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-affecd51-40bd-4f74-bdd5-ea8b6633a300 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] [instance: 2d7787a2-b8da-4d39-9b16-4c7bcb275f85] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 10:17:41 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-affecd51-40bd-4f74-bdd5-ea8b6633a300 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] [instance: 2d7787a2-b8da-4d39-9b16-4c7bcb275f85] Found default for hw_cdrom_bus of ide {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:17:41 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-affecd51-40bd-4f74-bdd5-ea8b6633a300 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] [instance: 2d7787a2-b8da-4d39-9b16-4c7bcb275f85] Found default for hw_disk_bus of virtio {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:17:41 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-affecd51-40bd-4f74-bdd5-ea8b6633a300 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] [instance: 2d7787a2-b8da-4d39-9b16-4c7bcb275f85] Found default for hw_input_bus of None {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:17:41 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-affecd51-40bd-4f74-bdd5-ea8b6633a300 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] [instance: 2d7787a2-b8da-4d39-9b16-4c7bcb275f85] Found default for hw_pointer_model of None {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:17:41 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-affecd51-40bd-4f74-bdd5-ea8b6633a300 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] [instance: 2d7787a2-b8da-4d39-9b16-4c7bcb275f85] Found default for hw_video_model of virtio {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:17:41 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-affecd51-40bd-4f74-bdd5-ea8b6633a300 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] [instance: 2d7787a2-b8da-4d39-9b16-4c7bcb275f85] Found default for hw_vif_model of virtio {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:17:41 user nova-compute[85141]: INFO nova.compute.manager [None req-affecd51-40bd-4f74-bdd5-ea8b6633a300 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] [instance: 2d7787a2-b8da-4d39-9b16-4c7bcb275f85] Took 9.14 seconds to spawn the instance on the hypervisor.
Nov 16 10:17:41 user nova-compute[85141]: DEBUG nova.compute.manager [None req-affecd51-40bd-4f74-bdd5-ea8b6633a300 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] [instance: 2d7787a2-b8da-4d39-9b16-4c7bcb275f85] Checking state {{(pid=85141) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 10:17:41 user nova-compute[85141]: INFO nova.compute.manager [None req-affecd51-40bd-4f74-bdd5-ea8b6633a300 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] [instance: 2d7787a2-b8da-4d39-9b16-4c7bcb275f85] Took 10.56 seconds to build instance.
Nov 16 10:17:41 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-affecd51-40bd-4f74-bdd5-ea8b6633a300 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Lock "2d7787a2-b8da-4d39-9b16-4c7bcb275f85" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.661s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:17:41 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:17:42 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-f7318c46-eb4e-47c5-a9a4-5c9360f09ee8 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] [instance: fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f] Snapshot image upload complete
Nov 16 10:17:42 user nova-compute[85141]: INFO nova.compute.manager [None req-f7318c46-eb4e-47c5-a9a4-5c9360f09ee8 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] [instance: fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f] Took 6.22 seconds to snapshot the instance on the hypervisor.
Nov 16 10:17:42 user nova-compute[85141]: DEBUG nova.compute.manager [req-b2bb5613-7540-4b26-9285-e35209eedf7c req-e4645765-801c-44d9-b2c5-44f3ce2ac8da service nova] [instance: 2d7787a2-b8da-4d39-9b16-4c7bcb275f85] Received event network-vif-plugged-3f553883-eaa0-4a7e-8e31-1170241a0236 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:17:42 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-b2bb5613-7540-4b26-9285-e35209eedf7c req-e4645765-801c-44d9-b2c5-44f3ce2ac8da service nova] Acquiring lock "2d7787a2-b8da-4d39-9b16-4c7bcb275f85-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:17:42 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-b2bb5613-7540-4b26-9285-e35209eedf7c req-e4645765-801c-44d9-b2c5-44f3ce2ac8da service nova] Lock "2d7787a2-b8da-4d39-9b16-4c7bcb275f85-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:17:42 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-b2bb5613-7540-4b26-9285-e35209eedf7c req-e4645765-801c-44d9-b2c5-44f3ce2ac8da service nova] Lock "2d7787a2-b8da-4d39-9b16-4c7bcb275f85-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:17:42 user nova-compute[85141]: DEBUG nova.compute.manager [req-b2bb5613-7540-4b26-9285-e35209eedf7c req-e4645765-801c-44d9-b2c5-44f3ce2ac8da service nova] [instance: 2d7787a2-b8da-4d39-9b16-4c7bcb275f85] No waiting events found dispatching network-vif-plugged-3f553883-eaa0-4a7e-8e31-1170241a0236 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:17:42 user nova-compute[85141]: WARNING nova.compute.manager [req-b2bb5613-7540-4b26-9285-e35209eedf7c req-e4645765-801c-44d9-b2c5-44f3ce2ac8da service nova] [instance: 2d7787a2-b8da-4d39-9b16-4c7bcb275f85] Received unexpected event network-vif-plugged-3f553883-eaa0-4a7e-8e31-1170241a0236 for instance with vm_state active and task_state None.
Nov 16 10:17:42 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:17:42 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-cfd293ae-d48a-4e9f-a830-836e1f195589 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Acquiring lock "0b388b98-4e65-4258-bbe2-77e699321fb7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:17:42 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-cfd293ae-d48a-4e9f-a830-836e1f195589 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Lock "0b388b98-4e65-4258-bbe2-77e699321fb7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:17:43 user nova-compute[85141]: DEBUG nova.compute.manager [None req-cfd293ae-d48a-4e9f-a830-836e1f195589 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] [instance: 0b388b98-4e65-4258-bbe2-77e699321fb7] Starting instance... {{(pid=85141) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 10:17:43 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-cfd293ae-d48a-4e9f-a830-836e1f195589 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:17:43 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-cfd293ae-d48a-4e9f-a830-836e1f195589 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:17:43 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-cfd293ae-d48a-4e9f-a830-836e1f195589 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=85141) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 10:17:43 user nova-compute[85141]: INFO nova.compute.claims [None req-cfd293ae-d48a-4e9f-a830-836e1f195589 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] [instance: 0b388b98-4e65-4258-bbe2-77e699321fb7] Claim successful on node user
Nov 16 10:17:43 user nova-compute[85141]: DEBUG nova.compute.provider_tree [None req-cfd293ae-d48a-4e9f-a830-836e1f195589 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Inventory has not changed in ProviderTree for provider: bf8e0fa1-16b6-408f-9203-c4cd63916272 {{(pid=85141) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 10:17:43 user nova-compute[85141]: DEBUG nova.scheduler.client.report [None req-cfd293ae-d48a-4e9f-a830-836e1f195589 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Inventory has not changed for provider bf8e0fa1-16b6-408f-9203-c4cd63916272 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=85141) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 10:17:43 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-cfd293ae-d48a-4e9f-a830-836e1f195589 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.435s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:17:43 user nova-compute[85141]: DEBUG nova.compute.manager [None req-cfd293ae-d48a-4e9f-a830-836e1f195589 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] [instance: 0b388b98-4e65-4258-bbe2-77e699321fb7] Start building networks asynchronously for instance. {{(pid=85141) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 10:17:43 user nova-compute[85141]: DEBUG nova.compute.manager [None req-cfd293ae-d48a-4e9f-a830-836e1f195589 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] [instance: 0b388b98-4e65-4258-bbe2-77e699321fb7] Allocating IP information in the background. {{(pid=85141) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 10:17:43 user nova-compute[85141]: DEBUG nova.network.neutron [None req-cfd293ae-d48a-4e9f-a830-836e1f195589 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] [instance: 0b388b98-4e65-4258-bbe2-77e699321fb7] allocate_for_instance() {{(pid=85141) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 10:17:43 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-cfd293ae-d48a-4e9f-a830-836e1f195589 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] [instance: 0b388b98-4e65-4258-bbe2-77e699321fb7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 10:17:43 user nova-compute[85141]: DEBUG nova.compute.manager [None req-cfd293ae-d48a-4e9f-a830-836e1f195589 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] [instance: 0b388b98-4e65-4258-bbe2-77e699321fb7] Start building block device mappings for instance. {{(pid=85141) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 10:17:43 user nova-compute[85141]: DEBUG nova.policy [None req-cfd293ae-d48a-4e9f-a830-836e1f195589 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f58409e5923c42b685d0a3ad0ab42974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2acc04e107d4a229c3580cf078a20f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85141) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 10:17:43 user nova-compute[85141]: DEBUG nova.compute.manager [None req-cfd293ae-d48a-4e9f-a830-836e1f195589 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] [instance: 0b388b98-4e65-4258-bbe2-77e699321fb7] Start spawning the instance on the hypervisor. {{(pid=85141) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 10:17:43 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-cfd293ae-d48a-4e9f-a830-836e1f195589 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] [instance: 0b388b98-4e65-4258-bbe2-77e699321fb7] Creating instance directory {{(pid=85141) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 10:17:43 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-cfd293ae-d48a-4e9f-a830-836e1f195589 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] [instance: 0b388b98-4e65-4258-bbe2-77e699321fb7] Creating image(s)
Nov 16 10:17:43 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-cfd293ae-d48a-4e9f-a830-836e1f195589 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Acquiring lock "/opt/stack/data/nova/instances/0b388b98-4e65-4258-bbe2-77e699321fb7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:17:43 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-cfd293ae-d48a-4e9f-a830-836e1f195589 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Lock "/opt/stack/data/nova/instances/0b388b98-4e65-4258-bbe2-77e699321fb7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:17:43 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-cfd293ae-d48a-4e9f-a830-836e1f195589 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Lock "/opt/stack/data/nova/instances/0b388b98-4e65-4258-bbe2-77e699321fb7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:17:43 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-cfd293ae-d48a-4e9f-a830-836e1f195589 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:17:44 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-cfd293ae-d48a-4e9f-a830-836e1f195589 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json" returned: 0 in 0.183s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:17:44 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-cfd293ae-d48a-4e9f-a830-836e1f195589 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Acquiring lock "60a78556fb399ed4a41bc3ca4bccf77c96d8e811" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:17:44 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-cfd293ae-d48a-4e9f-a830-836e1f195589 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Lock "60a78556fb399ed4a41bc3ca4bccf77c96d8e811" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:17:44 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-cfd293ae-d48a-4e9f-a830-836e1f195589 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:17:44 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-cfd293ae-d48a-4e9f-a830-836e1f195589 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json" returned: 0 in 0.214s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:17:44 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-cfd293ae-d48a-4e9f-a830-836e1f195589 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811,backing_fmt=raw /opt/stack/data/nova/instances/0b388b98-4e65-4258-bbe2-77e699321fb7/disk 1073741824 {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:17:44 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-cfd293ae-d48a-4e9f-a830-836e1f195589 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811,backing_fmt=raw /opt/stack/data/nova/instances/0b388b98-4e65-4258-bbe2-77e699321fb7/disk 1073741824" returned: 0 in 0.054s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:17:44 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-cfd293ae-d48a-4e9f-a830-836e1f195589 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Lock "60a78556fb399ed4a41bc3ca4bccf77c96d8e811" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.275s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:17:44 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-cfd293ae-d48a-4e9f-a830-836e1f195589 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:17:44 user nova-compute[85141]: DEBUG nova.network.neutron [None req-cfd293ae-d48a-4e9f-a830-836e1f195589 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] [instance: 0b388b98-4e65-4258-bbe2-77e699321fb7] Successfully created port: 3ed9d2a6-c028-4b75-9023-95b1cfa982b6 {{(pid=85141) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 10:17:44 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-cfd293ae-d48a-4e9f-a830-836e1f195589 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json" returned: 0 in 0.202s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:17:44 user nova-compute[85141]: DEBUG nova.virt.disk.api [None req-cfd293ae-d48a-4e9f-a830-836e1f195589 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0b388b98-4e65-4258-bbe2-77e699321fb7/disk. size=1073741824 {{(pid=85141) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 10:17:44 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-cfd293ae-d48a-4e9f-a830-836e1f195589 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b388b98-4e65-4258-bbe2-77e699321fb7/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:17:44 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-cfd293ae-d48a-4e9f-a830-836e1f195589 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b388b98-4e65-4258-bbe2-77e699321fb7/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:17:44 user nova-compute[85141]: DEBUG nova.virt.disk.api [None req-cfd293ae-d48a-4e9f-a830-836e1f195589 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Cannot resize image /opt/stack/data/nova/instances/0b388b98-4e65-4258-bbe2-77e699321fb7/disk to a smaller size. {{(pid=85141) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 10:17:44 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-cfd293ae-d48a-4e9f-a830-836e1f195589 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] [instance: 0b388b98-4e65-4258-bbe2-77e699321fb7] Created local disks {{(pid=85141) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 10:17:44 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-cfd293ae-d48a-4e9f-a830-836e1f195589 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] [instance: 0b388b98-4e65-4258-bbe2-77e699321fb7] Ensure instance console log exists: /opt/stack/data/nova/instances/0b388b98-4e65-4258-bbe2-77e699321fb7/console.log {{(pid=85141) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 10:17:44 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-cfd293ae-d48a-4e9f-a830-836e1f195589 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:17:44 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-cfd293ae-d48a-4e9f-a830-836e1f195589 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:17:44 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-cfd293ae-d48a-4e9f-a830-836e1f195589 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:17:44 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-fa51855c-8493-4f5f-9f40-7d0cf0320675 tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] Acquiring lock "e88874fe-b0a6-4292-8832-023f95e4f53c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:17:44 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-fa51855c-8493-4f5f-9f40-7d0cf0320675 tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] Lock "e88874fe-b0a6-4292-8832-023f95e4f53c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:17:44 user nova-compute[85141]: DEBUG nova.compute.manager [None req-fa51855c-8493-4f5f-9f40-7d0cf0320675 tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] [instance: e88874fe-b0a6-4292-8832-023f95e4f53c] Starting instance... {{(pid=85141) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 10:17:44 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-fa51855c-8493-4f5f-9f40-7d0cf0320675 tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:17:44 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-fa51855c-8493-4f5f-9f40-7d0cf0320675 tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:17:44 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-fa51855c-8493-4f5f-9f40-7d0cf0320675 tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=85141) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 10:17:44 user nova-compute[85141]: INFO nova.compute.claims [None req-fa51855c-8493-4f5f-9f40-7d0cf0320675 tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] [instance: e88874fe-b0a6-4292-8832-023f95e4f53c] Claim successful on node user
Nov 16 10:17:45 user nova-compute[85141]: DEBUG nova.network.neutron [None req-cfd293ae-d48a-4e9f-a830-836e1f195589 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] [instance: 0b388b98-4e65-4258-bbe2-77e699321fb7] Successfully updated port: 3ed9d2a6-c028-4b75-9023-95b1cfa982b6 {{(pid=85141) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 10:17:45 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-cfd293ae-d48a-4e9f-a830-836e1f195589 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Acquiring lock "refresh_cache-0b388b98-4e65-4258-bbe2-77e699321fb7" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:17:45 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-cfd293ae-d48a-4e9f-a830-836e1f195589 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Acquired lock "refresh_cache-0b388b98-4e65-4258-bbe2-77e699321fb7" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:17:45 user nova-compute[85141]: DEBUG nova.network.neutron [None req-cfd293ae-d48a-4e9f-a830-836e1f195589 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] [instance: 0b388b98-4e65-4258-bbe2-77e699321fb7] Building network info cache for instance {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 10:17:45 user nova-compute[85141]: DEBUG nova.compute.manager [req-791a082f-51a4-47fc-83d4-a385840e014e req-4b1bd148-fbd2-4ac2-b85e-037937b2003a service nova] [instance: 0b388b98-4e65-4258-bbe2-77e699321fb7] Received event network-changed-3ed9d2a6-c028-4b75-9023-95b1cfa982b6 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:17:45 user nova-compute[85141]: DEBUG nova.compute.manager [req-791a082f-51a4-47fc-83d4-a385840e014e req-4b1bd148-fbd2-4ac2-b85e-037937b2003a service nova] [instance: 0b388b98-4e65-4258-bbe2-77e699321fb7] Refreshing instance network info cache due to event network-changed-3ed9d2a6-c028-4b75-9023-95b1cfa982b6. {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 10:17:45 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-791a082f-51a4-47fc-83d4-a385840e014e req-4b1bd148-fbd2-4ac2-b85e-037937b2003a service nova] Acquiring lock "refresh_cache-0b388b98-4e65-4258-bbe2-77e699321fb7" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:17:45 user nova-compute[85141]: DEBUG nova.network.neutron [None req-cfd293ae-d48a-4e9f-a830-836e1f195589 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] [instance: 0b388b98-4e65-4258-bbe2-77e699321fb7] Instance cache missing network info. {{(pid=85141) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 10:17:45 user nova-compute[85141]: DEBUG nova.compute.provider_tree [None req-fa51855c-8493-4f5f-9f40-7d0cf0320675 tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] Inventory has not changed in ProviderTree for provider: bf8e0fa1-16b6-408f-9203-c4cd63916272 {{(pid=85141) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 10:17:45 user nova-compute[85141]: DEBUG nova.scheduler.client.report [None req-fa51855c-8493-4f5f-9f40-7d0cf0320675 tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] Inventory has not changed for provider bf8e0fa1-16b6-408f-9203-c4cd63916272 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=85141) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 10:17:45 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-fa51855c-8493-4f5f-9f40-7d0cf0320675 tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.493s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:17:45 user nova-compute[85141]: DEBUG nova.compute.manager [None req-fa51855c-8493-4f5f-9f40-7d0cf0320675 tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] [instance: e88874fe-b0a6-4292-8832-023f95e4f53c] Start building networks asynchronously for instance. {{(pid=85141) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 10:17:45 user nova-compute[85141]: DEBUG nova.compute.manager [None req-fa51855c-8493-4f5f-9f40-7d0cf0320675 tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] [instance: e88874fe-b0a6-4292-8832-023f95e4f53c] Allocating IP information in the background. {{(pid=85141) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 10:17:45 user nova-compute[85141]: DEBUG nova.network.neutron [None req-fa51855c-8493-4f5f-9f40-7d0cf0320675 tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] [instance: e88874fe-b0a6-4292-8832-023f95e4f53c] allocate_for_instance() {{(pid=85141) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 10:17:45 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-fa51855c-8493-4f5f-9f40-7d0cf0320675 tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] [instance: e88874fe-b0a6-4292-8832-023f95e4f53c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 10:17:45 user nova-compute[85141]: DEBUG nova.compute.manager [None req-fa51855c-8493-4f5f-9f40-7d0cf0320675 tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] [instance: e88874fe-b0a6-4292-8832-023f95e4f53c] Start building block device mappings for instance. {{(pid=85141) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 10:17:45 user nova-compute[85141]: INFO nova.virt.block_device [None req-fa51855c-8493-4f5f-9f40-7d0cf0320675 tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] [instance: e88874fe-b0a6-4292-8832-023f95e4f53c] Booting with volume 674f9ae8-6ab5-4ff2-b715-fe8807c34793 at /dev/vda
Nov 16 10:17:45 user nova-compute[85141]: DEBUG nova.network.neutron [None req-cfd293ae-d48a-4e9f-a830-836e1f195589 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] [instance: 0b388b98-4e65-4258-bbe2-77e699321fb7] Updating instance_info_cache with network_info: [{"id": "3ed9d2a6-c028-4b75-9023-95b1cfa982b6", "address": "fa:16:3e:85:dd:4c", "network": {"id": "4e36c3d2-7d16-4305-a0a7-2358e1208df3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1030128743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2acc04e107d4a229c3580cf078a20f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ed9d2a6-c0", "ovs_interfaceid": "3ed9d2a6-c028-4b75-9023-95b1cfa982b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:17:45 user nova-compute[85141]: DEBUG nova.policy [None req-fa51855c-8493-4f5f-9f40-7d0cf0320675 tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '462543c542ac4e84b99277f8cdd29807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fc33dd813c64594a3626d2e7dff09ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85141) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 10:17:45 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-cfd293ae-d48a-4e9f-a830-836e1f195589 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Releasing lock "refresh_cache-0b388b98-4e65-4258-bbe2-77e699321fb7" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:17:45 user nova-compute[85141]: DEBUG nova.compute.manager [None req-cfd293ae-d48a-4e9f-a830-836e1f195589 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] [instance: 0b388b98-4e65-4258-bbe2-77e699321fb7] Instance network_info: |[{"id": "3ed9d2a6-c028-4b75-9023-95b1cfa982b6", "address": "fa:16:3e:85:dd:4c", "network": {"id": "4e36c3d2-7d16-4305-a0a7-2358e1208df3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1030128743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2acc04e107d4a229c3580cf078a20f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ed9d2a6-c0", "ovs_interfaceid": "3ed9d2a6-c028-4b75-9023-95b1cfa982b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=85141) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 10:17:45 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-791a082f-51a4-47fc-83d4-a385840e014e req-4b1bd148-fbd2-4ac2-b85e-037937b2003a service nova] Acquired lock "refresh_cache-0b388b98-4e65-4258-bbe2-77e699321fb7" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:17:45 user nova-compute[85141]: DEBUG nova.network.neutron [req-791a082f-51a4-47fc-83d4-a385840e014e req-4b1bd148-fbd2-4ac2-b85e-037937b2003a service nova] [instance: 0b388b98-4e65-4258-bbe2-77e699321fb7] Refreshing network info cache for port 3ed9d2a6-c028-4b75-9023-95b1cfa982b6 {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 10:17:45 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-cfd293ae-d48a-4e9f-a830-836e1f195589 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] [instance: 0b388b98-4e65-4258-bbe2-77e699321fb7] Start _get_guest_xml network_info=[{"id": "3ed9d2a6-c028-4b75-9023-95b1cfa982b6", "address": "fa:16:3e:85:dd:4c", "network": {"id": "4e36c3d2-7d16-4305-a0a7-2358e1208df3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1030128743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2acc04e107d4a229c3580cf078a20f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ed9d2a6-c0", "ovs_interfaceid": "3ed9d2a6-c028-4b75-9023-95b1cfa982b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T10:06:42Z,direct_url=<?>,disk_format='qcow2',id=bc4ca70f-a459-4d5c-a9e6-80f1948eb48b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1044631a5fe84ce8904864a7024049fa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T10:06:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_options': None, 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'image_id': 'bc4ca70f-a459-4d5c-a9e6-80f1948eb48b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=85141) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 10:17:45 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-cfd293ae-d48a-4e9f-a830-836e1f195589 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:17:45 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-cfd293ae-d48a-4e9f-a830-836e1f195589 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:17:45 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-cfd293ae-d48a-4e9f-a830-836e1f195589 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=85141) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 10:17:45 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-cfd293ae-d48a-4e9f-a830-836e1f195589 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] CPU controller missing on host. {{(pid=85141) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 10:17:45 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-cfd293ae-d48a-4e9f-a830-836e1f195589 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=85141) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 10:17:45 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-cfd293ae-d48a-4e9f-a830-836e1f195589 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] CPU controller found on host. {{(pid=85141) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 10:17:45 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-cfd293ae-d48a-4e9f-a830-836e1f195589 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=85141) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 10:17:45 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-cfd293ae-d48a-4e9f-a830-836e1f195589 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T10:06:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T10:06:42Z,direct_url=<?>,disk_format='qcow2',id=bc4ca70f-a459-4d5c-a9e6-80f1948eb48b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1044631a5fe84ce8904864a7024049fa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T10:06:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 10:17:45 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-cfd293ae-d48a-4e9f-a830-836e1f195589 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Flavor limits 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 10:17:45 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-cfd293ae-d48a-4e9f-a830-836e1f195589 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Image limits 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 10:17:45 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-cfd293ae-d48a-4e9f-a830-836e1f195589 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Flavor pref 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 10:17:45 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-cfd293ae-d48a-4e9f-a830-836e1f195589 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Image pref 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 10:17:45 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-cfd293ae-d48a-4e9f-a830-836e1f195589 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 10:17:45 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-cfd293ae-d48a-4e9f-a830-836e1f195589 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 10:17:45 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-cfd293ae-d48a-4e9f-a830-836e1f195589 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=85141) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 10:17:45 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-cfd293ae-d48a-4e9f-a830-836e1f195589 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Got 1 possible topologies {{(pid=85141) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 10:17:45 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-cfd293ae-d48a-4e9f-a830-836e1f195589 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 10:17:45 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-cfd293ae-d48a-4e9f-a830-836e1f195589 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 10:17:45 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-cfd293ae-d48a-4e9f-a830-836e1f195589 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T10:17:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1602512664',display_name='tempest-AttachVolumeTestJSON-server-1602512664',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1602512664',id=23,image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAR6bF9nouUYoCi9ZNGh3nZGY5ofrnXVxXtSu/7Acr1EHKWGjXKYUGtrq2XimOt/E4akdnq6ZnUvHCruk4Zy5W8xPtBZmROYAs+9Sfqoh0p8jGC4Ld4F7tm19PX/QAMtvA==',key_name='tempest-keypair-1960067559',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c2acc04e107d4a229c3580cf078a20f7',ramdisk_id='',reservation_id='r-ji9l4e80',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1609390288',owner_user_name='tempest-AttachVolumeTestJSON-1609390288-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T10:17:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f58409e5923c42b685d0a3ad0ab42974',uuid=0b388b98-4e65-4258-bbe2-77e699321fb7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3ed9d2a6-c028-4b75-9023-95b1cfa982b6", "address": "fa:16:3e:85:dd:4c", "network": {"id": "4e36c3d2-7d16-4305-a0a7-2358e1208df3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1030128743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2acc04e107d4a229c3580cf078a20f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ed9d2a6-c0", "ovs_interfaceid": "3ed9d2a6-c028-4b75-9023-95b1cfa982b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=85141) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 10:17:45 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-cfd293ae-d48a-4e9f-a830-836e1f195589 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Converting VIF {"id": "3ed9d2a6-c028-4b75-9023-95b1cfa982b6", "address": "fa:16:3e:85:dd:4c", "network": {"id": "4e36c3d2-7d16-4305-a0a7-2358e1208df3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1030128743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2acc04e107d4a229c3580cf078a20f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ed9d2a6-c0", "ovs_interfaceid": "3ed9d2a6-c028-4b75-9023-95b1cfa982b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:17:45 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-cfd293ae-d48a-4e9f-a830-836e1f195589 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:85:dd:4c,bridge_name='br-int',has_traffic_filtering=True,id=3ed9d2a6-c028-4b75-9023-95b1cfa982b6,network=Network(4e36c3d2-7d16-4305-a0a7-2358e1208df3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ed9d2a6-c0') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:17:45 user nova-compute[85141]: DEBUG nova.objects.instance [None req-cfd293ae-d48a-4e9f-a830-836e1f195589 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Lazy-loading 'pci_devices' on Instance uuid 0b388b98-4e65-4258-bbe2-77e699321fb7 {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:17:45 user nova-compute[85141]: DEBUG os_brick.utils [None req-fa51855c-8493-4f5f-9f40-7d0cf0320675 tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 10:17:45 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:17:45 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-cfd293ae-d48a-4e9f-a830-836e1f195589 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] [instance: 0b388b98-4e65-4258-bbe2-77e699321fb7] End _get_guest_xml xml=<domain type="kvm">
Nov 16 10:17:45 user nova-compute[85141]:   <uuid>0b388b98-4e65-4258-bbe2-77e699321fb7</uuid>
Nov 16 10:17:45 user nova-compute[85141]:   <name>instance-00000017</name>
Nov 16 10:17:45 user nova-compute[85141]:   <memory>524288</memory>
Nov 16 10:17:45 user nova-compute[85141]:   <vcpu>1</vcpu>
Nov 16 10:17:45 user nova-compute[85141]:   <metadata>
Nov 16 10:17:45 user nova-compute[85141]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 10:17:45 user nova-compute[85141]:       <nova:package version="0.0.0"/>
Nov 16 10:17:45 user nova-compute[85141]:       <nova:name>tempest-AttachVolumeTestJSON-server-1602512664</nova:name>
Nov 16 10:17:45 user nova-compute[85141]:       <nova:creationTime>2023-11-16 10:17:45</nova:creationTime>
Nov 16 10:17:45 user nova-compute[85141]:       <nova:flavor name="m1.tiny">
Nov 16 10:17:45 user nova-compute[85141]:         <nova:memory>512</nova:memory>
Nov 16 10:17:45 user nova-compute[85141]:         <nova:disk>1</nova:disk>
Nov 16 10:17:45 user nova-compute[85141]:         <nova:swap>0</nova:swap>
Nov 16 10:17:45 user nova-compute[85141]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 10:17:45 user nova-compute[85141]:         <nova:vcpus>1</nova:vcpus>
Nov 16 10:17:45 user nova-compute[85141]:       </nova:flavor>
Nov 16 10:17:45 user nova-compute[85141]:       <nova:owner>
Nov 16 10:17:45 user nova-compute[85141]:         <nova:user uuid="f58409e5923c42b685d0a3ad0ab42974">tempest-AttachVolumeTestJSON-1609390288-project-member</nova:user>
Nov 16 10:17:45 user nova-compute[85141]:         <nova:project uuid="c2acc04e107d4a229c3580cf078a20f7">tempest-AttachVolumeTestJSON-1609390288</nova:project>
Nov 16 10:17:45 user nova-compute[85141]:       </nova:owner>
Nov 16 10:17:45 user nova-compute[85141]:       <nova:root type="image" uuid="bc4ca70f-a459-4d5c-a9e6-80f1948eb48b"/>
Nov 16 10:17:45 user nova-compute[85141]:       <nova:ports>
Nov 16 10:17:45 user nova-compute[85141]:         <nova:port uuid="3ed9d2a6-c028-4b75-9023-95b1cfa982b6">
Nov 16 10:17:45 user nova-compute[85141]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 16 10:17:45 user nova-compute[85141]:         </nova:port>
Nov 16 10:17:45 user nova-compute[85141]:       </nova:ports>
Nov 16 10:17:45 user nova-compute[85141]:     </nova:instance>
Nov 16 10:17:45 user nova-compute[85141]:   </metadata>
Nov 16 10:17:45 user nova-compute[85141]:   <sysinfo type="smbios">
Nov 16 10:17:45 user nova-compute[85141]:     <system>
Nov 16 10:17:45 user nova-compute[85141]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 10:17:45 user nova-compute[85141]:       <entry name="product">OpenStack Nova</entry>
Nov 16 10:17:45 user nova-compute[85141]:       <entry name="version">0.0.0</entry>
Nov 16 10:17:45 user nova-compute[85141]:       <entry name="serial">0b388b98-4e65-4258-bbe2-77e699321fb7</entry>
Nov 16 10:17:45 user nova-compute[85141]:       <entry name="uuid">0b388b98-4e65-4258-bbe2-77e699321fb7</entry>
Nov 16 10:17:45 user nova-compute[85141]:       <entry name="family">Virtual Machine</entry>
Nov 16 10:17:45 user nova-compute[85141]:     </system>
Nov 16 10:17:45 user nova-compute[85141]:   </sysinfo>
Nov 16 10:17:45 user nova-compute[85141]:   <os>
Nov 16 10:17:45 user nova-compute[85141]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 10:17:45 user nova-compute[85141]:     <boot dev="hd"/>
Nov 16 10:17:45 user nova-compute[85141]:     <smbios mode="sysinfo"/>
Nov 16 10:17:45 user nova-compute[85141]:   </os>
Nov 16 10:17:45 user nova-compute[85141]:   <features>
Nov 16 10:17:45 user nova-compute[85141]:     <acpi/>
Nov 16 10:17:45 user nova-compute[85141]:     <apic/>
Nov 16 10:17:45 user nova-compute[85141]:     <vmcoreinfo/>
Nov 16 10:17:45 user nova-compute[85141]:   </features>
Nov 16 10:17:45 user nova-compute[85141]:   <clock offset="utc">
Nov 16 10:17:45 user nova-compute[85141]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 10:17:45 user nova-compute[85141]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 10:17:45 user nova-compute[85141]:     <timer name="hpet" present="no"/>
Nov 16 10:17:45 user nova-compute[85141]:   </clock>
Nov 16 10:17:45 user nova-compute[85141]:   <cpu mode="custom" match="exact">
Nov 16 10:17:45 user nova-compute[85141]:     <model>Nehalem</model>
Nov 16 10:17:45 user nova-compute[85141]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 10:17:45 user nova-compute[85141]:   </cpu>
Nov 16 10:17:45 user nova-compute[85141]:   <devices>
Nov 16 10:17:45 user nova-compute[85141]:     <disk type="file" device="disk">
Nov 16 10:17:45 user nova-compute[85141]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 10:17:45 user nova-compute[85141]:       <source file="/opt/stack/data/nova/instances/0b388b98-4e65-4258-bbe2-77e699321fb7/disk"/>
Nov 16 10:17:45 user nova-compute[85141]:       <target dev="vda" bus="virtio"/>
Nov 16 10:17:45 user nova-compute[85141]:     </disk>
Nov 16 10:17:45 user nova-compute[85141]:     <interface type="ethernet">
Nov 16 10:17:45 user nova-compute[85141]:       <mac address="fa:16:3e:85:dd:4c"/>
Nov 16 10:17:45 user nova-compute[85141]:       <model type="virtio"/>
Nov 16 10:17:45 user nova-compute[85141]:       <mtu size="1442"/>
Nov 16 10:17:45 user nova-compute[85141]:       <target dev="tap3ed9d2a6-c0"/>
Nov 16 10:17:45 user nova-compute[85141]:     </interface>
Nov 16 10:17:45 user nova-compute[85141]:     <serial type="pty">
Nov 16 10:17:45 user nova-compute[85141]:       <log file="/opt/stack/data/nova/instances/0b388b98-4e65-4258-bbe2-77e699321fb7/console.log" append="off"/>
Nov 16 10:17:45 user nova-compute[85141]:     </serial>
Nov 16 10:17:45 user nova-compute[85141]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 10:17:45 user nova-compute[85141]:     <video>
Nov 16 10:17:45 user nova-compute[85141]:       <model type="virtio"/>
Nov 16 10:17:45 user nova-compute[85141]:     </video>
Nov 16 10:17:45 user nova-compute[85141]:     <rng model="virtio">
Nov 16 10:17:45 user nova-compute[85141]:       <backend model="random">/dev/urandom</backend>
Nov 16 10:17:45 user nova-compute[85141]:     </rng>
Nov 16 10:17:45 user nova-compute[85141]:     <controller type="usb" index="0" model="none"/>
Nov 16 10:17:45 user nova-compute[85141]:     <memballoon model="virtio">
Nov 16 10:17:45 user nova-compute[85141]:       <stats period="10"/>
Nov 16 10:17:45 user nova-compute[85141]:     </memballoon>
Nov 16 10:17:45 user nova-compute[85141]:   </devices>
Nov 16 10:17:45 user nova-compute[85141]: </domain>
Nov 16 10:17:45 user nova-compute[85141]:  {{(pid=85141) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 10:17:45 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-cfd293ae-d48a-4e9f-a830-836e1f195589 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T10:17:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1602512664',display_name='tempest-AttachVolumeTestJSON-server-1602512664',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1602512664',id=23,image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAR6bF9nouUYoCi9ZNGh3nZGY5ofrnXVxXtSu/7Acr1EHKWGjXKYUGtrq2XimOt/E4akdnq6ZnUvHCruk4Zy5W8xPtBZmROYAs+9Sfqoh0p8jGC4Ld4F7tm19PX/QAMtvA==',key_name='tempest-keypair-1960067559',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c2acc04e107d4a229c3580cf078a20f7',ramdisk_id='',reservation_id='r-ji9l4e80',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1609390288',owner_user_name='tempest-AttachVolumeTestJSON-1609390288-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T10:17:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f58409e5923c42b685d0a3ad0ab42974',uuid=0b388b98-4e65-4258-bbe2-77e699321fb7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3ed9d2a6-c028-4b75-9023-95b1cfa982b6", "address": "fa:16:3e:85:dd:4c", "network": {"id": "4e36c3d2-7d16-4305-a0a7-2358e1208df3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1030128743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2acc04e107d4a229c3580cf078a20f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ed9d2a6-c0", "ovs_interfaceid": "3ed9d2a6-c028-4b75-9023-95b1cfa982b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 10:17:45 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-cfd293ae-d48a-4e9f-a830-836e1f195589 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Converting VIF {"id": "3ed9d2a6-c028-4b75-9023-95b1cfa982b6", "address": "fa:16:3e:85:dd:4c", "network": {"id": "4e36c3d2-7d16-4305-a0a7-2358e1208df3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1030128743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2acc04e107d4a229c3580cf078a20f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ed9d2a6-c0", "ovs_interfaceid": "3ed9d2a6-c028-4b75-9023-95b1cfa982b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:17:45 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-cfd293ae-d48a-4e9f-a830-836e1f195589 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:85:dd:4c,bridge_name='br-int',has_traffic_filtering=True,id=3ed9d2a6-c028-4b75-9023-95b1cfa982b6,network=Network(4e36c3d2-7d16-4305-a0a7-2358e1208df3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ed9d2a6-c0') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:17:45 user nova-compute[85141]: DEBUG os_vif [None req-cfd293ae-d48a-4e9f-a830-836e1f195589 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:85:dd:4c,bridge_name='br-int',has_traffic_filtering=True,id=3ed9d2a6-c028-4b75-9023-95b1cfa982b6,network=Network(4e36c3d2-7d16-4305-a0a7-2358e1208df3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ed9d2a6-c0') {{(pid=85141) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 10:17:45 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:17:45 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:17:45 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 10:17:45 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:17:45 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[8650a5a7-16c7-48af-b0b6-75c242428201]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c7834de5c295\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:17:45 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:17:45 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0d9404e5-c1b0-55b5-995e-7843afb8e8d3', '_type': 'linux-noop'}}, row=False) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:17:45 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:17:45 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:17:45 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:17:45 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:17:45 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3ed9d2a6-c0, may_exist=True, interface_attrs={}) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:17:45 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3ed9d2a6-c0, col_values=(('qos', UUID('b7ebbee7-93b3-4cb0-8720-27990ab643ca')),), if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:17:45 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3ed9d2a6-c0, col_values=(('external_ids', {'iface-id': '3ed9d2a6-c028-4b75-9023-95b1cfa982b6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:85:dd:4c', 'vm-uuid': '0b388b98-4e65-4258-bbe2-77e699321fb7'}),), if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:17:45 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:17:45 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:17:45 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.029s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:17:45 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4c40cdf-d596-4a2a-8395-4d5f5d284e91]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:17:45 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:17:45 user nova-compute[85141]: INFO os_vif [None req-cfd293ae-d48a-4e9f-a830-836e1f195589 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:85:dd:4c,bridge_name='br-int',has_traffic_filtering=True,id=3ed9d2a6-c028-4b75-9023-95b1cfa982b6,network=Network(4e36c3d2-7d16-4305-a0a7-2358e1208df3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ed9d2a6-c0')
Nov 16 10:17:45 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:17:45 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-cfd293ae-d48a-4e9f-a830-836e1f195589 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] No BDM found with device name vda, not building metadata. {{(pid=85141) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 10:17:45 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-cfd293ae-d48a-4e9f-a830-836e1f195589 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] No VIF found with MAC fa:16:3e:85:dd:4c, not building metadata {{(pid=85141) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 10:17:45 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.071s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:17:45 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[722716f2-82bb-4199-b333-a5d0b2ef00c6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:17:45 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[817c3842-f441-43ad-a704-fe27ab43a796]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:17:45 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-fa51855c-8493-4f5f-9f40-7d0cf0320675 tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] Running cmd (subprocess): nvme version {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:17:45 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-fa51855c-8493-4f5f-9f40-7d0cf0320675 tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] 'nvme version' failed. Not Retrying. {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 10:17:45 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fa51855c-8493-4f5f-9f40-7d0cf0320675 tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] nvme not present on system {{(pid=85141) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 10:17:45 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:17:45 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 10:17:45 user nova-compute[85141]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 10:17:45 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d6a932e-939c-40e0-ae1b-521559e2cd85]: (4, '') {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:17:45 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.lightos [None req-fa51855c-8493-4f5f-9f40-7d0cf0320675 tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=85141) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 10:17:45 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.lightos [None req-fa51855c-8493-4f5f-9f40-7d0cf0320675 tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=85141) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 10:17:45 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.lightos [None req-fa51855c-8493-4f5f-9f40-7d0cf0320675 tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] LIGHTOS: no hostnqn found. {{(pid=85141) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 10:17:45 user nova-compute[85141]: DEBUG os_brick.utils [None req-fa51855c-8493-4f5f-9f40-7d0cf0320675 tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] <== get_connector_properties: return (231ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c7834de5c295', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 10:17:45 user nova-compute[85141]: DEBUG nova.virt.block_device [None req-fa51855c-8493-4f5f-9f40-7d0cf0320675 tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] [instance: e88874fe-b0a6-4292-8832-023f95e4f53c] Updating existing volume attachment record: 57279998-3c54-4ba8-833a-7159ba1ddbee {{(pid=85141) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 10:17:46 user nova-compute[85141]: DEBUG nova.network.neutron [req-791a082f-51a4-47fc-83d4-a385840e014e req-4b1bd148-fbd2-4ac2-b85e-037937b2003a service nova] [instance: 0b388b98-4e65-4258-bbe2-77e699321fb7] Updated VIF entry in instance network info cache for port 3ed9d2a6-c028-4b75-9023-95b1cfa982b6. {{(pid=85141) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 10:17:46 user nova-compute[85141]: DEBUG nova.network.neutron [req-791a082f-51a4-47fc-83d4-a385840e014e req-4b1bd148-fbd2-4ac2-b85e-037937b2003a service nova] [instance: 0b388b98-4e65-4258-bbe2-77e699321fb7] Updating instance_info_cache with network_info: [{"id": "3ed9d2a6-c028-4b75-9023-95b1cfa982b6", "address": "fa:16:3e:85:dd:4c", "network": {"id": "4e36c3d2-7d16-4305-a0a7-2358e1208df3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1030128743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2acc04e107d4a229c3580cf078a20f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ed9d2a6-c0", "ovs_interfaceid": "3ed9d2a6-c028-4b75-9023-95b1cfa982b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:17:46 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-791a082f-51a4-47fc-83d4-a385840e014e req-4b1bd148-fbd2-4ac2-b85e-037937b2003a service nova] Releasing lock "refresh_cache-0b388b98-4e65-4258-bbe2-77e699321fb7" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:17:46 user nova-compute[85141]: DEBUG nova.network.neutron [None req-fa51855c-8493-4f5f-9f40-7d0cf0320675 tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] [instance: e88874fe-b0a6-4292-8832-023f95e4f53c] Successfully created port: 7bbea642-d504-433b-ae99-8e7159942751 {{(pid=85141) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 10:17:47 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:17:47 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:17:47 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:17:47 user nova-compute[85141]: DEBUG nova.network.neutron [None req-fa51855c-8493-4f5f-9f40-7d0cf0320675 tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] [instance: e88874fe-b0a6-4292-8832-023f95e4f53c] Successfully updated port: 7bbea642-d504-433b-ae99-8e7159942751 {{(pid=85141) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 10:17:47 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-fa51855c-8493-4f5f-9f40-7d0cf0320675 tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] Acquiring lock "refresh_cache-e88874fe-b0a6-4292-8832-023f95e4f53c" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:17:47 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-fa51855c-8493-4f5f-9f40-7d0cf0320675 tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] Acquired lock "refresh_cache-e88874fe-b0a6-4292-8832-023f95e4f53c" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:17:47 user nova-compute[85141]: DEBUG nova.network.neutron [None req-fa51855c-8493-4f5f-9f40-7d0cf0320675 tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] [instance: e88874fe-b0a6-4292-8832-023f95e4f53c] Building network info cache for instance {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 10:17:47 user nova-compute[85141]: DEBUG nova.compute.manager [req-8a7bffc5-c2ff-4b68-90d1-f8c97d8b0171 req-7bfefb7e-b95e-4170-9ed1-1029462341f6 service nova] [instance: e88874fe-b0a6-4292-8832-023f95e4f53c] Received event network-changed-7bbea642-d504-433b-ae99-8e7159942751 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:17:47 user nova-compute[85141]: DEBUG nova.compute.manager [req-8a7bffc5-c2ff-4b68-90d1-f8c97d8b0171 req-7bfefb7e-b95e-4170-9ed1-1029462341f6 service nova] [instance: e88874fe-b0a6-4292-8832-023f95e4f53c] Refreshing instance network info cache due to event network-changed-7bbea642-d504-433b-ae99-8e7159942751. {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 10:17:47 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-8a7bffc5-c2ff-4b68-90d1-f8c97d8b0171 req-7bfefb7e-b95e-4170-9ed1-1029462341f6 service nova] Acquiring lock "refresh_cache-e88874fe-b0a6-4292-8832-023f95e4f53c" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:17:47 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:17:47 user nova-compute[85141]: DEBUG nova.network.neutron [None req-fa51855c-8493-4f5f-9f40-7d0cf0320675 tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] [instance: e88874fe-b0a6-4292-8832-023f95e4f53c] Instance cache missing network info. {{(pid=85141) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 10:17:47 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:17:47 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:17:48 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:17:48 user nova-compute[85141]: DEBUG nova.network.neutron [None req-fa51855c-8493-4f5f-9f40-7d0cf0320675 tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] [instance: e88874fe-b0a6-4292-8832-023f95e4f53c] Updating instance_info_cache with network_info: [{"id": "7bbea642-d504-433b-ae99-8e7159942751", "address": "fa:16:3e:6a:e8:c6", "network": {"id": "3fc8f327-8ef7-4b60-abf0-31d75e40478e", "bridge": "br-int", "label": "tempest-TestShelveInstance-452311162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fc33dd813c64594a3626d2e7dff09ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bbea642-d5", "ovs_interfaceid": "7bbea642-d504-433b-ae99-8e7159942751", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:17:48 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-fa51855c-8493-4f5f-9f40-7d0cf0320675 tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] Releasing lock "refresh_cache-e88874fe-b0a6-4292-8832-023f95e4f53c" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:17:48 user nova-compute[85141]: DEBUG nova.compute.manager [None req-fa51855c-8493-4f5f-9f40-7d0cf0320675 tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] [instance: e88874fe-b0a6-4292-8832-023f95e4f53c] Instance network_info: |[{"id": "7bbea642-d504-433b-ae99-8e7159942751", "address": "fa:16:3e:6a:e8:c6", "network": {"id": "3fc8f327-8ef7-4b60-abf0-31d75e40478e", "bridge": "br-int", "label": "tempest-TestShelveInstance-452311162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fc33dd813c64594a3626d2e7dff09ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bbea642-d5", "ovs_interfaceid": "7bbea642-d504-433b-ae99-8e7159942751", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=85141) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 10:17:48 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-8a7bffc5-c2ff-4b68-90d1-f8c97d8b0171 req-7bfefb7e-b95e-4170-9ed1-1029462341f6 service nova] Acquired lock "refresh_cache-e88874fe-b0a6-4292-8832-023f95e4f53c" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:17:48 user nova-compute[85141]: DEBUG nova.network.neutron [req-8a7bffc5-c2ff-4b68-90d1-f8c97d8b0171 req-7bfefb7e-b95e-4170-9ed1-1029462341f6 service nova] [instance: e88874fe-b0a6-4292-8832-023f95e4f53c] Refreshing network info cache for port 7bbea642-d504-433b-ae99-8e7159942751 {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 10:17:48 user nova-compute[85141]: DEBUG nova.network.neutron [req-8a7bffc5-c2ff-4b68-90d1-f8c97d8b0171 req-7bfefb7e-b95e-4170-9ed1-1029462341f6 service nova] [instance: e88874fe-b0a6-4292-8832-023f95e4f53c] Updated VIF entry in instance network info cache for port 7bbea642-d504-433b-ae99-8e7159942751. {{(pid=85141) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 10:17:48 user nova-compute[85141]: DEBUG nova.network.neutron [req-8a7bffc5-c2ff-4b68-90d1-f8c97d8b0171 req-7bfefb7e-b95e-4170-9ed1-1029462341f6 service nova] [instance: e88874fe-b0a6-4292-8832-023f95e4f53c] Updating instance_info_cache with network_info: [{"id": "7bbea642-d504-433b-ae99-8e7159942751", "address": "fa:16:3e:6a:e8:c6", "network": {"id": "3fc8f327-8ef7-4b60-abf0-31d75e40478e", "bridge": "br-int", "label": "tempest-TestShelveInstance-452311162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fc33dd813c64594a3626d2e7dff09ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bbea642-d5", "ovs_interfaceid": "7bbea642-d504-433b-ae99-8e7159942751", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:17:48 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-8a7bffc5-c2ff-4b68-90d1-f8c97d8b0171 req-7bfefb7e-b95e-4170-9ed1-1029462341f6 service nova] Releasing lock "refresh_cache-e88874fe-b0a6-4292-8832-023f95e4f53c" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:17:49 user nova-compute[85141]: DEBUG nova.compute.manager [None req-cfd293ae-d48a-4e9f-a830-836e1f195589 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] [instance: 0b388b98-4e65-4258-bbe2-77e699321fb7] Instance event wait completed in 0 seconds for  {{(pid=85141) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 10:17:49 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-cfd293ae-d48a-4e9f-a830-836e1f195589 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] [instance: 0b388b98-4e65-4258-bbe2-77e699321fb7] Guest created on hypervisor {{(pid=85141) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 10:17:49 user nova-compute[85141]: DEBUG nova.compute.manager [req-e1d0b39b-7f25-40f7-a7fe-17598f905f4a req-40026d7c-be40-4ddb-9e14-d479f1116e6c service nova] [instance: 0b388b98-4e65-4258-bbe2-77e699321fb7] Received event network-vif-plugged-3ed9d2a6-c028-4b75-9023-95b1cfa982b6 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:17:49 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-e1d0b39b-7f25-40f7-a7fe-17598f905f4a req-40026d7c-be40-4ddb-9e14-d479f1116e6c service nova] Acquiring lock "0b388b98-4e65-4258-bbe2-77e699321fb7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:17:49 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-e1d0b39b-7f25-40f7-a7fe-17598f905f4a req-40026d7c-be40-4ddb-9e14-d479f1116e6c service nova] Lock "0b388b98-4e65-4258-bbe2-77e699321fb7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:17:49 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-e1d0b39b-7f25-40f7-a7fe-17598f905f4a req-40026d7c-be40-4ddb-9e14-d479f1116e6c service nova] Lock "0b388b98-4e65-4258-bbe2-77e699321fb7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:17:49 user nova-compute[85141]: DEBUG nova.compute.manager [req-e1d0b39b-7f25-40f7-a7fe-17598f905f4a req-40026d7c-be40-4ddb-9e14-d479f1116e6c service nova] [instance: 0b388b98-4e65-4258-bbe2-77e699321fb7] No waiting events found dispatching network-vif-plugged-3ed9d2a6-c028-4b75-9023-95b1cfa982b6 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:17:49 user nova-compute[85141]: WARNING nova.compute.manager [req-e1d0b39b-7f25-40f7-a7fe-17598f905f4a req-40026d7c-be40-4ddb-9e14-d479f1116e6c service nova] [instance: 0b388b98-4e65-4258-bbe2-77e699321fb7] Received unexpected event network-vif-plugged-3ed9d2a6-c028-4b75-9023-95b1cfa982b6 for instance with vm_state building and task_state spawning.
Nov 16 10:17:49 user nova-compute[85141]: DEBUG nova.compute.manager [req-e1d0b39b-7f25-40f7-a7fe-17598f905f4a req-40026d7c-be40-4ddb-9e14-d479f1116e6c service nova] [instance: 0b388b98-4e65-4258-bbe2-77e699321fb7] Received event network-vif-plugged-3ed9d2a6-c028-4b75-9023-95b1cfa982b6 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:17:49 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-e1d0b39b-7f25-40f7-a7fe-17598f905f4a req-40026d7c-be40-4ddb-9e14-d479f1116e6c service nova] Acquiring lock "0b388b98-4e65-4258-bbe2-77e699321fb7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:17:49 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-e1d0b39b-7f25-40f7-a7fe-17598f905f4a req-40026d7c-be40-4ddb-9e14-d479f1116e6c service nova] Lock "0b388b98-4e65-4258-bbe2-77e699321fb7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:17:49 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-e1d0b39b-7f25-40f7-a7fe-17598f905f4a req-40026d7c-be40-4ddb-9e14-d479f1116e6c service nova] Lock "0b388b98-4e65-4258-bbe2-77e699321fb7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:17:49 user nova-compute[85141]: DEBUG nova.compute.manager [req-e1d0b39b-7f25-40f7-a7fe-17598f905f4a req-40026d7c-be40-4ddb-9e14-d479f1116e6c service nova] [instance: 0b388b98-4e65-4258-bbe2-77e699321fb7] No waiting events found dispatching network-vif-plugged-3ed9d2a6-c028-4b75-9023-95b1cfa982b6 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:17:49 user nova-compute[85141]: WARNING nova.compute.manager [req-e1d0b39b-7f25-40f7-a7fe-17598f905f4a req-40026d7c-be40-4ddb-9e14-d479f1116e6c service nova] [instance: 0b388b98-4e65-4258-bbe2-77e699321fb7] Received unexpected event network-vif-plugged-3ed9d2a6-c028-4b75-9023-95b1cfa982b6 for instance with vm_state building and task_state spawning.
Nov 16 10:17:49 user nova-compute[85141]: INFO nova.virt.libvirt.driver [-] [instance: 0b388b98-4e65-4258-bbe2-77e699321fb7] Instance spawned successfully.
Nov 16 10:17:49 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-cfd293ae-d48a-4e9f-a830-836e1f195589 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] [instance: 0b388b98-4e65-4258-bbe2-77e699321fb7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 10:17:49 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-cfd293ae-d48a-4e9f-a830-836e1f195589 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] [instance: 0b388b98-4e65-4258-bbe2-77e699321fb7] Found default for hw_cdrom_bus of ide {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:17:49 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-cfd293ae-d48a-4e9f-a830-836e1f195589 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] [instance: 0b388b98-4e65-4258-bbe2-77e699321fb7] Found default for hw_disk_bus of virtio {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:17:49 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-cfd293ae-d48a-4e9f-a830-836e1f195589 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] [instance: 0b388b98-4e65-4258-bbe2-77e699321fb7] Found default for hw_input_bus of None {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:17:49 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-cfd293ae-d48a-4e9f-a830-836e1f195589 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] [instance: 0b388b98-4e65-4258-bbe2-77e699321fb7] Found default for hw_pointer_model of None {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:17:49 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-cfd293ae-d48a-4e9f-a830-836e1f195589 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] [instance: 0b388b98-4e65-4258-bbe2-77e699321fb7] Found default for hw_video_model of virtio {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:17:49 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-cfd293ae-d48a-4e9f-a830-836e1f195589 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] [instance: 0b388b98-4e65-4258-bbe2-77e699321fb7] Found default for hw_vif_model of virtio {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:17:49 user nova-compute[85141]: INFO nova.compute.manager [None req-cfd293ae-d48a-4e9f-a830-836e1f195589 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] [instance: 0b388b98-4e65-4258-bbe2-77e699321fb7] Took 5.91 seconds to spawn the instance on the hypervisor.
Nov 16 10:17:49 user nova-compute[85141]: DEBUG nova.compute.manager [None req-cfd293ae-d48a-4e9f-a830-836e1f195589 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] [instance: 0b388b98-4e65-4258-bbe2-77e699321fb7] Checking state {{(pid=85141) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 10:17:49 user nova-compute[85141]: INFO nova.compute.manager [None req-cfd293ae-d48a-4e9f-a830-836e1f195589 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] [instance: 0b388b98-4e65-4258-bbe2-77e699321fb7] Took 6.71 seconds to build instance.
Nov 16 10:17:49 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-cfd293ae-d48a-4e9f-a830-836e1f195589 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Lock "0b388b98-4e65-4258-bbe2-77e699321fb7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.858s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:17:50 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-2568174c-2593-4746-896f-77f0cc2d6c34 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Acquiring lock "bff3a84b-6ab5-4256-8a04-2d21a4ba20b3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:17:50 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-2568174c-2593-4746-896f-77f0cc2d6c34 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Lock "bff3a84b-6ab5-4256-8a04-2d21a4ba20b3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:17:50 user nova-compute[85141]: DEBUG nova.compute.manager [None req-2568174c-2593-4746-896f-77f0cc2d6c34 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] [instance: bff3a84b-6ab5-4256-8a04-2d21a4ba20b3] Starting instance... {{(pid=85141) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 10:17:50 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:17:50 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-2568174c-2593-4746-896f-77f0cc2d6c34 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:17:50 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-2568174c-2593-4746-896f-77f0cc2d6c34 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:17:50 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-2568174c-2593-4746-896f-77f0cc2d6c34 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=85141) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 10:17:50 user nova-compute[85141]: INFO nova.compute.claims [None req-2568174c-2593-4746-896f-77f0cc2d6c34 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] [instance: bff3a84b-6ab5-4256-8a04-2d21a4ba20b3] Claim successful on node user
Nov 16 10:17:51 user nova-compute[85141]: DEBUG nova.compute.provider_tree [None req-2568174c-2593-4746-896f-77f0cc2d6c34 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Inventory has not changed in ProviderTree for provider: bf8e0fa1-16b6-408f-9203-c4cd63916272 {{(pid=85141) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 10:17:51 user nova-compute[85141]: DEBUG nova.scheduler.client.report [None req-2568174c-2593-4746-896f-77f0cc2d6c34 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Inventory has not changed for provider bf8e0fa1-16b6-408f-9203-c4cd63916272 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=85141) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 10:17:51 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-2568174c-2593-4746-896f-77f0cc2d6c34 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.539s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:17:51 user nova-compute[85141]: DEBUG nova.compute.manager [None req-2568174c-2593-4746-896f-77f0cc2d6c34 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] [instance: bff3a84b-6ab5-4256-8a04-2d21a4ba20b3] Start building networks asynchronously for instance. {{(pid=85141) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 10:17:51 user nova-compute[85141]: DEBUG nova.compute.manager [None req-2568174c-2593-4746-896f-77f0cc2d6c34 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] [instance: bff3a84b-6ab5-4256-8a04-2d21a4ba20b3] Allocating IP information in the background. {{(pid=85141) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 10:17:51 user nova-compute[85141]: DEBUG nova.network.neutron [None req-2568174c-2593-4746-896f-77f0cc2d6c34 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] [instance: bff3a84b-6ab5-4256-8a04-2d21a4ba20b3] allocate_for_instance() {{(pid=85141) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 10:17:51 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-2568174c-2593-4746-896f-77f0cc2d6c34 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] [instance: bff3a84b-6ab5-4256-8a04-2d21a4ba20b3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 10:17:51 user nova-compute[85141]: DEBUG nova.compute.manager [None req-2568174c-2593-4746-896f-77f0cc2d6c34 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] [instance: bff3a84b-6ab5-4256-8a04-2d21a4ba20b3] Start building block device mappings for instance. {{(pid=85141) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 10:17:51 user nova-compute[85141]: DEBUG nova.policy [None req-2568174c-2593-4746-896f-77f0cc2d6c34 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'baec48c887ae4a418e0ea7b32b05bc59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08ef12fb41a14ecd8abb84d4d69b7c27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85141) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 10:17:51 user nova-compute[85141]: DEBUG nova.compute.manager [None req-2568174c-2593-4746-896f-77f0cc2d6c34 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] [instance: bff3a84b-6ab5-4256-8a04-2d21a4ba20b3] Start spawning the instance on the hypervisor. {{(pid=85141) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 10:17:51 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-2568174c-2593-4746-896f-77f0cc2d6c34 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] [instance: bff3a84b-6ab5-4256-8a04-2d21a4ba20b3] Creating instance directory {{(pid=85141) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 10:17:51 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-2568174c-2593-4746-896f-77f0cc2d6c34 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] [instance: bff3a84b-6ab5-4256-8a04-2d21a4ba20b3] Creating image(s)
Nov 16 10:17:51 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-2568174c-2593-4746-896f-77f0cc2d6c34 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Acquiring lock "/opt/stack/data/nova/instances/bff3a84b-6ab5-4256-8a04-2d21a4ba20b3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:17:51 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-2568174c-2593-4746-896f-77f0cc2d6c34 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Lock "/opt/stack/data/nova/instances/bff3a84b-6ab5-4256-8a04-2d21a4ba20b3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:17:51 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-2568174c-2593-4746-896f-77f0cc2d6c34 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Lock "/opt/stack/data/nova/instances/bff3a84b-6ab5-4256-8a04-2d21a4ba20b3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:17:51 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-2568174c-2593-4746-896f-77f0cc2d6c34 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:17:51 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-2568174c-2593-4746-896f-77f0cc2d6c34 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json" returned: 0 in 0.197s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:17:51 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-2568174c-2593-4746-896f-77f0cc2d6c34 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Acquiring lock "60a78556fb399ed4a41bc3ca4bccf77c96d8e811" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:17:51 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-2568174c-2593-4746-896f-77f0cc2d6c34 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Lock "60a78556fb399ed4a41bc3ca4bccf77c96d8e811" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:17:51 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-2568174c-2593-4746-896f-77f0cc2d6c34 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:17:52 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-2568174c-2593-4746-896f-77f0cc2d6c34 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json" returned: 0 in 0.208s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:17:52 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-2568174c-2593-4746-896f-77f0cc2d6c34 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811,backing_fmt=raw /opt/stack/data/nova/instances/bff3a84b-6ab5-4256-8a04-2d21a4ba20b3/disk 1073741824 {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:17:52 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-2568174c-2593-4746-896f-77f0cc2d6c34 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811,backing_fmt=raw /opt/stack/data/nova/instances/bff3a84b-6ab5-4256-8a04-2d21a4ba20b3/disk 1073741824" returned: 0 in 0.065s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:17:52 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-2568174c-2593-4746-896f-77f0cc2d6c34 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Lock "60a78556fb399ed4a41bc3ca4bccf77c96d8e811" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.281s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:17:52 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-2568174c-2593-4746-896f-77f0cc2d6c34 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:17:52 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-2568174c-2593-4746-896f-77f0cc2d6c34 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json" returned: 0 in 0.250s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:17:52 user nova-compute[85141]: DEBUG nova.virt.disk.api [None req-2568174c-2593-4746-896f-77f0cc2d6c34 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bff3a84b-6ab5-4256-8a04-2d21a4ba20b3/disk. size=1073741824 {{(pid=85141) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 10:17:52 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-2568174c-2593-4746-896f-77f0cc2d6c34 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bff3a84b-6ab5-4256-8a04-2d21a4ba20b3/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:17:52 user nova-compute[85141]: DEBUG nova.compute.manager [None req-fa51855c-8493-4f5f-9f40-7d0cf0320675 tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] [instance: e88874fe-b0a6-4292-8832-023f95e4f53c] Start spawning the instance on the hypervisor. {{(pid=85141) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 10:17:52 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-fa51855c-8493-4f5f-9f40-7d0cf0320675 tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] [instance: e88874fe-b0a6-4292-8832-023f95e4f53c] Creating instance directory {{(pid=85141) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 10:17:52 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-fa51855c-8493-4f5f-9f40-7d0cf0320675 tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] [instance: e88874fe-b0a6-4292-8832-023f95e4f53c] Creating image(s)
Nov 16 10:17:52 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-fa51855c-8493-4f5f-9f40-7d0cf0320675 tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] [instance: e88874fe-b0a6-4292-8832-023f95e4f53c] Did not create local disks {{(pid=85141) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 16 10:17:52 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-fa51855c-8493-4f5f-9f40-7d0cf0320675 tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] [instance: e88874fe-b0a6-4292-8832-023f95e4f53c] Ensure instance console log exists: /opt/stack/data/nova/instances/e88874fe-b0a6-4292-8832-023f95e4f53c/console.log {{(pid=85141) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 10:17:52 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-fa51855c-8493-4f5f-9f40-7d0cf0320675 tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:17:52 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-fa51855c-8493-4f5f-9f40-7d0cf0320675 tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:17:52 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-fa51855c-8493-4f5f-9f40-7d0cf0320675 tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:17:52 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-fa51855c-8493-4f5f-9f40-7d0cf0320675 tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] [instance: e88874fe-b0a6-4292-8832-023f95e4f53c] Start _get_guest_xml network_info=[{"id": "7bbea642-d504-433b-ae99-8e7159942751", "address": "fa:16:3e:6a:e8:c6", "network": {"id": "3fc8f327-8ef7-4b60-abf0-31d75e40478e", "bridge": "br-int", "label": "tempest-TestShelveInstance-452311162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fc33dd813c64594a3626d2e7dff09ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bbea642-d5", "ovs_interfaceid": "7bbea642-d504-433b-ae99-8e7159942751", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:674f9ae8-6ab5-4ff2-b715-fe8807c34793', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qDxyoBhW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e88874fe-b0a6-4292-8832-023f95e4f53c', 'attached_at': '', 'detached_at': '', 'volume_id': '674f9ae8-6ab5-4ff2-b715-fe8807c34793', 'serial': '674f9ae8-6ab5-4ff2-b715-fe8807c34793'}, 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'attachment_id': '57279998-3c54-4ba8-833a-7159ba1ddbee', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=85141) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 10:17:52 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-fa51855c-8493-4f5f-9f40-7d0cf0320675 tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:17:52 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-fa51855c-8493-4f5f-9f40-7d0cf0320675 tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:17:52 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:17:52 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-fa51855c-8493-4f5f-9f40-7d0cf0320675 tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=85141) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 10:17:52 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-fa51855c-8493-4f5f-9f40-7d0cf0320675 tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] CPU controller missing on host. {{(pid=85141) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 10:17:52 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-fa51855c-8493-4f5f-9f40-7d0cf0320675 tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=85141) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 10:17:52 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-fa51855c-8493-4f5f-9f40-7d0cf0320675 tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] CPU controller found on host. {{(pid=85141) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 10:17:52 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-fa51855c-8493-4f5f-9f40-7d0cf0320675 tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=85141) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 10:17:52 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-fa51855c-8493-4f5f-9f40-7d0cf0320675 tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T10:06:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 10:17:52 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-fa51855c-8493-4f5f-9f40-7d0cf0320675 tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] Flavor limits 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 10:17:52 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-fa51855c-8493-4f5f-9f40-7d0cf0320675 tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] Image limits 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 10:17:52 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-fa51855c-8493-4f5f-9f40-7d0cf0320675 tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] Flavor pref 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 10:17:52 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-fa51855c-8493-4f5f-9f40-7d0cf0320675 tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] Image pref 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 10:17:52 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-fa51855c-8493-4f5f-9f40-7d0cf0320675 tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 10:17:52 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-fa51855c-8493-4f5f-9f40-7d0cf0320675 tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 10:17:52 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-fa51855c-8493-4f5f-9f40-7d0cf0320675 tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=85141) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 10:17:52 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-fa51855c-8493-4f5f-9f40-7d0cf0320675 tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] Got 1 possible topologies {{(pid=85141) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 10:17:52 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-fa51855c-8493-4f5f-9f40-7d0cf0320675 tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 10:17:52 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-fa51855c-8493-4f5f-9f40-7d0cf0320675 tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 10:17:52 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fa51855c-8493-4f5f-9f40-7d0cf0320675 tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] [instance: e88874fe-b0a6-4292-8832-023f95e4f53c] Calling os-brick to attach iSCSI Volume {{(pid=85141) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 10:17:52 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa51855c-8493-4f5f-9f40-7d0cf0320675 tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51806b6080>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:674f9ae8-6ab5-4ff2-b715-fe8807c34793', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qDxyoBhW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 10:17:52 user nova-compute[85141]: WARNING os_brick.initiator.connectors.base [None req-fa51855c-8493-4f5f-9f40-7d0cf0320675 tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 10:17:52 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-fa51855c-8493-4f5f-9f40-7d0cf0320675 tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 10:17:52 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-fa51855c-8493-4f5f-9f40-7d0cf0320675 tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 10:17:52 user nova-compute[85141]: WARNING os_brick.initiator.connectors.base [None req-fa51855c-8493-4f5f-9f40-7d0cf0320675 tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 10:17:52 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-fa51855c-8493-4f5f-9f40-7d0cf0320675 tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:674f9ae8-6ab5-4ff2-b715-fe8807c34793" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 10:17:52 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-fa51855c-8493-4f5f-9f40-7d0cf0320675 tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:674f9ae8-6ab5-4ff2-b715-fe8807c34793" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 10:17:52 user nova-compute[85141]: INFO os_brick.initiator.connectors.iscsi [None req-fa51855c-8493-4f5f-9f40-7d0cf0320675 tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 10:17:52 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:674f9ae8-6ab5-4ff2-b715-fe8807c34793 -p 172.16.0.220:3260 {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:17:52 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-2568174c-2593-4746-896f-77f0cc2d6c34 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bff3a84b-6ab5-4256-8a04-2d21a4ba20b3/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:17:52 user nova-compute[85141]: DEBUG nova.virt.disk.api [None req-2568174c-2593-4746-896f-77f0cc2d6c34 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Cannot resize image /opt/stack/data/nova/instances/bff3a84b-6ab5-4256-8a04-2d21a4ba20b3/disk to a smaller size. {{(pid=85141) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 10:17:52 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-2568174c-2593-4746-896f-77f0cc2d6c34 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] [instance: bff3a84b-6ab5-4256-8a04-2d21a4ba20b3] Created local disks {{(pid=85141) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 10:17:52 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-2568174c-2593-4746-896f-77f0cc2d6c34 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] [instance: bff3a84b-6ab5-4256-8a04-2d21a4ba20b3] Ensure instance console log exists: /opt/stack/data/nova/instances/bff3a84b-6ab5-4256-8a04-2d21a4ba20b3/console.log {{(pid=85141) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 10:17:52 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-2568174c-2593-4746-896f-77f0cc2d6c34 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:17:52 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-2568174c-2593-4746-896f-77f0cc2d6c34 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:17:52 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-2568174c-2593-4746-896f-77f0cc2d6c34 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:17:52 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:674f9ae8-6ab5-4ff2-b715-fe8807c34793 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:17:52 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[b02698b4-c00d-4442-be2d-8283c91e20b7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:17:52 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa51855c-8493-4f5f-9f40-7d0cf0320675 tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 10:17:52 user nova-compute[85141]:  {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:17:52 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:674f9ae8-6ab5-4ff2-b715-fe8807c34793 -p 172.16.0.220:3260 --interface default --op new {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:17:52 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:674f9ae8-6ab5-4ff2-b715-fe8807c34793 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:17:52 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[bff00a1c-7fa5-439c-bf74-754be1c90b22]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:674f9ae8-6ab5-4ff2-b715-fe8807c34793] added\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:17:52 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa51855c-8493-4f5f-9f40-7d0cf0320675 tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:674f9ae8-6ab5-4ff2-b715-fe8807c34793] added
Nov 16 10:17:52 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:17:52 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:674f9ae8-6ab5-4ff2-b715-fe8807c34793 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:17:52 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:674f9ae8-6ab5-4ff2-b715-fe8807c34793 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:17:52 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[f31017df-c0be-46bd-882b-3f6ae692086a]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:17:52 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa51855c-8493-4f5f-9f40-7d0cf0320675 tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:17:52 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:674f9ae8-6ab5-4ff2-b715-fe8807c34793 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:17:52 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:674f9ae8-6ab5-4ff2-b715-fe8807c34793 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:17:52 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[48eb72ce-0ca1-4918-829a-8534b76a0b29]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:17:52 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa51855c-8493-4f5f-9f40-7d0cf0320675 tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:17:52 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:674f9ae8-6ab5-4ff2-b715-fe8807c34793 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qDxyoBhW {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:17:52 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:674f9ae8-6ab5-4ff2-b715-fe8807c34793 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qDxyoBhW" returned: 0 in 0.037s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:17:52 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8ef93a9-445f-4744-b3e2-573c1bc6c8cc]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:17:52 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa51855c-8493-4f5f-9f40-7d0cf0320675 tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qDxyoBhW'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:17:52 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:674f9ae8-6ab5-4ff2-b715-fe8807c34793 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:17:52 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:674f9ae8-6ab5-4ff2-b715-fe8807c34793 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:17:52 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[31e6e221-baab-4e26-bdf3-ce121a882f40]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:17:52 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa51855c-8493-4f5f-9f40-7d0cf0320675 tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:17:52 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:17:52 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.040s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:17:52 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[55a8de4c-690a-4ff5-b03f-a49a6f6b2855]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fa41a79-b1fc-4047-9ae9-f674f348378f (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef975afa-7705-454b-88d3-798b0a74dbb9 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:030d6106-e7ec-4eb8-9642-b64a4685f6bb (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abda547a-8d00-4a02-a6e4-d0670e47815a (non-flash)\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:17:52 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa51855c-8493-4f5f-9f40-7d0cf0320675 tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)
Nov 16 10:17:52 user nova-compute[85141]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fa41a79-b1fc-4047-9ae9-f674f348378f (non-flash)
Nov 16 10:17:52 user nova-compute[85141]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef975afa-7705-454b-88d3-798b0a74dbb9 (non-flash)
Nov 16 10:17:52 user nova-compute[85141]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:030d6106-e7ec-4eb8-9642-b64a4685f6bb (non-flash)
Nov 16 10:17:52 user nova-compute[85141]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abda547a-8d00-4a02-a6e4-d0670e47815a (non-flash)
Nov 16 10:17:52 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:17:52 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa51855c-8493-4f5f-9f40-7d0cf0320675 tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)
Nov 16 10:17:52 user nova-compute[85141]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fa41a79-b1fc-4047-9ae9-f674f348378f (non-flash)
Nov 16 10:17:52 user nova-compute[85141]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef975afa-7705-454b-88d3-798b0a74dbb9 (non-flash)
Nov 16 10:17:52 user nova-compute[85141]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:030d6106-e7ec-4eb8-9642-b64a4685f6bb (non-flash)
Nov 16 10:17:52 user nova-compute[85141]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abda547a-8d00-4a02-a6e4-d0670e47815a (non-flash)
Nov 16 10:17:52 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 10:17:52 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:674f9ae8-6ab5-4ff2-b715-fe8807c34793 -p 172.16.0.220:3260 --login {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:17:52 user nova-compute[85141]: DEBUG nova.network.neutron [None req-2568174c-2593-4746-896f-77f0cc2d6c34 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] [instance: bff3a84b-6ab5-4256-8a04-2d21a4ba20b3] Successfully created port: 23ec0327-ca81-4524-8850-2c081e596d44 {{(pid=85141) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 10:17:52 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:674f9ae8-6ab5-4ff2-b715-fe8807c34793 -p 172.16.0.220:3260 --login" returned: 0 in 0.089s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:17:52 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[260d24e2-2144-432d-a140-1d2a6eb1c8b9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:674f9ae8-6ab5-4ff2-b715-fe8807c34793, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:674f9ae8-6ab5-4ff2-b715-fe8807c34793, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:17:52 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa51855c-8493-4f5f-9f40-7d0cf0320675 tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:674f9ae8-6ab5-4ff2-b715-fe8807c34793, portal: 172.16.0.220,3260]
Nov 16 10:17:52 user nova-compute[85141]: Login to [iface: default, target: iqn.2010-10.org.openstack:674f9ae8-6ab5-4ff2-b715-fe8807c34793, portal: 172.16.0.220,3260] successful.
Nov 16 10:17:52 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:17:52 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:674f9ae8-6ab5-4ff2-b715-fe8807c34793 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:17:52 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:674f9ae8-6ab5-4ff2-b715-fe8807c34793 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:17:52 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[82f9d629-a253-449f-92db-e9abbcb9d758]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:17:52 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa51855c-8493-4f5f-9f40-7d0cf0320675 tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:17:52 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:17:53 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:17:53 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[ada3f5b0-9ec2-4cca-9fd6-062dbd939457]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fa41a79-b1fc-4047-9ae9-f674f348378f (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef975afa-7705-454b-88d3-798b0a74dbb9 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:030d6106-e7ec-4eb8-9642-b64a4685f6bb (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abda547a-8d00-4a02-a6e4-d0670e47815a (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:674f9ae8-6ab5-4ff2-b715-fe8807c34793 (non-flash)\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:17:53 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa51855c-8493-4f5f-9f40-7d0cf0320675 tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)
Nov 16 10:17:53 user nova-compute[85141]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fa41a79-b1fc-4047-9ae9-f674f348378f (non-flash)
Nov 16 10:17:53 user nova-compute[85141]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef975afa-7705-454b-88d3-798b0a74dbb9 (non-flash)
Nov 16 10:17:53 user nova-compute[85141]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:030d6106-e7ec-4eb8-9642-b64a4685f6bb (non-flash)
Nov 16 10:17:53 user nova-compute[85141]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abda547a-8d00-4a02-a6e4-d0670e47815a (non-flash)
Nov 16 10:17:53 user nova-compute[85141]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:674f9ae8-6ab5-4ff2-b715-fe8807c34793 (non-flash)
Nov 16 10:17:53 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:17:53 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa51855c-8493-4f5f-9f40-7d0cf0320675 tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)
Nov 16 10:17:53 user nova-compute[85141]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fa41a79-b1fc-4047-9ae9-f674f348378f (non-flash)
Nov 16 10:17:53 user nova-compute[85141]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef975afa-7705-454b-88d3-798b0a74dbb9 (non-flash)
Nov 16 10:17:53 user nova-compute[85141]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:030d6106-e7ec-4eb8-9642-b64a4685f6bb (non-flash)
Nov 16 10:17:53 user nova-compute[85141]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abda547a-8d00-4a02-a6e4-d0670e47815a (non-flash)
Nov 16 10:17:53 user nova-compute[85141]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:674f9ae8-6ab5-4ff2-b715-fe8807c34793 (non-flash)
Nov 16 10:17:53 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 10:17:53 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-fa51855c-8493-4f5f-9f40-7d0cf0320675 tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:674f9ae8-6ab5-4ff2-b715-fe8807c34793" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.401s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 10:17:53 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa51855c-8493-4f5f-9f40-7d0cf0320675 tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] Connected to 172.16.0.220:3260 {{(pid=85141) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 10:17:53 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-fa51855c-8493-4f5f-9f40-7d0cf0320675 tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] HCTL ('38', '-', '-', 0) found on session 25 with lun 0 {{(pid=85141) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 10:17:53 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-fa51855c-8493-4f5f-9f40-7d0cf0320675 tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=85141) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 10:17:53 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:17:53 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.034s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:17:53 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[897e1e07-6fbd-4d11-a85d-dd3df65db64c]: (4, ('- - 0', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:17:53 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-fa51855c-8493-4f5f-9f40-7d0cf0320675 tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] Searching for a device in session 25 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=85141) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 10:17:53 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa51855c-8493-4f5f-9f40-7d0cf0320675 tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:674f9ae8-6ab5-4ff2-b715-fe8807c34793', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qDxyoBhW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=85141) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 10:17:53 user nova-compute[85141]: DEBUG nova.compute.manager [req-1a5992a2-6649-48e0-b8da-f4ed05c18b73 req-4b42561d-e3a8-45c4-8f4e-7127fdeeb22b service nova] [instance: 0c359f00-f4b7-43c3-8454-364842893779] Received event network-changed-97833d7f-68d7-4a6a-a283-83744d5afd10 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:17:53 user nova-compute[85141]: DEBUG nova.compute.manager [req-1a5992a2-6649-48e0-b8da-f4ed05c18b73 req-4b42561d-e3a8-45c4-8f4e-7127fdeeb22b service nova] [instance: 0c359f00-f4b7-43c3-8454-364842893779] Refreshing instance network info cache due to event network-changed-97833d7f-68d7-4a6a-a283-83744d5afd10. {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 10:17:53 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-1a5992a2-6649-48e0-b8da-f4ed05c18b73 req-4b42561d-e3a8-45c4-8f4e-7127fdeeb22b service nova] Acquiring lock "refresh_cache-0c359f00-f4b7-43c3-8454-364842893779" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:17:53 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-1a5992a2-6649-48e0-b8da-f4ed05c18b73 req-4b42561d-e3a8-45c4-8f4e-7127fdeeb22b service nova] Acquired lock "refresh_cache-0c359f00-f4b7-43c3-8454-364842893779" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:17:53 user nova-compute[85141]: DEBUG nova.network.neutron [req-1a5992a2-6649-48e0-b8da-f4ed05c18b73 req-4b42561d-e3a8-45c4-8f4e-7127fdeeb22b service nova] [instance: 0c359f00-f4b7-43c3-8454-364842893779] Refreshing network info cache for port 97833d7f-68d7-4a6a-a283-83744d5afd10 {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 10:17:53 user nova-compute[85141]: DEBUG nova.network.neutron [None req-2568174c-2593-4746-896f-77f0cc2d6c34 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] [instance: bff3a84b-6ab5-4256-8a04-2d21a4ba20b3] Successfully updated port: 23ec0327-ca81-4524-8850-2c081e596d44 {{(pid=85141) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 10:17:53 user nova-compute[85141]: DEBUG nova.network.neutron [req-1a5992a2-6649-48e0-b8da-f4ed05c18b73 req-4b42561d-e3a8-45c4-8f4e-7127fdeeb22b service nova] [instance: 0c359f00-f4b7-43c3-8454-364842893779] Updated VIF entry in instance network info cache for port 97833d7f-68d7-4a6a-a283-83744d5afd10. {{(pid=85141) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 10:17:53 user nova-compute[85141]: DEBUG nova.network.neutron [req-1a5992a2-6649-48e0-b8da-f4ed05c18b73 req-4b42561d-e3a8-45c4-8f4e-7127fdeeb22b service nova] [instance: 0c359f00-f4b7-43c3-8454-364842893779] Updating instance_info_cache with network_info: [{"id": "97833d7f-68d7-4a6a-a283-83744d5afd10", "address": "fa:16:3e:b6:30:ac", "network": {"id": "cfb2308f-7c88-4329-a72d-4253cbbaca17", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1320471327-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92b768cf0f234b5da6d29450a58ce8e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97833d7f-68", "ovs_interfaceid": "97833d7f-68d7-4a6a-a283-83744d5afd10", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "da46c331-8f37-4473-9c17-7bcb1c691b65", "address": "fa:16:3e:c7:5e:17", "network": {"id": "90bcfce1-33ea-4029-aa72-93b729655e77", "bridge": "br-int", "label": "tempest-device-tagging-net1-660308139", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.209", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "92b768cf0f234b5da6d29450a58ce8e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda46c331-8f", "ovs_interfaceid": "da46c331-8f37-4473-9c17-7bcb1c691b65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5b1acf97-626c-4014-b463-5b4455f0f1e6", "address": "fa:16:3e:0b:c9:63", "network": {"id": "90bcfce1-33ea-4029-aa72-93b729655e77", "bridge": "br-int", "label": "tempest-device-tagging-net1-660308139", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.15", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "92b768cf0f234b5da6d29450a58ce8e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b1acf97-62", "ovs_interfaceid": "5b1acf97-626c-4014-b463-5b4455f0f1e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2243117f-44a8-4d51-8676-d67748b3c9aa", "address": "fa:16:3e:87:12:47", "network": {"id": "90bcfce1-33ea-4029-aa72-93b729655e77", "bridge": "br-int", "label": "tempest-device-tagging-net1-660308139", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.140", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "92b768cf0f234b5da6d29450a58ce8e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2243117f-44", "ovs_interfaceid": "2243117f-44a8-4d51-8676-d67748b3c9aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6d48ae8e-004c-459d-ad7c-081cc9228fee", "address": "fa:16:3e:49:c2:7d", "network": {"id": "90bcfce1-33ea-4029-aa72-93b729655e77", "bridge": "br-int", "label": "tempest-device-tagging-net1-660308139", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "92b768cf0f234b5da6d29450a58ce8e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d48ae8e-00", "ovs_interfaceid": "6d48ae8e-004c-459d-ad7c-081cc9228fee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8a0146a0-20fd-4879-be20-c8732bd6563c", "address": "fa:16:3e:6d:38:4b", "network": {"id": "054ba1f8-e55e-4af1-a668-c4e247430926", "bridge": "br-int", "label": "tempest-device-tagging-net2-1758238013", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "92b768cf0f234b5da6d29450a58ce8e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a0146a0-20", "ovs_interfaceid": "8a0146a0-20fd-4879-be20-c8732bd6563c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "450233b4-a16d-4b2d-bc6a-a87736db7ff4", "address": "fa:16:3e:fe:ae:28", "network": {"id": "054ba1f8-e55e-4af1-a668-c4e247430926", "bridge": "br-int", "label": "tempest-device-tagging-net2-1758238013", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "92b768cf0f234b5da6d29450a58ce8e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap450233b4-a1", "ovs_interfaceid": "450233b4-a16d-4b2d-bc6a-a87736db7ff4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:17:53 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-2568174c-2593-4746-896f-77f0cc2d6c34 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Acquiring lock "refresh_cache-bff3a84b-6ab5-4256-8a04-2d21a4ba20b3" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:17:53 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-2568174c-2593-4746-896f-77f0cc2d6c34 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Acquired lock "refresh_cache-bff3a84b-6ab5-4256-8a04-2d21a4ba20b3" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:17:53 user nova-compute[85141]: DEBUG nova.network.neutron [None req-2568174c-2593-4746-896f-77f0cc2d6c34 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] [instance: bff3a84b-6ab5-4256-8a04-2d21a4ba20b3] Building network info cache for instance {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 10:17:54 user nova-compute[85141]: DEBUG nova.compute.manager [req-0ea80227-8bc2-4f07-822c-0be1c55201ee req-c8e49be8-2fa5-4689-a511-31aa94c3178b service nova] [instance: bff3a84b-6ab5-4256-8a04-2d21a4ba20b3] Received event network-changed-23ec0327-ca81-4524-8850-2c081e596d44 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:17:54 user nova-compute[85141]: DEBUG nova.compute.manager [req-0ea80227-8bc2-4f07-822c-0be1c55201ee req-c8e49be8-2fa5-4689-a511-31aa94c3178b service nova] [instance: bff3a84b-6ab5-4256-8a04-2d21a4ba20b3] Refreshing instance network info cache due to event network-changed-23ec0327-ca81-4524-8850-2c081e596d44. {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 10:17:54 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-0ea80227-8bc2-4f07-822c-0be1c55201ee req-c8e49be8-2fa5-4689-a511-31aa94c3178b service nova] Acquiring lock "refresh_cache-bff3a84b-6ab5-4256-8a04-2d21a4ba20b3" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:17:54 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-1a5992a2-6649-48e0-b8da-f4ed05c18b73 req-4b42561d-e3a8-45c4-8f4e-7127fdeeb22b service nova] Releasing lock "refresh_cache-0c359f00-f4b7-43c3-8454-364842893779" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:17:54 user nova-compute[85141]: DEBUG nova.network.neutron [None req-2568174c-2593-4746-896f-77f0cc2d6c34 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] [instance: bff3a84b-6ab5-4256-8a04-2d21a4ba20b3] Instance cache missing network info. {{(pid=85141) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 10:17:54 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-fa51855c-8493-4f5f-9f40-7d0cf0320675 tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.462s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 10:17:54 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa51855c-8493-4f5f-9f40-7d0cf0320675 tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] <== connect_volume: return (1465ms) {'type': 'block', 'scsi_wwn': '26133636236623535', 'path': '/dev/sdg'} {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 10:17:54 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fa51855c-8493-4f5f-9f40-7d0cf0320675 tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] [instance: e88874fe-b0a6-4292-8832-023f95e4f53c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26133636236623535', 'path': '/dev/sdg'} {{(pid=85141) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 10:17:54 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-fa51855c-8493-4f5f-9f40-7d0cf0320675 tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T10:17:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-2111105262',display_name='tempest-TestShelveInstance-server-2111105262',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-2111105262',id=24,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBfWaK0ZY9CcidWmK2fKQywgej86dJ2hf+UK4R5TPd7pgcpe0Smv+B/1pPMISWG/EAcRok8hWGEmbvkAXnZfkTd4Ehr6r8dlkWNbm3jRYnDsKSJPOJlCYlPCFvR/gAoWpQ==',key_name='tempest-TestShelveInstance-1696654997',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5fc33dd813c64594a3626d2e7dff09ad',ramdisk_id='',reservation_id='r-7djljt23',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-289614798',owner_user_name='tempest-TestShelveInstance-289614798-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T10:17:45Z,user_data=None,user_id='462543c542ac4e84b99277f8cdd29807',uuid=e88874fe-b0a6-4292-8832-023f95e4f53c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7bbea642-d504-433b-ae99-8e7159942751", "address": "fa:16:3e:6a:e8:c6", "network": {"id": "3fc8f327-8ef7-4b60-abf0-31d75e40478e", "bridge": "br-int", "label": "tempest-TestShelveInstance-452311162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fc33dd813c64594a3626d2e7dff09ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bbea642-d5", "ovs_interfaceid": "7bbea642-d504-433b-ae99-8e7159942751", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=85141) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 10:17:54 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-fa51855c-8493-4f5f-9f40-7d0cf0320675 tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] Converting VIF {"id": "7bbea642-d504-433b-ae99-8e7159942751", "address": "fa:16:3e:6a:e8:c6", "network": {"id": "3fc8f327-8ef7-4b60-abf0-31d75e40478e", "bridge": "br-int", "label": "tempest-TestShelveInstance-452311162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fc33dd813c64594a3626d2e7dff09ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bbea642-d5", "ovs_interfaceid": "7bbea642-d504-433b-ae99-8e7159942751", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:17:54 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-fa51855c-8493-4f5f-9f40-7d0cf0320675 tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6a:e8:c6,bridge_name='br-int',has_traffic_filtering=True,id=7bbea642-d504-433b-ae99-8e7159942751,network=Network(3fc8f327-8ef7-4b60-abf0-31d75e40478e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7bbea642-d5') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:17:54 user nova-compute[85141]: DEBUG nova.objects.instance [None req-fa51855c-8493-4f5f-9f40-7d0cf0320675 tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] Lazy-loading 'pci_devices' on Instance uuid e88874fe-b0a6-4292-8832-023f95e4f53c {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:17:54 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-fa51855c-8493-4f5f-9f40-7d0cf0320675 tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] [instance: e88874fe-b0a6-4292-8832-023f95e4f53c] End _get_guest_xml xml=<domain type="kvm">
Nov 16 10:17:54 user nova-compute[85141]:   <uuid>e88874fe-b0a6-4292-8832-023f95e4f53c</uuid>
Nov 16 10:17:54 user nova-compute[85141]:   <name>instance-00000018</name>
Nov 16 10:17:54 user nova-compute[85141]:   <memory>524288</memory>
Nov 16 10:17:54 user nova-compute[85141]:   <vcpu>1</vcpu>
Nov 16 10:17:54 user nova-compute[85141]:   <metadata>
Nov 16 10:17:54 user nova-compute[85141]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 10:17:54 user nova-compute[85141]:       <nova:package version="0.0.0"/>
Nov 16 10:17:54 user nova-compute[85141]:       <nova:name>tempest-TestShelveInstance-server-2111105262</nova:name>
Nov 16 10:17:54 user nova-compute[85141]:       <nova:creationTime>2023-11-16 10:17:52</nova:creationTime>
Nov 16 10:17:54 user nova-compute[85141]:       <nova:flavor name="m1.tiny">
Nov 16 10:17:54 user nova-compute[85141]:         <nova:memory>512</nova:memory>
Nov 16 10:17:54 user nova-compute[85141]:         <nova:disk>1</nova:disk>
Nov 16 10:17:54 user nova-compute[85141]:         <nova:swap>0</nova:swap>
Nov 16 10:17:54 user nova-compute[85141]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 10:17:54 user nova-compute[85141]:         <nova:vcpus>1</nova:vcpus>
Nov 16 10:17:54 user nova-compute[85141]:       </nova:flavor>
Nov 16 10:17:54 user nova-compute[85141]:       <nova:owner>
Nov 16 10:17:54 user nova-compute[85141]:         <nova:user uuid="462543c542ac4e84b99277f8cdd29807">tempest-TestShelveInstance-289614798-project-member</nova:user>
Nov 16 10:17:54 user nova-compute[85141]:         <nova:project uuid="5fc33dd813c64594a3626d2e7dff09ad">tempest-TestShelveInstance-289614798</nova:project>
Nov 16 10:17:54 user nova-compute[85141]:       </nova:owner>
Nov 16 10:17:54 user nova-compute[85141]:       <nova:ports>
Nov 16 10:17:54 user nova-compute[85141]:         <nova:port uuid="7bbea642-d504-433b-ae99-8e7159942751">
Nov 16 10:17:54 user nova-compute[85141]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 16 10:17:54 user nova-compute[85141]:         </nova:port>
Nov 16 10:17:54 user nova-compute[85141]:       </nova:ports>
Nov 16 10:17:54 user nova-compute[85141]:     </nova:instance>
Nov 16 10:17:54 user nova-compute[85141]:   </metadata>
Nov 16 10:17:54 user nova-compute[85141]:   <sysinfo type="smbios">
Nov 16 10:17:54 user nova-compute[85141]:     <system>
Nov 16 10:17:54 user nova-compute[85141]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 10:17:54 user nova-compute[85141]:       <entry name="product">OpenStack Nova</entry>
Nov 16 10:17:54 user nova-compute[85141]:       <entry name="version">0.0.0</entry>
Nov 16 10:17:54 user nova-compute[85141]:       <entry name="serial">e88874fe-b0a6-4292-8832-023f95e4f53c</entry>
Nov 16 10:17:54 user nova-compute[85141]:       <entry name="uuid">e88874fe-b0a6-4292-8832-023f95e4f53c</entry>
Nov 16 10:17:54 user nova-compute[85141]:       <entry name="family">Virtual Machine</entry>
Nov 16 10:17:54 user nova-compute[85141]:     </system>
Nov 16 10:17:54 user nova-compute[85141]:   </sysinfo>
Nov 16 10:17:54 user nova-compute[85141]:   <os>
Nov 16 10:17:54 user nova-compute[85141]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 10:17:54 user nova-compute[85141]:     <boot dev="hd"/>
Nov 16 10:17:54 user nova-compute[85141]:     <smbios mode="sysinfo"/>
Nov 16 10:17:54 user nova-compute[85141]:   </os>
Nov 16 10:17:54 user nova-compute[85141]:   <features>
Nov 16 10:17:54 user nova-compute[85141]:     <acpi/>
Nov 16 10:17:54 user nova-compute[85141]:     <apic/>
Nov 16 10:17:54 user nova-compute[85141]:     <vmcoreinfo/>
Nov 16 10:17:54 user nova-compute[85141]:   </features>
Nov 16 10:17:54 user nova-compute[85141]:   <clock offset="utc">
Nov 16 10:17:54 user nova-compute[85141]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 10:17:54 user nova-compute[85141]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 10:17:54 user nova-compute[85141]:     <timer name="hpet" present="no"/>
Nov 16 10:17:54 user nova-compute[85141]:   </clock>
Nov 16 10:17:54 user nova-compute[85141]:   <cpu mode="custom" match="exact">
Nov 16 10:17:54 user nova-compute[85141]:     <model>Nehalem</model>
Nov 16 10:17:54 user nova-compute[85141]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 10:17:54 user nova-compute[85141]:   </cpu>
Nov 16 10:17:54 user nova-compute[85141]:   <devices>
Nov 16 10:17:54 user nova-compute[85141]:     <disk type="block" device="disk">
Nov 16 10:17:54 user nova-compute[85141]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 10:17:54 user nova-compute[85141]:       <source dev="/dev/sdg"/>
Nov 16 10:17:54 user nova-compute[85141]:       <target dev="vda" bus="virtio"/>
Nov 16 10:17:54 user nova-compute[85141]:       <serial>674f9ae8-6ab5-4ff2-b715-fe8807c34793</serial>
Nov 16 10:17:54 user nova-compute[85141]:     </disk>
Nov 16 10:17:54 user nova-compute[85141]:     <interface type="ethernet">
Nov 16 10:17:54 user nova-compute[85141]:       <mac address="fa:16:3e:6a:e8:c6"/>
Nov 16 10:17:54 user nova-compute[85141]:       <model type="virtio"/>
Nov 16 10:17:54 user nova-compute[85141]:       <mtu size="1442"/>
Nov 16 10:17:54 user nova-compute[85141]:       <target dev="tap7bbea642-d5"/>
Nov 16 10:17:54 user nova-compute[85141]:     </interface>
Nov 16 10:17:54 user nova-compute[85141]:     <serial type="pty">
Nov 16 10:17:54 user nova-compute[85141]:       <log file="/opt/stack/data/nova/instances/e88874fe-b0a6-4292-8832-023f95e4f53c/console.log" append="off"/>
Nov 16 10:17:54 user nova-compute[85141]:     </serial>
Nov 16 10:17:54 user nova-compute[85141]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 10:17:54 user nova-compute[85141]:     <video>
Nov 16 10:17:54 user nova-compute[85141]:       <model type="virtio"/>
Nov 16 10:17:54 user nova-compute[85141]:     </video>
Nov 16 10:17:54 user nova-compute[85141]:     <rng model="virtio">
Nov 16 10:17:54 user nova-compute[85141]:       <backend model="random">/dev/urandom</backend>
Nov 16 10:17:54 user nova-compute[85141]:     </rng>
Nov 16 10:17:54 user nova-compute[85141]:     <controller type="usb" index="0" model="none"/>
Nov 16 10:17:54 user nova-compute[85141]:     <memballoon model="virtio">
Nov 16 10:17:54 user nova-compute[85141]:       <stats period="10"/>
Nov 16 10:17:54 user nova-compute[85141]:     </memballoon>
Nov 16 10:17:54 user nova-compute[85141]:   </devices>
Nov 16 10:17:54 user nova-compute[85141]: </domain>
Nov 16 10:17:54 user nova-compute[85141]:  {{(pid=85141) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 10:17:54 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-fa51855c-8493-4f5f-9f40-7d0cf0320675 tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T10:17:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-2111105262',display_name='tempest-TestShelveInstance-server-2111105262',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-2111105262',id=24,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBfWaK0ZY9CcidWmK2fKQywgej86dJ2hf+UK4R5TPd7pgcpe0Smv+B/1pPMISWG/EAcRok8hWGEmbvkAXnZfkTd4Ehr6r8dlkWNbm3jRYnDsKSJPOJlCYlPCFvR/gAoWpQ==',key_name='tempest-TestShelveInstance-1696654997',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5fc33dd813c64594a3626d2e7dff09ad',ramdisk_id='',reservation_id='r-7djljt23',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-289614798',owner_user_name='tempest-TestShelveInstance-289614798-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T10:17:45Z,user_data=None,user_id='462543c542ac4e84b99277f8cdd29807',uuid=e88874fe-b0a6-4292-8832-023f95e4f53c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7bbea642-d504-433b-ae99-8e7159942751", "address": "fa:16:3e:6a:e8:c6", "network": {"id": "3fc8f327-8ef7-4b60-abf0-31d75e40478e", "bridge": "br-int", "label": "tempest-TestShelveInstance-452311162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fc33dd813c64594a3626d2e7dff09ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bbea642-d5", "ovs_interfaceid": "7bbea642-d504-433b-ae99-8e7159942751", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 10:17:54 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-fa51855c-8493-4f5f-9f40-7d0cf0320675 tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] Converting VIF {"id": "7bbea642-d504-433b-ae99-8e7159942751", "address": "fa:16:3e:6a:e8:c6", "network": {"id": "3fc8f327-8ef7-4b60-abf0-31d75e40478e", "bridge": "br-int", "label": "tempest-TestShelveInstance-452311162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fc33dd813c64594a3626d2e7dff09ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bbea642-d5", "ovs_interfaceid": "7bbea642-d504-433b-ae99-8e7159942751", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:17:54 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-fa51855c-8493-4f5f-9f40-7d0cf0320675 tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6a:e8:c6,bridge_name='br-int',has_traffic_filtering=True,id=7bbea642-d504-433b-ae99-8e7159942751,network=Network(3fc8f327-8ef7-4b60-abf0-31d75e40478e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7bbea642-d5') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:17:54 user nova-compute[85141]: DEBUG os_vif [None req-fa51855c-8493-4f5f-9f40-7d0cf0320675 tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:e8:c6,bridge_name='br-int',has_traffic_filtering=True,id=7bbea642-d504-433b-ae99-8e7159942751,network=Network(3fc8f327-8ef7-4b60-abf0-31d75e40478e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7bbea642-d5') {{(pid=85141) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 10:17:54 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:17:54 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:17:54 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 10:17:54 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:17:54 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '279738f6-68c2-5eec-b55e-6c54fe32c174', '_type': 'linux-noop'}}, row=False) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:17:54 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:17:54 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:17:54 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:17:54 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7bbea642-d5, may_exist=True, interface_attrs={}) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:17:54 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7bbea642-d5, col_values=(('qos', UUID('e95c9279-7c23-4521-9332-5bf077a75cb5')),), if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:17:54 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7bbea642-d5, col_values=(('external_ids', {'iface-id': '7bbea642-d504-433b-ae99-8e7159942751', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6a:e8:c6', 'vm-uuid': 'e88874fe-b0a6-4292-8832-023f95e4f53c'}),), if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:17:54 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:17:54 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:17:54 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:17:54 user nova-compute[85141]: INFO os_vif [None req-fa51855c-8493-4f5f-9f40-7d0cf0320675 tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:e8:c6,bridge_name='br-int',has_traffic_filtering=True,id=7bbea642-d504-433b-ae99-8e7159942751,network=Network(3fc8f327-8ef7-4b60-abf0-31d75e40478e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7bbea642-d5')
Nov 16 10:17:54 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-fa51855c-8493-4f5f-9f40-7d0cf0320675 tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] No BDM found with device name vda, not building metadata. {{(pid=85141) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 10:17:54 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-fa51855c-8493-4f5f-9f40-7d0cf0320675 tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] No VIF found with MAC fa:16:3e:6a:e8:c6, not building metadata {{(pid=85141) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 10:17:54 user nova-compute[85141]: DEBUG nova.network.neutron [None req-2568174c-2593-4746-896f-77f0cc2d6c34 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] [instance: bff3a84b-6ab5-4256-8a04-2d21a4ba20b3] Updating instance_info_cache with network_info: [{"id": "23ec0327-ca81-4524-8850-2c081e596d44", "address": "fa:16:3e:e1:61:4a", "network": {"id": "4fb7c85e-c966-481d-b6f2-856a17ac8f7c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-81570496-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08ef12fb41a14ecd8abb84d4d69b7c27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23ec0327-ca", "ovs_interfaceid": "23ec0327-ca81-4524-8850-2c081e596d44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:17:54 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-2568174c-2593-4746-896f-77f0cc2d6c34 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Releasing lock "refresh_cache-bff3a84b-6ab5-4256-8a04-2d21a4ba20b3" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:17:54 user nova-compute[85141]: DEBUG nova.compute.manager [None req-2568174c-2593-4746-896f-77f0cc2d6c34 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] [instance: bff3a84b-6ab5-4256-8a04-2d21a4ba20b3] Instance network_info: |[{"id": "23ec0327-ca81-4524-8850-2c081e596d44", "address": "fa:16:3e:e1:61:4a", "network": {"id": "4fb7c85e-c966-481d-b6f2-856a17ac8f7c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-81570496-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08ef12fb41a14ecd8abb84d4d69b7c27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23ec0327-ca", "ovs_interfaceid": "23ec0327-ca81-4524-8850-2c081e596d44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=85141) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 10:17:54 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-0ea80227-8bc2-4f07-822c-0be1c55201ee req-c8e49be8-2fa5-4689-a511-31aa94c3178b service nova] Acquired lock "refresh_cache-bff3a84b-6ab5-4256-8a04-2d21a4ba20b3" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:17:54 user nova-compute[85141]: DEBUG nova.network.neutron [req-0ea80227-8bc2-4f07-822c-0be1c55201ee req-c8e49be8-2fa5-4689-a511-31aa94c3178b service nova] [instance: bff3a84b-6ab5-4256-8a04-2d21a4ba20b3] Refreshing network info cache for port 23ec0327-ca81-4524-8850-2c081e596d44 {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 10:17:54 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-2568174c-2593-4746-896f-77f0cc2d6c34 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] [instance: bff3a84b-6ab5-4256-8a04-2d21a4ba20b3] Start _get_guest_xml network_info=[{"id": "23ec0327-ca81-4524-8850-2c081e596d44", "address": "fa:16:3e:e1:61:4a", "network": {"id": "4fb7c85e-c966-481d-b6f2-856a17ac8f7c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-81570496-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08ef12fb41a14ecd8abb84d4d69b7c27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23ec0327-ca", "ovs_interfaceid": "23ec0327-ca81-4524-8850-2c081e596d44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T10:06:42Z,direct_url=<?>,disk_format='qcow2',id=bc4ca70f-a459-4d5c-a9e6-80f1948eb48b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1044631a5fe84ce8904864a7024049fa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T10:06:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_options': None, 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'image_id': 'bc4ca70f-a459-4d5c-a9e6-80f1948eb48b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=85141) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 10:17:54 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-2568174c-2593-4746-896f-77f0cc2d6c34 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:17:54 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-2568174c-2593-4746-896f-77f0cc2d6c34 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:17:54 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-2568174c-2593-4746-896f-77f0cc2d6c34 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=85141) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 10:17:54 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-2568174c-2593-4746-896f-77f0cc2d6c34 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] CPU controller missing on host. {{(pid=85141) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 10:17:54 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-2568174c-2593-4746-896f-77f0cc2d6c34 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=85141) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 10:17:54 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-2568174c-2593-4746-896f-77f0cc2d6c34 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] CPU controller found on host. {{(pid=85141) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 10:17:54 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-2568174c-2593-4746-896f-77f0cc2d6c34 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=85141) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 10:17:54 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-2568174c-2593-4746-896f-77f0cc2d6c34 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T10:06:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T10:06:42Z,direct_url=<?>,disk_format='qcow2',id=bc4ca70f-a459-4d5c-a9e6-80f1948eb48b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1044631a5fe84ce8904864a7024049fa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T10:06:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 10:17:54 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-2568174c-2593-4746-896f-77f0cc2d6c34 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Flavor limits 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 10:17:54 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-2568174c-2593-4746-896f-77f0cc2d6c34 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Image limits 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 10:17:54 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-2568174c-2593-4746-896f-77f0cc2d6c34 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Flavor pref 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 10:17:54 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-2568174c-2593-4746-896f-77f0cc2d6c34 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Image pref 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 10:17:54 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-2568174c-2593-4746-896f-77f0cc2d6c34 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 10:17:54 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-2568174c-2593-4746-896f-77f0cc2d6c34 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 10:17:54 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-2568174c-2593-4746-896f-77f0cc2d6c34 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=85141) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 10:17:54 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-2568174c-2593-4746-896f-77f0cc2d6c34 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Got 1 possible topologies {{(pid=85141) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 10:17:54 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-2568174c-2593-4746-896f-77f0cc2d6c34 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 10:17:54 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-2568174c-2593-4746-896f-77f0cc2d6c34 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 10:17:54 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-2568174c-2593-4746-896f-77f0cc2d6c34 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T10:17:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-614284673',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-614284673',id=25,image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPrlp76Olur0ZBpPoZ4m3G4Hwg5TXY71OdfaQUGbHoElIxC/z9jY6d0topldSFOLBvCWRDtLDl17PNg8CQuntmhvUqsl16M2lr6nhPkJ/90Htz0ywDAC3fTsHsTT9yVpJQ==',key_name='tempest-keypair-1229413697',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='08ef12fb41a14ecd8abb84d4d69b7c27',ramdisk_id='',reservation_id='r-m6x0xg39',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-958501663',owner_user_name='tempest-AttachVolumeShelveTestJSON-958501663-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T10:17:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='baec48c887ae4a418e0ea7b32b05bc59',uuid=bff3a84b-6ab5-4256-8a04-2d21a4ba20b3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "23ec0327-ca81-4524-8850-2c081e596d44", "address": "fa:16:3e:e1:61:4a", "network": {"id": "4fb7c85e-c966-481d-b6f2-856a17ac8f7c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-81570496-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08ef12fb41a14ecd8abb84d4d69b7c27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23ec0327-ca", "ovs_interfaceid": "23ec0327-ca81-4524-8850-2c081e596d44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=85141) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 10:17:54 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-2568174c-2593-4746-896f-77f0cc2d6c34 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Converting VIF {"id": "23ec0327-ca81-4524-8850-2c081e596d44", "address": "fa:16:3e:e1:61:4a", "network": {"id": "4fb7c85e-c966-481d-b6f2-856a17ac8f7c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-81570496-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08ef12fb41a14ecd8abb84d4d69b7c27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23ec0327-ca", "ovs_interfaceid": "23ec0327-ca81-4524-8850-2c081e596d44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:17:54 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-2568174c-2593-4746-896f-77f0cc2d6c34 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:61:4a,bridge_name='br-int',has_traffic_filtering=True,id=23ec0327-ca81-4524-8850-2c081e596d44,network=Network(4fb7c85e-c966-481d-b6f2-856a17ac8f7c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23ec0327-ca') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:17:54 user nova-compute[85141]: DEBUG nova.objects.instance [None req-2568174c-2593-4746-896f-77f0cc2d6c34 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Lazy-loading 'pci_devices' on Instance uuid bff3a84b-6ab5-4256-8a04-2d21a4ba20b3 {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:17:54 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-2568174c-2593-4746-896f-77f0cc2d6c34 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] [instance: bff3a84b-6ab5-4256-8a04-2d21a4ba20b3] End _get_guest_xml xml=<domain type="kvm">
Nov 16 10:17:54 user nova-compute[85141]:   <uuid>bff3a84b-6ab5-4256-8a04-2d21a4ba20b3</uuid>
Nov 16 10:17:54 user nova-compute[85141]:   <name>instance-00000019</name>
Nov 16 10:17:54 user nova-compute[85141]:   <memory>524288</memory>
Nov 16 10:17:54 user nova-compute[85141]:   <vcpu>1</vcpu>
Nov 16 10:17:54 user nova-compute[85141]:   <metadata>
Nov 16 10:17:54 user nova-compute[85141]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 10:17:54 user nova-compute[85141]:       <nova:package version="0.0.0"/>
Nov 16 10:17:54 user nova-compute[85141]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-614284673</nova:name>
Nov 16 10:17:54 user nova-compute[85141]:       <nova:creationTime>2023-11-16 10:17:54</nova:creationTime>
Nov 16 10:17:54 user nova-compute[85141]:       <nova:flavor name="m1.tiny">
Nov 16 10:17:54 user nova-compute[85141]:         <nova:memory>512</nova:memory>
Nov 16 10:17:54 user nova-compute[85141]:         <nova:disk>1</nova:disk>
Nov 16 10:17:54 user nova-compute[85141]:         <nova:swap>0</nova:swap>
Nov 16 10:17:54 user nova-compute[85141]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 10:17:54 user nova-compute[85141]:         <nova:vcpus>1</nova:vcpus>
Nov 16 10:17:54 user nova-compute[85141]:       </nova:flavor>
Nov 16 10:17:54 user nova-compute[85141]:       <nova:owner>
Nov 16 10:17:54 user nova-compute[85141]:         <nova:user uuid="baec48c887ae4a418e0ea7b32b05bc59">tempest-AttachVolumeShelveTestJSON-958501663-project-member</nova:user>
Nov 16 10:17:54 user nova-compute[85141]:         <nova:project uuid="08ef12fb41a14ecd8abb84d4d69b7c27">tempest-AttachVolumeShelveTestJSON-958501663</nova:project>
Nov 16 10:17:54 user nova-compute[85141]:       </nova:owner>
Nov 16 10:17:54 user nova-compute[85141]:       <nova:root type="image" uuid="bc4ca70f-a459-4d5c-a9e6-80f1948eb48b"/>
Nov 16 10:17:54 user nova-compute[85141]:       <nova:ports>
Nov 16 10:17:54 user nova-compute[85141]:         <nova:port uuid="23ec0327-ca81-4524-8850-2c081e596d44">
Nov 16 10:17:54 user nova-compute[85141]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 16 10:17:54 user nova-compute[85141]:         </nova:port>
Nov 16 10:17:54 user nova-compute[85141]:       </nova:ports>
Nov 16 10:17:54 user nova-compute[85141]:     </nova:instance>
Nov 16 10:17:54 user nova-compute[85141]:   </metadata>
Nov 16 10:17:54 user nova-compute[85141]:   <sysinfo type="smbios">
Nov 16 10:17:54 user nova-compute[85141]:     <system>
Nov 16 10:17:54 user nova-compute[85141]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 10:17:54 user nova-compute[85141]:       <entry name="product">OpenStack Nova</entry>
Nov 16 10:17:54 user nova-compute[85141]:       <entry name="version">0.0.0</entry>
Nov 16 10:17:54 user nova-compute[85141]:       <entry name="serial">bff3a84b-6ab5-4256-8a04-2d21a4ba20b3</entry>
Nov 16 10:17:54 user nova-compute[85141]:       <entry name="uuid">bff3a84b-6ab5-4256-8a04-2d21a4ba20b3</entry>
Nov 16 10:17:54 user nova-compute[85141]:       <entry name="family">Virtual Machine</entry>
Nov 16 10:17:54 user nova-compute[85141]:     </system>
Nov 16 10:17:54 user nova-compute[85141]:   </sysinfo>
Nov 16 10:17:54 user nova-compute[85141]:   <os>
Nov 16 10:17:54 user nova-compute[85141]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 10:17:54 user nova-compute[85141]:     <boot dev="hd"/>
Nov 16 10:17:54 user nova-compute[85141]:     <smbios mode="sysinfo"/>
Nov 16 10:17:54 user nova-compute[85141]:   </os>
Nov 16 10:17:54 user nova-compute[85141]:   <features>
Nov 16 10:17:54 user nova-compute[85141]:     <acpi/>
Nov 16 10:17:54 user nova-compute[85141]:     <apic/>
Nov 16 10:17:54 user nova-compute[85141]:     <vmcoreinfo/>
Nov 16 10:17:54 user nova-compute[85141]:   </features>
Nov 16 10:17:54 user nova-compute[85141]:   <clock offset="utc">
Nov 16 10:17:54 user nova-compute[85141]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 10:17:54 user nova-compute[85141]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 10:17:54 user nova-compute[85141]:     <timer name="hpet" present="no"/>
Nov 16 10:17:54 user nova-compute[85141]:   </clock>
Nov 16 10:17:54 user nova-compute[85141]:   <cpu mode="custom" match="exact">
Nov 16 10:17:54 user nova-compute[85141]:     <model>Nehalem</model>
Nov 16 10:17:54 user nova-compute[85141]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 10:17:54 user nova-compute[85141]:   </cpu>
Nov 16 10:17:54 user nova-compute[85141]:   <devices>
Nov 16 10:17:54 user nova-compute[85141]:     <disk type="file" device="disk">
Nov 16 10:17:54 user nova-compute[85141]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 10:17:54 user nova-compute[85141]:       <source file="/opt/stack/data/nova/instances/bff3a84b-6ab5-4256-8a04-2d21a4ba20b3/disk"/>
Nov 16 10:17:54 user nova-compute[85141]:       <target dev="vda" bus="virtio"/>
Nov 16 10:17:54 user nova-compute[85141]:     </disk>
Nov 16 10:17:54 user nova-compute[85141]:     <interface type="ethernet">
Nov 16 10:17:54 user nova-compute[85141]:       <mac address="fa:16:3e:e1:61:4a"/>
Nov 16 10:17:54 user nova-compute[85141]:       <model type="virtio"/>
Nov 16 10:17:54 user nova-compute[85141]:       <mtu size="1442"/>
Nov 16 10:17:54 user nova-compute[85141]:       <target dev="tap23ec0327-ca"/>
Nov 16 10:17:54 user nova-compute[85141]:     </interface>
Nov 16 10:17:54 user nova-compute[85141]:     <serial type="pty">
Nov 16 10:17:54 user nova-compute[85141]:       <log file="/opt/stack/data/nova/instances/bff3a84b-6ab5-4256-8a04-2d21a4ba20b3/console.log" append="off"/>
Nov 16 10:17:54 user nova-compute[85141]:     </serial>
Nov 16 10:17:54 user nova-compute[85141]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 10:17:54 user nova-compute[85141]:     <video>
Nov 16 10:17:54 user nova-compute[85141]:       <model type="virtio"/>
Nov 16 10:17:54 user nova-compute[85141]:     </video>
Nov 16 10:17:54 user nova-compute[85141]:     <rng model="virtio">
Nov 16 10:17:54 user nova-compute[85141]:       <backend model="random">/dev/urandom</backend>
Nov 16 10:17:54 user nova-compute[85141]:     </rng>
Nov 16 10:17:54 user nova-compute[85141]:     <controller type="usb" index="0" model="none"/>
Nov 16 10:17:54 user nova-compute[85141]:     <memballoon model="virtio">
Nov 16 10:17:54 user nova-compute[85141]:       <stats period="10"/>
Nov 16 10:17:54 user nova-compute[85141]:     </memballoon>
Nov 16 10:17:54 user nova-compute[85141]:   </devices>
Nov 16 10:17:54 user nova-compute[85141]: </domain>
Nov 16 10:17:54 user nova-compute[85141]:  {{(pid=85141) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 10:17:54 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-2568174c-2593-4746-896f-77f0cc2d6c34 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T10:17:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-614284673',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-614284673',id=25,image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPrlp76Olur0ZBpPoZ4m3G4Hwg5TXY71OdfaQUGbHoElIxC/z9jY6d0topldSFOLBvCWRDtLDl17PNg8CQuntmhvUqsl16M2lr6nhPkJ/90Htz0ywDAC3fTsHsTT9yVpJQ==',key_name='tempest-keypair-1229413697',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='08ef12fb41a14ecd8abb84d4d69b7c27',ramdisk_id='',reservation_id='r-m6x0xg39',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-958501663',owner_user_name='tempest-AttachVolumeShelveTestJSON-958501663-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T10:17:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='baec48c887ae4a418e0ea7b32b05bc59',uuid=bff3a84b-6ab5-4256-8a04-2d21a4ba20b3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "23ec0327-ca81-4524-8850-2c081e596d44", "address": "fa:16:3e:e1:61:4a", "network": {"id": "4fb7c85e-c966-481d-b6f2-856a17ac8f7c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-81570496-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08ef12fb41a14ecd8abb84d4d69b7c27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23ec0327-ca", "ovs_interfaceid": "23ec0327-ca81-4524-8850-2c081e596d44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 10:17:54 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-2568174c-2593-4746-896f-77f0cc2d6c34 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Converting VIF {"id": "23ec0327-ca81-4524-8850-2c081e596d44", "address": "fa:16:3e:e1:61:4a", "network": {"id": "4fb7c85e-c966-481d-b6f2-856a17ac8f7c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-81570496-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08ef12fb41a14ecd8abb84d4d69b7c27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23ec0327-ca", "ovs_interfaceid": "23ec0327-ca81-4524-8850-2c081e596d44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:17:54 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-2568174c-2593-4746-896f-77f0cc2d6c34 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:61:4a,bridge_name='br-int',has_traffic_filtering=True,id=23ec0327-ca81-4524-8850-2c081e596d44,network=Network(4fb7c85e-c966-481d-b6f2-856a17ac8f7c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23ec0327-ca') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:17:54 user nova-compute[85141]: DEBUG os_vif [None req-2568174c-2593-4746-896f-77f0cc2d6c34 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:61:4a,bridge_name='br-int',has_traffic_filtering=True,id=23ec0327-ca81-4524-8850-2c081e596d44,network=Network(4fb7c85e-c966-481d-b6f2-856a17ac8f7c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23ec0327-ca') {{(pid=85141) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 10:17:54 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:17:54 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:17:54 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 10:17:54 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:17:54 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c43d069a-c7a3-5307-a553-0d436449db15', '_type': 'linux-noop'}}, row=False) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:17:54 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:17:54 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:17:54 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:17:54 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:17:54 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap23ec0327-ca, may_exist=True, interface_attrs={}) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:17:54 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap23ec0327-ca, col_values=(('qos', UUID('d448ea39-8d4c-4030-8d58-d7ee8e71d987')),), if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:17:54 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap23ec0327-ca, col_values=(('external_ids', {'iface-id': '23ec0327-ca81-4524-8850-2c081e596d44', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e1:61:4a', 'vm-uuid': 'bff3a84b-6ab5-4256-8a04-2d21a4ba20b3'}),), if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:17:54 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:17:54 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:17:54 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:17:54 user nova-compute[85141]: INFO os_vif [None req-2568174c-2593-4746-896f-77f0cc2d6c34 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:61:4a,bridge_name='br-int',has_traffic_filtering=True,id=23ec0327-ca81-4524-8850-2c081e596d44,network=Network(4fb7c85e-c966-481d-b6f2-856a17ac8f7c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23ec0327-ca')
Nov 16 10:17:54 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-2568174c-2593-4746-896f-77f0cc2d6c34 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] No BDM found with device name vda, not building metadata. {{(pid=85141) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 10:17:54 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-2568174c-2593-4746-896f-77f0cc2d6c34 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] No VIF found with MAC fa:16:3e:e1:61:4a, not building metadata {{(pid=85141) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 10:17:54 user nova-compute[85141]: DEBUG nova.network.neutron [req-0ea80227-8bc2-4f07-822c-0be1c55201ee req-c8e49be8-2fa5-4689-a511-31aa94c3178b service nova] [instance: bff3a84b-6ab5-4256-8a04-2d21a4ba20b3] Updated VIF entry in instance network info cache for port 23ec0327-ca81-4524-8850-2c081e596d44. {{(pid=85141) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 10:17:54 user nova-compute[85141]: DEBUG nova.network.neutron [req-0ea80227-8bc2-4f07-822c-0be1c55201ee req-c8e49be8-2fa5-4689-a511-31aa94c3178b service nova] [instance: bff3a84b-6ab5-4256-8a04-2d21a4ba20b3] Updating instance_info_cache with network_info: [{"id": "23ec0327-ca81-4524-8850-2c081e596d44", "address": "fa:16:3e:e1:61:4a", "network": {"id": "4fb7c85e-c966-481d-b6f2-856a17ac8f7c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-81570496-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08ef12fb41a14ecd8abb84d4d69b7c27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23ec0327-ca", "ovs_interfaceid": "23ec0327-ca81-4524-8850-2c081e596d44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:17:54 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-0ea80227-8bc2-4f07-822c-0be1c55201ee req-c8e49be8-2fa5-4689-a511-31aa94c3178b service nova] Releasing lock "refresh_cache-bff3a84b-6ab5-4256-8a04-2d21a4ba20b3" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:17:55 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-788b2849-eb9d-406f-8533-c4c016604a6b tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] Acquiring lock "0c359f00-f4b7-43c3-8454-364842893779" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:17:55 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-788b2849-eb9d-406f-8533-c4c016604a6b tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] Lock "0c359f00-f4b7-43c3-8454-364842893779" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:17:55 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-788b2849-eb9d-406f-8533-c4c016604a6b tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] Acquiring lock "0c359f00-f4b7-43c3-8454-364842893779-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:17:55 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-788b2849-eb9d-406f-8533-c4c016604a6b tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] Lock "0c359f00-f4b7-43c3-8454-364842893779-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:17:55 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-788b2849-eb9d-406f-8533-c4c016604a6b tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] Lock "0c359f00-f4b7-43c3-8454-364842893779-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:17:55 user nova-compute[85141]: INFO nova.compute.manager [None req-788b2849-eb9d-406f-8533-c4c016604a6b tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] [instance: 0c359f00-f4b7-43c3-8454-364842893779] Terminating instance
Nov 16 10:17:55 user nova-compute[85141]: DEBUG nova.compute.manager [None req-788b2849-eb9d-406f-8533-c4c016604a6b tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] [instance: 0c359f00-f4b7-43c3-8454-364842893779] Start destroying the instance on the hypervisor. {{(pid=85141) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 10:17:56 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:17:56 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:17:56 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:17:56 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:17:56 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:17:56 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:17:56 user nova-compute[85141]: DEBUG nova.compute.manager [req-e7c1c828-88a8-4c1b-bbe1-e098b04bd021 req-7b3731f8-69e3-49f6-9078-12d4bf4f2ff4 service nova] [instance: 0c359f00-f4b7-43c3-8454-364842893779] Received event network-vif-unplugged-97833d7f-68d7-4a6a-a283-83744d5afd10 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:17:56 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-e7c1c828-88a8-4c1b-bbe1-e098b04bd021 req-7b3731f8-69e3-49f6-9078-12d4bf4f2ff4 service nova] Acquiring lock "0c359f00-f4b7-43c3-8454-364842893779-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:17:56 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-e7c1c828-88a8-4c1b-bbe1-e098b04bd021 req-7b3731f8-69e3-49f6-9078-12d4bf4f2ff4 service nova] Lock "0c359f00-f4b7-43c3-8454-364842893779-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:17:56 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-e7c1c828-88a8-4c1b-bbe1-e098b04bd021 req-7b3731f8-69e3-49f6-9078-12d4bf4f2ff4 service nova] Lock "0c359f00-f4b7-43c3-8454-364842893779-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:17:56 user nova-compute[85141]: DEBUG nova.compute.manager [req-e7c1c828-88a8-4c1b-bbe1-e098b04bd021 req-7b3731f8-69e3-49f6-9078-12d4bf4f2ff4 service nova] [instance: 0c359f00-f4b7-43c3-8454-364842893779] No waiting events found dispatching network-vif-unplugged-97833d7f-68d7-4a6a-a283-83744d5afd10 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:17:56 user nova-compute[85141]: DEBUG nova.compute.manager [req-e7c1c828-88a8-4c1b-bbe1-e098b04bd021 req-7b3731f8-69e3-49f6-9078-12d4bf4f2ff4 service nova] [instance: 0c359f00-f4b7-43c3-8454-364842893779] Received event network-vif-unplugged-97833d7f-68d7-4a6a-a283-83744d5afd10 for instance with task_state deleting. {{(pid=85141) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 10:17:56 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:17:56 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:17:56 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:17:56 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:17:56 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:17:56 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:17:56 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:17:56 user nova-compute[85141]: DEBUG nova.compute.manager [req-5f6a7f83-1b92-4659-ba36-1f7d2255ebcb req-a3b78541-629c-4455-8e88-ae1f591b2ae3 service nova] [instance: 0c359f00-f4b7-43c3-8454-364842893779] Received event network-vif-unplugged-2243117f-44a8-4d51-8676-d67748b3c9aa {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:17:56 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-5f6a7f83-1b92-4659-ba36-1f7d2255ebcb req-a3b78541-629c-4455-8e88-ae1f591b2ae3 service nova] Acquiring lock "0c359f00-f4b7-43c3-8454-364842893779-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:17:56 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-5f6a7f83-1b92-4659-ba36-1f7d2255ebcb req-a3b78541-629c-4455-8e88-ae1f591b2ae3 service nova] Lock "0c359f00-f4b7-43c3-8454-364842893779-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:17:56 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-5f6a7f83-1b92-4659-ba36-1f7d2255ebcb req-a3b78541-629c-4455-8e88-ae1f591b2ae3 service nova] Lock "0c359f00-f4b7-43c3-8454-364842893779-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:17:56 user nova-compute[85141]: DEBUG nova.compute.manager [req-5f6a7f83-1b92-4659-ba36-1f7d2255ebcb req-a3b78541-629c-4455-8e88-ae1f591b2ae3 service nova] [instance: 0c359f00-f4b7-43c3-8454-364842893779] No waiting events found dispatching network-vif-unplugged-2243117f-44a8-4d51-8676-d67748b3c9aa {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:17:56 user nova-compute[85141]: DEBUG nova.compute.manager [req-5f6a7f83-1b92-4659-ba36-1f7d2255ebcb req-a3b78541-629c-4455-8e88-ae1f591b2ae3 service nova] [instance: 0c359f00-f4b7-43c3-8454-364842893779] Received event network-vif-unplugged-2243117f-44a8-4d51-8676-d67748b3c9aa for instance with task_state deleting. {{(pid=85141) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 10:17:56 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:17:57 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:17:57 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:17:57 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:17:57 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:17:57 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:17:57 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:17:57 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:17:58 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:17:58 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:17:58 user nova-compute[85141]: INFO nova.virt.libvirt.driver [-] [instance: 0c359f00-f4b7-43c3-8454-364842893779] Instance destroyed successfully.
Nov 16 10:17:58 user nova-compute[85141]: DEBUG nova.objects.instance [None req-788b2849-eb9d-406f-8533-c4c016604a6b tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] Lazy-loading 'resources' on Instance uuid 0c359f00-f4b7-43c3-8454-364842893779 {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:17:58 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-788b2849-eb9d-406f-8533-c4c016604a6b tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T10:16:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2082484665',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2082484665',id=20,image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKrh2Bof78f1GbJ8gbebS4oyTSP8WglgJTFEydBYPe1tDZFGM71mwkIVvhvKHeqCxlHAP/OJrMQQa+0/ZND/hwmjTMgKHnoGjCJWqCZRpPKiQjDx27A4g/dcEbVlvqH96g==',key_name='tempest-keypair-1313405448',keypairs=<?>,launch_index=0,launched_at=2023-11-16T10:16:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='92b768cf0f234b5da6d29450a58ce8e7',ramdisk_id='',reservation_id='r-lbhzqlsr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1698183890',owner_user_name='tempest-TaggedBootDevicesTest-1698183890-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T10:16:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9fd70ad0794943a7b93eced34e17aa4d',uuid=0c359f00-f4b7-43c3-8454-364842893779,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "97833d7f-68d7-4a6a-a283-83744d5afd10", "address": "fa:16:3e:b6:30:ac", "network": {"id": "cfb2308f-7c88-4329-a72d-4253cbbaca17", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1320471327-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92b768cf0f234b5da6d29450a58ce8e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97833d7f-68", "ovs_interfaceid": "97833d7f-68d7-4a6a-a283-83744d5afd10", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 10:17:58 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-788b2849-eb9d-406f-8533-c4c016604a6b tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] Converting VIF {"id": "97833d7f-68d7-4a6a-a283-83744d5afd10", "address": "fa:16:3e:b6:30:ac", "network": {"id": "cfb2308f-7c88-4329-a72d-4253cbbaca17", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1320471327-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92b768cf0f234b5da6d29450a58ce8e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97833d7f-68", "ovs_interfaceid": "97833d7f-68d7-4a6a-a283-83744d5afd10", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:17:58 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-788b2849-eb9d-406f-8533-c4c016604a6b tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b6:30:ac,bridge_name='br-int',has_traffic_filtering=True,id=97833d7f-68d7-4a6a-a283-83744d5afd10,network=Network(cfb2308f-7c88-4329-a72d-4253cbbaca17),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97833d7f-68') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:17:58 user nova-compute[85141]: DEBUG os_vif [None req-788b2849-eb9d-406f-8533-c4c016604a6b tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b6:30:ac,bridge_name='br-int',has_traffic_filtering=True,id=97833d7f-68d7-4a6a-a283-83744d5afd10,network=Network(cfb2308f-7c88-4329-a72d-4253cbbaca17),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97833d7f-68') {{(pid=85141) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 10:17:58 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:17:58 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap97833d7f-68, bridge=br-int, if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:17:58 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:17:58 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:17:58 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:17:58 user nova-compute[85141]: DEBUG nova.compute.manager [req-5d1c0694-6861-40b7-90f9-5aa22c64d07d req-0a4538e7-bbba-4e3f-b0c1-ef101897d329 service nova] [instance: 0c359f00-f4b7-43c3-8454-364842893779] Received event network-vif-plugged-97833d7f-68d7-4a6a-a283-83744d5afd10 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:17:58 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-5d1c0694-6861-40b7-90f9-5aa22c64d07d req-0a4538e7-bbba-4e3f-b0c1-ef101897d329 service nova] Acquiring lock "0c359f00-f4b7-43c3-8454-364842893779-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:17:58 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-5d1c0694-6861-40b7-90f9-5aa22c64d07d req-0a4538e7-bbba-4e3f-b0c1-ef101897d329 service nova] Lock "0c359f00-f4b7-43c3-8454-364842893779-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:17:58 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-5d1c0694-6861-40b7-90f9-5aa22c64d07d req-0a4538e7-bbba-4e3f-b0c1-ef101897d329 service nova] Lock "0c359f00-f4b7-43c3-8454-364842893779-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:17:58 user nova-compute[85141]: DEBUG nova.compute.manager [req-5d1c0694-6861-40b7-90f9-5aa22c64d07d req-0a4538e7-bbba-4e3f-b0c1-ef101897d329 service nova] [instance: 0c359f00-f4b7-43c3-8454-364842893779] No waiting events found dispatching network-vif-plugged-97833d7f-68d7-4a6a-a283-83744d5afd10 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:17:58 user nova-compute[85141]: WARNING nova.compute.manager [req-5d1c0694-6861-40b7-90f9-5aa22c64d07d req-0a4538e7-bbba-4e3f-b0c1-ef101897d329 service nova] [instance: 0c359f00-f4b7-43c3-8454-364842893779] Received unexpected event network-vif-plugged-97833d7f-68d7-4a6a-a283-83744d5afd10 for instance with vm_state active and task_state deleting.
Nov 16 10:17:58 user nova-compute[85141]: DEBUG nova.compute.manager [req-5d1c0694-6861-40b7-90f9-5aa22c64d07d req-0a4538e7-bbba-4e3f-b0c1-ef101897d329 service nova] [instance: 0c359f00-f4b7-43c3-8454-364842893779] Received event network-vif-unplugged-da46c331-8f37-4473-9c17-7bcb1c691b65 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:17:58 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-5d1c0694-6861-40b7-90f9-5aa22c64d07d req-0a4538e7-bbba-4e3f-b0c1-ef101897d329 service nova] Acquiring lock "0c359f00-f4b7-43c3-8454-364842893779-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:17:58 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-5d1c0694-6861-40b7-90f9-5aa22c64d07d req-0a4538e7-bbba-4e3f-b0c1-ef101897d329 service nova] Lock "0c359f00-f4b7-43c3-8454-364842893779-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:17:58 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-5d1c0694-6861-40b7-90f9-5aa22c64d07d req-0a4538e7-bbba-4e3f-b0c1-ef101897d329 service nova] Lock "0c359f00-f4b7-43c3-8454-364842893779-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:17:58 user nova-compute[85141]: DEBUG nova.compute.manager [req-5d1c0694-6861-40b7-90f9-5aa22c64d07d req-0a4538e7-bbba-4e3f-b0c1-ef101897d329 service nova] [instance: 0c359f00-f4b7-43c3-8454-364842893779] No waiting events found dispatching network-vif-unplugged-da46c331-8f37-4473-9c17-7bcb1c691b65 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:17:58 user nova-compute[85141]: DEBUG nova.compute.manager [req-5d1c0694-6861-40b7-90f9-5aa22c64d07d req-0a4538e7-bbba-4e3f-b0c1-ef101897d329 service nova] [instance: 0c359f00-f4b7-43c3-8454-364842893779] Received event network-vif-unplugged-da46c331-8f37-4473-9c17-7bcb1c691b65 for instance with task_state deleting. {{(pid=85141) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 10:17:58 user nova-compute[85141]: DEBUG nova.compute.manager [req-5d1c0694-6861-40b7-90f9-5aa22c64d07d req-0a4538e7-bbba-4e3f-b0c1-ef101897d329 service nova] [instance: 0c359f00-f4b7-43c3-8454-364842893779] Received event network-vif-plugged-da46c331-8f37-4473-9c17-7bcb1c691b65 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:17:58 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-5d1c0694-6861-40b7-90f9-5aa22c64d07d req-0a4538e7-bbba-4e3f-b0c1-ef101897d329 service nova] Acquiring lock "0c359f00-f4b7-43c3-8454-364842893779-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:17:58 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-5d1c0694-6861-40b7-90f9-5aa22c64d07d req-0a4538e7-bbba-4e3f-b0c1-ef101897d329 service nova] Lock "0c359f00-f4b7-43c3-8454-364842893779-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:17:58 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-5d1c0694-6861-40b7-90f9-5aa22c64d07d req-0a4538e7-bbba-4e3f-b0c1-ef101897d329 service nova] Lock "0c359f00-f4b7-43c3-8454-364842893779-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.009s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:17:58 user nova-compute[85141]: DEBUG nova.compute.manager [req-5d1c0694-6861-40b7-90f9-5aa22c64d07d req-0a4538e7-bbba-4e3f-b0c1-ef101897d329 service nova] [instance: 0c359f00-f4b7-43c3-8454-364842893779] No waiting events found dispatching network-vif-plugged-da46c331-8f37-4473-9c17-7bcb1c691b65 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:17:58 user nova-compute[85141]: WARNING nova.compute.manager [req-5d1c0694-6861-40b7-90f9-5aa22c64d07d req-0a4538e7-bbba-4e3f-b0c1-ef101897d329 service nova] [instance: 0c359f00-f4b7-43c3-8454-364842893779] Received unexpected event network-vif-plugged-da46c331-8f37-4473-9c17-7bcb1c691b65 for instance with vm_state active and task_state deleting.
Nov 16 10:17:58 user nova-compute[85141]: DEBUG nova.compute.manager [req-5d1c0694-6861-40b7-90f9-5aa22c64d07d req-0a4538e7-bbba-4e3f-b0c1-ef101897d329 service nova] [instance: 0c359f00-f4b7-43c3-8454-364842893779] Received event network-vif-unplugged-5b1acf97-626c-4014-b463-5b4455f0f1e6 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:17:58 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-5d1c0694-6861-40b7-90f9-5aa22c64d07d req-0a4538e7-bbba-4e3f-b0c1-ef101897d329 service nova] Acquiring lock "0c359f00-f4b7-43c3-8454-364842893779-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:17:58 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-5d1c0694-6861-40b7-90f9-5aa22c64d07d req-0a4538e7-bbba-4e3f-b0c1-ef101897d329 service nova] Lock "0c359f00-f4b7-43c3-8454-364842893779-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:17:58 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-5d1c0694-6861-40b7-90f9-5aa22c64d07d req-0a4538e7-bbba-4e3f-b0c1-ef101897d329 service nova] Lock "0c359f00-f4b7-43c3-8454-364842893779-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:17:58 user nova-compute[85141]: DEBUG nova.compute.manager [req-5d1c0694-6861-40b7-90f9-5aa22c64d07d req-0a4538e7-bbba-4e3f-b0c1-ef101897d329 service nova] [instance: 0c359f00-f4b7-43c3-8454-364842893779] No waiting events found dispatching network-vif-unplugged-5b1acf97-626c-4014-b463-5b4455f0f1e6 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:17:58 user nova-compute[85141]: DEBUG nova.compute.manager [req-5d1c0694-6861-40b7-90f9-5aa22c64d07d req-0a4538e7-bbba-4e3f-b0c1-ef101897d329 service nova] [instance: 0c359f00-f4b7-43c3-8454-364842893779] Received event network-vif-unplugged-5b1acf97-626c-4014-b463-5b4455f0f1e6 for instance with task_state deleting. {{(pid=85141) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 10:17:58 user nova-compute[85141]: DEBUG nova.compute.manager [req-5d1c0694-6861-40b7-90f9-5aa22c64d07d req-0a4538e7-bbba-4e3f-b0c1-ef101897d329 service nova] [instance: 0c359f00-f4b7-43c3-8454-364842893779] Received event network-vif-plugged-5b1acf97-626c-4014-b463-5b4455f0f1e6 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:17:58 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-5d1c0694-6861-40b7-90f9-5aa22c64d07d req-0a4538e7-bbba-4e3f-b0c1-ef101897d329 service nova] Acquiring lock "0c359f00-f4b7-43c3-8454-364842893779-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:17:58 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-5d1c0694-6861-40b7-90f9-5aa22c64d07d req-0a4538e7-bbba-4e3f-b0c1-ef101897d329 service nova] Lock "0c359f00-f4b7-43c3-8454-364842893779-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:17:58 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-5d1c0694-6861-40b7-90f9-5aa22c64d07d req-0a4538e7-bbba-4e3f-b0c1-ef101897d329 service nova] Lock "0c359f00-f4b7-43c3-8454-364842893779-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:17:58 user nova-compute[85141]: DEBUG nova.compute.manager [req-5d1c0694-6861-40b7-90f9-5aa22c64d07d req-0a4538e7-bbba-4e3f-b0c1-ef101897d329 service nova] [instance: 0c359f00-f4b7-43c3-8454-364842893779] No waiting events found dispatching network-vif-plugged-5b1acf97-626c-4014-b463-5b4455f0f1e6 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:17:58 user nova-compute[85141]: WARNING nova.compute.manager [req-5d1c0694-6861-40b7-90f9-5aa22c64d07d req-0a4538e7-bbba-4e3f-b0c1-ef101897d329 service nova] [instance: 0c359f00-f4b7-43c3-8454-364842893779] Received unexpected event network-vif-plugged-5b1acf97-626c-4014-b463-5b4455f0f1e6 for instance with vm_state active and task_state deleting.
Nov 16 10:17:58 user nova-compute[85141]: DEBUG nova.compute.manager [req-5d1c0694-6861-40b7-90f9-5aa22c64d07d req-0a4538e7-bbba-4e3f-b0c1-ef101897d329 service nova] [instance: 0c359f00-f4b7-43c3-8454-364842893779] Received event network-vif-unplugged-6d48ae8e-004c-459d-ad7c-081cc9228fee {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:17:58 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-5d1c0694-6861-40b7-90f9-5aa22c64d07d req-0a4538e7-bbba-4e3f-b0c1-ef101897d329 service nova] Acquiring lock "0c359f00-f4b7-43c3-8454-364842893779-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:17:58 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-5d1c0694-6861-40b7-90f9-5aa22c64d07d req-0a4538e7-bbba-4e3f-b0c1-ef101897d329 service nova] Lock "0c359f00-f4b7-43c3-8454-364842893779-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:17:58 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-5d1c0694-6861-40b7-90f9-5aa22c64d07d req-0a4538e7-bbba-4e3f-b0c1-ef101897d329 service nova] Lock "0c359f00-f4b7-43c3-8454-364842893779-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:17:58 user nova-compute[85141]: DEBUG nova.compute.manager [req-5d1c0694-6861-40b7-90f9-5aa22c64d07d req-0a4538e7-bbba-4e3f-b0c1-ef101897d329 service nova] [instance: 0c359f00-f4b7-43c3-8454-364842893779] No waiting events found dispatching network-vif-unplugged-6d48ae8e-004c-459d-ad7c-081cc9228fee {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:17:58 user nova-compute[85141]: DEBUG nova.compute.manager [req-5d1c0694-6861-40b7-90f9-5aa22c64d07d req-0a4538e7-bbba-4e3f-b0c1-ef101897d329 service nova] [instance: 0c359f00-f4b7-43c3-8454-364842893779] Received event network-vif-unplugged-6d48ae8e-004c-459d-ad7c-081cc9228fee for instance with task_state deleting. {{(pid=85141) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 10:17:58 user nova-compute[85141]: DEBUG nova.compute.manager [req-5d1c0694-6861-40b7-90f9-5aa22c64d07d req-0a4538e7-bbba-4e3f-b0c1-ef101897d329 service nova] [instance: 0c359f00-f4b7-43c3-8454-364842893779] Received event network-vif-plugged-6d48ae8e-004c-459d-ad7c-081cc9228fee {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:17:58 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-5d1c0694-6861-40b7-90f9-5aa22c64d07d req-0a4538e7-bbba-4e3f-b0c1-ef101897d329 service nova] Acquiring lock "0c359f00-f4b7-43c3-8454-364842893779-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:17:58 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-5d1c0694-6861-40b7-90f9-5aa22c64d07d req-0a4538e7-bbba-4e3f-b0c1-ef101897d329 service nova] Lock "0c359f00-f4b7-43c3-8454-364842893779-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:17:58 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-5d1c0694-6861-40b7-90f9-5aa22c64d07d req-0a4538e7-bbba-4e3f-b0c1-ef101897d329 service nova] Lock "0c359f00-f4b7-43c3-8454-364842893779-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:17:58 user nova-compute[85141]: DEBUG nova.compute.manager [req-5d1c0694-6861-40b7-90f9-5aa22c64d07d req-0a4538e7-bbba-4e3f-b0c1-ef101897d329 service nova] [instance: 0c359f00-f4b7-43c3-8454-364842893779] No waiting events found dispatching network-vif-plugged-6d48ae8e-004c-459d-ad7c-081cc9228fee {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:17:58 user nova-compute[85141]: WARNING nova.compute.manager [req-5d1c0694-6861-40b7-90f9-5aa22c64d07d req-0a4538e7-bbba-4e3f-b0c1-ef101897d329 service nova] [instance: 0c359f00-f4b7-43c3-8454-364842893779] Received unexpected event network-vif-plugged-6d48ae8e-004c-459d-ad7c-081cc9228fee for instance with vm_state active and task_state deleting.
Nov 16 10:17:58 user nova-compute[85141]: DEBUG nova.compute.manager [req-5d1c0694-6861-40b7-90f9-5aa22c64d07d req-0a4538e7-bbba-4e3f-b0c1-ef101897d329 service nova] [instance: 0c359f00-f4b7-43c3-8454-364842893779] Received event network-vif-unplugged-450233b4-a16d-4b2d-bc6a-a87736db7ff4 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:17:58 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-5d1c0694-6861-40b7-90f9-5aa22c64d07d req-0a4538e7-bbba-4e3f-b0c1-ef101897d329 service nova] Acquiring lock "0c359f00-f4b7-43c3-8454-364842893779-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:17:58 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-5d1c0694-6861-40b7-90f9-5aa22c64d07d req-0a4538e7-bbba-4e3f-b0c1-ef101897d329 service nova] Lock "0c359f00-f4b7-43c3-8454-364842893779-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:17:58 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-5d1c0694-6861-40b7-90f9-5aa22c64d07d req-0a4538e7-bbba-4e3f-b0c1-ef101897d329 service nova] Lock "0c359f00-f4b7-43c3-8454-364842893779-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:17:58 user nova-compute[85141]: DEBUG nova.compute.manager [req-5d1c0694-6861-40b7-90f9-5aa22c64d07d req-0a4538e7-bbba-4e3f-b0c1-ef101897d329 service nova] [instance: 0c359f00-f4b7-43c3-8454-364842893779] No waiting events found dispatching network-vif-unplugged-450233b4-a16d-4b2d-bc6a-a87736db7ff4 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:17:58 user nova-compute[85141]: DEBUG nova.compute.manager [req-5d1c0694-6861-40b7-90f9-5aa22c64d07d req-0a4538e7-bbba-4e3f-b0c1-ef101897d329 service nova] [instance: 0c359f00-f4b7-43c3-8454-364842893779] Received event network-vif-unplugged-450233b4-a16d-4b2d-bc6a-a87736db7ff4 for instance with task_state deleting. {{(pid=85141) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 10:17:58 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:17:58 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:17:58 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f5b71170-f99d-486c-8ead-81b60fc92265) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:17:58 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:17:58 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:17:58 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:17:58 user nova-compute[85141]: INFO os_vif [None req-788b2849-eb9d-406f-8533-c4c016604a6b tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b6:30:ac,bridge_name='br-int',has_traffic_filtering=True,id=97833d7f-68d7-4a6a-a283-83744d5afd10,network=Network(cfb2308f-7c88-4329-a72d-4253cbbaca17),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97833d7f-68')
Nov 16 10:17:58 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-788b2849-eb9d-406f-8533-c4c016604a6b tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T10:16:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2082484665',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2082484665',id=20,image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKrh2Bof78f1GbJ8gbebS4oyTSP8WglgJTFEydBYPe1tDZFGM71mwkIVvhvKHeqCxlHAP/OJrMQQa+0/ZND/hwmjTMgKHnoGjCJWqCZRpPKiQjDx27A4g/dcEbVlvqH96g==',key_name='tempest-keypair-1313405448',keypairs=<?>,launch_index=0,launched_at=2023-11-16T10:16:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='92b768cf0f234b5da6d29450a58ce8e7',ramdisk_id='',reservation_id='r-lbhzqlsr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1698183890',owner_user_name='tempest-TaggedBootDevicesTest-1698183890-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T10:16:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9fd70ad0794943a7b93eced34e17aa4d',uuid=0c359f00-f4b7-43c3-8454-364842893779,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "da46c331-8f37-4473-9c17-7bcb1c691b65", "address": "fa:16:3e:c7:5e:17", "network": {"id": "90bcfce1-33ea-4029-aa72-93b729655e77", "bridge": "br-int", "label": "tempest-device-tagging-net1-660308139", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.209", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "92b768cf0f234b5da6d29450a58ce8e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda46c331-8f", "ovs_interfaceid": "da46c331-8f37-4473-9c17-7bcb1c691b65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=85141) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 10:17:58 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-788b2849-eb9d-406f-8533-c4c016604a6b tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] Converting VIF {"id": "da46c331-8f37-4473-9c17-7bcb1c691b65", "address": "fa:16:3e:c7:5e:17", "network": {"id": "90bcfce1-33ea-4029-aa72-93b729655e77", "bridge": "br-int", "label": "tempest-device-tagging-net1-660308139", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.209", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "92b768cf0f234b5da6d29450a58ce8e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda46c331-8f", "ovs_interfaceid": "da46c331-8f37-4473-9c17-7bcb1c691b65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:17:58 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-788b2849-eb9d-406f-8533-c4c016604a6b tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c7:5e:17,bridge_name='br-int',has_traffic_filtering=True,id=da46c331-8f37-4473-9c17-7bcb1c691b65,network=Network(90bcfce1-33ea-4029-aa72-93b729655e77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapda46c331-8f') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:17:58 user nova-compute[85141]: DEBUG os_vif [None req-788b2849-eb9d-406f-8533-c4c016604a6b tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:5e:17,bridge_name='br-int',has_traffic_filtering=True,id=da46c331-8f37-4473-9c17-7bcb1c691b65,network=Network(90bcfce1-33ea-4029-aa72-93b729655e77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapda46c331-8f') {{(pid=85141) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 10:17:58 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:17:58 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapda46c331-8f, bridge=br-int, if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:17:58 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:17:58 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:17:58 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:17:58 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:17:58 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d25c8c10-1b4e-4b08-8f3d-91e4add9ba15) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:17:58 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:17:58 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:17:58 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:17:58 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:17:58 user nova-compute[85141]: INFO os_vif [None req-788b2849-eb9d-406f-8533-c4c016604a6b tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:5e:17,bridge_name='br-int',has_traffic_filtering=True,id=da46c331-8f37-4473-9c17-7bcb1c691b65,network=Network(90bcfce1-33ea-4029-aa72-93b729655e77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapda46c331-8f')
Nov 16 10:17:58 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-788b2849-eb9d-406f-8533-c4c016604a6b tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T10:16:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2082484665',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2082484665',id=20,image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKrh2Bof78f1GbJ8gbebS4oyTSP8WglgJTFEydBYPe1tDZFGM71mwkIVvhvKHeqCxlHAP/OJrMQQa+0/ZND/hwmjTMgKHnoGjCJWqCZRpPKiQjDx27A4g/dcEbVlvqH96g==',key_name='tempest-keypair-1313405448',keypairs=<?>,launch_index=0,launched_at=2023-11-16T10:16:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='92b768cf0f234b5da6d29450a58ce8e7',ramdisk_id='',reservation_id='r-lbhzqlsr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1698183890',owner_user_name='tempest-TaggedBootDevicesTest-1698183890-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T10:16:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9fd70ad0794943a7b93eced34e17aa4d',uuid=0c359f00-f4b7-43c3-8454-364842893779,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5b1acf97-626c-4014-b463-5b4455f0f1e6", "address": "fa:16:3e:0b:c9:63", "network": {"id": "90bcfce1-33ea-4029-aa72-93b729655e77", "bridge": "br-int", "label": "tempest-device-tagging-net1-660308139", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.15", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "92b768cf0f234b5da6d29450a58ce8e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b1acf97-62", "ovs_interfaceid": "5b1acf97-626c-4014-b463-5b4455f0f1e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=85141) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 10:17:58 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-788b2849-eb9d-406f-8533-c4c016604a6b tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] Converting VIF {"id": "5b1acf97-626c-4014-b463-5b4455f0f1e6", "address": "fa:16:3e:0b:c9:63", "network": {"id": "90bcfce1-33ea-4029-aa72-93b729655e77", "bridge": "br-int", "label": "tempest-device-tagging-net1-660308139", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.15", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "92b768cf0f234b5da6d29450a58ce8e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b1acf97-62", "ovs_interfaceid": "5b1acf97-626c-4014-b463-5b4455f0f1e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:17:58 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-788b2849-eb9d-406f-8533-c4c016604a6b tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0b:c9:63,bridge_name='br-int',has_traffic_filtering=True,id=5b1acf97-626c-4014-b463-5b4455f0f1e6,network=Network(90bcfce1-33ea-4029-aa72-93b729655e77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5b1acf97-62') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:17:58 user nova-compute[85141]: DEBUG os_vif [None req-788b2849-eb9d-406f-8533-c4c016604a6b tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:c9:63,bridge_name='br-int',has_traffic_filtering=True,id=5b1acf97-626c-4014-b463-5b4455f0f1e6,network=Network(90bcfce1-33ea-4029-aa72-93b729655e77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5b1acf97-62') {{(pid=85141) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 10:17:58 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:17:58 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5b1acf97-62, bridge=br-int, if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:17:58 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:17:58 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:17:58 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:17:58 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:17:58 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:17:58 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:17:58 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=177396c6-6725-4fb3-bc93-e750e8686dea) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:17:58 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:17:58 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:17:58 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:17:58 user nova-compute[85141]: INFO os_vif [None req-788b2849-eb9d-406f-8533-c4c016604a6b tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:c9:63,bridge_name='br-int',has_traffic_filtering=True,id=5b1acf97-626c-4014-b463-5b4455f0f1e6,network=Network(90bcfce1-33ea-4029-aa72-93b729655e77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5b1acf97-62')
Nov 16 10:17:58 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-788b2849-eb9d-406f-8533-c4c016604a6b tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T10:16:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2082484665',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2082484665',id=20,image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKrh2Bof78f1GbJ8gbebS4oyTSP8WglgJTFEydBYPe1tDZFGM71mwkIVvhvKHeqCxlHAP/OJrMQQa+0/ZND/hwmjTMgKHnoGjCJWqCZRpPKiQjDx27A4g/dcEbVlvqH96g==',key_name='tempest-keypair-1313405448',keypairs=<?>,launch_index=0,launched_at=2023-11-16T10:16:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='92b768cf0f234b5da6d29450a58ce8e7',ramdisk_id='',reservation_id='r-lbhzqlsr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1698183890',owner_user_name='tempest-TaggedBootDevicesTest-1698183890-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T10:16:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9fd70ad0794943a7b93eced34e17aa4d',uuid=0c359f00-f4b7-43c3-8454-364842893779,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2243117f-44a8-4d51-8676-d67748b3c9aa", "address": "fa:16:3e:87:12:47", "network": {"id": "90bcfce1-33ea-4029-aa72-93b729655e77", "bridge": "br-int", "label": "tempest-device-tagging-net1-660308139", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.140", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "92b768cf0f234b5da6d29450a58ce8e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2243117f-44", "ovs_interfaceid": "2243117f-44a8-4d51-8676-d67748b3c9aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 10:17:58 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-788b2849-eb9d-406f-8533-c4c016604a6b tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] Converting VIF {"id": "2243117f-44a8-4d51-8676-d67748b3c9aa", "address": "fa:16:3e:87:12:47", "network": {"id": "90bcfce1-33ea-4029-aa72-93b729655e77", "bridge": "br-int", "label": "tempest-device-tagging-net1-660308139", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.140", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "92b768cf0f234b5da6d29450a58ce8e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2243117f-44", "ovs_interfaceid": "2243117f-44a8-4d51-8676-d67748b3c9aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:17:58 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-788b2849-eb9d-406f-8533-c4c016604a6b tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:12:47,bridge_name='br-int',has_traffic_filtering=True,id=2243117f-44a8-4d51-8676-d67748b3c9aa,network=Network(90bcfce1-33ea-4029-aa72-93b729655e77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2243117f-44') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:17:58 user nova-compute[85141]: DEBUG os_vif [None req-788b2849-eb9d-406f-8533-c4c016604a6b tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:12:47,bridge_name='br-int',has_traffic_filtering=True,id=2243117f-44a8-4d51-8676-d67748b3c9aa,network=Network(90bcfce1-33ea-4029-aa72-93b729655e77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2243117f-44') {{(pid=85141) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 10:17:58 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:17:58 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2243117f-44, bridge=br-int, if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:17:58 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:17:58 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:17:58 user nova-compute[85141]: DEBUG nova.compute.manager [req-440d6c86-b3ef-4cd1-97ef-f5f92d074679 req-fad94a01-efe3-43ce-80b9-3fe89cd87f7e service nova] [instance: 0c359f00-f4b7-43c3-8454-364842893779] Received event network-vif-plugged-2243117f-44a8-4d51-8676-d67748b3c9aa {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:17:58 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-440d6c86-b3ef-4cd1-97ef-f5f92d074679 req-fad94a01-efe3-43ce-80b9-3fe89cd87f7e service nova] Acquiring lock "0c359f00-f4b7-43c3-8454-364842893779-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:17:58 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-440d6c86-b3ef-4cd1-97ef-f5f92d074679 req-fad94a01-efe3-43ce-80b9-3fe89cd87f7e service nova] Lock "0c359f00-f4b7-43c3-8454-364842893779-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:17:58 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-440d6c86-b3ef-4cd1-97ef-f5f92d074679 req-fad94a01-efe3-43ce-80b9-3fe89cd87f7e service nova] Lock "0c359f00-f4b7-43c3-8454-364842893779-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:17:58 user nova-compute[85141]: DEBUG nova.compute.manager [req-440d6c86-b3ef-4cd1-97ef-f5f92d074679 req-fad94a01-efe3-43ce-80b9-3fe89cd87f7e service nova] [instance: 0c359f00-f4b7-43c3-8454-364842893779] No waiting events found dispatching network-vif-plugged-2243117f-44a8-4d51-8676-d67748b3c9aa {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:17:58 user nova-compute[85141]: WARNING nova.compute.manager [req-440d6c86-b3ef-4cd1-97ef-f5f92d074679 req-fad94a01-efe3-43ce-80b9-3fe89cd87f7e service nova] [instance: 0c359f00-f4b7-43c3-8454-364842893779] Received unexpected event network-vif-plugged-2243117f-44a8-4d51-8676-d67748b3c9aa for instance with vm_state active and task_state deleting.
Nov 16 10:17:58 user nova-compute[85141]: DEBUG nova.compute.manager [req-440d6c86-b3ef-4cd1-97ef-f5f92d074679 req-fad94a01-efe3-43ce-80b9-3fe89cd87f7e service nova] [instance: 0c359f00-f4b7-43c3-8454-364842893779] Received event network-vif-unplugged-8a0146a0-20fd-4879-be20-c8732bd6563c {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:17:58 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-440d6c86-b3ef-4cd1-97ef-f5f92d074679 req-fad94a01-efe3-43ce-80b9-3fe89cd87f7e service nova] Acquiring lock "0c359f00-f4b7-43c3-8454-364842893779-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:17:58 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-440d6c86-b3ef-4cd1-97ef-f5f92d074679 req-fad94a01-efe3-43ce-80b9-3fe89cd87f7e service nova] Lock "0c359f00-f4b7-43c3-8454-364842893779-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:17:58 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-440d6c86-b3ef-4cd1-97ef-f5f92d074679 req-fad94a01-efe3-43ce-80b9-3fe89cd87f7e service nova] Lock "0c359f00-f4b7-43c3-8454-364842893779-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:17:58 user nova-compute[85141]: DEBUG nova.compute.manager [req-440d6c86-b3ef-4cd1-97ef-f5f92d074679 req-fad94a01-efe3-43ce-80b9-3fe89cd87f7e service nova] [instance: 0c359f00-f4b7-43c3-8454-364842893779] No waiting events found dispatching network-vif-unplugged-8a0146a0-20fd-4879-be20-c8732bd6563c {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:17:58 user nova-compute[85141]: DEBUG nova.compute.manager [req-440d6c86-b3ef-4cd1-97ef-f5f92d074679 req-fad94a01-efe3-43ce-80b9-3fe89cd87f7e service nova] [instance: 0c359f00-f4b7-43c3-8454-364842893779] Received event network-vif-unplugged-8a0146a0-20fd-4879-be20-c8732bd6563c for instance with task_state deleting. {{(pid=85141) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 10:17:58 user nova-compute[85141]: DEBUG nova.compute.manager [req-440d6c86-b3ef-4cd1-97ef-f5f92d074679 req-fad94a01-efe3-43ce-80b9-3fe89cd87f7e service nova] [instance: 0c359f00-f4b7-43c3-8454-364842893779] Received event network-vif-plugged-8a0146a0-20fd-4879-be20-c8732bd6563c {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:17:58 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-440d6c86-b3ef-4cd1-97ef-f5f92d074679 req-fad94a01-efe3-43ce-80b9-3fe89cd87f7e service nova] Acquiring lock "0c359f00-f4b7-43c3-8454-364842893779-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:17:58 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-440d6c86-b3ef-4cd1-97ef-f5f92d074679 req-fad94a01-efe3-43ce-80b9-3fe89cd87f7e service nova] Lock "0c359f00-f4b7-43c3-8454-364842893779-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:17:58 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-440d6c86-b3ef-4cd1-97ef-f5f92d074679 req-fad94a01-efe3-43ce-80b9-3fe89cd87f7e service nova] Lock "0c359f00-f4b7-43c3-8454-364842893779-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:17:58 user nova-compute[85141]: DEBUG nova.compute.manager [req-440d6c86-b3ef-4cd1-97ef-f5f92d074679 req-fad94a01-efe3-43ce-80b9-3fe89cd87f7e service nova] [instance: 0c359f00-f4b7-43c3-8454-364842893779] No waiting events found dispatching network-vif-plugged-8a0146a0-20fd-4879-be20-c8732bd6563c {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:17:58 user nova-compute[85141]: WARNING nova.compute.manager [req-440d6c86-b3ef-4cd1-97ef-f5f92d074679 req-fad94a01-efe3-43ce-80b9-3fe89cd87f7e service nova] [instance: 0c359f00-f4b7-43c3-8454-364842893779] Received unexpected event network-vif-plugged-8a0146a0-20fd-4879-be20-c8732bd6563c for instance with vm_state active and task_state deleting.
Nov 16 10:17:58 user nova-compute[85141]: DEBUG nova.compute.manager [req-440d6c86-b3ef-4cd1-97ef-f5f92d074679 req-fad94a01-efe3-43ce-80b9-3fe89cd87f7e service nova] [instance: e88874fe-b0a6-4292-8832-023f95e4f53c] Received event network-vif-plugged-7bbea642-d504-433b-ae99-8e7159942751 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:17:58 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-440d6c86-b3ef-4cd1-97ef-f5f92d074679 req-fad94a01-efe3-43ce-80b9-3fe89cd87f7e service nova] Acquiring lock "e88874fe-b0a6-4292-8832-023f95e4f53c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:17:58 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-440d6c86-b3ef-4cd1-97ef-f5f92d074679 req-fad94a01-efe3-43ce-80b9-3fe89cd87f7e service nova] Lock "e88874fe-b0a6-4292-8832-023f95e4f53c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:17:58 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-440d6c86-b3ef-4cd1-97ef-f5f92d074679 req-fad94a01-efe3-43ce-80b9-3fe89cd87f7e service nova] Lock "e88874fe-b0a6-4292-8832-023f95e4f53c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:17:58 user nova-compute[85141]: DEBUG nova.compute.manager [req-440d6c86-b3ef-4cd1-97ef-f5f92d074679 req-fad94a01-efe3-43ce-80b9-3fe89cd87f7e service nova] [instance: e88874fe-b0a6-4292-8832-023f95e4f53c] No waiting events found dispatching network-vif-plugged-7bbea642-d504-433b-ae99-8e7159942751 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:17:58 user nova-compute[85141]: WARNING nova.compute.manager [req-440d6c86-b3ef-4cd1-97ef-f5f92d074679 req-fad94a01-efe3-43ce-80b9-3fe89cd87f7e service nova] [instance: e88874fe-b0a6-4292-8832-023f95e4f53c] Received unexpected event network-vif-plugged-7bbea642-d504-433b-ae99-8e7159942751 for instance with vm_state building and task_state spawning.
Nov 16 10:17:58 user nova-compute[85141]: DEBUG nova.compute.manager [req-440d6c86-b3ef-4cd1-97ef-f5f92d074679 req-fad94a01-efe3-43ce-80b9-3fe89cd87f7e service nova] [instance: e88874fe-b0a6-4292-8832-023f95e4f53c] Received event network-vif-plugged-7bbea642-d504-433b-ae99-8e7159942751 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:17:58 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-440d6c86-b3ef-4cd1-97ef-f5f92d074679 req-fad94a01-efe3-43ce-80b9-3fe89cd87f7e service nova] Acquiring lock "e88874fe-b0a6-4292-8832-023f95e4f53c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:17:58 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-440d6c86-b3ef-4cd1-97ef-f5f92d074679 req-fad94a01-efe3-43ce-80b9-3fe89cd87f7e service nova] Lock "e88874fe-b0a6-4292-8832-023f95e4f53c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:17:58 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-440d6c86-b3ef-4cd1-97ef-f5f92d074679 req-fad94a01-efe3-43ce-80b9-3fe89cd87f7e service nova] Lock "e88874fe-b0a6-4292-8832-023f95e4f53c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:17:58 user nova-compute[85141]: DEBUG nova.compute.manager [req-440d6c86-b3ef-4cd1-97ef-f5f92d074679 req-fad94a01-efe3-43ce-80b9-3fe89cd87f7e service nova] [instance: e88874fe-b0a6-4292-8832-023f95e4f53c] No waiting events found dispatching network-vif-plugged-7bbea642-d504-433b-ae99-8e7159942751 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:17:58 user nova-compute[85141]: WARNING nova.compute.manager [req-440d6c86-b3ef-4cd1-97ef-f5f92d074679 req-fad94a01-efe3-43ce-80b9-3fe89cd87f7e service nova] [instance: e88874fe-b0a6-4292-8832-023f95e4f53c] Received unexpected event network-vif-plugged-7bbea642-d504-433b-ae99-8e7159942751 for instance with vm_state building and task_state spawning.
Nov 16 10:17:59 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:17:59 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:17:59 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=620825e4-653e-488a-932b-826ca13c085a) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:17:59 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:17:59 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:17:59 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:17:59 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:17:59 user nova-compute[85141]: INFO os_vif [None req-788b2849-eb9d-406f-8533-c4c016604a6b tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:12:47,bridge_name='br-int',has_traffic_filtering=True,id=2243117f-44a8-4d51-8676-d67748b3c9aa,network=Network(90bcfce1-33ea-4029-aa72-93b729655e77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2243117f-44')
Nov 16 10:17:59 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-788b2849-eb9d-406f-8533-c4c016604a6b tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T10:16:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2082484665',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2082484665',id=20,image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKrh2Bof78f1GbJ8gbebS4oyTSP8WglgJTFEydBYPe1tDZFGM71mwkIVvhvKHeqCxlHAP/OJrMQQa+0/ZND/hwmjTMgKHnoGjCJWqCZRpPKiQjDx27A4g/dcEbVlvqH96g==',key_name='tempest-keypair-1313405448',keypairs=<?>,launch_index=0,launched_at=2023-11-16T10:16:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='92b768cf0f234b5da6d29450a58ce8e7',ramdisk_id='',reservation_id='r-lbhzqlsr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1698183890',owner_user_name='tempest-TaggedBootDevicesTest-1698183890-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T10:16:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9fd70ad0794943a7b93eced34e17aa4d',uuid=0c359f00-f4b7-43c3-8454-364842893779,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6d48ae8e-004c-459d-ad7c-081cc9228fee", "address": "fa:16:3e:49:c2:7d", "network": {"id": "90bcfce1-33ea-4029-aa72-93b729655e77", "bridge": "br-int", "label": "tempest-device-tagging-net1-660308139", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "92b768cf0f234b5da6d29450a58ce8e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d48ae8e-00", "ovs_interfaceid": "6d48ae8e-004c-459d-ad7c-081cc9228fee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 10:17:59 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-788b2849-eb9d-406f-8533-c4c016604a6b tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] Converting VIF {"id": "6d48ae8e-004c-459d-ad7c-081cc9228fee", "address": "fa:16:3e:49:c2:7d", "network": {"id": "90bcfce1-33ea-4029-aa72-93b729655e77", "bridge": "br-int", "label": "tempest-device-tagging-net1-660308139", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "92b768cf0f234b5da6d29450a58ce8e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d48ae8e-00", "ovs_interfaceid": "6d48ae8e-004c-459d-ad7c-081cc9228fee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:17:59 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-788b2849-eb9d-406f-8533-c4c016604a6b tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:49:c2:7d,bridge_name='br-int',has_traffic_filtering=True,id=6d48ae8e-004c-459d-ad7c-081cc9228fee,network=Network(90bcfce1-33ea-4029-aa72-93b729655e77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d48ae8e-00') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:17:59 user nova-compute[85141]: DEBUG os_vif [None req-788b2849-eb9d-406f-8533-c4c016604a6b tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:c2:7d,bridge_name='br-int',has_traffic_filtering=True,id=6d48ae8e-004c-459d-ad7c-081cc9228fee,network=Network(90bcfce1-33ea-4029-aa72-93b729655e77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d48ae8e-00') {{(pid=85141) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 10:17:59 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:17:59 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6d48ae8e-00, bridge=br-int, if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:17:59 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:17:59 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:17:59 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:17:59 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:17:59 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d277d787-19a2-4b42-bce5-2392609624d2) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:17:59 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:17:59 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:17:59 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:17:59 user nova-compute[85141]: INFO os_vif [None req-788b2849-eb9d-406f-8533-c4c016604a6b tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:c2:7d,bridge_name='br-int',has_traffic_filtering=True,id=6d48ae8e-004c-459d-ad7c-081cc9228fee,network=Network(90bcfce1-33ea-4029-aa72-93b729655e77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d48ae8e-00')
Nov 16 10:17:59 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-788b2849-eb9d-406f-8533-c4c016604a6b tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T10:16:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2082484665',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2082484665',id=20,image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKrh2Bof78f1GbJ8gbebS4oyTSP8WglgJTFEydBYPe1tDZFGM71mwkIVvhvKHeqCxlHAP/OJrMQQa+0/ZND/hwmjTMgKHnoGjCJWqCZRpPKiQjDx27A4g/dcEbVlvqH96g==',key_name='tempest-keypair-1313405448',keypairs=<?>,launch_index=0,launched_at=2023-11-16T10:16:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='92b768cf0f234b5da6d29450a58ce8e7',ramdisk_id='',reservation_id='r-lbhzqlsr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1698183890',owner_user_name='tempest-TaggedBootDevicesTest-1698183890-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T10:16:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9fd70ad0794943a7b93eced34e17aa4d',uuid=0c359f00-f4b7-43c3-8454-364842893779,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8a0146a0-20fd-4879-be20-c8732bd6563c", "address": "fa:16:3e:6d:38:4b", "network": {"id": "054ba1f8-e55e-4af1-a668-c4e247430926", "bridge": "br-int", "label": "tempest-device-tagging-net2-1758238013", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "92b768cf0f234b5da6d29450a58ce8e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a0146a0-20", "ovs_interfaceid": "8a0146a0-20fd-4879-be20-c8732bd6563c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 10:17:59 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-788b2849-eb9d-406f-8533-c4c016604a6b tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] Converting VIF {"id": "8a0146a0-20fd-4879-be20-c8732bd6563c", "address": "fa:16:3e:6d:38:4b", "network": {"id": "054ba1f8-e55e-4af1-a668-c4e247430926", "bridge": "br-int", "label": "tempest-device-tagging-net2-1758238013", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "92b768cf0f234b5da6d29450a58ce8e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a0146a0-20", "ovs_interfaceid": "8a0146a0-20fd-4879-be20-c8732bd6563c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:17:59 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-788b2849-eb9d-406f-8533-c4c016604a6b tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:38:4b,bridge_name='br-int',has_traffic_filtering=True,id=8a0146a0-20fd-4879-be20-c8732bd6563c,network=Network(054ba1f8-e55e-4af1-a668-c4e247430926),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a0146a0-20') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:17:59 user nova-compute[85141]: DEBUG os_vif [None req-788b2849-eb9d-406f-8533-c4c016604a6b tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:38:4b,bridge_name='br-int',has_traffic_filtering=True,id=8a0146a0-20fd-4879-be20-c8732bd6563c,network=Network(054ba1f8-e55e-4af1-a668-c4e247430926),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a0146a0-20') {{(pid=85141) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 10:17:59 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:17:59 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8a0146a0-20, bridge=br-int, if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:17:59 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:17:59 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:17:59 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:17:59 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:17:59 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=caa885ef-e504-4821-82a8-9c24bfbd7078) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:17:59 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:17:59 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:17:59 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:17:59 user nova-compute[85141]: INFO os_vif [None req-788b2849-eb9d-406f-8533-c4c016604a6b tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:38:4b,bridge_name='br-int',has_traffic_filtering=True,id=8a0146a0-20fd-4879-be20-c8732bd6563c,network=Network(054ba1f8-e55e-4af1-a668-c4e247430926),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a0146a0-20')
Nov 16 10:17:59 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-788b2849-eb9d-406f-8533-c4c016604a6b tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T10:16:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2082484665',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2082484665',id=20,image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKrh2Bof78f1GbJ8gbebS4oyTSP8WglgJTFEydBYPe1tDZFGM71mwkIVvhvKHeqCxlHAP/OJrMQQa+0/ZND/hwmjTMgKHnoGjCJWqCZRpPKiQjDx27A4g/dcEbVlvqH96g==',key_name='tempest-keypair-1313405448',keypairs=<?>,launch_index=0,launched_at=2023-11-16T10:16:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='92b768cf0f234b5da6d29450a58ce8e7',ramdisk_id='',reservation_id='r-lbhzqlsr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1698183890',owner_user_name='tempest-TaggedBootDevicesTest-1698183890-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T10:16:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9fd70ad0794943a7b93eced34e17aa4d',uuid=0c359f00-f4b7-43c3-8454-364842893779,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "450233b4-a16d-4b2d-bc6a-a87736db7ff4", "address": "fa:16:3e:fe:ae:28", "network": {"id": "054ba1f8-e55e-4af1-a668-c4e247430926", "bridge": "br-int", "label": "tempest-device-tagging-net2-1758238013", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "92b768cf0f234b5da6d29450a58ce8e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap450233b4-a1", "ovs_interfaceid": "450233b4-a16d-4b2d-bc6a-a87736db7ff4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 10:17:59 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-788b2849-eb9d-406f-8533-c4c016604a6b tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] Converting VIF {"id": "450233b4-a16d-4b2d-bc6a-a87736db7ff4", "address": "fa:16:3e:fe:ae:28", "network": {"id": "054ba1f8-e55e-4af1-a668-c4e247430926", "bridge": "br-int", "label": "tempest-device-tagging-net2-1758238013", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "92b768cf0f234b5da6d29450a58ce8e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap450233b4-a1", "ovs_interfaceid": "450233b4-a16d-4b2d-bc6a-a87736db7ff4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:17:59 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-788b2849-eb9d-406f-8533-c4c016604a6b tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fe:ae:28,bridge_name='br-int',has_traffic_filtering=True,id=450233b4-a16d-4b2d-bc6a-a87736db7ff4,network=Network(054ba1f8-e55e-4af1-a668-c4e247430926),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap450233b4-a1') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:17:59 user nova-compute[85141]: DEBUG os_vif [None req-788b2849-eb9d-406f-8533-c4c016604a6b tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:ae:28,bridge_name='br-int',has_traffic_filtering=True,id=450233b4-a16d-4b2d-bc6a-a87736db7ff4,network=Network(054ba1f8-e55e-4af1-a668-c4e247430926),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap450233b4-a1') {{(pid=85141) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 10:17:59 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:17:59 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap450233b4-a1, bridge=br-int, if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:17:59 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:17:59 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:17:59 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:17:59 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=77d5fbb8-712b-4bed-ae1c-e5b0a22b4d66) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:17:59 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:17:59 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:17:59 user nova-compute[85141]: INFO os_vif [None req-788b2849-eb9d-406f-8533-c4c016604a6b tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:ae:28,bridge_name='br-int',has_traffic_filtering=True,id=450233b4-a16d-4b2d-bc6a-a87736db7ff4,network=Network(054ba1f8-e55e-4af1-a668-c4e247430926),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap450233b4-a1')
Nov 16 10:17:59 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-788b2849-eb9d-406f-8533-c4c016604a6b tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] [instance: 0c359f00-f4b7-43c3-8454-364842893779] calling os-brick to detach iSCSI Volume {{(pid=85141) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 10:17:59 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-788b2849-eb9d-406f-8533-c4c016604a6b tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51806b6080>, {'target_iqn': 'iqn.2010-10.org.openstack:1fa41a79-b1fc-4047-9ae9-f674f348378f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EgOvCfzd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 10:17:59 user nova-compute[85141]: WARNING os_brick.initiator.connectors.base [None req-788b2849-eb9d-406f-8533-c4c016604a6b tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 10:17:59 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-788b2849-eb9d-406f-8533-c4c016604a6b tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 10:17:59 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-788b2849-eb9d-406f-8533-c4c016604a6b tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 10:17:59 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:17:59 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:17:59 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c7aea2a-49c4-4907-9bcb-d7976fe0e58f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:030d6106-e7ec-4eb8-9642-b64a4685f6bb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ef975afa-7705-454b-88d3-798b0a74dbb9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1fa41a79-b1fc-4047-9ae9-f674f348378f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:674f9ae8-6ab5-4ff2-b715-fe8807c34793\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:abda547a-8d00-4a02-a6e4-d0670e47815a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:17:59 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-788b2849-eb9d-406f-8533-c4c016604a6b tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 10:17:59 user nova-compute[85141]: No targets found.
Nov 16 10:17:59 user nova-compute[85141]: iSNS:
Nov 16 10:17:59 user nova-compute[85141]: No targets found.
Nov 16 10:17:59 user nova-compute[85141]: STATIC:
Nov 16 10:17:59 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:030d6106-e7ec-4eb8-9642-b64a4685f6bb
Nov 16 10:17:59 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:17:59 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:17:59 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee
Nov 16 10:17:59 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:17:59 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:17:59 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:ef975afa-7705-454b-88d3-798b0a74dbb9
Nov 16 10:17:59 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:17:59 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:17:59 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:1fa41a79-b1fc-4047-9ae9-f674f348378f
Nov 16 10:17:59 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:17:59 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:17:59 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:674f9ae8-6ab5-4ff2-b715-fe8807c34793
Nov 16 10:17:59 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:17:59 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:17:59 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:abda547a-8d00-4a02-a6e4-d0670e47815a
Nov 16 10:17:59 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:17:59 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:17:59 user nova-compute[85141]: FIRMWARE:
Nov 16 10:17:59 user nova-compute[85141]: No targets found.
Nov 16 10:17:59 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:17:59 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-788b2849-eb9d-406f-8533-c4c016604a6b tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 10:17:59 user nova-compute[85141]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 10:17:59 user nova-compute[85141]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=85141) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 10:17:59 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-788b2849-eb9d-406f-8533-c4c016604a6b tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1fa41a79-b1fc-4047-9ae9-f674f348378f', 0)] {{(pid=85141) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 10:17:59 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:17:59 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:17:59 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[25a347b5-d901-4830-bc91-21425c13341e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:030d6106-e7ec-4eb8-9642-b64a4685f6bb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1fa41a79-b1fc-4047-9ae9-f674f348378f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:674f9ae8-6ab5-4ff2-b715-fe8807c34793\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:abda547a-8d00-4a02-a6e4-d0670e47815a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef975afa-7705-454b-88d3-798b0a74dbb9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:17:59 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:17:59 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:17:59 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[67a61a32-40c6-4743-b721-99001c6a2d36]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fa41a79-b1fc-4047-9ae9-f674f348378f (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef975afa-7705-454b-88d3-798b0a74dbb9 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:030d6106-e7ec-4eb8-9642-b64a4685f6bb (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abda547a-8d00-4a02-a6e4-d0670e47815a (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:674f9ae8-6ab5-4ff2-b715-fe8807c34793 (non-flash)\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:17:59 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-788b2849-eb9d-406f-8533-c4c016604a6b tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)
Nov 16 10:17:59 user nova-compute[85141]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fa41a79-b1fc-4047-9ae9-f674f348378f (non-flash)
Nov 16 10:17:59 user nova-compute[85141]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef975afa-7705-454b-88d3-798b0a74dbb9 (non-flash)
Nov 16 10:17:59 user nova-compute[85141]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:030d6106-e7ec-4eb8-9642-b64a4685f6bb (non-flash)
Nov 16 10:17:59 user nova-compute[85141]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abda547a-8d00-4a02-a6e4-d0670e47815a (non-flash)
Nov 16 10:17:59 user nova-compute[85141]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:674f9ae8-6ab5-4ff2-b715-fe8807c34793 (non-flash)
Nov 16 10:17:59 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:17:59 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-788b2849-eb9d-406f-8533-c4c016604a6b tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)
Nov 16 10:17:59 user nova-compute[85141]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fa41a79-b1fc-4047-9ae9-f674f348378f (non-flash)
Nov 16 10:17:59 user nova-compute[85141]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef975afa-7705-454b-88d3-798b0a74dbb9 (non-flash)
Nov 16 10:17:59 user nova-compute[85141]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:030d6106-e7ec-4eb8-9642-b64a4685f6bb (non-flash)
Nov 16 10:17:59 user nova-compute[85141]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abda547a-8d00-4a02-a6e4-d0670e47815a (non-flash)
Nov 16 10:17:59 user nova-compute[85141]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:674f9ae8-6ab5-4ff2-b715-fe8807c34793 (non-flash)
Nov 16 10:17:59 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 10:17:59 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-788b2849-eb9d-406f-8533-c4c016604a6b tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f516072c9d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1fa41a79-b1fc-4047-9ae9-f674f348378f'): ({'sdb'}, set())}) {{(pid=85141) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 10:17:59 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-788b2849-eb9d-406f-8533-c4c016604a6b tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] Removing single pathed devices sdb {{(pid=85141) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 10:17:59 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:17:59 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:17:59 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[f66292ae-b5dc-4ed6-b284-1718524135ff]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:17:59 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:17:59 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.037s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:17:59 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7fe8855-d31c-418a-89ec-23c083801d3f]: (4, ('ok\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:17:59 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-788b2849-eb9d-406f-8533-c4c016604a6b tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] Flushing IO for device /dev/sdb {{(pid=85141) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 10:17:59 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:17:59 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:17:59 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3c0f37b-1bb6-4120-8406-b9d0c33945a7]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:17:59 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-788b2849-eb9d-406f-8533-c4c016604a6b tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=85141) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 10:17:59 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:17:59 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.033s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:17:59 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa2fd84e-ffba-40b3-bb81-75f9fe718ab8]: (4, ('1', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:17:59 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-788b2849-eb9d-406f-8533-c4c016604a6b tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=85141) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 10:17:59 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-788b2849-eb9d-406f-8533-c4c016604a6b tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] SCSI volumes sdb have been removed. {{(pid=85141) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 10:17:59 user nova-compute[85141]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26439313663636361', '/dev/disk/by-id/scsi-1SCST_BIOe9696dde-d916ccca7c238f3c', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_e9696dde') {{(pid=95342) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 16 10:17:59 user nova-compute[85141]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-26439313663636361
Nov 16 10:17:59 user nova-compute[85141]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIOe9696dde-d916ccca7c238f3c
Nov 16 10:17:59 user nova-compute[85141]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_e9696dde
Nov 16 10:17:59 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[7db2be9e-c6d0-4a93-9072-da3cacb32546]: (4, None) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:17:59 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-788b2849-eb9d-406f-8533-c4c016604a6b tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1fa41a79-b1fc-4047-9ae9-f674f348378f')] {{(pid=85141) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 10:17:59 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1fa41a79-b1fc-4047-9ae9-f674f348378f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:17:59 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1fa41a79-b1fc-4047-9ae9-f674f348378f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.035s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:17:59 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc2914db-458c-4cfb-b1eb-648de830cb17]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:17:59 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-788b2849-eb9d-406f-8533-c4c016604a6b tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:17:59 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1fa41a79-b1fc-4047-9ae9-f674f348378f -p 172.16.0.220:3260 --logout {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:17:59 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1fa41a79-b1fc-4047-9ae9-f674f348378f -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:17:59 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef15fd0c-5f01-4b07-99ba-2a1a371704d4]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:1fa41a79-b1fc-4047-9ae9-f674f348378f, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:1fa41a79-b1fc-4047-9ae9-f674f348378f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:17:59 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-788b2849-eb9d-406f-8533-c4c016604a6b tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:1fa41a79-b1fc-4047-9ae9-f674f348378f, portal: 172.16.0.220,3260]
Nov 16 10:17:59 user nova-compute[85141]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:1fa41a79-b1fc-4047-9ae9-f674f348378f, portal: 172.16.0.220,3260] successful.
Nov 16 10:17:59 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:17:59 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1fa41a79-b1fc-4047-9ae9-f674f348378f -p 172.16.0.220:3260 --op delete {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:17:59 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1fa41a79-b1fc-4047-9ae9-f674f348378f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:17:59 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[df2d7b2c-f1be-48ab-af5f-f34c25a8b95f]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:17:59 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-788b2849-eb9d-406f-8533-c4c016604a6b tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:17:59 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-788b2849-eb9d-406f-8533-c4c016604a6b tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.365s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 10:17:59 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-788b2849-eb9d-406f-8533-c4c016604a6b tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] <== disconnect_volume: return (366ms) None {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 10:17:59 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-788b2849-eb9d-406f-8533-c4c016604a6b tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] [instance: 0c359f00-f4b7-43c3-8454-364842893779] Disconnected iSCSI Volume {{(pid=85141) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 10:17:59 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-788b2849-eb9d-406f-8533-c4c016604a6b tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] [instance: 0c359f00-f4b7-43c3-8454-364842893779] calling os-brick to detach iSCSI Volume {{(pid=85141) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 10:17:59 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-788b2849-eb9d-406f-8533-c4c016604a6b tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51806b6080>, {'target_iqn': 'iqn.2010-10.org.openstack:ef975afa-7705-454b-88d3-798b0a74dbb9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KEWyzSCs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 10:17:59 user nova-compute[85141]: WARNING os_brick.initiator.connectors.base [None req-788b2849-eb9d-406f-8533-c4c016604a6b tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 10:17:59 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-788b2849-eb9d-406f-8533-c4c016604a6b tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 10:17:59 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-788b2849-eb9d-406f-8533-c4c016604a6b tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 10:17:59 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:17:59 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:17:59 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b86193f-e9ef-4afc-99c3-c8a42b22bf49]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:030d6106-e7ec-4eb8-9642-b64a4685f6bb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ef975afa-7705-454b-88d3-798b0a74dbb9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:674f9ae8-6ab5-4ff2-b715-fe8807c34793\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:abda547a-8d00-4a02-a6e4-d0670e47815a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:17:59 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-788b2849-eb9d-406f-8533-c4c016604a6b tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 10:17:59 user nova-compute[85141]: No targets found.
Nov 16 10:17:59 user nova-compute[85141]: iSNS:
Nov 16 10:17:59 user nova-compute[85141]: No targets found.
Nov 16 10:17:59 user nova-compute[85141]: STATIC:
Nov 16 10:17:59 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:030d6106-e7ec-4eb8-9642-b64a4685f6bb
Nov 16 10:17:59 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:17:59 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:17:59 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee
Nov 16 10:17:59 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:17:59 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:17:59 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:ef975afa-7705-454b-88d3-798b0a74dbb9
Nov 16 10:17:59 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:17:59 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:17:59 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:674f9ae8-6ab5-4ff2-b715-fe8807c34793
Nov 16 10:17:59 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:17:59 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:17:59 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:abda547a-8d00-4a02-a6e4-d0670e47815a
Nov 16 10:17:59 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:17:59 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:17:59 user nova-compute[85141]: FIRMWARE:
Nov 16 10:17:59 user nova-compute[85141]: No targets found.
Nov 16 10:17:59 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:17:59 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-788b2849-eb9d-406f-8533-c4c016604a6b tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 10:17:59 user nova-compute[85141]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 10:17:59 user nova-compute[85141]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=85141) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 10:17:59 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-788b2849-eb9d-406f-8533-c4c016604a6b tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ef975afa-7705-454b-88d3-798b0a74dbb9', 0)] {{(pid=85141) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 10:17:59 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:17:59 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:17:59 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[07842720-8663-4fb5-8dcc-bed18124409e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:030d6106-e7ec-4eb8-9642-b64a4685f6bb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:674f9ae8-6ab5-4ff2-b715-fe8807c34793\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:abda547a-8d00-4a02-a6e4-d0670e47815a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef975afa-7705-454b-88d3-798b0a74dbb9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:17:59 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:17:59 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:17:59 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[41f8059e-cd0d-4a5c-ae80-36540578a794]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef975afa-7705-454b-88d3-798b0a74dbb9 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:030d6106-e7ec-4eb8-9642-b64a4685f6bb (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abda547a-8d00-4a02-a6e4-d0670e47815a (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:674f9ae8-6ab5-4ff2-b715-fe8807c34793 (non-flash)\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:17:59 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-788b2849-eb9d-406f-8533-c4c016604a6b tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)
Nov 16 10:17:59 user nova-compute[85141]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef975afa-7705-454b-88d3-798b0a74dbb9 (non-flash)
Nov 16 10:17:59 user nova-compute[85141]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:030d6106-e7ec-4eb8-9642-b64a4685f6bb (non-flash)
Nov 16 10:17:59 user nova-compute[85141]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abda547a-8d00-4a02-a6e4-d0670e47815a (non-flash)
Nov 16 10:17:59 user nova-compute[85141]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:674f9ae8-6ab5-4ff2-b715-fe8807c34793 (non-flash)
Nov 16 10:17:59 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:17:59 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-788b2849-eb9d-406f-8533-c4c016604a6b tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)
Nov 16 10:17:59 user nova-compute[85141]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef975afa-7705-454b-88d3-798b0a74dbb9 (non-flash)
Nov 16 10:17:59 user nova-compute[85141]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:030d6106-e7ec-4eb8-9642-b64a4685f6bb (non-flash)
Nov 16 10:17:59 user nova-compute[85141]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abda547a-8d00-4a02-a6e4-d0670e47815a (non-flash)
Nov 16 10:17:59 user nova-compute[85141]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:674f9ae8-6ab5-4ff2-b715-fe8807c34793 (non-flash)
Nov 16 10:17:59 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 10:17:59 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-788b2849-eb9d-406f-8533-c4c016604a6b tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f516072c9d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ef975afa-7705-454b-88d3-798b0a74dbb9'): ({'sdd'}, set())}) {{(pid=85141) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 10:17:59 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-788b2849-eb9d-406f-8533-c4c016604a6b tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] Removing single pathed devices sdd {{(pid=85141) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 10:17:59 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:17:59 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:17:59 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[d12cc7a3-05b8-4102-8bc8-d73893a074cf]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:17:59 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:17:59 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.022s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:17:59 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa149fd3-7a54-40a2-ba2e-fe7426994af7]: (4, ('ok\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:17:59 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-788b2849-eb9d-406f-8533-c4c016604a6b tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] Flushing IO for device /dev/sdd {{(pid=85141) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 10:17:59 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:17:59 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:17:59 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4eb8c48-8608-4074-aea9-1befb971722d]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:17:59 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-788b2849-eb9d-406f-8533-c4c016604a6b tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=85141) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 10:17:59 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:17:59 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:17:59 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.035s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:17:59 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[40988da3-c65b-4a54-ab88-914f18902b63]: (4, ('1', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:17:59 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-788b2849-eb9d-406f-8533-c4c016604a6b tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=85141) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 10:17:59 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-788b2849-eb9d-406f-8533-c4c016604a6b tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] SCSI volumes sdd have been removed. {{(pid=85141) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 10:17:59 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-788b2849-eb9d-406f-8533-c4c016604a6b tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ef975afa-7705-454b-88d3-798b0a74dbb9')] {{(pid=85141) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 10:17:59 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:17:59 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef975afa-7705-454b-88d3-798b0a74dbb9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:17:59 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef975afa-7705-454b-88d3-798b0a74dbb9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:17:59 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b1bb94d-7a67-4d01-9d7f-dde6ed66c0e9]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:17:59 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-788b2849-eb9d-406f-8533-c4c016604a6b tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:17:59 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef975afa-7705-454b-88d3-798b0a74dbb9 -p 172.16.0.220:3260 --logout {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:17:59 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:17:59 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef975afa-7705-454b-88d3-798b0a74dbb9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:17:59 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb03c4d1-ba01-4678-b2bc-f927dbab3ac6]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:ef975afa-7705-454b-88d3-798b0a74dbb9, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:ef975afa-7705-454b-88d3-798b0a74dbb9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:17:59 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-788b2849-eb9d-406f-8533-c4c016604a6b tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:ef975afa-7705-454b-88d3-798b0a74dbb9, portal: 172.16.0.220,3260]
Nov 16 10:17:59 user nova-compute[85141]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:ef975afa-7705-454b-88d3-798b0a74dbb9, portal: 172.16.0.220,3260] successful.
Nov 16 10:17:59 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:17:59 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef975afa-7705-454b-88d3-798b0a74dbb9 -p 172.16.0.220:3260 --op delete {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:17:59 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef975afa-7705-454b-88d3-798b0a74dbb9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:17:59 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6e53a8e-caa5-4c83-9d12-02d50e5a42f3]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:17:59 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-788b2849-eb9d-406f-8533-c4c016604a6b tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:17:59 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-788b2849-eb9d-406f-8533-c4c016604a6b tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.329s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 10:17:59 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-788b2849-eb9d-406f-8533-c4c016604a6b tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] <== disconnect_volume: return (329ms) None {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 10:17:59 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-788b2849-eb9d-406f-8533-c4c016604a6b tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] [instance: 0c359f00-f4b7-43c3-8454-364842893779] Disconnected iSCSI Volume {{(pid=85141) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 10:17:59 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-788b2849-eb9d-406f-8533-c4c016604a6b tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] [instance: 0c359f00-f4b7-43c3-8454-364842893779] calling os-brick to detach iSCSI Volume {{(pid=85141) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 10:17:59 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-788b2849-eb9d-406f-8533-c4c016604a6b tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51806b6080>, {'target_iqn': 'iqn.2010-10.org.openstack:030d6106-e7ec-4eb8-9642-b64a4685f6bb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vPKFhqwg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 10:17:59 user nova-compute[85141]: WARNING os_brick.initiator.connectors.base [None req-788b2849-eb9d-406f-8533-c4c016604a6b tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 10:17:59 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-788b2849-eb9d-406f-8533-c4c016604a6b tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 10:17:59 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-788b2849-eb9d-406f-8533-c4c016604a6b tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 10:17:59 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:17:59 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:17:59 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[91eea17a-0d3a-4074-82c2-e3d3fe879638]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:030d6106-e7ec-4eb8-9642-b64a4685f6bb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:674f9ae8-6ab5-4ff2-b715-fe8807c34793\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:abda547a-8d00-4a02-a6e4-d0670e47815a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:17:59 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-788b2849-eb9d-406f-8533-c4c016604a6b tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 10:17:59 user nova-compute[85141]: No targets found.
Nov 16 10:17:59 user nova-compute[85141]: iSNS:
Nov 16 10:17:59 user nova-compute[85141]: No targets found.
Nov 16 10:17:59 user nova-compute[85141]: STATIC:
Nov 16 10:17:59 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:030d6106-e7ec-4eb8-9642-b64a4685f6bb
Nov 16 10:17:59 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:17:59 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:17:59 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee
Nov 16 10:17:59 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:17:59 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:17:59 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:674f9ae8-6ab5-4ff2-b715-fe8807c34793
Nov 16 10:17:59 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:17:59 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:17:59 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:abda547a-8d00-4a02-a6e4-d0670e47815a
Nov 16 10:17:59 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:17:59 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:17:59 user nova-compute[85141]: FIRMWARE:
Nov 16 10:17:59 user nova-compute[85141]: No targets found.
Nov 16 10:17:59 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:17:59 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-788b2849-eb9d-406f-8533-c4c016604a6b tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 10:17:59 user nova-compute[85141]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 10:17:59 user nova-compute[85141]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=85141) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 10:17:59 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-788b2849-eb9d-406f-8533-c4c016604a6b tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:030d6106-e7ec-4eb8-9642-b64a4685f6bb', 0)] {{(pid=85141) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 10:17:59 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:18:00 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:18:00 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[111010d4-f5ea-49b0-b498-659379efe22e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:030d6106-e7ec-4eb8-9642-b64a4685f6bb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:674f9ae8-6ab5-4ff2-b715-fe8807c34793\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:abda547a-8d00-4a02-a6e4-d0670e47815a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:18:00 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:18:00 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:18:00 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7f8b11a-d756-450f-b6d1-aefa2c081b7d]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:030d6106-e7ec-4eb8-9642-b64a4685f6bb (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abda547a-8d00-4a02-a6e4-d0670e47815a (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:674f9ae8-6ab5-4ff2-b715-fe8807c34793 (non-flash)\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:18:00 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-788b2849-eb9d-406f-8533-c4c016604a6b tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)
Nov 16 10:18:00 user nova-compute[85141]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:030d6106-e7ec-4eb8-9642-b64a4685f6bb (non-flash)
Nov 16 10:18:00 user nova-compute[85141]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abda547a-8d00-4a02-a6e4-d0670e47815a (non-flash)
Nov 16 10:18:00 user nova-compute[85141]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:674f9ae8-6ab5-4ff2-b715-fe8807c34793 (non-flash)
Nov 16 10:18:00 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:18:00 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-788b2849-eb9d-406f-8533-c4c016604a6b tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)
Nov 16 10:18:00 user nova-compute[85141]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:030d6106-e7ec-4eb8-9642-b64a4685f6bb (non-flash)
Nov 16 10:18:00 user nova-compute[85141]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abda547a-8d00-4a02-a6e4-d0670e47815a (non-flash)
Nov 16 10:18:00 user nova-compute[85141]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:674f9ae8-6ab5-4ff2-b715-fe8807c34793 (non-flash)
Nov 16 10:18:00 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 10:18:00 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-788b2849-eb9d-406f-8533-c4c016604a6b tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f516072c9d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:030d6106-e7ec-4eb8-9642-b64a4685f6bb'): ({'sde'}, set())}) {{(pid=85141) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 10:18:00 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-788b2849-eb9d-406f-8533-c4c016604a6b tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] Removing single pathed devices sde {{(pid=85141) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 10:18:00 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:18:00 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:18:00 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1766db8-9e5c-438a-983e-fd15e0d91de4]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:18:00 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:18:00 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.017s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:18:00 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[5de70354-e49b-4a23-8693-9eb64bc01ef8]: (4, ('ok\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:18:00 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-788b2849-eb9d-406f-8533-c4c016604a6b tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] Flushing IO for device /dev/sde {{(pid=85141) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 10:18:00 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:18:00 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.012s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:18:00 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8ddf068-5791-4f07-842c-4aeafcc9a552]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:18:00 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-788b2849-eb9d-406f-8533-c4c016604a6b tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=85141) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 10:18:00 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:18:00 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.036s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:18:00 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8a3ad73-43e5-4615-9bdf-65cb435c6ea2]: (4, ('1', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:18:00 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-788b2849-eb9d-406f-8533-c4c016604a6b tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=85141) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 10:18:00 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-788b2849-eb9d-406f-8533-c4c016604a6b tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] SCSI volumes sde have been removed. {{(pid=85141) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 10:18:00 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-788b2849-eb9d-406f-8533-c4c016604a6b tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:030d6106-e7ec-4eb8-9642-b64a4685f6bb')] {{(pid=85141) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 10:18:00 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:030d6106-e7ec-4eb8-9642-b64a4685f6bb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:18:00 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:030d6106-e7ec-4eb8-9642-b64a4685f6bb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:18:00 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5be38cb-7ca0-459c-8fd4-881a2234aeba]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:18:00 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-788b2849-eb9d-406f-8533-c4c016604a6b tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:18:00 user nova-compute[85141]: DEBUG nova.compute.manager [None req-2568174c-2593-4746-896f-77f0cc2d6c34 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] [instance: bff3a84b-6ab5-4256-8a04-2d21a4ba20b3] Instance event wait completed in 0 seconds for  {{(pid=85141) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 10:18:00 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-2568174c-2593-4746-896f-77f0cc2d6c34 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] [instance: bff3a84b-6ab5-4256-8a04-2d21a4ba20b3] Guest created on hypervisor {{(pid=85141) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 10:18:00 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:030d6106-e7ec-4eb8-9642-b64a4685f6bb -p 172.16.0.220:3260 --logout {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:18:00 user nova-compute[85141]: DEBUG nova.compute.manager [None req-fa51855c-8493-4f5f-9f40-7d0cf0320675 tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] [instance: e88874fe-b0a6-4292-8832-023f95e4f53c] Instance event wait completed in 0 seconds for  {{(pid=85141) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 10:18:00 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-fa51855c-8493-4f5f-9f40-7d0cf0320675 tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] [instance: e88874fe-b0a6-4292-8832-023f95e4f53c] Guest created on hypervisor {{(pid=85141) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 10:18:00 user nova-compute[85141]: INFO nova.virt.libvirt.driver [-] [instance: bff3a84b-6ab5-4256-8a04-2d21a4ba20b3] Instance spawned successfully.
Nov 16 10:18:00 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-2568174c-2593-4746-896f-77f0cc2d6c34 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] [instance: bff3a84b-6ab5-4256-8a04-2d21a4ba20b3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 10:18:00 user nova-compute[85141]: INFO nova.virt.libvirt.driver [-] [instance: e88874fe-b0a6-4292-8832-023f95e4f53c] Instance spawned successfully.
Nov 16 10:18:00 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-fa51855c-8493-4f5f-9f40-7d0cf0320675 tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] [instance: e88874fe-b0a6-4292-8832-023f95e4f53c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 10:18:00 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-2568174c-2593-4746-896f-77f0cc2d6c34 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] [instance: bff3a84b-6ab5-4256-8a04-2d21a4ba20b3] Found default for hw_cdrom_bus of ide {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:18:00 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-2568174c-2593-4746-896f-77f0cc2d6c34 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] [instance: bff3a84b-6ab5-4256-8a04-2d21a4ba20b3] Found default for hw_disk_bus of virtio {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:18:00 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-2568174c-2593-4746-896f-77f0cc2d6c34 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] [instance: bff3a84b-6ab5-4256-8a04-2d21a4ba20b3] Found default for hw_input_bus of None {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:18:00 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-2568174c-2593-4746-896f-77f0cc2d6c34 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] [instance: bff3a84b-6ab5-4256-8a04-2d21a4ba20b3] Found default for hw_pointer_model of None {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:18:00 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-2568174c-2593-4746-896f-77f0cc2d6c34 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] [instance: bff3a84b-6ab5-4256-8a04-2d21a4ba20b3] Found default for hw_video_model of virtio {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:18:00 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-2568174c-2593-4746-896f-77f0cc2d6c34 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] [instance: bff3a84b-6ab5-4256-8a04-2d21a4ba20b3] Found default for hw_vif_model of virtio {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:18:00 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-fa51855c-8493-4f5f-9f40-7d0cf0320675 tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] [instance: e88874fe-b0a6-4292-8832-023f95e4f53c] Found default for hw_cdrom_bus of ide {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:18:00 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-fa51855c-8493-4f5f-9f40-7d0cf0320675 tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] [instance: e88874fe-b0a6-4292-8832-023f95e4f53c] Found default for hw_disk_bus of virtio {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:18:00 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-fa51855c-8493-4f5f-9f40-7d0cf0320675 tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] [instance: e88874fe-b0a6-4292-8832-023f95e4f53c] Found default for hw_input_bus of None {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:18:00 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-fa51855c-8493-4f5f-9f40-7d0cf0320675 tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] [instance: e88874fe-b0a6-4292-8832-023f95e4f53c] Found default for hw_pointer_model of None {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:18:00 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-fa51855c-8493-4f5f-9f40-7d0cf0320675 tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] [instance: e88874fe-b0a6-4292-8832-023f95e4f53c] Found default for hw_video_model of virtio {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:18:00 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-fa51855c-8493-4f5f-9f40-7d0cf0320675 tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] [instance: e88874fe-b0a6-4292-8832-023f95e4f53c] Found default for hw_vif_model of virtio {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:18:00 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:030d6106-e7ec-4eb8-9642-b64a4685f6bb -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:18:00 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcbf9041-16aa-46c9-837d-951e22b9cda5]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:030d6106-e7ec-4eb8-9642-b64a4685f6bb, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:030d6106-e7ec-4eb8-9642-b64a4685f6bb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:18:00 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-788b2849-eb9d-406f-8533-c4c016604a6b tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:030d6106-e7ec-4eb8-9642-b64a4685f6bb, portal: 172.16.0.220,3260]
Nov 16 10:18:00 user nova-compute[85141]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:030d6106-e7ec-4eb8-9642-b64a4685f6bb, portal: 172.16.0.220,3260] successful.
Nov 16 10:18:00 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:18:00 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:030d6106-e7ec-4eb8-9642-b64a4685f6bb -p 172.16.0.220:3260 --op delete {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:18:00 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:030d6106-e7ec-4eb8-9642-b64a4685f6bb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:18:00 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfeccd10-00ab-496c-aee1-2a46894382bd]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:18:00 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-788b2849-eb9d-406f-8533-c4c016604a6b tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:18:00 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-788b2849-eb9d-406f-8533-c4c016604a6b tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.317s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 10:18:00 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-788b2849-eb9d-406f-8533-c4c016604a6b tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] <== disconnect_volume: return (319ms) None {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 10:18:00 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-788b2849-eb9d-406f-8533-c4c016604a6b tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] [instance: 0c359f00-f4b7-43c3-8454-364842893779] Disconnected iSCSI Volume {{(pid=85141) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 10:18:00 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-788b2849-eb9d-406f-8533-c4c016604a6b tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] [instance: 0c359f00-f4b7-43c3-8454-364842893779] Deleting instance files /opt/stack/data/nova/instances/0c359f00-f4b7-43c3-8454-364842893779_del
Nov 16 10:18:00 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-788b2849-eb9d-406f-8533-c4c016604a6b tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] [instance: 0c359f00-f4b7-43c3-8454-364842893779] Deletion of /opt/stack/data/nova/instances/0c359f00-f4b7-43c3-8454-364842893779_del complete
Nov 16 10:18:00 user nova-compute[85141]: INFO nova.compute.manager [None req-2568174c-2593-4746-896f-77f0cc2d6c34 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] [instance: bff3a84b-6ab5-4256-8a04-2d21a4ba20b3] Took 8.62 seconds to spawn the instance on the hypervisor.
Nov 16 10:18:00 user nova-compute[85141]: DEBUG nova.compute.manager [None req-2568174c-2593-4746-896f-77f0cc2d6c34 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] [instance: bff3a84b-6ab5-4256-8a04-2d21a4ba20b3] Checking state {{(pid=85141) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 10:18:00 user nova-compute[85141]: INFO nova.compute.manager [None req-fa51855c-8493-4f5f-9f40-7d0cf0320675 tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] [instance: e88874fe-b0a6-4292-8832-023f95e4f53c] Took 7.81 seconds to spawn the instance on the hypervisor.
Nov 16 10:18:00 user nova-compute[85141]: DEBUG nova.compute.manager [None req-fa51855c-8493-4f5f-9f40-7d0cf0320675 tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] [instance: e88874fe-b0a6-4292-8832-023f95e4f53c] Checking state {{(pid=85141) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 10:18:00 user nova-compute[85141]: INFO nova.compute.manager [None req-788b2849-eb9d-406f-8533-c4c016604a6b tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] [instance: 0c359f00-f4b7-43c3-8454-364842893779] Took 4.46 seconds to destroy the instance on the hypervisor.
Nov 16 10:18:00 user nova-compute[85141]: DEBUG oslo.service.loopingcall [None req-788b2849-eb9d-406f-8533-c4c016604a6b tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=85141) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 10:18:00 user nova-compute[85141]: DEBUG nova.compute.manager [-] [instance: 0c359f00-f4b7-43c3-8454-364842893779] Deallocating network for instance {{(pid=85141) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 10:18:00 user nova-compute[85141]: DEBUG nova.network.neutron [-] [instance: 0c359f00-f4b7-43c3-8454-364842893779] deallocate_for_instance() {{(pid=85141) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 10:18:00 user nova-compute[85141]: INFO nova.compute.manager [None req-2568174c-2593-4746-896f-77f0cc2d6c34 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] [instance: bff3a84b-6ab5-4256-8a04-2d21a4ba20b3] Took 9.69 seconds to build instance.
Nov 16 10:18:00 user nova-compute[85141]: INFO nova.compute.manager [None req-fa51855c-8493-4f5f-9f40-7d0cf0320675 tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] [instance: e88874fe-b0a6-4292-8832-023f95e4f53c] Took 15.59 seconds to build instance.
Nov 16 10:18:00 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-2568174c-2593-4746-896f-77f0cc2d6c34 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Lock "bff3a84b-6ab5-4256-8a04-2d21a4ba20b3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.843s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:18:00 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-fa51855c-8493-4f5f-9f40-7d0cf0320675 tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] Lock "e88874fe-b0a6-4292-8832-023f95e4f53c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.683s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:18:00 user nova-compute[85141]: DEBUG nova.compute.manager [req-468bfcb3-70f7-421e-84f9-10373c6ed1a8 req-890e0c00-9d81-4419-a49a-78e0227be508 service nova] [instance: 0c359f00-f4b7-43c3-8454-364842893779] Received event network-vif-plugged-450233b4-a16d-4b2d-bc6a-a87736db7ff4 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:18:00 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-468bfcb3-70f7-421e-84f9-10373c6ed1a8 req-890e0c00-9d81-4419-a49a-78e0227be508 service nova] Acquiring lock "0c359f00-f4b7-43c3-8454-364842893779-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:18:00 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-468bfcb3-70f7-421e-84f9-10373c6ed1a8 req-890e0c00-9d81-4419-a49a-78e0227be508 service nova] Lock "0c359f00-f4b7-43c3-8454-364842893779-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:18:00 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-468bfcb3-70f7-421e-84f9-10373c6ed1a8 req-890e0c00-9d81-4419-a49a-78e0227be508 service nova] Lock "0c359f00-f4b7-43c3-8454-364842893779-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:18:00 user nova-compute[85141]: DEBUG nova.compute.manager [req-468bfcb3-70f7-421e-84f9-10373c6ed1a8 req-890e0c00-9d81-4419-a49a-78e0227be508 service nova] [instance: 0c359f00-f4b7-43c3-8454-364842893779] No waiting events found dispatching network-vif-plugged-450233b4-a16d-4b2d-bc6a-a87736db7ff4 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:18:00 user nova-compute[85141]: WARNING nova.compute.manager [req-468bfcb3-70f7-421e-84f9-10373c6ed1a8 req-890e0c00-9d81-4419-a49a-78e0227be508 service nova] [instance: 0c359f00-f4b7-43c3-8454-364842893779] Received unexpected event network-vif-plugged-450233b4-a16d-4b2d-bc6a-a87736db7ff4 for instance with vm_state active and task_state deleting.
Nov 16 10:18:00 user nova-compute[85141]: DEBUG nova.compute.manager [req-468bfcb3-70f7-421e-84f9-10373c6ed1a8 req-890e0c00-9d81-4419-a49a-78e0227be508 service nova] [instance: bff3a84b-6ab5-4256-8a04-2d21a4ba20b3] Received event network-vif-plugged-23ec0327-ca81-4524-8850-2c081e596d44 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:18:00 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-468bfcb3-70f7-421e-84f9-10373c6ed1a8 req-890e0c00-9d81-4419-a49a-78e0227be508 service nova] Acquiring lock "bff3a84b-6ab5-4256-8a04-2d21a4ba20b3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:18:00 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-468bfcb3-70f7-421e-84f9-10373c6ed1a8 req-890e0c00-9d81-4419-a49a-78e0227be508 service nova] Lock "bff3a84b-6ab5-4256-8a04-2d21a4ba20b3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:18:00 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-468bfcb3-70f7-421e-84f9-10373c6ed1a8 req-890e0c00-9d81-4419-a49a-78e0227be508 service nova] Lock "bff3a84b-6ab5-4256-8a04-2d21a4ba20b3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:18:00 user nova-compute[85141]: DEBUG nova.compute.manager [req-468bfcb3-70f7-421e-84f9-10373c6ed1a8 req-890e0c00-9d81-4419-a49a-78e0227be508 service nova] [instance: bff3a84b-6ab5-4256-8a04-2d21a4ba20b3] No waiting events found dispatching network-vif-plugged-23ec0327-ca81-4524-8850-2c081e596d44 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:18:00 user nova-compute[85141]: WARNING nova.compute.manager [req-468bfcb3-70f7-421e-84f9-10373c6ed1a8 req-890e0c00-9d81-4419-a49a-78e0227be508 service nova] [instance: bff3a84b-6ab5-4256-8a04-2d21a4ba20b3] Received unexpected event network-vif-plugged-23ec0327-ca81-4524-8850-2c081e596d44 for instance with vm_state active and task_state None.
Nov 16 10:18:00 user nova-compute[85141]: DEBUG nova.compute.manager [req-468bfcb3-70f7-421e-84f9-10373c6ed1a8 req-890e0c00-9d81-4419-a49a-78e0227be508 service nova] [instance: bff3a84b-6ab5-4256-8a04-2d21a4ba20b3] Received event network-vif-plugged-23ec0327-ca81-4524-8850-2c081e596d44 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:18:00 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-468bfcb3-70f7-421e-84f9-10373c6ed1a8 req-890e0c00-9d81-4419-a49a-78e0227be508 service nova] Acquiring lock "bff3a84b-6ab5-4256-8a04-2d21a4ba20b3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:18:00 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-468bfcb3-70f7-421e-84f9-10373c6ed1a8 req-890e0c00-9d81-4419-a49a-78e0227be508 service nova] Lock "bff3a84b-6ab5-4256-8a04-2d21a4ba20b3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:18:00 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-468bfcb3-70f7-421e-84f9-10373c6ed1a8 req-890e0c00-9d81-4419-a49a-78e0227be508 service nova] Lock "bff3a84b-6ab5-4256-8a04-2d21a4ba20b3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:18:00 user nova-compute[85141]: DEBUG nova.compute.manager [req-468bfcb3-70f7-421e-84f9-10373c6ed1a8 req-890e0c00-9d81-4419-a49a-78e0227be508 service nova] [instance: bff3a84b-6ab5-4256-8a04-2d21a4ba20b3] No waiting events found dispatching network-vif-plugged-23ec0327-ca81-4524-8850-2c081e596d44 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:18:00 user nova-compute[85141]: WARNING nova.compute.manager [req-468bfcb3-70f7-421e-84f9-10373c6ed1a8 req-890e0c00-9d81-4419-a49a-78e0227be508 service nova] [instance: bff3a84b-6ab5-4256-8a04-2d21a4ba20b3] Received unexpected event network-vif-plugged-23ec0327-ca81-4524-8850-2c081e596d44 for instance with vm_state active and task_state None.
Nov 16 10:18:02 user nova-compute[85141]: DEBUG nova.compute.manager [req-21161ccd-4868-4c12-b645-7a8843d22bcd req-526cd877-76ac-441d-95a5-412d270708ba service nova] [instance: 0c359f00-f4b7-43c3-8454-364842893779] Received event network-vif-deleted-97833d7f-68d7-4a6a-a283-83744d5afd10 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:18:02 user nova-compute[85141]: INFO nova.compute.manager [req-21161ccd-4868-4c12-b645-7a8843d22bcd req-526cd877-76ac-441d-95a5-412d270708ba service nova] [instance: 0c359f00-f4b7-43c3-8454-364842893779] Neutron deleted interface 97833d7f-68d7-4a6a-a283-83744d5afd10; detaching it from the instance and deleting it from the info cache
Nov 16 10:18:02 user nova-compute[85141]: DEBUG nova.network.neutron [req-21161ccd-4868-4c12-b645-7a8843d22bcd req-526cd877-76ac-441d-95a5-412d270708ba service nova] [instance: 0c359f00-f4b7-43c3-8454-364842893779] Updating instance_info_cache with network_info: [{"id": "da46c331-8f37-4473-9c17-7bcb1c691b65", "address": "fa:16:3e:c7:5e:17", "network": {"id": "90bcfce1-33ea-4029-aa72-93b729655e77", "bridge": "br-int", "label": "tempest-device-tagging-net1-660308139", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.209", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "92b768cf0f234b5da6d29450a58ce8e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda46c331-8f", "ovs_interfaceid": "da46c331-8f37-4473-9c17-7bcb1c691b65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5b1acf97-626c-4014-b463-5b4455f0f1e6", "address": "fa:16:3e:0b:c9:63", "network": {"id": "90bcfce1-33ea-4029-aa72-93b729655e77", "bridge": "br-int", "label": "tempest-device-tagging-net1-660308139", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.15", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "92b768cf0f234b5da6d29450a58ce8e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b1acf97-62", "ovs_interfaceid": "5b1acf97-626c-4014-b463-5b4455f0f1e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2243117f-44a8-4d51-8676-d67748b3c9aa", "address": "fa:16:3e:87:12:47", "network": {"id": "90bcfce1-33ea-4029-aa72-93b729655e77", "bridge": "br-int", "label": "tempest-device-tagging-net1-660308139", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.140", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "92b768cf0f234b5da6d29450a58ce8e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2243117f-44", "ovs_interfaceid": "2243117f-44a8-4d51-8676-d67748b3c9aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6d48ae8e-004c-459d-ad7c-081cc9228fee", "address": "fa:16:3e:49:c2:7d", "network": {"id": "90bcfce1-33ea-4029-aa72-93b729655e77", "bridge": "br-int", "label": "tempest-device-tagging-net1-660308139", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "92b768cf0f234b5da6d29450a58ce8e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d48ae8e-00", "ovs_interfaceid": "6d48ae8e-004c-459d-ad7c-081cc9228fee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8a0146a0-20fd-4879-be20-c8732bd6563c", "address": "fa:16:3e:6d:38:4b", "network": {"id": "054ba1f8-e55e-4af1-a668-c4e247430926", "bridge": "br-int", "label": "tempest-device-tagging-net2-1758238013", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "92b768cf0f234b5da6d29450a58ce8e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a0146a0-20", "ovs_interfaceid": "8a0146a0-20fd-4879-be20-c8732bd6563c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "450233b4-a16d-4b2d-bc6a-a87736db7ff4", "address": "fa:16:3e:fe:ae:28", "network": {"id": "054ba1f8-e55e-4af1-a668-c4e247430926", "bridge": "br-int", "label": "tempest-device-tagging-net2-1758238013", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "92b768cf0f234b5da6d29450a58ce8e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap450233b4-a1", "ovs_interfaceid": "450233b4-a16d-4b2d-bc6a-a87736db7ff4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:18:02 user nova-compute[85141]: DEBUG nova.compute.manager [req-21161ccd-4868-4c12-b645-7a8843d22bcd req-526cd877-76ac-441d-95a5-412d270708ba service nova] [instance: 0c359f00-f4b7-43c3-8454-364842893779] Detach interface failed, port_id=97833d7f-68d7-4a6a-a283-83744d5afd10, reason: Instance 0c359f00-f4b7-43c3-8454-364842893779 could not be found. {{(pid=85141) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 16 10:18:02 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:18:03 user nova-compute[85141]: DEBUG nova.network.neutron [-] [instance: 0c359f00-f4b7-43c3-8454-364842893779] Updating instance_info_cache with network_info: [] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:18:03 user nova-compute[85141]: INFO nova.compute.manager [-] [instance: 0c359f00-f4b7-43c3-8454-364842893779] Took 3.19 seconds to deallocate network for instance.
Nov 16 10:18:04 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:18:04 user nova-compute[85141]: DEBUG nova.compute.manager [req-108224f6-3f90-4406-9de6-2a4ef92790e6 req-c89d6bcb-1ff9-4631-a87d-f0f0651c5ce4 service nova] [instance: 0c359f00-f4b7-43c3-8454-364842893779] Received event network-vif-deleted-2243117f-44a8-4d51-8676-d67748b3c9aa {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:18:04 user nova-compute[85141]: DEBUG nova.compute.manager [req-108224f6-3f90-4406-9de6-2a4ef92790e6 req-c89d6bcb-1ff9-4631-a87d-f0f0651c5ce4 service nova] [instance: 0c359f00-f4b7-43c3-8454-364842893779] Received event network-vif-deleted-450233b4-a16d-4b2d-bc6a-a87736db7ff4 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:18:04 user nova-compute[85141]: DEBUG nova.compute.manager [req-108224f6-3f90-4406-9de6-2a4ef92790e6 req-c89d6bcb-1ff9-4631-a87d-f0f0651c5ce4 service nova] [instance: 0c359f00-f4b7-43c3-8454-364842893779] Received event network-vif-deleted-6d48ae8e-004c-459d-ad7c-081cc9228fee {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:18:04 user nova-compute[85141]: DEBUG nova.compute.manager [req-108224f6-3f90-4406-9de6-2a4ef92790e6 req-c89d6bcb-1ff9-4631-a87d-f0f0651c5ce4 service nova] [instance: 0c359f00-f4b7-43c3-8454-364842893779] Received event network-vif-deleted-8a0146a0-20fd-4879-be20-c8732bd6563c {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:18:06 user nova-compute[85141]: INFO nova.compute.manager [None req-788b2849-eb9d-406f-8533-c4c016604a6b tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] [instance: 0c359f00-f4b7-43c3-8454-364842893779] Took 2.70 seconds to detach 3 volumes for instance.
Nov 16 10:18:06 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-788b2849-eb9d-406f-8533-c4c016604a6b tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:18:06 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-788b2849-eb9d-406f-8533-c4c016604a6b tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:18:06 user nova-compute[85141]: DEBUG nova.compute.provider_tree [None req-788b2849-eb9d-406f-8533-c4c016604a6b tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] Inventory has not changed in ProviderTree for provider: bf8e0fa1-16b6-408f-9203-c4cd63916272 {{(pid=85141) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 10:18:06 user nova-compute[85141]: DEBUG nova.scheduler.client.report [None req-788b2849-eb9d-406f-8533-c4c016604a6b tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] Inventory has not changed for provider bf8e0fa1-16b6-408f-9203-c4cd63916272 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=85141) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 10:18:06 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-788b2849-eb9d-406f-8533-c4c016604a6b tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.403s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:18:06 user nova-compute[85141]: INFO nova.scheduler.client.report [None req-788b2849-eb9d-406f-8533-c4c016604a6b tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] Deleted allocations for instance 0c359f00-f4b7-43c3-8454-364842893779
Nov 16 10:18:06 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-788b2849-eb9d-406f-8533-c4c016604a6b tempest-TaggedBootDevicesTest-1698183890 tempest-TaggedBootDevicesTest-1698183890-project-member] Lock "0c359f00-f4b7-43c3-8454-364842893779" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 10.954s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:18:07 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:18:09 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:18:12 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:18:14 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:18:17 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:18:19 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:18:20 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:18:20 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:18:22 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:18:23 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:18:23 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Starting heal instance info cache {{(pid=85141) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 10:18:23 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Acquiring lock "refresh_cache-e65ccf79-718d-4eeb-8914-f0db2e2c9ce2" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:18:23 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Acquired lock "refresh_cache-e65ccf79-718d-4eeb-8914-f0db2e2c9ce2" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:18:23 user nova-compute[85141]: DEBUG nova.network.neutron [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] [instance: e65ccf79-718d-4eeb-8914-f0db2e2c9ce2] Forcefully refreshing network info cache for instance {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 10:18:23 user nova-compute[85141]: DEBUG nova.network.neutron [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] [instance: e65ccf79-718d-4eeb-8914-f0db2e2c9ce2] Updating instance_info_cache with network_info: [{"id": "9b681ac7-3246-4ff4-8691-f8e4f1d62061", "address": "fa:16:3e:ce:f3:cd", "network": {"id": "ac11f3ed-4c14-4051-aff5-44d400d6368c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-679726958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7044a386486d4426bcccfe0b7d225c80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b681ac7-32", "ovs_interfaceid": "9b681ac7-3246-4ff4-8691-f8e4f1d62061", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:18:23 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Releasing lock "refresh_cache-e65ccf79-718d-4eeb-8914-f0db2e2c9ce2" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:18:23 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] [instance: e65ccf79-718d-4eeb-8914-f0db2e2c9ce2] Updated the network info_cache for instance {{(pid=85141) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 10:18:23 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:18:23 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:18:23 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:18:23 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=85141) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 10:18:24 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:18:24 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:18:27 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:18:28 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:18:28 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager.update_available_resource {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:18:28 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:18:28 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:18:28 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:18:28 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Auditing locally available compute resources for user (node: user) {{(pid=85141) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 10:18:28 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e65ccf79-718d-4eeb-8914-f0db2e2c9ce2/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:18:28 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e65ccf79-718d-4eeb-8914-f0db2e2c9ce2/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:18:28 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e65ccf79-718d-4eeb-8914-f0db2e2c9ce2/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:18:28 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e65ccf79-718d-4eeb-8914-f0db2e2c9ce2/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:18:28 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=85141) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 10:18:28 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:18:29 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:18:29 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:18:29 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:18:29 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:18:29 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d842f90e-663b-4c95-9d7c-d092d2bac41f/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:18:29 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d842f90e-663b-4c95-9d7c-d092d2bac41f/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:18:29 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d842f90e-663b-4c95-9d7c-d092d2bac41f/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:18:29 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d842f90e-663b-4c95-9d7c-d092d2bac41f/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:18:29 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d7787a2-b8da-4d39-9b16-4c7bcb275f85/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:18:29 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d7787a2-b8da-4d39-9b16-4c7bcb275f85/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:18:29 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d7787a2-b8da-4d39-9b16-4c7bcb275f85/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:18:30 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d7787a2-b8da-4d39-9b16-4c7bcb275f85/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:18:30 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bff3a84b-6ab5-4256-8a04-2d21a4ba20b3/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:18:30 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bff3a84b-6ab5-4256-8a04-2d21a4ba20b3/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:18:30 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bff3a84b-6ab5-4256-8a04-2d21a4ba20b3/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:18:30 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bff3a84b-6ab5-4256-8a04-2d21a4ba20b3/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:18:30 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e214bbb-5bbb-4e6f-ac09-9cb1412f068b/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:18:30 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e214bbb-5bbb-4e6f-ac09-9cb1412f068b/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:18:30 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e214bbb-5bbb-4e6f-ac09-9cb1412f068b/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:18:30 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e214bbb-5bbb-4e6f-ac09-9cb1412f068b/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:18:30 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b24c3954-06ff-4e15-9e43-c65d1dae7a5d/disk.rescue --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:18:30 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b24c3954-06ff-4e15-9e43-c65d1dae7a5d/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:18:30 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b24c3954-06ff-4e15-9e43-c65d1dae7a5d/disk.rescue --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:18:31 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b24c3954-06ff-4e15-9e43-c65d1dae7a5d/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:18:31 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b24c3954-06ff-4e15-9e43-c65d1dae7a5d/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:18:31 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b24c3954-06ff-4e15-9e43-c65d1dae7a5d/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:18:31 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b24c3954-06ff-4e15-9e43-c65d1dae7a5d/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:18:31 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b24c3954-06ff-4e15-9e43-c65d1dae7a5d/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:18:31 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=85141) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 10:18:31 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/059d6974-bd0c-4f73-91fc-8202ebda4238/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:18:31 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/059d6974-bd0c-4f73-91fc-8202ebda4238/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:18:31 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/059d6974-bd0c-4f73-91fc-8202ebda4238/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:18:31 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/059d6974-bd0c-4f73-91fc-8202ebda4238/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:18:31 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:18:32 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:18:32 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:18:32 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:18:32 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b388b98-4e65-4258-bbe2-77e699321fb7/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:18:32 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b388b98-4e65-4258-bbe2-77e699321fb7/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:18:32 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b388b98-4e65-4258-bbe2-77e699321fb7/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:18:32 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:18:32 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b388b98-4e65-4258-bbe2-77e699321fb7/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:18:32 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=85141) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 10:18:33 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:18:33 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:18:33 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Hypervisor/Node resource view: name=user free_ram=7091MB free_disk=25.077922821044922GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=85141) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 10:18:33 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:18:33 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:18:33 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance d842f90e-663b-4c95-9d7c-d092d2bac41f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:18:33 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance f01dc8cf-1a69-4618-a15d-0c1075157f05 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:18:33 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance 059d6974-bd0c-4f73-91fc-8202ebda4238 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:18:33 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance e65ccf79-718d-4eeb-8914-f0db2e2c9ce2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:18:33 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance 4e214bbb-5bbb-4e6f-ac09-9cb1412f068b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:18:33 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance b24c3954-06ff-4e15-9e43-c65d1dae7a5d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:18:33 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:18:33 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance 9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:18:33 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance 2d7787a2-b8da-4d39-9b16-4c7bcb275f85 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:18:33 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance 0b388b98-4e65-4258-bbe2-77e699321fb7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:18:33 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance e88874fe-b0a6-4292-8832-023f95e4f53c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:18:33 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance bff3a84b-6ab5-4256-8a04-2d21a4ba20b3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:18:33 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=85141) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 10:18:33 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=85141) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 10:18:33 user nova-compute[85141]: DEBUG nova.compute.provider_tree [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Inventory has not changed in ProviderTree for provider: bf8e0fa1-16b6-408f-9203-c4cd63916272 {{(pid=85141) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 10:18:33 user nova-compute[85141]: DEBUG nova.scheduler.client.report [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Inventory has not changed for provider bf8e0fa1-16b6-408f-9203-c4cd63916272 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=85141) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 10:18:33 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Compute_service record updated for user:user {{(pid=85141) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 10:18:33 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.476s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:18:34 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:18:36 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:18:39 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:18:44 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:18:44 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:18:44 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=85141) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 10:18:44 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=85141) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 10:18:44 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=85141) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 10:18:44 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:18:46 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:18:49 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:18:49 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:18:54 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:18:57 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:18:59 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:19:00 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:19:01 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-b2d05e04-1a2b-45e2-a44a-cb313f4774db tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Acquiring lock "11986c5b-6914-491e-8e71-983ab6b13c6e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:19:01 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-b2d05e04-1a2b-45e2-a44a-cb313f4774db tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Lock "11986c5b-6914-491e-8e71-983ab6b13c6e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:19:01 user nova-compute[85141]: DEBUG nova.compute.manager [None req-b2d05e04-1a2b-45e2-a44a-cb313f4774db tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] [instance: 11986c5b-6914-491e-8e71-983ab6b13c6e] Starting instance... {{(pid=85141) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 10:19:01 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-b2d05e04-1a2b-45e2-a44a-cb313f4774db tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:19:01 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-b2d05e04-1a2b-45e2-a44a-cb313f4774db tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:19:01 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-b2d05e04-1a2b-45e2-a44a-cb313f4774db tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=85141) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 10:19:01 user nova-compute[85141]: INFO nova.compute.claims [None req-b2d05e04-1a2b-45e2-a44a-cb313f4774db tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] [instance: 11986c5b-6914-491e-8e71-983ab6b13c6e] Claim successful on node user
Nov 16 10:19:01 user nova-compute[85141]: DEBUG nova.compute.provider_tree [None req-b2d05e04-1a2b-45e2-a44a-cb313f4774db tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Inventory has not changed in ProviderTree for provider: bf8e0fa1-16b6-408f-9203-c4cd63916272 {{(pid=85141) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 10:19:01 user nova-compute[85141]: DEBUG nova.scheduler.client.report [None req-b2d05e04-1a2b-45e2-a44a-cb313f4774db tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Inventory has not changed for provider bf8e0fa1-16b6-408f-9203-c4cd63916272 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=85141) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 10:19:01 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-b2d05e04-1a2b-45e2-a44a-cb313f4774db tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.465s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:19:01 user nova-compute[85141]: DEBUG nova.compute.manager [None req-b2d05e04-1a2b-45e2-a44a-cb313f4774db tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] [instance: 11986c5b-6914-491e-8e71-983ab6b13c6e] Start building networks asynchronously for instance. {{(pid=85141) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 10:19:01 user nova-compute[85141]: DEBUG nova.compute.manager [None req-b2d05e04-1a2b-45e2-a44a-cb313f4774db tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] [instance: 11986c5b-6914-491e-8e71-983ab6b13c6e] Allocating IP information in the background. {{(pid=85141) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 10:19:01 user nova-compute[85141]: DEBUG nova.network.neutron [None req-b2d05e04-1a2b-45e2-a44a-cb313f4774db tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] [instance: 11986c5b-6914-491e-8e71-983ab6b13c6e] allocate_for_instance() {{(pid=85141) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 10:19:01 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-b2d05e04-1a2b-45e2-a44a-cb313f4774db tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] [instance: 11986c5b-6914-491e-8e71-983ab6b13c6e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 10:19:02 user nova-compute[85141]: DEBUG nova.compute.manager [None req-b2d05e04-1a2b-45e2-a44a-cb313f4774db tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] [instance: 11986c5b-6914-491e-8e71-983ab6b13c6e] Start building block device mappings for instance. {{(pid=85141) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 10:19:02 user nova-compute[85141]: DEBUG nova.policy [None req-b2d05e04-1a2b-45e2-a44a-cb313f4774db tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ffe6ceff3cc346b59b4fbf294b9fc1a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733b504d4dbe4f028963cf2c197f0064', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85141) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 10:19:02 user nova-compute[85141]: DEBUG nova.compute.manager [None req-b2d05e04-1a2b-45e2-a44a-cb313f4774db tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] [instance: 11986c5b-6914-491e-8e71-983ab6b13c6e] Start spawning the instance on the hypervisor. {{(pid=85141) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 10:19:02 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-b2d05e04-1a2b-45e2-a44a-cb313f4774db tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] [instance: 11986c5b-6914-491e-8e71-983ab6b13c6e] Creating instance directory {{(pid=85141) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 10:19:02 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-b2d05e04-1a2b-45e2-a44a-cb313f4774db tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] [instance: 11986c5b-6914-491e-8e71-983ab6b13c6e] Creating image(s)
Nov 16 10:19:02 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-b2d05e04-1a2b-45e2-a44a-cb313f4774db tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Acquiring lock "/opt/stack/data/nova/instances/11986c5b-6914-491e-8e71-983ab6b13c6e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:19:02 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-b2d05e04-1a2b-45e2-a44a-cb313f4774db tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Lock "/opt/stack/data/nova/instances/11986c5b-6914-491e-8e71-983ab6b13c6e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:19:02 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-b2d05e04-1a2b-45e2-a44a-cb313f4774db tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Lock "/opt/stack/data/nova/instances/11986c5b-6914-491e-8e71-983ab6b13c6e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:19:02 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-b2d05e04-1a2b-45e2-a44a-cb313f4774db tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:19:02 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-b2d05e04-1a2b-45e2-a44a-cb313f4774db tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json" returned: 0 in 0.165s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:19:02 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-b2d05e04-1a2b-45e2-a44a-cb313f4774db tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Acquiring lock "60a78556fb399ed4a41bc3ca4bccf77c96d8e811" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:19:02 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-b2d05e04-1a2b-45e2-a44a-cb313f4774db tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Lock "60a78556fb399ed4a41bc3ca4bccf77c96d8e811" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:19:02 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-b2d05e04-1a2b-45e2-a44a-cb313f4774db tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:19:02 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-b2d05e04-1a2b-45e2-a44a-cb313f4774db tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json" returned: 0 in 0.174s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:19:02 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-b2d05e04-1a2b-45e2-a44a-cb313f4774db tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811,backing_fmt=raw /opt/stack/data/nova/instances/11986c5b-6914-491e-8e71-983ab6b13c6e/disk 1073741824 {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:19:02 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-b2d05e04-1a2b-45e2-a44a-cb313f4774db tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811,backing_fmt=raw /opt/stack/data/nova/instances/11986c5b-6914-491e-8e71-983ab6b13c6e/disk 1073741824" returned: 0 in 0.049s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:19:02 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-b2d05e04-1a2b-45e2-a44a-cb313f4774db tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Lock "60a78556fb399ed4a41bc3ca4bccf77c96d8e811" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.230s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:19:02 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-b2d05e04-1a2b-45e2-a44a-cb313f4774db tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:19:02 user nova-compute[85141]: DEBUG nova.network.neutron [None req-b2d05e04-1a2b-45e2-a44a-cb313f4774db tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] [instance: 11986c5b-6914-491e-8e71-983ab6b13c6e] Successfully created port: 5fc0fede-224a-4cb0-a586-8be6617c5138 {{(pid=85141) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 10:19:02 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-b2d05e04-1a2b-45e2-a44a-cb313f4774db tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json" returned: 0 in 0.179s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:19:02 user nova-compute[85141]: DEBUG nova.virt.disk.api [None req-b2d05e04-1a2b-45e2-a44a-cb313f4774db tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Checking if we can resize image /opt/stack/data/nova/instances/11986c5b-6914-491e-8e71-983ab6b13c6e/disk. size=1073741824 {{(pid=85141) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 10:19:02 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-b2d05e04-1a2b-45e2-a44a-cb313f4774db tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11986c5b-6914-491e-8e71-983ab6b13c6e/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:19:02 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-b2d05e04-1a2b-45e2-a44a-cb313f4774db tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11986c5b-6914-491e-8e71-983ab6b13c6e/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:19:02 user nova-compute[85141]: DEBUG nova.virt.disk.api [None req-b2d05e04-1a2b-45e2-a44a-cb313f4774db tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Cannot resize image /opt/stack/data/nova/instances/11986c5b-6914-491e-8e71-983ab6b13c6e/disk to a smaller size. {{(pid=85141) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 10:19:02 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-b2d05e04-1a2b-45e2-a44a-cb313f4774db tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] [instance: 11986c5b-6914-491e-8e71-983ab6b13c6e] Created local disks {{(pid=85141) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 10:19:02 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-b2d05e04-1a2b-45e2-a44a-cb313f4774db tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] [instance: 11986c5b-6914-491e-8e71-983ab6b13c6e] Ensure instance console log exists: /opt/stack/data/nova/instances/11986c5b-6914-491e-8e71-983ab6b13c6e/console.log {{(pid=85141) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 10:19:02 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-b2d05e04-1a2b-45e2-a44a-cb313f4774db tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:19:02 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-b2d05e04-1a2b-45e2-a44a-cb313f4774db tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:19:02 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-b2d05e04-1a2b-45e2-a44a-cb313f4774db tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:19:03 user nova-compute[85141]: DEBUG nova.network.neutron [None req-b2d05e04-1a2b-45e2-a44a-cb313f4774db tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] [instance: 11986c5b-6914-491e-8e71-983ab6b13c6e] Successfully updated port: 5fc0fede-224a-4cb0-a586-8be6617c5138 {{(pid=85141) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 10:19:03 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-b2d05e04-1a2b-45e2-a44a-cb313f4774db tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Acquiring lock "refresh_cache-11986c5b-6914-491e-8e71-983ab6b13c6e" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:19:03 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-b2d05e04-1a2b-45e2-a44a-cb313f4774db tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Acquired lock "refresh_cache-11986c5b-6914-491e-8e71-983ab6b13c6e" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:19:03 user nova-compute[85141]: DEBUG nova.network.neutron [None req-b2d05e04-1a2b-45e2-a44a-cb313f4774db tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] [instance: 11986c5b-6914-491e-8e71-983ab6b13c6e] Building network info cache for instance {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 10:19:03 user nova-compute[85141]: DEBUG nova.compute.manager [req-ff354a2f-8605-4b24-b511-2e1d33256b04 req-fcd8e3f3-d891-443a-aba4-9605d6214b2d service nova] [instance: 11986c5b-6914-491e-8e71-983ab6b13c6e] Received event network-changed-5fc0fede-224a-4cb0-a586-8be6617c5138 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:19:03 user nova-compute[85141]: DEBUG nova.compute.manager [req-ff354a2f-8605-4b24-b511-2e1d33256b04 req-fcd8e3f3-d891-443a-aba4-9605d6214b2d service nova] [instance: 11986c5b-6914-491e-8e71-983ab6b13c6e] Refreshing instance network info cache due to event network-changed-5fc0fede-224a-4cb0-a586-8be6617c5138. {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 10:19:03 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-ff354a2f-8605-4b24-b511-2e1d33256b04 req-fcd8e3f3-d891-443a-aba4-9605d6214b2d service nova] Acquiring lock "refresh_cache-11986c5b-6914-491e-8e71-983ab6b13c6e" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:19:03 user nova-compute[85141]: DEBUG nova.network.neutron [None req-b2d05e04-1a2b-45e2-a44a-cb313f4774db tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] [instance: 11986c5b-6914-491e-8e71-983ab6b13c6e] Instance cache missing network info. {{(pid=85141) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 10:19:03 user nova-compute[85141]: DEBUG nova.network.neutron [None req-b2d05e04-1a2b-45e2-a44a-cb313f4774db tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] [instance: 11986c5b-6914-491e-8e71-983ab6b13c6e] Updating instance_info_cache with network_info: [{"id": "5fc0fede-224a-4cb0-a586-8be6617c5138", "address": "fa:16:3e:1c:46:5c", "network": {"id": "e40e4bd2-4277-40b1-9451-1c8365ffa488", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1333036447-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "733b504d4dbe4f028963cf2c197f0064", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fc0fede-22", "ovs_interfaceid": "5fc0fede-224a-4cb0-a586-8be6617c5138", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:19:03 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-b2d05e04-1a2b-45e2-a44a-cb313f4774db tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Releasing lock "refresh_cache-11986c5b-6914-491e-8e71-983ab6b13c6e" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:19:03 user nova-compute[85141]: DEBUG nova.compute.manager [None req-b2d05e04-1a2b-45e2-a44a-cb313f4774db tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] [instance: 11986c5b-6914-491e-8e71-983ab6b13c6e] Instance network_info: |[{"id": "5fc0fede-224a-4cb0-a586-8be6617c5138", "address": "fa:16:3e:1c:46:5c", "network": {"id": "e40e4bd2-4277-40b1-9451-1c8365ffa488", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1333036447-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "733b504d4dbe4f028963cf2c197f0064", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fc0fede-22", "ovs_interfaceid": "5fc0fede-224a-4cb0-a586-8be6617c5138", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=85141) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 10:19:03 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-ff354a2f-8605-4b24-b511-2e1d33256b04 req-fcd8e3f3-d891-443a-aba4-9605d6214b2d service nova] Acquired lock "refresh_cache-11986c5b-6914-491e-8e71-983ab6b13c6e" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:19:03 user nova-compute[85141]: DEBUG nova.network.neutron [req-ff354a2f-8605-4b24-b511-2e1d33256b04 req-fcd8e3f3-d891-443a-aba4-9605d6214b2d service nova] [instance: 11986c5b-6914-491e-8e71-983ab6b13c6e] Refreshing network info cache for port 5fc0fede-224a-4cb0-a586-8be6617c5138 {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 10:19:03 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-b2d05e04-1a2b-45e2-a44a-cb313f4774db tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] [instance: 11986c5b-6914-491e-8e71-983ab6b13c6e] Start _get_guest_xml network_info=[{"id": "5fc0fede-224a-4cb0-a586-8be6617c5138", "address": "fa:16:3e:1c:46:5c", "network": {"id": "e40e4bd2-4277-40b1-9451-1c8365ffa488", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1333036447-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "733b504d4dbe4f028963cf2c197f0064", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fc0fede-22", "ovs_interfaceid": "5fc0fede-224a-4cb0-a586-8be6617c5138", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T10:06:42Z,direct_url=<?>,disk_format='qcow2',id=bc4ca70f-a459-4d5c-a9e6-80f1948eb48b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1044631a5fe84ce8904864a7024049fa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T10:06:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_options': None, 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'image_id': 'bc4ca70f-a459-4d5c-a9e6-80f1948eb48b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=85141) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 10:19:03 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-b2d05e04-1a2b-45e2-a44a-cb313f4774db tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:19:03 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-b2d05e04-1a2b-45e2-a44a-cb313f4774db tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:19:03 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-b2d05e04-1a2b-45e2-a44a-cb313f4774db tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=85141) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 10:19:03 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-b2d05e04-1a2b-45e2-a44a-cb313f4774db tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] CPU controller missing on host. {{(pid=85141) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 10:19:03 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-b2d05e04-1a2b-45e2-a44a-cb313f4774db tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=85141) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 10:19:03 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-b2d05e04-1a2b-45e2-a44a-cb313f4774db tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] CPU controller found on host. {{(pid=85141) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 10:19:03 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-b2d05e04-1a2b-45e2-a44a-cb313f4774db tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=85141) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 10:19:03 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-b2d05e04-1a2b-45e2-a44a-cb313f4774db tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T10:06:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T10:06:42Z,direct_url=<?>,disk_format='qcow2',id=bc4ca70f-a459-4d5c-a9e6-80f1948eb48b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1044631a5fe84ce8904864a7024049fa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T10:06:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 10:19:03 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-b2d05e04-1a2b-45e2-a44a-cb313f4774db tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Flavor limits 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 10:19:03 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-b2d05e04-1a2b-45e2-a44a-cb313f4774db tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Image limits 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 10:19:03 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-b2d05e04-1a2b-45e2-a44a-cb313f4774db tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Flavor pref 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 10:19:03 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-b2d05e04-1a2b-45e2-a44a-cb313f4774db tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Image pref 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 10:19:03 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-b2d05e04-1a2b-45e2-a44a-cb313f4774db tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 10:19:03 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-b2d05e04-1a2b-45e2-a44a-cb313f4774db tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 10:19:03 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-b2d05e04-1a2b-45e2-a44a-cb313f4774db tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=85141) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 10:19:03 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-b2d05e04-1a2b-45e2-a44a-cb313f4774db tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Got 1 possible topologies {{(pid=85141) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 10:19:03 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-b2d05e04-1a2b-45e2-a44a-cb313f4774db tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 10:19:03 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-b2d05e04-1a2b-45e2-a44a-cb313f4774db tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 10:19:03 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-b2d05e04-1a2b-45e2-a44a-cb313f4774db tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T10:19:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1385112868',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1385112868',id=26,image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='733b504d4dbe4f028963cf2c197f0064',ramdisk_id='',reservation_id='r-t0i0h8s4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-742384119',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T10:19:02Z,user_data=None,user_id='ffe6ceff3cc346b59b4fbf294b9fc1a3',uuid=11986c5b-6914-491e-8e71-983ab6b13c6e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5fc0fede-224a-4cb0-a586-8be6617c5138", "address": "fa:16:3e:1c:46:5c", "network": {"id": "e40e4bd2-4277-40b1-9451-1c8365ffa488", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1333036447-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "733b504d4dbe4f028963cf2c197f0064", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fc0fede-22", "ovs_interfaceid": "5fc0fede-224a-4cb0-a586-8be6617c5138", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=85141) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 10:19:03 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-b2d05e04-1a2b-45e2-a44a-cb313f4774db tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Converting VIF {"id": "5fc0fede-224a-4cb0-a586-8be6617c5138", "address": "fa:16:3e:1c:46:5c", "network": {"id": "e40e4bd2-4277-40b1-9451-1c8365ffa488", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1333036447-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "733b504d4dbe4f028963cf2c197f0064", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fc0fede-22", "ovs_interfaceid": "5fc0fede-224a-4cb0-a586-8be6617c5138", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:19:03 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-b2d05e04-1a2b-45e2-a44a-cb313f4774db tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1c:46:5c,bridge_name='br-int',has_traffic_filtering=True,id=5fc0fede-224a-4cb0-a586-8be6617c5138,network=Network(e40e4bd2-4277-40b1-9451-1c8365ffa488),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5fc0fede-22') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:19:03 user nova-compute[85141]: DEBUG nova.objects.instance [None req-b2d05e04-1a2b-45e2-a44a-cb313f4774db tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Lazy-loading 'pci_devices' on Instance uuid 11986c5b-6914-491e-8e71-983ab6b13c6e {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:19:03 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-b2d05e04-1a2b-45e2-a44a-cb313f4774db tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] [instance: 11986c5b-6914-491e-8e71-983ab6b13c6e] End _get_guest_xml xml=<domain type="kvm">
Nov 16 10:19:03 user nova-compute[85141]:   <uuid>11986c5b-6914-491e-8e71-983ab6b13c6e</uuid>
Nov 16 10:19:03 user nova-compute[85141]:   <name>instance-0000001a</name>
Nov 16 10:19:03 user nova-compute[85141]:   <memory>524288</memory>
Nov 16 10:19:03 user nova-compute[85141]:   <vcpu>1</vcpu>
Nov 16 10:19:03 user nova-compute[85141]:   <metadata>
Nov 16 10:19:03 user nova-compute[85141]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 10:19:03 user nova-compute[85141]:       <nova:package version="0.0.0"/>
Nov 16 10:19:03 user nova-compute[85141]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1385112868</nova:name>
Nov 16 10:19:03 user nova-compute[85141]:       <nova:creationTime>2023-11-16 10:19:03</nova:creationTime>
Nov 16 10:19:03 user nova-compute[85141]:       <nova:flavor name="m1.tiny">
Nov 16 10:19:03 user nova-compute[85141]:         <nova:memory>512</nova:memory>
Nov 16 10:19:03 user nova-compute[85141]:         <nova:disk>1</nova:disk>
Nov 16 10:19:03 user nova-compute[85141]:         <nova:swap>0</nova:swap>
Nov 16 10:19:03 user nova-compute[85141]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 10:19:03 user nova-compute[85141]:         <nova:vcpus>1</nova:vcpus>
Nov 16 10:19:03 user nova-compute[85141]:       </nova:flavor>
Nov 16 10:19:03 user nova-compute[85141]:       <nova:owner>
Nov 16 10:19:03 user nova-compute[85141]:         <nova:user uuid="ffe6ceff3cc346b59b4fbf294b9fc1a3">tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member</nova:user>
Nov 16 10:19:03 user nova-compute[85141]:         <nova:project uuid="733b504d4dbe4f028963cf2c197f0064">tempest-ServerBootFromVolumeStableRescueTest-742384119</nova:project>
Nov 16 10:19:03 user nova-compute[85141]:       </nova:owner>
Nov 16 10:19:03 user nova-compute[85141]:       <nova:root type="image" uuid="bc4ca70f-a459-4d5c-a9e6-80f1948eb48b"/>
Nov 16 10:19:03 user nova-compute[85141]:       <nova:ports>
Nov 16 10:19:03 user nova-compute[85141]:         <nova:port uuid="5fc0fede-224a-4cb0-a586-8be6617c5138">
Nov 16 10:19:03 user nova-compute[85141]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 16 10:19:03 user nova-compute[85141]:         </nova:port>
Nov 16 10:19:03 user nova-compute[85141]:       </nova:ports>
Nov 16 10:19:03 user nova-compute[85141]:     </nova:instance>
Nov 16 10:19:03 user nova-compute[85141]:   </metadata>
Nov 16 10:19:03 user nova-compute[85141]:   <sysinfo type="smbios">
Nov 16 10:19:03 user nova-compute[85141]:     <system>
Nov 16 10:19:03 user nova-compute[85141]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 10:19:03 user nova-compute[85141]:       <entry name="product">OpenStack Nova</entry>
Nov 16 10:19:03 user nova-compute[85141]:       <entry name="version">0.0.0</entry>
Nov 16 10:19:03 user nova-compute[85141]:       <entry name="serial">11986c5b-6914-491e-8e71-983ab6b13c6e</entry>
Nov 16 10:19:03 user nova-compute[85141]:       <entry name="uuid">11986c5b-6914-491e-8e71-983ab6b13c6e</entry>
Nov 16 10:19:03 user nova-compute[85141]:       <entry name="family">Virtual Machine</entry>
Nov 16 10:19:03 user nova-compute[85141]:     </system>
Nov 16 10:19:03 user nova-compute[85141]:   </sysinfo>
Nov 16 10:19:03 user nova-compute[85141]:   <os>
Nov 16 10:19:03 user nova-compute[85141]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 10:19:03 user nova-compute[85141]:     <boot dev="hd"/>
Nov 16 10:19:03 user nova-compute[85141]:     <smbios mode="sysinfo"/>
Nov 16 10:19:03 user nova-compute[85141]:   </os>
Nov 16 10:19:03 user nova-compute[85141]:   <features>
Nov 16 10:19:03 user nova-compute[85141]:     <acpi/>
Nov 16 10:19:03 user nova-compute[85141]:     <apic/>
Nov 16 10:19:03 user nova-compute[85141]:     <vmcoreinfo/>
Nov 16 10:19:03 user nova-compute[85141]:   </features>
Nov 16 10:19:03 user nova-compute[85141]:   <clock offset="utc">
Nov 16 10:19:03 user nova-compute[85141]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 10:19:03 user nova-compute[85141]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 10:19:03 user nova-compute[85141]:     <timer name="hpet" present="no"/>
Nov 16 10:19:03 user nova-compute[85141]:   </clock>
Nov 16 10:19:03 user nova-compute[85141]:   <cpu mode="custom" match="exact">
Nov 16 10:19:03 user nova-compute[85141]:     <model>Nehalem</model>
Nov 16 10:19:03 user nova-compute[85141]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 10:19:03 user nova-compute[85141]:   </cpu>
Nov 16 10:19:03 user nova-compute[85141]:   <devices>
Nov 16 10:19:03 user nova-compute[85141]:     <disk type="file" device="disk">
Nov 16 10:19:03 user nova-compute[85141]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 10:19:03 user nova-compute[85141]:       <source file="/opt/stack/data/nova/instances/11986c5b-6914-491e-8e71-983ab6b13c6e/disk"/>
Nov 16 10:19:03 user nova-compute[85141]:       <target dev="vda" bus="virtio"/>
Nov 16 10:19:03 user nova-compute[85141]:     </disk>
Nov 16 10:19:03 user nova-compute[85141]:     <interface type="ethernet">
Nov 16 10:19:03 user nova-compute[85141]:       <mac address="fa:16:3e:1c:46:5c"/>
Nov 16 10:19:03 user nova-compute[85141]:       <model type="virtio"/>
Nov 16 10:19:03 user nova-compute[85141]:       <mtu size="1442"/>
Nov 16 10:19:03 user nova-compute[85141]:       <target dev="tap5fc0fede-22"/>
Nov 16 10:19:03 user nova-compute[85141]:     </interface>
Nov 16 10:19:03 user nova-compute[85141]:     <serial type="pty">
Nov 16 10:19:03 user nova-compute[85141]:       <log file="/opt/stack/data/nova/instances/11986c5b-6914-491e-8e71-983ab6b13c6e/console.log" append="off"/>
Nov 16 10:19:03 user nova-compute[85141]:     </serial>
Nov 16 10:19:03 user nova-compute[85141]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 10:19:03 user nova-compute[85141]:     <video>
Nov 16 10:19:03 user nova-compute[85141]:       <model type="virtio"/>
Nov 16 10:19:03 user nova-compute[85141]:     </video>
Nov 16 10:19:03 user nova-compute[85141]:     <rng model="virtio">
Nov 16 10:19:03 user nova-compute[85141]:       <backend model="random">/dev/urandom</backend>
Nov 16 10:19:03 user nova-compute[85141]:     </rng>
Nov 16 10:19:03 user nova-compute[85141]:     <controller type="usb" index="0" model="none"/>
Nov 16 10:19:03 user nova-compute[85141]:     <memballoon model="virtio">
Nov 16 10:19:03 user nova-compute[85141]:       <stats period="10"/>
Nov 16 10:19:03 user nova-compute[85141]:     </memballoon>
Nov 16 10:19:03 user nova-compute[85141]:   </devices>
Nov 16 10:19:03 user nova-compute[85141]: </domain>
Nov 16 10:19:03 user nova-compute[85141]:  {{(pid=85141) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 10:19:03 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-b2d05e04-1a2b-45e2-a44a-cb313f4774db tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T10:19:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1385112868',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1385112868',id=26,image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='733b504d4dbe4f028963cf2c197f0064',ramdisk_id='',reservation_id='r-t0i0h8s4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-742384119',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T10:19:02Z,user_data=None,user_id='ffe6ceff3cc346b59b4fbf294b9fc1a3',uuid=11986c5b-6914-491e-8e71-983ab6b13c6e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5fc0fede-224a-4cb0-a586-8be6617c5138", "address": "fa:16:3e:1c:46:5c", "network": {"id": "e40e4bd2-4277-40b1-9451-1c8365ffa488", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1333036447-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "733b504d4dbe4f028963cf2c197f0064", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fc0fede-22", "ovs_interfaceid": "5fc0fede-224a-4cb0-a586-8be6617c5138", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 10:19:03 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-b2d05e04-1a2b-45e2-a44a-cb313f4774db tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Converting VIF {"id": "5fc0fede-224a-4cb0-a586-8be6617c5138", "address": "fa:16:3e:1c:46:5c", "network": {"id": "e40e4bd2-4277-40b1-9451-1c8365ffa488", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1333036447-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "733b504d4dbe4f028963cf2c197f0064", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fc0fede-22", "ovs_interfaceid": "5fc0fede-224a-4cb0-a586-8be6617c5138", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:19:03 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-b2d05e04-1a2b-45e2-a44a-cb313f4774db tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1c:46:5c,bridge_name='br-int',has_traffic_filtering=True,id=5fc0fede-224a-4cb0-a586-8be6617c5138,network=Network(e40e4bd2-4277-40b1-9451-1c8365ffa488),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5fc0fede-22') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:19:03 user nova-compute[85141]: DEBUG os_vif [None req-b2d05e04-1a2b-45e2-a44a-cb313f4774db tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:46:5c,bridge_name='br-int',has_traffic_filtering=True,id=5fc0fede-224a-4cb0-a586-8be6617c5138,network=Network(e40e4bd2-4277-40b1-9451-1c8365ffa488),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5fc0fede-22') {{(pid=85141) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 10:19:03 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:19:03 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:19:03 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 10:19:03 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:19:03 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '89787873-7618-5558-b095-c7c8c94ef084', '_type': 'linux-noop'}}, row=False) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:19:03 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:19:03 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:19:03 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:19:03 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5fc0fede-22, may_exist=True, interface_attrs={}) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:19:03 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5fc0fede-22, col_values=(('qos', UUID('c9f1764b-428a-4004-857e-68a291ffbe94')),), if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:19:03 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5fc0fede-22, col_values=(('external_ids', {'iface-id': '5fc0fede-224a-4cb0-a586-8be6617c5138', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1c:46:5c', 'vm-uuid': '11986c5b-6914-491e-8e71-983ab6b13c6e'}),), if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:19:03 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:19:03 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:19:03 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:19:03 user nova-compute[85141]: INFO os_vif [None req-b2d05e04-1a2b-45e2-a44a-cb313f4774db tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:46:5c,bridge_name='br-int',has_traffic_filtering=True,id=5fc0fede-224a-4cb0-a586-8be6617c5138,network=Network(e40e4bd2-4277-40b1-9451-1c8365ffa488),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5fc0fede-22')
Nov 16 10:19:03 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-b2d05e04-1a2b-45e2-a44a-cb313f4774db tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] No BDM found with device name vda, not building metadata. {{(pid=85141) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 10:19:03 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-b2d05e04-1a2b-45e2-a44a-cb313f4774db tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] No VIF found with MAC fa:16:3e:1c:46:5c, not building metadata {{(pid=85141) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 10:19:04 user nova-compute[85141]: DEBUG nova.network.neutron [req-ff354a2f-8605-4b24-b511-2e1d33256b04 req-fcd8e3f3-d891-443a-aba4-9605d6214b2d service nova] [instance: 11986c5b-6914-491e-8e71-983ab6b13c6e] Updated VIF entry in instance network info cache for port 5fc0fede-224a-4cb0-a586-8be6617c5138. {{(pid=85141) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 10:19:04 user nova-compute[85141]: DEBUG nova.network.neutron [req-ff354a2f-8605-4b24-b511-2e1d33256b04 req-fcd8e3f3-d891-443a-aba4-9605d6214b2d service nova] [instance: 11986c5b-6914-491e-8e71-983ab6b13c6e] Updating instance_info_cache with network_info: [{"id": "5fc0fede-224a-4cb0-a586-8be6617c5138", "address": "fa:16:3e:1c:46:5c", "network": {"id": "e40e4bd2-4277-40b1-9451-1c8365ffa488", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1333036447-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "733b504d4dbe4f028963cf2c197f0064", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fc0fede-22", "ovs_interfaceid": "5fc0fede-224a-4cb0-a586-8be6617c5138", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:19:04 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-ff354a2f-8605-4b24-b511-2e1d33256b04 req-fcd8e3f3-d891-443a-aba4-9605d6214b2d service nova] Releasing lock "refresh_cache-11986c5b-6914-491e-8e71-983ab6b13c6e" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:19:05 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:19:05 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:19:05 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:19:05 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:19:05 user nova-compute[85141]: DEBUG nova.compute.manager [req-f4af84b6-6a50-409f-9bfe-64303ece9665 req-7b3431c7-becd-45a5-bebc-14285742a5e7 service nova] [instance: 11986c5b-6914-491e-8e71-983ab6b13c6e] Received event network-vif-plugged-5fc0fede-224a-4cb0-a586-8be6617c5138 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:19:05 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-f4af84b6-6a50-409f-9bfe-64303ece9665 req-7b3431c7-becd-45a5-bebc-14285742a5e7 service nova] Acquiring lock "11986c5b-6914-491e-8e71-983ab6b13c6e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:19:05 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-f4af84b6-6a50-409f-9bfe-64303ece9665 req-7b3431c7-becd-45a5-bebc-14285742a5e7 service nova] Lock "11986c5b-6914-491e-8e71-983ab6b13c6e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:19:05 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-f4af84b6-6a50-409f-9bfe-64303ece9665 req-7b3431c7-becd-45a5-bebc-14285742a5e7 service nova] Lock "11986c5b-6914-491e-8e71-983ab6b13c6e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:19:05 user nova-compute[85141]: DEBUG nova.compute.manager [req-f4af84b6-6a50-409f-9bfe-64303ece9665 req-7b3431c7-becd-45a5-bebc-14285742a5e7 service nova] [instance: 11986c5b-6914-491e-8e71-983ab6b13c6e] No waiting events found dispatching network-vif-plugged-5fc0fede-224a-4cb0-a586-8be6617c5138 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:19:05 user nova-compute[85141]: WARNING nova.compute.manager [req-f4af84b6-6a50-409f-9bfe-64303ece9665 req-7b3431c7-becd-45a5-bebc-14285742a5e7 service nova] [instance: 11986c5b-6914-491e-8e71-983ab6b13c6e] Received unexpected event network-vif-plugged-5fc0fede-224a-4cb0-a586-8be6617c5138 for instance with vm_state building and task_state spawning.
Nov 16 10:19:05 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:19:07 user nova-compute[85141]: DEBUG nova.compute.manager [None req-b2d05e04-1a2b-45e2-a44a-cb313f4774db tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] [instance: 11986c5b-6914-491e-8e71-983ab6b13c6e] Instance event wait completed in 0 seconds for  {{(pid=85141) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 10:19:07 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-b2d05e04-1a2b-45e2-a44a-cb313f4774db tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] [instance: 11986c5b-6914-491e-8e71-983ab6b13c6e] Guest created on hypervisor {{(pid=85141) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 10:19:07 user nova-compute[85141]: INFO nova.virt.libvirt.driver [-] [instance: 11986c5b-6914-491e-8e71-983ab6b13c6e] Instance spawned successfully.
Nov 16 10:19:07 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-b2d05e04-1a2b-45e2-a44a-cb313f4774db tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] [instance: 11986c5b-6914-491e-8e71-983ab6b13c6e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 10:19:07 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-b2d05e04-1a2b-45e2-a44a-cb313f4774db tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] [instance: 11986c5b-6914-491e-8e71-983ab6b13c6e] Found default for hw_cdrom_bus of ide {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:19:07 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-b2d05e04-1a2b-45e2-a44a-cb313f4774db tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] [instance: 11986c5b-6914-491e-8e71-983ab6b13c6e] Found default for hw_disk_bus of virtio {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:19:07 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-b2d05e04-1a2b-45e2-a44a-cb313f4774db tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] [instance: 11986c5b-6914-491e-8e71-983ab6b13c6e] Found default for hw_input_bus of None {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:19:07 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-b2d05e04-1a2b-45e2-a44a-cb313f4774db tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] [instance: 11986c5b-6914-491e-8e71-983ab6b13c6e] Found default for hw_pointer_model of None {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:19:07 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-b2d05e04-1a2b-45e2-a44a-cb313f4774db tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] [instance: 11986c5b-6914-491e-8e71-983ab6b13c6e] Found default for hw_video_model of virtio {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:19:07 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-b2d05e04-1a2b-45e2-a44a-cb313f4774db tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] [instance: 11986c5b-6914-491e-8e71-983ab6b13c6e] Found default for hw_vif_model of virtio {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:19:07 user nova-compute[85141]: INFO nova.compute.manager [None req-b2d05e04-1a2b-45e2-a44a-cb313f4774db tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] [instance: 11986c5b-6914-491e-8e71-983ab6b13c6e] Took 5.29 seconds to spawn the instance on the hypervisor.
Nov 16 10:19:07 user nova-compute[85141]: DEBUG nova.compute.manager [None req-b2d05e04-1a2b-45e2-a44a-cb313f4774db tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] [instance: 11986c5b-6914-491e-8e71-983ab6b13c6e] Checking state {{(pid=85141) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 10:19:07 user nova-compute[85141]: DEBUG nova.compute.manager [req-eefd37c1-9d38-4921-92d9-fc54dfee3278 req-21aff799-dc13-484b-97a7-80e0edf8cba7 service nova] [instance: 11986c5b-6914-491e-8e71-983ab6b13c6e] Received event network-vif-plugged-5fc0fede-224a-4cb0-a586-8be6617c5138 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:19:07 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-eefd37c1-9d38-4921-92d9-fc54dfee3278 req-21aff799-dc13-484b-97a7-80e0edf8cba7 service nova] Acquiring lock "11986c5b-6914-491e-8e71-983ab6b13c6e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:19:07 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-eefd37c1-9d38-4921-92d9-fc54dfee3278 req-21aff799-dc13-484b-97a7-80e0edf8cba7 service nova] Lock "11986c5b-6914-491e-8e71-983ab6b13c6e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:19:07 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-eefd37c1-9d38-4921-92d9-fc54dfee3278 req-21aff799-dc13-484b-97a7-80e0edf8cba7 service nova] Lock "11986c5b-6914-491e-8e71-983ab6b13c6e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:19:07 user nova-compute[85141]: DEBUG nova.compute.manager [req-eefd37c1-9d38-4921-92d9-fc54dfee3278 req-21aff799-dc13-484b-97a7-80e0edf8cba7 service nova] [instance: 11986c5b-6914-491e-8e71-983ab6b13c6e] No waiting events found dispatching network-vif-plugged-5fc0fede-224a-4cb0-a586-8be6617c5138 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:19:07 user nova-compute[85141]: WARNING nova.compute.manager [req-eefd37c1-9d38-4921-92d9-fc54dfee3278 req-21aff799-dc13-484b-97a7-80e0edf8cba7 service nova] [instance: 11986c5b-6914-491e-8e71-983ab6b13c6e] Received unexpected event network-vif-plugged-5fc0fede-224a-4cb0-a586-8be6617c5138 for instance with vm_state building and task_state spawning.
Nov 16 10:19:07 user nova-compute[85141]: INFO nova.compute.manager [None req-b2d05e04-1a2b-45e2-a44a-cb313f4774db tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] [instance: 11986c5b-6914-491e-8e71-983ab6b13c6e] Took 6.08 seconds to build instance.
Nov 16 10:19:07 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-b2d05e04-1a2b-45e2-a44a-cb313f4774db tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Lock "11986c5b-6914-491e-8e71-983ab6b13c6e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.170s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:19:07 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:19:08 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:19:12 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-a9a6f59b-5d16-453f-8edf-8a1801e9f002 tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Acquiring lock "e65ccf79-718d-4eeb-8914-f0db2e2c9ce2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:19:12 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-a9a6f59b-5d16-453f-8edf-8a1801e9f002 tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Lock "e65ccf79-718d-4eeb-8914-f0db2e2c9ce2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:19:12 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-a9a6f59b-5d16-453f-8edf-8a1801e9f002 tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Acquiring lock "e65ccf79-718d-4eeb-8914-f0db2e2c9ce2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:19:12 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-a9a6f59b-5d16-453f-8edf-8a1801e9f002 tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Lock "e65ccf79-718d-4eeb-8914-f0db2e2c9ce2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:19:12 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-a9a6f59b-5d16-453f-8edf-8a1801e9f002 tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Lock "e65ccf79-718d-4eeb-8914-f0db2e2c9ce2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:19:12 user nova-compute[85141]: INFO nova.compute.manager [None req-a9a6f59b-5d16-453f-8edf-8a1801e9f002 tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] [instance: e65ccf79-718d-4eeb-8914-f0db2e2c9ce2] Terminating instance
Nov 16 10:19:12 user nova-compute[85141]: DEBUG nova.compute.manager [None req-a9a6f59b-5d16-453f-8edf-8a1801e9f002 tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] [instance: e65ccf79-718d-4eeb-8914-f0db2e2c9ce2] Start destroying the instance on the hypervisor. {{(pid=85141) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 10:19:12 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:19:12 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:19:12 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:19:12 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:19:12 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:19:13 user nova-compute[85141]: DEBUG nova.compute.manager [req-0740cb85-96fc-4a3a-b9e3-45fccbd9213f req-d0207f1f-eb93-4dda-b8eb-161f8af34876 service nova] [instance: e65ccf79-718d-4eeb-8914-f0db2e2c9ce2] Received event network-vif-unplugged-9b681ac7-3246-4ff4-8691-f8e4f1d62061 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:19:13 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-0740cb85-96fc-4a3a-b9e3-45fccbd9213f req-d0207f1f-eb93-4dda-b8eb-161f8af34876 service nova] Acquiring lock "e65ccf79-718d-4eeb-8914-f0db2e2c9ce2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:19:13 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-0740cb85-96fc-4a3a-b9e3-45fccbd9213f req-d0207f1f-eb93-4dda-b8eb-161f8af34876 service nova] Lock "e65ccf79-718d-4eeb-8914-f0db2e2c9ce2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:19:13 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-0740cb85-96fc-4a3a-b9e3-45fccbd9213f req-d0207f1f-eb93-4dda-b8eb-161f8af34876 service nova] Lock "e65ccf79-718d-4eeb-8914-f0db2e2c9ce2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:19:13 user nova-compute[85141]: DEBUG nova.compute.manager [req-0740cb85-96fc-4a3a-b9e3-45fccbd9213f req-d0207f1f-eb93-4dda-b8eb-161f8af34876 service nova] [instance: e65ccf79-718d-4eeb-8914-f0db2e2c9ce2] No waiting events found dispatching network-vif-unplugged-9b681ac7-3246-4ff4-8691-f8e4f1d62061 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:19:13 user nova-compute[85141]: DEBUG nova.compute.manager [req-0740cb85-96fc-4a3a-b9e3-45fccbd9213f req-d0207f1f-eb93-4dda-b8eb-161f8af34876 service nova] [instance: e65ccf79-718d-4eeb-8914-f0db2e2c9ce2] Received event network-vif-unplugged-9b681ac7-3246-4ff4-8691-f8e4f1d62061 for instance with task_state deleting. {{(pid=85141) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 10:19:13 user nova-compute[85141]: INFO nova.virt.libvirt.driver [-] [instance: e65ccf79-718d-4eeb-8914-f0db2e2c9ce2] Instance destroyed successfully.
Nov 16 10:19:13 user nova-compute[85141]: DEBUG nova.objects.instance [None req-a9a6f59b-5d16-453f-8edf-8a1801e9f002 tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Lazy-loading 'resources' on Instance uuid e65ccf79-718d-4eeb-8914-f0db2e2c9ce2 {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:19:13 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-a9a6f59b-5d16-453f-8edf-8a1801e9f002 tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T10:10:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-2047998705',display_name='tempest-ServerActionsTestOtherB-server-2047998705',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-2047998705',id=4,image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHf5WUZHhTvllxOmAg72z1YtUbpT94pAZ2VioYM/1ZPcnLSsLgh6rPndkFT+8xfTCaDEevGxVERzODZXR4Exh9KNRXP3xfU1ZBhWrD+YWL3uQCHfG8ms6Vv5yEaXpnuCDg==',key_name='tempest-keypair-2137833999',keypairs=<?>,launch_index=0,launched_at=2023-11-16T10:16:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7044a386486d4426bcccfe0b7d225c80',ramdisk_id='',reservation_id='r-2q3wdtbp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-876168065',owner_user_name='tempest-ServerActionsTestOtherB-876168065-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T10:16:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='776d4157be1a4e56a8821d50da998475',uuid=e65ccf79-718d-4eeb-8914-f0db2e2c9ce2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9b681ac7-3246-4ff4-8691-f8e4f1d62061", "address": "fa:16:3e:ce:f3:cd", "network": {"id": "ac11f3ed-4c14-4051-aff5-44d400d6368c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-679726958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7044a386486d4426bcccfe0b7d225c80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b681ac7-32", "ovs_interfaceid": "9b681ac7-3246-4ff4-8691-f8e4f1d62061", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 10:19:13 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-a9a6f59b-5d16-453f-8edf-8a1801e9f002 tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Converting VIF {"id": "9b681ac7-3246-4ff4-8691-f8e4f1d62061", "address": "fa:16:3e:ce:f3:cd", "network": {"id": "ac11f3ed-4c14-4051-aff5-44d400d6368c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-679726958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7044a386486d4426bcccfe0b7d225c80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b681ac7-32", "ovs_interfaceid": "9b681ac7-3246-4ff4-8691-f8e4f1d62061", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:19:13 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-a9a6f59b-5d16-453f-8edf-8a1801e9f002 tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ce:f3:cd,bridge_name='br-int',has_traffic_filtering=True,id=9b681ac7-3246-4ff4-8691-f8e4f1d62061,network=Network(ac11f3ed-4c14-4051-aff5-44d400d6368c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b681ac7-32') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:19:13 user nova-compute[85141]: DEBUG os_vif [None req-a9a6f59b-5d16-453f-8edf-8a1801e9f002 tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ce:f3:cd,bridge_name='br-int',has_traffic_filtering=True,id=9b681ac7-3246-4ff4-8691-f8e4f1d62061,network=Network(ac11f3ed-4c14-4051-aff5-44d400d6368c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b681ac7-32') {{(pid=85141) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 10:19:13 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:19:13 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9b681ac7-32, bridge=br-int, if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:19:13 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:19:13 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:19:13 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:19:13 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=77accd01-11ce-40d2-9514-41e81b1f5698) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:19:13 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:19:13 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:19:13 user nova-compute[85141]: INFO os_vif [None req-a9a6f59b-5d16-453f-8edf-8a1801e9f002 tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ce:f3:cd,bridge_name='br-int',has_traffic_filtering=True,id=9b681ac7-3246-4ff4-8691-f8e4f1d62061,network=Network(ac11f3ed-4c14-4051-aff5-44d400d6368c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b681ac7-32')
Nov 16 10:19:13 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a9a6f59b-5d16-453f-8edf-8a1801e9f002 tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] [instance: e65ccf79-718d-4eeb-8914-f0db2e2c9ce2] calling os-brick to detach iSCSI Volume {{(pid=85141) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 10:19:13 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9a6f59b-5d16-453f-8edf-8a1801e9f002 tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51806b6080>, {'target_iqn': 'iqn.2010-10.org.openstack:abda547a-8d00-4a02-a6e4-d0670e47815a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RgkfZDbl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 10:19:13 user nova-compute[85141]: WARNING os_brick.initiator.connectors.base [None req-a9a6f59b-5d16-453f-8edf-8a1801e9f002 tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 10:19:13 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-a9a6f59b-5d16-453f-8edf-8a1801e9f002 tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 10:19:13 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-a9a6f59b-5d16-453f-8edf-8a1801e9f002 tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 10:19:13 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:19:13 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:19:13 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee6c26a3-1eaa-4eab-9451-1a4338f06811]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:674f9ae8-6ab5-4ff2-b715-fe8807c34793\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:abda547a-8d00-4a02-a6e4-d0670e47815a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:19:13 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9a6f59b-5d16-453f-8edf-8a1801e9f002 tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 10:19:13 user nova-compute[85141]: No targets found.
Nov 16 10:19:13 user nova-compute[85141]: iSNS:
Nov 16 10:19:13 user nova-compute[85141]: No targets found.
Nov 16 10:19:13 user nova-compute[85141]: STATIC:
Nov 16 10:19:13 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee
Nov 16 10:19:13 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:19:13 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:19:13 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:674f9ae8-6ab5-4ff2-b715-fe8807c34793
Nov 16 10:19:13 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:19:13 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:19:13 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:abda547a-8d00-4a02-a6e4-d0670e47815a
Nov 16 10:19:13 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:19:13 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:19:13 user nova-compute[85141]: FIRMWARE:
Nov 16 10:19:13 user nova-compute[85141]: No targets found.
Nov 16 10:19:13 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:19:13 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9a6f59b-5d16-453f-8edf-8a1801e9f002 tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 10:19:13 user nova-compute[85141]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 10:19:13 user nova-compute[85141]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=85141) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 10:19:13 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9a6f59b-5d16-453f-8edf-8a1801e9f002 tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:abda547a-8d00-4a02-a6e4-d0670e47815a', 0)] {{(pid=85141) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 10:19:13 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:19:13 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:19:13 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[54e1c961-864f-4595-acfb-dc5b1d5a8d39]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:674f9ae8-6ab5-4ff2-b715-fe8807c34793\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:abda547a-8d00-4a02-a6e4-d0670e47815a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:19:13 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:19:13 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:19:13 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[25db8aa1-a6ff-4d6d-85b4-32fac4f5ecfa]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abda547a-8d00-4a02-a6e4-d0670e47815a (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:674f9ae8-6ab5-4ff2-b715-fe8807c34793 (non-flash)\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:19:13 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9a6f59b-5d16-453f-8edf-8a1801e9f002 tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)
Nov 16 10:19:13 user nova-compute[85141]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abda547a-8d00-4a02-a6e4-d0670e47815a (non-flash)
Nov 16 10:19:13 user nova-compute[85141]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:674f9ae8-6ab5-4ff2-b715-fe8807c34793 (non-flash)
Nov 16 10:19:13 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:19:13 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9a6f59b-5d16-453f-8edf-8a1801e9f002 tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)
Nov 16 10:19:13 user nova-compute[85141]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abda547a-8d00-4a02-a6e4-d0670e47815a (non-flash)
Nov 16 10:19:13 user nova-compute[85141]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:674f9ae8-6ab5-4ff2-b715-fe8807c34793 (non-flash)
Nov 16 10:19:13 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 10:19:13 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9a6f59b-5d16-453f-8edf-8a1801e9f002 tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f516073cca0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:abda547a-8d00-4a02-a6e4-d0670e47815a'): ({'sdf'}, set())}) {{(pid=85141) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 10:19:13 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-a9a6f59b-5d16-453f-8edf-8a1801e9f002 tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Removing single pathed devices sdf {{(pid=85141) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 10:19:13 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:19:13 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:19:13 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a68821b-8907-4a94-aa53-11a1a884c8aa]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:19:13 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:19:13 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.017s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:19:13 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[5061fd75-8a43-42b4-8fb4-3da3a3fd0fce]: (4, ('ok\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:19:13 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-a9a6f59b-5d16-453f-8edf-8a1801e9f002 tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Flushing IO for device /dev/sdf {{(pid=85141) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 10:19:13 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:19:13 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:19:13 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a368a85-6aff-4019-8a3d-6b020d4a4f50]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:19:13 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-a9a6f59b-5d16-453f-8edf-8a1801e9f002 tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=85141) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 10:19:13 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:19:13 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.042s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:19:13 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[23a1f84a-eb77-4da8-ac3d-eb0fbd29cba6]: (4, ('1', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:19:13 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-a9a6f59b-5d16-453f-8edf-8a1801e9f002 tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=85141) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 10:19:13 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-a9a6f59b-5d16-453f-8edf-8a1801e9f002 tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] SCSI volumes sdf have been removed. {{(pid=85141) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 10:19:13 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9a6f59b-5d16-453f-8edf-8a1801e9f002 tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:abda547a-8d00-4a02-a6e4-d0670e47815a')] {{(pid=85141) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 10:19:13 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abda547a-8d00-4a02-a6e4-d0670e47815a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:19:13 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abda547a-8d00-4a02-a6e4-d0670e47815a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.032s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:19:13 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[2515a0bb-5bf2-49e8-a6f9-f67e95044204]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:19:13 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9a6f59b-5d16-453f-8edf-8a1801e9f002 tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:19:13 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abda547a-8d00-4a02-a6e4-d0670e47815a -p 172.16.0.220:3260 --logout {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:19:13 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abda547a-8d00-4a02-a6e4-d0670e47815a -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:19:13 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab374b63-cf94-4656-92cc-57b42d2c07bb]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:abda547a-8d00-4a02-a6e4-d0670e47815a, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:abda547a-8d00-4a02-a6e4-d0670e47815a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:19:13 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9a6f59b-5d16-453f-8edf-8a1801e9f002 tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:abda547a-8d00-4a02-a6e4-d0670e47815a, portal: 172.16.0.220,3260]
Nov 16 10:19:13 user nova-compute[85141]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:abda547a-8d00-4a02-a6e4-d0670e47815a, portal: 172.16.0.220,3260] successful.
Nov 16 10:19:13 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:19:13 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abda547a-8d00-4a02-a6e4-d0670e47815a -p 172.16.0.220:3260 --op delete {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:19:13 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abda547a-8d00-4a02-a6e4-d0670e47815a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:19:13 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[41e89133-e778-45b9-a0d9-23d9499fd600]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:19:13 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9a6f59b-5d16-453f-8edf-8a1801e9f002 tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:19:13 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-a9a6f59b-5d16-453f-8edf-8a1801e9f002 tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.310s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 10:19:13 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9a6f59b-5d16-453f-8edf-8a1801e9f002 tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] <== disconnect_volume: return (312ms) None {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 10:19:13 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a9a6f59b-5d16-453f-8edf-8a1801e9f002 tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] [instance: e65ccf79-718d-4eeb-8914-f0db2e2c9ce2] Disconnected iSCSI Volume {{(pid=85141) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 10:19:13 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-a9a6f59b-5d16-453f-8edf-8a1801e9f002 tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] [instance: e65ccf79-718d-4eeb-8914-f0db2e2c9ce2] Deleting instance files /opt/stack/data/nova/instances/e65ccf79-718d-4eeb-8914-f0db2e2c9ce2_del
Nov 16 10:19:13 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-a9a6f59b-5d16-453f-8edf-8a1801e9f002 tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] [instance: e65ccf79-718d-4eeb-8914-f0db2e2c9ce2] Deletion of /opt/stack/data/nova/instances/e65ccf79-718d-4eeb-8914-f0db2e2c9ce2_del complete
Nov 16 10:19:14 user nova-compute[85141]: INFO nova.compute.manager [None req-a9a6f59b-5d16-453f-8edf-8a1801e9f002 tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] [instance: e65ccf79-718d-4eeb-8914-f0db2e2c9ce2] Took 1.24 seconds to destroy the instance on the hypervisor.
Nov 16 10:19:14 user nova-compute[85141]: DEBUG oslo.service.loopingcall [None req-a9a6f59b-5d16-453f-8edf-8a1801e9f002 tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=85141) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 10:19:14 user nova-compute[85141]: DEBUG nova.compute.manager [-] [instance: e65ccf79-718d-4eeb-8914-f0db2e2c9ce2] Deallocating network for instance {{(pid=85141) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 10:19:14 user nova-compute[85141]: DEBUG nova.network.neutron [-] [instance: e65ccf79-718d-4eeb-8914-f0db2e2c9ce2] deallocate_for_instance() {{(pid=85141) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 10:19:14 user nova-compute[85141]: DEBUG nova.network.neutron [-] [instance: e65ccf79-718d-4eeb-8914-f0db2e2c9ce2] Updating instance_info_cache with network_info: [] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:19:14 user nova-compute[85141]: DEBUG nova.compute.manager [req-622d2cca-5604-42f8-aafa-94fb6eb578ec req-72d08c0d-775c-4e24-9c19-ccb250f6a8cd service nova] [instance: e65ccf79-718d-4eeb-8914-f0db2e2c9ce2] Received event network-vif-deleted-9b681ac7-3246-4ff4-8691-f8e4f1d62061 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:19:14 user nova-compute[85141]: INFO nova.compute.manager [req-622d2cca-5604-42f8-aafa-94fb6eb578ec req-72d08c0d-775c-4e24-9c19-ccb250f6a8cd service nova] [instance: e65ccf79-718d-4eeb-8914-f0db2e2c9ce2] Neutron deleted interface 9b681ac7-3246-4ff4-8691-f8e4f1d62061; detaching it from the instance and deleting it from the info cache
Nov 16 10:19:14 user nova-compute[85141]: DEBUG nova.network.neutron [req-622d2cca-5604-42f8-aafa-94fb6eb578ec req-72d08c0d-775c-4e24-9c19-ccb250f6a8cd service nova] [instance: e65ccf79-718d-4eeb-8914-f0db2e2c9ce2] Updating instance_info_cache with network_info: [] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:19:15 user nova-compute[85141]: INFO nova.compute.manager [-] [instance: e65ccf79-718d-4eeb-8914-f0db2e2c9ce2] Took 1.06 seconds to deallocate network for instance.
Nov 16 10:19:15 user nova-compute[85141]: DEBUG nova.compute.manager [req-622d2cca-5604-42f8-aafa-94fb6eb578ec req-72d08c0d-775c-4e24-9c19-ccb250f6a8cd service nova] [instance: e65ccf79-718d-4eeb-8914-f0db2e2c9ce2] Detach interface failed, port_id=9b681ac7-3246-4ff4-8691-f8e4f1d62061, reason: Instance e65ccf79-718d-4eeb-8914-f0db2e2c9ce2 could not be found. {{(pid=85141) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 16 10:19:15 user nova-compute[85141]: DEBUG nova.compute.manager [req-e3ae7340-3ba9-49c7-8e5c-b6bd3a171506 req-2079ed96-581e-4527-a310-3871f8027e53 service nova] [instance: e65ccf79-718d-4eeb-8914-f0db2e2c9ce2] Received event network-vif-plugged-9b681ac7-3246-4ff4-8691-f8e4f1d62061 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:19:15 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-e3ae7340-3ba9-49c7-8e5c-b6bd3a171506 req-2079ed96-581e-4527-a310-3871f8027e53 service nova] Acquiring lock "e65ccf79-718d-4eeb-8914-f0db2e2c9ce2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:19:15 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-e3ae7340-3ba9-49c7-8e5c-b6bd3a171506 req-2079ed96-581e-4527-a310-3871f8027e53 service nova] Lock "e65ccf79-718d-4eeb-8914-f0db2e2c9ce2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:19:15 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-e3ae7340-3ba9-49c7-8e5c-b6bd3a171506 req-2079ed96-581e-4527-a310-3871f8027e53 service nova] Lock "e65ccf79-718d-4eeb-8914-f0db2e2c9ce2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:19:15 user nova-compute[85141]: DEBUG nova.compute.manager [req-e3ae7340-3ba9-49c7-8e5c-b6bd3a171506 req-2079ed96-581e-4527-a310-3871f8027e53 service nova] [instance: e65ccf79-718d-4eeb-8914-f0db2e2c9ce2] No waiting events found dispatching network-vif-plugged-9b681ac7-3246-4ff4-8691-f8e4f1d62061 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:19:15 user nova-compute[85141]: WARNING nova.compute.manager [req-e3ae7340-3ba9-49c7-8e5c-b6bd3a171506 req-2079ed96-581e-4527-a310-3871f8027e53 service nova] [instance: e65ccf79-718d-4eeb-8914-f0db2e2c9ce2] Received unexpected event network-vif-plugged-9b681ac7-3246-4ff4-8691-f8e4f1d62061 for instance with vm_state active and task_state deleting.
Nov 16 10:19:15 user nova-compute[85141]: DEBUG nova.compute.manager [req-4be8e147-71a9-4ced-8523-1db85708a52b req-3014bbe4-03e8-4638-a669-7485756e1970 service nova] [instance: 9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008] Received event network-changed-6e352298-a803-4a3c-8f40-dc88ee03687f {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:19:15 user nova-compute[85141]: DEBUG nova.compute.manager [req-4be8e147-71a9-4ced-8523-1db85708a52b req-3014bbe4-03e8-4638-a669-7485756e1970 service nova] [instance: 9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008] Refreshing instance network info cache due to event network-changed-6e352298-a803-4a3c-8f40-dc88ee03687f. {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 10:19:15 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-4be8e147-71a9-4ced-8523-1db85708a52b req-3014bbe4-03e8-4638-a669-7485756e1970 service nova] Acquiring lock "refresh_cache-9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:19:15 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-4be8e147-71a9-4ced-8523-1db85708a52b req-3014bbe4-03e8-4638-a669-7485756e1970 service nova] Acquired lock "refresh_cache-9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:19:15 user nova-compute[85141]: DEBUG nova.network.neutron [req-4be8e147-71a9-4ced-8523-1db85708a52b req-3014bbe4-03e8-4638-a669-7485756e1970 service nova] [instance: 9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008] Refreshing network info cache for port 6e352298-a803-4a3c-8f40-dc88ee03687f {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 10:19:15 user nova-compute[85141]: DEBUG nova.network.neutron [req-4be8e147-71a9-4ced-8523-1db85708a52b req-3014bbe4-03e8-4638-a669-7485756e1970 service nova] [instance: 9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008] Updated VIF entry in instance network info cache for port 6e352298-a803-4a3c-8f40-dc88ee03687f. {{(pid=85141) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 10:19:15 user nova-compute[85141]: DEBUG nova.network.neutron [req-4be8e147-71a9-4ced-8523-1db85708a52b req-3014bbe4-03e8-4638-a669-7485756e1970 service nova] [instance: 9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008] Updating instance_info_cache with network_info: [{"id": "6e352298-a803-4a3c-8f40-dc88ee03687f", "address": "fa:16:3e:ab:ca:9e", "network": {"id": "859d1f09-56c4-4c2b-b2c3-02b1938e8dbf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1562516834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "879fa3f4dfc34726b20149b8a7db22dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e352298-a8", "ovs_interfaceid": "6e352298-a803-4a3c-8f40-dc88ee03687f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:19:15 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-4be8e147-71a9-4ced-8523-1db85708a52b req-3014bbe4-03e8-4638-a669-7485756e1970 service nova] Releasing lock "refresh_cache-9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:19:15 user nova-compute[85141]: INFO nova.compute.manager [None req-a9a6f59b-5d16-453f-8edf-8a1801e9f002 tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] [instance: e65ccf79-718d-4eeb-8914-f0db2e2c9ce2] Took 0.79 seconds to detach 1 volumes for instance.
Nov 16 10:19:15 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-a9a6f59b-5d16-453f-8edf-8a1801e9f002 tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:19:15 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-a9a6f59b-5d16-453f-8edf-8a1801e9f002 tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:19:16 user nova-compute[85141]: DEBUG nova.compute.provider_tree [None req-a9a6f59b-5d16-453f-8edf-8a1801e9f002 tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Inventory has not changed in ProviderTree for provider: bf8e0fa1-16b6-408f-9203-c4cd63916272 {{(pid=85141) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 10:19:16 user nova-compute[85141]: DEBUG nova.scheduler.client.report [None req-a9a6f59b-5d16-453f-8edf-8a1801e9f002 tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Inventory has not changed for provider bf8e0fa1-16b6-408f-9203-c4cd63916272 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=85141) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 10:19:16 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-a9a6f59b-5d16-453f-8edf-8a1801e9f002 tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.483s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:19:16 user nova-compute[85141]: INFO nova.scheduler.client.report [None req-a9a6f59b-5d16-453f-8edf-8a1801e9f002 tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Deleted allocations for instance e65ccf79-718d-4eeb-8914-f0db2e2c9ce2
Nov 16 10:19:16 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-a9a6f59b-5d16-453f-8edf-8a1801e9f002 tempest-ServerActionsTestOtherB-876168065 tempest-ServerActionsTestOtherB-876168065-project-member] Lock "e65ccf79-718d-4eeb-8914-f0db2e2c9ce2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.769s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:19:16 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-4051b8c3-df05-4069-aabc-5d3474102f59 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Acquiring lock "9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:19:16 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-4051b8c3-df05-4069-aabc-5d3474102f59 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Lock "9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:19:16 user nova-compute[85141]: DEBUG nova.objects.instance [None req-4051b8c3-df05-4069-aabc-5d3474102f59 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Lazy-loading 'flavor' on Instance uuid 9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008 {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:19:16 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-4051b8c3-df05-4069-aabc-5d3474102f59 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Lock "9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:19:17 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-4051b8c3-df05-4069-aabc-5d3474102f59 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Acquiring lock "9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:19:17 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-4051b8c3-df05-4069-aabc-5d3474102f59 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Lock "9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:19:17 user nova-compute[85141]: INFO nova.compute.manager [None req-4051b8c3-df05-4069-aabc-5d3474102f59 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] [instance: 9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008] Attaching volume 2f7784b4-2ba5-4085-9e17-877c754115c8 to /dev/vdb
Nov 16 10:19:17 user nova-compute[85141]: DEBUG os_brick.utils [None req-4051b8c3-df05-4069-aabc-5d3474102f59 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 10:19:17 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:19:17 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:19:17 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf756f2e-1eb9-4052-b72c-3d00de1e2305]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c7834de5c295\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:19:17 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:19:17 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:19:17 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[7607b24a-c098-41dc-8b2b-8247661014e0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:19:17 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:19:17 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:19:17 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[94a26fd2-1de4-45a3-b0c6-493d5866c4d1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:19:17 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b21cd30-9c80-4e20-bd41-51753033e12c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:19:17 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-4051b8c3-df05-4069-aabc-5d3474102f59 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Running cmd (subprocess): nvme version {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:19:17 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-4051b8c3-df05-4069-aabc-5d3474102f59 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] 'nvme version' failed. Not Retrying. {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 10:19:17 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4051b8c3-df05-4069-aabc-5d3474102f59 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] nvme not present on system {{(pid=85141) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 10:19:17 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:19:17 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 10:19:17 user nova-compute[85141]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 10:19:17 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[e328f0ab-42a2-4ea8-968a-c73a30562207]: (4, '') {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:19:17 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.lightos [None req-4051b8c3-df05-4069-aabc-5d3474102f59 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=85141) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 10:19:17 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.lightos [None req-4051b8c3-df05-4069-aabc-5d3474102f59 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=85141) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 10:19:17 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.lightos [None req-4051b8c3-df05-4069-aabc-5d3474102f59 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] LIGHTOS: no hostnqn found. {{(pid=85141) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 10:19:17 user nova-compute[85141]: DEBUG os_brick.utils [None req-4051b8c3-df05-4069-aabc-5d3474102f59 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c7834de5c295', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 10:19:17 user nova-compute[85141]: DEBUG nova.virt.block_device [None req-4051b8c3-df05-4069-aabc-5d3474102f59 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] [instance: 9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008] Updating existing volume attachment record: a43198da-61bc-49e2-8b33-54b7fe991412 {{(pid=85141) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 10:19:17 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:19:18 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:19:22 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:19:22 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4051b8c3-df05-4069-aabc-5d3474102f59 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] [instance: 9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008] Calling os-brick to attach iSCSI Volume {{(pid=85141) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 10:19:22 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-4051b8c3-df05-4069-aabc-5d3474102f59 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51806b6080>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2f7784b4-2ba5-4085-9e17-877c754115c8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yEORChLP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 10:19:22 user nova-compute[85141]: WARNING os_brick.initiator.connectors.base [None req-4051b8c3-df05-4069-aabc-5d3474102f59 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 10:19:22 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-4051b8c3-df05-4069-aabc-5d3474102f59 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 10:19:22 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-4051b8c3-df05-4069-aabc-5d3474102f59 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 10:19:22 user nova-compute[85141]: WARNING os_brick.initiator.connectors.base [None req-4051b8c3-df05-4069-aabc-5d3474102f59 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 10:19:22 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-4051b8c3-df05-4069-aabc-5d3474102f59 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2f7784b4-2ba5-4085-9e17-877c754115c8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 10:19:22 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-4051b8c3-df05-4069-aabc-5d3474102f59 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2f7784b4-2ba5-4085-9e17-877c754115c8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 10:19:22 user nova-compute[85141]: INFO os_brick.initiator.connectors.iscsi [None req-4051b8c3-df05-4069-aabc-5d3474102f59 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 10:19:22 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f7784b4-2ba5-4085-9e17-877c754115c8 -p 172.16.0.220:3260 {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:19:22 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f7784b4-2ba5-4085-9e17-877c754115c8 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:19:22 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[68feaae0-49e2-4893-9358-f9f5f5277135]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:19:22 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-4051b8c3-df05-4069-aabc-5d3474102f59 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 10:19:22 user nova-compute[85141]:  {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:19:22 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f7784b4-2ba5-4085-9e17-877c754115c8 -p 172.16.0.220:3260 --interface default --op new {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:19:22 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f7784b4-2ba5-4085-9e17-877c754115c8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:19:22 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[c07ccb73-f9db-4492-9a8f-4f584716a788]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2f7784b4-2ba5-4085-9e17-877c754115c8] added\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:19:22 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-4051b8c3-df05-4069-aabc-5d3474102f59 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2f7784b4-2ba5-4085-9e17-877c754115c8] added
Nov 16 10:19:22 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:19:22 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f7784b4-2ba5-4085-9e17-877c754115c8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:19:22 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f7784b4-2ba5-4085-9e17-877c754115c8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:19:22 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[117bb243-7de4-4353-b40b-b2c7c1d61d17]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:19:22 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-4051b8c3-df05-4069-aabc-5d3474102f59 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:19:22 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f7784b4-2ba5-4085-9e17-877c754115c8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:19:22 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f7784b4-2ba5-4085-9e17-877c754115c8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:19:22 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[d628fd8c-7e53-447d-84c2-dcf8a14f0769]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:19:22 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-4051b8c3-df05-4069-aabc-5d3474102f59 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:19:22 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f7784b4-2ba5-4085-9e17-877c754115c8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yEORChLP {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:19:22 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f7784b4-2ba5-4085-9e17-877c754115c8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yEORChLP" returned: 0 in 0.017s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:19:22 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[7edf3983-b448-4a27-aef3-c037364589b5]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:19:22 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-4051b8c3-df05-4069-aabc-5d3474102f59 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yEORChLP'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:19:22 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f7784b4-2ba5-4085-9e17-877c754115c8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:19:22 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f7784b4-2ba5-4085-9e17-877c754115c8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:19:22 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ba95021-dbaf-4cd1-9149-1a5892ef14a3]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:19:22 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-4051b8c3-df05-4069-aabc-5d3474102f59 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:19:22 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:19:22 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:19:22 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[15a25c10-a3e8-403d-8d75-6abddde15032]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:674f9ae8-6ab5-4ff2-b715-fe8807c34793 (non-flash)\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:19:22 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-4051b8c3-df05-4069-aabc-5d3474102f59 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)
Nov 16 10:19:22 user nova-compute[85141]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:674f9ae8-6ab5-4ff2-b715-fe8807c34793 (non-flash)
Nov 16 10:19:22 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:19:22 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-4051b8c3-df05-4069-aabc-5d3474102f59 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)
Nov 16 10:19:22 user nova-compute[85141]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:674f9ae8-6ab5-4ff2-b715-fe8807c34793 (non-flash)
Nov 16 10:19:22 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 10:19:22 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f7784b4-2ba5-4085-9e17-877c754115c8 -p 172.16.0.220:3260 --login {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:19:22 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:19:22 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f7784b4-2ba5-4085-9e17-877c754115c8 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:19:22 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cbd9b02-b718-4343-a838-c7cf31bbd7ca]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2f7784b4-2ba5-4085-9e17-877c754115c8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2f7784b4-2ba5-4085-9e17-877c754115c8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:19:22 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-4051b8c3-df05-4069-aabc-5d3474102f59 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2f7784b4-2ba5-4085-9e17-877c754115c8, portal: 172.16.0.220,3260]
Nov 16 10:19:22 user nova-compute[85141]: Login to [iface: default, target: iqn.2010-10.org.openstack:2f7784b4-2ba5-4085-9e17-877c754115c8, portal: 172.16.0.220,3260] successful.
Nov 16 10:19:22 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:19:22 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f7784b4-2ba5-4085-9e17-877c754115c8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:19:22 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f7784b4-2ba5-4085-9e17-877c754115c8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:19:22 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[48e91c8c-2eec-4cca-8fd7-f00815424897]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:19:22 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-4051b8c3-df05-4069-aabc-5d3474102f59 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:19:22 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:19:22 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:19:22 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[50f3d911-ddea-4b17-9e8e-a4e62665656e]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:674f9ae8-6ab5-4ff2-b715-fe8807c34793 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7784b4-2ba5-4085-9e17-877c754115c8 (non-flash)\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:19:22 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-4051b8c3-df05-4069-aabc-5d3474102f59 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)
Nov 16 10:19:22 user nova-compute[85141]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:674f9ae8-6ab5-4ff2-b715-fe8807c34793 (non-flash)
Nov 16 10:19:22 user nova-compute[85141]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7784b4-2ba5-4085-9e17-877c754115c8 (non-flash)
Nov 16 10:19:22 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:19:22 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-4051b8c3-df05-4069-aabc-5d3474102f59 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)
Nov 16 10:19:22 user nova-compute[85141]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:674f9ae8-6ab5-4ff2-b715-fe8807c34793 (non-flash)
Nov 16 10:19:22 user nova-compute[85141]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7784b4-2ba5-4085-9e17-877c754115c8 (non-flash)
Nov 16 10:19:22 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 10:19:22 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-4051b8c3-df05-4069-aabc-5d3474102f59 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2f7784b4-2ba5-4085-9e17-877c754115c8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.281s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 10:19:22 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-4051b8c3-df05-4069-aabc-5d3474102f59 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Connected to 172.16.0.220:3260 {{(pid=85141) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 10:19:22 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-4051b8c3-df05-4069-aabc-5d3474102f59 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] HCTL ('33', '-', '-', 0) found on session 26 with lun 0 {{(pid=85141) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 10:19:22 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-4051b8c3-df05-4069-aabc-5d3474102f59 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=85141) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 10:19:22 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:19:22 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:19:22 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[26edf0ac-7edb-43ee-932b-c188323f5178]: (4, ('- - 0', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:19:22 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-4051b8c3-df05-4069-aabc-5d3474102f59 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Searching for a device in session 26 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=85141) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 10:19:22 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-4051b8c3-df05-4069-aabc-5d3474102f59 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:2f7784b4-2ba5-4085-9e17-877c754115c8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yEORChLP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=85141) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 10:19:23 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-d20dbdb7-3d7e-4f46-981f-92308223e2e1 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Acquiring lock "2d7787a2-b8da-4d39-9b16-4c7bcb275f85" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:19:23 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-d20dbdb7-3d7e-4f46-981f-92308223e2e1 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Lock "2d7787a2-b8da-4d39-9b16-4c7bcb275f85" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:19:23 user nova-compute[85141]: DEBUG nova.objects.instance [None req-d20dbdb7-3d7e-4f46-981f-92308223e2e1 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Lazy-loading 'flavor' on Instance uuid 2d7787a2-b8da-4d39-9b16-4c7bcb275f85 {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:19:23 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-d20dbdb7-3d7e-4f46-981f-92308223e2e1 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Lock "2d7787a2-b8da-4d39-9b16-4c7bcb275f85" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:19:23 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-d20dbdb7-3d7e-4f46-981f-92308223e2e1 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Acquiring lock "2d7787a2-b8da-4d39-9b16-4c7bcb275f85" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:19:23 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-d20dbdb7-3d7e-4f46-981f-92308223e2e1 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Lock "2d7787a2-b8da-4d39-9b16-4c7bcb275f85" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:19:23 user nova-compute[85141]: INFO nova.compute.manager [None req-d20dbdb7-3d7e-4f46-981f-92308223e2e1 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] [instance: 2d7787a2-b8da-4d39-9b16-4c7bcb275f85] Attaching volume 7dc504e0-da46-4c57-a66d-8ae6ce9c733c to /dev/vdb
Nov 16 10:19:23 user nova-compute[85141]: DEBUG os_brick.utils [None req-d20dbdb7-3d7e-4f46-981f-92308223e2e1 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 10:19:23 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:19:23 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:19:23 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[f26db87c-abd4-419e-b904-ca9b9602b79b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c7834de5c295\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:19:23 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:19:23 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:19:23 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[7687fae7-b009-4110-b069-eda94fb7a483]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:19:23 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:19:23 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:19:23 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9968f36-d2ce-4003-ba29-701a9ffd1026]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:19:23 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[062f37e6-11f8-4a77-a40c-84b65a32643b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:19:23 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-d20dbdb7-3d7e-4f46-981f-92308223e2e1 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Running cmd (subprocess): nvme version {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:19:23 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-d20dbdb7-3d7e-4f46-981f-92308223e2e1 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] 'nvme version' failed. Not Retrying. {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 10:19:23 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d20dbdb7-3d7e-4f46-981f-92308223e2e1 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] nvme not present on system {{(pid=85141) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 10:19:23 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:19:23 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 10:19:23 user nova-compute[85141]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 10:19:23 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed45d2f0-9249-4565-bbc2-8f7fa2df4e76]: (4, '') {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:19:23 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.lightos [None req-d20dbdb7-3d7e-4f46-981f-92308223e2e1 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=85141) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 10:19:23 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.lightos [None req-d20dbdb7-3d7e-4f46-981f-92308223e2e1 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=85141) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 10:19:23 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.lightos [None req-d20dbdb7-3d7e-4f46-981f-92308223e2e1 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] LIGHTOS: no hostnqn found. {{(pid=85141) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 10:19:23 user nova-compute[85141]: DEBUG os_brick.utils [None req-d20dbdb7-3d7e-4f46-981f-92308223e2e1 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c7834de5c295', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 10:19:23 user nova-compute[85141]: DEBUG nova.virt.block_device [None req-d20dbdb7-3d7e-4f46-981f-92308223e2e1 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] [instance: 2d7787a2-b8da-4d39-9b16-4c7bcb275f85] Updating existing volume attachment record: 01da587b-e658-411f-99e7-f8c0cea89ac9 {{(pid=85141) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 10:19:23 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:19:23 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-4051b8c3-df05-4069-aabc-5d3474102f59 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.321s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 10:19:23 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-4051b8c3-df05-4069-aabc-5d3474102f59 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] <== connect_volume: return (1323ms) {'type': 'block', 'scsi_wwn': '23638326337643931', 'path': '/dev/sdb'} {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 10:19:23 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4051b8c3-df05-4069-aabc-5d3474102f59 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] [instance: 9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23638326337643931', 'path': '/dev/sdb'} {{(pid=85141) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 10:19:23 user nova-compute[85141]: DEBUG nova.objects.instance [None req-4051b8c3-df05-4069-aabc-5d3474102f59 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Lazy-loading 'flavor' on Instance uuid 9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008 {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:19:23 user nova-compute[85141]: DEBUG nova.virt.libvirt.guest [None req-4051b8c3-df05-4069-aabc-5d3474102f59 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 10:19:23 user nova-compute[85141]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 10:19:23 user nova-compute[85141]:   <source dev="/dev/sdb"/>
Nov 16 10:19:23 user nova-compute[85141]:   <target dev="vdb" bus="virtio"/>
Nov 16 10:19:23 user nova-compute[85141]:   <serial>2f7784b4-2ba5-4085-9e17-877c754115c8</serial>
Nov 16 10:19:23 user nova-compute[85141]: </disk>
Nov 16 10:19:23 user nova-compute[85141]:  {{(pid=85141) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 10:19:24 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-4051b8c3-df05-4069-aabc-5d3474102f59 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] No BDM found with device name vda, not building metadata. {{(pid=85141) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 10:19:24 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-4051b8c3-df05-4069-aabc-5d3474102f59 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] No BDM found with device name vdb, not building metadata. {{(pid=85141) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 10:19:24 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-4051b8c3-df05-4069-aabc-5d3474102f59 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] No VIF found with MAC fa:16:3e:ab:ca:9e, not building metadata {{(pid=85141) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 10:19:24 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:19:24 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:19:24 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Starting heal instance info cache {{(pid=85141) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 10:19:24 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-4051b8c3-df05-4069-aabc-5d3474102f59 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Lock "9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.347s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:19:24 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Acquiring lock "refresh_cache-f01dc8cf-1a69-4618-a15d-0c1075157f05" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:19:24 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Acquired lock "refresh_cache-f01dc8cf-1a69-4618-a15d-0c1075157f05" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:19:24 user nova-compute[85141]: DEBUG nova.network.neutron [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] [instance: f01dc8cf-1a69-4618-a15d-0c1075157f05] Forcefully refreshing network info cache for instance {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 10:19:25 user nova-compute[85141]: INFO nova.compute.manager [None req-7a7a4e4d-2f16-4640-a866-9af9d05426e0 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] [instance: 9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008] Rebuilding instance
Nov 16 10:19:25 user nova-compute[85141]: DEBUG nova.network.neutron [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] [instance: f01dc8cf-1a69-4618-a15d-0c1075157f05] Updating instance_info_cache with network_info: [{"id": "52edc378-51f4-43c3-b9f3-2d0201ed125d", "address": "fa:16:3e:38:1f:8f", "network": {"id": "e40e4bd2-4277-40b1-9451-1c8365ffa488", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1333036447-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "733b504d4dbe4f028963cf2c197f0064", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52edc378-51", "ovs_interfaceid": "52edc378-51f4-43c3-b9f3-2d0201ed125d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:19:25 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Releasing lock "refresh_cache-f01dc8cf-1a69-4618-a15d-0c1075157f05" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:19:25 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] [instance: f01dc8cf-1a69-4618-a15d-0c1075157f05] Updated the network info_cache for instance {{(pid=85141) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 10:19:25 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:19:25 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:19:25 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:19:25 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=85141) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 10:19:25 user nova-compute[85141]: DEBUG nova.compute.manager [None req-7a7a4e4d-2f16-4640-a866-9af9d05426e0 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] [instance: 9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008] Checking state {{(pid=85141) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 10:19:25 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:19:25 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:19:25 user nova-compute[85141]: DEBUG nova.compute.manager [req-969407af-142b-4a9a-8364-0a4652383ca7 req-7185819d-6256-444c-bfc1-b1a16ab50939 service nova] [instance: 9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008] Received event network-vif-unplugged-6e352298-a803-4a3c-8f40-dc88ee03687f {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:19:25 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-969407af-142b-4a9a-8364-0a4652383ca7 req-7185819d-6256-444c-bfc1-b1a16ab50939 service nova] Acquiring lock "9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:19:25 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-969407af-142b-4a9a-8364-0a4652383ca7 req-7185819d-6256-444c-bfc1-b1a16ab50939 service nova] Lock "9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:19:25 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-969407af-142b-4a9a-8364-0a4652383ca7 req-7185819d-6256-444c-bfc1-b1a16ab50939 service nova] Lock "9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:19:25 user nova-compute[85141]: DEBUG nova.compute.manager [req-969407af-142b-4a9a-8364-0a4652383ca7 req-7185819d-6256-444c-bfc1-b1a16ab50939 service nova] [instance: 9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008] No waiting events found dispatching network-vif-unplugged-6e352298-a803-4a3c-8f40-dc88ee03687f {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:19:25 user nova-compute[85141]: WARNING nova.compute.manager [req-969407af-142b-4a9a-8364-0a4652383ca7 req-7185819d-6256-444c-bfc1-b1a16ab50939 service nova] [instance: 9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008] Received unexpected event network-vif-unplugged-6e352298-a803-4a3c-8f40-dc88ee03687f for instance with vm_state active and task_state rebuilding.
Nov 16 10:19:25 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:19:25 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:19:26 user nova-compute[85141]: INFO nova.virt.libvirt.driver [-] [instance: 9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008] Instance destroyed successfully.
Nov 16 10:19:26 user nova-compute[85141]: INFO nova.compute.manager [None req-7a7a4e4d-2f16-4640-a866-9af9d05426e0 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] [instance: 9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008] Detaching volume 2f7784b4-2ba5-4085-9e17-877c754115c8
Nov 16 10:19:26 user nova-compute[85141]: INFO nova.virt.block_device [None req-7a7a4e4d-2f16-4640-a866-9af9d05426e0 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] [instance: 9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008] Attempting to driver detach volume 2f7784b4-2ba5-4085-9e17-877c754115c8 from mountpoint /dev/vdb
Nov 16 10:19:26 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-7a7a4e4d-2f16-4640-a866-9af9d05426e0 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Attempting to detach device vdb from instance 9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008 from the persistent domain config. {{(pid=85141) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 10:19:26 user nova-compute[85141]: DEBUG nova.virt.libvirt.guest [None req-7a7a4e4d-2f16-4640-a866-9af9d05426e0 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 10:19:26 user nova-compute[85141]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 10:19:26 user nova-compute[85141]:   <source dev="/dev/sdb"/>
Nov 16 10:19:26 user nova-compute[85141]:   <target dev="vdb" bus="virtio"/>
Nov 16 10:19:26 user nova-compute[85141]:   <serial>2f7784b4-2ba5-4085-9e17-877c754115c8</serial>
Nov 16 10:19:26 user nova-compute[85141]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 10:19:26 user nova-compute[85141]: </disk>
Nov 16 10:19:26 user nova-compute[85141]:  {{(pid=85141) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 10:19:26 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-7a7a4e4d-2f16-4640-a866-9af9d05426e0 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Successfully detached device vdb from instance 9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008 from the persistent domain config.
Nov 16 10:19:26 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7a7a4e4d-2f16-4640-a866-9af9d05426e0 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] [instance: 9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008] calling os-brick to detach iSCSI Volume {{(pid=85141) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 10:19:26 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a7a4e4d-2f16-4640-a866-9af9d05426e0 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51806b6080>, {'target_iqn': 'iqn.2010-10.org.openstack:2f7784b4-2ba5-4085-9e17-877c754115c8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yEORChLP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 10:19:26 user nova-compute[85141]: WARNING os_brick.initiator.connectors.base [None req-7a7a4e4d-2f16-4640-a866-9af9d05426e0 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 16 10:19:26 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-7a7a4e4d-2f16-4640-a866-9af9d05426e0 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 10:19:26 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-7a7a4e4d-2f16-4640-a866-9af9d05426e0 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 10:19:26 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:19:26 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:19:26 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[10da29d9-87c4-4c13-876d-af0a311c5783]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2f7784b4-2ba5-4085-9e17-877c754115c8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:674f9ae8-6ab5-4ff2-b715-fe8807c34793\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:19:26 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a7a4e4d-2f16-4640-a866-9af9d05426e0 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 10:19:26 user nova-compute[85141]: No targets found.
Nov 16 10:19:26 user nova-compute[85141]: iSNS:
Nov 16 10:19:26 user nova-compute[85141]: No targets found.
Nov 16 10:19:26 user nova-compute[85141]: STATIC:
Nov 16 10:19:26 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee
Nov 16 10:19:26 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:19:26 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:19:26 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:2f7784b4-2ba5-4085-9e17-877c754115c8
Nov 16 10:19:26 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:19:26 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:19:26 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:674f9ae8-6ab5-4ff2-b715-fe8807c34793
Nov 16 10:19:26 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:19:26 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:19:26 user nova-compute[85141]: FIRMWARE:
Nov 16 10:19:26 user nova-compute[85141]: No targets found.
Nov 16 10:19:26 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:19:26 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a7a4e4d-2f16-4640-a866-9af9d05426e0 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 10:19:26 user nova-compute[85141]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 10:19:26 user nova-compute[85141]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=85141) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 10:19:26 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a7a4e4d-2f16-4640-a866-9af9d05426e0 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2f7784b4-2ba5-4085-9e17-877c754115c8', 0)] {{(pid=85141) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 10:19:26 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:19:26 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:19:26 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff46f8ed-1f45-45f1-b6f3-e6034b1d75fc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2f7784b4-2ba5-4085-9e17-877c754115c8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:674f9ae8-6ab5-4ff2-b715-fe8807c34793\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:19:26 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:19:26 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:19:26 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[68e24ed4-fa26-4408-bbb5-db09e73e92dd]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:674f9ae8-6ab5-4ff2-b715-fe8807c34793 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7784b4-2ba5-4085-9e17-877c754115c8 (non-flash)\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:19:26 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a7a4e4d-2f16-4640-a866-9af9d05426e0 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)
Nov 16 10:19:26 user nova-compute[85141]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:674f9ae8-6ab5-4ff2-b715-fe8807c34793 (non-flash)
Nov 16 10:19:26 user nova-compute[85141]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7784b4-2ba5-4085-9e17-877c754115c8 (non-flash)
Nov 16 10:19:26 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:19:26 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a7a4e4d-2f16-4640-a866-9af9d05426e0 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)
Nov 16 10:19:26 user nova-compute[85141]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:674f9ae8-6ab5-4ff2-b715-fe8807c34793 (non-flash)
Nov 16 10:19:26 user nova-compute[85141]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7784b4-2ba5-4085-9e17-877c754115c8 (non-flash)
Nov 16 10:19:26 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 10:19:26 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a7a4e4d-2f16-4640-a866-9af9d05426e0 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5180501e10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2f7784b4-2ba5-4085-9e17-877c754115c8'): ({'sdb'}, set())}) {{(pid=85141) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 10:19:26 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-7a7a4e4d-2f16-4640-a866-9af9d05426e0 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Removing single pathed devices sdb {{(pid=85141) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 10:19:26 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:19:26 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:19:26 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fe7faba-10f2-4446-97d9-8e6003b694a4]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:19:26 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:19:26 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:19:26 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[33f68ab3-4456-41ac-b103-763c694aac1f]: (4, ('ok\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:19:26 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-7a7a4e4d-2f16-4640-a866-9af9d05426e0 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Flushing IO for device /dev/sdb {{(pid=85141) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 10:19:26 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:19:26 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:19:26 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ba58caa-1b43-412c-925d-d36f5095a4a0]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:19:26 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-7a7a4e4d-2f16-4640-a866-9af9d05426e0 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=85141) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 10:19:26 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:19:26 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.055s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:19:26 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[93bb1186-bcc4-47ab-a573-25f0f2b9f273]: (4, ('1', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:19:26 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-7a7a4e4d-2f16-4640-a866-9af9d05426e0 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=85141) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 10:19:26 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-7a7a4e4d-2f16-4640-a866-9af9d05426e0 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] SCSI volumes sdb have been removed. {{(pid=85141) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 10:19:26 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a7a4e4d-2f16-4640-a866-9af9d05426e0 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2f7784b4-2ba5-4085-9e17-877c754115c8')] {{(pid=85141) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 10:19:26 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f7784b4-2ba5-4085-9e17-877c754115c8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:19:26 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f7784b4-2ba5-4085-9e17-877c754115c8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:19:26 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ba100a4-2d40-4f17-9419-38db60e4573f]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:19:26 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a7a4e4d-2f16-4640-a866-9af9d05426e0 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:19:26 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f7784b4-2ba5-4085-9e17-877c754115c8 -p 172.16.0.220:3260 --logout {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:19:26 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f7784b4-2ba5-4085-9e17-877c754115c8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:19:26 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[262e6469-13cd-4a82-bc15-0d16eea723a0]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:2f7784b4-2ba5-4085-9e17-877c754115c8, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:2f7784b4-2ba5-4085-9e17-877c754115c8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:19:26 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a7a4e4d-2f16-4640-a866-9af9d05426e0 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:2f7784b4-2ba5-4085-9e17-877c754115c8, portal: 172.16.0.220,3260]
Nov 16 10:19:26 user nova-compute[85141]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:2f7784b4-2ba5-4085-9e17-877c754115c8, portal: 172.16.0.220,3260] successful.
Nov 16 10:19:26 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:19:26 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f7784b4-2ba5-4085-9e17-877c754115c8 -p 172.16.0.220:3260 --op delete {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:19:26 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f7784b4-2ba5-4085-9e17-877c754115c8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:19:26 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[71f9a17e-077f-4d23-ae3a-4fc78f1bf991]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:19:26 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a7a4e4d-2f16-4640-a866-9af9d05426e0 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:19:26 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-7a7a4e4d-2f16-4640-a866-9af9d05426e0 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.300s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 10:19:26 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a7a4e4d-2f16-4640-a866-9af9d05426e0 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] <== disconnect_volume: return (302ms) None {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 10:19:26 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7a7a4e4d-2f16-4640-a866-9af9d05426e0 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] [instance: 9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008] Disconnected iSCSI Volume {{(pid=85141) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 10:19:26 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-698f16d4-46fd-45fa-b4aa-17c293fa83f6 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] Acquiring lock "fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:19:26 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-698f16d4-46fd-45fa-b4aa-17c293fa83f6 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] Lock "fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:19:26 user nova-compute[85141]: DEBUG nova.objects.instance [None req-698f16d4-46fd-45fa-b4aa-17c293fa83f6 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] Lazy-loading 'flavor' on Instance uuid fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:19:27 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-698f16d4-46fd-45fa-b4aa-17c293fa83f6 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] Lock "fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.080s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:19:27 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-698f16d4-46fd-45fa-b4aa-17c293fa83f6 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] Acquiring lock "fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:19:27 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-698f16d4-46fd-45fa-b4aa-17c293fa83f6 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] Lock "fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:19:27 user nova-compute[85141]: INFO nova.compute.manager [None req-698f16d4-46fd-45fa-b4aa-17c293fa83f6 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] [instance: fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f] Attaching volume 3392fa71-5ceb-42f9-acb8-b9e69b8b1cfa to /dev/vdb
Nov 16 10:19:27 user nova-compute[85141]: DEBUG os_brick.utils [None req-698f16d4-46fd-45fa-b4aa-17c293fa83f6 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 10:19:27 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:19:27 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:19:27 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[87ac4af9-b1ea-495d-8a46-e41ddc6b97c3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c7834de5c295\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:19:27 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:19:27 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:19:27 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[04c58d11-dd38-49b9-90b7-af4345e895f6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:19:27 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:19:27 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:19:27 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[d36dc3e7-0b66-4ac2-b0b8-db062be5a3c1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:19:27 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[54a959fa-d8d8-4441-b5b6-50cc9153d3a6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:19:27 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-698f16d4-46fd-45fa-b4aa-17c293fa83f6 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] Running cmd (subprocess): nvme version {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:19:27 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-698f16d4-46fd-45fa-b4aa-17c293fa83f6 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] 'nvme version' failed. Not Retrying. {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 10:19:27 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.nvmeof [None req-698f16d4-46fd-45fa-b4aa-17c293fa83f6 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] nvme not present on system {{(pid=85141) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 10:19:27 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:19:27 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 10:19:27 user nova-compute[85141]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 10:19:27 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc37bdd4-9080-400e-8985-42ae5d395650]: (4, '') {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:19:27 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.lightos [None req-698f16d4-46fd-45fa-b4aa-17c293fa83f6 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=85141) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 10:19:27 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.lightos [None req-698f16d4-46fd-45fa-b4aa-17c293fa83f6 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=85141) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 10:19:27 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.lightos [None req-698f16d4-46fd-45fa-b4aa-17c293fa83f6 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] LIGHTOS: no hostnqn found. {{(pid=85141) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 10:19:27 user nova-compute[85141]: DEBUG os_brick.utils [None req-698f16d4-46fd-45fa-b4aa-17c293fa83f6 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c7834de5c295', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 10:19:27 user nova-compute[85141]: DEBUG nova.virt.block_device [None req-698f16d4-46fd-45fa-b4aa-17c293fa83f6 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] [instance: fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f] Updating existing volume attachment record: 8c82e1d9-8d90-4d20-87d8-bf47ef16d2dd {{(pid=85141) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 10:19:27 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:19:27 user nova-compute[85141]: DEBUG nova.compute.manager [req-b082c64a-c679-4e39-a4fa-9faf5dbb3c38 req-a8dec9da-c931-4f58-aed8-a32fa161acf8 service nova] [instance: 9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008] Received event network-vif-plugged-6e352298-a803-4a3c-8f40-dc88ee03687f {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:19:27 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-b082c64a-c679-4e39-a4fa-9faf5dbb3c38 req-a8dec9da-c931-4f58-aed8-a32fa161acf8 service nova] Acquiring lock "9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:19:27 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-b082c64a-c679-4e39-a4fa-9faf5dbb3c38 req-a8dec9da-c931-4f58-aed8-a32fa161acf8 service nova] Lock "9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:19:27 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-b082c64a-c679-4e39-a4fa-9faf5dbb3c38 req-a8dec9da-c931-4f58-aed8-a32fa161acf8 service nova] Lock "9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:19:27 user nova-compute[85141]: DEBUG nova.compute.manager [req-b082c64a-c679-4e39-a4fa-9faf5dbb3c38 req-a8dec9da-c931-4f58-aed8-a32fa161acf8 service nova] [instance: 9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008] No waiting events found dispatching network-vif-plugged-6e352298-a803-4a3c-8f40-dc88ee03687f {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:19:27 user nova-compute[85141]: WARNING nova.compute.manager [req-b082c64a-c679-4e39-a4fa-9faf5dbb3c38 req-a8dec9da-c931-4f58-aed8-a32fa161acf8 service nova] [instance: 9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008] Received unexpected event network-vif-plugged-6e352298-a803-4a3c-8f40-dc88ee03687f for instance with vm_state active and task_state rebuilding.
Nov 16 10:19:27 user nova-compute[85141]: INFO nova.virt.libvirt.driver [-] [instance: 9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008] Instance destroyed successfully.
Nov 16 10:19:27 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-7a7a4e4d-2f16-4640-a866-9af9d05426e0 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T10:17:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1065707614',display_name='tempest-ServerActionsTestOtherA-server-1206991665',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1065707614',id=21,image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLYW31ovczNyLDED4yKs9dsdr/XSErfr1XRe8heGwagMSLKlZc0gAr6TCWuL5DKCAIkQKMPHxCnrx6sG+CmW97Y7nMFFBSlsHjdgZoOxsnNiaYYiicSNNLBDSCW1u0DNWw==',key_name='tempest-keypair-1951575816',keypairs=<?>,launch_index=0,launched_at=2023-11-16T10:17:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='879fa3f4dfc34726b20149b8a7db22dc',ramdisk_id='',reservation_id='r-0bhqn0jn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1137992555',owner_user_name='tempest-ServerActionsTestOtherA-1137992555-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T10:19:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e95802a919de4345add493a8d7873e48',uuid=9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6e352298-a803-4a3c-8f40-dc88ee03687f", "address": "fa:16:3e:ab:ca:9e", "network": {"id": "859d1f09-56c4-4c2b-b2c3-02b1938e8dbf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1562516834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "879fa3f4dfc34726b20149b8a7db22dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e352298-a8", "ovs_interfaceid": "6e352298-a803-4a3c-8f40-dc88ee03687f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 10:19:27 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-7a7a4e4d-2f16-4640-a866-9af9d05426e0 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Converting VIF {"id": "6e352298-a803-4a3c-8f40-dc88ee03687f", "address": "fa:16:3e:ab:ca:9e", "network": {"id": "859d1f09-56c4-4c2b-b2c3-02b1938e8dbf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1562516834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "879fa3f4dfc34726b20149b8a7db22dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e352298-a8", "ovs_interfaceid": "6e352298-a803-4a3c-8f40-dc88ee03687f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:19:27 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-7a7a4e4d-2f16-4640-a866-9af9d05426e0 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ab:ca:9e,bridge_name='br-int',has_traffic_filtering=True,id=6e352298-a803-4a3c-8f40-dc88ee03687f,network=Network(859d1f09-56c4-4c2b-b2c3-02b1938e8dbf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e352298-a8') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:19:27 user nova-compute[85141]: DEBUG os_vif [None req-7a7a4e4d-2f16-4640-a866-9af9d05426e0 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ab:ca:9e,bridge_name='br-int',has_traffic_filtering=True,id=6e352298-a803-4a3c-8f40-dc88ee03687f,network=Network(859d1f09-56c4-4c2b-b2c3-02b1938e8dbf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e352298-a8') {{(pid=85141) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 10:19:27 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:19:27 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6e352298-a8, bridge=br-int, if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:19:27 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:19:27 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:19:27 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:19:27 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8f02f0e2-ffa8-48ec-beca-f5c137ab67c6) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:19:27 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:19:27 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:19:27 user nova-compute[85141]: INFO os_vif [None req-7a7a4e4d-2f16-4640-a866-9af9d05426e0 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ab:ca:9e,bridge_name='br-int',has_traffic_filtering=True,id=6e352298-a803-4a3c-8f40-dc88ee03687f,network=Network(859d1f09-56c4-4c2b-b2c3-02b1938e8dbf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e352298-a8')
Nov 16 10:19:27 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7a7a4e4d-2f16-4640-a866-9af9d05426e0 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] [instance: 9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008] calling os-brick to detach iSCSI Volume {{(pid=85141) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 10:19:27 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a7a4e4d-2f16-4640-a866-9af9d05426e0 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51806b6080>, {'target_iqn': 'iqn.2010-10.org.openstack:2f7784b4-2ba5-4085-9e17-877c754115c8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yEORChLP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 10:19:27 user nova-compute[85141]: WARNING os_brick.initiator.connectors.base [None req-7a7a4e4d-2f16-4640-a866-9af9d05426e0 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 16 10:19:27 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-7a7a4e4d-2f16-4640-a866-9af9d05426e0 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 10:19:27 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-7a7a4e4d-2f16-4640-a866-9af9d05426e0 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 10:19:27 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:19:27 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:19:27 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[378d1830-576f-4fef-bb03-a5eb6210fa6b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:674f9ae8-6ab5-4ff2-b715-fe8807c34793\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:19:27 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a7a4e4d-2f16-4640-a866-9af9d05426e0 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 10:19:27 user nova-compute[85141]: No targets found.
Nov 16 10:19:27 user nova-compute[85141]: iSNS:
Nov 16 10:19:27 user nova-compute[85141]: No targets found.
Nov 16 10:19:27 user nova-compute[85141]: STATIC:
Nov 16 10:19:27 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee
Nov 16 10:19:27 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:19:27 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:19:27 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:674f9ae8-6ab5-4ff2-b715-fe8807c34793
Nov 16 10:19:27 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:19:27 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:19:27 user nova-compute[85141]: FIRMWARE:
Nov 16 10:19:27 user nova-compute[85141]: No targets found.
Nov 16 10:19:27 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:19:27 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a7a4e4d-2f16-4640-a866-9af9d05426e0 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 10:19:27 user nova-compute[85141]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 10:19:27 user nova-compute[85141]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=85141) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 10:19:27 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a7a4e4d-2f16-4640-a866-9af9d05426e0 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2f7784b4-2ba5-4085-9e17-877c754115c8', 0)] {{(pid=85141) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 10:19:27 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:19:27 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:19:27 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[b63b9cdd-e1b4-4c27-a9b2-2b3f20cd5130]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:674f9ae8-6ab5-4ff2-b715-fe8807c34793\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:19:27 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:19:27 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:19:27 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d35cc6f-4f04-43f8-8f01-5e078b7b8d9c]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:674f9ae8-6ab5-4ff2-b715-fe8807c34793 (non-flash)\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:19:27 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a7a4e4d-2f16-4640-a866-9af9d05426e0 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)
Nov 16 10:19:27 user nova-compute[85141]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:674f9ae8-6ab5-4ff2-b715-fe8807c34793 (non-flash)
Nov 16 10:19:27 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:19:27 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a7a4e4d-2f16-4640-a866-9af9d05426e0 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)
Nov 16 10:19:27 user nova-compute[85141]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:674f9ae8-6ab5-4ff2-b715-fe8807c34793 (non-flash)
Nov 16 10:19:27 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 10:19:27 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a7a4e4d-2f16-4640-a866-9af9d05426e0 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f51a0a5d7e0>, {}) {{(pid=85141) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 10:19:27 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a7a4e4d-2f16-4640-a866-9af9d05426e0 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Disconnecting from: [] {{(pid=85141) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 10:19:28 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-7a7a4e4d-2f16-4640-a866-9af9d05426e0 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.071s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 10:19:28 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a7a4e4d-2f16-4640-a866-9af9d05426e0 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] <== disconnect_volume: return (73ms) None {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 10:19:28 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7a7a4e4d-2f16-4640-a866-9af9d05426e0 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] [instance: 9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008] Disconnected iSCSI Volume {{(pid=85141) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 10:19:28 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-7a7a4e4d-2f16-4640-a866-9af9d05426e0 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] [instance: 9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008] Deleting instance files /opt/stack/data/nova/instances/9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008_del
Nov 16 10:19:28 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-7a7a4e4d-2f16-4640-a866-9af9d05426e0 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] [instance: 9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008] Deletion of /opt/stack/data/nova/instances/9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008_del complete
Nov 16 10:19:28 user nova-compute[85141]: INFO nova.virt.block_device [None req-7a7a4e4d-2f16-4640-a866-9af9d05426e0 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] [instance: 9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008] Booting with volume 2f7784b4-2ba5-4085-9e17-877c754115c8 at /dev/vdb
Nov 16 10:19:28 user nova-compute[85141]: DEBUG os_brick.utils [None req-7a7a4e4d-2f16-4640-a866-9af9d05426e0 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 10:19:28 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:19:28 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:19:28 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[45b4f533-903e-4647-8dd1-7b6ee340e0ec]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c7834de5c295\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:19:28 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:19:28 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:19:28 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b209fdf-7fcf-4275-8b83-a4c1218cf71d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:19:28 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:19:28 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:19:28 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[4db9de8c-c95d-4dc5-8d19-564d63590b82]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:19:28 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e0908cf-013c-4ca8-913b-889c7880946f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:19:28 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-7a7a4e4d-2f16-4640-a866-9af9d05426e0 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Running cmd (subprocess): nvme version {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:19:28 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-7a7a4e4d-2f16-4640-a866-9af9d05426e0 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] 'nvme version' failed. Not Retrying. {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 10:19:28 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7a7a4e4d-2f16-4640-a866-9af9d05426e0 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] nvme not present on system {{(pid=85141) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 10:19:28 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:19:28 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 10:19:28 user nova-compute[85141]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 10:19:28 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[6479e728-76b1-46ba-bd5d-5946f09896a1]: (4, '') {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:19:28 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.lightos [None req-7a7a4e4d-2f16-4640-a866-9af9d05426e0 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=85141) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 10:19:28 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.lightos [None req-7a7a4e4d-2f16-4640-a866-9af9d05426e0 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=85141) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 10:19:28 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.lightos [None req-7a7a4e4d-2f16-4640-a866-9af9d05426e0 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] LIGHTOS: no hostnqn found. {{(pid=85141) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 10:19:28 user nova-compute[85141]: DEBUG os_brick.utils [None req-7a7a4e4d-2f16-4640-a866-9af9d05426e0 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c7834de5c295', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 10:19:28 user nova-compute[85141]: DEBUG nova.virt.block_device [None req-7a7a4e4d-2f16-4640-a866-9af9d05426e0 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] [instance: 9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008] Updating existing volume attachment record: 57283c37-196d-4e6d-8ec2-bb39ad92e0d5 {{(pid=85141) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 10:19:28 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:19:28 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager.update_available_resource {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:19:28 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:19:28 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:19:28 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:19:28 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Auditing locally available compute resources for user (node: user) {{(pid=85141) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 10:19:28 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:19:28 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:19:28 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:19:28 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:19:28 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d842f90e-663b-4c95-9d7c-d092d2bac41f/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:19:29 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d20dbdb7-3d7e-4f46-981f-92308223e2e1 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] [instance: 2d7787a2-b8da-4d39-9b16-4c7bcb275f85] Calling os-brick to attach iSCSI Volume {{(pid=85141) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 10:19:29 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-d20dbdb7-3d7e-4f46-981f-92308223e2e1 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51806b6080>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7dc504e0-da46-4c57-a66d-8ae6ce9c733c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iFVOdJIq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 10:19:29 user nova-compute[85141]: WARNING os_brick.initiator.connectors.base [None req-d20dbdb7-3d7e-4f46-981f-92308223e2e1 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 10:19:29 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-d20dbdb7-3d7e-4f46-981f-92308223e2e1 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 10:19:29 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-d20dbdb7-3d7e-4f46-981f-92308223e2e1 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 10:19:29 user nova-compute[85141]: WARNING os_brick.initiator.connectors.base [None req-d20dbdb7-3d7e-4f46-981f-92308223e2e1 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 10:19:29 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-d20dbdb7-3d7e-4f46-981f-92308223e2e1 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7dc504e0-da46-4c57-a66d-8ae6ce9c733c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 10:19:29 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-d20dbdb7-3d7e-4f46-981f-92308223e2e1 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7dc504e0-da46-4c57-a66d-8ae6ce9c733c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 10:19:29 user nova-compute[85141]: INFO os_brick.initiator.connectors.iscsi [None req-d20dbdb7-3d7e-4f46-981f-92308223e2e1 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 10:19:29 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7dc504e0-da46-4c57-a66d-8ae6ce9c733c -p 172.16.0.220:3260 {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:19:29 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7dc504e0-da46-4c57-a66d-8ae6ce9c733c -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:19:29 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[32811c83-ec62-4812-a140-4826af0ee418]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:19:29 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-d20dbdb7-3d7e-4f46-981f-92308223e2e1 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 10:19:29 user nova-compute[85141]:  {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:19:29 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7dc504e0-da46-4c57-a66d-8ae6ce9c733c -p 172.16.0.220:3260 --interface default --op new {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:19:29 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d842f90e-663b-4c95-9d7c-d092d2bac41f/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:19:29 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d842f90e-663b-4c95-9d7c-d092d2bac41f/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:19:29 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7dc504e0-da46-4c57-a66d-8ae6ce9c733c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:19:29 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[348b9c05-0f1b-4d70-bd10-6cd581d3fff5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7dc504e0-da46-4c57-a66d-8ae6ce9c733c] added\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:19:29 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-d20dbdb7-3d7e-4f46-981f-92308223e2e1 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7dc504e0-da46-4c57-a66d-8ae6ce9c733c] added
Nov 16 10:19:29 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:19:29 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7dc504e0-da46-4c57-a66d-8ae6ce9c733c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:19:29 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7dc504e0-da46-4c57-a66d-8ae6ce9c733c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:19:29 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[372854ac-1c3e-4c86-9d86-ef7376434f1c]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:19:29 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-d20dbdb7-3d7e-4f46-981f-92308223e2e1 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:19:29 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7dc504e0-da46-4c57-a66d-8ae6ce9c733c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:19:29 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7dc504e0-da46-4c57-a66d-8ae6ce9c733c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:19:29 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf2c9883-bd05-473f-a1b2-167ead08e25b]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:19:29 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-d20dbdb7-3d7e-4f46-981f-92308223e2e1 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:19:29 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7dc504e0-da46-4c57-a66d-8ae6ce9c733c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iFVOdJIq {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:19:29 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7dc504e0-da46-4c57-a66d-8ae6ce9c733c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iFVOdJIq" returned: 0 in 0.019s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:19:29 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2605dbe-a991-4922-909f-a520b12c690f]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:19:29 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-d20dbdb7-3d7e-4f46-981f-92308223e2e1 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'iFVOdJIq'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:19:29 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7dc504e0-da46-4c57-a66d-8ae6ce9c733c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:19:29 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7dc504e0-da46-4c57-a66d-8ae6ce9c733c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:19:29 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[eea842d1-5d5f-430f-ba2e-afd31da750fd]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:19:29 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-d20dbdb7-3d7e-4f46-981f-92308223e2e1 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:19:29 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:19:29 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:19:29 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[9561efdf-c84a-4a07-8148-f457c8508800]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:674f9ae8-6ab5-4ff2-b715-fe8807c34793 (non-flash)\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:19:29 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-d20dbdb7-3d7e-4f46-981f-92308223e2e1 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)
Nov 16 10:19:29 user nova-compute[85141]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:674f9ae8-6ab5-4ff2-b715-fe8807c34793 (non-flash)
Nov 16 10:19:29 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:19:29 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-d20dbdb7-3d7e-4f46-981f-92308223e2e1 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)
Nov 16 10:19:29 user nova-compute[85141]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:674f9ae8-6ab5-4ff2-b715-fe8807c34793 (non-flash)
Nov 16 10:19:29 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 10:19:29 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7dc504e0-da46-4c57-a66d-8ae6ce9c733c -p 172.16.0.220:3260 --login {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:19:29 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d842f90e-663b-4c95-9d7c-d092d2bac41f/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:19:29 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d7787a2-b8da-4d39-9b16-4c7bcb275f85/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:19:29 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7dc504e0-da46-4c57-a66d-8ae6ce9c733c -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:19:29 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bed979b-04e5-4ea7-b846-20a44fdfee39]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7dc504e0-da46-4c57-a66d-8ae6ce9c733c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7dc504e0-da46-4c57-a66d-8ae6ce9c733c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:19:29 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-d20dbdb7-3d7e-4f46-981f-92308223e2e1 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7dc504e0-da46-4c57-a66d-8ae6ce9c733c, portal: 172.16.0.220,3260]
Nov 16 10:19:29 user nova-compute[85141]: Login to [iface: default, target: iqn.2010-10.org.openstack:7dc504e0-da46-4c57-a66d-8ae6ce9c733c, portal: 172.16.0.220,3260] successful.
Nov 16 10:19:29 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:19:29 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7dc504e0-da46-4c57-a66d-8ae6ce9c733c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:19:29 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7dc504e0-da46-4c57-a66d-8ae6ce9c733c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:19:29 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[15a61ef8-fdf6-4dc1-bea9-5323999e5cbf]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:19:29 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-d20dbdb7-3d7e-4f46-981f-92308223e2e1 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:19:29 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:19:29 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:19:29 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[157eb9a8-57a4-431b-ae21-4e88845b29be]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:674f9ae8-6ab5-4ff2-b715-fe8807c34793 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dc504e0-da46-4c57-a66d-8ae6ce9c733c (non-flash)\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:19:29 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-d20dbdb7-3d7e-4f46-981f-92308223e2e1 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)
Nov 16 10:19:29 user nova-compute[85141]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:674f9ae8-6ab5-4ff2-b715-fe8807c34793 (non-flash)
Nov 16 10:19:29 user nova-compute[85141]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dc504e0-da46-4c57-a66d-8ae6ce9c733c (non-flash)
Nov 16 10:19:29 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:19:29 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-d20dbdb7-3d7e-4f46-981f-92308223e2e1 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)
Nov 16 10:19:29 user nova-compute[85141]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:674f9ae8-6ab5-4ff2-b715-fe8807c34793 (non-flash)
Nov 16 10:19:29 user nova-compute[85141]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dc504e0-da46-4c57-a66d-8ae6ce9c733c (non-flash)
Nov 16 10:19:29 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 10:19:29 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-d20dbdb7-3d7e-4f46-981f-92308223e2e1 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7dc504e0-da46-4c57-a66d-8ae6ce9c733c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.343s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 10:19:29 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-d20dbdb7-3d7e-4f46-981f-92308223e2e1 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Connected to 172.16.0.220:3260 {{(pid=85141) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 10:19:29 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-d20dbdb7-3d7e-4f46-981f-92308223e2e1 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] HCTL ('33', '-', '-', 0) found on session 27 with lun 0 {{(pid=85141) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 10:19:29 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-d20dbdb7-3d7e-4f46-981f-92308223e2e1 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=85141) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 10:19:29 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:19:29 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:19:29 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[3206cf6c-1af9-42ff-9474-1c9471198c1a]: (4, ('- - 0', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:19:29 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-d20dbdb7-3d7e-4f46-981f-92308223e2e1 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Searching for a device in session 27 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=85141) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 10:19:29 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-d20dbdb7-3d7e-4f46-981f-92308223e2e1 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:7dc504e0-da46-4c57-a66d-8ae6ce9c733c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iFVOdJIq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=85141) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 10:19:29 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d7787a2-b8da-4d39-9b16-4c7bcb275f85/disk --force-share --output=json" returned: 0 in 0.250s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:19:29 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d7787a2-b8da-4d39-9b16-4c7bcb275f85/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:19:29 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d7787a2-b8da-4d39-9b16-4c7bcb275f85/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:19:29 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bff3a84b-6ab5-4256-8a04-2d21a4ba20b3/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:19:29 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bff3a84b-6ab5-4256-8a04-2d21a4ba20b3/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:19:29 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bff3a84b-6ab5-4256-8a04-2d21a4ba20b3/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:19:30 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bff3a84b-6ab5-4256-8a04-2d21a4ba20b3/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:19:30 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e214bbb-5bbb-4e6f-ac09-9cb1412f068b/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:19:30 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e214bbb-5bbb-4e6f-ac09-9cb1412f068b/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:19:30 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e214bbb-5bbb-4e6f-ac09-9cb1412f068b/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:19:30 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-d20dbdb7-3d7e-4f46-981f-92308223e2e1 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.381s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 10:19:30 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-d20dbdb7-3d7e-4f46-981f-92308223e2e1 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] <== connect_volume: return (1387ms) {'type': 'block', 'scsi_wwn': '23633336435663635', 'path': '/dev/sdb'} {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 10:19:30 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d20dbdb7-3d7e-4f46-981f-92308223e2e1 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] [instance: 2d7787a2-b8da-4d39-9b16-4c7bcb275f85] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23633336435663635', 'path': '/dev/sdb'} {{(pid=85141) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 10:19:30 user nova-compute[85141]: DEBUG nova.objects.instance [None req-d20dbdb7-3d7e-4f46-981f-92308223e2e1 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Lazy-loading 'flavor' on Instance uuid 2d7787a2-b8da-4d39-9b16-4c7bcb275f85 {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:19:30 user nova-compute[85141]: DEBUG nova.virt.libvirt.guest [None req-d20dbdb7-3d7e-4f46-981f-92308223e2e1 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 10:19:30 user nova-compute[85141]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 10:19:30 user nova-compute[85141]:   <source dev="/dev/sdb"/>
Nov 16 10:19:30 user nova-compute[85141]:   <target dev="vdb" bus="virtio"/>
Nov 16 10:19:30 user nova-compute[85141]:   <serial>7dc504e0-da46-4c57-a66d-8ae6ce9c733c</serial>
Nov 16 10:19:30 user nova-compute[85141]: </disk>
Nov 16 10:19:30 user nova-compute[85141]:  {{(pid=85141) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 10:19:30 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e214bbb-5bbb-4e6f-ac09-9cb1412f068b/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:19:30 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11986c5b-6914-491e-8e71-983ab6b13c6e/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:19:30 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11986c5b-6914-491e-8e71-983ab6b13c6e/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:19:30 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11986c5b-6914-491e-8e71-983ab6b13c6e/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:19:30 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11986c5b-6914-491e-8e71-983ab6b13c6e/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:19:30 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b24c3954-06ff-4e15-9e43-c65d1dae7a5d/disk.rescue --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:19:30 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-d20dbdb7-3d7e-4f46-981f-92308223e2e1 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] No BDM found with device name vda, not building metadata. {{(pid=85141) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 10:19:30 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-d20dbdb7-3d7e-4f46-981f-92308223e2e1 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] No BDM found with device name vdb, not building metadata. {{(pid=85141) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 10:19:30 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-d20dbdb7-3d7e-4f46-981f-92308223e2e1 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] No VIF found with MAC fa:16:3e:1c:29:6f, not building metadata {{(pid=85141) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 10:19:31 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-d20dbdb7-3d7e-4f46-981f-92308223e2e1 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Lock "2d7787a2-b8da-4d39-9b16-4c7bcb275f85" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.811s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:19:31 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b24c3954-06ff-4e15-9e43-c65d1dae7a5d/disk.rescue --force-share --output=json" returned: 0 in 0.232s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:19:31 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b24c3954-06ff-4e15-9e43-c65d1dae7a5d/disk.rescue --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:19:31 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b24c3954-06ff-4e15-9e43-c65d1dae7a5d/disk.rescue --force-share --output=json" returned: 0 in 0.205s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:19:31 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b24c3954-06ff-4e15-9e43-c65d1dae7a5d/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:19:31 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b24c3954-06ff-4e15-9e43-c65d1dae7a5d/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:19:31 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b24c3954-06ff-4e15-9e43-c65d1dae7a5d/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:19:31 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b24c3954-06ff-4e15-9e43-c65d1dae7a5d/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:19:31 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=85141) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 10:19:31 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/059d6974-bd0c-4f73-91fc-8202ebda4238/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:19:31 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/059d6974-bd0c-4f73-91fc-8202ebda4238/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:19:31 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/059d6974-bd0c-4f73-91fc-8202ebda4238/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:19:32 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/059d6974-bd0c-4f73-91fc-8202ebda4238/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:19:32 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b388b98-4e65-4258-bbe2-77e699321fb7/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:19:32 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b388b98-4e65-4258-bbe2-77e699321fb7/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:19:32 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b388b98-4e65-4258-bbe2-77e699321fb7/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:19:32 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:19:32 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b388b98-4e65-4258-bbe2-77e699321fb7/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:19:32 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=85141) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 10:19:33 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:19:33 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-698f16d4-46fd-45fa-b4aa-17c293fa83f6 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] [instance: fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f] Calling os-brick to attach iSCSI Volume {{(pid=85141) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 10:19:33 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-698f16d4-46fd-45fa-b4aa-17c293fa83f6 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51806b6080>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3392fa71-5ceb-42f9-acb8-b9e69b8b1cfa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'svSOAuQY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 10:19:33 user nova-compute[85141]: WARNING os_brick.initiator.connectors.base [None req-698f16d4-46fd-45fa-b4aa-17c293fa83f6 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 10:19:33 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-698f16d4-46fd-45fa-b4aa-17c293fa83f6 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 10:19:33 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-698f16d4-46fd-45fa-b4aa-17c293fa83f6 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 10:19:33 user nova-compute[85141]: WARNING os_brick.initiator.connectors.base [None req-698f16d4-46fd-45fa-b4aa-17c293fa83f6 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 10:19:33 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-698f16d4-46fd-45fa-b4aa-17c293fa83f6 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3392fa71-5ceb-42f9-acb8-b9e69b8b1cfa" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 10:19:33 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-698f16d4-46fd-45fa-b4aa-17c293fa83f6 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3392fa71-5ceb-42f9-acb8-b9e69b8b1cfa" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 10:19:33 user nova-compute[85141]: INFO os_brick.initiator.connectors.iscsi [None req-698f16d4-46fd-45fa-b4aa-17c293fa83f6 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 10:19:33 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3392fa71-5ceb-42f9-acb8-b9e69b8b1cfa -p 172.16.0.220:3260 {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:19:33 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:19:33 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:19:33 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Hypervisor/Node resource view: name=user free_ram=7398MB free_disk=25.09445571899414GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=85141) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 10:19:33 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:19:33 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:19:33 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3392fa71-5ceb-42f9-acb8-b9e69b8b1cfa -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:19:33 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf86f10e-b60f-4738-9dc4-25f32dd13f3b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:19:33 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-698f16d4-46fd-45fa-b4aa-17c293fa83f6 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 10:19:33 user nova-compute[85141]:  {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:19:33 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3392fa71-5ceb-42f9-acb8-b9e69b8b1cfa -p 172.16.0.220:3260 --interface default --op new {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:19:33 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3392fa71-5ceb-42f9-acb8-b9e69b8b1cfa -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:19:33 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[85de747d-7d0f-4470-887f-059d4cb44055]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3392fa71-5ceb-42f9-acb8-b9e69b8b1cfa] added\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:19:33 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-698f16d4-46fd-45fa-b4aa-17c293fa83f6 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3392fa71-5ceb-42f9-acb8-b9e69b8b1cfa] added
Nov 16 10:19:33 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:19:33 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3392fa71-5ceb-42f9-acb8-b9e69b8b1cfa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:19:33 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3392fa71-5ceb-42f9-acb8-b9e69b8b1cfa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:19:33 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5edb434-da7a-495e-abc5-89338dbd0e6c]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:19:33 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-698f16d4-46fd-45fa-b4aa-17c293fa83f6 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:19:33 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3392fa71-5ceb-42f9-acb8-b9e69b8b1cfa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:19:33 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3392fa71-5ceb-42f9-acb8-b9e69b8b1cfa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:19:33 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a3bd743-9082-445d-8cc3-138156b7e359]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:19:33 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-698f16d4-46fd-45fa-b4aa-17c293fa83f6 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:19:33 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3392fa71-5ceb-42f9-acb8-b9e69b8b1cfa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v svSOAuQY {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:19:33 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3392fa71-5ceb-42f9-acb8-b9e69b8b1cfa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v svSOAuQY" returned: 0 in 0.026s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:19:33 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaea4860-f6e3-4341-9ade-ccbe6fc71a2e]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:19:33 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-698f16d4-46fd-45fa-b4aa-17c293fa83f6 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'svSOAuQY'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:19:33 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3392fa71-5ceb-42f9-acb8-b9e69b8b1cfa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:19:33 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance d842f90e-663b-4c95-9d7c-d092d2bac41f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:19:33 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance f01dc8cf-1a69-4618-a15d-0c1075157f05 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:19:33 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance 059d6974-bd0c-4f73-91fc-8202ebda4238 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:19:33 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance 4e214bbb-5bbb-4e6f-ac09-9cb1412f068b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:19:33 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance b24c3954-06ff-4e15-9e43-c65d1dae7a5d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:19:33 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:19:33 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance 9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:19:33 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance 2d7787a2-b8da-4d39-9b16-4c7bcb275f85 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:19:33 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance 0b388b98-4e65-4258-bbe2-77e699321fb7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:19:33 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance e88874fe-b0a6-4292-8832-023f95e4f53c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:19:33 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance bff3a84b-6ab5-4256-8a04-2d21a4ba20b3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:19:33 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance 11986c5b-6914-491e-8e71-983ab6b13c6e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:19:33 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=85141) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 10:19:33 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=85141) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 10:19:33 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3392fa71-5ceb-42f9-acb8-b9e69b8b1cfa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:19:33 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8d16543-a966-4da3-b5b4-1f429280fd89]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:19:33 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-698f16d4-46fd-45fa-b4aa-17c293fa83f6 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:19:33 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:19:33 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:19:33 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[047233f3-034d-4170-bc05-0683f0352baf]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:674f9ae8-6ab5-4ff2-b715-fe8807c34793 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dc504e0-da46-4c57-a66d-8ae6ce9c733c (non-flash)\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:19:33 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-698f16d4-46fd-45fa-b4aa-17c293fa83f6 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)
Nov 16 10:19:33 user nova-compute[85141]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:674f9ae8-6ab5-4ff2-b715-fe8807c34793 (non-flash)
Nov 16 10:19:33 user nova-compute[85141]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dc504e0-da46-4c57-a66d-8ae6ce9c733c (non-flash)
Nov 16 10:19:33 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:19:33 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-698f16d4-46fd-45fa-b4aa-17c293fa83f6 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)
Nov 16 10:19:33 user nova-compute[85141]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:674f9ae8-6ab5-4ff2-b715-fe8807c34793 (non-flash)
Nov 16 10:19:33 user nova-compute[85141]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dc504e0-da46-4c57-a66d-8ae6ce9c733c (non-flash)
Nov 16 10:19:33 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 10:19:33 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3392fa71-5ceb-42f9-acb8-b9e69b8b1cfa -p 172.16.0.220:3260 --login {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:19:33 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3392fa71-5ceb-42f9-acb8-b9e69b8b1cfa -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:19:33 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef02c12d-0437-43ba-8a3c-5607911246b4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3392fa71-5ceb-42f9-acb8-b9e69b8b1cfa, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3392fa71-5ceb-42f9-acb8-b9e69b8b1cfa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:19:33 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-698f16d4-46fd-45fa-b4aa-17c293fa83f6 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3392fa71-5ceb-42f9-acb8-b9e69b8b1cfa, portal: 172.16.0.220,3260]
Nov 16 10:19:33 user nova-compute[85141]: Login to [iface: default, target: iqn.2010-10.org.openstack:3392fa71-5ceb-42f9-acb8-b9e69b8b1cfa, portal: 172.16.0.220,3260] successful.
Nov 16 10:19:33 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:19:33 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3392fa71-5ceb-42f9-acb8-b9e69b8b1cfa -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:19:33 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3392fa71-5ceb-42f9-acb8-b9e69b8b1cfa -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.030s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:19:33 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a7df97b-7f18-4978-b8cc-897117997b30]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:19:33 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-698f16d4-46fd-45fa-b4aa-17c293fa83f6 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:19:33 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:19:33 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:19:33 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[79af2581-2be1-4f62-9845-f000b4adbd1a]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:674f9ae8-6ab5-4ff2-b715-fe8807c34793 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dc504e0-da46-4c57-a66d-8ae6ce9c733c (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3392fa71-5ceb-42f9-acb8-b9e69b8b1cfa (non-flash)\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:19:33 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-698f16d4-46fd-45fa-b4aa-17c293fa83f6 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)
Nov 16 10:19:33 user nova-compute[85141]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:674f9ae8-6ab5-4ff2-b715-fe8807c34793 (non-flash)
Nov 16 10:19:33 user nova-compute[85141]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dc504e0-da46-4c57-a66d-8ae6ce9c733c (non-flash)
Nov 16 10:19:33 user nova-compute[85141]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3392fa71-5ceb-42f9-acb8-b9e69b8b1cfa (non-flash)
Nov 16 10:19:33 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:19:33 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-698f16d4-46fd-45fa-b4aa-17c293fa83f6 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)
Nov 16 10:19:33 user nova-compute[85141]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:674f9ae8-6ab5-4ff2-b715-fe8807c34793 (non-flash)
Nov 16 10:19:33 user nova-compute[85141]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dc504e0-da46-4c57-a66d-8ae6ce9c733c (non-flash)
Nov 16 10:19:33 user nova-compute[85141]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3392fa71-5ceb-42f9-acb8-b9e69b8b1cfa (non-flash)
Nov 16 10:19:33 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 10:19:33 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-698f16d4-46fd-45fa-b4aa-17c293fa83f6 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3392fa71-5ceb-42f9-acb8-b9e69b8b1cfa" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.346s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 10:19:33 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-698f16d4-46fd-45fa-b4aa-17c293fa83f6 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] Connected to 172.16.0.220:3260 {{(pid=85141) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 10:19:33 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-698f16d4-46fd-45fa-b4aa-17c293fa83f6 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] HCTL ('35', '-', '-', 0) found on session 28 with lun 0 {{(pid=85141) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 10:19:33 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-698f16d4-46fd-45fa-b4aa-17c293fa83f6 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=85141) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 10:19:33 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:19:33 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.024s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:19:33 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0918c05-48e3-4134-8e8c-44853264cae4]: (4, ('- - 0', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:19:33 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-698f16d4-46fd-45fa-b4aa-17c293fa83f6 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] Searching for a device in session 28 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=85141) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 10:19:33 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-698f16d4-46fd-45fa-b4aa-17c293fa83f6 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:3392fa71-5ceb-42f9-acb8-b9e69b8b1cfa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'svSOAuQY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=85141) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 10:19:33 user nova-compute[85141]: DEBUG nova.compute.provider_tree [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Inventory has not changed in ProviderTree for provider: bf8e0fa1-16b6-408f-9203-c4cd63916272 {{(pid=85141) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 10:19:33 user nova-compute[85141]: DEBUG nova.scheduler.client.report [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Inventory has not changed for provider bf8e0fa1-16b6-408f-9203-c4cd63916272 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=85141) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 10:19:33 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Compute_service record updated for user:user {{(pid=85141) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 10:19:33 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.649s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:19:34 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-7a7a4e4d-2f16-4640-a866-9af9d05426e0 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] [instance: 9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008] Creating instance directory {{(pid=85141) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 10:19:34 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-7a7a4e4d-2f16-4640-a866-9af9d05426e0 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] [instance: 9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008] Creating image(s)
Nov 16 10:19:34 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-7a7a4e4d-2f16-4640-a866-9af9d05426e0 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Acquiring lock "/opt/stack/data/nova/instances/9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:19:34 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-7a7a4e4d-2f16-4640-a866-9af9d05426e0 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Lock "/opt/stack/data/nova/instances/9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.003s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:19:34 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-7a7a4e4d-2f16-4640-a866-9af9d05426e0 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Lock "/opt/stack/data/nova/instances/9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:19:34 user nova-compute[85141]: DEBUG nova.compute.manager [req-62e0ade1-03d0-4474-99c5-3a110cb8e984 req-0cbe73ad-114c-4f15-9bfe-0bafe98a77ab service nova] [instance: 0b388b98-4e65-4258-bbe2-77e699321fb7] Received event network-changed-3ed9d2a6-c028-4b75-9023-95b1cfa982b6 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:19:34 user nova-compute[85141]: DEBUG nova.compute.manager [req-62e0ade1-03d0-4474-99c5-3a110cb8e984 req-0cbe73ad-114c-4f15-9bfe-0bafe98a77ab service nova] [instance: 0b388b98-4e65-4258-bbe2-77e699321fb7] Refreshing instance network info cache due to event network-changed-3ed9d2a6-c028-4b75-9023-95b1cfa982b6. {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 10:19:34 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-62e0ade1-03d0-4474-99c5-3a110cb8e984 req-0cbe73ad-114c-4f15-9bfe-0bafe98a77ab service nova] Acquiring lock "refresh_cache-0b388b98-4e65-4258-bbe2-77e699321fb7" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:19:34 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-62e0ade1-03d0-4474-99c5-3a110cb8e984 req-0cbe73ad-114c-4f15-9bfe-0bafe98a77ab service nova] Acquired lock "refresh_cache-0b388b98-4e65-4258-bbe2-77e699321fb7" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:19:34 user nova-compute[85141]: DEBUG nova.network.neutron [req-62e0ade1-03d0-4474-99c5-3a110cb8e984 req-0cbe73ad-114c-4f15-9bfe-0bafe98a77ab service nova] [instance: 0b388b98-4e65-4258-bbe2-77e699321fb7] Refreshing network info cache for port 3ed9d2a6-c028-4b75-9023-95b1cfa982b6 {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 10:19:34 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-7a7a4e4d-2f16-4640-a866-9af9d05426e0 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:19:34 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-7a7a4e4d-2f16-4640-a866-9af9d05426e0 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json" returned: 0 in 0.175s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:19:34 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-7a7a4e4d-2f16-4640-a866-9af9d05426e0 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Acquiring lock "60a78556fb399ed4a41bc3ca4bccf77c96d8e811" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:19:34 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-7a7a4e4d-2f16-4640-a866-9af9d05426e0 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Lock "60a78556fb399ed4a41bc3ca4bccf77c96d8e811" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:19:34 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-7a7a4e4d-2f16-4640-a866-9af9d05426e0 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:19:34 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-7a7a4e4d-2f16-4640-a866-9af9d05426e0 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json" returned: 0 in 0.180s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:19:34 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-7a7a4e4d-2f16-4640-a866-9af9d05426e0 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811,backing_fmt=raw /opt/stack/data/nova/instances/9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008/disk 1073741824 {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:19:34 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-7a7a4e4d-2f16-4640-a866-9af9d05426e0 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811,backing_fmt=raw /opt/stack/data/nova/instances/9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008/disk 1073741824" returned: 0 in 0.055s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:19:34 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-7a7a4e4d-2f16-4640-a866-9af9d05426e0 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Lock "60a78556fb399ed4a41bc3ca4bccf77c96d8e811" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.240s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:19:34 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-7a7a4e4d-2f16-4640-a866-9af9d05426e0 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:19:34 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-698f16d4-46fd-45fa-b4aa-17c293fa83f6 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.426s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 10:19:34 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-698f16d4-46fd-45fa-b4aa-17c293fa83f6 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] <== connect_volume: return (1431ms) {'type': 'block', 'scsi_wwn': '26634316339366235', 'path': '/dev/sdd'} {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 10:19:34 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-698f16d4-46fd-45fa-b4aa-17c293fa83f6 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] [instance: fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26634316339366235', 'path': '/dev/sdd'} {{(pid=85141) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 10:19:34 user nova-compute[85141]: DEBUG nova.objects.instance [None req-698f16d4-46fd-45fa-b4aa-17c293fa83f6 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] Lazy-loading 'flavor' on Instance uuid fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:19:34 user nova-compute[85141]: DEBUG nova.virt.libvirt.guest [None req-698f16d4-46fd-45fa-b4aa-17c293fa83f6 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 10:19:34 user nova-compute[85141]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 10:19:34 user nova-compute[85141]:   <source dev="/dev/sdd"/>
Nov 16 10:19:34 user nova-compute[85141]:   <target dev="vdb" bus="virtio"/>
Nov 16 10:19:34 user nova-compute[85141]:   <serial>3392fa71-5ceb-42f9-acb8-b9e69b8b1cfa</serial>
Nov 16 10:19:34 user nova-compute[85141]: </disk>
Nov 16 10:19:34 user nova-compute[85141]:  {{(pid=85141) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 10:19:34 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-7a7a4e4d-2f16-4640-a866-9af9d05426e0 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json" returned: 0 in 0.195s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:19:34 user nova-compute[85141]: DEBUG nova.virt.disk.api [None req-7a7a4e4d-2f16-4640-a866-9af9d05426e0 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008/disk. size=1073741824 {{(pid=85141) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 10:19:34 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-7a7a4e4d-2f16-4640-a866-9af9d05426e0 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:19:35 user nova-compute[85141]: DEBUG nova.network.neutron [req-62e0ade1-03d0-4474-99c5-3a110cb8e984 req-0cbe73ad-114c-4f15-9bfe-0bafe98a77ab service nova] [instance: 0b388b98-4e65-4258-bbe2-77e699321fb7] Updated VIF entry in instance network info cache for port 3ed9d2a6-c028-4b75-9023-95b1cfa982b6. {{(pid=85141) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 10:19:35 user nova-compute[85141]: DEBUG nova.network.neutron [req-62e0ade1-03d0-4474-99c5-3a110cb8e984 req-0cbe73ad-114c-4f15-9bfe-0bafe98a77ab service nova] [instance: 0b388b98-4e65-4258-bbe2-77e699321fb7] Updating instance_info_cache with network_info: [{"id": "3ed9d2a6-c028-4b75-9023-95b1cfa982b6", "address": "fa:16:3e:85:dd:4c", "network": {"id": "4e36c3d2-7d16-4305-a0a7-2358e1208df3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1030128743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2acc04e107d4a229c3580cf078a20f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ed9d2a6-c0", "ovs_interfaceid": "3ed9d2a6-c028-4b75-9023-95b1cfa982b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:19:35 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-62e0ade1-03d0-4474-99c5-3a110cb8e984 req-0cbe73ad-114c-4f15-9bfe-0bafe98a77ab service nova] Releasing lock "refresh_cache-0b388b98-4e65-4258-bbe2-77e699321fb7" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:19:35 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-7a7a4e4d-2f16-4640-a866-9af9d05426e0 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:19:35 user nova-compute[85141]: DEBUG nova.virt.disk.api [None req-7a7a4e4d-2f16-4640-a866-9af9d05426e0 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Cannot resize image /opt/stack/data/nova/instances/9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008/disk to a smaller size. {{(pid=85141) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 10:19:35 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-7a7a4e4d-2f16-4640-a866-9af9d05426e0 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] [instance: 9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008] Created local disks {{(pid=85141) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 10:19:35 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-7a7a4e4d-2f16-4640-a866-9af9d05426e0 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] [instance: 9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008] Ensure instance console log exists: /opt/stack/data/nova/instances/9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008/console.log {{(pid=85141) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 10:19:35 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-7a7a4e4d-2f16-4640-a866-9af9d05426e0 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:19:35 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-7a7a4e4d-2f16-4640-a866-9af9d05426e0 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:19:35 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-7a7a4e4d-2f16-4640-a866-9af9d05426e0 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:19:35 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-7a7a4e4d-2f16-4640-a866-9af9d05426e0 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] [instance: 9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008] Start _get_guest_xml network_info=[{"id": "6e352298-a803-4a3c-8f40-dc88ee03687f", "address": "fa:16:3e:ab:ca:9e", "network": {"id": "859d1f09-56c4-4c2b-b2c3-02b1938e8dbf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1562516834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "879fa3f4dfc34726b20149b8a7db22dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e352298-a8", "ovs_interfaceid": "6e352298-a803-4a3c-8f40-dc88ee03687f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T10:06:42Z,direct_url=<?>,disk_format='qcow2',id=bc4ca70f-a459-4d5c-a9e6-80f1948eb48b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1044631a5fe84ce8904864a7024049fa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T10:06:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_options': None, 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'image_id': 'bc4ca70f-a459-4d5c-a9e6-80f1948eb48b'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2f7784b4-2ba5-4085-9e17-877c754115c8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yEORChLP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008', 'attached_at': '', 'detached_at': '', 'volume_id': '2f7784b4-2ba5-4085-9e17-877c754115c8', 'serial': '2f7784b4-2ba5-4085-9e17-877c754115c8'}, 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'boot_index': None, 'attachment_id': '57283c37-196d-4e6d-8ec2-bb39ad92e0d5', 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=85141) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 10:19:35 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-7a7a4e4d-2f16-4640-a866-9af9d05426e0 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 16 10:19:35 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-7a7a4e4d-2f16-4640-a866-9af9d05426e0 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 16 10:19:35 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-7a7a4e4d-2f16-4640-a866-9af9d05426e0 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=85141) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 10:19:35 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-7a7a4e4d-2f16-4640-a866-9af9d05426e0 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] CPU controller missing on host. {{(pid=85141) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 10:19:35 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-7a7a4e4d-2f16-4640-a866-9af9d05426e0 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=85141) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 10:19:35 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-7a7a4e4d-2f16-4640-a866-9af9d05426e0 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] CPU controller found on host. {{(pid=85141) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 10:19:35 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-7a7a4e4d-2f16-4640-a866-9af9d05426e0 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=85141) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 10:19:35 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-7a7a4e4d-2f16-4640-a866-9af9d05426e0 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T10:06:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T10:06:42Z,direct_url=<?>,disk_format='qcow2',id=bc4ca70f-a459-4d5c-a9e6-80f1948eb48b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1044631a5fe84ce8904864a7024049fa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T10:06:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 10:19:35 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-7a7a4e4d-2f16-4640-a866-9af9d05426e0 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Flavor limits 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 10:19:35 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-7a7a4e4d-2f16-4640-a866-9af9d05426e0 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Image limits 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 10:19:35 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-7a7a4e4d-2f16-4640-a866-9af9d05426e0 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Flavor pref 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 10:19:35 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-7a7a4e4d-2f16-4640-a866-9af9d05426e0 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Image pref 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 10:19:35 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-7a7a4e4d-2f16-4640-a866-9af9d05426e0 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 10:19:35 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-7a7a4e4d-2f16-4640-a866-9af9d05426e0 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 10:19:35 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-7a7a4e4d-2f16-4640-a866-9af9d05426e0 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=85141) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 10:19:35 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-7a7a4e4d-2f16-4640-a866-9af9d05426e0 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Got 1 possible topologies {{(pid=85141) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 10:19:35 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-7a7a4e4d-2f16-4640-a866-9af9d05426e0 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 10:19:35 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-7a7a4e4d-2f16-4640-a866-9af9d05426e0 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 10:19:35 user nova-compute[85141]: DEBUG nova.objects.instance [None req-7a7a4e4d-2f16-4640-a866-9af9d05426e0 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Lazy-loading 'vcpu_model' on Instance uuid 9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008 {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:19:35 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7a7a4e4d-2f16-4640-a866-9af9d05426e0 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] [instance: 9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008] Calling os-brick to attach iSCSI Volume {{(pid=85141) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 10:19:35 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a7a4e4d-2f16-4640-a866-9af9d05426e0 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51806b6080>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2f7784b4-2ba5-4085-9e17-877c754115c8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yEORChLP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 10:19:35 user nova-compute[85141]: WARNING os_brick.initiator.connectors.base [None req-7a7a4e4d-2f16-4640-a866-9af9d05426e0 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 16 10:19:35 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-7a7a4e4d-2f16-4640-a866-9af9d05426e0 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 10:19:35 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-7a7a4e4d-2f16-4640-a866-9af9d05426e0 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 10:19:35 user nova-compute[85141]: WARNING os_brick.initiator.connectors.base [None req-7a7a4e4d-2f16-4640-a866-9af9d05426e0 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 16 10:19:35 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-7a7a4e4d-2f16-4640-a866-9af9d05426e0 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2f7784b4-2ba5-4085-9e17-877c754115c8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 10:19:35 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-7a7a4e4d-2f16-4640-a866-9af9d05426e0 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2f7784b4-2ba5-4085-9e17-877c754115c8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 10:19:35 user nova-compute[85141]: INFO os_brick.initiator.connectors.iscsi [None req-7a7a4e4d-2f16-4640-a866-9af9d05426e0 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 10:19:35 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f7784b4-2ba5-4085-9e17-877c754115c8 -p 172.16.0.220:3260 {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:19:35 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f7784b4-2ba5-4085-9e17-877c754115c8 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:19:35 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d018c66-38dd-4540-9cda-b54207ed1691]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:19:35 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a7a4e4d-2f16-4640-a866-9af9d05426e0 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 10:19:35 user nova-compute[85141]:  {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:19:35 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f7784b4-2ba5-4085-9e17-877c754115c8 -p 172.16.0.220:3260 --interface default --op new {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:19:35 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f7784b4-2ba5-4085-9e17-877c754115c8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:19:35 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7428cdb-8224-4ccc-a41f-ad9807f3d485]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2f7784b4-2ba5-4085-9e17-877c754115c8] added\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:19:35 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a7a4e4d-2f16-4640-a866-9af9d05426e0 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2f7784b4-2ba5-4085-9e17-877c754115c8] added
Nov 16 10:19:35 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:19:35 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f7784b4-2ba5-4085-9e17-877c754115c8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:19:35 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-698f16d4-46fd-45fa-b4aa-17c293fa83f6 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] No BDM found with device name vda, not building metadata. {{(pid=85141) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 10:19:35 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-698f16d4-46fd-45fa-b4aa-17c293fa83f6 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] No BDM found with device name vdb, not building metadata. {{(pid=85141) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 10:19:35 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-698f16d4-46fd-45fa-b4aa-17c293fa83f6 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] No VIF found with MAC fa:16:3e:3b:bc:05, not building metadata {{(pid=85141) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 10:19:35 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f7784b4-2ba5-4085-9e17-877c754115c8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:19:35 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3d8ca5b-509f-43be-9054-688c96be62ff]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:19:35 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a7a4e4d-2f16-4640-a866-9af9d05426e0 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:19:35 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f7784b4-2ba5-4085-9e17-877c754115c8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:19:35 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f7784b4-2ba5-4085-9e17-877c754115c8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:19:35 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[0092d5f7-5e00-44f5-aafd-c3cee7c38edb]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:19:35 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a7a4e4d-2f16-4640-a866-9af9d05426e0 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:19:35 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f7784b4-2ba5-4085-9e17-877c754115c8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yEORChLP {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:19:35 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f7784b4-2ba5-4085-9e17-877c754115c8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yEORChLP" returned: 0 in 0.025s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:19:35 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[a805e09f-c0dd-44b5-baeb-6eb0950971fa]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:19:35 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a7a4e4d-2f16-4640-a866-9af9d05426e0 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yEORChLP'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:19:35 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f7784b4-2ba5-4085-9e17-877c754115c8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:19:35 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f7784b4-2ba5-4085-9e17-877c754115c8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:19:35 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[5de33827-32ec-4c49-82a2-96220ee464fb]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:19:35 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a7a4e4d-2f16-4640-a866-9af9d05426e0 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:19:35 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:19:35 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:19:35 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[0311e2c4-588a-4d8f-b12d-8db23cab179a]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:674f9ae8-6ab5-4ff2-b715-fe8807c34793 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dc504e0-da46-4c57-a66d-8ae6ce9c733c (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3392fa71-5ceb-42f9-acb8-b9e69b8b1cfa (non-flash)\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:19:35 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a7a4e4d-2f16-4640-a866-9af9d05426e0 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)
Nov 16 10:19:35 user nova-compute[85141]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:674f9ae8-6ab5-4ff2-b715-fe8807c34793 (non-flash)
Nov 16 10:19:35 user nova-compute[85141]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dc504e0-da46-4c57-a66d-8ae6ce9c733c (non-flash)
Nov 16 10:19:35 user nova-compute[85141]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3392fa71-5ceb-42f9-acb8-b9e69b8b1cfa (non-flash)
Nov 16 10:19:35 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:19:35 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a7a4e4d-2f16-4640-a866-9af9d05426e0 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)
Nov 16 10:19:35 user nova-compute[85141]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:674f9ae8-6ab5-4ff2-b715-fe8807c34793 (non-flash)
Nov 16 10:19:35 user nova-compute[85141]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dc504e0-da46-4c57-a66d-8ae6ce9c733c (non-flash)
Nov 16 10:19:35 user nova-compute[85141]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3392fa71-5ceb-42f9-acb8-b9e69b8b1cfa (non-flash)
Nov 16 10:19:35 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 10:19:35 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f7784b4-2ba5-4085-9e17-877c754115c8 -p 172.16.0.220:3260 --login {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:19:35 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-698f16d4-46fd-45fa-b4aa-17c293fa83f6 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] Lock "fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.159s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:19:35 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f7784b4-2ba5-4085-9e17-877c754115c8 -p 172.16.0.220:3260 --login" returned: 0 in 0.092s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:19:35 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[f55b0e81-18ac-4183-8e06-6c9840378bd4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2f7784b4-2ba5-4085-9e17-877c754115c8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2f7784b4-2ba5-4085-9e17-877c754115c8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:19:35 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a7a4e4d-2f16-4640-a866-9af9d05426e0 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2f7784b4-2ba5-4085-9e17-877c754115c8, portal: 172.16.0.220,3260]
Nov 16 10:19:35 user nova-compute[85141]: Login to [iface: default, target: iqn.2010-10.org.openstack:2f7784b4-2ba5-4085-9e17-877c754115c8, portal: 172.16.0.220,3260] successful.
Nov 16 10:19:35 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:19:35 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f7784b4-2ba5-4085-9e17-877c754115c8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:19:35 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f7784b4-2ba5-4085-9e17-877c754115c8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:19:35 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[4af4820f-e515-4b79-9794-9f3efc74f4c4]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:19:35 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a7a4e4d-2f16-4640-a866-9af9d05426e0 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:19:35 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:19:35 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:19:35 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[db9c0975-3e17-4072-b466-9fc0c728fb9b]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:674f9ae8-6ab5-4ff2-b715-fe8807c34793 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dc504e0-da46-4c57-a66d-8ae6ce9c733c (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3392fa71-5ceb-42f9-acb8-b9e69b8b1cfa (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7784b4-2ba5-4085-9e17-877c754115c8 (non-flash)\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:19:35 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a7a4e4d-2f16-4640-a866-9af9d05426e0 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)
Nov 16 10:19:35 user nova-compute[85141]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:674f9ae8-6ab5-4ff2-b715-fe8807c34793 (non-flash)
Nov 16 10:19:35 user nova-compute[85141]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dc504e0-da46-4c57-a66d-8ae6ce9c733c (non-flash)
Nov 16 10:19:35 user nova-compute[85141]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3392fa71-5ceb-42f9-acb8-b9e69b8b1cfa (non-flash)
Nov 16 10:19:35 user nova-compute[85141]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7784b4-2ba5-4085-9e17-877c754115c8 (non-flash)
Nov 16 10:19:35 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:19:35 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a7a4e4d-2f16-4640-a866-9af9d05426e0 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)
Nov 16 10:19:35 user nova-compute[85141]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:674f9ae8-6ab5-4ff2-b715-fe8807c34793 (non-flash)
Nov 16 10:19:35 user nova-compute[85141]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dc504e0-da46-4c57-a66d-8ae6ce9c733c (non-flash)
Nov 16 10:19:35 user nova-compute[85141]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3392fa71-5ceb-42f9-acb8-b9e69b8b1cfa (non-flash)
Nov 16 10:19:35 user nova-compute[85141]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7784b4-2ba5-4085-9e17-877c754115c8 (non-flash)
Nov 16 10:19:35 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 10:19:35 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-7a7a4e4d-2f16-4640-a866-9af9d05426e0 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2f7784b4-2ba5-4085-9e17-877c754115c8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.357s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 10:19:35 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a7a4e4d-2f16-4640-a866-9af9d05426e0 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Connected to 172.16.0.220:3260 {{(pid=85141) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 10:19:35 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-7a7a4e4d-2f16-4640-a866-9af9d05426e0 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] HCTL ('36', '-', '-', 0) found on session 29 with lun 0 {{(pid=85141) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 10:19:35 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-7a7a4e4d-2f16-4640-a866-9af9d05426e0 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=85141) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 10:19:35 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:19:35 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:19:35 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[259de469-9e3e-4104-9599-1c9db777b830]: (4, ('- - 0', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:19:35 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-7a7a4e4d-2f16-4640-a866-9af9d05426e0 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Searching for a device in session 29 and hctl ['36', '*', '*', 0] yield: sde {{(pid=85141) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 10:19:35 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a7a4e4d-2f16-4640-a866-9af9d05426e0 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:2f7784b4-2ba5-4085-9e17-877c754115c8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yEORChLP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=85141) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 10:19:35 user nova-compute[85141]: DEBUG nova.compute.manager [req-ac406cc7-c655-4878-9cb2-05818ee2cc3a req-12a70ff5-6104-4d1d-81ee-697d74c02663 service nova] [instance: 2d7787a2-b8da-4d39-9b16-4c7bcb275f85] Received event network-changed-3f553883-eaa0-4a7e-8e31-1170241a0236 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:19:35 user nova-compute[85141]: DEBUG nova.compute.manager [req-ac406cc7-c655-4878-9cb2-05818ee2cc3a req-12a70ff5-6104-4d1d-81ee-697d74c02663 service nova] [instance: 2d7787a2-b8da-4d39-9b16-4c7bcb275f85] Refreshing instance network info cache due to event network-changed-3f553883-eaa0-4a7e-8e31-1170241a0236. {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 10:19:35 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-ac406cc7-c655-4878-9cb2-05818ee2cc3a req-12a70ff5-6104-4d1d-81ee-697d74c02663 service nova] Acquiring lock "refresh_cache-2d7787a2-b8da-4d39-9b16-4c7bcb275f85" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:19:35 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-ac406cc7-c655-4878-9cb2-05818ee2cc3a req-12a70ff5-6104-4d1d-81ee-697d74c02663 service nova] Acquired lock "refresh_cache-2d7787a2-b8da-4d39-9b16-4c7bcb275f85" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:19:35 user nova-compute[85141]: DEBUG nova.network.neutron [req-ac406cc7-c655-4878-9cb2-05818ee2cc3a req-12a70ff5-6104-4d1d-81ee-697d74c02663 service nova] [instance: 2d7787a2-b8da-4d39-9b16-4c7bcb275f85] Refreshing network info cache for port 3f553883-eaa0-4a7e-8e31-1170241a0236 {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 10:19:36 user nova-compute[85141]: DEBUG nova.network.neutron [req-ac406cc7-c655-4878-9cb2-05818ee2cc3a req-12a70ff5-6104-4d1d-81ee-697d74c02663 service nova] [instance: 2d7787a2-b8da-4d39-9b16-4c7bcb275f85] Updated VIF entry in instance network info cache for port 3f553883-eaa0-4a7e-8e31-1170241a0236. {{(pid=85141) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 10:19:36 user nova-compute[85141]: DEBUG nova.network.neutron [req-ac406cc7-c655-4878-9cb2-05818ee2cc3a req-12a70ff5-6104-4d1d-81ee-697d74c02663 service nova] [instance: 2d7787a2-b8da-4d39-9b16-4c7bcb275f85] Updating instance_info_cache with network_info: [{"id": "3f553883-eaa0-4a7e-8e31-1170241a0236", "address": "fa:16:3e:1c:29:6f", "network": {"id": "436477fd-9294-4297-bfb3-405564823fa0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1068749207-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4e4f57f79564d2fbcb8080bf8f1c5c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f553883-ea", "ovs_interfaceid": "3f553883-eaa0-4a7e-8e31-1170241a0236", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:19:36 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-ac406cc7-c655-4878-9cb2-05818ee2cc3a req-12a70ff5-6104-4d1d-81ee-697d74c02663 service nova] Releasing lock "refresh_cache-2d7787a2-b8da-4d39-9b16-4c7bcb275f85" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:19:36 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-7a7a4e4d-2f16-4640-a866-9af9d05426e0 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.392s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 10:19:36 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a7a4e4d-2f16-4640-a866-9af9d05426e0 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] <== connect_volume: return (1394ms) {'type': 'block', 'scsi_wwn': '23638326337643931', 'path': '/dev/sde'} {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 10:19:36 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7a7a4e4d-2f16-4640-a866-9af9d05426e0 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] [instance: 9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23638326337643931', 'path': '/dev/sde'} {{(pid=85141) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 10:19:36 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-7a7a4e4d-2f16-4640-a866-9af9d05426e0 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-16T10:17:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1065707614',display_name='tempest-ServerActionsTestOtherA-server-1206991665',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1065707614',id=21,image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLYW31ovczNyLDED4yKs9dsdr/XSErfr1XRe8heGwagMSLKlZc0gAr6TCWuL5DKCAIkQKMPHxCnrx6sG+CmW97Y7nMFFBSlsHjdgZoOxsnNiaYYiicSNNLBDSCW1u0DNWw==',key_name='tempest-keypair-1951575816',keypairs=<?>,launch_index=0,launched_at=2023-11-16T10:17:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='879fa3f4dfc34726b20149b8a7db22dc',ramdisk_id='',reservation_id='r-0bhqn0jn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1137992555',owner_user_name='tempest-ServerActionsTestOtherA-1137992555-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T10:19:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e95802a919de4345add493a8d7873e48',uuid=9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6e352298-a803-4a3c-8f40-dc88ee03687f", "address": "fa:16:3e:ab:ca:9e", "network": {"id": "859d1f09-56c4-4c2b-b2c3-02b1938e8dbf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1562516834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "879fa3f4dfc34726b20149b8a7db22dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e352298-a8", "ovs_interfaceid": "6e352298-a803-4a3c-8f40-dc88ee03687f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=85141) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 10:19:36 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-7a7a4e4d-2f16-4640-a866-9af9d05426e0 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Converting VIF {"id": "6e352298-a803-4a3c-8f40-dc88ee03687f", "address": "fa:16:3e:ab:ca:9e", "network": {"id": "859d1f09-56c4-4c2b-b2c3-02b1938e8dbf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1562516834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "879fa3f4dfc34726b20149b8a7db22dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e352298-a8", "ovs_interfaceid": "6e352298-a803-4a3c-8f40-dc88ee03687f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:19:36 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-7a7a4e4d-2f16-4640-a866-9af9d05426e0 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ab:ca:9e,bridge_name='br-int',has_traffic_filtering=True,id=6e352298-a803-4a3c-8f40-dc88ee03687f,network=Network(859d1f09-56c4-4c2b-b2c3-02b1938e8dbf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e352298-a8') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:19:36 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-7a7a4e4d-2f16-4640-a866-9af9d05426e0 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] [instance: 9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008] End _get_guest_xml xml=<domain type="kvm">
Nov 16 10:19:36 user nova-compute[85141]:   <uuid>9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008</uuid>
Nov 16 10:19:36 user nova-compute[85141]:   <name>instance-00000015</name>
Nov 16 10:19:36 user nova-compute[85141]:   <memory>524288</memory>
Nov 16 10:19:36 user nova-compute[85141]:   <vcpu>1</vcpu>
Nov 16 10:19:36 user nova-compute[85141]:   <metadata>
Nov 16 10:19:36 user nova-compute[85141]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 10:19:36 user nova-compute[85141]:       <nova:package version="0.0.0"/>
Nov 16 10:19:36 user nova-compute[85141]:       <nova:name>tempest-ServerActionsTestOtherA-server-1206991665</nova:name>
Nov 16 10:19:36 user nova-compute[85141]:       <nova:creationTime>2023-11-16 10:19:35</nova:creationTime>
Nov 16 10:19:36 user nova-compute[85141]:       <nova:flavor name="m1.tiny">
Nov 16 10:19:36 user nova-compute[85141]:         <nova:memory>512</nova:memory>
Nov 16 10:19:36 user nova-compute[85141]:         <nova:disk>1</nova:disk>
Nov 16 10:19:36 user nova-compute[85141]:         <nova:swap>0</nova:swap>
Nov 16 10:19:36 user nova-compute[85141]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 10:19:36 user nova-compute[85141]:         <nova:vcpus>1</nova:vcpus>
Nov 16 10:19:36 user nova-compute[85141]:       </nova:flavor>
Nov 16 10:19:36 user nova-compute[85141]:       <nova:owner>
Nov 16 10:19:36 user nova-compute[85141]:         <nova:user uuid="e95802a919de4345add493a8d7873e48">tempest-ServerActionsTestOtherA-1137992555-project-member</nova:user>
Nov 16 10:19:36 user nova-compute[85141]:         <nova:project uuid="879fa3f4dfc34726b20149b8a7db22dc">tempest-ServerActionsTestOtherA-1137992555</nova:project>
Nov 16 10:19:36 user nova-compute[85141]:       </nova:owner>
Nov 16 10:19:36 user nova-compute[85141]:       <nova:root type="image" uuid="bc4ca70f-a459-4d5c-a9e6-80f1948eb48b"/>
Nov 16 10:19:36 user nova-compute[85141]:       <nova:ports>
Nov 16 10:19:36 user nova-compute[85141]:         <nova:port uuid="6e352298-a803-4a3c-8f40-dc88ee03687f">
Nov 16 10:19:36 user nova-compute[85141]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 16 10:19:36 user nova-compute[85141]:         </nova:port>
Nov 16 10:19:36 user nova-compute[85141]:       </nova:ports>
Nov 16 10:19:36 user nova-compute[85141]:     </nova:instance>
Nov 16 10:19:36 user nova-compute[85141]:   </metadata>
Nov 16 10:19:36 user nova-compute[85141]:   <sysinfo type="smbios">
Nov 16 10:19:36 user nova-compute[85141]:     <system>
Nov 16 10:19:36 user nova-compute[85141]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 10:19:36 user nova-compute[85141]:       <entry name="product">OpenStack Nova</entry>
Nov 16 10:19:36 user nova-compute[85141]:       <entry name="version">0.0.0</entry>
Nov 16 10:19:36 user nova-compute[85141]:       <entry name="serial">9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008</entry>
Nov 16 10:19:36 user nova-compute[85141]:       <entry name="uuid">9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008</entry>
Nov 16 10:19:36 user nova-compute[85141]:       <entry name="family">Virtual Machine</entry>
Nov 16 10:19:36 user nova-compute[85141]:     </system>
Nov 16 10:19:36 user nova-compute[85141]:   </sysinfo>
Nov 16 10:19:36 user nova-compute[85141]:   <os>
Nov 16 10:19:36 user nova-compute[85141]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 10:19:36 user nova-compute[85141]:     <boot dev="hd"/>
Nov 16 10:19:36 user nova-compute[85141]:     <smbios mode="sysinfo"/>
Nov 16 10:19:36 user nova-compute[85141]:   </os>
Nov 16 10:19:36 user nova-compute[85141]:   <features>
Nov 16 10:19:36 user nova-compute[85141]:     <acpi/>
Nov 16 10:19:36 user nova-compute[85141]:     <apic/>
Nov 16 10:19:36 user nova-compute[85141]:     <vmcoreinfo/>
Nov 16 10:19:36 user nova-compute[85141]:   </features>
Nov 16 10:19:36 user nova-compute[85141]:   <clock offset="utc">
Nov 16 10:19:36 user nova-compute[85141]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 10:19:36 user nova-compute[85141]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 10:19:36 user nova-compute[85141]:     <timer name="hpet" present="no"/>
Nov 16 10:19:36 user nova-compute[85141]:   </clock>
Nov 16 10:19:36 user nova-compute[85141]:   <cpu mode="custom" match="exact">
Nov 16 10:19:36 user nova-compute[85141]:     <model>Nehalem</model>
Nov 16 10:19:36 user nova-compute[85141]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 10:19:36 user nova-compute[85141]:   </cpu>
Nov 16 10:19:36 user nova-compute[85141]:   <devices>
Nov 16 10:19:36 user nova-compute[85141]:     <disk type="file" device="disk">
Nov 16 10:19:36 user nova-compute[85141]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 10:19:36 user nova-compute[85141]:       <source file="/opt/stack/data/nova/instances/9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008/disk"/>
Nov 16 10:19:36 user nova-compute[85141]:       <target dev="vda" bus="virtio"/>
Nov 16 10:19:36 user nova-compute[85141]:     </disk>
Nov 16 10:19:36 user nova-compute[85141]:     <disk type="block" device="disk">
Nov 16 10:19:36 user nova-compute[85141]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 10:19:36 user nova-compute[85141]:       <source dev="/dev/sde"/>
Nov 16 10:19:36 user nova-compute[85141]:       <target dev="vdb" bus="virtio"/>
Nov 16 10:19:36 user nova-compute[85141]:       <serial>2f7784b4-2ba5-4085-9e17-877c754115c8</serial>
Nov 16 10:19:36 user nova-compute[85141]:     </disk>
Nov 16 10:19:36 user nova-compute[85141]:     <interface type="ethernet">
Nov 16 10:19:36 user nova-compute[85141]:       <mac address="fa:16:3e:ab:ca:9e"/>
Nov 16 10:19:36 user nova-compute[85141]:       <model type="virtio"/>
Nov 16 10:19:36 user nova-compute[85141]:       <mtu size="1442"/>
Nov 16 10:19:36 user nova-compute[85141]:       <target dev="tap6e352298-a8"/>
Nov 16 10:19:36 user nova-compute[85141]:     </interface>
Nov 16 10:19:36 user nova-compute[85141]:     <serial type="pty">
Nov 16 10:19:36 user nova-compute[85141]:       <log file="/opt/stack/data/nova/instances/9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008/console.log" append="off"/>
Nov 16 10:19:36 user nova-compute[85141]:     </serial>
Nov 16 10:19:36 user nova-compute[85141]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 10:19:36 user nova-compute[85141]:     <video>
Nov 16 10:19:36 user nova-compute[85141]:       <model type="virtio"/>
Nov 16 10:19:36 user nova-compute[85141]:     </video>
Nov 16 10:19:36 user nova-compute[85141]:     <rng model="virtio">
Nov 16 10:19:36 user nova-compute[85141]:       <backend model="random">/dev/urandom</backend>
Nov 16 10:19:36 user nova-compute[85141]:     </rng>
Nov 16 10:19:36 user nova-compute[85141]:     <controller type="usb" index="0" model="none"/>
Nov 16 10:19:36 user nova-compute[85141]:     <memballoon model="virtio">
Nov 16 10:19:36 user nova-compute[85141]:       <stats period="10"/>
Nov 16 10:19:36 user nova-compute[85141]:     </memballoon>
Nov 16 10:19:36 user nova-compute[85141]:   </devices>
Nov 16 10:19:36 user nova-compute[85141]: </domain>
Nov 16 10:19:36 user nova-compute[85141]:  {{(pid=85141) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 10:19:36 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-7a7a4e4d-2f16-4640-a866-9af9d05426e0 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-16T10:17:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1065707614',display_name='tempest-ServerActionsTestOtherA-server-1206991665',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1065707614',id=21,image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLYW31ovczNyLDED4yKs9dsdr/XSErfr1XRe8heGwagMSLKlZc0gAr6TCWuL5DKCAIkQKMPHxCnrx6sG+CmW97Y7nMFFBSlsHjdgZoOxsnNiaYYiicSNNLBDSCW1u0DNWw==',key_name='tempest-keypair-1951575816',keypairs=<?>,launch_index=0,launched_at=2023-11-16T10:17:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='879fa3f4dfc34726b20149b8a7db22dc',ramdisk_id='',reservation_id='r-0bhqn0jn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1137992555',owner_user_name='tempest-ServerActionsTestOtherA-1137992555-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T10:19:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e95802a919de4345add493a8d7873e48',uuid=9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6e352298-a803-4a3c-8f40-dc88ee03687f", "address": "fa:16:3e:ab:ca:9e", "network": {"id": "859d1f09-56c4-4c2b-b2c3-02b1938e8dbf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1562516834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "879fa3f4dfc34726b20149b8a7db22dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e352298-a8", "ovs_interfaceid": "6e352298-a803-4a3c-8f40-dc88ee03687f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 10:19:36 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-7a7a4e4d-2f16-4640-a866-9af9d05426e0 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Converting VIF {"id": "6e352298-a803-4a3c-8f40-dc88ee03687f", "address": "fa:16:3e:ab:ca:9e", "network": {"id": "859d1f09-56c4-4c2b-b2c3-02b1938e8dbf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1562516834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "879fa3f4dfc34726b20149b8a7db22dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e352298-a8", "ovs_interfaceid": "6e352298-a803-4a3c-8f40-dc88ee03687f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:19:36 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-7a7a4e4d-2f16-4640-a866-9af9d05426e0 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ab:ca:9e,bridge_name='br-int',has_traffic_filtering=True,id=6e352298-a803-4a3c-8f40-dc88ee03687f,network=Network(859d1f09-56c4-4c2b-b2c3-02b1938e8dbf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e352298-a8') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:19:36 user nova-compute[85141]: DEBUG os_vif [None req-7a7a4e4d-2f16-4640-a866-9af9d05426e0 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ab:ca:9e,bridge_name='br-int',has_traffic_filtering=True,id=6e352298-a803-4a3c-8f40-dc88ee03687f,network=Network(859d1f09-56c4-4c2b-b2c3-02b1938e8dbf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e352298-a8') {{(pid=85141) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 10:19:36 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:19:36 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:19:36 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 10:19:36 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:19:36 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7a371930-7a40-52eb-9879-c7e9d9a8cabb', '_type': 'linux-noop'}}, row=False) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:19:36 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:19:36 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:19:36 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:19:36 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6e352298-a8, may_exist=True, interface_attrs={}) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:19:36 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6e352298-a8, col_values=(('qos', UUID('25897e87-86b6-4bc8-9490-c1ca40bbf2e8')),), if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:19:36 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6e352298-a8, col_values=(('external_ids', {'iface-id': '6e352298-a803-4a3c-8f40-dc88ee03687f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ab:ca:9e', 'vm-uuid': '9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008'}),), if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:19:36 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:19:36 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:19:36 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:19:36 user nova-compute[85141]: INFO os_vif [None req-7a7a4e4d-2f16-4640-a866-9af9d05426e0 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ab:ca:9e,bridge_name='br-int',has_traffic_filtering=True,id=6e352298-a803-4a3c-8f40-dc88ee03687f,network=Network(859d1f09-56c4-4c2b-b2c3-02b1938e8dbf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e352298-a8')
Nov 16 10:19:36 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-7a7a4e4d-2f16-4640-a866-9af9d05426e0 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] No BDM found with device name vda, not building metadata. {{(pid=85141) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 10:19:36 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-7a7a4e4d-2f16-4640-a866-9af9d05426e0 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] No BDM found with device name vdb, not building metadata. {{(pid=85141) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 10:19:36 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-7a7a4e4d-2f16-4640-a866-9af9d05426e0 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] No VIF found with MAC fa:16:3e:ab:ca:9e, not building metadata {{(pid=85141) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 10:19:36 user nova-compute[85141]: INFO nova.compute.manager [None req-27e093f4-6ae1-4d32-a75f-6b1cddd9b374 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] [instance: fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f] Rescuing
Nov 16 10:19:36 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-27e093f4-6ae1-4d32-a75f-6b1cddd9b374 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] Acquiring lock "refresh_cache-fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:19:36 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-27e093f4-6ae1-4d32-a75f-6b1cddd9b374 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] Acquired lock "refresh_cache-fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:19:36 user nova-compute[85141]: DEBUG nova.network.neutron [None req-27e093f4-6ae1-4d32-a75f-6b1cddd9b374 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] [instance: fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f] Building network info cache for instance {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 10:19:37 user nova-compute[85141]: DEBUG nova.compute.manager [req-1ef83663-3953-43b6-a62d-92170212e6c4 req-1fd7be2e-8a45-4d7d-968f-88a6917e7789 service nova] [instance: e88874fe-b0a6-4292-8832-023f95e4f53c] Received event network-changed-7bbea642-d504-433b-ae99-8e7159942751 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:19:37 user nova-compute[85141]: DEBUG nova.compute.manager [req-1ef83663-3953-43b6-a62d-92170212e6c4 req-1fd7be2e-8a45-4d7d-968f-88a6917e7789 service nova] [instance: e88874fe-b0a6-4292-8832-023f95e4f53c] Refreshing instance network info cache due to event network-changed-7bbea642-d504-433b-ae99-8e7159942751. {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 10:19:37 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-1ef83663-3953-43b6-a62d-92170212e6c4 req-1fd7be2e-8a45-4d7d-968f-88a6917e7789 service nova] Acquiring lock "refresh_cache-e88874fe-b0a6-4292-8832-023f95e4f53c" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:19:37 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-1ef83663-3953-43b6-a62d-92170212e6c4 req-1fd7be2e-8a45-4d7d-968f-88a6917e7789 service nova] Acquired lock "refresh_cache-e88874fe-b0a6-4292-8832-023f95e4f53c" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:19:37 user nova-compute[85141]: DEBUG nova.network.neutron [req-1ef83663-3953-43b6-a62d-92170212e6c4 req-1fd7be2e-8a45-4d7d-968f-88a6917e7789 service nova] [instance: e88874fe-b0a6-4292-8832-023f95e4f53c] Refreshing network info cache for port 7bbea642-d504-433b-ae99-8e7159942751 {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 10:19:37 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-0624d22b-652a-482a-bc6e-bae4ef8d9331 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Acquiring lock "0b388b98-4e65-4258-bbe2-77e699321fb7" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:19:37 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-0624d22b-652a-482a-bc6e-bae4ef8d9331 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Lock "0b388b98-4e65-4258-bbe2-77e699321fb7" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:19:37 user nova-compute[85141]: DEBUG nova.objects.instance [None req-0624d22b-652a-482a-bc6e-bae4ef8d9331 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Lazy-loading 'flavor' on Instance uuid 0b388b98-4e65-4258-bbe2-77e699321fb7 {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:19:37 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-0624d22b-652a-482a-bc6e-bae4ef8d9331 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Lock "0b388b98-4e65-4258-bbe2-77e699321fb7" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:19:37 user nova-compute[85141]: DEBUG nova.network.neutron [None req-27e093f4-6ae1-4d32-a75f-6b1cddd9b374 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] [instance: fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f] Updating instance_info_cache with network_info: [{"id": "cc62aa76-c6d3-42a2-bf2a-7241919a5fc4", "address": "fa:16:3e:3b:bc:05", "network": {"id": "434cf325-212a-4f85-9779-7791dc1c678f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-248496413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cdf22a86934481196276e29c2cdb48b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc62aa76-c6", "ovs_interfaceid": "cc62aa76-c6d3-42a2-bf2a-7241919a5fc4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:19:37 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-0624d22b-652a-482a-bc6e-bae4ef8d9331 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Acquiring lock "0b388b98-4e65-4258-bbe2-77e699321fb7" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:19:37 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-0624d22b-652a-482a-bc6e-bae4ef8d9331 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Lock "0b388b98-4e65-4258-bbe2-77e699321fb7" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:19:37 user nova-compute[85141]: INFO nova.compute.manager [None req-0624d22b-652a-482a-bc6e-bae4ef8d9331 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] [instance: 0b388b98-4e65-4258-bbe2-77e699321fb7] Attaching volume ca5a51ee-cdb2-4efa-b7e5-8a97d0c99bf7 to /dev/vdb
Nov 16 10:19:37 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-27e093f4-6ae1-4d32-a75f-6b1cddd9b374 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] Releasing lock "refresh_cache-fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:19:37 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-f7d2f038-395f-476c-b910-ed77ab36f92b tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] Acquiring lock "e88874fe-b0a6-4292-8832-023f95e4f53c" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:19:37 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-f7d2f038-395f-476c-b910-ed77ab36f92b tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] Lock "e88874fe-b0a6-4292-8832-023f95e4f53c" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:19:37 user nova-compute[85141]: INFO nova.compute.manager [None req-f7d2f038-395f-476c-b910-ed77ab36f92b tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] [instance: e88874fe-b0a6-4292-8832-023f95e4f53c] Shelve offloading
Nov 16 10:19:37 user nova-compute[85141]: DEBUG os_brick.utils [None req-0624d22b-652a-482a-bc6e-bae4ef8d9331 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 10:19:37 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:19:37 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:19:37 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc313414-e6a2-4816-8f1f-859b040d55ed]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c7834de5c295\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:19:37 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:19:37 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:19:37 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[49276d9d-61a0-4452-b450-882b1716f8c5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:19:37 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:19:37 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:19:37 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:19:37 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd3fd018-a6f1-40ff-bf0a-e4a749d0c1eb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:19:37 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e8c6c15-cf37-459c-8c66-e19e803fe994]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:19:37 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-0624d22b-652a-482a-bc6e-bae4ef8d9331 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Running cmd (subprocess): nvme version {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:19:37 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-0624d22b-652a-482a-bc6e-bae4ef8d9331 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] 'nvme version' failed. Not Retrying. {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 10:19:37 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0624d22b-652a-482a-bc6e-bae4ef8d9331 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] nvme not present on system {{(pid=85141) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 10:19:37 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:19:37 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:19:37 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 10:19:37 user nova-compute[85141]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 10:19:37 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[95a879d7-97ec-406c-8bd0-6652149c04ce]: (4, '') {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:19:37 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.lightos [None req-0624d22b-652a-482a-bc6e-bae4ef8d9331 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=85141) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 10:19:37 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.lightos [None req-0624d22b-652a-482a-bc6e-bae4ef8d9331 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=85141) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 10:19:37 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.lightos [None req-0624d22b-652a-482a-bc6e-bae4ef8d9331 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] LIGHTOS: no hostnqn found. {{(pid=85141) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 10:19:37 user nova-compute[85141]: DEBUG os_brick.utils [None req-0624d22b-652a-482a-bc6e-bae4ef8d9331 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] <== get_connector_properties: return (194ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c7834de5c295', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 10:19:37 user nova-compute[85141]: DEBUG nova.virt.block_device [None req-0624d22b-652a-482a-bc6e-bae4ef8d9331 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] [instance: 0b388b98-4e65-4258-bbe2-77e699321fb7] Updating existing volume attachment record: 0cf7d9f1-d7ea-40e1-a185-112abb45db84 {{(pid=85141) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 10:19:37 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:19:37 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:19:37 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:19:37 user nova-compute[85141]: DEBUG nova.network.neutron [req-1ef83663-3953-43b6-a62d-92170212e6c4 req-1fd7be2e-8a45-4d7d-968f-88a6917e7789 service nova] [instance: e88874fe-b0a6-4292-8832-023f95e4f53c] Updated VIF entry in instance network info cache for port 7bbea642-d504-433b-ae99-8e7159942751. {{(pid=85141) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 10:19:37 user nova-compute[85141]: DEBUG nova.network.neutron [req-1ef83663-3953-43b6-a62d-92170212e6c4 req-1fd7be2e-8a45-4d7d-968f-88a6917e7789 service nova] [instance: e88874fe-b0a6-4292-8832-023f95e4f53c] Updating instance_info_cache with network_info: [{"id": "7bbea642-d504-433b-ae99-8e7159942751", "address": "fa:16:3e:6a:e8:c6", "network": {"id": "3fc8f327-8ef7-4b60-abf0-31d75e40478e", "bridge": "br-int", "label": "tempest-TestShelveInstance-452311162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fc33dd813c64594a3626d2e7dff09ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bbea642-d5", "ovs_interfaceid": "7bbea642-d504-433b-ae99-8e7159942751", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:19:37 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-1ef83663-3953-43b6-a62d-92170212e6c4 req-1fd7be2e-8a45-4d7d-968f-88a6917e7789 service nova] Releasing lock "refresh_cache-e88874fe-b0a6-4292-8832-023f95e4f53c" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:19:37 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:19:37 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:19:37 user nova-compute[85141]: DEBUG nova.compute.manager [req-cb2ab3ff-9e78-4ea0-b4f4-95655d9a501a req-c8384dce-14f2-4cc3-84ec-a4e8dce2d318 service nova] [instance: fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f] Received event network-vif-unplugged-cc62aa76-c6d3-42a2-bf2a-7241919a5fc4 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:19:37 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-cb2ab3ff-9e78-4ea0-b4f4-95655d9a501a req-c8384dce-14f2-4cc3-84ec-a4e8dce2d318 service nova] Acquiring lock "fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:19:37 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-cb2ab3ff-9e78-4ea0-b4f4-95655d9a501a req-c8384dce-14f2-4cc3-84ec-a4e8dce2d318 service nova] Lock "fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:19:37 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-cb2ab3ff-9e78-4ea0-b4f4-95655d9a501a req-c8384dce-14f2-4cc3-84ec-a4e8dce2d318 service nova] Lock "fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:19:37 user nova-compute[85141]: DEBUG nova.compute.manager [req-cb2ab3ff-9e78-4ea0-b4f4-95655d9a501a req-c8384dce-14f2-4cc3-84ec-a4e8dce2d318 service nova] [instance: fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f] No waiting events found dispatching network-vif-unplugged-cc62aa76-c6d3-42a2-bf2a-7241919a5fc4 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:19:37 user nova-compute[85141]: WARNING nova.compute.manager [req-cb2ab3ff-9e78-4ea0-b4f4-95655d9a501a req-c8384dce-14f2-4cc3-84ec-a4e8dce2d318 service nova] [instance: fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f] Received unexpected event network-vif-unplugged-cc62aa76-c6d3-42a2-bf2a-7241919a5fc4 for instance with vm_state active and task_state rescuing.
Nov 16 10:19:38 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:19:38 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:19:38 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:19:38 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:19:38 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:19:38 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:19:38 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:19:38 user nova-compute[85141]: DEBUG nova.compute.manager [req-f0f2ccde-430d-40f2-8ac7-8d6d8f5f4e6e req-38618e2a-6254-4b3e-adb1-d746f6e8d04e service nova] [instance: 2d7787a2-b8da-4d39-9b16-4c7bcb275f85] Received event network-changed-3f553883-eaa0-4a7e-8e31-1170241a0236 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:19:38 user nova-compute[85141]: DEBUG nova.compute.manager [req-f0f2ccde-430d-40f2-8ac7-8d6d8f5f4e6e req-38618e2a-6254-4b3e-adb1-d746f6e8d04e service nova] [instance: 2d7787a2-b8da-4d39-9b16-4c7bcb275f85] Refreshing instance network info cache due to event network-changed-3f553883-eaa0-4a7e-8e31-1170241a0236. {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 10:19:38 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-f0f2ccde-430d-40f2-8ac7-8d6d8f5f4e6e req-38618e2a-6254-4b3e-adb1-d746f6e8d04e service nova] Acquiring lock "refresh_cache-2d7787a2-b8da-4d39-9b16-4c7bcb275f85" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:19:38 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-f0f2ccde-430d-40f2-8ac7-8d6d8f5f4e6e req-38618e2a-6254-4b3e-adb1-d746f6e8d04e service nova] Acquired lock "refresh_cache-2d7787a2-b8da-4d39-9b16-4c7bcb275f85" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:19:38 user nova-compute[85141]: DEBUG nova.network.neutron [req-f0f2ccde-430d-40f2-8ac7-8d6d8f5f4e6e req-38618e2a-6254-4b3e-adb1-d746f6e8d04e service nova] [instance: 2d7787a2-b8da-4d39-9b16-4c7bcb275f85] Refreshing network info cache for port 3f553883-eaa0-4a7e-8e31-1170241a0236 {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 10:19:39 user nova-compute[85141]: INFO nova.virt.libvirt.driver [-] [instance: fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f] Instance destroyed successfully.
Nov 16 10:19:39 user nova-compute[85141]: DEBUG nova.network.neutron [req-f0f2ccde-430d-40f2-8ac7-8d6d8f5f4e6e req-38618e2a-6254-4b3e-adb1-d746f6e8d04e service nova] [instance: 2d7787a2-b8da-4d39-9b16-4c7bcb275f85] Updated VIF entry in instance network info cache for port 3f553883-eaa0-4a7e-8e31-1170241a0236. {{(pid=85141) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 10:19:39 user nova-compute[85141]: DEBUG nova.network.neutron [req-f0f2ccde-430d-40f2-8ac7-8d6d8f5f4e6e req-38618e2a-6254-4b3e-adb1-d746f6e8d04e service nova] [instance: 2d7787a2-b8da-4d39-9b16-4c7bcb275f85] Updating instance_info_cache with network_info: [{"id": "3f553883-eaa0-4a7e-8e31-1170241a0236", "address": "fa:16:3e:1c:29:6f", "network": {"id": "436477fd-9294-4297-bfb3-405564823fa0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1068749207-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4e4f57f79564d2fbcb8080bf8f1c5c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f553883-ea", "ovs_interfaceid": "3f553883-eaa0-4a7e-8e31-1170241a0236", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:19:39 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-f0f2ccde-430d-40f2-8ac7-8d6d8f5f4e6e req-38618e2a-6254-4b3e-adb1-d746f6e8d04e service nova] Releasing lock "refresh_cache-2d7787a2-b8da-4d39-9b16-4c7bcb275f85" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:19:39 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-27e093f4-6ae1-4d32-a75f-6b1cddd9b374 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] [instance: fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f] Attempting a stable device rescue
Nov 16 10:19:39 user nova-compute[85141]: DEBUG nova.compute.manager [req-b5309bd0-2691-40ad-bc05-9924e82b1ad4 req-2593b831-8a3d-4400-a512-ef3f59aba2e5 service nova] [instance: e88874fe-b0a6-4292-8832-023f95e4f53c] Received event network-vif-unplugged-7bbea642-d504-433b-ae99-8e7159942751 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:19:39 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-b5309bd0-2691-40ad-bc05-9924e82b1ad4 req-2593b831-8a3d-4400-a512-ef3f59aba2e5 service nova] Acquiring lock "e88874fe-b0a6-4292-8832-023f95e4f53c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:19:39 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-b5309bd0-2691-40ad-bc05-9924e82b1ad4 req-2593b831-8a3d-4400-a512-ef3f59aba2e5 service nova] Lock "e88874fe-b0a6-4292-8832-023f95e4f53c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:19:39 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-b5309bd0-2691-40ad-bc05-9924e82b1ad4 req-2593b831-8a3d-4400-a512-ef3f59aba2e5 service nova] Lock "e88874fe-b0a6-4292-8832-023f95e4f53c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:19:39 user nova-compute[85141]: DEBUG nova.compute.manager [req-b5309bd0-2691-40ad-bc05-9924e82b1ad4 req-2593b831-8a3d-4400-a512-ef3f59aba2e5 service nova] [instance: e88874fe-b0a6-4292-8832-023f95e4f53c] No waiting events found dispatching network-vif-unplugged-7bbea642-d504-433b-ae99-8e7159942751 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:19:39 user nova-compute[85141]: WARNING nova.compute.manager [req-b5309bd0-2691-40ad-bc05-9924e82b1ad4 req-2593b831-8a3d-4400-a512-ef3f59aba2e5 service nova] [instance: e88874fe-b0a6-4292-8832-023f95e4f53c] Received unexpected event network-vif-unplugged-7bbea642-d504-433b-ae99-8e7159942751 for instance with vm_state active and task_state shelving.
Nov 16 10:19:39 user nova-compute[85141]: DEBUG nova.compute.manager [req-b5309bd0-2691-40ad-bc05-9924e82b1ad4 req-2593b831-8a3d-4400-a512-ef3f59aba2e5 service nova] [instance: e88874fe-b0a6-4292-8832-023f95e4f53c] Received event network-vif-plugged-7bbea642-d504-433b-ae99-8e7159942751 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:19:39 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-b5309bd0-2691-40ad-bc05-9924e82b1ad4 req-2593b831-8a3d-4400-a512-ef3f59aba2e5 service nova] Acquiring lock "e88874fe-b0a6-4292-8832-023f95e4f53c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:19:39 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-b5309bd0-2691-40ad-bc05-9924e82b1ad4 req-2593b831-8a3d-4400-a512-ef3f59aba2e5 service nova] Lock "e88874fe-b0a6-4292-8832-023f95e4f53c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:19:39 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-b5309bd0-2691-40ad-bc05-9924e82b1ad4 req-2593b831-8a3d-4400-a512-ef3f59aba2e5 service nova] Lock "e88874fe-b0a6-4292-8832-023f95e4f53c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:19:39 user nova-compute[85141]: DEBUG nova.compute.manager [req-b5309bd0-2691-40ad-bc05-9924e82b1ad4 req-2593b831-8a3d-4400-a512-ef3f59aba2e5 service nova] [instance: e88874fe-b0a6-4292-8832-023f95e4f53c] No waiting events found dispatching network-vif-plugged-7bbea642-d504-433b-ae99-8e7159942751 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:19:39 user nova-compute[85141]: WARNING nova.compute.manager [req-b5309bd0-2691-40ad-bc05-9924e82b1ad4 req-2593b831-8a3d-4400-a512-ef3f59aba2e5 service nova] [instance: e88874fe-b0a6-4292-8832-023f95e4f53c] Received unexpected event network-vif-plugged-7bbea642-d504-433b-ae99-8e7159942751 for instance with vm_state active and task_state shelving.
Nov 16 10:19:39 user nova-compute[85141]: INFO nova.virt.libvirt.driver [-] [instance: e88874fe-b0a6-4292-8832-023f95e4f53c] Instance destroyed successfully.
Nov 16 10:19:39 user nova-compute[85141]: DEBUG nova.compute.manager [None req-f7d2f038-395f-476c-b910-ed77ab36f92b tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] [instance: e88874fe-b0a6-4292-8832-023f95e4f53c] Checking state {{(pid=85141) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 10:19:39 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-f7d2f038-395f-476c-b910-ed77ab36f92b tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] Acquiring lock "refresh_cache-e88874fe-b0a6-4292-8832-023f95e4f53c" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:19:39 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-f7d2f038-395f-476c-b910-ed77ab36f92b tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] Acquired lock "refresh_cache-e88874fe-b0a6-4292-8832-023f95e4f53c" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:19:39 user nova-compute[85141]: DEBUG nova.network.neutron [None req-f7d2f038-395f-476c-b910-ed77ab36f92b tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] [instance: e88874fe-b0a6-4292-8832-023f95e4f53c] Building network info cache for instance {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 10:19:39 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-27e093f4-6ae1-4d32-a75f-6b1cddd9b374 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=85141) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 16 10:19:39 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-27e093f4-6ae1-4d32-a75f-6b1cddd9b374 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] [instance: fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f] Instance directory exists: not creating {{(pid=85141) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 16 10:19:39 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-27e093f4-6ae1-4d32-a75f-6b1cddd9b374 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] [instance: fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f] Creating image(s)
Nov 16 10:19:39 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-27e093f4-6ae1-4d32-a75f-6b1cddd9b374 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] Acquiring lock "/opt/stack/data/nova/instances/fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:19:39 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-27e093f4-6ae1-4d32-a75f-6b1cddd9b374 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] Lock "/opt/stack/data/nova/instances/fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:19:39 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-27e093f4-6ae1-4d32-a75f-6b1cddd9b374 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] Lock "/opt/stack/data/nova/instances/fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:19:39 user nova-compute[85141]: DEBUG nova.objects.instance [None req-27e093f4-6ae1-4d32-a75f-6b1cddd9b374 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] Lazy-loading 'trusted_certs' on Instance uuid fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:19:39 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-27e093f4-6ae1-4d32-a75f-6b1cddd9b374 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] Acquiring lock "406cc5a202afc266bb11ff5fcb0c435bca757503" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:19:39 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-27e093f4-6ae1-4d32-a75f-6b1cddd9b374 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] Lock "406cc5a202afc266bb11ff5fcb0c435bca757503" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:19:40 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-27e093f4-6ae1-4d32-a75f-6b1cddd9b374 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/406cc5a202afc266bb11ff5fcb0c435bca757503.part --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:19:40 user nova-compute[85141]: DEBUG nova.compute.manager [req-32555075-8ddc-491e-a649-b2012dfaaf7e req-f27d2942-7978-49f9-9553-61735a7c7185 service nova] [instance: fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f] Received event network-vif-plugged-cc62aa76-c6d3-42a2-bf2a-7241919a5fc4 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:19:40 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-32555075-8ddc-491e-a649-b2012dfaaf7e req-f27d2942-7978-49f9-9553-61735a7c7185 service nova] Acquiring lock "fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:19:40 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-32555075-8ddc-491e-a649-b2012dfaaf7e req-f27d2942-7978-49f9-9553-61735a7c7185 service nova] Lock "fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:19:40 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-32555075-8ddc-491e-a649-b2012dfaaf7e req-f27d2942-7978-49f9-9553-61735a7c7185 service nova] Lock "fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:19:40 user nova-compute[85141]: DEBUG nova.compute.manager [req-32555075-8ddc-491e-a649-b2012dfaaf7e req-f27d2942-7978-49f9-9553-61735a7c7185 service nova] [instance: fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f] No waiting events found dispatching network-vif-plugged-cc62aa76-c6d3-42a2-bf2a-7241919a5fc4 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:19:40 user nova-compute[85141]: WARNING nova.compute.manager [req-32555075-8ddc-491e-a649-b2012dfaaf7e req-f27d2942-7978-49f9-9553-61735a7c7185 service nova] [instance: fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f] Received unexpected event network-vif-plugged-cc62aa76-c6d3-42a2-bf2a-7241919a5fc4 for instance with vm_state active and task_state rescuing.
Nov 16 10:19:40 user nova-compute[85141]: DEBUG nova.compute.manager [req-32555075-8ddc-491e-a649-b2012dfaaf7e req-f27d2942-7978-49f9-9553-61735a7c7185 service nova] [instance: 9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008] Received event network-vif-plugged-6e352298-a803-4a3c-8f40-dc88ee03687f {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:19:40 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-32555075-8ddc-491e-a649-b2012dfaaf7e req-f27d2942-7978-49f9-9553-61735a7c7185 service nova] Acquiring lock "9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:19:40 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-32555075-8ddc-491e-a649-b2012dfaaf7e req-f27d2942-7978-49f9-9553-61735a7c7185 service nova] Lock "9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:19:40 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-32555075-8ddc-491e-a649-b2012dfaaf7e req-f27d2942-7978-49f9-9553-61735a7c7185 service nova] Lock "9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:19:40 user nova-compute[85141]: DEBUG nova.compute.manager [req-32555075-8ddc-491e-a649-b2012dfaaf7e req-f27d2942-7978-49f9-9553-61735a7c7185 service nova] [instance: 9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008] No waiting events found dispatching network-vif-plugged-6e352298-a803-4a3c-8f40-dc88ee03687f {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:19:40 user nova-compute[85141]: WARNING nova.compute.manager [req-32555075-8ddc-491e-a649-b2012dfaaf7e req-f27d2942-7978-49f9-9553-61735a7c7185 service nova] [instance: 9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008] Received unexpected event network-vif-plugged-6e352298-a803-4a3c-8f40-dc88ee03687f for instance with vm_state active and task_state rebuild_spawning.
Nov 16 10:19:40 user nova-compute[85141]: DEBUG nova.compute.manager [req-32555075-8ddc-491e-a649-b2012dfaaf7e req-f27d2942-7978-49f9-9553-61735a7c7185 service nova] [instance: 9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008] Received event network-vif-plugged-6e352298-a803-4a3c-8f40-dc88ee03687f {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:19:40 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-32555075-8ddc-491e-a649-b2012dfaaf7e req-f27d2942-7978-49f9-9553-61735a7c7185 service nova] Acquiring lock "9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:19:40 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-32555075-8ddc-491e-a649-b2012dfaaf7e req-f27d2942-7978-49f9-9553-61735a7c7185 service nova] Lock "9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:19:40 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-32555075-8ddc-491e-a649-b2012dfaaf7e req-f27d2942-7978-49f9-9553-61735a7c7185 service nova] Lock "9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:19:40 user nova-compute[85141]: DEBUG nova.compute.manager [req-32555075-8ddc-491e-a649-b2012dfaaf7e req-f27d2942-7978-49f9-9553-61735a7c7185 service nova] [instance: 9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008] No waiting events found dispatching network-vif-plugged-6e352298-a803-4a3c-8f40-dc88ee03687f {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:19:40 user nova-compute[85141]: WARNING nova.compute.manager [req-32555075-8ddc-491e-a649-b2012dfaaf7e req-f27d2942-7978-49f9-9553-61735a7c7185 service nova] [instance: 9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008] Received unexpected event network-vif-plugged-6e352298-a803-4a3c-8f40-dc88ee03687f for instance with vm_state active and task_state rebuild_spawning.
Nov 16 10:19:40 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-27e093f4-6ae1-4d32-a75f-6b1cddd9b374 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/406cc5a202afc266bb11ff5fcb0c435bca757503.part --force-share --output=json" returned: 0 in 0.214s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:19:40 user nova-compute[85141]: DEBUG nova.virt.images [None req-27e093f4-6ae1-4d32-a75f-6b1cddd9b374 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] d30c4c00-a799-4d6e-b6c9-8e05a214d632 was qcow2, converting to raw {{(pid=85141) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 16 10:19:40 user nova-compute[85141]: DEBUG nova.privsep.utils [None req-27e093f4-6ae1-4d32-a75f-6b1cddd9b374 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=85141) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 16 10:19:40 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-27e093f4-6ae1-4d32-a75f-6b1cddd9b374 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/406cc5a202afc266bb11ff5fcb0c435bca757503.part /opt/stack/data/nova/instances/_base/406cc5a202afc266bb11ff5fcb0c435bca757503.converted {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:19:40 user nova-compute[85141]: DEBUG nova.network.neutron [None req-f7d2f038-395f-476c-b910-ed77ab36f92b tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] [instance: e88874fe-b0a6-4292-8832-023f95e4f53c] Updating instance_info_cache with network_info: [{"id": "7bbea642-d504-433b-ae99-8e7159942751", "address": "fa:16:3e:6a:e8:c6", "network": {"id": "3fc8f327-8ef7-4b60-abf0-31d75e40478e", "bridge": "br-int", "label": "tempest-TestShelveInstance-452311162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fc33dd813c64594a3626d2e7dff09ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bbea642-d5", "ovs_interfaceid": "7bbea642-d504-433b-ae99-8e7159942751", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:19:40 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-f7d2f038-395f-476c-b910-ed77ab36f92b tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] Releasing lock "refresh_cache-e88874fe-b0a6-4292-8832-023f95e4f53c" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:19:41 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-27e093f4-6ae1-4d32-a75f-6b1cddd9b374 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/406cc5a202afc266bb11ff5fcb0c435bca757503.part /opt/stack/data/nova/instances/_base/406cc5a202afc266bb11ff5fcb0c435bca757503.converted" returned: 0 in 0.819s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:19:41 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-27e093f4-6ae1-4d32-a75f-6b1cddd9b374 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/406cc5a202afc266bb11ff5fcb0c435bca757503.converted --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:19:41 user nova-compute[85141]: DEBUG nova.compute.manager [None req-7a7a4e4d-2f16-4640-a866-9af9d05426e0 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] [instance: 9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008] Instance event wait completed in 0 seconds for  {{(pid=85141) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 10:19:41 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-7a7a4e4d-2f16-4640-a866-9af9d05426e0 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] [instance: 9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008] Guest created on hypervisor {{(pid=85141) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 10:19:41 user nova-compute[85141]: DEBUG nova.compute.manager [req-8dc83b03-9afd-4229-a535-dcd2e47280bd req-b975cf90-8834-41b6-ab81-f4b1c110dbf6 service nova] [instance: bff3a84b-6ab5-4256-8a04-2d21a4ba20b3] Received event network-changed-23ec0327-ca81-4524-8850-2c081e596d44 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:19:41 user nova-compute[85141]: DEBUG nova.compute.manager [req-8dc83b03-9afd-4229-a535-dcd2e47280bd req-b975cf90-8834-41b6-ab81-f4b1c110dbf6 service nova] [instance: bff3a84b-6ab5-4256-8a04-2d21a4ba20b3] Refreshing instance network info cache due to event network-changed-23ec0327-ca81-4524-8850-2c081e596d44. {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 10:19:41 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-8dc83b03-9afd-4229-a535-dcd2e47280bd req-b975cf90-8834-41b6-ab81-f4b1c110dbf6 service nova] Acquiring lock "refresh_cache-bff3a84b-6ab5-4256-8a04-2d21a4ba20b3" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:19:41 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-8dc83b03-9afd-4229-a535-dcd2e47280bd req-b975cf90-8834-41b6-ab81-f4b1c110dbf6 service nova] Acquired lock "refresh_cache-bff3a84b-6ab5-4256-8a04-2d21a4ba20b3" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:19:41 user nova-compute[85141]: DEBUG nova.network.neutron [req-8dc83b03-9afd-4229-a535-dcd2e47280bd req-b975cf90-8834-41b6-ab81-f4b1c110dbf6 service nova] [instance: bff3a84b-6ab5-4256-8a04-2d21a4ba20b3] Refreshing network info cache for port 23ec0327-ca81-4524-8850-2c081e596d44 {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 10:19:41 user nova-compute[85141]: INFO nova.virt.libvirt.driver [-] [instance: 9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008] Instance spawned successfully.
Nov 16 10:19:41 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-7a7a4e4d-2f16-4640-a866-9af9d05426e0 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] [instance: 9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 10:19:41 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-7a7a4e4d-2f16-4640-a866-9af9d05426e0 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] [instance: 9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008] Found default for hw_cdrom_bus of ide {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:19:41 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-7a7a4e4d-2f16-4640-a866-9af9d05426e0 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] [instance: 9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008] Found default for hw_disk_bus of virtio {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:19:41 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-7a7a4e4d-2f16-4640-a866-9af9d05426e0 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] [instance: 9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008] Found default for hw_input_bus of None {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:19:41 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-7a7a4e4d-2f16-4640-a866-9af9d05426e0 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] [instance: 9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008] Found default for hw_pointer_model of None {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:19:41 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-7a7a4e4d-2f16-4640-a866-9af9d05426e0 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] [instance: 9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008] Found default for hw_video_model of virtio {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:19:41 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-7a7a4e4d-2f16-4640-a866-9af9d05426e0 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] [instance: 9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008] Found default for hw_vif_model of virtio {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:19:41 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:19:41 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-27e093f4-6ae1-4d32-a75f-6b1cddd9b374 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/406cc5a202afc266bb11ff5fcb0c435bca757503.converted --force-share --output=json" returned: 0 in 0.199s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:19:41 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-27e093f4-6ae1-4d32-a75f-6b1cddd9b374 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] Lock "406cc5a202afc266bb11ff5fcb0c435bca757503" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.421s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:19:41 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-27e093f4-6ae1-4d32-a75f-6b1cddd9b374 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] Acquiring lock "406cc5a202afc266bb11ff5fcb0c435bca757503" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:19:41 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-27e093f4-6ae1-4d32-a75f-6b1cddd9b374 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] Lock "406cc5a202afc266bb11ff5fcb0c435bca757503" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:19:41 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-27e093f4-6ae1-4d32-a75f-6b1cddd9b374 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/406cc5a202afc266bb11ff5fcb0c435bca757503 --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:19:41 user nova-compute[85141]: DEBUG nova.compute.manager [None req-7a7a4e4d-2f16-4640-a866-9af9d05426e0 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] [instance: 9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008] Checking state {{(pid=85141) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 10:19:41 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-f4238145-325c-45e3-8d23-2cd20cedfc9d tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Acquiring lock "2d7787a2-b8da-4d39-9b16-4c7bcb275f85" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:19:41 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-f4238145-325c-45e3-8d23-2cd20cedfc9d tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Lock "2d7787a2-b8da-4d39-9b16-4c7bcb275f85" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:19:41 user nova-compute[85141]: INFO nova.compute.manager [None req-f4238145-325c-45e3-8d23-2cd20cedfc9d tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] [instance: 2d7787a2-b8da-4d39-9b16-4c7bcb275f85] Rebooting instance
Nov 16 10:19:41 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-7a7a4e4d-2f16-4640-a866-9af9d05426e0 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:19:41 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-7a7a4e4d-2f16-4640-a866-9af9d05426e0 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:19:41 user nova-compute[85141]: DEBUG nova.objects.instance [None req-7a7a4e4d-2f16-4640-a866-9af9d05426e0 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] [instance: 9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008] Trying to apply a migration context that does not seem to be set for this instance {{(pid=85141) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Nov 16 10:19:41 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-27e093f4-6ae1-4d32-a75f-6b1cddd9b374 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/406cc5a202afc266bb11ff5fcb0c435bca757503 --force-share --output=json" returned: 0 in 0.211s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:19:41 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-27e093f4-6ae1-4d32-a75f-6b1cddd9b374 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/406cc5a202afc266bb11ff5fcb0c435bca757503,backing_fmt=raw /opt/stack/data/nova/instances/fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f/disk.rescue {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:19:41 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-27e093f4-6ae1-4d32-a75f-6b1cddd9b374 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/406cc5a202afc266bb11ff5fcb0c435bca757503,backing_fmt=raw /opt/stack/data/nova/instances/fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f/disk.rescue" returned: 0 in 0.067s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:19:41 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-27e093f4-6ae1-4d32-a75f-6b1cddd9b374 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] Lock "406cc5a202afc266bb11ff5fcb0c435bca757503" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.283s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:19:41 user nova-compute[85141]: DEBUG nova.objects.instance [None req-27e093f4-6ae1-4d32-a75f-6b1cddd9b374 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] Lazy-loading 'migration_context' on Instance uuid fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:19:41 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-7a7a4e4d-2f16-4640-a866-9af9d05426e0 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.145s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:19:41 user nova-compute[85141]: DEBUG nova.objects.base [None req-27e093f4-6ae1-4d32-a75f-6b1cddd9b374 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] Object Instance<fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f> lazy-loaded attributes: trusted_certs,migration_context {{(pid=85141) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 10:19:41 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-27e093f4-6ae1-4d32-a75f-6b1cddd9b374 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] [instance: fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f] Created local disks {{(pid=85141) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 10:19:41 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-27e093f4-6ae1-4d32-a75f-6b1cddd9b374 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] [instance: fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f] Start _get_guest_xml network_info=[{"id": "cc62aa76-c6d3-42a2-bf2a-7241919a5fc4", "address": "fa:16:3e:3b:bc:05", "network": {"id": "434cf325-212a-4f85-9779-7791dc1c678f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-248496413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-248496413-network", "vif_mac": "fa:16:3e:3b:bc:05"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cdf22a86934481196276e29c2cdb48b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc62aa76-c6", "ovs_interfaceid": "cc62aa76-c6d3-42a2-bf2a-7241919a5fc4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T10:06:42Z,direct_url=<?>,disk_format='qcow2',id=bc4ca70f-a459-4d5c-a9e6-80f1948eb48b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1044631a5fe84ce8904864a7024049fa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T10:06:44Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'd30c4c00-a799-4d6e-b6c9-8e05a214d632', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_options': None, 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'image_id': 'bc4ca70f-a459-4d5c-a9e6-80f1948eb48b'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:3392fa71-5ceb-42f9-acb8-b9e69b8b1cfa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'svSOAuQY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': 'fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f', 'attached_at': '', 'detached_at': '', 'volume_id': '3392fa71-5ceb-42f9-acb8-b9e69b8b1cfa', 'serial': '3392fa71-5ceb-42f9-acb8-b9e69b8b1cfa'}, 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'boot_index': None, 'attachment_id': '8c82e1d9-8d90-4d20-87d8-bf47ef16d2dd', 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=85141) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 10:19:41 user nova-compute[85141]: DEBUG nova.objects.instance [None req-27e093f4-6ae1-4d32-a75f-6b1cddd9b374 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] Lazy-loading 'resources' on Instance uuid fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:19:42 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-f4238145-325c-45e3-8d23-2cd20cedfc9d tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Acquiring lock "refresh_cache-2d7787a2-b8da-4d39-9b16-4c7bcb275f85" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:19:42 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-f4238145-325c-45e3-8d23-2cd20cedfc9d tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Acquired lock "refresh_cache-2d7787a2-b8da-4d39-9b16-4c7bcb275f85" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:19:42 user nova-compute[85141]: DEBUG nova.network.neutron [None req-f4238145-325c-45e3-8d23-2cd20cedfc9d tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] [instance: 2d7787a2-b8da-4d39-9b16-4c7bcb275f85] Building network info cache for instance {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 10:19:42 user nova-compute[85141]: DEBUG nova.objects.base [None req-27e093f4-6ae1-4d32-a75f-6b1cddd9b374 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] Object Instance<fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=85141) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 10:19:42 user nova-compute[85141]: DEBUG nova.objects.instance [None req-27e093f4-6ae1-4d32-a75f-6b1cddd9b374 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] Lazy-loading 'numa_topology' on Instance uuid fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:19:42 user nova-compute[85141]: DEBUG nova.objects.base [None req-27e093f4-6ae1-4d32-a75f-6b1cddd9b374 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] Object Instance<fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=85141) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 10:19:42 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-27e093f4-6ae1-4d32-a75f-6b1cddd9b374 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:19:42 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-27e093f4-6ae1-4d32-a75f-6b1cddd9b374 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:19:42 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-27e093f4-6ae1-4d32-a75f-6b1cddd9b374 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=85141) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 10:19:42 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-27e093f4-6ae1-4d32-a75f-6b1cddd9b374 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] CPU controller missing on host. {{(pid=85141) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 10:19:42 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-27e093f4-6ae1-4d32-a75f-6b1cddd9b374 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=85141) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 10:19:42 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-27e093f4-6ae1-4d32-a75f-6b1cddd9b374 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] CPU controller found on host. {{(pid=85141) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 10:19:42 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-27e093f4-6ae1-4d32-a75f-6b1cddd9b374 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=85141) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 10:19:42 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-27e093f4-6ae1-4d32-a75f-6b1cddd9b374 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T10:06:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T10:06:42Z,direct_url=<?>,disk_format='qcow2',id=bc4ca70f-a459-4d5c-a9e6-80f1948eb48b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1044631a5fe84ce8904864a7024049fa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T10:06:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 10:19:42 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-27e093f4-6ae1-4d32-a75f-6b1cddd9b374 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] Flavor limits 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 10:19:42 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-27e093f4-6ae1-4d32-a75f-6b1cddd9b374 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] Image limits 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 10:19:42 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-27e093f4-6ae1-4d32-a75f-6b1cddd9b374 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] Flavor pref 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 10:19:42 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-27e093f4-6ae1-4d32-a75f-6b1cddd9b374 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] Image pref 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 10:19:42 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-27e093f4-6ae1-4d32-a75f-6b1cddd9b374 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 10:19:42 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-27e093f4-6ae1-4d32-a75f-6b1cddd9b374 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 10:19:42 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-27e093f4-6ae1-4d32-a75f-6b1cddd9b374 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=85141) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 10:19:42 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-27e093f4-6ae1-4d32-a75f-6b1cddd9b374 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] Got 1 possible topologies {{(pid=85141) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 10:19:42 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-27e093f4-6ae1-4d32-a75f-6b1cddd9b374 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 10:19:42 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-27e093f4-6ae1-4d32-a75f-6b1cddd9b374 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 10:19:42 user nova-compute[85141]: DEBUG nova.objects.instance [None req-27e093f4-6ae1-4d32-a75f-6b1cddd9b374 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] Lazy-loading 'vcpu_model' on Instance uuid fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:19:42 user nova-compute[85141]: DEBUG nova.objects.base [None req-27e093f4-6ae1-4d32-a75f-6b1cddd9b374 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] Object Instance<fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=85141) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 10:19:42 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-27e093f4-6ae1-4d32-a75f-6b1cddd9b374 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] [instance: fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f] Calling os-brick to attach iSCSI Volume {{(pid=85141) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 10:19:42 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-27e093f4-6ae1-4d32-a75f-6b1cddd9b374 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51806b6080>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3392fa71-5ceb-42f9-acb8-b9e69b8b1cfa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'svSOAuQY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 10:19:42 user nova-compute[85141]: WARNING os_brick.initiator.connectors.base [None req-27e093f4-6ae1-4d32-a75f-6b1cddd9b374 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 10:19:42 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-27e093f4-6ae1-4d32-a75f-6b1cddd9b374 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 10:19:42 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-27e093f4-6ae1-4d32-a75f-6b1cddd9b374 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 10:19:42 user nova-compute[85141]: WARNING os_brick.initiator.connectors.base [None req-27e093f4-6ae1-4d32-a75f-6b1cddd9b374 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 10:19:42 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-27e093f4-6ae1-4d32-a75f-6b1cddd9b374 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3392fa71-5ceb-42f9-acb8-b9e69b8b1cfa" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 10:19:42 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-27e093f4-6ae1-4d32-a75f-6b1cddd9b374 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3392fa71-5ceb-42f9-acb8-b9e69b8b1cfa" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 10:19:42 user nova-compute[85141]: INFO os_brick.initiator.connectors.iscsi [None req-27e093f4-6ae1-4d32-a75f-6b1cddd9b374 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 10:19:42 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3392fa71-5ceb-42f9-acb8-b9e69b8b1cfa -p 172.16.0.220:3260 {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:19:42 user nova-compute[85141]: DEBUG nova.compute.manager [req-7d1d8463-64c0-46cc-bfc9-7f6a14d40a21 req-f47f16eb-9ffd-4bf9-9e6f-be8d3f4dbb3b service nova] [instance: e88874fe-b0a6-4292-8832-023f95e4f53c] Received event network-changed-7bbea642-d504-433b-ae99-8e7159942751 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:19:42 user nova-compute[85141]: DEBUG nova.compute.manager [req-7d1d8463-64c0-46cc-bfc9-7f6a14d40a21 req-f47f16eb-9ffd-4bf9-9e6f-be8d3f4dbb3b service nova] [instance: e88874fe-b0a6-4292-8832-023f95e4f53c] Refreshing instance network info cache due to event network-changed-7bbea642-d504-433b-ae99-8e7159942751. {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 10:19:42 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-7d1d8463-64c0-46cc-bfc9-7f6a14d40a21 req-f47f16eb-9ffd-4bf9-9e6f-be8d3f4dbb3b service nova] Acquiring lock "refresh_cache-e88874fe-b0a6-4292-8832-023f95e4f53c" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:19:42 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-7d1d8463-64c0-46cc-bfc9-7f6a14d40a21 req-f47f16eb-9ffd-4bf9-9e6f-be8d3f4dbb3b service nova] Acquired lock "refresh_cache-e88874fe-b0a6-4292-8832-023f95e4f53c" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:19:42 user nova-compute[85141]: DEBUG nova.network.neutron [req-7d1d8463-64c0-46cc-bfc9-7f6a14d40a21 req-f47f16eb-9ffd-4bf9-9e6f-be8d3f4dbb3b service nova] [instance: e88874fe-b0a6-4292-8832-023f95e4f53c] Refreshing network info cache for port 7bbea642-d504-433b-ae99-8e7159942751 {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 10:19:42 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3392fa71-5ceb-42f9-acb8-b9e69b8b1cfa -p 172.16.0.220:3260" returned: 0 in 0.020s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:19:42 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[49e06765-04fc-4e27-90a7-ea655d15bde6]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:3392fa71-5ceb-42f9-acb8-b9e69b8b1cfa\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = svSOAuQY\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:19:42 user nova-compute[85141]: INFO nova.virt.libvirt.driver [-] [instance: e88874fe-b0a6-4292-8832-023f95e4f53c] Instance destroyed successfully.
Nov 16 10:19:42 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-27e093f4-6ae1-4d32-a75f-6b1cddd9b374 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 16 10:19:42 user nova-compute[85141]: node.name = iqn.2010-10.org.openstack:3392fa71-5ceb-42f9-acb8-b9e69b8b1cfa
Nov 16 10:19:42 user nova-compute[85141]: node.tpgt = -1
Nov 16 10:19:42 user nova-compute[85141]: node.startup = automatic
Nov 16 10:19:42 user nova-compute[85141]: node.leading_login = No
Nov 16 10:19:42 user nova-compute[85141]: iface.iscsi_ifacename = default
Nov 16 10:19:42 user nova-compute[85141]: iface.net_ifacename = <empty>
Nov 16 10:19:42 user nova-compute[85141]: iface.ipaddress = <empty>
Nov 16 10:19:42 user nova-compute[85141]: iface.prefix_len = 0
Nov 16 10:19:42 user nova-compute[85141]: iface.hwaddress = <empty>
Nov 16 10:19:42 user nova-compute[85141]: iface.transport_name = tcp
Nov 16 10:19:42 user nova-compute[85141]: iface.initiatorname = <empty>
Nov 16 10:19:42 user nova-compute[85141]: iface.state = <empty>
Nov 16 10:19:42 user nova-compute[85141]: iface.vlan_id = 0
Nov 16 10:19:42 user nova-compute[85141]: iface.vlan_priority = 0
Nov 16 10:19:42 user nova-compute[85141]: iface.vlan_state = <empty>
Nov 16 10:19:42 user nova-compute[85141]: iface.iface_num = 0
Nov 16 10:19:42 user nova-compute[85141]: iface.mtu = 0
Nov 16 10:19:42 user nova-compute[85141]: iface.port = 0
Nov 16 10:19:42 user nova-compute[85141]: iface.bootproto = <empty>
Nov 16 10:19:42 user nova-compute[85141]: iface.subnet_mask = <empty>
Nov 16 10:19:42 user nova-compute[85141]: iface.gateway = <empty>
Nov 16 10:19:42 user nova-compute[85141]: iface.dhcp_alt_client_id_state = <empty>
Nov 16 10:19:42 user nova-compute[85141]: iface.dhcp_alt_client_id = <empty>
Nov 16 10:19:42 user nova-compute[85141]: iface.dhcp_dns = <empty>
Nov 16 10:19:42 user nova-compute[85141]: iface.dhcp_learn_iqn = <empty>
Nov 16 10:19:42 user nova-compute[85141]: iface.dhcp_req_vendor_id_state = <empty>
Nov 16 10:19:42 user nova-compute[85141]: iface.dhcp_vendor_id_state = <empty>
Nov 16 10:19:42 user nova-compute[85141]: iface.dhcp_vendor_id = <empty>
Nov 16 10:19:42 user nova-compute[85141]: iface.dhcp_slp_da = <empty>
Nov 16 10:19:42 user nova-compute[85141]: iface.fragmentation = <empty>
Nov 16 10:19:42 user nova-compute[85141]: iface.gratuitous_arp = <empty>
Nov 16 10:19:42 user nova-compute[85141]: iface.incoming_forwarding = <empty>
Nov 16 10:19:42 user nova-compute[85141]: iface.tos_state = <empty>
Nov 16 10:19:42 user nova-compute[85141]: iface.tos = 0
Nov 16 10:19:42 user nova-compute[85141]: iface.ttl = 0
Nov 16 10:19:42 user nova-compute[85141]: iface.delayed_ack = <empty>
Nov 16 10:19:42 user nova-compute[85141]: iface.tcp_nagle = <empty>
Nov 16 10:19:42 user nova-compute[85141]: iface.tcp_wsf_state = <empty>
Nov 16 10:19:42 user nova-compute[85141]: iface.tcp_wsf = 0
Nov 16 10:19:42 user nova-compute[85141]: iface.tcp_timer_scale = 0
Nov 16 10:19:42 user nova-compute[85141]: iface.tcp_timestamp = <empty>
Nov 16 10:19:42 user nova-compute[85141]: iface.redirect = <empty>
Nov 16 10:19:42 user nova-compute[85141]: iface.def_task_mgmt_timeout = 0
Nov 16 10:19:42 user nova-compute[85141]: iface.header_digest = <empty>
Nov 16 10:19:42 user nova-compute[85141]: iface.data_digest = <empty>
Nov 16 10:19:42 user nova-compute[85141]: iface.immediate_data = <empty>
Nov 16 10:19:42 user nova-compute[85141]: iface.initial_r2t = <empty>
Nov 16 10:19:42 user nova-compute[85141]: iface.data_seq_inorder = <empty>
Nov 16 10:19:42 user nova-compute[85141]: iface.data_pdu_inorder = <empty>
Nov 16 10:19:42 user nova-compute[85141]: iface.erl = 0
Nov 16 10:19:42 user nova-compute[85141]: iface.max_receive_data_len = 0
Nov 16 10:19:42 user nova-compute[85141]: iface.first_burst_len = 0
Nov 16 10:19:42 user nova-compute[85141]: iface.max_outstanding_r2t = 0
Nov 16 10:19:42 user nova-compute[85141]: iface.max_burst_len = 0
Nov 16 10:19:42 user nova-compute[85141]: iface.chap_auth = <empty>
Nov 16 10:19:42 user nova-compute[85141]: iface.bidi_chap = <empty>
Nov 16 10:19:42 user nova-compute[85141]: iface.strict_login_compliance = <empty>
Nov 16 10:19:42 user nova-compute[85141]: iface.discovery_auth = <empty>
Nov 16 10:19:42 user nova-compute[85141]: iface.discovery_logout = <empty>
Nov 16 10:19:42 user nova-compute[85141]: node.discovery_address = <empty>
Nov 16 10:19:42 user nova-compute[85141]: node.discovery_port = 0
Nov 16 10:19:42 user nova-compute[85141]: node.discovery_type = static
Nov 16 10:19:42 user nova-compute[85141]: node.session.initial_cmdsn = 0
Nov 16 10:19:42 user nova-compute[85141]: node.session.initial_login_retry_max = 8
Nov 16 10:19:42 user nova-compute[85141]: node.session.xmit_thread_priority = -20
Nov 16 10:19:42 user nova-compute[85141]: node.session.cmds_max = 128
Nov 16 10:19:42 user nova-compute[85141]: node.session.queue_depth = 32
Nov 16 10:19:42 user nova-compute[85141]: node.session.nr_sessions = 1
Nov 16 10:19:42 user nova-compute[85141]: node.session.auth.authmethod = CHAP
Nov 16 10:19:42 user nova-compute[85141]: node.session.auth.username = svSOAuQY
Nov 16 10:19:42 user nova-compute[85141]: node.session.auth.password = ***
Nov 16 10:19:42 user nova-compute[85141]: node.session.auth.username_in = <empty>
Nov 16 10:19:42 user nova-compute[85141]: node.session.auth.password_in = <empty>
Nov 16 10:19:42 user nova-compute[85141]: node.session.auth.chap_algs = MD5
Nov 16 10:19:42 user nova-compute[85141]: node.session.timeo.replacement_timeout = 120
Nov 16 10:19:42 user nova-compute[85141]: node.session.err_timeo.abort_timeout = 15
Nov 16 10:19:42 user nova-compute[85141]: node.session.err_timeo.lu_reset_timeout = 30
Nov 16 10:19:42 user nova-compute[85141]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 16 10:19:42 user nova-compute[85141]: node.session.err_timeo.host_reset_timeout = 60
Nov 16 10:19:42 user nova-compute[85141]: node.session.iscsi.FastAbort = Yes
Nov 16 10:19:42 user nova-compute[85141]: node.session.iscsi.InitialR2T = No
Nov 16 10:19:42 user nova-compute[85141]: node.session.iscsi.ImmediateData = Yes
Nov 16 10:19:42 user nova-compute[85141]: node.session.iscsi.FirstBurstLength = 262144
Nov 16 10:19:42 user nova-compute[85141]: node.session.iscsi.MaxBurstLength = 16776192
Nov 16 10:19:42 user nova-compute[85141]: node.session.iscsi.DefaultTime2Retain = 0
Nov 16 10:19:42 user nova-compute[85141]: node.session.iscsi.DefaultTime2Wait = 2
Nov 16 10:19:42 user nova-compute[85141]: node.session.iscsi.MaxConnections = 1
Nov 16 10:19:42 user nova-compute[85141]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 16 10:19:42 user nova-compute[85141]: node.session.iscsi.ERL = 0
Nov 16 10:19:42 user nova-compute[85141]: node.session.scan = manual
Nov 16 10:19:42 user nova-compute[85141]: node.session.reopen_max = 0
Nov 16 10:19:42 user nova-compute[85141]: node.conn[0].address = 172.16.0.220
Nov 16 10:19:42 user nova-compute[85141]: node.conn[0].port = 3260
Nov 16 10:19:42 user nova-compute[85141]: node.conn[0].startup = manual
Nov 16 10:19:42 user nova-compute[85141]: node.conn[0].tcp.window_size = 524288
Nov 16 10:19:42 user nova-compute[85141]: node.conn[0].tcp.type_of_service = 0
Nov 16 10:19:42 user nova-compute[85141]: node.conn[0].timeo.logout_timeout = 15
Nov 16 10:19:42 user nova-compute[85141]: node.conn[0].timeo.login_timeout = 15
Nov 16 10:19:42 user nova-compute[85141]: node.conn[0].timeo.auth_timeout = 45
Nov 16 10:19:42 user nova-compute[85141]: node.conn[0].timeo.noop_out_interval = 5
Nov 16 10:19:42 user nova-compute[85141]: node.conn[0].timeo.noop_out_timeout = 5
Nov 16 10:19:42 user nova-compute[85141]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 16 10:19:42 user nova-compute[85141]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 16 10:19:42 user nova-compute[85141]: node.conn[0].iscsi.HeaderDigest = None
Nov 16 10:19:42 user nova-compute[85141]: node.conn[0].iscsi.DataDigest = None
Nov 16 10:19:42 user nova-compute[85141]: node.conn[0].iscsi.IFMarker = No
Nov 16 10:19:42 user nova-compute[85141]: node.conn[0].iscsi.OFMarker = No
Nov 16 10:19:42 user nova-compute[85141]: # END RECORD
Nov 16 10:19:42 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:19:42 user nova-compute[85141]: DEBUG nova.objects.instance [None req-f7d2f038-395f-476c-b910-ed77ab36f92b tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] Lazy-loading 'resources' on Instance uuid e88874fe-b0a6-4292-8832-023f95e4f53c {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:19:42 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3392fa71-5ceb-42f9-acb8-b9e69b8b1cfa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:19:42 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-f7d2f038-395f-476c-b910-ed77ab36f92b tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T10:17:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-2111105262',display_name='tempest-TestShelveInstance-server-2111105262',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-2111105262',id=24,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBfWaK0ZY9CcidWmK2fKQywgej86dJ2hf+UK4R5TPd7pgcpe0Smv+B/1pPMISWG/EAcRok8hWGEmbvkAXnZfkTd4Ehr6r8dlkWNbm3jRYnDsKSJPOJlCYlPCFvR/gAoWpQ==',key_name='tempest-TestShelveInstance-1696654997',keypairs=<?>,launch_index=0,launched_at=2023-11-16T10:18:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5fc33dd813c64594a3626d2e7dff09ad',ramdisk_id='',reservation_id='r-7djljt23',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-289614798',owner_user_name='tempest-TestShelveInstance-289614798-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T10:18:00Z,user_data=None,user_id='462543c542ac4e84b99277f8cdd29807',uuid=e88874fe-b0a6-4292-8832-023f95e4f53c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7bbea642-d504-433b-ae99-8e7159942751", "address": "fa:16:3e:6a:e8:c6", "network": {"id": "3fc8f327-8ef7-4b60-abf0-31d75e40478e", "bridge": "br-int", "label": "tempest-TestShelveInstance-452311162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fc33dd813c64594a3626d2e7dff09ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bbea642-d5", "ovs_interfaceid": "7bbea642-d504-433b-ae99-8e7159942751", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 10:19:42 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-f7d2f038-395f-476c-b910-ed77ab36f92b tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] Converting VIF {"id": "7bbea642-d504-433b-ae99-8e7159942751", "address": "fa:16:3e:6a:e8:c6", "network": {"id": "3fc8f327-8ef7-4b60-abf0-31d75e40478e", "bridge": "br-int", "label": "tempest-TestShelveInstance-452311162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fc33dd813c64594a3626d2e7dff09ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bbea642-d5", "ovs_interfaceid": "7bbea642-d504-433b-ae99-8e7159942751", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:19:42 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-f7d2f038-395f-476c-b910-ed77ab36f92b tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6a:e8:c6,bridge_name='br-int',has_traffic_filtering=True,id=7bbea642-d504-433b-ae99-8e7159942751,network=Network(3fc8f327-8ef7-4b60-abf0-31d75e40478e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7bbea642-d5') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:19:42 user nova-compute[85141]: DEBUG os_vif [None req-f7d2f038-395f-476c-b910-ed77ab36f92b tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:e8:c6,bridge_name='br-int',has_traffic_filtering=True,id=7bbea642-d504-433b-ae99-8e7159942751,network=Network(3fc8f327-8ef7-4b60-abf0-31d75e40478e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7bbea642-d5') {{(pid=85141) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 10:19:42 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3392fa71-5ceb-42f9-acb8-b9e69b8b1cfa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:19:42 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[3259a56e-80c5-459c-93c2-f819ab849493]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:19:42 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-27e093f4-6ae1-4d32-a75f-6b1cddd9b374 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:19:42 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:19:42 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7bbea642-d5, bridge=br-int, if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:19:42 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3392fa71-5ceb-42f9-acb8-b9e69b8b1cfa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:19:42 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:19:42 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:19:42 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:19:42 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:19:42 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e95c9279-7c23-4521-9332-5bf077a75cb5) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:19:42 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:19:42 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:19:42 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3392fa71-5ceb-42f9-acb8-b9e69b8b1cfa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.030s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:19:42 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2be2d75-0627-4090-a074-e27afb6cd4bb]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:19:42 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-27e093f4-6ae1-4d32-a75f-6b1cddd9b374 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:19:42 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:19:42 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3392fa71-5ceb-42f9-acb8-b9e69b8b1cfa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v svSOAuQY {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:19:42 user nova-compute[85141]: INFO os_vif [None req-f7d2f038-395f-476c-b910-ed77ab36f92b tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:e8:c6,bridge_name='br-int',has_traffic_filtering=True,id=7bbea642-d504-433b-ae99-8e7159942751,network=Network(3fc8f327-8ef7-4b60-abf0-31d75e40478e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7bbea642-d5')
Nov 16 10:19:42 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f7d2f038-395f-476c-b910-ed77ab36f92b tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] [instance: e88874fe-b0a6-4292-8832-023f95e4f53c] calling os-brick to detach iSCSI Volume {{(pid=85141) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 10:19:42 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7d2f038-395f-476c-b910-ed77ab36f92b tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51806b6080>, {'target_iqn': 'iqn.2010-10.org.openstack:674f9ae8-6ab5-4ff2-b715-fe8807c34793', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qDxyoBhW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 10:19:42 user nova-compute[85141]: WARNING os_brick.initiator.connectors.base [None req-f7d2f038-395f-476c-b910-ed77ab36f92b tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 10:19:42 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-f7d2f038-395f-476c-b910-ed77ab36f92b tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 10:19:42 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3392fa71-5ceb-42f9-acb8-b9e69b8b1cfa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v svSOAuQY" returned: 0 in 0.026s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:19:42 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[86f98f5a-4ce2-4f67-82a5-f21bf5a481d9]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:19:42 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-27e093f4-6ae1-4d32-a75f-6b1cddd9b374 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'svSOAuQY'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:19:42 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3392fa71-5ceb-42f9-acb8-b9e69b8b1cfa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:19:42 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3392fa71-5ceb-42f9-acb8-b9e69b8b1cfa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.029s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:19:42 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a127799-30e4-48c7-9b96-25672cb939fc]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:19:42 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-27e093f4-6ae1-4d32-a75f-6b1cddd9b374 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:19:42 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:19:42 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:19:42 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b0994e8-e533-4cd7-b32b-6e30b7ee1f24]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:674f9ae8-6ab5-4ff2-b715-fe8807c34793 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dc504e0-da46-4c57-a66d-8ae6ce9c733c (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3392fa71-5ceb-42f9-acb8-b9e69b8b1cfa (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7784b4-2ba5-4085-9e17-877c754115c8 (non-flash)\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:19:42 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-27e093f4-6ae1-4d32-a75f-6b1cddd9b374 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)
Nov 16 10:19:42 user nova-compute[85141]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:674f9ae8-6ab5-4ff2-b715-fe8807c34793 (non-flash)
Nov 16 10:19:42 user nova-compute[85141]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dc504e0-da46-4c57-a66d-8ae6ce9c733c (non-flash)
Nov 16 10:19:42 user nova-compute[85141]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3392fa71-5ceb-42f9-acb8-b9e69b8b1cfa (non-flash)
Nov 16 10:19:42 user nova-compute[85141]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7784b4-2ba5-4085-9e17-877c754115c8 (non-flash)
Nov 16 10:19:42 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:19:42 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-27e093f4-6ae1-4d32-a75f-6b1cddd9b374 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)
Nov 16 10:19:42 user nova-compute[85141]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:674f9ae8-6ab5-4ff2-b715-fe8807c34793 (non-flash)
Nov 16 10:19:42 user nova-compute[85141]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dc504e0-da46-4c57-a66d-8ae6ce9c733c (non-flash)
Nov 16 10:19:42 user nova-compute[85141]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3392fa71-5ceb-42f9-acb8-b9e69b8b1cfa (non-flash)
Nov 16 10:19:42 user nova-compute[85141]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7784b4-2ba5-4085-9e17-877c754115c8 (non-flash)
Nov 16 10:19:42 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 10:19:42 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-27e093f4-6ae1-4d32-a75f-6b1cddd9b374 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3392fa71-5ceb-42f9-acb8-b9e69b8b1cfa" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.209s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 10:19:42 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-27e093f4-6ae1-4d32-a75f-6b1cddd9b374 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] Connected to 172.16.0.220:3260 {{(pid=85141) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 10:19:42 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-27e093f4-6ae1-4d32-a75f-6b1cddd9b374 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] HCTL ('35', '0', '0', 0) found on session 28 with lun 0 {{(pid=85141) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 10:19:42 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-27e093f4-6ae1-4d32-a75f-6b1cddd9b374 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] Scanning host 35 c: 0, t: 0, l: 0) {{(pid=85141) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 10:19:42 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:19:42 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.013s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:19:42 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c406a0c-146f-48ec-852b-bc36fc31427b]: (4, ('0 0 0', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:19:42 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-27e093f4-6ae1-4d32-a75f-6b1cddd9b374 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] Searching for a device in session 28 and hctl ('35', '0', '0', 0) yield: sdd {{(pid=85141) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 10:19:42 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-27e093f4-6ae1-4d32-a75f-6b1cddd9b374 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:3392fa71-5ceb-42f9-acb8-b9e69b8b1cfa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'svSOAuQY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=85141) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 10:19:42 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-27e093f4-6ae1-4d32-a75f-6b1cddd9b374 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.234s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 10:19:42 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-27e093f4-6ae1-4d32-a75f-6b1cddd9b374 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] <== connect_volume: return (236ms) {'type': 'block', 'scsi_wwn': '26634316339366235', 'path': '/dev/sdd'} {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 10:19:42 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-27e093f4-6ae1-4d32-a75f-6b1cddd9b374 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] [instance: fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26634316339366235', 'path': '/dev/sdd'} {{(pid=85141) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 10:19:42 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-f7d2f038-395f-476c-b910-ed77ab36f92b tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.121s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 10:19:42 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:19:42 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:19:42 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b609efb-98ac-41d9-bab3-f0373cc18cb1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3392fa71-5ceb-42f9-acb8-b9e69b8b1cfa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2f7784b4-2ba5-4085-9e17-877c754115c8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7dc504e0-da46-4c57-a66d-8ae6ce9c733c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:674f9ae8-6ab5-4ff2-b715-fe8807c34793\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:19:42 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7d2f038-395f-476c-b910-ed77ab36f92b tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 10:19:42 user nova-compute[85141]: No targets found.
Nov 16 10:19:42 user nova-compute[85141]: iSNS:
Nov 16 10:19:42 user nova-compute[85141]: No targets found.
Nov 16 10:19:42 user nova-compute[85141]: STATIC:
Nov 16 10:19:42 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:3392fa71-5ceb-42f9-acb8-b9e69b8b1cfa
Nov 16 10:19:42 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:19:42 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:19:42 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee
Nov 16 10:19:42 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:19:42 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:19:42 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:2f7784b4-2ba5-4085-9e17-877c754115c8
Nov 16 10:19:42 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:19:42 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:19:42 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:7dc504e0-da46-4c57-a66d-8ae6ce9c733c
Nov 16 10:19:42 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:19:42 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:19:42 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:674f9ae8-6ab5-4ff2-b715-fe8807c34793
Nov 16 10:19:42 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:19:42 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:19:42 user nova-compute[85141]: FIRMWARE:
Nov 16 10:19:42 user nova-compute[85141]: No targets found.
Nov 16 10:19:42 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:19:42 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7d2f038-395f-476c-b910-ed77ab36f92b tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 10:19:42 user nova-compute[85141]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 10:19:42 user nova-compute[85141]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=85141) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 10:19:42 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7d2f038-395f-476c-b910-ed77ab36f92b tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:674f9ae8-6ab5-4ff2-b715-fe8807c34793', 0)] {{(pid=85141) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 10:19:42 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:19:42 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-27e093f4-6ae1-4d32-a75f-6b1cddd9b374 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T10:15:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-675096085',display_name='tempest-ServerStableDeviceRescueTest-server-675096085',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-675096085',id=19,image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDy6W/eGM5RIOL9sRQS4LaKkBVIMYLDkobB3fvhz5SdWZrhWPoji+Lbru+de1gziqrO+W/0HhQiWO7dkjKIiUJZL6ldxRiGA5rCsMCcnOQwbGGZ5zFupHppDTFvdF4wPCw==',key_name='tempest-keypair-756270117',keypairs=<?>,launch_index=0,launched_at=2023-11-16T10:15:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0cdf22a86934481196276e29c2cdb48b',ramdisk_id='',reservation_id='r-4s0k8n8m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-692155468',owner_user_name='tempest-ServerStableDeviceRescueTest-692155468-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T10:17:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9e95eddbeebf4768bc04632d5a94003a',uuid=fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cc62aa76-c6d3-42a2-bf2a-7241919a5fc4", "address": "fa:16:3e:3b:bc:05", "network": {"id": "434cf325-212a-4f85-9779-7791dc1c678f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-248496413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-248496413-network", "vif_mac": "fa:16:3e:3b:bc:05"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cdf22a86934481196276e29c2cdb48b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc62aa76-c6", "ovs_interfaceid": "cc62aa76-c6d3-42a2-bf2a-7241919a5fc4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=85141) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 10:19:42 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-27e093f4-6ae1-4d32-a75f-6b1cddd9b374 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] Converting VIF {"id": "cc62aa76-c6d3-42a2-bf2a-7241919a5fc4", "address": "fa:16:3e:3b:bc:05", "network": {"id": "434cf325-212a-4f85-9779-7791dc1c678f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-248496413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-248496413-network", "vif_mac": "fa:16:3e:3b:bc:05"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cdf22a86934481196276e29c2cdb48b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc62aa76-c6", "ovs_interfaceid": "cc62aa76-c6d3-42a2-bf2a-7241919a5fc4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:19:42 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-27e093f4-6ae1-4d32-a75f-6b1cddd9b374 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3b:bc:05,bridge_name='br-int',has_traffic_filtering=True,id=cc62aa76-c6d3-42a2-bf2a-7241919a5fc4,network=Network(434cf325-212a-4f85-9779-7791dc1c678f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc62aa76-c6') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:19:42 user nova-compute[85141]: DEBUG nova.objects.instance [None req-27e093f4-6ae1-4d32-a75f-6b1cddd9b374 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] Lazy-loading 'pci_devices' on Instance uuid fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:19:42 user nova-compute[85141]: DEBUG nova.objects.base [None req-27e093f4-6ae1-4d32-a75f-6b1cddd9b374 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] Object Instance<fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=85141) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 10:19:42 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-27e093f4-6ae1-4d32-a75f-6b1cddd9b374 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] [instance: fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f] End _get_guest_xml xml=<domain type="kvm">
Nov 16 10:19:42 user nova-compute[85141]:   <uuid>fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f</uuid>
Nov 16 10:19:42 user nova-compute[85141]:   <name>instance-00000013</name>
Nov 16 10:19:42 user nova-compute[85141]:   <memory>524288</memory>
Nov 16 10:19:42 user nova-compute[85141]:   <vcpu>1</vcpu>
Nov 16 10:19:42 user nova-compute[85141]:   <metadata>
Nov 16 10:19:42 user nova-compute[85141]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 10:19:42 user nova-compute[85141]:       <nova:package version="0.0.0"/>
Nov 16 10:19:42 user nova-compute[85141]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-675096085</nova:name>
Nov 16 10:19:42 user nova-compute[85141]:       <nova:creationTime>2023-11-16 10:19:42</nova:creationTime>
Nov 16 10:19:42 user nova-compute[85141]:       <nova:flavor name="m1.tiny">
Nov 16 10:19:42 user nova-compute[85141]:         <nova:memory>512</nova:memory>
Nov 16 10:19:42 user nova-compute[85141]:         <nova:disk>1</nova:disk>
Nov 16 10:19:42 user nova-compute[85141]:         <nova:swap>0</nova:swap>
Nov 16 10:19:42 user nova-compute[85141]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 10:19:42 user nova-compute[85141]:         <nova:vcpus>1</nova:vcpus>
Nov 16 10:19:42 user nova-compute[85141]:       </nova:flavor>
Nov 16 10:19:42 user nova-compute[85141]:       <nova:owner>
Nov 16 10:19:42 user nova-compute[85141]:         <nova:user uuid="9e95eddbeebf4768bc04632d5a94003a">tempest-ServerStableDeviceRescueTest-692155468-project-member</nova:user>
Nov 16 10:19:42 user nova-compute[85141]:         <nova:project uuid="0cdf22a86934481196276e29c2cdb48b">tempest-ServerStableDeviceRescueTest-692155468</nova:project>
Nov 16 10:19:42 user nova-compute[85141]:       </nova:owner>
Nov 16 10:19:42 user nova-compute[85141]:       <nova:root type="image" uuid="bc4ca70f-a459-4d5c-a9e6-80f1948eb48b"/>
Nov 16 10:19:42 user nova-compute[85141]:       <nova:ports>
Nov 16 10:19:42 user nova-compute[85141]:         <nova:port uuid="cc62aa76-c6d3-42a2-bf2a-7241919a5fc4">
Nov 16 10:19:42 user nova-compute[85141]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 16 10:19:42 user nova-compute[85141]:         </nova:port>
Nov 16 10:19:42 user nova-compute[85141]:       </nova:ports>
Nov 16 10:19:42 user nova-compute[85141]:     </nova:instance>
Nov 16 10:19:42 user nova-compute[85141]:   </metadata>
Nov 16 10:19:42 user nova-compute[85141]:   <sysinfo type="smbios">
Nov 16 10:19:42 user nova-compute[85141]:     <system>
Nov 16 10:19:42 user nova-compute[85141]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 10:19:42 user nova-compute[85141]:       <entry name="product">OpenStack Nova</entry>
Nov 16 10:19:42 user nova-compute[85141]:       <entry name="version">0.0.0</entry>
Nov 16 10:19:42 user nova-compute[85141]:       <entry name="serial">fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f</entry>
Nov 16 10:19:42 user nova-compute[85141]:       <entry name="uuid">fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f</entry>
Nov 16 10:19:42 user nova-compute[85141]:       <entry name="family">Virtual Machine</entry>
Nov 16 10:19:42 user nova-compute[85141]:     </system>
Nov 16 10:19:42 user nova-compute[85141]:   </sysinfo>
Nov 16 10:19:42 user nova-compute[85141]:   <os>
Nov 16 10:19:42 user nova-compute[85141]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 10:19:42 user nova-compute[85141]:     <smbios mode="sysinfo"/>
Nov 16 10:19:42 user nova-compute[85141]:   </os>
Nov 16 10:19:42 user nova-compute[85141]:   <features>
Nov 16 10:19:42 user nova-compute[85141]:     <acpi/>
Nov 16 10:19:42 user nova-compute[85141]:     <apic/>
Nov 16 10:19:42 user nova-compute[85141]:     <vmcoreinfo/>
Nov 16 10:19:42 user nova-compute[85141]:   </features>
Nov 16 10:19:42 user nova-compute[85141]:   <clock offset="utc">
Nov 16 10:19:42 user nova-compute[85141]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 10:19:42 user nova-compute[85141]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 10:19:42 user nova-compute[85141]:     <timer name="hpet" present="no"/>
Nov 16 10:19:42 user nova-compute[85141]:   </clock>
Nov 16 10:19:42 user nova-compute[85141]:   <cpu mode="custom" match="exact">
Nov 16 10:19:42 user nova-compute[85141]:     <model>Nehalem</model>
Nov 16 10:19:42 user nova-compute[85141]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 10:19:42 user nova-compute[85141]:   </cpu>
Nov 16 10:19:42 user nova-compute[85141]:   <devices>
Nov 16 10:19:42 user nova-compute[85141]:     <disk type="file" device="disk">
Nov 16 10:19:42 user nova-compute[85141]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 10:19:42 user nova-compute[85141]:       <source file="/opt/stack/data/nova/instances/fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f/disk"/>
Nov 16 10:19:42 user nova-compute[85141]:       <target dev="vda" bus="virtio"/>
Nov 16 10:19:42 user nova-compute[85141]:     </disk>
Nov 16 10:19:42 user nova-compute[85141]:     <disk type="block" device="disk">
Nov 16 10:19:42 user nova-compute[85141]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 10:19:42 user nova-compute[85141]:       <source dev="/dev/sdd"/>
Nov 16 10:19:42 user nova-compute[85141]:       <target dev="vdb" bus="virtio"/>
Nov 16 10:19:42 user nova-compute[85141]:       <serial>3392fa71-5ceb-42f9-acb8-b9e69b8b1cfa</serial>
Nov 16 10:19:42 user nova-compute[85141]:     </disk>
Nov 16 10:19:42 user nova-compute[85141]:     <disk type="file" device="disk">
Nov 16 10:19:42 user nova-compute[85141]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 10:19:42 user nova-compute[85141]:       <source file="/opt/stack/data/nova/instances/fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f/disk.rescue"/>
Nov 16 10:19:42 user nova-compute[85141]:       <target dev="vdc" bus="virtio"/>
Nov 16 10:19:42 user nova-compute[85141]:       <boot order="1"/>
Nov 16 10:19:42 user nova-compute[85141]:     </disk>
Nov 16 10:19:42 user nova-compute[85141]:     <interface type="ethernet">
Nov 16 10:19:42 user nova-compute[85141]:       <mac address="fa:16:3e:3b:bc:05"/>
Nov 16 10:19:42 user nova-compute[85141]:       <model type="virtio"/>
Nov 16 10:19:42 user nova-compute[85141]:       <mtu size="1442"/>
Nov 16 10:19:42 user nova-compute[85141]:       <target dev="tapcc62aa76-c6"/>
Nov 16 10:19:42 user nova-compute[85141]:     </interface>
Nov 16 10:19:42 user nova-compute[85141]:     <serial type="pty">
Nov 16 10:19:42 user nova-compute[85141]:       <log file="/opt/stack/data/nova/instances/fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f/console.log" append="off"/>
Nov 16 10:19:42 user nova-compute[85141]:     </serial>
Nov 16 10:19:42 user nova-compute[85141]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 10:19:42 user nova-compute[85141]:     <video>
Nov 16 10:19:42 user nova-compute[85141]:       <model type="virtio"/>
Nov 16 10:19:42 user nova-compute[85141]:     </video>
Nov 16 10:19:42 user nova-compute[85141]:     <rng model="virtio">
Nov 16 10:19:42 user nova-compute[85141]:       <backend model="random">/dev/urandom</backend>
Nov 16 10:19:42 user nova-compute[85141]:     </rng>
Nov 16 10:19:42 user nova-compute[85141]:     <controller type="usb" index="0" model="none"/>
Nov 16 10:19:42 user nova-compute[85141]:     <memballoon model="virtio">
Nov 16 10:19:42 user nova-compute[85141]:       <stats period="10"/>
Nov 16 10:19:42 user nova-compute[85141]:     </memballoon>
Nov 16 10:19:42 user nova-compute[85141]:   </devices>
Nov 16 10:19:42 user nova-compute[85141]: </domain>
Nov 16 10:19:42 user nova-compute[85141]:  {{(pid=85141) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 10:19:42 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:19:42 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[69823298-fa18-4fe4-8c96-832b7ff721cd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2f7784b4-2ba5-4085-9e17-877c754115c8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3392fa71-5ceb-42f9-acb8-b9e69b8b1cfa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:674f9ae8-6ab5-4ff2-b715-fe8807c34793\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7dc504e0-da46-4c57-a66d-8ae6ce9c733c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:19:42 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:19:42 user nova-compute[85141]: INFO nova.virt.libvirt.driver [-] [instance: fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f] Instance destroyed successfully.
Nov 16 10:19:42 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:19:42 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[27ff081d-d09d-404b-a993-dc56b911f1be]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:674f9ae8-6ab5-4ff2-b715-fe8807c34793 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dc504e0-da46-4c57-a66d-8ae6ce9c733c (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3392fa71-5ceb-42f9-acb8-b9e69b8b1cfa (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7784b4-2ba5-4085-9e17-877c754115c8 (non-flash)\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:19:42 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7d2f038-395f-476c-b910-ed77ab36f92b tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)
Nov 16 10:19:42 user nova-compute[85141]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:674f9ae8-6ab5-4ff2-b715-fe8807c34793 (non-flash)
Nov 16 10:19:42 user nova-compute[85141]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dc504e0-da46-4c57-a66d-8ae6ce9c733c (non-flash)
Nov 16 10:19:42 user nova-compute[85141]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3392fa71-5ceb-42f9-acb8-b9e69b8b1cfa (non-flash)
Nov 16 10:19:42 user nova-compute[85141]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7784b4-2ba5-4085-9e17-877c754115c8 (non-flash)
Nov 16 10:19:42 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:19:42 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7d2f038-395f-476c-b910-ed77ab36f92b tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)
Nov 16 10:19:42 user nova-compute[85141]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:674f9ae8-6ab5-4ff2-b715-fe8807c34793 (non-flash)
Nov 16 10:19:42 user nova-compute[85141]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dc504e0-da46-4c57-a66d-8ae6ce9c733c (non-flash)
Nov 16 10:19:42 user nova-compute[85141]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3392fa71-5ceb-42f9-acb8-b9e69b8b1cfa (non-flash)
Nov 16 10:19:42 user nova-compute[85141]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7784b4-2ba5-4085-9e17-877c754115c8 (non-flash)
Nov 16 10:19:42 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 10:19:42 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7d2f038-395f-476c-b910-ed77ab36f92b tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f516072d870>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:674f9ae8-6ab5-4ff2-b715-fe8807c34793'): ({'sdg'}, set())}) {{(pid=85141) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 10:19:42 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-f7d2f038-395f-476c-b910-ed77ab36f92b tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] Removing single pathed devices sdg {{(pid=85141) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 10:19:42 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:19:42 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:19:42 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eed30ca-9eab-498e-b20b-a59ab7ac9b36]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:19:42 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:19:42 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.021s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:19:42 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbac9baf-3892-4c31-a777-761a225fe3b6]: (4, ('ok\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:19:42 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-f7d2f038-395f-476c-b910-ed77ab36f92b tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] Flushing IO for device /dev/sdg {{(pid=85141) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 10:19:42 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:19:42 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-27e093f4-6ae1-4d32-a75f-6b1cddd9b374 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] No BDM found with device name vda, not building metadata. {{(pid=85141) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 10:19:42 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-27e093f4-6ae1-4d32-a75f-6b1cddd9b374 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] No BDM found with device name vdb, not building metadata. {{(pid=85141) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 10:19:42 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-27e093f4-6ae1-4d32-a75f-6b1cddd9b374 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] No BDM found with device name vdc, not building metadata. {{(pid=85141) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 10:19:42 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-27e093f4-6ae1-4d32-a75f-6b1cddd9b374 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] No VIF found with MAC fa:16:3e:3b:bc:05, not building metadata {{(pid=85141) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 10:19:42 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.015s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:19:42 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffa265e5-6514-45b4-ace6-e512fc6703a7]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:19:42 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-f7d2f038-395f-476c-b910-ed77ab36f92b tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=85141) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 10:19:42 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:19:42 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:19:42 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.044s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:19:42 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3d23dd0-19f1-4317-92d9-0b1f5f96c7ae]: (4, ('1', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:19:42 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-f7d2f038-395f-476c-b910-ed77ab36f92b tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=85141) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 10:19:42 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-f7d2f038-395f-476c-b910-ed77ab36f92b tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] SCSI volumes sdg have been removed. {{(pid=85141) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 10:19:42 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7d2f038-395f-476c-b910-ed77ab36f92b tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:674f9ae8-6ab5-4ff2-b715-fe8807c34793')] {{(pid=85141) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 10:19:42 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:674f9ae8-6ab5-4ff2-b715-fe8807c34793 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:19:42 user nova-compute[85141]: DEBUG nova.network.neutron [None req-f4238145-325c-45e3-8d23-2cd20cedfc9d tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] [instance: 2d7787a2-b8da-4d39-9b16-4c7bcb275f85] Updating instance_info_cache with network_info: [{"id": "3f553883-eaa0-4a7e-8e31-1170241a0236", "address": "fa:16:3e:1c:29:6f", "network": {"id": "436477fd-9294-4297-bfb3-405564823fa0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1068749207-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4e4f57f79564d2fbcb8080bf8f1c5c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f553883-ea", "ovs_interfaceid": "3f553883-eaa0-4a7e-8e31-1170241a0236", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:19:42 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:674f9ae8-6ab5-4ff2-b715-fe8807c34793 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:19:42 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[846bfa93-a820-4b93-a61e-5010d69041b5]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:19:42 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7d2f038-395f-476c-b910-ed77ab36f92b tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:19:42 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:674f9ae8-6ab5-4ff2-b715-fe8807c34793 -p 172.16.0.220:3260 --logout {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:19:42 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-f4238145-325c-45e3-8d23-2cd20cedfc9d tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Releasing lock "refresh_cache-2d7787a2-b8da-4d39-9b16-4c7bcb275f85" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:19:42 user nova-compute[85141]: DEBUG nova.compute.manager [None req-f4238145-325c-45e3-8d23-2cd20cedfc9d tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] [instance: 2d7787a2-b8da-4d39-9b16-4c7bcb275f85] Checking state {{(pid=85141) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 10:19:42 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:674f9ae8-6ab5-4ff2-b715-fe8807c34793 -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:19:42 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[30ddc537-f8cb-45a4-9368-52874b818f32]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:674f9ae8-6ab5-4ff2-b715-fe8807c34793, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:674f9ae8-6ab5-4ff2-b715-fe8807c34793, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:19:42 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7d2f038-395f-476c-b910-ed77ab36f92b tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:674f9ae8-6ab5-4ff2-b715-fe8807c34793, portal: 172.16.0.220,3260]
Nov 16 10:19:42 user nova-compute[85141]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:674f9ae8-6ab5-4ff2-b715-fe8807c34793, portal: 172.16.0.220,3260] successful.
Nov 16 10:19:42 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:19:42 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:674f9ae8-6ab5-4ff2-b715-fe8807c34793 -p 172.16.0.220:3260 --op delete {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:19:42 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:674f9ae8-6ab5-4ff2-b715-fe8807c34793 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:19:42 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c76b42e-94dc-4963-96b8-1199e48b9564]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:19:42 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7d2f038-395f-476c-b910-ed77ab36f92b tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:19:42 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-f7d2f038-395f-476c-b910-ed77ab36f92b tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.370s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 10:19:42 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7d2f038-395f-476c-b910-ed77ab36f92b tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] <== disconnect_volume: return (490ms) None {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 10:19:42 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f7d2f038-395f-476c-b910-ed77ab36f92b tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] [instance: e88874fe-b0a6-4292-8832-023f95e4f53c] Disconnected iSCSI Volume {{(pid=85141) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 10:19:42 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-f7d2f038-395f-476c-b910-ed77ab36f92b tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] [instance: e88874fe-b0a6-4292-8832-023f95e4f53c] Deleting instance files /opt/stack/data/nova/instances/e88874fe-b0a6-4292-8832-023f95e4f53c_del
Nov 16 10:19:42 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-f7d2f038-395f-476c-b910-ed77ab36f92b tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] [instance: e88874fe-b0a6-4292-8832-023f95e4f53c] Deletion of /opt/stack/data/nova/instances/e88874fe-b0a6-4292-8832-023f95e4f53c_del complete
Nov 16 10:19:42 user nova-compute[85141]: DEBUG nova.network.neutron [req-8dc83b03-9afd-4229-a535-dcd2e47280bd req-b975cf90-8834-41b6-ab81-f4b1c110dbf6 service nova] [instance: bff3a84b-6ab5-4256-8a04-2d21a4ba20b3] Updated VIF entry in instance network info cache for port 23ec0327-ca81-4524-8850-2c081e596d44. {{(pid=85141) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 10:19:42 user nova-compute[85141]: DEBUG nova.network.neutron [req-8dc83b03-9afd-4229-a535-dcd2e47280bd req-b975cf90-8834-41b6-ab81-f4b1c110dbf6 service nova] [instance: bff3a84b-6ab5-4256-8a04-2d21a4ba20b3] Updating instance_info_cache with network_info: [{"id": "23ec0327-ca81-4524-8850-2c081e596d44", "address": "fa:16:3e:e1:61:4a", "network": {"id": "4fb7c85e-c966-481d-b6f2-856a17ac8f7c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-81570496-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08ef12fb41a14ecd8abb84d4d69b7c27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23ec0327-ca", "ovs_interfaceid": "23ec0327-ca81-4524-8850-2c081e596d44", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:19:42 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-8dc83b03-9afd-4229-a535-dcd2e47280bd req-b975cf90-8834-41b6-ab81-f4b1c110dbf6 service nova] Releasing lock "refresh_cache-bff3a84b-6ab5-4256-8a04-2d21a4ba20b3" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:19:42 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:19:42 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:19:42 user nova-compute[85141]: DEBUG nova.network.neutron [req-7d1d8463-64c0-46cc-bfc9-7f6a14d40a21 req-f47f16eb-9ffd-4bf9-9e6f-be8d3f4dbb3b service nova] [instance: e88874fe-b0a6-4292-8832-023f95e4f53c] Updated VIF entry in instance network info cache for port 7bbea642-d504-433b-ae99-8e7159942751. {{(pid=85141) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 10:19:42 user nova-compute[85141]: DEBUG nova.network.neutron [req-7d1d8463-64c0-46cc-bfc9-7f6a14d40a21 req-f47f16eb-9ffd-4bf9-9e6f-be8d3f4dbb3b service nova] [instance: e88874fe-b0a6-4292-8832-023f95e4f53c] Updating instance_info_cache with network_info: [{"id": "7bbea642-d504-433b-ae99-8e7159942751", "address": "fa:16:3e:6a:e8:c6", "network": {"id": "3fc8f327-8ef7-4b60-abf0-31d75e40478e", "bridge": null, "label": "tempest-TestShelveInstance-452311162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fc33dd813c64594a3626d2e7dff09ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap7bbea642-d5", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:19:42 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:19:43 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-7d1d8463-64c0-46cc-bfc9-7f6a14d40a21 req-f47f16eb-9ffd-4bf9-9e6f-be8d3f4dbb3b service nova] Releasing lock "refresh_cache-e88874fe-b0a6-4292-8832-023f95e4f53c" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:19:43 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:19:43 user nova-compute[85141]: DEBUG nova.compute.manager [req-329676e9-1bc3-4380-be34-9975e9a215af req-c5b2161b-8ab2-43b0-83c7-a88a0f406518 service nova] [instance: 2d7787a2-b8da-4d39-9b16-4c7bcb275f85] Received event network-vif-unplugged-3f553883-eaa0-4a7e-8e31-1170241a0236 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:19:43 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-329676e9-1bc3-4380-be34-9975e9a215af req-c5b2161b-8ab2-43b0-83c7-a88a0f406518 service nova] Acquiring lock "2d7787a2-b8da-4d39-9b16-4c7bcb275f85-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:19:43 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-329676e9-1bc3-4380-be34-9975e9a215af req-c5b2161b-8ab2-43b0-83c7-a88a0f406518 service nova] Lock "2d7787a2-b8da-4d39-9b16-4c7bcb275f85-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:19:43 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-329676e9-1bc3-4380-be34-9975e9a215af req-c5b2161b-8ab2-43b0-83c7-a88a0f406518 service nova] Lock "2d7787a2-b8da-4d39-9b16-4c7bcb275f85-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:19:43 user nova-compute[85141]: DEBUG nova.compute.manager [req-329676e9-1bc3-4380-be34-9975e9a215af req-c5b2161b-8ab2-43b0-83c7-a88a0f406518 service nova] [instance: 2d7787a2-b8da-4d39-9b16-4c7bcb275f85] No waiting events found dispatching network-vif-unplugged-3f553883-eaa0-4a7e-8e31-1170241a0236 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:19:43 user nova-compute[85141]: WARNING nova.compute.manager [req-329676e9-1bc3-4380-be34-9975e9a215af req-c5b2161b-8ab2-43b0-83c7-a88a0f406518 service nova] [instance: 2d7787a2-b8da-4d39-9b16-4c7bcb275f85] Received unexpected event network-vif-unplugged-3f553883-eaa0-4a7e-8e31-1170241a0236 for instance with vm_state active and task_state reboot_started_hard.
Nov 16 10:19:43 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0624d22b-652a-482a-bc6e-bae4ef8d9331 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] [instance: 0b388b98-4e65-4258-bbe2-77e699321fb7] Calling os-brick to attach iSCSI Volume {{(pid=85141) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 10:19:43 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-0624d22b-652a-482a-bc6e-bae4ef8d9331 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51806b6080>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ca5a51ee-cdb2-4efa-b7e5-8a97d0c99bf7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ercfVhZa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 10:19:43 user nova-compute[85141]: WARNING os_brick.initiator.connectors.base [None req-0624d22b-652a-482a-bc6e-bae4ef8d9331 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 10:19:43 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-0624d22b-652a-482a-bc6e-bae4ef8d9331 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 10:19:43 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-0624d22b-652a-482a-bc6e-bae4ef8d9331 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 10:19:43 user nova-compute[85141]: WARNING os_brick.initiator.connectors.base [None req-0624d22b-652a-482a-bc6e-bae4ef8d9331 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 10:19:43 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-0624d22b-652a-482a-bc6e-bae4ef8d9331 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ca5a51ee-cdb2-4efa-b7e5-8a97d0c99bf7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 10:19:43 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-0624d22b-652a-482a-bc6e-bae4ef8d9331 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ca5a51ee-cdb2-4efa-b7e5-8a97d0c99bf7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 10:19:43 user nova-compute[85141]: INFO os_brick.initiator.connectors.iscsi [None req-0624d22b-652a-482a-bc6e-bae4ef8d9331 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 10:19:43 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca5a51ee-cdb2-4efa-b7e5-8a97d0c99bf7 -p 172.16.0.220:3260 {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:19:43 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca5a51ee-cdb2-4efa-b7e5-8a97d0c99bf7 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:19:43 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[10401e6a-a076-4711-8d05-e112d0a64131]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:19:43 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-0624d22b-652a-482a-bc6e-bae4ef8d9331 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 10:19:43 user nova-compute[85141]:  {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:19:43 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca5a51ee-cdb2-4efa-b7e5-8a97d0c99bf7 -p 172.16.0.220:3260 --interface default --op new {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:19:43 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca5a51ee-cdb2-4efa-b7e5-8a97d0c99bf7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:19:43 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[b748f408-78dd-4109-a486-cf8b0639626f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ca5a51ee-cdb2-4efa-b7e5-8a97d0c99bf7] added\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:19:43 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-0624d22b-652a-482a-bc6e-bae4ef8d9331 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ca5a51ee-cdb2-4efa-b7e5-8a97d0c99bf7] added
Nov 16 10:19:43 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:19:43 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca5a51ee-cdb2-4efa-b7e5-8a97d0c99bf7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:19:43 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca5a51ee-cdb2-4efa-b7e5-8a97d0c99bf7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:19:43 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d9b0ede-845e-4a89-8754-68bb7e6471b4]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:19:43 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-0624d22b-652a-482a-bc6e-bae4ef8d9331 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:19:43 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca5a51ee-cdb2-4efa-b7e5-8a97d0c99bf7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:19:43 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca5a51ee-cdb2-4efa-b7e5-8a97d0c99bf7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:19:43 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[e918321a-64ec-434d-9ab9-1844ab19e91b]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:19:43 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-0624d22b-652a-482a-bc6e-bae4ef8d9331 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:19:43 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca5a51ee-cdb2-4efa-b7e5-8a97d0c99bf7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ercfVhZa {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:19:43 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca5a51ee-cdb2-4efa-b7e5-8a97d0c99bf7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ercfVhZa" returned: 0 in 0.025s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:19:43 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[1973d4d6-9f09-4025-a564-7c4a5e9a635f]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:19:43 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-0624d22b-652a-482a-bc6e-bae4ef8d9331 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ercfVhZa'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:19:43 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca5a51ee-cdb2-4efa-b7e5-8a97d0c99bf7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:19:43 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca5a51ee-cdb2-4efa-b7e5-8a97d0c99bf7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:19:43 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[88b4cefa-37e0-4339-a148-687ad3a213dd]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:19:43 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-0624d22b-652a-482a-bc6e-bae4ef8d9331 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:19:43 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:19:43 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:19:43 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[da8d6402-aa16-4419-8dfc-650ce4b31947]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dc504e0-da46-4c57-a66d-8ae6ce9c733c (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3392fa71-5ceb-42f9-acb8-b9e69b8b1cfa (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7784b4-2ba5-4085-9e17-877c754115c8 (non-flash)\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:19:43 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-0624d22b-652a-482a-bc6e-bae4ef8d9331 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)
Nov 16 10:19:43 user nova-compute[85141]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dc504e0-da46-4c57-a66d-8ae6ce9c733c (non-flash)
Nov 16 10:19:43 user nova-compute[85141]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3392fa71-5ceb-42f9-acb8-b9e69b8b1cfa (non-flash)
Nov 16 10:19:43 user nova-compute[85141]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7784b4-2ba5-4085-9e17-877c754115c8 (non-flash)
Nov 16 10:19:43 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:19:43 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-0624d22b-652a-482a-bc6e-bae4ef8d9331 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)
Nov 16 10:19:43 user nova-compute[85141]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dc504e0-da46-4c57-a66d-8ae6ce9c733c (non-flash)
Nov 16 10:19:43 user nova-compute[85141]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3392fa71-5ceb-42f9-acb8-b9e69b8b1cfa (non-flash)
Nov 16 10:19:43 user nova-compute[85141]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7784b4-2ba5-4085-9e17-877c754115c8 (non-flash)
Nov 16 10:19:43 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 10:19:43 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca5a51ee-cdb2-4efa-b7e5-8a97d0c99bf7 -p 172.16.0.220:3260 --login {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:19:43 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca5a51ee-cdb2-4efa-b7e5-8a97d0c99bf7 -p 172.16.0.220:3260 --login" returned: 0 in 0.091s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:19:43 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[3507a469-8957-4097-94ee-a275e5bb3cf7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ca5a51ee-cdb2-4efa-b7e5-8a97d0c99bf7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ca5a51ee-cdb2-4efa-b7e5-8a97d0c99bf7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:19:43 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-0624d22b-652a-482a-bc6e-bae4ef8d9331 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ca5a51ee-cdb2-4efa-b7e5-8a97d0c99bf7, portal: 172.16.0.220,3260]
Nov 16 10:19:43 user nova-compute[85141]: Login to [iface: default, target: iqn.2010-10.org.openstack:ca5a51ee-cdb2-4efa-b7e5-8a97d0c99bf7, portal: 172.16.0.220,3260] successful.
Nov 16 10:19:43 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:19:43 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca5a51ee-cdb2-4efa-b7e5-8a97d0c99bf7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:19:43 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca5a51ee-cdb2-4efa-b7e5-8a97d0c99bf7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:19:43 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ec1aa0b-e623-4f56-ab41-97fafb910422]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:19:43 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-0624d22b-652a-482a-bc6e-bae4ef8d9331 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:19:43 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:19:43 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:19:43 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9b1bf7d-2fb3-41e0-9867-a8170b46ed05]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dc504e0-da46-4c57-a66d-8ae6ce9c733c (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3392fa71-5ceb-42f9-acb8-b9e69b8b1cfa (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7784b4-2ba5-4085-9e17-877c754115c8 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca5a51ee-cdb2-4efa-b7e5-8a97d0c99bf7 (non-flash)\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:19:43 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-0624d22b-652a-482a-bc6e-bae4ef8d9331 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)
Nov 16 10:19:43 user nova-compute[85141]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dc504e0-da46-4c57-a66d-8ae6ce9c733c (non-flash)
Nov 16 10:19:43 user nova-compute[85141]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3392fa71-5ceb-42f9-acb8-b9e69b8b1cfa (non-flash)
Nov 16 10:19:43 user nova-compute[85141]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7784b4-2ba5-4085-9e17-877c754115c8 (non-flash)
Nov 16 10:19:43 user nova-compute[85141]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca5a51ee-cdb2-4efa-b7e5-8a97d0c99bf7 (non-flash)
Nov 16 10:19:43 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:19:43 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-0624d22b-652a-482a-bc6e-bae4ef8d9331 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)
Nov 16 10:19:43 user nova-compute[85141]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dc504e0-da46-4c57-a66d-8ae6ce9c733c (non-flash)
Nov 16 10:19:43 user nova-compute[85141]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3392fa71-5ceb-42f9-acb8-b9e69b8b1cfa (non-flash)
Nov 16 10:19:43 user nova-compute[85141]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7784b4-2ba5-4085-9e17-877c754115c8 (non-flash)
Nov 16 10:19:43 user nova-compute[85141]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca5a51ee-cdb2-4efa-b7e5-8a97d0c99bf7 (non-flash)
Nov 16 10:19:43 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 10:19:43 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-0624d22b-652a-482a-bc6e-bae4ef8d9331 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ca5a51ee-cdb2-4efa-b7e5-8a97d0c99bf7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.327s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 10:19:43 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-0624d22b-652a-482a-bc6e-bae4ef8d9331 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Connected to 172.16.0.220:3260 {{(pid=85141) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 10:19:43 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-0624d22b-652a-482a-bc6e-bae4ef8d9331 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] HCTL ('37', '-', '-', 0) found on session 30 with lun 0 {{(pid=85141) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 10:19:43 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-0624d22b-652a-482a-bc6e-bae4ef8d9331 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=85141) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 10:19:43 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:19:43 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.021s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:19:43 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[30d7f9a1-9fd4-442b-af6d-f33df52948c6]: (4, ('- - 0', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:19:43 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-0624d22b-652a-482a-bc6e-bae4ef8d9331 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Searching for a device in session 30 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=85141) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 10:19:43 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-0624d22b-652a-482a-bc6e-bae4ef8d9331 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:ca5a51ee-cdb2-4efa-b7e5-8a97d0c99bf7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ercfVhZa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=85141) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 10:19:44 user nova-compute[85141]: INFO nova.scheduler.client.report [None req-f7d2f038-395f-476c-b910-ed77ab36f92b tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] Deleted allocations for instance e88874fe-b0a6-4292-8832-023f95e4f53c
Nov 16 10:19:44 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-f7d2f038-395f-476c-b910-ed77ab36f92b tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:19:44 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-f7d2f038-395f-476c-b910-ed77ab36f92b tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:19:44 user nova-compute[85141]: DEBUG nova.objects.instance [None req-f7d2f038-395f-476c-b910-ed77ab36f92b tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] Lazy-loading 'numa_topology' on Instance uuid e88874fe-b0a6-4292-8832-023f95e4f53c {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:19:44 user nova-compute[85141]: DEBUG nova.objects.base [None req-f7d2f038-395f-476c-b910-ed77ab36f92b tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] Object Instance<e88874fe-b0a6-4292-8832-023f95e4f53c> lazy-loaded attributes: resources,numa_topology {{(pid=85141) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 10:19:44 user nova-compute[85141]: INFO nova.virt.libvirt.driver [-] [instance: 2d7787a2-b8da-4d39-9b16-4c7bcb275f85] Instance destroyed successfully.
Nov 16 10:19:44 user nova-compute[85141]: DEBUG nova.objects.instance [None req-f4238145-325c-45e3-8d23-2cd20cedfc9d tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Lazy-loading 'resources' on Instance uuid 2d7787a2-b8da-4d39-9b16-4c7bcb275f85 {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:19:44 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:19:44 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:19:44 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-f4238145-325c-45e3-8d23-2cd20cedfc9d tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T10:17:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1258419633',display_name='tempest-TestMinimumBasicScenario-server-1258419633',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1258419633',id=22,image_ref='e960df59-53b9-475b-b762-72c61c99e0eb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBItDkOA9C0uJPf9LijOMkhRvGGhUREdg5zYTmAP8Jr2q5TskNTHRCZQqwtHRWI5QTrlnhI5kKcYXRZFhe3aqQnbfNkSahjTY0HHASfhQQbujcaJQTG8nSUyM5nxOwF6+5g==',key_name='tempest-TestMinimumBasicScenario-2119154314',keypairs=<?>,launch_index=0,launched_at=2023-11-16T10:17:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b4e4f57f79564d2fbcb8080bf8f1c5c0',ramdisk_id='',reservation_id='r-3bxzxj23',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e960df59-53b9-475b-b762-72c61c99e0eb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-766472507',owner_user_name='tempest-TestMinimumBasicScenario-766472507-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T10:19:43Z,user_data=None,user_id='f8792b5cbd0845299dc396f922399980',uuid=2d7787a2-b8da-4d39-9b16-4c7bcb275f85,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3f553883-eaa0-4a7e-8e31-1170241a0236", "address": "fa:16:3e:1c:29:6f", "network": {"id": "436477fd-9294-4297-bfb3-405564823fa0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1068749207-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4e4f57f79564d2fbcb8080bf8f1c5c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f553883-ea", "ovs_interfaceid": "3f553883-eaa0-4a7e-8e31-1170241a0236", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 10:19:44 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-f4238145-325c-45e3-8d23-2cd20cedfc9d tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Converting VIF {"id": "3f553883-eaa0-4a7e-8e31-1170241a0236", "address": "fa:16:3e:1c:29:6f", "network": {"id": "436477fd-9294-4297-bfb3-405564823fa0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1068749207-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4e4f57f79564d2fbcb8080bf8f1c5c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f553883-ea", "ovs_interfaceid": "3f553883-eaa0-4a7e-8e31-1170241a0236", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:19:44 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-f4238145-325c-45e3-8d23-2cd20cedfc9d tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1c:29:6f,bridge_name='br-int',has_traffic_filtering=True,id=3f553883-eaa0-4a7e-8e31-1170241a0236,network=Network(436477fd-9294-4297-bfb3-405564823fa0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f553883-ea') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:19:44 user nova-compute[85141]: DEBUG os_vif [None req-f4238145-325c-45e3-8d23-2cd20cedfc9d tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1c:29:6f,bridge_name='br-int',has_traffic_filtering=True,id=3f553883-eaa0-4a7e-8e31-1170241a0236,network=Network(436477fd-9294-4297-bfb3-405564823fa0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f553883-ea') {{(pid=85141) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 10:19:44 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:19:44 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3f553883-ea, bridge=br-int, if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:19:44 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:19:44 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:19:44 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:19:44 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:19:44 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:19:44 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5c718ede-062e-435b-b9a4-156f87fe1d6a) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:19:44 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:19:44 user nova-compute[85141]: INFO os_vif [None req-f4238145-325c-45e3-8d23-2cd20cedfc9d tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1c:29:6f,bridge_name='br-int',has_traffic_filtering=True,id=3f553883-eaa0-4a7e-8e31-1170241a0236,network=Network(436477fd-9294-4297-bfb3-405564823fa0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f553883-ea')
Nov 16 10:19:44 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f4238145-325c-45e3-8d23-2cd20cedfc9d tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] [instance: 2d7787a2-b8da-4d39-9b16-4c7bcb275f85] calling os-brick to detach iSCSI Volume {{(pid=85141) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 10:19:44 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4238145-325c-45e3-8d23-2cd20cedfc9d tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51806b6080>, {'target_iqn': 'iqn.2010-10.org.openstack:7dc504e0-da46-4c57-a66d-8ae6ce9c733c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iFVOdJIq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 10:19:44 user nova-compute[85141]: WARNING os_brick.initiator.connectors.base [None req-f4238145-325c-45e3-8d23-2cd20cedfc9d tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 10:19:44 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-f4238145-325c-45e3-8d23-2cd20cedfc9d tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 10:19:44 user nova-compute[85141]: DEBUG nova.compute.provider_tree [None req-f7d2f038-395f-476c-b910-ed77ab36f92b tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] Inventory has not changed in ProviderTree for provider: bf8e0fa1-16b6-408f-9203-c4cd63916272 {{(pid=85141) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 10:19:44 user nova-compute[85141]: DEBUG nova.scheduler.client.report [None req-f7d2f038-395f-476c-b910-ed77ab36f92b tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] Inventory has not changed for provider bf8e0fa1-16b6-408f-9203-c4cd63916272 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=85141) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 10:19:44 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-f7d2f038-395f-476c-b910-ed77ab36f92b tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.627s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:19:44 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-0624d22b-652a-482a-bc6e-bae4ef8d9331 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.369s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 10:19:44 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-0624d22b-652a-482a-bc6e-bae4ef8d9331 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] <== connect_volume: return (1374ms) {'type': 'block', 'scsi_wwn': '23437373037316332', 'path': '/dev/sdf'} {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 10:19:44 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0624d22b-652a-482a-bc6e-bae4ef8d9331 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] [instance: 0b388b98-4e65-4258-bbe2-77e699321fb7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23437373037316332', 'path': '/dev/sdf'} {{(pid=85141) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 10:19:44 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-f4238145-325c-45e3-8d23-2cd20cedfc9d tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.317s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 10:19:44 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:19:44 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:19:44 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d9cbf0d-1f7f-401e-a4e4-ab44840c6116]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3392fa71-5ceb-42f9-acb8-b9e69b8b1cfa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2f7784b4-2ba5-4085-9e17-877c754115c8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ca5a51ee-cdb2-4efa-b7e5-8a97d0c99bf7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7dc504e0-da46-4c57-a66d-8ae6ce9c733c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:19:44 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4238145-325c-45e3-8d23-2cd20cedfc9d tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 10:19:44 user nova-compute[85141]: No targets found.
Nov 16 10:19:44 user nova-compute[85141]: iSNS:
Nov 16 10:19:44 user nova-compute[85141]: No targets found.
Nov 16 10:19:44 user nova-compute[85141]: STATIC:
Nov 16 10:19:44 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:3392fa71-5ceb-42f9-acb8-b9e69b8b1cfa
Nov 16 10:19:44 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:19:44 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:19:44 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee
Nov 16 10:19:44 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:19:44 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:19:44 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:2f7784b4-2ba5-4085-9e17-877c754115c8
Nov 16 10:19:44 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:19:44 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:19:44 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:ca5a51ee-cdb2-4efa-b7e5-8a97d0c99bf7
Nov 16 10:19:44 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:19:44 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:19:44 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:7dc504e0-da46-4c57-a66d-8ae6ce9c733c
Nov 16 10:19:44 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:19:44 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:19:44 user nova-compute[85141]: FIRMWARE:
Nov 16 10:19:44 user nova-compute[85141]: No targets found.
Nov 16 10:19:44 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:19:44 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4238145-325c-45e3-8d23-2cd20cedfc9d tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 10:19:44 user nova-compute[85141]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 10:19:44 user nova-compute[85141]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=85141) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 10:19:44 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4238145-325c-45e3-8d23-2cd20cedfc9d tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7dc504e0-da46-4c57-a66d-8ae6ce9c733c', 0)] {{(pid=85141) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 10:19:44 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:19:44 user nova-compute[85141]: DEBUG nova.objects.instance [None req-0624d22b-652a-482a-bc6e-bae4ef8d9331 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Lazy-loading 'flavor' on Instance uuid 0b388b98-4e65-4258-bbe2-77e699321fb7 {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:19:44 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:19:44 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[361cb885-574a-4d17-95a7-0ede16ce4938]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2f7784b4-2ba5-4085-9e17-877c754115c8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3392fa71-5ceb-42f9-acb8-b9e69b8b1cfa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7dc504e0-da46-4c57-a66d-8ae6ce9c733c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ca5a51ee-cdb2-4efa-b7e5-8a97d0c99bf7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:19:44 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:19:44 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-f7d2f038-395f-476c-b910-ed77ab36f92b tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] Lock "e88874fe-b0a6-4292-8832-023f95e4f53c" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 7.403s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:19:44 user nova-compute[85141]: DEBUG nova.virt.libvirt.guest [None req-0624d22b-652a-482a-bc6e-bae4ef8d9331 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 10:19:44 user nova-compute[85141]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 10:19:44 user nova-compute[85141]:   <source dev="/dev/sdf"/>
Nov 16 10:19:44 user nova-compute[85141]:   <target dev="vdb" bus="virtio"/>
Nov 16 10:19:44 user nova-compute[85141]:   <serial>ca5a51ee-cdb2-4efa-b7e5-8a97d0c99bf7</serial>
Nov 16 10:19:44 user nova-compute[85141]: </disk>
Nov 16 10:19:44 user nova-compute[85141]:  {{(pid=85141) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 10:19:44 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.046s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:19:44 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[33705cb9-b2a1-4a40-8bc2-7083c137f809]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dc504e0-da46-4c57-a66d-8ae6ce9c733c (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3392fa71-5ceb-42f9-acb8-b9e69b8b1cfa (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7784b4-2ba5-4085-9e17-877c754115c8 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca5a51ee-cdb2-4efa-b7e5-8a97d0c99bf7 (non-flash)\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:19:44 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4238145-325c-45e3-8d23-2cd20cedfc9d tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)
Nov 16 10:19:44 user nova-compute[85141]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dc504e0-da46-4c57-a66d-8ae6ce9c733c (non-flash)
Nov 16 10:19:44 user nova-compute[85141]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3392fa71-5ceb-42f9-acb8-b9e69b8b1cfa (non-flash)
Nov 16 10:19:44 user nova-compute[85141]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7784b4-2ba5-4085-9e17-877c754115c8 (non-flash)
Nov 16 10:19:44 user nova-compute[85141]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca5a51ee-cdb2-4efa-b7e5-8a97d0c99bf7 (non-flash)
Nov 16 10:19:44 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:19:44 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4238145-325c-45e3-8d23-2cd20cedfc9d tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)
Nov 16 10:19:44 user nova-compute[85141]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dc504e0-da46-4c57-a66d-8ae6ce9c733c (non-flash)
Nov 16 10:19:44 user nova-compute[85141]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3392fa71-5ceb-42f9-acb8-b9e69b8b1cfa (non-flash)
Nov 16 10:19:44 user nova-compute[85141]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7784b4-2ba5-4085-9e17-877c754115c8 (non-flash)
Nov 16 10:19:44 user nova-compute[85141]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca5a51ee-cdb2-4efa-b7e5-8a97d0c99bf7 (non-flash)
Nov 16 10:19:44 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 10:19:45 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4238145-325c-45e3-8d23-2cd20cedfc9d tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f51a01081f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7dc504e0-da46-4c57-a66d-8ae6ce9c733c'): ({'sdb'}, set())}) {{(pid=85141) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 10:19:45 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-f4238145-325c-45e3-8d23-2cd20cedfc9d tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Removing single pathed devices sdb {{(pid=85141) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 10:19:45 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:19:45 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:19:45 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b9eb2e2-cc99-48db-b8a8-7f6568b085f7]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:19:45 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:19:45 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:19:45 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[465d94a1-f60d-40bb-bf62-2d2c2b12a069]: (4, ('ok\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:19:45 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-f4238145-325c-45e3-8d23-2cd20cedfc9d tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Flushing IO for device /dev/sdb {{(pid=85141) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 10:19:45 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:19:45 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:19:45 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca9f2da5-31ec-421a-98c5-e06da57cc089]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:19:45 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-f4238145-325c-45e3-8d23-2cd20cedfc9d tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=85141) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 10:19:45 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:19:45 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.051s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:19:45 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5d7f807-069f-43c7-aa29-1165c5852607]: (4, ('1', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:19:45 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-f4238145-325c-45e3-8d23-2cd20cedfc9d tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=85141) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 10:19:45 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-f4238145-325c-45e3-8d23-2cd20cedfc9d tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] SCSI volumes sdb have been removed. {{(pid=85141) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 10:19:45 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4238145-325c-45e3-8d23-2cd20cedfc9d tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7dc504e0-da46-4c57-a66d-8ae6ce9c733c')] {{(pid=85141) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 10:19:45 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7dc504e0-da46-4c57-a66d-8ae6ce9c733c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:19:45 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7dc504e0-da46-4c57-a66d-8ae6ce9c733c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:19:45 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[72f2afbe-b455-448e-bec6-29a550176017]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:19:45 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4238145-325c-45e3-8d23-2cd20cedfc9d tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:19:45 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7dc504e0-da46-4c57-a66d-8ae6ce9c733c -p 172.16.0.220:3260 --logout {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:19:45 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7dc504e0-da46-4c57-a66d-8ae6ce9c733c -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:19:45 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec8b5c2b-4134-428d-901b-b1a26b9bd968]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:7dc504e0-da46-4c57-a66d-8ae6ce9c733c, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:7dc504e0-da46-4c57-a66d-8ae6ce9c733c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:19:45 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4238145-325c-45e3-8d23-2cd20cedfc9d tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:7dc504e0-da46-4c57-a66d-8ae6ce9c733c, portal: 172.16.0.220,3260]
Nov 16 10:19:45 user nova-compute[85141]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:7dc504e0-da46-4c57-a66d-8ae6ce9c733c, portal: 172.16.0.220,3260] successful.
Nov 16 10:19:45 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:19:45 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7dc504e0-da46-4c57-a66d-8ae6ce9c733c -p 172.16.0.220:3260 --op delete {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:19:45 user nova-compute[85141]: DEBUG nova.compute.manager [req-5a1a076b-e4ca-43c8-865c-021de312c16e req-1d8cb021-db88-4ebc-9cbf-b051c9e832f9 service nova] [instance: 2d7787a2-b8da-4d39-9b16-4c7bcb275f85] Received event network-vif-plugged-3f553883-eaa0-4a7e-8e31-1170241a0236 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:19:45 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-5a1a076b-e4ca-43c8-865c-021de312c16e req-1d8cb021-db88-4ebc-9cbf-b051c9e832f9 service nova] Acquiring lock "2d7787a2-b8da-4d39-9b16-4c7bcb275f85-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:19:45 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-5a1a076b-e4ca-43c8-865c-021de312c16e req-1d8cb021-db88-4ebc-9cbf-b051c9e832f9 service nova] Lock "2d7787a2-b8da-4d39-9b16-4c7bcb275f85-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:19:45 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-5a1a076b-e4ca-43c8-865c-021de312c16e req-1d8cb021-db88-4ebc-9cbf-b051c9e832f9 service nova] Lock "2d7787a2-b8da-4d39-9b16-4c7bcb275f85-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:19:45 user nova-compute[85141]: DEBUG nova.compute.manager [req-5a1a076b-e4ca-43c8-865c-021de312c16e req-1d8cb021-db88-4ebc-9cbf-b051c9e832f9 service nova] [instance: 2d7787a2-b8da-4d39-9b16-4c7bcb275f85] No waiting events found dispatching network-vif-plugged-3f553883-eaa0-4a7e-8e31-1170241a0236 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:19:45 user nova-compute[85141]: WARNING nova.compute.manager [req-5a1a076b-e4ca-43c8-865c-021de312c16e req-1d8cb021-db88-4ebc-9cbf-b051c9e832f9 service nova] [instance: 2d7787a2-b8da-4d39-9b16-4c7bcb275f85] Received unexpected event network-vif-plugged-3f553883-eaa0-4a7e-8e31-1170241a0236 for instance with vm_state active and task_state reboot_started_hard.
Nov 16 10:19:45 user nova-compute[85141]: DEBUG nova.compute.manager [req-5a1a076b-e4ca-43c8-865c-021de312c16e req-1d8cb021-db88-4ebc-9cbf-b051c9e832f9 service nova] [instance: fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f] Received event network-vif-plugged-cc62aa76-c6d3-42a2-bf2a-7241919a5fc4 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:19:45 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-5a1a076b-e4ca-43c8-865c-021de312c16e req-1d8cb021-db88-4ebc-9cbf-b051c9e832f9 service nova] Acquiring lock "fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:19:45 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-5a1a076b-e4ca-43c8-865c-021de312c16e req-1d8cb021-db88-4ebc-9cbf-b051c9e832f9 service nova] Lock "fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:19:45 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-5a1a076b-e4ca-43c8-865c-021de312c16e req-1d8cb021-db88-4ebc-9cbf-b051c9e832f9 service nova] Lock "fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:19:45 user nova-compute[85141]: DEBUG nova.compute.manager [req-5a1a076b-e4ca-43c8-865c-021de312c16e req-1d8cb021-db88-4ebc-9cbf-b051c9e832f9 service nova] [instance: fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f] No waiting events found dispatching network-vif-plugged-cc62aa76-c6d3-42a2-bf2a-7241919a5fc4 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:19:45 user nova-compute[85141]: WARNING nova.compute.manager [req-5a1a076b-e4ca-43c8-865c-021de312c16e req-1d8cb021-db88-4ebc-9cbf-b051c9e832f9 service nova] [instance: fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f] Received unexpected event network-vif-plugged-cc62aa76-c6d3-42a2-bf2a-7241919a5fc4 for instance with vm_state active and task_state rescuing.
Nov 16 10:19:45 user nova-compute[85141]: DEBUG nova.compute.manager [req-5a1a076b-e4ca-43c8-865c-021de312c16e req-1d8cb021-db88-4ebc-9cbf-b051c9e832f9 service nova] [instance: fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f] Received event network-vif-plugged-cc62aa76-c6d3-42a2-bf2a-7241919a5fc4 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:19:45 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-5a1a076b-e4ca-43c8-865c-021de312c16e req-1d8cb021-db88-4ebc-9cbf-b051c9e832f9 service nova] Acquiring lock "fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:19:45 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-5a1a076b-e4ca-43c8-865c-021de312c16e req-1d8cb021-db88-4ebc-9cbf-b051c9e832f9 service nova] Lock "fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:19:45 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-5a1a076b-e4ca-43c8-865c-021de312c16e req-1d8cb021-db88-4ebc-9cbf-b051c9e832f9 service nova] Lock "fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:19:45 user nova-compute[85141]: DEBUG nova.compute.manager [req-5a1a076b-e4ca-43c8-865c-021de312c16e req-1d8cb021-db88-4ebc-9cbf-b051c9e832f9 service nova] [instance: fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f] No waiting events found dispatching network-vif-plugged-cc62aa76-c6d3-42a2-bf2a-7241919a5fc4 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:19:45 user nova-compute[85141]: WARNING nova.compute.manager [req-5a1a076b-e4ca-43c8-865c-021de312c16e req-1d8cb021-db88-4ebc-9cbf-b051c9e832f9 service nova] [instance: fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f] Received unexpected event network-vif-plugged-cc62aa76-c6d3-42a2-bf2a-7241919a5fc4 for instance with vm_state active and task_state rescuing.
Nov 16 10:19:45 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7dc504e0-da46-4c57-a66d-8ae6ce9c733c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:19:45 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[412f8597-a410-46b1-85d1-11325a034525]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:19:45 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4238145-325c-45e3-8d23-2cd20cedfc9d tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:19:45 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-f4238145-325c-45e3-8d23-2cd20cedfc9d tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.444s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 10:19:45 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4238145-325c-45e3-8d23-2cd20cedfc9d tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] <== disconnect_volume: return (761ms) None {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 10:19:45 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f4238145-325c-45e3-8d23-2cd20cedfc9d tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] [instance: 2d7787a2-b8da-4d39-9b16-4c7bcb275f85] Disconnected iSCSI Volume {{(pid=85141) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 10:19:45 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-f4238145-325c-45e3-8d23-2cd20cedfc9d tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] [instance: 2d7787a2-b8da-4d39-9b16-4c7bcb275f85] Start _get_guest_xml network_info=[{"id": "3f553883-eaa0-4a7e-8e31-1170241a0236", "address": "fa:16:3e:1c:29:6f", "network": {"id": "436477fd-9294-4297-bfb3-405564823fa0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1068749207-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4e4f57f79564d2fbcb8080bf8f1c5c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f553883-ea", "ovs_interfaceid": "3f553883-eaa0-4a7e-8e31-1170241a0236", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=e960df59-53b9-475b-b762-72c61c99e0eb,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_options': None, 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'image_id': 'e960df59-53b9-475b-b762-72c61c99e0eb'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:7dc504e0-da46-4c57-a66d-8ae6ce9c733c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iFVOdJIq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '2d7787a2-b8da-4d39-9b16-4c7bcb275f85', 'attached_at': '', 'detached_at': '', 'volume_id': '7dc504e0-da46-4c57-a66d-8ae6ce9c733c', 'serial': '7dc504e0-da46-4c57-a66d-8ae6ce9c733c'}, 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'boot_index': None, 'attachment_id': '01da587b-e658-411f-99e7-f8c0cea89ac9', 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=85141) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 10:19:45 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-f4238145-325c-45e3-8d23-2cd20cedfc9d tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:19:45 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-f4238145-325c-45e3-8d23-2cd20cedfc9d tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:19:45 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-f4238145-325c-45e3-8d23-2cd20cedfc9d tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=85141) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 10:19:45 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-f4238145-325c-45e3-8d23-2cd20cedfc9d tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] CPU controller missing on host. {{(pid=85141) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 10:19:45 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-f4238145-325c-45e3-8d23-2cd20cedfc9d tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=85141) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 10:19:45 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-f4238145-325c-45e3-8d23-2cd20cedfc9d tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] CPU controller found on host. {{(pid=85141) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 10:19:45 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-f4238145-325c-45e3-8d23-2cd20cedfc9d tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=85141) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 10:19:45 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-f4238145-325c-45e3-8d23-2cd20cedfc9d tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T10:06:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=e960df59-53b9-475b-b762-72c61c99e0eb,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 10:19:45 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-f4238145-325c-45e3-8d23-2cd20cedfc9d tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Flavor limits 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 10:19:45 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-f4238145-325c-45e3-8d23-2cd20cedfc9d tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Image limits 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 10:19:45 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-f4238145-325c-45e3-8d23-2cd20cedfc9d tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Flavor pref 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 10:19:45 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-f4238145-325c-45e3-8d23-2cd20cedfc9d tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Image pref 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 10:19:45 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-f4238145-325c-45e3-8d23-2cd20cedfc9d tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 10:19:45 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-f4238145-325c-45e3-8d23-2cd20cedfc9d tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 10:19:45 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-f4238145-325c-45e3-8d23-2cd20cedfc9d tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=85141) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 10:19:45 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-f4238145-325c-45e3-8d23-2cd20cedfc9d tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Got 1 possible topologies {{(pid=85141) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 10:19:45 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-f4238145-325c-45e3-8d23-2cd20cedfc9d tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 10:19:45 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-f4238145-325c-45e3-8d23-2cd20cedfc9d tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 10:19:45 user nova-compute[85141]: DEBUG nova.objects.instance [None req-f4238145-325c-45e3-8d23-2cd20cedfc9d tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Lazy-loading 'vcpu_model' on Instance uuid 2d7787a2-b8da-4d39-9b16-4c7bcb275f85 {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:19:45 user nova-compute[85141]: DEBUG nova.objects.base [None req-f4238145-325c-45e3-8d23-2cd20cedfc9d tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Object Instance<2d7787a2-b8da-4d39-9b16-4c7bcb275f85> lazy-loaded attributes: resources,vcpu_model {{(pid=85141) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 10:19:45 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f4238145-325c-45e3-8d23-2cd20cedfc9d tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] [instance: 2d7787a2-b8da-4d39-9b16-4c7bcb275f85] Calling os-brick to attach iSCSI Volume {{(pid=85141) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 10:19:45 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4238145-325c-45e3-8d23-2cd20cedfc9d tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51806b6080>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7dc504e0-da46-4c57-a66d-8ae6ce9c733c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iFVOdJIq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 10:19:45 user nova-compute[85141]: WARNING os_brick.initiator.connectors.base [None req-f4238145-325c-45e3-8d23-2cd20cedfc9d tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 10:19:45 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-f4238145-325c-45e3-8d23-2cd20cedfc9d tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 10:19:45 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-f4238145-325c-45e3-8d23-2cd20cedfc9d tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 10:19:45 user nova-compute[85141]: WARNING os_brick.initiator.connectors.base [None req-f4238145-325c-45e3-8d23-2cd20cedfc9d tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 10:19:45 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-f4238145-325c-45e3-8d23-2cd20cedfc9d tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7dc504e0-da46-4c57-a66d-8ae6ce9c733c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 10:19:45 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-f4238145-325c-45e3-8d23-2cd20cedfc9d tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7dc504e0-da46-4c57-a66d-8ae6ce9c733c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 10:19:45 user nova-compute[85141]: INFO os_brick.initiator.connectors.iscsi [None req-f4238145-325c-45e3-8d23-2cd20cedfc9d tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 10:19:45 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:19:45 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7dc504e0-da46-4c57-a66d-8ae6ce9c733c -p 172.16.0.220:3260 {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:19:45 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7dc504e0-da46-4c57-a66d-8ae6ce9c733c -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:19:45 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[2639e4b2-a074-4b39-85ce-1d4e8d07be45]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:19:45 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4238145-325c-45e3-8d23-2cd20cedfc9d tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 10:19:45 user nova-compute[85141]:  {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:19:45 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7dc504e0-da46-4c57-a66d-8ae6ce9c733c -p 172.16.0.220:3260 --interface default --op new {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:19:45 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:19:45 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7dc504e0-da46-4c57-a66d-8ae6ce9c733c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:19:45 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[5507df74-9857-44a5-8d7f-115cecc9e1ca]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7dc504e0-da46-4c57-a66d-8ae6ce9c733c] added\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:19:45 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4238145-325c-45e3-8d23-2cd20cedfc9d tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7dc504e0-da46-4c57-a66d-8ae6ce9c733c] added
Nov 16 10:19:45 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:19:45 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7dc504e0-da46-4c57-a66d-8ae6ce9c733c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:19:45 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-0624d22b-652a-482a-bc6e-bae4ef8d9331 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] No BDM found with device name vda, not building metadata. {{(pid=85141) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 10:19:45 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-0624d22b-652a-482a-bc6e-bae4ef8d9331 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] No BDM found with device name vdb, not building metadata. {{(pid=85141) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 10:19:45 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-0624d22b-652a-482a-bc6e-bae4ef8d9331 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] No VIF found with MAC fa:16:3e:85:dd:4c, not building metadata {{(pid=85141) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 10:19:45 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7dc504e0-da46-4c57-a66d-8ae6ce9c733c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:19:45 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[40c0dc69-9116-4d9e-82e9-f81494630c07]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:19:45 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4238145-325c-45e3-8d23-2cd20cedfc9d tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:19:45 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7dc504e0-da46-4c57-a66d-8ae6ce9c733c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:19:45 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7dc504e0-da46-4c57-a66d-8ae6ce9c733c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:19:45 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[3da0e266-6ca8-4166-b14a-c9309ca2c9f6]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:19:45 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4238145-325c-45e3-8d23-2cd20cedfc9d tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:19:45 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7dc504e0-da46-4c57-a66d-8ae6ce9c733c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iFVOdJIq {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:19:45 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7dc504e0-da46-4c57-a66d-8ae6ce9c733c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iFVOdJIq" returned: 0 in 0.024s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:19:45 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ff79b42-c89c-4444-a592-5ce1ca0a8370]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:19:45 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4238145-325c-45e3-8d23-2cd20cedfc9d tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'iFVOdJIq'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:19:45 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7dc504e0-da46-4c57-a66d-8ae6ce9c733c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:19:45 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7dc504e0-da46-4c57-a66d-8ae6ce9c733c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:19:45 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8f587d1-8ed4-402c-b1a7-8d6066ab7e4e]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:19:45 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4238145-325c-45e3-8d23-2cd20cedfc9d tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:19:45 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:19:45 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:19:45 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebf36690-b4d4-4fd4-a2e0-2bdbc6e58934]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3392fa71-5ceb-42f9-acb8-b9e69b8b1cfa (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7784b4-2ba5-4085-9e17-877c754115c8 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca5a51ee-cdb2-4efa-b7e5-8a97d0c99bf7 (non-flash)\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:19:45 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4238145-325c-45e3-8d23-2cd20cedfc9d tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)
Nov 16 10:19:45 user nova-compute[85141]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3392fa71-5ceb-42f9-acb8-b9e69b8b1cfa (non-flash)
Nov 16 10:19:45 user nova-compute[85141]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7784b4-2ba5-4085-9e17-877c754115c8 (non-flash)
Nov 16 10:19:45 user nova-compute[85141]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca5a51ee-cdb2-4efa-b7e5-8a97d0c99bf7 (non-flash)
Nov 16 10:19:45 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:19:45 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4238145-325c-45e3-8d23-2cd20cedfc9d tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)
Nov 16 10:19:45 user nova-compute[85141]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3392fa71-5ceb-42f9-acb8-b9e69b8b1cfa (non-flash)
Nov 16 10:19:45 user nova-compute[85141]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7784b4-2ba5-4085-9e17-877c754115c8 (non-flash)
Nov 16 10:19:45 user nova-compute[85141]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca5a51ee-cdb2-4efa-b7e5-8a97d0c99bf7 (non-flash)
Nov 16 10:19:45 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 10:19:45 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7dc504e0-da46-4c57-a66d-8ae6ce9c733c -p 172.16.0.220:3260 --login {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:19:45 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-f64a28fc-5741-46d4-94c8-5b7bcd56d17e tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Acquiring lock "bff3a84b-6ab5-4256-8a04-2d21a4ba20b3" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:19:45 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-f64a28fc-5741-46d4-94c8-5b7bcd56d17e tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Lock "bff3a84b-6ab5-4256-8a04-2d21a4ba20b3" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:19:45 user nova-compute[85141]: INFO nova.compute.manager [None req-f64a28fc-5741-46d4-94c8-5b7bcd56d17e tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] [instance: bff3a84b-6ab5-4256-8a04-2d21a4ba20b3] Shelving
Nov 16 10:19:45 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-0624d22b-652a-482a-bc6e-bae4ef8d9331 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Lock "0b388b98-4e65-4258-bbe2-77e699321fb7" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.145s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:19:45 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7dc504e0-da46-4c57-a66d-8ae6ce9c733c -p 172.16.0.220:3260 --login" returned: 0 in 0.089s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:19:45 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[df0926d6-a5c4-461e-8072-b32ee9aabe42]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7dc504e0-da46-4c57-a66d-8ae6ce9c733c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7dc504e0-da46-4c57-a66d-8ae6ce9c733c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:19:45 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4238145-325c-45e3-8d23-2cd20cedfc9d tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7dc504e0-da46-4c57-a66d-8ae6ce9c733c, portal: 172.16.0.220,3260]
Nov 16 10:19:45 user nova-compute[85141]: Login to [iface: default, target: iqn.2010-10.org.openstack:7dc504e0-da46-4c57-a66d-8ae6ce9c733c, portal: 172.16.0.220,3260] successful.
Nov 16 10:19:45 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:19:45 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7dc504e0-da46-4c57-a66d-8ae6ce9c733c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:19:45 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7dc504e0-da46-4c57-a66d-8ae6ce9c733c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:19:45 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[afbb8a32-b2e1-438a-ace1-e23011ade336]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:19:45 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4238145-325c-45e3-8d23-2cd20cedfc9d tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:19:45 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:19:45 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:19:45 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.046s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:19:45 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[64ee030c-3ab6-4681-a93e-abc448b3028d]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3392fa71-5ceb-42f9-acb8-b9e69b8b1cfa (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7784b4-2ba5-4085-9e17-877c754115c8 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca5a51ee-cdb2-4efa-b7e5-8a97d0c99bf7 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dc504e0-da46-4c57-a66d-8ae6ce9c733c (non-flash)\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:19:45 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4238145-325c-45e3-8d23-2cd20cedfc9d tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)
Nov 16 10:19:45 user nova-compute[85141]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3392fa71-5ceb-42f9-acb8-b9e69b8b1cfa (non-flash)
Nov 16 10:19:45 user nova-compute[85141]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7784b4-2ba5-4085-9e17-877c754115c8 (non-flash)
Nov 16 10:19:45 user nova-compute[85141]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca5a51ee-cdb2-4efa-b7e5-8a97d0c99bf7 (non-flash)
Nov 16 10:19:45 user nova-compute[85141]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dc504e0-da46-4c57-a66d-8ae6ce9c733c (non-flash)
Nov 16 10:19:45 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:19:45 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4238145-325c-45e3-8d23-2cd20cedfc9d tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)
Nov 16 10:19:45 user nova-compute[85141]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3392fa71-5ceb-42f9-acb8-b9e69b8b1cfa (non-flash)
Nov 16 10:19:45 user nova-compute[85141]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7784b4-2ba5-4085-9e17-877c754115c8 (non-flash)
Nov 16 10:19:45 user nova-compute[85141]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca5a51ee-cdb2-4efa-b7e5-8a97d0c99bf7 (non-flash)
Nov 16 10:19:45 user nova-compute[85141]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dc504e0-da46-4c57-a66d-8ae6ce9c733c (non-flash)
Nov 16 10:19:45 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 10:19:45 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-f4238145-325c-45e3-8d23-2cd20cedfc9d tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7dc504e0-da46-4c57-a66d-8ae6ce9c733c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.367s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 10:19:45 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4238145-325c-45e3-8d23-2cd20cedfc9d tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Connected to 172.16.0.220:3260 {{(pid=85141) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 10:19:45 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-f4238145-325c-45e3-8d23-2cd20cedfc9d tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] HCTL ('33', '-', '-', 0) found on session 31 with lun 0 {{(pid=85141) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 10:19:45 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-f4238145-325c-45e3-8d23-2cd20cedfc9d tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=85141) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 10:19:45 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:19:45 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:19:45 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:19:45 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.037s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:19:45 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6f8666e-51d2-4681-9dd5-d06945f97c9f]: (4, ('- - 0', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:19:45 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-f4238145-325c-45e3-8d23-2cd20cedfc9d tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Searching for a device in session 31 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=85141) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 10:19:45 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4238145-325c-45e3-8d23-2cd20cedfc9d tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:7dc504e0-da46-4c57-a66d-8ae6ce9c733c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iFVOdJIq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=85141) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 10:19:45 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:19:45 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:19:46 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-7d6081d8-a767-4b0b-9620-3f514249d18c tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Acquiring lock "0b388b98-4e65-4258-bbe2-77e699321fb7" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:19:46 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-7d6081d8-a767-4b0b-9620-3f514249d18c tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Lock "0b388b98-4e65-4258-bbe2-77e699321fb7" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.002s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:19:46 user nova-compute[85141]: DEBUG nova.compute.manager [None req-7d6081d8-a767-4b0b-9620-3f514249d18c tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] [instance: 0b388b98-4e65-4258-bbe2-77e699321fb7] Checking state {{(pid=85141) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 10:19:46 user nova-compute[85141]: DEBUG nova.compute.manager [None req-7d6081d8-a767-4b0b-9620-3f514249d18c tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] [instance: 0b388b98-4e65-4258-bbe2-77e699321fb7] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=85141) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Nov 16 10:19:46 user nova-compute[85141]: DEBUG nova.objects.instance [None req-7d6081d8-a767-4b0b-9620-3f514249d18c tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Lazy-loading 'flavor' on Instance uuid 0b388b98-4e65-4258-bbe2-77e699321fb7 {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:19:46 user nova-compute[85141]: INFO nova.virt.libvirt.driver [-] [instance: bff3a84b-6ab5-4256-8a04-2d21a4ba20b3] Instance destroyed successfully.
Nov 16 10:19:46 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-f64a28fc-5741-46d4-94c8-5b7bcd56d17e tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] [instance: bff3a84b-6ab5-4256-8a04-2d21a4ba20b3] Beginning cold snapshot process
Nov 16 10:19:46 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:19:46 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:19:46 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:19:46 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:19:46 user nova-compute[85141]: DEBUG nova.privsep.utils [None req-f64a28fc-5741-46d4-94c8-5b7bcd56d17e tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=85141) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 16 10:19:46 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-f64a28fc-5741-46d4-94c8-5b7bcd56d17e tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/bff3a84b-6ab5-4256-8a04-2d21a4ba20b3/disk /opt/stack/data/nova/instances/snapshots/tmpmkri6vix/2a49657713b446b49b71b3e9633bd407 {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:19:46 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-f4238145-325c-45e3-8d23-2cd20cedfc9d tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.444s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 10:19:46 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4238145-325c-45e3-8d23-2cd20cedfc9d tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] <== connect_volume: return (1446ms) {'type': 'block', 'scsi_wwn': '23633336435663635', 'path': '/dev/sdb'} {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 10:19:46 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f4238145-325c-45e3-8d23-2cd20cedfc9d tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] [instance: 2d7787a2-b8da-4d39-9b16-4c7bcb275f85] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23633336435663635', 'path': '/dev/sdb'} {{(pid=85141) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 10:19:46 user nova-compute[85141]: DEBUG nova.compute.manager [req-844528a1-6ad4-409c-b86c-8b221c5d46d4 req-07f8ba36-0865-4600-b878-d7c921ec3e3f service nova] [instance: 0b388b98-4e65-4258-bbe2-77e699321fb7] Received event network-vif-unplugged-3ed9d2a6-c028-4b75-9023-95b1cfa982b6 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:19:46 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-844528a1-6ad4-409c-b86c-8b221c5d46d4 req-07f8ba36-0865-4600-b878-d7c921ec3e3f service nova] Acquiring lock "0b388b98-4e65-4258-bbe2-77e699321fb7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:19:46 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-844528a1-6ad4-409c-b86c-8b221c5d46d4 req-07f8ba36-0865-4600-b878-d7c921ec3e3f service nova] Lock "0b388b98-4e65-4258-bbe2-77e699321fb7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:19:46 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-844528a1-6ad4-409c-b86c-8b221c5d46d4 req-07f8ba36-0865-4600-b878-d7c921ec3e3f service nova] Lock "0b388b98-4e65-4258-bbe2-77e699321fb7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:19:46 user nova-compute[85141]: DEBUG nova.compute.manager [req-844528a1-6ad4-409c-b86c-8b221c5d46d4 req-07f8ba36-0865-4600-b878-d7c921ec3e3f service nova] [instance: 0b388b98-4e65-4258-bbe2-77e699321fb7] No waiting events found dispatching network-vif-unplugged-3ed9d2a6-c028-4b75-9023-95b1cfa982b6 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:19:46 user nova-compute[85141]: WARNING nova.compute.manager [req-844528a1-6ad4-409c-b86c-8b221c5d46d4 req-07f8ba36-0865-4600-b878-d7c921ec3e3f service nova] [instance: 0b388b98-4e65-4258-bbe2-77e699321fb7] Received unexpected event network-vif-unplugged-3ed9d2a6-c028-4b75-9023-95b1cfa982b6 for instance with vm_state active and task_state powering-off.
Nov 16 10:19:46 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-f4238145-325c-45e3-8d23-2cd20cedfc9d tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T10:17:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1258419633',display_name='tempest-TestMinimumBasicScenario-server-1258419633',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1258419633',id=22,image_ref='e960df59-53b9-475b-b762-72c61c99e0eb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBItDkOA9C0uJPf9LijOMkhRvGGhUREdg5zYTmAP8Jr2q5TskNTHRCZQqwtHRWI5QTrlnhI5kKcYXRZFhe3aqQnbfNkSahjTY0HHASfhQQbujcaJQTG8nSUyM5nxOwF6+5g==',key_name='tempest-TestMinimumBasicScenario-2119154314',keypairs=<?>,launch_index=0,launched_at=2023-11-16T10:17:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b4e4f57f79564d2fbcb8080bf8f1c5c0',ramdisk_id='',reservation_id='r-3bxzxj23',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e960df59-53b9-475b-b762-72c61c99e0eb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-766472507',owner_user_name='tempest-TestMinimumBasicScenario-766472507-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T10:19:43Z,user_data=None,user_id='f8792b5cbd0845299dc396f922399980',uuid=2d7787a2-b8da-4d39-9b16-4c7bcb275f85,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3f553883-eaa0-4a7e-8e31-1170241a0236", "address": "fa:16:3e:1c:29:6f", "network": {"id": "436477fd-9294-4297-bfb3-405564823fa0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1068749207-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4e4f57f79564d2fbcb8080bf8f1c5c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f553883-ea", "ovs_interfaceid": "3f553883-eaa0-4a7e-8e31-1170241a0236", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=85141) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 10:19:46 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-f4238145-325c-45e3-8d23-2cd20cedfc9d tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Converting VIF {"id": "3f553883-eaa0-4a7e-8e31-1170241a0236", "address": "fa:16:3e:1c:29:6f", "network": {"id": "436477fd-9294-4297-bfb3-405564823fa0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1068749207-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4e4f57f79564d2fbcb8080bf8f1c5c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f553883-ea", "ovs_interfaceid": "3f553883-eaa0-4a7e-8e31-1170241a0236", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:19:46 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-f4238145-325c-45e3-8d23-2cd20cedfc9d tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1c:29:6f,bridge_name='br-int',has_traffic_filtering=True,id=3f553883-eaa0-4a7e-8e31-1170241a0236,network=Network(436477fd-9294-4297-bfb3-405564823fa0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f553883-ea') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:19:46 user nova-compute[85141]: DEBUG nova.objects.instance [None req-f4238145-325c-45e3-8d23-2cd20cedfc9d tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Lazy-loading 'pci_devices' on Instance uuid 2d7787a2-b8da-4d39-9b16-4c7bcb275f85 {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:19:46 user nova-compute[85141]: DEBUG nova.objects.base [None req-f4238145-325c-45e3-8d23-2cd20cedfc9d tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Object Instance<2d7787a2-b8da-4d39-9b16-4c7bcb275f85> lazy-loaded attributes: resources,vcpu_model,pci_devices {{(pid=85141) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 10:19:46 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-f4238145-325c-45e3-8d23-2cd20cedfc9d tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] [instance: 2d7787a2-b8da-4d39-9b16-4c7bcb275f85] End _get_guest_xml xml=<domain type="kvm">
Nov 16 10:19:46 user nova-compute[85141]:   <uuid>2d7787a2-b8da-4d39-9b16-4c7bcb275f85</uuid>
Nov 16 10:19:46 user nova-compute[85141]:   <name>instance-00000016</name>
Nov 16 10:19:46 user nova-compute[85141]:   <memory>524288</memory>
Nov 16 10:19:46 user nova-compute[85141]:   <vcpu>1</vcpu>
Nov 16 10:19:46 user nova-compute[85141]:   <metadata>
Nov 16 10:19:46 user nova-compute[85141]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 10:19:46 user nova-compute[85141]:       <nova:package version="0.0.0"/>
Nov 16 10:19:46 user nova-compute[85141]:       <nova:name>tempest-TestMinimumBasicScenario-server-1258419633</nova:name>
Nov 16 10:19:46 user nova-compute[85141]:       <nova:creationTime>2023-11-16 10:19:45</nova:creationTime>
Nov 16 10:19:46 user nova-compute[85141]:       <nova:flavor name="m1.tiny">
Nov 16 10:19:46 user nova-compute[85141]:         <nova:memory>512</nova:memory>
Nov 16 10:19:46 user nova-compute[85141]:         <nova:disk>1</nova:disk>
Nov 16 10:19:46 user nova-compute[85141]:         <nova:swap>0</nova:swap>
Nov 16 10:19:46 user nova-compute[85141]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 10:19:46 user nova-compute[85141]:         <nova:vcpus>1</nova:vcpus>
Nov 16 10:19:46 user nova-compute[85141]:       </nova:flavor>
Nov 16 10:19:46 user nova-compute[85141]:       <nova:owner>
Nov 16 10:19:46 user nova-compute[85141]:         <nova:user uuid="f8792b5cbd0845299dc396f922399980">tempest-TestMinimumBasicScenario-766472507-project-member</nova:user>
Nov 16 10:19:46 user nova-compute[85141]:         <nova:project uuid="b4e4f57f79564d2fbcb8080bf8f1c5c0">tempest-TestMinimumBasicScenario-766472507</nova:project>
Nov 16 10:19:46 user nova-compute[85141]:       </nova:owner>
Nov 16 10:19:46 user nova-compute[85141]:       <nova:root type="image" uuid="e960df59-53b9-475b-b762-72c61c99e0eb"/>
Nov 16 10:19:46 user nova-compute[85141]:       <nova:ports>
Nov 16 10:19:46 user nova-compute[85141]:         <nova:port uuid="3f553883-eaa0-4a7e-8e31-1170241a0236">
Nov 16 10:19:46 user nova-compute[85141]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 16 10:19:46 user nova-compute[85141]:         </nova:port>
Nov 16 10:19:46 user nova-compute[85141]:       </nova:ports>
Nov 16 10:19:46 user nova-compute[85141]:     </nova:instance>
Nov 16 10:19:46 user nova-compute[85141]:   </metadata>
Nov 16 10:19:46 user nova-compute[85141]:   <sysinfo type="smbios">
Nov 16 10:19:46 user nova-compute[85141]:     <system>
Nov 16 10:19:46 user nova-compute[85141]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 10:19:46 user nova-compute[85141]:       <entry name="product">OpenStack Nova</entry>
Nov 16 10:19:46 user nova-compute[85141]:       <entry name="version">0.0.0</entry>
Nov 16 10:19:46 user nova-compute[85141]:       <entry name="serial">2d7787a2-b8da-4d39-9b16-4c7bcb275f85</entry>
Nov 16 10:19:46 user nova-compute[85141]:       <entry name="uuid">2d7787a2-b8da-4d39-9b16-4c7bcb275f85</entry>
Nov 16 10:19:46 user nova-compute[85141]:       <entry name="family">Virtual Machine</entry>
Nov 16 10:19:46 user nova-compute[85141]:     </system>
Nov 16 10:19:46 user nova-compute[85141]:   </sysinfo>
Nov 16 10:19:46 user nova-compute[85141]:   <os>
Nov 16 10:19:46 user nova-compute[85141]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 10:19:46 user nova-compute[85141]:     <boot dev="hd"/>
Nov 16 10:19:46 user nova-compute[85141]:     <smbios mode="sysinfo"/>
Nov 16 10:19:46 user nova-compute[85141]:   </os>
Nov 16 10:19:46 user nova-compute[85141]:   <features>
Nov 16 10:19:46 user nova-compute[85141]:     <acpi/>
Nov 16 10:19:46 user nova-compute[85141]:     <apic/>
Nov 16 10:19:46 user nova-compute[85141]:     <vmcoreinfo/>
Nov 16 10:19:46 user nova-compute[85141]:   </features>
Nov 16 10:19:46 user nova-compute[85141]:   <clock offset="utc">
Nov 16 10:19:46 user nova-compute[85141]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 10:19:46 user nova-compute[85141]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 10:19:46 user nova-compute[85141]:     <timer name="hpet" present="no"/>
Nov 16 10:19:46 user nova-compute[85141]:   </clock>
Nov 16 10:19:46 user nova-compute[85141]:   <cpu mode="custom" match="exact">
Nov 16 10:19:46 user nova-compute[85141]:     <model>Nehalem</model>
Nov 16 10:19:46 user nova-compute[85141]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 10:19:46 user nova-compute[85141]:   </cpu>
Nov 16 10:19:46 user nova-compute[85141]:   <devices>
Nov 16 10:19:46 user nova-compute[85141]:     <disk type="file" device="disk">
Nov 16 10:19:46 user nova-compute[85141]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 10:19:46 user nova-compute[85141]:       <source file="/opt/stack/data/nova/instances/2d7787a2-b8da-4d39-9b16-4c7bcb275f85/disk"/>
Nov 16 10:19:46 user nova-compute[85141]:       <target dev="vda" bus="virtio"/>
Nov 16 10:19:46 user nova-compute[85141]:     </disk>
Nov 16 10:19:46 user nova-compute[85141]:     <disk type="block" device="disk">
Nov 16 10:19:46 user nova-compute[85141]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 10:19:46 user nova-compute[85141]:       <source dev="/dev/sdb"/>
Nov 16 10:19:46 user nova-compute[85141]:       <target dev="vdb" bus="virtio"/>
Nov 16 10:19:46 user nova-compute[85141]:       <serial>7dc504e0-da46-4c57-a66d-8ae6ce9c733c</serial>
Nov 16 10:19:46 user nova-compute[85141]:     </disk>
Nov 16 10:19:46 user nova-compute[85141]:     <interface type="ethernet">
Nov 16 10:19:46 user nova-compute[85141]:       <mac address="fa:16:3e:1c:29:6f"/>
Nov 16 10:19:46 user nova-compute[85141]:       <model type="virtio"/>
Nov 16 10:19:46 user nova-compute[85141]:       <mtu size="1442"/>
Nov 16 10:19:46 user nova-compute[85141]:       <target dev="tap3f553883-ea"/>
Nov 16 10:19:46 user nova-compute[85141]:     </interface>
Nov 16 10:19:46 user nova-compute[85141]:     <serial type="pty">
Nov 16 10:19:46 user nova-compute[85141]:       <log file="/opt/stack/data/nova/instances/2d7787a2-b8da-4d39-9b16-4c7bcb275f85/console.log" append="off"/>
Nov 16 10:19:46 user nova-compute[85141]:     </serial>
Nov 16 10:19:46 user nova-compute[85141]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 10:19:46 user nova-compute[85141]:     <video>
Nov 16 10:19:46 user nova-compute[85141]:       <model type="virtio"/>
Nov 16 10:19:46 user nova-compute[85141]:     </video>
Nov 16 10:19:46 user nova-compute[85141]:     <rng model="virtio">
Nov 16 10:19:46 user nova-compute[85141]:       <backend model="random">/dev/urandom</backend>
Nov 16 10:19:46 user nova-compute[85141]:     </rng>
Nov 16 10:19:46 user nova-compute[85141]:     <controller type="usb" index="0" model="none"/>
Nov 16 10:19:46 user nova-compute[85141]:     <memballoon model="virtio">
Nov 16 10:19:46 user nova-compute[85141]:       <stats period="10"/>
Nov 16 10:19:46 user nova-compute[85141]:     </memballoon>
Nov 16 10:19:46 user nova-compute[85141]:   </devices>
Nov 16 10:19:46 user nova-compute[85141]: </domain>
Nov 16 10:19:46 user nova-compute[85141]:  {{(pid=85141) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 10:19:46 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-f4238145-325c-45e3-8d23-2cd20cedfc9d tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d7787a2-b8da-4d39-9b16-4c7bcb275f85/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:19:47 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-f4238145-325c-45e3-8d23-2cd20cedfc9d tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d7787a2-b8da-4d39-9b16-4c7bcb275f85/disk --force-share --output=json" returned: 0 in 0.287s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:19:47 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-f4238145-325c-45e3-8d23-2cd20cedfc9d tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d7787a2-b8da-4d39-9b16-4c7bcb275f85/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:19:47 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:19:47 user nova-compute[85141]: DEBUG nova.compute.manager [req-bf20d4a2-4c16-410a-992e-fb1d13527e87 req-2f3b77a6-43f1-4e72-9c80-e0c02956f170 service nova] [instance: bff3a84b-6ab5-4256-8a04-2d21a4ba20b3] Received event network-vif-unplugged-23ec0327-ca81-4524-8850-2c081e596d44 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:19:47 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-bf20d4a2-4c16-410a-992e-fb1d13527e87 req-2f3b77a6-43f1-4e72-9c80-e0c02956f170 service nova] Acquiring lock "bff3a84b-6ab5-4256-8a04-2d21a4ba20b3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:19:47 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-bf20d4a2-4c16-410a-992e-fb1d13527e87 req-2f3b77a6-43f1-4e72-9c80-e0c02956f170 service nova] Lock "bff3a84b-6ab5-4256-8a04-2d21a4ba20b3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:19:47 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-bf20d4a2-4c16-410a-992e-fb1d13527e87 req-2f3b77a6-43f1-4e72-9c80-e0c02956f170 service nova] Lock "bff3a84b-6ab5-4256-8a04-2d21a4ba20b3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:19:47 user nova-compute[85141]: DEBUG nova.compute.manager [req-bf20d4a2-4c16-410a-992e-fb1d13527e87 req-2f3b77a6-43f1-4e72-9c80-e0c02956f170 service nova] [instance: bff3a84b-6ab5-4256-8a04-2d21a4ba20b3] No waiting events found dispatching network-vif-unplugged-23ec0327-ca81-4524-8850-2c081e596d44 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:19:47 user nova-compute[85141]: WARNING nova.compute.manager [req-bf20d4a2-4c16-410a-992e-fb1d13527e87 req-2f3b77a6-43f1-4e72-9c80-e0c02956f170 service nova] [instance: bff3a84b-6ab5-4256-8a04-2d21a4ba20b3] Received unexpected event network-vif-unplugged-23ec0327-ca81-4524-8850-2c081e596d44 for instance with vm_state active and task_state shelving_image_pending_upload.
Nov 16 10:19:47 user nova-compute[85141]: DEBUG nova.compute.manager [req-bf20d4a2-4c16-410a-992e-fb1d13527e87 req-2f3b77a6-43f1-4e72-9c80-e0c02956f170 service nova] [instance: bff3a84b-6ab5-4256-8a04-2d21a4ba20b3] Received event network-vif-plugged-23ec0327-ca81-4524-8850-2c081e596d44 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:19:47 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-bf20d4a2-4c16-410a-992e-fb1d13527e87 req-2f3b77a6-43f1-4e72-9c80-e0c02956f170 service nova] Acquiring lock "bff3a84b-6ab5-4256-8a04-2d21a4ba20b3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:19:47 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-bf20d4a2-4c16-410a-992e-fb1d13527e87 req-2f3b77a6-43f1-4e72-9c80-e0c02956f170 service nova] Lock "bff3a84b-6ab5-4256-8a04-2d21a4ba20b3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:19:47 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-bf20d4a2-4c16-410a-992e-fb1d13527e87 req-2f3b77a6-43f1-4e72-9c80-e0c02956f170 service nova] Lock "bff3a84b-6ab5-4256-8a04-2d21a4ba20b3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:19:47 user nova-compute[85141]: DEBUG nova.compute.manager [req-bf20d4a2-4c16-410a-992e-fb1d13527e87 req-2f3b77a6-43f1-4e72-9c80-e0c02956f170 service nova] [instance: bff3a84b-6ab5-4256-8a04-2d21a4ba20b3] No waiting events found dispatching network-vif-plugged-23ec0327-ca81-4524-8850-2c081e596d44 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:19:47 user nova-compute[85141]: WARNING nova.compute.manager [req-bf20d4a2-4c16-410a-992e-fb1d13527e87 req-2f3b77a6-43f1-4e72-9c80-e0c02956f170 service nova] [instance: bff3a84b-6ab5-4256-8a04-2d21a4ba20b3] Received unexpected event network-vif-plugged-23ec0327-ca81-4524-8850-2c081e596d44 for instance with vm_state active and task_state shelving_image_pending_upload.
Nov 16 10:19:47 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:19:47 user nova-compute[85141]: INFO nova.virt.libvirt.driver [-] [instance: 0b388b98-4e65-4258-bbe2-77e699321fb7] Instance destroyed successfully.
Nov 16 10:19:47 user nova-compute[85141]: DEBUG nova.compute.manager [None req-7d6081d8-a767-4b0b-9620-3f514249d18c tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] [instance: 0b388b98-4e65-4258-bbe2-77e699321fb7] Checking state {{(pid=85141) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 10:19:47 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-f4238145-325c-45e3-8d23-2cd20cedfc9d tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d7787a2-b8da-4d39-9b16-4c7bcb275f85/disk --force-share --output=json" returned: 0 in 0.288s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:19:47 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-f4238145-325c-45e3-8d23-2cd20cedfc9d tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=85141) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 10:19:47 user nova-compute[85141]: DEBUG nova.objects.instance [None req-f4238145-325c-45e3-8d23-2cd20cedfc9d tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Lazy-loading 'trusted_certs' on Instance uuid 2d7787a2-b8da-4d39-9b16-4c7bcb275f85 {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:19:47 user nova-compute[85141]: DEBUG nova.objects.base [None req-f4238145-325c-45e3-8d23-2cd20cedfc9d tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Object Instance<2d7787a2-b8da-4d39-9b16-4c7bcb275f85> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs {{(pid=85141) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 10:19:47 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-f4238145-325c-45e3-8d23-2cd20cedfc9d tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a1f7888919bcf90b1a285400ac888d0a386989df --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:19:47 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-7d6081d8-a767-4b0b-9620-3f514249d18c tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Lock "0b388b98-4e65-4258-bbe2-77e699321fb7" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 1.137s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:19:47 user nova-compute[85141]: DEBUG nova.compute.manager [None req-27e093f4-6ae1-4d32-a75f-6b1cddd9b374 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] [instance: fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f] Checking state {{(pid=85141) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 10:19:47 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:19:47 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-f64a28fc-5741-46d4-94c8-5b7bcd56d17e tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/bff3a84b-6ab5-4256-8a04-2d21a4ba20b3/disk /opt/stack/data/nova/instances/snapshots/tmpmkri6vix/2a49657713b446b49b71b3e9633bd407" returned: 0 in 0.854s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:19:47 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-f64a28fc-5741-46d4-94c8-5b7bcd56d17e tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] [instance: bff3a84b-6ab5-4256-8a04-2d21a4ba20b3] Snapshot extracted, beginning image upload
Nov 16 10:19:47 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-f4238145-325c-45e3-8d23-2cd20cedfc9d tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a1f7888919bcf90b1a285400ac888d0a386989df --force-share --output=json" returned: 0 in 0.191s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:19:47 user nova-compute[85141]: DEBUG nova.virt.disk.api [None req-f4238145-325c-45e3-8d23-2cd20cedfc9d tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2d7787a2-b8da-4d39-9b16-4c7bcb275f85/disk. size=1073741824 {{(pid=85141) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 10:19:47 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-f4238145-325c-45e3-8d23-2cd20cedfc9d tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d7787a2-b8da-4d39-9b16-4c7bcb275f85/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:19:47 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-f4238145-325c-45e3-8d23-2cd20cedfc9d tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d7787a2-b8da-4d39-9b16-4c7bcb275f85/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:19:47 user nova-compute[85141]: DEBUG nova.virt.disk.api [None req-f4238145-325c-45e3-8d23-2cd20cedfc9d tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Cannot resize image /opt/stack/data/nova/instances/2d7787a2-b8da-4d39-9b16-4c7bcb275f85/disk to a smaller size. {{(pid=85141) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 10:19:47 user nova-compute[85141]: DEBUG nova.objects.instance [None req-f4238145-325c-45e3-8d23-2cd20cedfc9d tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Lazy-loading 'migration_context' on Instance uuid 2d7787a2-b8da-4d39-9b16-4c7bcb275f85 {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:19:47 user nova-compute[85141]: DEBUG nova.objects.base [None req-f4238145-325c-45e3-8d23-2cd20cedfc9d tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Object Instance<2d7787a2-b8da-4d39-9b16-4c7bcb275f85> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=85141) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 10:19:47 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-f4238145-325c-45e3-8d23-2cd20cedfc9d tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T10:17:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1258419633',display_name='tempest-TestMinimumBasicScenario-server-1258419633',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1258419633',id=22,image_ref='e960df59-53b9-475b-b762-72c61c99e0eb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBItDkOA9C0uJPf9LijOMkhRvGGhUREdg5zYTmAP8Jr2q5TskNTHRCZQqwtHRWI5QTrlnhI5kKcYXRZFhe3aqQnbfNkSahjTY0HHASfhQQbujcaJQTG8nSUyM5nxOwF6+5g==',key_name='tempest-TestMinimumBasicScenario-2119154314',keypairs=<?>,launch_index=0,launched_at=2023-11-16T10:17:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='b4e4f57f79564d2fbcb8080bf8f1c5c0',ramdisk_id='',reservation_id='r-3bxzxj23',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e960df59-53b9-475b-b762-72c61c99e0eb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-766472507',owner_user_name='tempest-TestMinimumBasicScenario-766472507-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T10:19:43Z,user_data=None,user_id='f8792b5cbd0845299dc396f922399980',uuid=2d7787a2-b8da-4d39-9b16-4c7bcb275f85,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3f553883-eaa0-4a7e-8e31-1170241a0236", "address": "fa:16:3e:1c:29:6f", "network": {"id": "436477fd-9294-4297-bfb3-405564823fa0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1068749207-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4e4f57f79564d2fbcb8080bf8f1c5c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f553883-ea", "ovs_interfaceid": "3f553883-eaa0-4a7e-8e31-1170241a0236", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 10:19:47 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-f4238145-325c-45e3-8d23-2cd20cedfc9d tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Converting VIF {"id": "3f553883-eaa0-4a7e-8e31-1170241a0236", "address": "fa:16:3e:1c:29:6f", "network": {"id": "436477fd-9294-4297-bfb3-405564823fa0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1068749207-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4e4f57f79564d2fbcb8080bf8f1c5c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f553883-ea", "ovs_interfaceid": "3f553883-eaa0-4a7e-8e31-1170241a0236", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:19:47 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-f4238145-325c-45e3-8d23-2cd20cedfc9d tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1c:29:6f,bridge_name='br-int',has_traffic_filtering=True,id=3f553883-eaa0-4a7e-8e31-1170241a0236,network=Network(436477fd-9294-4297-bfb3-405564823fa0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f553883-ea') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:19:47 user nova-compute[85141]: DEBUG os_vif [None req-f4238145-325c-45e3-8d23-2cd20cedfc9d tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1c:29:6f,bridge_name='br-int',has_traffic_filtering=True,id=3f553883-eaa0-4a7e-8e31-1170241a0236,network=Network(436477fd-9294-4297-bfb3-405564823fa0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f553883-ea') {{(pid=85141) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 10:19:47 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:19:47 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:19:47 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 10:19:47 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:19:47 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '04508027-90b5-5ace-a385-e821f61d5f0e', '_type': 'linux-noop'}}, row=False) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:19:47 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:19:47 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:19:47 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:19:47 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:19:47 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3f553883-ea, may_exist=True, interface_attrs={}) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:19:47 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3f553883-ea, col_values=(('qos', UUID('15c82592-e54f-40d0-94f4-1c596a63b7ca')),), if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:19:47 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3f553883-ea, col_values=(('external_ids', {'iface-id': '3f553883-eaa0-4a7e-8e31-1170241a0236', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1c:29:6f', 'vm-uuid': '2d7787a2-b8da-4d39-9b16-4c7bcb275f85'}),), if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:19:47 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:19:47 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:19:48 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:19:48 user nova-compute[85141]: INFO os_vif [None req-f4238145-325c-45e3-8d23-2cd20cedfc9d tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1c:29:6f,bridge_name='br-int',has_traffic_filtering=True,id=3f553883-eaa0-4a7e-8e31-1170241a0236,network=Network(436477fd-9294-4297-bfb3-405564823fa0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f553883-ea')
Nov 16 10:19:48 user nova-compute[85141]: DEBUG nova.compute.manager [req-a759631b-d67d-4b2e-b7b2-de67f6ec35e9 req-3e3dc8f9-d0bc-4660-a6a1-bd43a762b01d service nova] [instance: 0b388b98-4e65-4258-bbe2-77e699321fb7] Received event network-vif-plugged-3ed9d2a6-c028-4b75-9023-95b1cfa982b6 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:19:48 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-a759631b-d67d-4b2e-b7b2-de67f6ec35e9 req-3e3dc8f9-d0bc-4660-a6a1-bd43a762b01d service nova] Acquiring lock "0b388b98-4e65-4258-bbe2-77e699321fb7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:19:48 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-a759631b-d67d-4b2e-b7b2-de67f6ec35e9 req-3e3dc8f9-d0bc-4660-a6a1-bd43a762b01d service nova] Lock "0b388b98-4e65-4258-bbe2-77e699321fb7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:19:48 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-a759631b-d67d-4b2e-b7b2-de67f6ec35e9 req-3e3dc8f9-d0bc-4660-a6a1-bd43a762b01d service nova] Lock "0b388b98-4e65-4258-bbe2-77e699321fb7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:19:48 user nova-compute[85141]: DEBUG nova.compute.manager [req-a759631b-d67d-4b2e-b7b2-de67f6ec35e9 req-3e3dc8f9-d0bc-4660-a6a1-bd43a762b01d service nova] [instance: 0b388b98-4e65-4258-bbe2-77e699321fb7] No waiting events found dispatching network-vif-plugged-3ed9d2a6-c028-4b75-9023-95b1cfa982b6 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:19:48 user nova-compute[85141]: WARNING nova.compute.manager [req-a759631b-d67d-4b2e-b7b2-de67f6ec35e9 req-3e3dc8f9-d0bc-4660-a6a1-bd43a762b01d service nova] [instance: 0b388b98-4e65-4258-bbe2-77e699321fb7] Received unexpected event network-vif-plugged-3ed9d2a6-c028-4b75-9023-95b1cfa982b6 for instance with vm_state stopped and task_state None.
Nov 16 10:19:49 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:19:49 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:19:49 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:19:49 user nova-compute[85141]: DEBUG nova.compute.manager [req-a51c98a3-43a4-4940-9331-87562afadd25 req-af7eb17e-7670-4434-8e1a-75d4955af119 service nova] [instance: 2d7787a2-b8da-4d39-9b16-4c7bcb275f85] Received event network-vif-plugged-3f553883-eaa0-4a7e-8e31-1170241a0236 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:19:49 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-a51c98a3-43a4-4940-9331-87562afadd25 req-af7eb17e-7670-4434-8e1a-75d4955af119 service nova] Acquiring lock "2d7787a2-b8da-4d39-9b16-4c7bcb275f85-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:19:49 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-a51c98a3-43a4-4940-9331-87562afadd25 req-af7eb17e-7670-4434-8e1a-75d4955af119 service nova] Lock "2d7787a2-b8da-4d39-9b16-4c7bcb275f85-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:19:49 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-a51c98a3-43a4-4940-9331-87562afadd25 req-af7eb17e-7670-4434-8e1a-75d4955af119 service nova] Lock "2d7787a2-b8da-4d39-9b16-4c7bcb275f85-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:19:49 user nova-compute[85141]: DEBUG nova.compute.manager [req-a51c98a3-43a4-4940-9331-87562afadd25 req-af7eb17e-7670-4434-8e1a-75d4955af119 service nova] [instance: 2d7787a2-b8da-4d39-9b16-4c7bcb275f85] No waiting events found dispatching network-vif-plugged-3f553883-eaa0-4a7e-8e31-1170241a0236 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:19:49 user nova-compute[85141]: WARNING nova.compute.manager [req-a51c98a3-43a4-4940-9331-87562afadd25 req-af7eb17e-7670-4434-8e1a-75d4955af119 service nova] [instance: 2d7787a2-b8da-4d39-9b16-4c7bcb275f85] Received unexpected event network-vif-plugged-3f553883-eaa0-4a7e-8e31-1170241a0236 for instance with vm_state active and task_state reboot_started_hard.
Nov 16 10:19:49 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:19:50 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:19:50 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:19:50 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:19:50 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:19:50 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-f64a28fc-5741-46d4-94c8-5b7bcd56d17e tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] [instance: bff3a84b-6ab5-4256-8a04-2d21a4ba20b3] Snapshot image upload complete
Nov 16 10:19:50 user nova-compute[85141]: DEBUG nova.compute.manager [None req-f64a28fc-5741-46d4-94c8-5b7bcd56d17e tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] [instance: bff3a84b-6ab5-4256-8a04-2d21a4ba20b3] Checking state {{(pid=85141) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 10:19:50 user nova-compute[85141]: INFO nova.compute.manager [None req-f64a28fc-5741-46d4-94c8-5b7bcd56d17e tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] [instance: bff3a84b-6ab5-4256-8a04-2d21a4ba20b3] Shelve offloading
Nov 16 10:19:50 user nova-compute[85141]: INFO nova.virt.libvirt.driver [-] [instance: bff3a84b-6ab5-4256-8a04-2d21a4ba20b3] Instance destroyed successfully.
Nov 16 10:19:50 user nova-compute[85141]: DEBUG nova.compute.manager [None req-f64a28fc-5741-46d4-94c8-5b7bcd56d17e tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] [instance: bff3a84b-6ab5-4256-8a04-2d21a4ba20b3] Checking state {{(pid=85141) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 10:19:50 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-f64a28fc-5741-46d4-94c8-5b7bcd56d17e tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Acquiring lock "refresh_cache-bff3a84b-6ab5-4256-8a04-2d21a4ba20b3" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:19:50 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-f64a28fc-5741-46d4-94c8-5b7bcd56d17e tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Acquired lock "refresh_cache-bff3a84b-6ab5-4256-8a04-2d21a4ba20b3" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:19:50 user nova-compute[85141]: DEBUG nova.network.neutron [None req-f64a28fc-5741-46d4-94c8-5b7bcd56d17e tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] [instance: bff3a84b-6ab5-4256-8a04-2d21a4ba20b3] Building network info cache for instance {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 10:19:50 user nova-compute[85141]: DEBUG nova.network.neutron [None req-f64a28fc-5741-46d4-94c8-5b7bcd56d17e tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] [instance: bff3a84b-6ab5-4256-8a04-2d21a4ba20b3] Updating instance_info_cache with network_info: [{"id": "23ec0327-ca81-4524-8850-2c081e596d44", "address": "fa:16:3e:e1:61:4a", "network": {"id": "4fb7c85e-c966-481d-b6f2-856a17ac8f7c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-81570496-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08ef12fb41a14ecd8abb84d4d69b7c27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23ec0327-ca", "ovs_interfaceid": "23ec0327-ca81-4524-8850-2c081e596d44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:19:50 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-f64a28fc-5741-46d4-94c8-5b7bcd56d17e tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Releasing lock "refresh_cache-bff3a84b-6ab5-4256-8a04-2d21a4ba20b3" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:19:51 user nova-compute[85141]: INFO nova.virt.libvirt.driver [-] [instance: bff3a84b-6ab5-4256-8a04-2d21a4ba20b3] Instance destroyed successfully.
Nov 16 10:19:51 user nova-compute[85141]: DEBUG nova.objects.instance [None req-f64a28fc-5741-46d4-94c8-5b7bcd56d17e tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Lazy-loading 'resources' on Instance uuid bff3a84b-6ab5-4256-8a04-2d21a4ba20b3 {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:19:51 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-f64a28fc-5741-46d4-94c8-5b7bcd56d17e tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T10:17:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-614284673',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-614284673',id=25,image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPrlp76Olur0ZBpPoZ4m3G4Hwg5TXY71OdfaQUGbHoElIxC/z9jY6d0topldSFOLBvCWRDtLDl17PNg8CQuntmhvUqsl16M2lr6nhPkJ/90Htz0ywDAC3fTsHsTT9yVpJQ==',key_name='tempest-keypair-1229413697',keypairs=<?>,launch_index=0,launched_at=2023-11-16T10:18:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='08ef12fb41a14ecd8abb84d4d69b7c27',ramdisk_id='',reservation_id='r-m6x0xg39',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-958501663',owner_user_name='tempest-AttachVolumeShelveTestJSON-958501663-project-member',shelved_at='2023-11-16T10:19:50.343466',shelved_host='user',shelved_image_id='1b4f956c-5533-48f0-bf16-1695e8e06e81'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T10:19:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='baec48c887ae4a418e0ea7b32b05bc59',uuid=bff3a84b-6ab5-4256-8a04-2d21a4ba20b3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "23ec0327-ca81-4524-8850-2c081e596d44", "address": "fa:16:3e:e1:61:4a", "network": {"id": "4fb7c85e-c966-481d-b6f2-856a17ac8f7c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-81570496-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08ef12fb41a14ecd8abb84d4d69b7c27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23ec0327-ca", "ovs_interfaceid": "23ec0327-ca81-4524-8850-2c081e596d44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 10:19:51 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-f64a28fc-5741-46d4-94c8-5b7bcd56d17e tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Converting VIF {"id": "23ec0327-ca81-4524-8850-2c081e596d44", "address": "fa:16:3e:e1:61:4a", "network": {"id": "4fb7c85e-c966-481d-b6f2-856a17ac8f7c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-81570496-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08ef12fb41a14ecd8abb84d4d69b7c27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23ec0327-ca", "ovs_interfaceid": "23ec0327-ca81-4524-8850-2c081e596d44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:19:51 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-f64a28fc-5741-46d4-94c8-5b7bcd56d17e tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:61:4a,bridge_name='br-int',has_traffic_filtering=True,id=23ec0327-ca81-4524-8850-2c081e596d44,network=Network(4fb7c85e-c966-481d-b6f2-856a17ac8f7c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23ec0327-ca') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:19:51 user nova-compute[85141]: DEBUG os_vif [None req-f64a28fc-5741-46d4-94c8-5b7bcd56d17e tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:61:4a,bridge_name='br-int',has_traffic_filtering=True,id=23ec0327-ca81-4524-8850-2c081e596d44,network=Network(4fb7c85e-c966-481d-b6f2-856a17ac8f7c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23ec0327-ca') {{(pid=85141) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 10:19:51 user nova-compute[85141]: DEBUG nova.compute.manager [req-de0730f8-bafe-4e33-b76d-1e0a4beeef96 req-b1f4667d-ccf2-4eea-9dfa-642a3ab53490 service nova] [instance: bff3a84b-6ab5-4256-8a04-2d21a4ba20b3] Received event network-changed-23ec0327-ca81-4524-8850-2c081e596d44 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:19:51 user nova-compute[85141]: DEBUG nova.compute.manager [req-de0730f8-bafe-4e33-b76d-1e0a4beeef96 req-b1f4667d-ccf2-4eea-9dfa-642a3ab53490 service nova] [instance: bff3a84b-6ab5-4256-8a04-2d21a4ba20b3] Refreshing instance network info cache due to event network-changed-23ec0327-ca81-4524-8850-2c081e596d44. {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 10:19:51 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-de0730f8-bafe-4e33-b76d-1e0a4beeef96 req-b1f4667d-ccf2-4eea-9dfa-642a3ab53490 service nova] Acquiring lock "refresh_cache-bff3a84b-6ab5-4256-8a04-2d21a4ba20b3" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:19:51 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-de0730f8-bafe-4e33-b76d-1e0a4beeef96 req-b1f4667d-ccf2-4eea-9dfa-642a3ab53490 service nova] Acquired lock "refresh_cache-bff3a84b-6ab5-4256-8a04-2d21a4ba20b3" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:19:51 user nova-compute[85141]: DEBUG nova.network.neutron [req-de0730f8-bafe-4e33-b76d-1e0a4beeef96 req-b1f4667d-ccf2-4eea-9dfa-642a3ab53490 service nova] [instance: bff3a84b-6ab5-4256-8a04-2d21a4ba20b3] Refreshing network info cache for port 23ec0327-ca81-4524-8850-2c081e596d44 {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 10:19:51 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:19:51 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap23ec0327-ca, bridge=br-int, if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:19:51 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:19:51 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:19:51 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:19:51 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:19:51 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d448ea39-8d4c-4030-8d58-d7ee8e71d987) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:19:51 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:19:51 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:19:51 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:19:51 user nova-compute[85141]: INFO os_vif [None req-f64a28fc-5741-46d4-94c8-5b7bcd56d17e tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:61:4a,bridge_name='br-int',has_traffic_filtering=True,id=23ec0327-ca81-4524-8850-2c081e596d44,network=Network(4fb7c85e-c966-481d-b6f2-856a17ac8f7c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23ec0327-ca')
Nov 16 10:19:51 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-f64a28fc-5741-46d4-94c8-5b7bcd56d17e tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] [instance: bff3a84b-6ab5-4256-8a04-2d21a4ba20b3] Deleting instance files /opt/stack/data/nova/instances/bff3a84b-6ab5-4256-8a04-2d21a4ba20b3_del
Nov 16 10:19:51 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-f64a28fc-5741-46d4-94c8-5b7bcd56d17e tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] [instance: bff3a84b-6ab5-4256-8a04-2d21a4ba20b3] Deletion of /opt/stack/data/nova/instances/bff3a84b-6ab5-4256-8a04-2d21a4ba20b3_del complete
Nov 16 10:19:51 user nova-compute[85141]: INFO nova.scheduler.client.report [None req-f64a28fc-5741-46d4-94c8-5b7bcd56d17e tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Deleted allocations for instance bff3a84b-6ab5-4256-8a04-2d21a4ba20b3
Nov 16 10:19:51 user nova-compute[85141]: DEBUG nova.compute.manager [None req-f4238145-325c-45e3-8d23-2cd20cedfc9d tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] [instance: 2d7787a2-b8da-4d39-9b16-4c7bcb275f85] Instance event wait completed in 0 seconds for  {{(pid=85141) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 10:19:51 user nova-compute[85141]: INFO nova.virt.libvirt.driver [-] [instance: 2d7787a2-b8da-4d39-9b16-4c7bcb275f85] Instance rebooted successfully.
Nov 16 10:19:51 user nova-compute[85141]: DEBUG nova.compute.manager [None req-f4238145-325c-45e3-8d23-2cd20cedfc9d tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] [instance: 2d7787a2-b8da-4d39-9b16-4c7bcb275f85] Checking state {{(pid=85141) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 10:19:51 user nova-compute[85141]: DEBUG nova.compute.manager [req-469c09b8-46e1-490f-9ee8-43327ee50275 req-8d43901b-44f7-4011-9987-c4ed02d35de0 service nova] [instance: 2d7787a2-b8da-4d39-9b16-4c7bcb275f85] Received event network-vif-plugged-3f553883-eaa0-4a7e-8e31-1170241a0236 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:19:51 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-469c09b8-46e1-490f-9ee8-43327ee50275 req-8d43901b-44f7-4011-9987-c4ed02d35de0 service nova] Acquiring lock "2d7787a2-b8da-4d39-9b16-4c7bcb275f85-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:19:51 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-469c09b8-46e1-490f-9ee8-43327ee50275 req-8d43901b-44f7-4011-9987-c4ed02d35de0 service nova] Lock "2d7787a2-b8da-4d39-9b16-4c7bcb275f85-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:19:51 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-469c09b8-46e1-490f-9ee8-43327ee50275 req-8d43901b-44f7-4011-9987-c4ed02d35de0 service nova] Lock "2d7787a2-b8da-4d39-9b16-4c7bcb275f85-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:19:51 user nova-compute[85141]: DEBUG nova.compute.manager [req-469c09b8-46e1-490f-9ee8-43327ee50275 req-8d43901b-44f7-4011-9987-c4ed02d35de0 service nova] [instance: 2d7787a2-b8da-4d39-9b16-4c7bcb275f85] No waiting events found dispatching network-vif-plugged-3f553883-eaa0-4a7e-8e31-1170241a0236 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:19:51 user nova-compute[85141]: WARNING nova.compute.manager [req-469c09b8-46e1-490f-9ee8-43327ee50275 req-8d43901b-44f7-4011-9987-c4ed02d35de0 service nova] [instance: 2d7787a2-b8da-4d39-9b16-4c7bcb275f85] Received unexpected event network-vif-plugged-3f553883-eaa0-4a7e-8e31-1170241a0236 for instance with vm_state active and task_state reboot_started_hard.
Nov 16 10:19:51 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-f64a28fc-5741-46d4-94c8-5b7bcd56d17e tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:19:51 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-f64a28fc-5741-46d4-94c8-5b7bcd56d17e tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:19:51 user nova-compute[85141]: DEBUG nova.objects.instance [None req-f64a28fc-5741-46d4-94c8-5b7bcd56d17e tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Lazy-loading 'numa_topology' on Instance uuid bff3a84b-6ab5-4256-8a04-2d21a4ba20b3 {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:19:51 user nova-compute[85141]: DEBUG nova.objects.base [None req-f64a28fc-5741-46d4-94c8-5b7bcd56d17e tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Object Instance<bff3a84b-6ab5-4256-8a04-2d21a4ba20b3> lazy-loaded attributes: resources,numa_topology {{(pid=85141) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 10:19:51 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-f4238145-325c-45e3-8d23-2cd20cedfc9d tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Lock "2d7787a2-b8da-4d39-9b16-4c7bcb275f85" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 10.066s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:19:51 user nova-compute[85141]: DEBUG nova.network.neutron [req-de0730f8-bafe-4e33-b76d-1e0a4beeef96 req-b1f4667d-ccf2-4eea-9dfa-642a3ab53490 service nova] [instance: bff3a84b-6ab5-4256-8a04-2d21a4ba20b3] Updated VIF entry in instance network info cache for port 23ec0327-ca81-4524-8850-2c081e596d44. {{(pid=85141) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 10:19:51 user nova-compute[85141]: DEBUG nova.network.neutron [req-de0730f8-bafe-4e33-b76d-1e0a4beeef96 req-b1f4667d-ccf2-4eea-9dfa-642a3ab53490 service nova] [instance: bff3a84b-6ab5-4256-8a04-2d21a4ba20b3] Updating instance_info_cache with network_info: [{"id": "23ec0327-ca81-4524-8850-2c081e596d44", "address": "fa:16:3e:e1:61:4a", "network": {"id": "4fb7c85e-c966-481d-b6f2-856a17ac8f7c", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-81570496-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08ef12fb41a14ecd8abb84d4d69b7c27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap23ec0327-ca", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:19:51 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-de0730f8-bafe-4e33-b76d-1e0a4beeef96 req-b1f4667d-ccf2-4eea-9dfa-642a3ab53490 service nova] Releasing lock "refresh_cache-bff3a84b-6ab5-4256-8a04-2d21a4ba20b3" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:19:52 user nova-compute[85141]: DEBUG nova.compute.provider_tree [None req-f64a28fc-5741-46d4-94c8-5b7bcd56d17e tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Inventory has not changed in ProviderTree for provider: bf8e0fa1-16b6-408f-9203-c4cd63916272 {{(pid=85141) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 10:19:52 user nova-compute[85141]: DEBUG nova.scheduler.client.report [None req-f64a28fc-5741-46d4-94c8-5b7bcd56d17e tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Inventory has not changed for provider bf8e0fa1-16b6-408f-9203-c4cd63916272 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=85141) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 10:19:52 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-f64a28fc-5741-46d4-94c8-5b7bcd56d17e tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.394s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:19:52 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-f64a28fc-5741-46d4-94c8-5b7bcd56d17e tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Lock "bff3a84b-6ab5-4256-8a04-2d21a4ba20b3" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 6.585s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:19:52 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:19:56 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:19:57 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:20:00 user nova-compute[85141]: INFO nova.compute.manager [None req-17c0a38f-2717-4f3e-915c-3c71937a7420 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] [instance: 4e214bbb-5bbb-4e6f-ac09-9cb1412f068b] Rescuing
Nov 16 10:20:00 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-17c0a38f-2717-4f3e-915c-3c71937a7420 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Acquiring lock "refresh_cache-4e214bbb-5bbb-4e6f-ac09-9cb1412f068b" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:20:00 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-17c0a38f-2717-4f3e-915c-3c71937a7420 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Acquired lock "refresh_cache-4e214bbb-5bbb-4e6f-ac09-9cb1412f068b" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:20:00 user nova-compute[85141]: DEBUG nova.network.neutron [None req-17c0a38f-2717-4f3e-915c-3c71937a7420 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] [instance: 4e214bbb-5bbb-4e6f-ac09-9cb1412f068b] Building network info cache for instance {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 10:20:00 user nova-compute[85141]: DEBUG nova.network.neutron [None req-17c0a38f-2717-4f3e-915c-3c71937a7420 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] [instance: 4e214bbb-5bbb-4e6f-ac09-9cb1412f068b] Updating instance_info_cache with network_info: [{"id": "b0a1b07c-bdba-4ef8-893e-fb5dcdbac88c", "address": "fa:16:3e:b9:03:60", "network": {"id": "5b67a3fd-ef1e-4f2c-b6e0-31766ef39d30", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2137186235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09b520de67ac4290a4b779f50afeb1a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0a1b07c-bd", "ovs_interfaceid": "b0a1b07c-bdba-4ef8-893e-fb5dcdbac88c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:20:00 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-17c0a38f-2717-4f3e-915c-3c71937a7420 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Releasing lock "refresh_cache-4e214bbb-5bbb-4e6f-ac09-9cb1412f068b" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:20:00 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:20:00 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:20:00 user nova-compute[85141]: DEBUG nova.compute.manager [req-6b181709-fb3b-4e03-a4ef-c3d7f8872774 req-1b8b87a2-2eb5-4625-873e-aa4af814aab7 service nova] [instance: 4e214bbb-5bbb-4e6f-ac09-9cb1412f068b] Received event network-vif-unplugged-b0a1b07c-bdba-4ef8-893e-fb5dcdbac88c {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:20:00 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-6b181709-fb3b-4e03-a4ef-c3d7f8872774 req-1b8b87a2-2eb5-4625-873e-aa4af814aab7 service nova] Acquiring lock "4e214bbb-5bbb-4e6f-ac09-9cb1412f068b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:20:00 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-6b181709-fb3b-4e03-a4ef-c3d7f8872774 req-1b8b87a2-2eb5-4625-873e-aa4af814aab7 service nova] Lock "4e214bbb-5bbb-4e6f-ac09-9cb1412f068b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:20:00 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-6b181709-fb3b-4e03-a4ef-c3d7f8872774 req-1b8b87a2-2eb5-4625-873e-aa4af814aab7 service nova] Lock "4e214bbb-5bbb-4e6f-ac09-9cb1412f068b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:20:00 user nova-compute[85141]: DEBUG nova.compute.manager [req-6b181709-fb3b-4e03-a4ef-c3d7f8872774 req-1b8b87a2-2eb5-4625-873e-aa4af814aab7 service nova] [instance: 4e214bbb-5bbb-4e6f-ac09-9cb1412f068b] No waiting events found dispatching network-vif-unplugged-b0a1b07c-bdba-4ef8-893e-fb5dcdbac88c {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:20:00 user nova-compute[85141]: WARNING nova.compute.manager [req-6b181709-fb3b-4e03-a4ef-c3d7f8872774 req-1b8b87a2-2eb5-4625-873e-aa4af814aab7 service nova] [instance: 4e214bbb-5bbb-4e6f-ac09-9cb1412f068b] Received unexpected event network-vif-unplugged-b0a1b07c-bdba-4ef8-893e-fb5dcdbac88c for instance with vm_state active and task_state rescuing.
Nov 16 10:20:00 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:20:00 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:20:01 user nova-compute[85141]: INFO nova.virt.libvirt.driver [-] [instance: 4e214bbb-5bbb-4e6f-ac09-9cb1412f068b] Instance destroyed successfully.
Nov 16 10:20:01 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-17c0a38f-2717-4f3e-915c-3c71937a7420 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] [instance: 4e214bbb-5bbb-4e6f-ac09-9cb1412f068b] Attempting rescue
Nov 16 10:20:01 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-17c0a38f-2717-4f3e-915c-3c71937a7420 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=85141) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 16 10:20:01 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-17c0a38f-2717-4f3e-915c-3c71937a7420 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] [instance: 4e214bbb-5bbb-4e6f-ac09-9cb1412f068b] Instance directory exists: not creating {{(pid=85141) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 16 10:20:01 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-17c0a38f-2717-4f3e-915c-3c71937a7420 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] [instance: 4e214bbb-5bbb-4e6f-ac09-9cb1412f068b] Creating image(s)
Nov 16 10:20:01 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-17c0a38f-2717-4f3e-915c-3c71937a7420 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Acquiring lock "/opt/stack/data/nova/instances/4e214bbb-5bbb-4e6f-ac09-9cb1412f068b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:20:01 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-17c0a38f-2717-4f3e-915c-3c71937a7420 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Lock "/opt/stack/data/nova/instances/4e214bbb-5bbb-4e6f-ac09-9cb1412f068b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:20:01 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-17c0a38f-2717-4f3e-915c-3c71937a7420 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Lock "/opt/stack/data/nova/instances/4e214bbb-5bbb-4e6f-ac09-9cb1412f068b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:20:01 user nova-compute[85141]: DEBUG nova.objects.instance [None req-17c0a38f-2717-4f3e-915c-3c71937a7420 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Lazy-loading 'trusted_certs' on Instance uuid 4e214bbb-5bbb-4e6f-ac09-9cb1412f068b {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:20:01 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-17c0a38f-2717-4f3e-915c-3c71937a7420 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Acquiring lock "60a78556fb399ed4a41bc3ca4bccf77c96d8e811" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:20:01 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-17c0a38f-2717-4f3e-915c-3c71937a7420 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Lock "60a78556fb399ed4a41bc3ca4bccf77c96d8e811" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:20:01 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-17c0a38f-2717-4f3e-915c-3c71937a7420 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:20:01 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-17c0a38f-2717-4f3e-915c-3c71937a7420 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json" returned: 0 in 0.182s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:20:01 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-17c0a38f-2717-4f3e-915c-3c71937a7420 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811,backing_fmt=raw /opt/stack/data/nova/instances/4e214bbb-5bbb-4e6f-ac09-9cb1412f068b/disk.rescue {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:20:01 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-17c0a38f-2717-4f3e-915c-3c71937a7420 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811,backing_fmt=raw /opt/stack/data/nova/instances/4e214bbb-5bbb-4e6f-ac09-9cb1412f068b/disk.rescue" returned: 0 in 0.063s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:20:01 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-17c0a38f-2717-4f3e-915c-3c71937a7420 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Lock "60a78556fb399ed4a41bc3ca4bccf77c96d8e811" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.253s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:20:01 user nova-compute[85141]: DEBUG nova.objects.instance [None req-17c0a38f-2717-4f3e-915c-3c71937a7420 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Lazy-loading 'migration_context' on Instance uuid 4e214bbb-5bbb-4e6f-ac09-9cb1412f068b {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:20:01 user nova-compute[85141]: DEBUG nova.objects.base [None req-17c0a38f-2717-4f3e-915c-3c71937a7420 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Object Instance<4e214bbb-5bbb-4e6f-ac09-9cb1412f068b> lazy-loaded attributes: trusted_certs,migration_context {{(pid=85141) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 10:20:01 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-17c0a38f-2717-4f3e-915c-3c71937a7420 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] [instance: 4e214bbb-5bbb-4e6f-ac09-9cb1412f068b] Created local disks {{(pid=85141) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 10:20:01 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-17c0a38f-2717-4f3e-915c-3c71937a7420 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] [instance: 4e214bbb-5bbb-4e6f-ac09-9cb1412f068b] Start _get_guest_xml network_info=[{"id": "b0a1b07c-bdba-4ef8-893e-fb5dcdbac88c", "address": "fa:16:3e:b9:03:60", "network": {"id": "5b67a3fd-ef1e-4f2c-b6e0-31766ef39d30", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2137186235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-2137186235-network", "vif_mac": "fa:16:3e:b9:03:60"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09b520de67ac4290a4b779f50afeb1a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0a1b07c-bd", "ovs_interfaceid": "b0a1b07c-bdba-4ef8-893e-fb5dcdbac88c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T10:06:42Z,direct_url=<?>,disk_format='qcow2',id=bc4ca70f-a459-4d5c-a9e6-80f1948eb48b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1044631a5fe84ce8904864a7024049fa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T10:06:44Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'bc4ca70f-a459-4d5c-a9e6-80f1948eb48b', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=85141) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 10:20:01 user nova-compute[85141]: DEBUG nova.objects.instance [None req-17c0a38f-2717-4f3e-915c-3c71937a7420 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Lazy-loading 'resources' on Instance uuid 4e214bbb-5bbb-4e6f-ac09-9cb1412f068b {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:20:01 user nova-compute[85141]: DEBUG nova.objects.base [None req-17c0a38f-2717-4f3e-915c-3c71937a7420 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Object Instance<4e214bbb-5bbb-4e6f-ac09-9cb1412f068b> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=85141) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 10:20:01 user nova-compute[85141]: DEBUG nova.objects.instance [None req-17c0a38f-2717-4f3e-915c-3c71937a7420 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Lazy-loading 'numa_topology' on Instance uuid 4e214bbb-5bbb-4e6f-ac09-9cb1412f068b {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:20:01 user nova-compute[85141]: DEBUG nova.objects.base [None req-17c0a38f-2717-4f3e-915c-3c71937a7420 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Object Instance<4e214bbb-5bbb-4e6f-ac09-9cb1412f068b> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=85141) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 10:20:01 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-17c0a38f-2717-4f3e-915c-3c71937a7420 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:20:01 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-17c0a38f-2717-4f3e-915c-3c71937a7420 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:20:01 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-17c0a38f-2717-4f3e-915c-3c71937a7420 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=85141) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 10:20:01 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-17c0a38f-2717-4f3e-915c-3c71937a7420 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] CPU controller missing on host. {{(pid=85141) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 10:20:01 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-17c0a38f-2717-4f3e-915c-3c71937a7420 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=85141) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 10:20:01 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-17c0a38f-2717-4f3e-915c-3c71937a7420 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] CPU controller found on host. {{(pid=85141) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 10:20:01 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-17c0a38f-2717-4f3e-915c-3c71937a7420 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=85141) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 10:20:01 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-17c0a38f-2717-4f3e-915c-3c71937a7420 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T10:06:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T10:06:42Z,direct_url=<?>,disk_format='qcow2',id=bc4ca70f-a459-4d5c-a9e6-80f1948eb48b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1044631a5fe84ce8904864a7024049fa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T10:06:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 10:20:01 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-17c0a38f-2717-4f3e-915c-3c71937a7420 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Flavor limits 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 10:20:01 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-17c0a38f-2717-4f3e-915c-3c71937a7420 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Image limits 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 10:20:01 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-17c0a38f-2717-4f3e-915c-3c71937a7420 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Flavor pref 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 10:20:01 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-17c0a38f-2717-4f3e-915c-3c71937a7420 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Image pref 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 10:20:01 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-17c0a38f-2717-4f3e-915c-3c71937a7420 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 10:20:01 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-17c0a38f-2717-4f3e-915c-3c71937a7420 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 10:20:01 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-17c0a38f-2717-4f3e-915c-3c71937a7420 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=85141) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 10:20:01 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-17c0a38f-2717-4f3e-915c-3c71937a7420 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Got 1 possible topologies {{(pid=85141) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 10:20:01 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-17c0a38f-2717-4f3e-915c-3c71937a7420 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 10:20:01 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-17c0a38f-2717-4f3e-915c-3c71937a7420 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 10:20:01 user nova-compute[85141]: DEBUG nova.objects.instance [None req-17c0a38f-2717-4f3e-915c-3c71937a7420 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Lazy-loading 'vcpu_model' on Instance uuid 4e214bbb-5bbb-4e6f-ac09-9cb1412f068b {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:20:01 user nova-compute[85141]: DEBUG nova.objects.base [None req-17c0a38f-2717-4f3e-915c-3c71937a7420 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Object Instance<4e214bbb-5bbb-4e6f-ac09-9cb1412f068b> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=85141) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 10:20:01 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-17c0a38f-2717-4f3e-915c-3c71937a7420 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T10:15:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-936954893',display_name='tempest-ServerRescueNegativeTestJSON-server-936954893',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-936954893',id=17,image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-16T10:15:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='09b520de67ac4290a4b779f50afeb1a4',ramdisk_id='',reservation_id='r-xdeh19vp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-2068988845',owner_user_name='tempest-ServerRescueNegativeTestJSON-2068988845-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T10:15:27Z,user_data=None,user_id='76d4eaf5cef745c3bf3ae07068338b1a',uuid=4e214bbb-5bbb-4e6f-ac09-9cb1412f068b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b0a1b07c-bdba-4ef8-893e-fb5dcdbac88c", "address": "fa:16:3e:b9:03:60", "network": {"id": "5b67a3fd-ef1e-4f2c-b6e0-31766ef39d30", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2137186235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-2137186235-network", "vif_mac": "fa:16:3e:b9:03:60"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09b520de67ac4290a4b779f50afeb1a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0a1b07c-bd", "ovs_interfaceid": "b0a1b07c-bdba-4ef8-893e-fb5dcdbac88c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=85141) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 10:20:01 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-17c0a38f-2717-4f3e-915c-3c71937a7420 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Converting VIF {"id": "b0a1b07c-bdba-4ef8-893e-fb5dcdbac88c", "address": "fa:16:3e:b9:03:60", "network": {"id": "5b67a3fd-ef1e-4f2c-b6e0-31766ef39d30", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2137186235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-2137186235-network", "vif_mac": "fa:16:3e:b9:03:60"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09b520de67ac4290a4b779f50afeb1a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0a1b07c-bd", "ovs_interfaceid": "b0a1b07c-bdba-4ef8-893e-fb5dcdbac88c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:20:01 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-17c0a38f-2717-4f3e-915c-3c71937a7420 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b9:03:60,bridge_name='br-int',has_traffic_filtering=True,id=b0a1b07c-bdba-4ef8-893e-fb5dcdbac88c,network=Network(5b67a3fd-ef1e-4f2c-b6e0-31766ef39d30),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0a1b07c-bd') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:20:01 user nova-compute[85141]: DEBUG nova.objects.instance [None req-17c0a38f-2717-4f3e-915c-3c71937a7420 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Lazy-loading 'pci_devices' on Instance uuid 4e214bbb-5bbb-4e6f-ac09-9cb1412f068b {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:20:01 user nova-compute[85141]: DEBUG nova.objects.base [None req-17c0a38f-2717-4f3e-915c-3c71937a7420 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Object Instance<4e214bbb-5bbb-4e6f-ac09-9cb1412f068b> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=85141) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 10:20:01 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-17c0a38f-2717-4f3e-915c-3c71937a7420 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] [instance: 4e214bbb-5bbb-4e6f-ac09-9cb1412f068b] End _get_guest_xml xml=<domain type="kvm">
Nov 16 10:20:01 user nova-compute[85141]:   <uuid>4e214bbb-5bbb-4e6f-ac09-9cb1412f068b</uuid>
Nov 16 10:20:01 user nova-compute[85141]:   <name>instance-00000011</name>
Nov 16 10:20:01 user nova-compute[85141]:   <memory>524288</memory>
Nov 16 10:20:01 user nova-compute[85141]:   <vcpu>1</vcpu>
Nov 16 10:20:01 user nova-compute[85141]:   <metadata>
Nov 16 10:20:01 user nova-compute[85141]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 10:20:01 user nova-compute[85141]:       <nova:package version="0.0.0"/>
Nov 16 10:20:01 user nova-compute[85141]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-936954893</nova:name>
Nov 16 10:20:01 user nova-compute[85141]:       <nova:creationTime>2023-11-16 10:20:01</nova:creationTime>
Nov 16 10:20:01 user nova-compute[85141]:       <nova:flavor name="m1.tiny">
Nov 16 10:20:01 user nova-compute[85141]:         <nova:memory>512</nova:memory>
Nov 16 10:20:01 user nova-compute[85141]:         <nova:disk>1</nova:disk>
Nov 16 10:20:01 user nova-compute[85141]:         <nova:swap>0</nova:swap>
Nov 16 10:20:01 user nova-compute[85141]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 10:20:01 user nova-compute[85141]:         <nova:vcpus>1</nova:vcpus>
Nov 16 10:20:01 user nova-compute[85141]:       </nova:flavor>
Nov 16 10:20:01 user nova-compute[85141]:       <nova:owner>
Nov 16 10:20:01 user nova-compute[85141]:         <nova:user uuid="76d4eaf5cef745c3bf3ae07068338b1a">tempest-ServerRescueNegativeTestJSON-2068988845-project-member</nova:user>
Nov 16 10:20:01 user nova-compute[85141]:         <nova:project uuid="09b520de67ac4290a4b779f50afeb1a4">tempest-ServerRescueNegativeTestJSON-2068988845</nova:project>
Nov 16 10:20:01 user nova-compute[85141]:       </nova:owner>
Nov 16 10:20:01 user nova-compute[85141]:       <nova:root type="image" uuid="bc4ca70f-a459-4d5c-a9e6-80f1948eb48b"/>
Nov 16 10:20:01 user nova-compute[85141]:       <nova:ports>
Nov 16 10:20:01 user nova-compute[85141]:         <nova:port uuid="b0a1b07c-bdba-4ef8-893e-fb5dcdbac88c">
Nov 16 10:20:01 user nova-compute[85141]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 16 10:20:01 user nova-compute[85141]:         </nova:port>
Nov 16 10:20:01 user nova-compute[85141]:       </nova:ports>
Nov 16 10:20:01 user nova-compute[85141]:     </nova:instance>
Nov 16 10:20:01 user nova-compute[85141]:   </metadata>
Nov 16 10:20:01 user nova-compute[85141]:   <sysinfo type="smbios">
Nov 16 10:20:01 user nova-compute[85141]:     <system>
Nov 16 10:20:01 user nova-compute[85141]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 10:20:01 user nova-compute[85141]:       <entry name="product">OpenStack Nova</entry>
Nov 16 10:20:01 user nova-compute[85141]:       <entry name="version">0.0.0</entry>
Nov 16 10:20:01 user nova-compute[85141]:       <entry name="serial">4e214bbb-5bbb-4e6f-ac09-9cb1412f068b</entry>
Nov 16 10:20:01 user nova-compute[85141]:       <entry name="uuid">4e214bbb-5bbb-4e6f-ac09-9cb1412f068b</entry>
Nov 16 10:20:01 user nova-compute[85141]:       <entry name="family">Virtual Machine</entry>
Nov 16 10:20:01 user nova-compute[85141]:     </system>
Nov 16 10:20:01 user nova-compute[85141]:   </sysinfo>
Nov 16 10:20:01 user nova-compute[85141]:   <os>
Nov 16 10:20:01 user nova-compute[85141]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 10:20:01 user nova-compute[85141]:     <smbios mode="sysinfo"/>
Nov 16 10:20:01 user nova-compute[85141]:   </os>
Nov 16 10:20:01 user nova-compute[85141]:   <features>
Nov 16 10:20:01 user nova-compute[85141]:     <acpi/>
Nov 16 10:20:01 user nova-compute[85141]:     <apic/>
Nov 16 10:20:01 user nova-compute[85141]:     <vmcoreinfo/>
Nov 16 10:20:01 user nova-compute[85141]:   </features>
Nov 16 10:20:01 user nova-compute[85141]:   <clock offset="utc">
Nov 16 10:20:01 user nova-compute[85141]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 10:20:01 user nova-compute[85141]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 10:20:01 user nova-compute[85141]:     <timer name="hpet" present="no"/>
Nov 16 10:20:01 user nova-compute[85141]:   </clock>
Nov 16 10:20:01 user nova-compute[85141]:   <cpu mode="custom" match="exact">
Nov 16 10:20:01 user nova-compute[85141]:     <model>Nehalem</model>
Nov 16 10:20:01 user nova-compute[85141]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 10:20:01 user nova-compute[85141]:   </cpu>
Nov 16 10:20:01 user nova-compute[85141]:   <devices>
Nov 16 10:20:01 user nova-compute[85141]:     <disk type="file" device="disk">
Nov 16 10:20:01 user nova-compute[85141]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 10:20:01 user nova-compute[85141]:       <source file="/opt/stack/data/nova/instances/4e214bbb-5bbb-4e6f-ac09-9cb1412f068b/disk.rescue"/>
Nov 16 10:20:01 user nova-compute[85141]:       <target dev="vda" bus="virtio"/>
Nov 16 10:20:01 user nova-compute[85141]:     </disk>
Nov 16 10:20:01 user nova-compute[85141]:     <disk type="file" device="disk">
Nov 16 10:20:01 user nova-compute[85141]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 10:20:01 user nova-compute[85141]:       <source file="/opt/stack/data/nova/instances/4e214bbb-5bbb-4e6f-ac09-9cb1412f068b/disk"/>
Nov 16 10:20:01 user nova-compute[85141]:       <target dev="vdb" bus="virtio"/>
Nov 16 10:20:01 user nova-compute[85141]:     </disk>
Nov 16 10:20:01 user nova-compute[85141]:     <interface type="ethernet">
Nov 16 10:20:01 user nova-compute[85141]:       <mac address="fa:16:3e:b9:03:60"/>
Nov 16 10:20:01 user nova-compute[85141]:       <model type="virtio"/>
Nov 16 10:20:01 user nova-compute[85141]:       <mtu size="1442"/>
Nov 16 10:20:01 user nova-compute[85141]:       <target dev="tapb0a1b07c-bd"/>
Nov 16 10:20:01 user nova-compute[85141]:     </interface>
Nov 16 10:20:01 user nova-compute[85141]:     <serial type="pty">
Nov 16 10:20:01 user nova-compute[85141]:       <log file="/opt/stack/data/nova/instances/4e214bbb-5bbb-4e6f-ac09-9cb1412f068b/console.log" append="off"/>
Nov 16 10:20:01 user nova-compute[85141]:     </serial>
Nov 16 10:20:01 user nova-compute[85141]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 10:20:01 user nova-compute[85141]:     <video>
Nov 16 10:20:01 user nova-compute[85141]:       <model type="virtio"/>
Nov 16 10:20:01 user nova-compute[85141]:     </video>
Nov 16 10:20:01 user nova-compute[85141]:     <rng model="virtio">
Nov 16 10:20:01 user nova-compute[85141]:       <backend model="random">/dev/urandom</backend>
Nov 16 10:20:01 user nova-compute[85141]:     </rng>
Nov 16 10:20:01 user nova-compute[85141]:     <controller type="usb" index="0" model="none"/>
Nov 16 10:20:01 user nova-compute[85141]:     <memballoon model="virtio">
Nov 16 10:20:01 user nova-compute[85141]:       <stats period="10"/>
Nov 16 10:20:01 user nova-compute[85141]:     </memballoon>
Nov 16 10:20:01 user nova-compute[85141]:   </devices>
Nov 16 10:20:01 user nova-compute[85141]: </domain>
Nov 16 10:20:01 user nova-compute[85141]:  {{(pid=85141) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 10:20:01 user nova-compute[85141]: INFO nova.virt.libvirt.driver [-] [instance: 4e214bbb-5bbb-4e6f-ac09-9cb1412f068b] Instance destroyed successfully.
Nov 16 10:20:01 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:20:01 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-17c0a38f-2717-4f3e-915c-3c71937a7420 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] No BDM found with device name vda, not building metadata. {{(pid=85141) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 10:20:01 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-17c0a38f-2717-4f3e-915c-3c71937a7420 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] No BDM found with device name vdb, not building metadata. {{(pid=85141) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 10:20:01 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-17c0a38f-2717-4f3e-915c-3c71937a7420 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] No VIF found with MAC fa:16:3e:b9:03:60, not building metadata {{(pid=85141) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 10:20:02 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:20:02 user nova-compute[85141]: DEBUG nova.compute.manager [req-2afa264f-35f7-49a7-9410-92ba339d10c9 req-df49e512-e112-4bbd-a2ad-3dfeab228fe6 service nova] [instance: 4e214bbb-5bbb-4e6f-ac09-9cb1412f068b] Received event network-vif-plugged-b0a1b07c-bdba-4ef8-893e-fb5dcdbac88c {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:20:02 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-2afa264f-35f7-49a7-9410-92ba339d10c9 req-df49e512-e112-4bbd-a2ad-3dfeab228fe6 service nova] Acquiring lock "4e214bbb-5bbb-4e6f-ac09-9cb1412f068b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:20:02 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-2afa264f-35f7-49a7-9410-92ba339d10c9 req-df49e512-e112-4bbd-a2ad-3dfeab228fe6 service nova] Lock "4e214bbb-5bbb-4e6f-ac09-9cb1412f068b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:20:02 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-2afa264f-35f7-49a7-9410-92ba339d10c9 req-df49e512-e112-4bbd-a2ad-3dfeab228fe6 service nova] Lock "4e214bbb-5bbb-4e6f-ac09-9cb1412f068b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:20:02 user nova-compute[85141]: DEBUG nova.compute.manager [req-2afa264f-35f7-49a7-9410-92ba339d10c9 req-df49e512-e112-4bbd-a2ad-3dfeab228fe6 service nova] [instance: 4e214bbb-5bbb-4e6f-ac09-9cb1412f068b] No waiting events found dispatching network-vif-plugged-b0a1b07c-bdba-4ef8-893e-fb5dcdbac88c {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:20:02 user nova-compute[85141]: WARNING nova.compute.manager [req-2afa264f-35f7-49a7-9410-92ba339d10c9 req-df49e512-e112-4bbd-a2ad-3dfeab228fe6 service nova] [instance: 4e214bbb-5bbb-4e6f-ac09-9cb1412f068b] Received unexpected event network-vif-plugged-b0a1b07c-bdba-4ef8-893e-fb5dcdbac88c for instance with vm_state active and task_state rescuing.
Nov 16 10:20:02 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:20:02 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:20:03 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:20:03 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:20:03 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:20:03 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:20:04 user nova-compute[85141]: DEBUG nova.compute.manager [req-df26e8c7-7c09-4187-9e79-b016424a35b0 req-ad1363cf-4603-43ba-bea6-877b27ed3d3c service nova] [instance: 4e214bbb-5bbb-4e6f-ac09-9cb1412f068b] Received event network-vif-plugged-b0a1b07c-bdba-4ef8-893e-fb5dcdbac88c {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:20:04 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-df26e8c7-7c09-4187-9e79-b016424a35b0 req-ad1363cf-4603-43ba-bea6-877b27ed3d3c service nova] Acquiring lock "4e214bbb-5bbb-4e6f-ac09-9cb1412f068b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:20:04 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-df26e8c7-7c09-4187-9e79-b016424a35b0 req-ad1363cf-4603-43ba-bea6-877b27ed3d3c service nova] Lock "4e214bbb-5bbb-4e6f-ac09-9cb1412f068b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:20:04 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-df26e8c7-7c09-4187-9e79-b016424a35b0 req-ad1363cf-4603-43ba-bea6-877b27ed3d3c service nova] Lock "4e214bbb-5bbb-4e6f-ac09-9cb1412f068b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:20:04 user nova-compute[85141]: DEBUG nova.compute.manager [req-df26e8c7-7c09-4187-9e79-b016424a35b0 req-ad1363cf-4603-43ba-bea6-877b27ed3d3c service nova] [instance: 4e214bbb-5bbb-4e6f-ac09-9cb1412f068b] No waiting events found dispatching network-vif-plugged-b0a1b07c-bdba-4ef8-893e-fb5dcdbac88c {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:20:04 user nova-compute[85141]: WARNING nova.compute.manager [req-df26e8c7-7c09-4187-9e79-b016424a35b0 req-ad1363cf-4603-43ba-bea6-877b27ed3d3c service nova] [instance: 4e214bbb-5bbb-4e6f-ac09-9cb1412f068b] Received unexpected event network-vif-plugged-b0a1b07c-bdba-4ef8-893e-fb5dcdbac88c for instance with vm_state active and task_state rescuing.
Nov 16 10:20:04 user nova-compute[85141]: DEBUG nova.compute.manager [req-df26e8c7-7c09-4187-9e79-b016424a35b0 req-ad1363cf-4603-43ba-bea6-877b27ed3d3c service nova] [instance: 4e214bbb-5bbb-4e6f-ac09-9cb1412f068b] Received event network-vif-plugged-b0a1b07c-bdba-4ef8-893e-fb5dcdbac88c {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:20:04 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-df26e8c7-7c09-4187-9e79-b016424a35b0 req-ad1363cf-4603-43ba-bea6-877b27ed3d3c service nova] Acquiring lock "4e214bbb-5bbb-4e6f-ac09-9cb1412f068b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:20:04 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-df26e8c7-7c09-4187-9e79-b016424a35b0 req-ad1363cf-4603-43ba-bea6-877b27ed3d3c service nova] Lock "4e214bbb-5bbb-4e6f-ac09-9cb1412f068b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:20:04 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-df26e8c7-7c09-4187-9e79-b016424a35b0 req-ad1363cf-4603-43ba-bea6-877b27ed3d3c service nova] Lock "4e214bbb-5bbb-4e6f-ac09-9cb1412f068b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:20:04 user nova-compute[85141]: DEBUG nova.compute.manager [req-df26e8c7-7c09-4187-9e79-b016424a35b0 req-ad1363cf-4603-43ba-bea6-877b27ed3d3c service nova] [instance: 4e214bbb-5bbb-4e6f-ac09-9cb1412f068b] No waiting events found dispatching network-vif-plugged-b0a1b07c-bdba-4ef8-893e-fb5dcdbac88c {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:20:04 user nova-compute[85141]: WARNING nova.compute.manager [req-df26e8c7-7c09-4187-9e79-b016424a35b0 req-ad1363cf-4603-43ba-bea6-877b27ed3d3c service nova] [instance: 4e214bbb-5bbb-4e6f-ac09-9cb1412f068b] Received unexpected event network-vif-plugged-b0a1b07c-bdba-4ef8-893e-fb5dcdbac88c for instance with vm_state active and task_state rescuing.
Nov 16 10:20:05 user nova-compute[85141]: DEBUG nova.compute.manager [None req-17c0a38f-2717-4f3e-915c-3c71937a7420 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] [instance: 4e214bbb-5bbb-4e6f-ac09-9cb1412f068b] Checking state {{(pid=85141) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 10:20:06 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:20:07 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:20:09 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:20:11 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:20:12 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:20:16 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:20:17 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:20:21 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:20:21 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:20:22 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:20:23 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:20:24 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:20:24 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Starting heal instance info cache {{(pid=85141) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 10:20:24 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Acquiring lock "refresh_cache-059d6974-bd0c-4f73-91fc-8202ebda4238" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:20:24 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Acquired lock "refresh_cache-059d6974-bd0c-4f73-91fc-8202ebda4238" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:20:24 user nova-compute[85141]: DEBUG nova.network.neutron [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] [instance: 059d6974-bd0c-4f73-91fc-8202ebda4238] Forcefully refreshing network info cache for instance {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 10:20:24 user nova-compute[85141]: DEBUG nova.network.neutron [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] [instance: 059d6974-bd0c-4f73-91fc-8202ebda4238] Updating instance_info_cache with network_info: [{"id": "89bf502f-593d-4c6e-aa83-a041e0ad7b28", "address": "fa:16:3e:40:09:f4", "network": {"id": "859d1f09-56c4-4c2b-b2c3-02b1938e8dbf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1562516834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "879fa3f4dfc34726b20149b8a7db22dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89bf502f-59", "ovs_interfaceid": "89bf502f-593d-4c6e-aa83-a041e0ad7b28", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:20:24 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Releasing lock "refresh_cache-059d6974-bd0c-4f73-91fc-8202ebda4238" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:20:24 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] [instance: 059d6974-bd0c-4f73-91fc-8202ebda4238] Updated the network info_cache for instance {{(pid=85141) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 10:20:25 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:20:26 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:20:26 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:20:26 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:20:26 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=85141) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 10:20:26 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:20:27 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:20:28 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager.update_available_resource {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:20:28 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:20:28 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:20:28 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:20:28 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Auditing locally available compute resources for user (node: user) {{(pid=85141) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 10:20:28 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:20:28 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:20:28 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:20:28 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:20:28 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=85141) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 10:20:28 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f/disk.rescue --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:20:29 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f/disk.rescue --force-share --output=json" returned: 0 in 0.183s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:20:29 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f/disk.rescue --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:20:29 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f/disk.rescue --force-share --output=json" returned: 0 in 0.193s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:20:29 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d842f90e-663b-4c95-9d7c-d092d2bac41f/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:20:29 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d842f90e-663b-4c95-9d7c-d092d2bac41f/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:20:29 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d842f90e-663b-4c95-9d7c-d092d2bac41f/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:20:29 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d842f90e-663b-4c95-9d7c-d092d2bac41f/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:20:29 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d7787a2-b8da-4d39-9b16-4c7bcb275f85/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:20:29 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d7787a2-b8da-4d39-9b16-4c7bcb275f85/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:20:29 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d7787a2-b8da-4d39-9b16-4c7bcb275f85/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:20:30 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d7787a2-b8da-4d39-9b16-4c7bcb275f85/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:20:30 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=85141) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 10:20:30 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e214bbb-5bbb-4e6f-ac09-9cb1412f068b/disk.rescue --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:20:30 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e214bbb-5bbb-4e6f-ac09-9cb1412f068b/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:20:30 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e214bbb-5bbb-4e6f-ac09-9cb1412f068b/disk.rescue --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:20:30 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e214bbb-5bbb-4e6f-ac09-9cb1412f068b/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:20:30 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e214bbb-5bbb-4e6f-ac09-9cb1412f068b/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:20:30 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e214bbb-5bbb-4e6f-ac09-9cb1412f068b/disk --force-share --output=json" returned: 0 in 0.267s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:20:30 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e214bbb-5bbb-4e6f-ac09-9cb1412f068b/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:20:30 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e214bbb-5bbb-4e6f-ac09-9cb1412f068b/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:20:30 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11986c5b-6914-491e-8e71-983ab6b13c6e/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:20:31 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11986c5b-6914-491e-8e71-983ab6b13c6e/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:20:31 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11986c5b-6914-491e-8e71-983ab6b13c6e/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:20:31 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11986c5b-6914-491e-8e71-983ab6b13c6e/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:20:31 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b24c3954-06ff-4e15-9e43-c65d1dae7a5d/disk.rescue --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:20:31 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b24c3954-06ff-4e15-9e43-c65d1dae7a5d/disk.rescue --force-share --output=json" returned: 0 in 0.187s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:20:31 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b24c3954-06ff-4e15-9e43-c65d1dae7a5d/disk.rescue --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:20:31 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:20:31 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b24c3954-06ff-4e15-9e43-c65d1dae7a5d/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:20:31 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b24c3954-06ff-4e15-9e43-c65d1dae7a5d/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:20:31 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b24c3954-06ff-4e15-9e43-c65d1dae7a5d/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:20:31 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b24c3954-06ff-4e15-9e43-c65d1dae7a5d/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:20:32 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b24c3954-06ff-4e15-9e43-c65d1dae7a5d/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:20:32 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=85141) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 10:20:32 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/059d6974-bd0c-4f73-91fc-8202ebda4238/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:20:32 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/059d6974-bd0c-4f73-91fc-8202ebda4238/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:20:32 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/059d6974-bd0c-4f73-91fc-8202ebda4238/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:20:32 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/059d6974-bd0c-4f73-91fc-8202ebda4238/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:20:32 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:20:32 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:20:32 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:20:32 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:20:32 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:20:32 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=85141) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 10:20:32 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b388b98-4e65-4258-bbe2-77e699321fb7/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:20:33 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b388b98-4e65-4258-bbe2-77e699321fb7/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:20:33 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b388b98-4e65-4258-bbe2-77e699321fb7/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:20:33 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b388b98-4e65-4258-bbe2-77e699321fb7/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:20:33 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=85141) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 10:20:33 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:20:33 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:20:33 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Hypervisor/Node resource view: name=user free_ram=7716MB free_disk=24.925338745117188GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=85141) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 10:20:33 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:20:33 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:20:33 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance d842f90e-663b-4c95-9d7c-d092d2bac41f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:20:33 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance f01dc8cf-1a69-4618-a15d-0c1075157f05 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:20:33 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance 059d6974-bd0c-4f73-91fc-8202ebda4238 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:20:33 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance 4e214bbb-5bbb-4e6f-ac09-9cb1412f068b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:20:33 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance b24c3954-06ff-4e15-9e43-c65d1dae7a5d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:20:33 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:20:33 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance 9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:20:33 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance 2d7787a2-b8da-4d39-9b16-4c7bcb275f85 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:20:33 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance 0b388b98-4e65-4258-bbe2-77e699321fb7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:20:33 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance 11986c5b-6914-491e-8e71-983ab6b13c6e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:20:33 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=85141) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 10:20:33 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=85141) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 10:20:34 user nova-compute[85141]: DEBUG nova.compute.provider_tree [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Inventory has not changed in ProviderTree for provider: bf8e0fa1-16b6-408f-9203-c4cd63916272 {{(pid=85141) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 10:20:34 user nova-compute[85141]: DEBUG nova.scheduler.client.report [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Inventory has not changed for provider bf8e0fa1-16b6-408f-9203-c4cd63916272 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=85141) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 10:20:34 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Compute_service record updated for user:user {{(pid=85141) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 10:20:34 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.572s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:20:36 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:20:36 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:20:36 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:20:37 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:20:41 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:20:46 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:20:46 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:20:48 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:20:51 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:20:52 user nova-compute[85141]: DEBUG nova.compute.manager [None req-4b289f44-25e0-49b7-b37b-16ecee115b7c tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] [instance: 11986c5b-6914-491e-8e71-983ab6b13c6e] Checking state {{(pid=85141) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 10:20:52 user nova-compute[85141]: INFO nova.compute.manager [None req-4b289f44-25e0-49b7-b37b-16ecee115b7c tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] [instance: 11986c5b-6914-491e-8e71-983ab6b13c6e] instance snapshotting
Nov 16 10:20:52 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:20:52 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-4b289f44-25e0-49b7-b37b-16ecee115b7c tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] [instance: 11986c5b-6914-491e-8e71-983ab6b13c6e] Beginning live snapshot process
Nov 16 10:20:52 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-4b289f44-25e0-49b7-b37b-16ecee115b7c tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11986c5b-6914-491e-8e71-983ab6b13c6e/disk --force-share --output=json -f qcow2 {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:20:53 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-4b289f44-25e0-49b7-b37b-16ecee115b7c tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11986c5b-6914-491e-8e71-983ab6b13c6e/disk --force-share --output=json -f qcow2" returned: 0 in 0.171s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:20:53 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-4b289f44-25e0-49b7-b37b-16ecee115b7c tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11986c5b-6914-491e-8e71-983ab6b13c6e/disk --force-share --output=json -f qcow2 {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:20:53 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-4b289f44-25e0-49b7-b37b-16ecee115b7c tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11986c5b-6914-491e-8e71-983ab6b13c6e/disk --force-share --output=json -f qcow2" returned: 0 in 0.187s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:20:53 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-4b289f44-25e0-49b7-b37b-16ecee115b7c tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:20:53 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-4b289f44-25e0-49b7-b37b-16ecee115b7c tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json" returned: 0 in 0.173s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:20:53 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-4b289f44-25e0-49b7-b37b-16ecee115b7c tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmprq14ssvx/195e47e013ad4dfaa642e82bf2bdef4c.delta 1073741824 {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:20:53 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-4b289f44-25e0-49b7-b37b-16ecee115b7c tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmprq14ssvx/195e47e013ad4dfaa642e82bf2bdef4c.delta 1073741824" returned: 0 in 0.049s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:20:53 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-4b289f44-25e0-49b7-b37b-16ecee115b7c tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] [instance: 11986c5b-6914-491e-8e71-983ab6b13c6e] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 16 10:20:53 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:20:54 user nova-compute[85141]: DEBUG nova.virt.libvirt.guest [None req-4b289f44-25e0-49b7-b37b-16ecee115b7c tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=85141) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 10:20:54 user nova-compute[85141]: DEBUG nova.virt.libvirt.guest [None req-4b289f44-25e0-49b7-b37b-16ecee115b7c tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=85141) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 10:20:54 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-4b289f44-25e0-49b7-b37b-16ecee115b7c tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] [instance: 11986c5b-6914-491e-8e71-983ab6b13c6e] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 16 10:20:54 user nova-compute[85141]: DEBUG nova.privsep.utils [None req-4b289f44-25e0-49b7-b37b-16ecee115b7c tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=85141) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 16 10:20:54 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-4b289f44-25e0-49b7-b37b-16ecee115b7c tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmprq14ssvx/195e47e013ad4dfaa642e82bf2bdef4c.delta /opt/stack/data/nova/instances/snapshots/tmprq14ssvx/195e47e013ad4dfaa642e82bf2bdef4c {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:20:55 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-4b289f44-25e0-49b7-b37b-16ecee115b7c tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmprq14ssvx/195e47e013ad4dfaa642e82bf2bdef4c.delta /opt/stack/data/nova/instances/snapshots/tmprq14ssvx/195e47e013ad4dfaa642e82bf2bdef4c" returned: 0 in 0.499s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:20:55 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-4b289f44-25e0-49b7-b37b-16ecee115b7c tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] [instance: 11986c5b-6914-491e-8e71-983ab6b13c6e] Snapshot extracted, beginning image upload
Nov 16 10:20:56 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-bc28f590-b9ff-49bc-8d2e-191ed80a79d5 tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Acquiring lock "b2e7cb0b-61b6-4d23-9b20-f8b437c7884e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:20:56 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-bc28f590-b9ff-49bc-8d2e-191ed80a79d5 tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Lock "b2e7cb0b-61b6-4d23-9b20-f8b437c7884e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:20:56 user nova-compute[85141]: DEBUG nova.compute.manager [None req-bc28f590-b9ff-49bc-8d2e-191ed80a79d5 tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] [instance: b2e7cb0b-61b6-4d23-9b20-f8b437c7884e] Starting instance... {{(pid=85141) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 10:20:56 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-bc28f590-b9ff-49bc-8d2e-191ed80a79d5 tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:20:56 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-bc28f590-b9ff-49bc-8d2e-191ed80a79d5 tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:20:56 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-bc28f590-b9ff-49bc-8d2e-191ed80a79d5 tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=85141) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 10:20:56 user nova-compute[85141]: INFO nova.compute.claims [None req-bc28f590-b9ff-49bc-8d2e-191ed80a79d5 tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] [instance: b2e7cb0b-61b6-4d23-9b20-f8b437c7884e] Claim successful on node user
Nov 16 10:20:56 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:20:56 user nova-compute[85141]: DEBUG nova.compute.provider_tree [None req-bc28f590-b9ff-49bc-8d2e-191ed80a79d5 tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Inventory has not changed in ProviderTree for provider: bf8e0fa1-16b6-408f-9203-c4cd63916272 {{(pid=85141) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 10:20:56 user nova-compute[85141]: DEBUG nova.scheduler.client.report [None req-bc28f590-b9ff-49bc-8d2e-191ed80a79d5 tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Inventory has not changed for provider bf8e0fa1-16b6-408f-9203-c4cd63916272 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=85141) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 10:20:56 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-bc28f590-b9ff-49bc-8d2e-191ed80a79d5 tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.394s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:20:56 user nova-compute[85141]: DEBUG nova.compute.manager [None req-bc28f590-b9ff-49bc-8d2e-191ed80a79d5 tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] [instance: b2e7cb0b-61b6-4d23-9b20-f8b437c7884e] Start building networks asynchronously for instance. {{(pid=85141) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 10:20:56 user nova-compute[85141]: DEBUG nova.compute.manager [None req-bc28f590-b9ff-49bc-8d2e-191ed80a79d5 tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] [instance: b2e7cb0b-61b6-4d23-9b20-f8b437c7884e] Allocating IP information in the background. {{(pid=85141) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 10:20:56 user nova-compute[85141]: DEBUG nova.network.neutron [None req-bc28f590-b9ff-49bc-8d2e-191ed80a79d5 tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] [instance: b2e7cb0b-61b6-4d23-9b20-f8b437c7884e] allocate_for_instance() {{(pid=85141) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 10:20:56 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-bc28f590-b9ff-49bc-8d2e-191ed80a79d5 tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] [instance: b2e7cb0b-61b6-4d23-9b20-f8b437c7884e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 10:20:56 user nova-compute[85141]: DEBUG nova.compute.manager [None req-bc28f590-b9ff-49bc-8d2e-191ed80a79d5 tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] [instance: b2e7cb0b-61b6-4d23-9b20-f8b437c7884e] Start building block device mappings for instance. {{(pid=85141) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 10:20:56 user nova-compute[85141]: DEBUG nova.policy [None req-bc28f590-b9ff-49bc-8d2e-191ed80a79d5 tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'eb874e8c071f4305a1de443f23f5df95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a0984b7ef0346768c3231b9ab00fb57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85141) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 10:20:57 user nova-compute[85141]: DEBUG nova.compute.manager [None req-bc28f590-b9ff-49bc-8d2e-191ed80a79d5 tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] [instance: b2e7cb0b-61b6-4d23-9b20-f8b437c7884e] Start spawning the instance on the hypervisor. {{(pid=85141) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 10:20:57 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-bc28f590-b9ff-49bc-8d2e-191ed80a79d5 tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] [instance: b2e7cb0b-61b6-4d23-9b20-f8b437c7884e] Creating instance directory {{(pid=85141) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 10:20:57 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-bc28f590-b9ff-49bc-8d2e-191ed80a79d5 tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] [instance: b2e7cb0b-61b6-4d23-9b20-f8b437c7884e] Creating image(s)
Nov 16 10:20:57 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-bc28f590-b9ff-49bc-8d2e-191ed80a79d5 tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Acquiring lock "/opt/stack/data/nova/instances/b2e7cb0b-61b6-4d23-9b20-f8b437c7884e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:20:57 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-bc28f590-b9ff-49bc-8d2e-191ed80a79d5 tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Lock "/opt/stack/data/nova/instances/b2e7cb0b-61b6-4d23-9b20-f8b437c7884e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:20:57 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-bc28f590-b9ff-49bc-8d2e-191ed80a79d5 tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Lock "/opt/stack/data/nova/instances/b2e7cb0b-61b6-4d23-9b20-f8b437c7884e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:20:57 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-bc28f590-b9ff-49bc-8d2e-191ed80a79d5 tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:20:57 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-bc28f590-b9ff-49bc-8d2e-191ed80a79d5 tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json" returned: 0 in 0.181s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:20:57 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-bc28f590-b9ff-49bc-8d2e-191ed80a79d5 tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Acquiring lock "60a78556fb399ed4a41bc3ca4bccf77c96d8e811" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:20:57 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-bc28f590-b9ff-49bc-8d2e-191ed80a79d5 tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Lock "60a78556fb399ed4a41bc3ca4bccf77c96d8e811" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:20:57 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-bc28f590-b9ff-49bc-8d2e-191ed80a79d5 tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:20:57 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-bc28f590-b9ff-49bc-8d2e-191ed80a79d5 tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json" returned: 0 in 0.179s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:20:57 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-bc28f590-b9ff-49bc-8d2e-191ed80a79d5 tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811,backing_fmt=raw /opt/stack/data/nova/instances/b2e7cb0b-61b6-4d23-9b20-f8b437c7884e/disk 1073741824 {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:20:57 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-bc28f590-b9ff-49bc-8d2e-191ed80a79d5 tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811,backing_fmt=raw /opt/stack/data/nova/instances/b2e7cb0b-61b6-4d23-9b20-f8b437c7884e/disk 1073741824" returned: 0 in 0.070s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:20:57 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-bc28f590-b9ff-49bc-8d2e-191ed80a79d5 tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Lock "60a78556fb399ed4a41bc3ca4bccf77c96d8e811" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.260s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:20:57 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-bc28f590-b9ff-49bc-8d2e-191ed80a79d5 tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:20:57 user nova-compute[85141]: DEBUG nova.network.neutron [None req-bc28f590-b9ff-49bc-8d2e-191ed80a79d5 tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] [instance: b2e7cb0b-61b6-4d23-9b20-f8b437c7884e] Successfully created port: 3bcbe73a-3c72-4cfe-ab83-141399d14845 {{(pid=85141) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 10:20:57 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-4b289f44-25e0-49b7-b37b-16ecee115b7c tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] [instance: 11986c5b-6914-491e-8e71-983ab6b13c6e] Snapshot image upload complete
Nov 16 10:20:57 user nova-compute[85141]: INFO nova.compute.manager [None req-4b289f44-25e0-49b7-b37b-16ecee115b7c tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] [instance: 11986c5b-6914-491e-8e71-983ab6b13c6e] Took 5.08 seconds to snapshot the instance on the hypervisor.
Nov 16 10:20:57 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:20:57 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-bc28f590-b9ff-49bc-8d2e-191ed80a79d5 tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json" returned: 0 in 0.229s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:20:57 user nova-compute[85141]: DEBUG nova.virt.disk.api [None req-bc28f590-b9ff-49bc-8d2e-191ed80a79d5 tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b2e7cb0b-61b6-4d23-9b20-f8b437c7884e/disk. size=1073741824 {{(pid=85141) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 10:20:57 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-bc28f590-b9ff-49bc-8d2e-191ed80a79d5 tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2e7cb0b-61b6-4d23-9b20-f8b437c7884e/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:20:57 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-bc28f590-b9ff-49bc-8d2e-191ed80a79d5 tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2e7cb0b-61b6-4d23-9b20-f8b437c7884e/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:20:57 user nova-compute[85141]: DEBUG nova.virt.disk.api [None req-bc28f590-b9ff-49bc-8d2e-191ed80a79d5 tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Cannot resize image /opt/stack/data/nova/instances/b2e7cb0b-61b6-4d23-9b20-f8b437c7884e/disk to a smaller size. {{(pid=85141) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 10:20:57 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-bc28f590-b9ff-49bc-8d2e-191ed80a79d5 tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] [instance: b2e7cb0b-61b6-4d23-9b20-f8b437c7884e] Created local disks {{(pid=85141) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 10:20:57 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-bc28f590-b9ff-49bc-8d2e-191ed80a79d5 tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] [instance: b2e7cb0b-61b6-4d23-9b20-f8b437c7884e] Ensure instance console log exists: /opt/stack/data/nova/instances/b2e7cb0b-61b6-4d23-9b20-f8b437c7884e/console.log {{(pid=85141) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 10:20:57 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-bc28f590-b9ff-49bc-8d2e-191ed80a79d5 tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:20:57 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-bc28f590-b9ff-49bc-8d2e-191ed80a79d5 tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:20:57 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-bc28f590-b9ff-49bc-8d2e-191ed80a79d5 tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:20:58 user nova-compute[85141]: DEBUG nova.network.neutron [None req-bc28f590-b9ff-49bc-8d2e-191ed80a79d5 tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] [instance: b2e7cb0b-61b6-4d23-9b20-f8b437c7884e] Successfully updated port: 3bcbe73a-3c72-4cfe-ab83-141399d14845 {{(pid=85141) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 10:20:58 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-bc28f590-b9ff-49bc-8d2e-191ed80a79d5 tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Acquiring lock "refresh_cache-b2e7cb0b-61b6-4d23-9b20-f8b437c7884e" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:20:58 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-bc28f590-b9ff-49bc-8d2e-191ed80a79d5 tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Acquired lock "refresh_cache-b2e7cb0b-61b6-4d23-9b20-f8b437c7884e" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:20:58 user nova-compute[85141]: DEBUG nova.network.neutron [None req-bc28f590-b9ff-49bc-8d2e-191ed80a79d5 tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] [instance: b2e7cb0b-61b6-4d23-9b20-f8b437c7884e] Building network info cache for instance {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 10:20:59 user nova-compute[85141]: DEBUG nova.compute.manager [req-70049db4-e1a5-41c0-ba6b-e0bb158b4e73 req-a5bd2b1c-be78-4815-beca-6979ff8cd18e service nova] [instance: b2e7cb0b-61b6-4d23-9b20-f8b437c7884e] Received event network-changed-3bcbe73a-3c72-4cfe-ab83-141399d14845 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:20:59 user nova-compute[85141]: DEBUG nova.compute.manager [req-70049db4-e1a5-41c0-ba6b-e0bb158b4e73 req-a5bd2b1c-be78-4815-beca-6979ff8cd18e service nova] [instance: b2e7cb0b-61b6-4d23-9b20-f8b437c7884e] Refreshing instance network info cache due to event network-changed-3bcbe73a-3c72-4cfe-ab83-141399d14845. {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 10:20:59 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-70049db4-e1a5-41c0-ba6b-e0bb158b4e73 req-a5bd2b1c-be78-4815-beca-6979ff8cd18e service nova] Acquiring lock "refresh_cache-b2e7cb0b-61b6-4d23-9b20-f8b437c7884e" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:20:59 user nova-compute[85141]: DEBUG nova.network.neutron [None req-bc28f590-b9ff-49bc-8d2e-191ed80a79d5 tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] [instance: b2e7cb0b-61b6-4d23-9b20-f8b437c7884e] Instance cache missing network info. {{(pid=85141) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 10:20:59 user nova-compute[85141]: DEBUG nova.network.neutron [None req-bc28f590-b9ff-49bc-8d2e-191ed80a79d5 tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] [instance: b2e7cb0b-61b6-4d23-9b20-f8b437c7884e] Updating instance_info_cache with network_info: [{"id": "3bcbe73a-3c72-4cfe-ab83-141399d14845", "address": "fa:16:3e:3b:92:0e", "network": {"id": "d791d4f1-ec4b-4db3-ae9a-471f071206eb", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-369109742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a0984b7ef0346768c3231b9ab00fb57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bcbe73a-3c", "ovs_interfaceid": "3bcbe73a-3c72-4cfe-ab83-141399d14845", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:20:59 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-bc28f590-b9ff-49bc-8d2e-191ed80a79d5 tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Releasing lock "refresh_cache-b2e7cb0b-61b6-4d23-9b20-f8b437c7884e" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:20:59 user nova-compute[85141]: DEBUG nova.compute.manager [None req-bc28f590-b9ff-49bc-8d2e-191ed80a79d5 tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] [instance: b2e7cb0b-61b6-4d23-9b20-f8b437c7884e] Instance network_info: |[{"id": "3bcbe73a-3c72-4cfe-ab83-141399d14845", "address": "fa:16:3e:3b:92:0e", "network": {"id": "d791d4f1-ec4b-4db3-ae9a-471f071206eb", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-369109742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a0984b7ef0346768c3231b9ab00fb57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bcbe73a-3c", "ovs_interfaceid": "3bcbe73a-3c72-4cfe-ab83-141399d14845", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=85141) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 10:20:59 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-70049db4-e1a5-41c0-ba6b-e0bb158b4e73 req-a5bd2b1c-be78-4815-beca-6979ff8cd18e service nova] Acquired lock "refresh_cache-b2e7cb0b-61b6-4d23-9b20-f8b437c7884e" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:20:59 user nova-compute[85141]: DEBUG nova.network.neutron [req-70049db4-e1a5-41c0-ba6b-e0bb158b4e73 req-a5bd2b1c-be78-4815-beca-6979ff8cd18e service nova] [instance: b2e7cb0b-61b6-4d23-9b20-f8b437c7884e] Refreshing network info cache for port 3bcbe73a-3c72-4cfe-ab83-141399d14845 {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 10:20:59 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-bc28f590-b9ff-49bc-8d2e-191ed80a79d5 tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] [instance: b2e7cb0b-61b6-4d23-9b20-f8b437c7884e] Start _get_guest_xml network_info=[{"id": "3bcbe73a-3c72-4cfe-ab83-141399d14845", "address": "fa:16:3e:3b:92:0e", "network": {"id": "d791d4f1-ec4b-4db3-ae9a-471f071206eb", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-369109742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a0984b7ef0346768c3231b9ab00fb57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bcbe73a-3c", "ovs_interfaceid": "3bcbe73a-3c72-4cfe-ab83-141399d14845", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T10:06:42Z,direct_url=<?>,disk_format='qcow2',id=bc4ca70f-a459-4d5c-a9e6-80f1948eb48b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1044631a5fe84ce8904864a7024049fa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T10:06:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_options': None, 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'image_id': 'bc4ca70f-a459-4d5c-a9e6-80f1948eb48b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=85141) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 10:20:59 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-bc28f590-b9ff-49bc-8d2e-191ed80a79d5 tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:20:59 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-bc28f590-b9ff-49bc-8d2e-191ed80a79d5 tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:20:59 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-bc28f590-b9ff-49bc-8d2e-191ed80a79d5 tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=85141) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 10:20:59 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-bc28f590-b9ff-49bc-8d2e-191ed80a79d5 tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] CPU controller missing on host. {{(pid=85141) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 10:20:59 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-bc28f590-b9ff-49bc-8d2e-191ed80a79d5 tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=85141) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 10:20:59 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-bc28f590-b9ff-49bc-8d2e-191ed80a79d5 tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] CPU controller found on host. {{(pid=85141) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 10:20:59 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-bc28f590-b9ff-49bc-8d2e-191ed80a79d5 tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=85141) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 10:20:59 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-bc28f590-b9ff-49bc-8d2e-191ed80a79d5 tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T10:06:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T10:06:42Z,direct_url=<?>,disk_format='qcow2',id=bc4ca70f-a459-4d5c-a9e6-80f1948eb48b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1044631a5fe84ce8904864a7024049fa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T10:06:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 10:20:59 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-bc28f590-b9ff-49bc-8d2e-191ed80a79d5 tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Flavor limits 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 10:20:59 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-bc28f590-b9ff-49bc-8d2e-191ed80a79d5 tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Image limits 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 10:20:59 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-bc28f590-b9ff-49bc-8d2e-191ed80a79d5 tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Flavor pref 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 10:20:59 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-bc28f590-b9ff-49bc-8d2e-191ed80a79d5 tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Image pref 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 10:20:59 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-bc28f590-b9ff-49bc-8d2e-191ed80a79d5 tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 10:20:59 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-bc28f590-b9ff-49bc-8d2e-191ed80a79d5 tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 10:20:59 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-bc28f590-b9ff-49bc-8d2e-191ed80a79d5 tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=85141) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 10:20:59 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-bc28f590-b9ff-49bc-8d2e-191ed80a79d5 tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Got 1 possible topologies {{(pid=85141) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 10:20:59 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-bc28f590-b9ff-49bc-8d2e-191ed80a79d5 tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 10:20:59 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-bc28f590-b9ff-49bc-8d2e-191ed80a79d5 tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 10:20:59 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-bc28f590-b9ff-49bc-8d2e-191ed80a79d5 tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T10:20:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1956397478',display_name='tempest-VolumesSnapshotTestJSON-instance-1956397478',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1956397478',id=27,image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIJwgK7S/TnfN9KdqKlCDZxOGWZvg+h9uYyzv3uFXEs786hFNFnbmIGbZUIjQO8hpuLETHuXoPMh7iTV6dYhp4F1npHiYx7ZrMCeT5+mKmp0Vig12TwhLp1GA+Ut5KW9VQ==',key_name='tempest-keypair-2059313003',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6a0984b7ef0346768c3231b9ab00fb57',ramdisk_id='',reservation_id='r-fp7ehq9z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-790088929',owner_user_name='tempest-VolumesSnapshotTestJSON-790088929-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T10:20:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eb874e8c071f4305a1de443f23f5df95',uuid=b2e7cb0b-61b6-4d23-9b20-f8b437c7884e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3bcbe73a-3c72-4cfe-ab83-141399d14845", "address": "fa:16:3e:3b:92:0e", "network": {"id": "d791d4f1-ec4b-4db3-ae9a-471f071206eb", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-369109742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a0984b7ef0346768c3231b9ab00fb57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bcbe73a-3c", "ovs_interfaceid": "3bcbe73a-3c72-4cfe-ab83-141399d14845", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=85141) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 10:20:59 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-bc28f590-b9ff-49bc-8d2e-191ed80a79d5 tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Converting VIF {"id": "3bcbe73a-3c72-4cfe-ab83-141399d14845", "address": "fa:16:3e:3b:92:0e", "network": {"id": "d791d4f1-ec4b-4db3-ae9a-471f071206eb", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-369109742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a0984b7ef0346768c3231b9ab00fb57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bcbe73a-3c", "ovs_interfaceid": "3bcbe73a-3c72-4cfe-ab83-141399d14845", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:20:59 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-bc28f590-b9ff-49bc-8d2e-191ed80a79d5 tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3b:92:0e,bridge_name='br-int',has_traffic_filtering=True,id=3bcbe73a-3c72-4cfe-ab83-141399d14845,network=Network(d791d4f1-ec4b-4db3-ae9a-471f071206eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3bcbe73a-3c') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:20:59 user nova-compute[85141]: DEBUG nova.objects.instance [None req-bc28f590-b9ff-49bc-8d2e-191ed80a79d5 tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Lazy-loading 'pci_devices' on Instance uuid b2e7cb0b-61b6-4d23-9b20-f8b437c7884e {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:20:59 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-bc28f590-b9ff-49bc-8d2e-191ed80a79d5 tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] [instance: b2e7cb0b-61b6-4d23-9b20-f8b437c7884e] End _get_guest_xml xml=<domain type="kvm">
Nov 16 10:20:59 user nova-compute[85141]:   <uuid>b2e7cb0b-61b6-4d23-9b20-f8b437c7884e</uuid>
Nov 16 10:20:59 user nova-compute[85141]:   <name>instance-0000001b</name>
Nov 16 10:20:59 user nova-compute[85141]:   <memory>524288</memory>
Nov 16 10:20:59 user nova-compute[85141]:   <vcpu>1</vcpu>
Nov 16 10:20:59 user nova-compute[85141]:   <metadata>
Nov 16 10:20:59 user nova-compute[85141]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 10:20:59 user nova-compute[85141]:       <nova:package version="0.0.0"/>
Nov 16 10:20:59 user nova-compute[85141]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1956397478</nova:name>
Nov 16 10:20:59 user nova-compute[85141]:       <nova:creationTime>2023-11-16 10:20:59</nova:creationTime>
Nov 16 10:20:59 user nova-compute[85141]:       <nova:flavor name="m1.tiny">
Nov 16 10:20:59 user nova-compute[85141]:         <nova:memory>512</nova:memory>
Nov 16 10:20:59 user nova-compute[85141]:         <nova:disk>1</nova:disk>
Nov 16 10:20:59 user nova-compute[85141]:         <nova:swap>0</nova:swap>
Nov 16 10:20:59 user nova-compute[85141]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 10:20:59 user nova-compute[85141]:         <nova:vcpus>1</nova:vcpus>
Nov 16 10:20:59 user nova-compute[85141]:       </nova:flavor>
Nov 16 10:20:59 user nova-compute[85141]:       <nova:owner>
Nov 16 10:20:59 user nova-compute[85141]:         <nova:user uuid="eb874e8c071f4305a1de443f23f5df95">tempest-VolumesSnapshotTestJSON-790088929-project-member</nova:user>
Nov 16 10:20:59 user nova-compute[85141]:         <nova:project uuid="6a0984b7ef0346768c3231b9ab00fb57">tempest-VolumesSnapshotTestJSON-790088929</nova:project>
Nov 16 10:20:59 user nova-compute[85141]:       </nova:owner>
Nov 16 10:20:59 user nova-compute[85141]:       <nova:root type="image" uuid="bc4ca70f-a459-4d5c-a9e6-80f1948eb48b"/>
Nov 16 10:20:59 user nova-compute[85141]:       <nova:ports>
Nov 16 10:20:59 user nova-compute[85141]:         <nova:port uuid="3bcbe73a-3c72-4cfe-ab83-141399d14845">
Nov 16 10:20:59 user nova-compute[85141]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 16 10:20:59 user nova-compute[85141]:         </nova:port>
Nov 16 10:20:59 user nova-compute[85141]:       </nova:ports>
Nov 16 10:20:59 user nova-compute[85141]:     </nova:instance>
Nov 16 10:20:59 user nova-compute[85141]:   </metadata>
Nov 16 10:20:59 user nova-compute[85141]:   <sysinfo type="smbios">
Nov 16 10:20:59 user nova-compute[85141]:     <system>
Nov 16 10:20:59 user nova-compute[85141]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 10:20:59 user nova-compute[85141]:       <entry name="product">OpenStack Nova</entry>
Nov 16 10:20:59 user nova-compute[85141]:       <entry name="version">0.0.0</entry>
Nov 16 10:20:59 user nova-compute[85141]:       <entry name="serial">b2e7cb0b-61b6-4d23-9b20-f8b437c7884e</entry>
Nov 16 10:20:59 user nova-compute[85141]:       <entry name="uuid">b2e7cb0b-61b6-4d23-9b20-f8b437c7884e</entry>
Nov 16 10:20:59 user nova-compute[85141]:       <entry name="family">Virtual Machine</entry>
Nov 16 10:20:59 user nova-compute[85141]:     </system>
Nov 16 10:20:59 user nova-compute[85141]:   </sysinfo>
Nov 16 10:20:59 user nova-compute[85141]:   <os>
Nov 16 10:20:59 user nova-compute[85141]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 10:20:59 user nova-compute[85141]:     <boot dev="hd"/>
Nov 16 10:20:59 user nova-compute[85141]:     <smbios mode="sysinfo"/>
Nov 16 10:20:59 user nova-compute[85141]:   </os>
Nov 16 10:20:59 user nova-compute[85141]:   <features>
Nov 16 10:20:59 user nova-compute[85141]:     <acpi/>
Nov 16 10:20:59 user nova-compute[85141]:     <apic/>
Nov 16 10:20:59 user nova-compute[85141]:     <vmcoreinfo/>
Nov 16 10:20:59 user nova-compute[85141]:   </features>
Nov 16 10:20:59 user nova-compute[85141]:   <clock offset="utc">
Nov 16 10:20:59 user nova-compute[85141]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 10:20:59 user nova-compute[85141]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 10:20:59 user nova-compute[85141]:     <timer name="hpet" present="no"/>
Nov 16 10:20:59 user nova-compute[85141]:   </clock>
Nov 16 10:20:59 user nova-compute[85141]:   <cpu mode="custom" match="exact">
Nov 16 10:20:59 user nova-compute[85141]:     <model>Nehalem</model>
Nov 16 10:20:59 user nova-compute[85141]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 10:20:59 user nova-compute[85141]:   </cpu>
Nov 16 10:20:59 user nova-compute[85141]:   <devices>
Nov 16 10:20:59 user nova-compute[85141]:     <disk type="file" device="disk">
Nov 16 10:20:59 user nova-compute[85141]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 10:20:59 user nova-compute[85141]:       <source file="/opt/stack/data/nova/instances/b2e7cb0b-61b6-4d23-9b20-f8b437c7884e/disk"/>
Nov 16 10:20:59 user nova-compute[85141]:       <target dev="vda" bus="virtio"/>
Nov 16 10:20:59 user nova-compute[85141]:     </disk>
Nov 16 10:20:59 user nova-compute[85141]:     <interface type="ethernet">
Nov 16 10:20:59 user nova-compute[85141]:       <mac address="fa:16:3e:3b:92:0e"/>
Nov 16 10:20:59 user nova-compute[85141]:       <model type="virtio"/>
Nov 16 10:20:59 user nova-compute[85141]:       <mtu size="1442"/>
Nov 16 10:20:59 user nova-compute[85141]:       <target dev="tap3bcbe73a-3c"/>
Nov 16 10:20:59 user nova-compute[85141]:     </interface>
Nov 16 10:20:59 user nova-compute[85141]:     <serial type="pty">
Nov 16 10:20:59 user nova-compute[85141]:       <log file="/opt/stack/data/nova/instances/b2e7cb0b-61b6-4d23-9b20-f8b437c7884e/console.log" append="off"/>
Nov 16 10:20:59 user nova-compute[85141]:     </serial>
Nov 16 10:20:59 user nova-compute[85141]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 10:20:59 user nova-compute[85141]:     <video>
Nov 16 10:20:59 user nova-compute[85141]:       <model type="virtio"/>
Nov 16 10:20:59 user nova-compute[85141]:     </video>
Nov 16 10:20:59 user nova-compute[85141]:     <rng model="virtio">
Nov 16 10:20:59 user nova-compute[85141]:       <backend model="random">/dev/urandom</backend>
Nov 16 10:20:59 user nova-compute[85141]:     </rng>
Nov 16 10:20:59 user nova-compute[85141]:     <controller type="usb" index="0" model="none"/>
Nov 16 10:20:59 user nova-compute[85141]:     <memballoon model="virtio">
Nov 16 10:20:59 user nova-compute[85141]:       <stats period="10"/>
Nov 16 10:20:59 user nova-compute[85141]:     </memballoon>
Nov 16 10:20:59 user nova-compute[85141]:   </devices>
Nov 16 10:20:59 user nova-compute[85141]: </domain>
Nov 16 10:20:59 user nova-compute[85141]:  {{(pid=85141) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 10:20:59 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-bc28f590-b9ff-49bc-8d2e-191ed80a79d5 tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T10:20:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1956397478',display_name='tempest-VolumesSnapshotTestJSON-instance-1956397478',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1956397478',id=27,image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIJwgK7S/TnfN9KdqKlCDZxOGWZvg+h9uYyzv3uFXEs786hFNFnbmIGbZUIjQO8hpuLETHuXoPMh7iTV6dYhp4F1npHiYx7ZrMCeT5+mKmp0Vig12TwhLp1GA+Ut5KW9VQ==',key_name='tempest-keypair-2059313003',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6a0984b7ef0346768c3231b9ab00fb57',ramdisk_id='',reservation_id='r-fp7ehq9z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-790088929',owner_user_name='tempest-VolumesSnapshotTestJSON-790088929-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T10:20:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eb874e8c071f4305a1de443f23f5df95',uuid=b2e7cb0b-61b6-4d23-9b20-f8b437c7884e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3bcbe73a-3c72-4cfe-ab83-141399d14845", "address": "fa:16:3e:3b:92:0e", "network": {"id": "d791d4f1-ec4b-4db3-ae9a-471f071206eb", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-369109742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a0984b7ef0346768c3231b9ab00fb57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bcbe73a-3c", "ovs_interfaceid": "3bcbe73a-3c72-4cfe-ab83-141399d14845", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 10:20:59 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-bc28f590-b9ff-49bc-8d2e-191ed80a79d5 tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Converting VIF {"id": "3bcbe73a-3c72-4cfe-ab83-141399d14845", "address": "fa:16:3e:3b:92:0e", "network": {"id": "d791d4f1-ec4b-4db3-ae9a-471f071206eb", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-369109742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a0984b7ef0346768c3231b9ab00fb57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bcbe73a-3c", "ovs_interfaceid": "3bcbe73a-3c72-4cfe-ab83-141399d14845", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:20:59 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-bc28f590-b9ff-49bc-8d2e-191ed80a79d5 tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3b:92:0e,bridge_name='br-int',has_traffic_filtering=True,id=3bcbe73a-3c72-4cfe-ab83-141399d14845,network=Network(d791d4f1-ec4b-4db3-ae9a-471f071206eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3bcbe73a-3c') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:20:59 user nova-compute[85141]: DEBUG os_vif [None req-bc28f590-b9ff-49bc-8d2e-191ed80a79d5 tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:92:0e,bridge_name='br-int',has_traffic_filtering=True,id=3bcbe73a-3c72-4cfe-ab83-141399d14845,network=Network(d791d4f1-ec4b-4db3-ae9a-471f071206eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3bcbe73a-3c') {{(pid=85141) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 10:20:59 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:20:59 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:20:59 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 10:20:59 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:20:59 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '93e0ff0d-5939-523c-957d-156a7f21ff29', '_type': 'linux-noop'}}, row=False) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:20:59 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:20:59 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:20:59 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:20:59 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:20:59 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3bcbe73a-3c, may_exist=True, interface_attrs={}) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:20:59 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3bcbe73a-3c, col_values=(('qos', UUID('5b11cfdb-f944-4ad7-b47a-994e28a159f9')),), if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:20:59 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3bcbe73a-3c, col_values=(('external_ids', {'iface-id': '3bcbe73a-3c72-4cfe-ab83-141399d14845', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3b:92:0e', 'vm-uuid': 'b2e7cb0b-61b6-4d23-9b20-f8b437c7884e'}),), if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:20:59 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:20:59 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:20:59 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:20:59 user nova-compute[85141]: INFO os_vif [None req-bc28f590-b9ff-49bc-8d2e-191ed80a79d5 tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:92:0e,bridge_name='br-int',has_traffic_filtering=True,id=3bcbe73a-3c72-4cfe-ab83-141399d14845,network=Network(d791d4f1-ec4b-4db3-ae9a-471f071206eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3bcbe73a-3c')
Nov 16 10:20:59 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-bc28f590-b9ff-49bc-8d2e-191ed80a79d5 tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] No BDM found with device name vda, not building metadata. {{(pid=85141) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 10:20:59 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-bc28f590-b9ff-49bc-8d2e-191ed80a79d5 tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] No VIF found with MAC fa:16:3e:3b:92:0e, not building metadata {{(pid=85141) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 10:20:59 user nova-compute[85141]: DEBUG nova.network.neutron [req-70049db4-e1a5-41c0-ba6b-e0bb158b4e73 req-a5bd2b1c-be78-4815-beca-6979ff8cd18e service nova] [instance: b2e7cb0b-61b6-4d23-9b20-f8b437c7884e] Updated VIF entry in instance network info cache for port 3bcbe73a-3c72-4cfe-ab83-141399d14845. {{(pid=85141) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 10:20:59 user nova-compute[85141]: DEBUG nova.network.neutron [req-70049db4-e1a5-41c0-ba6b-e0bb158b4e73 req-a5bd2b1c-be78-4815-beca-6979ff8cd18e service nova] [instance: b2e7cb0b-61b6-4d23-9b20-f8b437c7884e] Updating instance_info_cache with network_info: [{"id": "3bcbe73a-3c72-4cfe-ab83-141399d14845", "address": "fa:16:3e:3b:92:0e", "network": {"id": "d791d4f1-ec4b-4db3-ae9a-471f071206eb", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-369109742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a0984b7ef0346768c3231b9ab00fb57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bcbe73a-3c", "ovs_interfaceid": "3bcbe73a-3c72-4cfe-ab83-141399d14845", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:20:59 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-70049db4-e1a5-41c0-ba6b-e0bb158b4e73 req-a5bd2b1c-be78-4815-beca-6979ff8cd18e service nova] Releasing lock "refresh_cache-b2e7cb0b-61b6-4d23-9b20-f8b437c7884e" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:21:00 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:21:00 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:21:00 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:21:00 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:21:01 user nova-compute[85141]: DEBUG nova.compute.manager [req-03c7352c-d5b3-4732-b4b6-ab63aab05345 req-991ece33-7e19-4275-9e9e-2e3fc3e6d0cc service nova] [instance: b2e7cb0b-61b6-4d23-9b20-f8b437c7884e] Received event network-vif-plugged-3bcbe73a-3c72-4cfe-ab83-141399d14845 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:21:01 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-03c7352c-d5b3-4732-b4b6-ab63aab05345 req-991ece33-7e19-4275-9e9e-2e3fc3e6d0cc service nova] Acquiring lock "b2e7cb0b-61b6-4d23-9b20-f8b437c7884e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:21:01 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-03c7352c-d5b3-4732-b4b6-ab63aab05345 req-991ece33-7e19-4275-9e9e-2e3fc3e6d0cc service nova] Lock "b2e7cb0b-61b6-4d23-9b20-f8b437c7884e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:21:01 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-03c7352c-d5b3-4732-b4b6-ab63aab05345 req-991ece33-7e19-4275-9e9e-2e3fc3e6d0cc service nova] Lock "b2e7cb0b-61b6-4d23-9b20-f8b437c7884e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:21:01 user nova-compute[85141]: DEBUG nova.compute.manager [req-03c7352c-d5b3-4732-b4b6-ab63aab05345 req-991ece33-7e19-4275-9e9e-2e3fc3e6d0cc service nova] [instance: b2e7cb0b-61b6-4d23-9b20-f8b437c7884e] No waiting events found dispatching network-vif-plugged-3bcbe73a-3c72-4cfe-ab83-141399d14845 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:21:01 user nova-compute[85141]: WARNING nova.compute.manager [req-03c7352c-d5b3-4732-b4b6-ab63aab05345 req-991ece33-7e19-4275-9e9e-2e3fc3e6d0cc service nova] [instance: b2e7cb0b-61b6-4d23-9b20-f8b437c7884e] Received unexpected event network-vif-plugged-3bcbe73a-3c72-4cfe-ab83-141399d14845 for instance with vm_state building and task_state spawning.
Nov 16 10:21:01 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:21:01 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:21:01 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:21:01 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:21:01 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:21:02 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:21:02 user nova-compute[85141]: DEBUG nova.compute.manager [None req-bc28f590-b9ff-49bc-8d2e-191ed80a79d5 tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] [instance: b2e7cb0b-61b6-4d23-9b20-f8b437c7884e] Instance event wait completed in 0 seconds for  {{(pid=85141) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 10:21:02 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-bc28f590-b9ff-49bc-8d2e-191ed80a79d5 tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] [instance: b2e7cb0b-61b6-4d23-9b20-f8b437c7884e] Guest created on hypervisor {{(pid=85141) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 10:21:02 user nova-compute[85141]: INFO nova.virt.libvirt.driver [-] [instance: b2e7cb0b-61b6-4d23-9b20-f8b437c7884e] Instance spawned successfully.
Nov 16 10:21:02 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-bc28f590-b9ff-49bc-8d2e-191ed80a79d5 tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] [instance: b2e7cb0b-61b6-4d23-9b20-f8b437c7884e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 10:21:03 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-bc28f590-b9ff-49bc-8d2e-191ed80a79d5 tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] [instance: b2e7cb0b-61b6-4d23-9b20-f8b437c7884e] Found default for hw_cdrom_bus of ide {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:21:03 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-bc28f590-b9ff-49bc-8d2e-191ed80a79d5 tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] [instance: b2e7cb0b-61b6-4d23-9b20-f8b437c7884e] Found default for hw_disk_bus of virtio {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:21:03 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-bc28f590-b9ff-49bc-8d2e-191ed80a79d5 tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] [instance: b2e7cb0b-61b6-4d23-9b20-f8b437c7884e] Found default for hw_input_bus of None {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:21:03 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-bc28f590-b9ff-49bc-8d2e-191ed80a79d5 tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] [instance: b2e7cb0b-61b6-4d23-9b20-f8b437c7884e] Found default for hw_pointer_model of None {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:21:03 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-bc28f590-b9ff-49bc-8d2e-191ed80a79d5 tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] [instance: b2e7cb0b-61b6-4d23-9b20-f8b437c7884e] Found default for hw_video_model of virtio {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:21:03 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-bc28f590-b9ff-49bc-8d2e-191ed80a79d5 tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] [instance: b2e7cb0b-61b6-4d23-9b20-f8b437c7884e] Found default for hw_vif_model of virtio {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:21:03 user nova-compute[85141]: INFO nova.compute.manager [None req-bc28f590-b9ff-49bc-8d2e-191ed80a79d5 tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] [instance: b2e7cb0b-61b6-4d23-9b20-f8b437c7884e] Took 6.03 seconds to spawn the instance on the hypervisor.
Nov 16 10:21:03 user nova-compute[85141]: DEBUG nova.compute.manager [None req-bc28f590-b9ff-49bc-8d2e-191ed80a79d5 tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] [instance: b2e7cb0b-61b6-4d23-9b20-f8b437c7884e] Checking state {{(pid=85141) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 10:21:03 user nova-compute[85141]: DEBUG nova.compute.manager [req-09b1dd20-3e14-41bf-be73-7242a906b75a req-3ed2fe97-8550-4091-a896-d205fe18a42c service nova] [instance: b2e7cb0b-61b6-4d23-9b20-f8b437c7884e] Received event network-vif-plugged-3bcbe73a-3c72-4cfe-ab83-141399d14845 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:21:03 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-09b1dd20-3e14-41bf-be73-7242a906b75a req-3ed2fe97-8550-4091-a896-d205fe18a42c service nova] Acquiring lock "b2e7cb0b-61b6-4d23-9b20-f8b437c7884e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:21:03 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-09b1dd20-3e14-41bf-be73-7242a906b75a req-3ed2fe97-8550-4091-a896-d205fe18a42c service nova] Lock "b2e7cb0b-61b6-4d23-9b20-f8b437c7884e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:21:03 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-09b1dd20-3e14-41bf-be73-7242a906b75a req-3ed2fe97-8550-4091-a896-d205fe18a42c service nova] Lock "b2e7cb0b-61b6-4d23-9b20-f8b437c7884e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:21:03 user nova-compute[85141]: DEBUG nova.compute.manager [req-09b1dd20-3e14-41bf-be73-7242a906b75a req-3ed2fe97-8550-4091-a896-d205fe18a42c service nova] [instance: b2e7cb0b-61b6-4d23-9b20-f8b437c7884e] No waiting events found dispatching network-vif-plugged-3bcbe73a-3c72-4cfe-ab83-141399d14845 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:21:03 user nova-compute[85141]: WARNING nova.compute.manager [req-09b1dd20-3e14-41bf-be73-7242a906b75a req-3ed2fe97-8550-4091-a896-d205fe18a42c service nova] [instance: b2e7cb0b-61b6-4d23-9b20-f8b437c7884e] Received unexpected event network-vif-plugged-3bcbe73a-3c72-4cfe-ab83-141399d14845 for instance with vm_state building and task_state spawning.
Nov 16 10:21:03 user nova-compute[85141]: INFO nova.compute.manager [None req-bc28f590-b9ff-49bc-8d2e-191ed80a79d5 tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] [instance: b2e7cb0b-61b6-4d23-9b20-f8b437c7884e] Took 6.79 seconds to build instance.
Nov 16 10:21:03 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-bc28f590-b9ff-49bc-8d2e-191ed80a79d5 tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Lock "b2e7cb0b-61b6-4d23-9b20-f8b437c7884e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.884s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:21:04 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:21:07 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:21:09 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:21:14 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:21:17 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:21:19 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:21:22 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:21:23 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:21:24 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:21:25 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:21:25 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Starting heal instance info cache {{(pid=85141) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 10:21:25 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Acquiring lock "refresh_cache-4e214bbb-5bbb-4e6f-ac09-9cb1412f068b" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:21:25 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Acquired lock "refresh_cache-4e214bbb-5bbb-4e6f-ac09-9cb1412f068b" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:21:25 user nova-compute[85141]: DEBUG nova.network.neutron [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] [instance: 4e214bbb-5bbb-4e6f-ac09-9cb1412f068b] Forcefully refreshing network info cache for instance {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 10:21:25 user nova-compute[85141]: DEBUG nova.network.neutron [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] [instance: 4e214bbb-5bbb-4e6f-ac09-9cb1412f068b] Updating instance_info_cache with network_info: [{"id": "b0a1b07c-bdba-4ef8-893e-fb5dcdbac88c", "address": "fa:16:3e:b9:03:60", "network": {"id": "5b67a3fd-ef1e-4f2c-b6e0-31766ef39d30", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2137186235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09b520de67ac4290a4b779f50afeb1a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0a1b07c-bd", "ovs_interfaceid": "b0a1b07c-bdba-4ef8-893e-fb5dcdbac88c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:21:25 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Releasing lock "refresh_cache-4e214bbb-5bbb-4e6f-ac09-9cb1412f068b" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:21:25 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] [instance: 4e214bbb-5bbb-4e6f-ac09-9cb1412f068b] Updated the network info_cache for instance {{(pid=85141) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 10:21:26 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:21:27 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:21:27 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=85141) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 10:21:27 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:21:27 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Cleaning up deleted instances with incomplete migration  {{(pid=85141) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 16 10:21:27 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:21:27 user nova-compute[85141]: INFO nova.compute.manager [None req-8da2efda-b09b-4e9e-941b-9097b751ec06 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] [instance: fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f] Unrescuing
Nov 16 10:21:27 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-8da2efda-b09b-4e9e-941b-9097b751ec06 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] Acquiring lock "refresh_cache-fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:21:27 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-8da2efda-b09b-4e9e-941b-9097b751ec06 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] Acquired lock "refresh_cache-fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:21:27 user nova-compute[85141]: DEBUG nova.network.neutron [None req-8da2efda-b09b-4e9e-941b-9097b751ec06 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] [instance: fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f] Building network info cache for instance {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 10:21:28 user nova-compute[85141]: DEBUG nova.network.neutron [None req-8da2efda-b09b-4e9e-941b-9097b751ec06 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] [instance: fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f] Updating instance_info_cache with network_info: [{"id": "cc62aa76-c6d3-42a2-bf2a-7241919a5fc4", "address": "fa:16:3e:3b:bc:05", "network": {"id": "434cf325-212a-4f85-9779-7791dc1c678f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-248496413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cdf22a86934481196276e29c2cdb48b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc62aa76-c6", "ovs_interfaceid": "cc62aa76-c6d3-42a2-bf2a-7241919a5fc4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:21:28 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-8da2efda-b09b-4e9e-941b-9097b751ec06 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] Releasing lock "refresh_cache-fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:21:28 user nova-compute[85141]: DEBUG nova.objects.instance [None req-8da2efda-b09b-4e9e-941b-9097b751ec06 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] Lazy-loading 'flavor' on Instance uuid fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:21:28 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:21:28 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:21:28 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:21:28 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:21:28 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:21:28 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:21:28 user nova-compute[85141]: DEBUG nova.compute.manager [req-efcb0472-119d-4829-9676-15750fad83c5 req-16d937bd-0057-4281-81f5-dc37d21588d5 service nova] [instance: fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f] Received event network-vif-unplugged-cc62aa76-c6d3-42a2-bf2a-7241919a5fc4 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:21:28 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-efcb0472-119d-4829-9676-15750fad83c5 req-16d937bd-0057-4281-81f5-dc37d21588d5 service nova] Acquiring lock "fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:21:28 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-efcb0472-119d-4829-9676-15750fad83c5 req-16d937bd-0057-4281-81f5-dc37d21588d5 service nova] Lock "fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:21:28 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-efcb0472-119d-4829-9676-15750fad83c5 req-16d937bd-0057-4281-81f5-dc37d21588d5 service nova] Lock "fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:21:28 user nova-compute[85141]: DEBUG nova.compute.manager [req-efcb0472-119d-4829-9676-15750fad83c5 req-16d937bd-0057-4281-81f5-dc37d21588d5 service nova] [instance: fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f] No waiting events found dispatching network-vif-unplugged-cc62aa76-c6d3-42a2-bf2a-7241919a5fc4 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:21:28 user nova-compute[85141]: WARNING nova.compute.manager [req-efcb0472-119d-4829-9676-15750fad83c5 req-16d937bd-0057-4281-81f5-dc37d21588d5 service nova] [instance: fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f] Received unexpected event network-vif-unplugged-cc62aa76-c6d3-42a2-bf2a-7241919a5fc4 for instance with vm_state rescued and task_state unrescuing.
Nov 16 10:21:29 user nova-compute[85141]: INFO nova.virt.libvirt.driver [-] [instance: fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f] Instance destroyed successfully.
Nov 16 10:21:29 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager.update_available_resource {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:21:29 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:21:29 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:21:29 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:21:29 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Auditing locally available compute resources for user (node: user) {{(pid=85141) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 10:21:29 user nova-compute[85141]: DEBUG nova.compute.manager [req-9d890a99-cece-4f8d-9c33-a327a4c7cbce req-5ace7bec-da94-4122-ba5e-5aaaa69b0569 service nova] [instance: fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f] Received event network-changed-cc62aa76-c6d3-42a2-bf2a-7241919a5fc4 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:21:29 user nova-compute[85141]: DEBUG nova.compute.manager [req-9d890a99-cece-4f8d-9c33-a327a4c7cbce req-5ace7bec-da94-4122-ba5e-5aaaa69b0569 service nova] [instance: fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f] Refreshing instance network info cache due to event network-changed-cc62aa76-c6d3-42a2-bf2a-7241919a5fc4. {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 10:21:29 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-9d890a99-cece-4f8d-9c33-a327a4c7cbce req-5ace7bec-da94-4122-ba5e-5aaaa69b0569 service nova] Acquiring lock "refresh_cache-fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:21:29 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-9d890a99-cece-4f8d-9c33-a327a4c7cbce req-5ace7bec-da94-4122-ba5e-5aaaa69b0569 service nova] Acquired lock "refresh_cache-fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:21:29 user nova-compute[85141]: DEBUG nova.network.neutron [req-9d890a99-cece-4f8d-9c33-a327a4c7cbce req-5ace7bec-da94-4122-ba5e-5aaaa69b0569 service nova] [instance: fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f] Refreshing network info cache for port cc62aa76-c6d3-42a2-bf2a-7241919a5fc4 {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 10:21:29 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:21:29 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-de9d0f76-e9eb-4864-aa68-4fdcadf98693 tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] Acquiring lock "e88874fe-b0a6-4292-8832-023f95e4f53c" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:21:29 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-de9d0f76-e9eb-4864-aa68-4fdcadf98693 tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] Lock "e88874fe-b0a6-4292-8832-023f95e4f53c" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:21:29 user nova-compute[85141]: INFO nova.compute.manager [None req-de9d0f76-e9eb-4864-aa68-4fdcadf98693 tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] [instance: e88874fe-b0a6-4292-8832-023f95e4f53c] Unshelving
Nov 16 10:21:29 user nova-compute[85141]: INFO nova.virt.block_device [None req-de9d0f76-e9eb-4864-aa68-4fdcadf98693 tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] [instance: e88874fe-b0a6-4292-8832-023f95e4f53c] Booting with volume 674f9ae8-6ab5-4ff2-b715-fe8807c34793 at /dev/vda
Nov 16 10:21:29 user nova-compute[85141]: DEBUG nova.network.neutron [req-9d890a99-cece-4f8d-9c33-a327a4c7cbce req-5ace7bec-da94-4122-ba5e-5aaaa69b0569 service nova] [instance: fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f] Updated VIF entry in instance network info cache for port cc62aa76-c6d3-42a2-bf2a-7241919a5fc4. {{(pid=85141) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 10:21:29 user nova-compute[85141]: DEBUG nova.network.neutron [req-9d890a99-cece-4f8d-9c33-a327a4c7cbce req-5ace7bec-da94-4122-ba5e-5aaaa69b0569 service nova] [instance: fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f] Updating instance_info_cache with network_info: [{"id": "cc62aa76-c6d3-42a2-bf2a-7241919a5fc4", "address": "fa:16:3e:3b:bc:05", "network": {"id": "434cf325-212a-4f85-9779-7791dc1c678f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-248496413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cdf22a86934481196276e29c2cdb48b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc62aa76-c6", "ovs_interfaceid": "cc62aa76-c6d3-42a2-bf2a-7241919a5fc4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:21:29 user nova-compute[85141]: DEBUG os_brick.utils [None req-de9d0f76-e9eb-4864-aa68-4fdcadf98693 tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 10:21:29 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-9d890a99-cece-4f8d-9c33-a327a4c7cbce req-5ace7bec-da94-4122-ba5e-5aaaa69b0569 service nova] Releasing lock "refresh_cache-fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:21:29 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:21:29 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:21:29 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3d303fc-cccd-4a40-9659-0f87875c1fd1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c7834de5c295\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:21:29 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:21:29 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:21:29 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[16ef43a1-7c01-4ceb-8864-d0f56ea5897d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:21:29 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:21:29 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:21:29 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[cba6fd55-3be1-412f-94e5-fd8e6e7c124e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:21:29 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ba2d3ce-c228-4c8d-a931-ca49b9fc866f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:21:29 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-de9d0f76-e9eb-4864-aa68-4fdcadf98693 tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] Running cmd (subprocess): nvme version {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:21:29 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-de9d0f76-e9eb-4864-aa68-4fdcadf98693 tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] 'nvme version' failed. Not Retrying. {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 10:21:29 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.nvmeof [None req-de9d0f76-e9eb-4864-aa68-4fdcadf98693 tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] nvme not present on system {{(pid=85141) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 10:21:29 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:21:29 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 10:21:29 user nova-compute[85141]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 10:21:29 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[77402eb8-6c2f-4761-a0b3-2e63314ee959]: (4, '') {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:21:29 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.lightos [None req-de9d0f76-e9eb-4864-aa68-4fdcadf98693 tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=85141) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 10:21:29 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.lightos [None req-de9d0f76-e9eb-4864-aa68-4fdcadf98693 tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=85141) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 10:21:29 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.lightos [None req-de9d0f76-e9eb-4864-aa68-4fdcadf98693 tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] LIGHTOS: no hostnqn found. {{(pid=85141) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 10:21:29 user nova-compute[85141]: DEBUG os_brick.utils [None req-de9d0f76-e9eb-4864-aa68-4fdcadf98693 tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c7834de5c295', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 10:21:29 user nova-compute[85141]: DEBUG nova.virt.block_device [None req-de9d0f76-e9eb-4864-aa68-4fdcadf98693 tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] [instance: e88874fe-b0a6-4292-8832-023f95e4f53c] Updating existing volume attachment record: f75fe213-a491-446f-ab4b-c6c48e986b5c {{(pid=85141) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 10:21:30 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:21:30 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:21:30 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:21:30 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:21:30 user nova-compute[85141]: DEBUG nova.compute.manager [req-c5081639-4947-40c6-a05c-8c451e13ecb1 req-a16f6ee9-689b-4de3-b342-800d8522b7d2 service nova] [instance: fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f] Received event network-vif-plugged-cc62aa76-c6d3-42a2-bf2a-7241919a5fc4 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:21:30 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-c5081639-4947-40c6-a05c-8c451e13ecb1 req-a16f6ee9-689b-4de3-b342-800d8522b7d2 service nova] Acquiring lock "fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:21:30 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-c5081639-4947-40c6-a05c-8c451e13ecb1 req-a16f6ee9-689b-4de3-b342-800d8522b7d2 service nova] Lock "fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:21:30 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-c5081639-4947-40c6-a05c-8c451e13ecb1 req-a16f6ee9-689b-4de3-b342-800d8522b7d2 service nova] Lock "fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:21:30 user nova-compute[85141]: DEBUG nova.compute.manager [req-c5081639-4947-40c6-a05c-8c451e13ecb1 req-a16f6ee9-689b-4de3-b342-800d8522b7d2 service nova] [instance: fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f] No waiting events found dispatching network-vif-plugged-cc62aa76-c6d3-42a2-bf2a-7241919a5fc4 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:21:30 user nova-compute[85141]: WARNING nova.compute.manager [req-c5081639-4947-40c6-a05c-8c451e13ecb1 req-a16f6ee9-689b-4de3-b342-800d8522b7d2 service nova] [instance: fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f] Received unexpected event network-vif-plugged-cc62aa76-c6d3-42a2-bf2a-7241919a5fc4 for instance with vm_state rescued and task_state unrescuing.
Nov 16 10:21:30 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:21:31 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:21:31 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:21:31 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:21:31 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:21:31 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:21:31 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:21:31 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:21:31 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=85141) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 10:21:31 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d842f90e-663b-4c95-9d7c-d092d2bac41f/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:21:31 user nova-compute[85141]: DEBUG nova.compute.manager [req-46498da1-598d-41bc-991b-215f7e926857 req-df12cb6b-d455-453a-a6e5-3ebbb79ce3fc service nova] [instance: fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f] Received event network-changed-cc62aa76-c6d3-42a2-bf2a-7241919a5fc4 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:21:31 user nova-compute[85141]: DEBUG nova.compute.manager [req-46498da1-598d-41bc-991b-215f7e926857 req-df12cb6b-d455-453a-a6e5-3ebbb79ce3fc service nova] [instance: fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f] Refreshing instance network info cache due to event network-changed-cc62aa76-c6d3-42a2-bf2a-7241919a5fc4. {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 10:21:31 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-46498da1-598d-41bc-991b-215f7e926857 req-df12cb6b-d455-453a-a6e5-3ebbb79ce3fc service nova] Acquiring lock "refresh_cache-fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:21:31 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-46498da1-598d-41bc-991b-215f7e926857 req-df12cb6b-d455-453a-a6e5-3ebbb79ce3fc service nova] Acquired lock "refresh_cache-fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:21:31 user nova-compute[85141]: DEBUG nova.network.neutron [req-46498da1-598d-41bc-991b-215f7e926857 req-df12cb6b-d455-453a-a6e5-3ebbb79ce3fc service nova] [instance: fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f] Refreshing network info cache for port cc62aa76-c6d3-42a2-bf2a-7241919a5fc4 {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 10:21:31 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d842f90e-663b-4c95-9d7c-d092d2bac41f/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:21:31 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d842f90e-663b-4c95-9d7c-d092d2bac41f/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:21:31 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d842f90e-663b-4c95-9d7c-d092d2bac41f/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:21:31 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d7787a2-b8da-4d39-9b16-4c7bcb275f85/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:21:31 user nova-compute[85141]: DEBUG nova.network.neutron [req-46498da1-598d-41bc-991b-215f7e926857 req-df12cb6b-d455-453a-a6e5-3ebbb79ce3fc service nova] [instance: fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f] Updated VIF entry in instance network info cache for port cc62aa76-c6d3-42a2-bf2a-7241919a5fc4. {{(pid=85141) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 10:21:31 user nova-compute[85141]: DEBUG nova.network.neutron [req-46498da1-598d-41bc-991b-215f7e926857 req-df12cb6b-d455-453a-a6e5-3ebbb79ce3fc service nova] [instance: fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f] Updating instance_info_cache with network_info: [{"id": "cc62aa76-c6d3-42a2-bf2a-7241919a5fc4", "address": "fa:16:3e:3b:bc:05", "network": {"id": "434cf325-212a-4f85-9779-7791dc1c678f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-248496413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cdf22a86934481196276e29c2cdb48b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc62aa76-c6", "ovs_interfaceid": "cc62aa76-c6d3-42a2-bf2a-7241919a5fc4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:21:31 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d7787a2-b8da-4d39-9b16-4c7bcb275f85/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:21:31 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d7787a2-b8da-4d39-9b16-4c7bcb275f85/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:21:31 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-46498da1-598d-41bc-991b-215f7e926857 req-df12cb6b-d455-453a-a6e5-3ebbb79ce3fc service nova] Releasing lock "refresh_cache-fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:21:32 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d7787a2-b8da-4d39-9b16-4c7bcb275f85/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:21:32 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=85141) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 10:21:32 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e214bbb-5bbb-4e6f-ac09-9cb1412f068b/disk.rescue --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:21:32 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e214bbb-5bbb-4e6f-ac09-9cb1412f068b/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:21:32 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e214bbb-5bbb-4e6f-ac09-9cb1412f068b/disk.rescue --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:21:32 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e214bbb-5bbb-4e6f-ac09-9cb1412f068b/disk.rescue --force-share --output=json" returned: 0 in 0.263s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:21:32 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e214bbb-5bbb-4e6f-ac09-9cb1412f068b/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:21:32 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:21:32 user nova-compute[85141]: DEBUG nova.compute.manager [req-c9ef6454-f32a-4094-8e6b-f4ed25bf1280 req-2f788344-3898-4083-8376-2b249c869a1c service nova] [instance: fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f] Received event network-vif-plugged-cc62aa76-c6d3-42a2-bf2a-7241919a5fc4 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:21:32 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-c9ef6454-f32a-4094-8e6b-f4ed25bf1280 req-2f788344-3898-4083-8376-2b249c869a1c service nova] Acquiring lock "fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:21:32 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-c9ef6454-f32a-4094-8e6b-f4ed25bf1280 req-2f788344-3898-4083-8376-2b249c869a1c service nova] Lock "fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:21:32 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-c9ef6454-f32a-4094-8e6b-f4ed25bf1280 req-2f788344-3898-4083-8376-2b249c869a1c service nova] Lock "fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:21:32 user nova-compute[85141]: DEBUG nova.compute.manager [req-c9ef6454-f32a-4094-8e6b-f4ed25bf1280 req-2f788344-3898-4083-8376-2b249c869a1c service nova] [instance: fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f] No waiting events found dispatching network-vif-plugged-cc62aa76-c6d3-42a2-bf2a-7241919a5fc4 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:21:32 user nova-compute[85141]: WARNING nova.compute.manager [req-c9ef6454-f32a-4094-8e6b-f4ed25bf1280 req-2f788344-3898-4083-8376-2b249c869a1c service nova] [instance: fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f] Received unexpected event network-vif-plugged-cc62aa76-c6d3-42a2-bf2a-7241919a5fc4 for instance with vm_state rescued and task_state unrescuing.
Nov 16 10:21:32 user nova-compute[85141]: DEBUG nova.compute.manager [req-c9ef6454-f32a-4094-8e6b-f4ed25bf1280 req-2f788344-3898-4083-8376-2b249c869a1c service nova] [instance: fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f] Received event network-vif-plugged-cc62aa76-c6d3-42a2-bf2a-7241919a5fc4 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:21:32 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-c9ef6454-f32a-4094-8e6b-f4ed25bf1280 req-2f788344-3898-4083-8376-2b249c869a1c service nova] Acquiring lock "fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:21:32 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-c9ef6454-f32a-4094-8e6b-f4ed25bf1280 req-2f788344-3898-4083-8376-2b249c869a1c service nova] Lock "fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:21:32 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-c9ef6454-f32a-4094-8e6b-f4ed25bf1280 req-2f788344-3898-4083-8376-2b249c869a1c service nova] Lock "fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:21:32 user nova-compute[85141]: DEBUG nova.compute.manager [req-c9ef6454-f32a-4094-8e6b-f4ed25bf1280 req-2f788344-3898-4083-8376-2b249c869a1c service nova] [instance: fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f] No waiting events found dispatching network-vif-plugged-cc62aa76-c6d3-42a2-bf2a-7241919a5fc4 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:21:32 user nova-compute[85141]: WARNING nova.compute.manager [req-c9ef6454-f32a-4094-8e6b-f4ed25bf1280 req-2f788344-3898-4083-8376-2b249c869a1c service nova] [instance: fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f] Received unexpected event network-vif-plugged-cc62aa76-c6d3-42a2-bf2a-7241919a5fc4 for instance with vm_state rescued and task_state unrescuing.
Nov 16 10:21:32 user nova-compute[85141]: DEBUG nova.compute.manager [None req-8da2efda-b09b-4e9e-941b-9097b751ec06 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] [instance: fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f] Checking state {{(pid=85141) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 10:21:32 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e214bbb-5bbb-4e6f-ac09-9cb1412f068b/disk --force-share --output=json" returned: 0 in 0.270s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:21:32 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e214bbb-5bbb-4e6f-ac09-9cb1412f068b/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:21:33 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e214bbb-5bbb-4e6f-ac09-9cb1412f068b/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:21:33 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11986c5b-6914-491e-8e71-983ab6b13c6e/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:21:33 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11986c5b-6914-491e-8e71-983ab6b13c6e/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:21:33 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11986c5b-6914-491e-8e71-983ab6b13c6e/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:21:33 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11986c5b-6914-491e-8e71-983ab6b13c6e/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:21:33 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2e7cb0b-61b6-4d23-9b20-f8b437c7884e/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:21:33 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2e7cb0b-61b6-4d23-9b20-f8b437c7884e/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:21:33 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2e7cb0b-61b6-4d23-9b20-f8b437c7884e/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:21:33 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2e7cb0b-61b6-4d23-9b20-f8b437c7884e/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:21:33 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b24c3954-06ff-4e15-9e43-c65d1dae7a5d/disk.rescue --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:21:34 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b24c3954-06ff-4e15-9e43-c65d1dae7a5d/disk.rescue --force-share --output=json" returned: 0 in 0.233s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:21:34 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b24c3954-06ff-4e15-9e43-c65d1dae7a5d/disk.rescue --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:21:34 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:21:34 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b24c3954-06ff-4e15-9e43-c65d1dae7a5d/disk.rescue --force-share --output=json" returned: 0 in 0.219s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:21:34 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b24c3954-06ff-4e15-9e43-c65d1dae7a5d/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:21:34 user nova-compute[85141]: DEBUG nova.compute.manager [req-03170ee3-43c9-4cd5-8046-22f09c7a39de req-470be4b7-ddb9-49bb-b20c-ebf6bacd5d0b service nova] [instance: 2d7787a2-b8da-4d39-9b16-4c7bcb275f85] Received event network-changed-3f553883-eaa0-4a7e-8e31-1170241a0236 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:21:34 user nova-compute[85141]: DEBUG nova.compute.manager [req-03170ee3-43c9-4cd5-8046-22f09c7a39de req-470be4b7-ddb9-49bb-b20c-ebf6bacd5d0b service nova] [instance: 2d7787a2-b8da-4d39-9b16-4c7bcb275f85] Refreshing instance network info cache due to event network-changed-3f553883-eaa0-4a7e-8e31-1170241a0236. {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 10:21:34 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-03170ee3-43c9-4cd5-8046-22f09c7a39de req-470be4b7-ddb9-49bb-b20c-ebf6bacd5d0b service nova] Acquiring lock "refresh_cache-2d7787a2-b8da-4d39-9b16-4c7bcb275f85" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:21:34 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-03170ee3-43c9-4cd5-8046-22f09c7a39de req-470be4b7-ddb9-49bb-b20c-ebf6bacd5d0b service nova] Acquired lock "refresh_cache-2d7787a2-b8da-4d39-9b16-4c7bcb275f85" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:21:34 user nova-compute[85141]: DEBUG nova.network.neutron [req-03170ee3-43c9-4cd5-8046-22f09c7a39de req-470be4b7-ddb9-49bb-b20c-ebf6bacd5d0b service nova] [instance: 2d7787a2-b8da-4d39-9b16-4c7bcb275f85] Refreshing network info cache for port 3f553883-eaa0-4a7e-8e31-1170241a0236 {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 10:21:34 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:21:34 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b24c3954-06ff-4e15-9e43-c65d1dae7a5d/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:21:34 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b24c3954-06ff-4e15-9e43-c65d1dae7a5d/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:21:34 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b24c3954-06ff-4e15-9e43-c65d1dae7a5d/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:21:34 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=85141) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 10:21:34 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/059d6974-bd0c-4f73-91fc-8202ebda4238/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:21:34 user nova-compute[85141]: DEBUG nova.network.neutron [req-03170ee3-43c9-4cd5-8046-22f09c7a39de req-470be4b7-ddb9-49bb-b20c-ebf6bacd5d0b service nova] [instance: 2d7787a2-b8da-4d39-9b16-4c7bcb275f85] Updated VIF entry in instance network info cache for port 3f553883-eaa0-4a7e-8e31-1170241a0236. {{(pid=85141) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 10:21:34 user nova-compute[85141]: DEBUG nova.network.neutron [req-03170ee3-43c9-4cd5-8046-22f09c7a39de req-470be4b7-ddb9-49bb-b20c-ebf6bacd5d0b service nova] [instance: 2d7787a2-b8da-4d39-9b16-4c7bcb275f85] Updating instance_info_cache with network_info: [{"id": "3f553883-eaa0-4a7e-8e31-1170241a0236", "address": "fa:16:3e:1c:29:6f", "network": {"id": "436477fd-9294-4297-bfb3-405564823fa0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1068749207-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4e4f57f79564d2fbcb8080bf8f1c5c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f553883-ea", "ovs_interfaceid": "3f553883-eaa0-4a7e-8e31-1170241a0236", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:21:34 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-03170ee3-43c9-4cd5-8046-22f09c7a39de req-470be4b7-ddb9-49bb-b20c-ebf6bacd5d0b service nova] Releasing lock "refresh_cache-2d7787a2-b8da-4d39-9b16-4c7bcb275f85" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:21:34 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/059d6974-bd0c-4f73-91fc-8202ebda4238/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:21:34 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/059d6974-bd0c-4f73-91fc-8202ebda4238/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:21:35 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/059d6974-bd0c-4f73-91fc-8202ebda4238/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:21:35 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:21:35 user nova-compute[85141]: DEBUG nova.compute.manager [req-8662986d-50d2-4941-aa4c-75aec8aa534c req-51b93088-8614-4555-8527-996ad22a7349 service nova] [instance: 2d7787a2-b8da-4d39-9b16-4c7bcb275f85] Received event network-changed-3f553883-eaa0-4a7e-8e31-1170241a0236 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:21:35 user nova-compute[85141]: DEBUG nova.compute.manager [req-8662986d-50d2-4941-aa4c-75aec8aa534c req-51b93088-8614-4555-8527-996ad22a7349 service nova] [instance: 2d7787a2-b8da-4d39-9b16-4c7bcb275f85] Refreshing instance network info cache due to event network-changed-3f553883-eaa0-4a7e-8e31-1170241a0236. {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 10:21:35 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-8662986d-50d2-4941-aa4c-75aec8aa534c req-51b93088-8614-4555-8527-996ad22a7349 service nova] Acquiring lock "refresh_cache-2d7787a2-b8da-4d39-9b16-4c7bcb275f85" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:21:35 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-8662986d-50d2-4941-aa4c-75aec8aa534c req-51b93088-8614-4555-8527-996ad22a7349 service nova] Acquired lock "refresh_cache-2d7787a2-b8da-4d39-9b16-4c7bcb275f85" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:21:35 user nova-compute[85141]: DEBUG nova.network.neutron [req-8662986d-50d2-4941-aa4c-75aec8aa534c req-51b93088-8614-4555-8527-996ad22a7349 service nova] [instance: 2d7787a2-b8da-4d39-9b16-4c7bcb275f85] Refreshing network info cache for port 3f553883-eaa0-4a7e-8e31-1170241a0236 {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 10:21:35 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:21:35 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:21:35 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-082dec01-b40d-435a-93a1-ced45489fc10 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Acquiring lock "2d7787a2-b8da-4d39-9b16-4c7bcb275f85" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:21:35 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-082dec01-b40d-435a-93a1-ced45489fc10 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Lock "2d7787a2-b8da-4d39-9b16-4c7bcb275f85" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:21:35 user nova-compute[85141]: INFO nova.compute.manager [None req-082dec01-b40d-435a-93a1-ced45489fc10 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] [instance: 2d7787a2-b8da-4d39-9b16-4c7bcb275f85] Detaching volume 7dc504e0-da46-4c57-a66d-8ae6ce9c733c
Nov 16 10:21:35 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:21:35 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=85141) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 10:21:35 user nova-compute[85141]: INFO nova.virt.block_device [None req-082dec01-b40d-435a-93a1-ced45489fc10 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] [instance: 2d7787a2-b8da-4d39-9b16-4c7bcb275f85] Attempting to driver detach volume 7dc504e0-da46-4c57-a66d-8ae6ce9c733c from mountpoint /dev/vdb
Nov 16 10:21:35 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b388b98-4e65-4258-bbe2-77e699321fb7/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:21:35 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-082dec01-b40d-435a-93a1-ced45489fc10 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Attempting to detach device vdb from instance 2d7787a2-b8da-4d39-9b16-4c7bcb275f85 from the persistent domain config. {{(pid=85141) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 10:21:35 user nova-compute[85141]: DEBUG nova.virt.libvirt.guest [None req-082dec01-b40d-435a-93a1-ced45489fc10 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 10:21:35 user nova-compute[85141]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 10:21:35 user nova-compute[85141]:   <source dev="/dev/sdb"/>
Nov 16 10:21:35 user nova-compute[85141]:   <target dev="vdb" bus="virtio"/>
Nov 16 10:21:35 user nova-compute[85141]:   <serial>7dc504e0-da46-4c57-a66d-8ae6ce9c733c</serial>
Nov 16 10:21:35 user nova-compute[85141]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 16 10:21:35 user nova-compute[85141]: </disk>
Nov 16 10:21:35 user nova-compute[85141]:  {{(pid=85141) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 10:21:35 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-082dec01-b40d-435a-93a1-ced45489fc10 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Successfully detached device vdb from instance 2d7787a2-b8da-4d39-9b16-4c7bcb275f85 from the persistent domain config.
Nov 16 10:21:35 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-082dec01-b40d-435a-93a1-ced45489fc10 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 2d7787a2-b8da-4d39-9b16-4c7bcb275f85 from the live domain config. {{(pid=85141) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 10:21:35 user nova-compute[85141]: DEBUG nova.virt.libvirt.guest [None req-082dec01-b40d-435a-93a1-ced45489fc10 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 10:21:35 user nova-compute[85141]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 10:21:35 user nova-compute[85141]:   <source dev="/dev/sdb"/>
Nov 16 10:21:35 user nova-compute[85141]:   <target dev="vdb" bus="virtio"/>
Nov 16 10:21:35 user nova-compute[85141]:   <serial>7dc504e0-da46-4c57-a66d-8ae6ce9c733c</serial>
Nov 16 10:21:35 user nova-compute[85141]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 16 10:21:35 user nova-compute[85141]: </disk>
Nov 16 10:21:35 user nova-compute[85141]:  {{(pid=85141) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 10:21:35 user nova-compute[85141]: DEBUG nova.network.neutron [req-8662986d-50d2-4941-aa4c-75aec8aa534c req-51b93088-8614-4555-8527-996ad22a7349 service nova] [instance: 2d7787a2-b8da-4d39-9b16-4c7bcb275f85] Updated VIF entry in instance network info cache for port 3f553883-eaa0-4a7e-8e31-1170241a0236. {{(pid=85141) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 10:21:35 user nova-compute[85141]: DEBUG nova.network.neutron [req-8662986d-50d2-4941-aa4c-75aec8aa534c req-51b93088-8614-4555-8527-996ad22a7349 service nova] [instance: 2d7787a2-b8da-4d39-9b16-4c7bcb275f85] Updating instance_info_cache with network_info: [{"id": "3f553883-eaa0-4a7e-8e31-1170241a0236", "address": "fa:16:3e:1c:29:6f", "network": {"id": "436477fd-9294-4297-bfb3-405564823fa0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1068749207-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4e4f57f79564d2fbcb8080bf8f1c5c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f553883-ea", "ovs_interfaceid": "3f553883-eaa0-4a7e-8e31-1170241a0236", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:21:35 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-8662986d-50d2-4941-aa4c-75aec8aa534c req-51b93088-8614-4555-8527-996ad22a7349 service nova] Releasing lock "refresh_cache-2d7787a2-b8da-4d39-9b16-4c7bcb275f85" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:21:35 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b388b98-4e65-4258-bbe2-77e699321fb7/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:21:35 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b388b98-4e65-4258-bbe2-77e699321fb7/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:21:35 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-de9d0f76-e9eb-4864-aa68-4fdcadf98693 tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:21:35 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-de9d0f76-e9eb-4864-aa68-4fdcadf98693 tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:21:35 user nova-compute[85141]: DEBUG nova.objects.instance [None req-de9d0f76-e9eb-4864-aa68-4fdcadf98693 tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] Lazy-loading 'pci_requests' on Instance uuid e88874fe-b0a6-4292-8832-023f95e4f53c {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:21:35 user nova-compute[85141]: DEBUG nova.objects.instance [None req-de9d0f76-e9eb-4864-aa68-4fdcadf98693 tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] Lazy-loading 'numa_topology' on Instance uuid e88874fe-b0a6-4292-8832-023f95e4f53c {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:21:35 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-de9d0f76-e9eb-4864-aa68-4fdcadf98693 tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=85141) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 10:21:35 user nova-compute[85141]: INFO nova.compute.claims [None req-de9d0f76-e9eb-4864-aa68-4fdcadf98693 tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] [instance: e88874fe-b0a6-4292-8832-023f95e4f53c] Claim successful on node user
Nov 16 10:21:36 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b388b98-4e65-4258-bbe2-77e699321fb7/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:21:36 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=85141) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 10:21:36 user nova-compute[85141]: DEBUG nova.scheduler.client.report [None req-de9d0f76-e9eb-4864-aa68-4fdcadf98693 tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] Refreshing inventories for resource provider bf8e0fa1-16b6-408f-9203-c4cd63916272 {{(pid=85141) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 16 10:21:36 user nova-compute[85141]: DEBUG nova.scheduler.client.report [None req-de9d0f76-e9eb-4864-aa68-4fdcadf98693 tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] Updating ProviderTree inventory for provider bf8e0fa1-16b6-408f-9203-c4cd63916272 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=85141) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 16 10:21:36 user nova-compute[85141]: DEBUG nova.compute.provider_tree [None req-de9d0f76-e9eb-4864-aa68-4fdcadf98693 tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] Updating inventory in ProviderTree for provider bf8e0fa1-16b6-408f-9203-c4cd63916272 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=85141) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 16 10:21:36 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-082dec01-b40d-435a-93a1-ced45489fc10 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 2d7787a2-b8da-4d39-9b16-4c7bcb275f85 {{(pid=85141) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 10:21:36 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:21:36 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:21:36 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Hypervisor/Node resource view: name=user free_ram=7734MB free_disk=24.844844818115234GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=85141) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 10:21:36 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:21:36 user nova-compute[85141]: DEBUG nova.scheduler.client.report [None req-de9d0f76-e9eb-4864-aa68-4fdcadf98693 tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] Refreshing aggregate associations for resource provider bf8e0fa1-16b6-408f-9203-c4cd63916272, aggregates: None {{(pid=85141) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 16 10:21:36 user nova-compute[85141]: DEBUG nova.scheduler.client.report [None req-de9d0f76-e9eb-4864-aa68-4fdcadf98693 tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] Refreshing trait associations for resource provider bf8e0fa1-16b6-408f-9203-c4cd63916272, traits: COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE41,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_ACCELERATORS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_USB,COMPUTE_TRUSTED_CERTS,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_RESCUE_BFV,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VOLUME_ATTACH_WITH_TAG {{(pid=85141) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 16 10:21:36 user nova-compute[85141]: DEBUG nova.compute.provider_tree [None req-de9d0f76-e9eb-4864-aa68-4fdcadf98693 tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] Inventory has not changed in ProviderTree for provider: bf8e0fa1-16b6-408f-9203-c4cd63916272 {{(pid=85141) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 10:21:36 user nova-compute[85141]: DEBUG nova.scheduler.client.report [None req-de9d0f76-e9eb-4864-aa68-4fdcadf98693 tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] Inventory has not changed for provider bf8e0fa1-16b6-408f-9203-c4cd63916272 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=85141) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 10:21:36 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-de9d0f76-e9eb-4864-aa68-4fdcadf98693 tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.092s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:21:36 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.424s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:21:37 user nova-compute[85141]: INFO nova.network.neutron [None req-de9d0f76-e9eb-4864-aa68-4fdcadf98693 tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] [instance: e88874fe-b0a6-4292-8832-023f95e4f53c] Updating port 7bbea642-d504-433b-ae99-8e7159942751 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 16 10:21:37 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance d842f90e-663b-4c95-9d7c-d092d2bac41f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:21:37 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance f01dc8cf-1a69-4618-a15d-0c1075157f05 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:21:37 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance 059d6974-bd0c-4f73-91fc-8202ebda4238 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:21:37 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance 4e214bbb-5bbb-4e6f-ac09-9cb1412f068b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:21:37 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance b24c3954-06ff-4e15-9e43-c65d1dae7a5d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:21:37 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:21:37 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance 9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:21:37 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance 2d7787a2-b8da-4d39-9b16-4c7bcb275f85 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:21:37 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance 0b388b98-4e65-4258-bbe2-77e699321fb7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:21:37 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance 11986c5b-6914-491e-8e71-983ab6b13c6e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:21:37 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance b2e7cb0b-61b6-4d23-9b20-f8b437c7884e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:21:37 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] [instance: e88874fe-b0a6-4292-8832-023f95e4f53c] Instance with task_state "spawning" is not being actively managed by this compute host but has allocations referencing this compute node (bf8e0fa1-16b6-408f-9203-c4cd63916272): {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. Skipping heal of allocations during the task state transition. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1777}}
Nov 16 10:21:37 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=85141) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 10:21:37 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=85141) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 10:21:37 user nova-compute[85141]: DEBUG nova.objects.instance [None req-b88d16f6-7877-4ba6-8d2d-fe7f68d9855e tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Lazy-loading 'flavor' on Instance uuid 0b388b98-4e65-4258-bbe2-77e699321fb7 {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:21:37 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-b88d16f6-7877-4ba6-8d2d-fe7f68d9855e tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Acquiring lock "refresh_cache-0b388b98-4e65-4258-bbe2-77e699321fb7" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:21:37 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-b88d16f6-7877-4ba6-8d2d-fe7f68d9855e tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Acquired lock "refresh_cache-0b388b98-4e65-4258-bbe2-77e699321fb7" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:21:37 user nova-compute[85141]: DEBUG nova.network.neutron [None req-b88d16f6-7877-4ba6-8d2d-fe7f68d9855e tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] [instance: 0b388b98-4e65-4258-bbe2-77e699321fb7] Building network info cache for instance {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 10:21:37 user nova-compute[85141]: DEBUG nova.objects.instance [None req-b88d16f6-7877-4ba6-8d2d-fe7f68d9855e tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Lazy-loading 'info_cache' on Instance uuid 0b388b98-4e65-4258-bbe2-77e699321fb7 {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:21:37 user nova-compute[85141]: DEBUG nova.objects.base [None req-b88d16f6-7877-4ba6-8d2d-fe7f68d9855e tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Object Instance<0b388b98-4e65-4258-bbe2-77e699321fb7> lazy-loaded attributes: flavor,info_cache {{(pid=85141) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 10:21:37 user nova-compute[85141]: DEBUG nova.compute.provider_tree [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Inventory has not changed in ProviderTree for provider: bf8e0fa1-16b6-408f-9203-c4cd63916272 {{(pid=85141) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 10:21:37 user nova-compute[85141]: DEBUG nova.scheduler.client.report [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Inventory has not changed for provider bf8e0fa1-16b6-408f-9203-c4cd63916272 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=85141) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 10:21:37 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Compute_service record updated for user:user {{(pid=85141) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 10:21:37 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.651s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:21:37 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:21:37 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Cleaning up deleted instances {{(pid=85141) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 16 10:21:37 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] There are 0 instances to clean {{(pid=85141) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 16 10:21:37 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:21:37 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:21:38 user nova-compute[85141]: DEBUG nova.network.neutron [None req-b88d16f6-7877-4ba6-8d2d-fe7f68d9855e tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] [instance: 0b388b98-4e65-4258-bbe2-77e699321fb7] Updating instance_info_cache with network_info: [{"id": "3ed9d2a6-c028-4b75-9023-95b1cfa982b6", "address": "fa:16:3e:85:dd:4c", "network": {"id": "4e36c3d2-7d16-4305-a0a7-2358e1208df3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1030128743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2acc04e107d4a229c3580cf078a20f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ed9d2a6-c0", "ovs_interfaceid": "3ed9d2a6-c028-4b75-9023-95b1cfa982b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:21:38 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-2cbc5a55-c109-48fa-af33-f0de5eb77452 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Acquiring lock "bff3a84b-6ab5-4256-8a04-2d21a4ba20b3" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:21:38 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-2cbc5a55-c109-48fa-af33-f0de5eb77452 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Lock "bff3a84b-6ab5-4256-8a04-2d21a4ba20b3" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:21:38 user nova-compute[85141]: INFO nova.compute.manager [None req-2cbc5a55-c109-48fa-af33-f0de5eb77452 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] [instance: bff3a84b-6ab5-4256-8a04-2d21a4ba20b3] Unshelving
Nov 16 10:21:38 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-b88d16f6-7877-4ba6-8d2d-fe7f68d9855e tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Releasing lock "refresh_cache-0b388b98-4e65-4258-bbe2-77e699321fb7" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:21:38 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-de9d0f76-e9eb-4864-aa68-4fdcadf98693 tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] Acquiring lock "refresh_cache-e88874fe-b0a6-4292-8832-023f95e4f53c" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:21:38 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-de9d0f76-e9eb-4864-aa68-4fdcadf98693 tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] Acquired lock "refresh_cache-e88874fe-b0a6-4292-8832-023f95e4f53c" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:21:38 user nova-compute[85141]: DEBUG nova.network.neutron [None req-de9d0f76-e9eb-4864-aa68-4fdcadf98693 tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] [instance: e88874fe-b0a6-4292-8832-023f95e4f53c] Building network info cache for instance {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 10:21:38 user nova-compute[85141]: INFO nova.virt.libvirt.driver [-] [instance: 0b388b98-4e65-4258-bbe2-77e699321fb7] Instance destroyed successfully.
Nov 16 10:21:38 user nova-compute[85141]: DEBUG nova.objects.instance [None req-b88d16f6-7877-4ba6-8d2d-fe7f68d9855e tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Lazy-loading 'resources' on Instance uuid 0b388b98-4e65-4258-bbe2-77e699321fb7 {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:21:38 user nova-compute[85141]: DEBUG nova.objects.base [None req-b88d16f6-7877-4ba6-8d2d-fe7f68d9855e tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Object Instance<0b388b98-4e65-4258-bbe2-77e699321fb7> lazy-loaded attributes: flavor,info_cache,resources {{(pid=85141) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 10:21:38 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-b88d16f6-7877-4ba6-8d2d-fe7f68d9855e tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T10:17:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1602512664',display_name='tempest-AttachVolumeTestJSON-server-1602512664',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1602512664',id=23,image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAR6bF9nouUYoCi9ZNGh3nZGY5ofrnXVxXtSu/7Acr1EHKWGjXKYUGtrq2XimOt/E4akdnq6ZnUvHCruk4Zy5W8xPtBZmROYAs+9Sfqoh0p8jGC4Ld4F7tm19PX/QAMtvA==',key_name='tempest-keypair-1960067559',keypairs=<?>,launch_index=0,launched_at=2023-11-16T10:17:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='c2acc04e107d4a229c3580cf078a20f7',ramdisk_id='',reservation_id='r-ji9l4e80',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1609390288',owner_user_name='tempest-AttachVolumeTestJSON-1609390288-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T10:19:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f58409e5923c42b685d0a3ad0ab42974',uuid=0b388b98-4e65-4258-bbe2-77e699321fb7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "3ed9d2a6-c028-4b75-9023-95b1cfa982b6", "address": "fa:16:3e:85:dd:4c", "network": {"id": "4e36c3d2-7d16-4305-a0a7-2358e1208df3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1030128743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2acc04e107d4a229c3580cf078a20f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ed9d2a6-c0", "ovs_interfaceid": "3ed9d2a6-c028-4b75-9023-95b1cfa982b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 10:21:38 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-b88d16f6-7877-4ba6-8d2d-fe7f68d9855e tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Converting VIF {"id": "3ed9d2a6-c028-4b75-9023-95b1cfa982b6", "address": "fa:16:3e:85:dd:4c", "network": {"id": "4e36c3d2-7d16-4305-a0a7-2358e1208df3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1030128743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2acc04e107d4a229c3580cf078a20f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ed9d2a6-c0", "ovs_interfaceid": "3ed9d2a6-c028-4b75-9023-95b1cfa982b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:21:38 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-b88d16f6-7877-4ba6-8d2d-fe7f68d9855e tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:85:dd:4c,bridge_name='br-int',has_traffic_filtering=True,id=3ed9d2a6-c028-4b75-9023-95b1cfa982b6,network=Network(4e36c3d2-7d16-4305-a0a7-2358e1208df3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ed9d2a6-c0') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:21:38 user nova-compute[85141]: DEBUG os_vif [None req-b88d16f6-7877-4ba6-8d2d-fe7f68d9855e tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:85:dd:4c,bridge_name='br-int',has_traffic_filtering=True,id=3ed9d2a6-c028-4b75-9023-95b1cfa982b6,network=Network(4e36c3d2-7d16-4305-a0a7-2358e1208df3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ed9d2a6-c0') {{(pid=85141) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 10:21:38 user nova-compute[85141]: DEBUG nova.compute.manager [req-b1aff09d-06c5-42d6-bae4-c2e2b95bed87 req-11ded88b-9d2b-4bf4-978b-b15c135b417c service nova] [instance: e88874fe-b0a6-4292-8832-023f95e4f53c] Received event network-changed-7bbea642-d504-433b-ae99-8e7159942751 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:21:38 user nova-compute[85141]: DEBUG nova.compute.manager [req-b1aff09d-06c5-42d6-bae4-c2e2b95bed87 req-11ded88b-9d2b-4bf4-978b-b15c135b417c service nova] [instance: e88874fe-b0a6-4292-8832-023f95e4f53c] Refreshing instance network info cache due to event network-changed-7bbea642-d504-433b-ae99-8e7159942751. {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 10:21:38 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-b1aff09d-06c5-42d6-bae4-c2e2b95bed87 req-11ded88b-9d2b-4bf4-978b-b15c135b417c service nova] Acquiring lock "refresh_cache-e88874fe-b0a6-4292-8832-023f95e4f53c" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:21:38 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:21:38 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3ed9d2a6-c0, bridge=br-int, if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:21:38 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-2cbc5a55-c109-48fa-af33-f0de5eb77452 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:21:38 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-2cbc5a55-c109-48fa-af33-f0de5eb77452 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:21:38 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:21:38 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:21:38 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b7ebbee7-93b3-4cb0-8720-27990ab643ca) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:21:38 user nova-compute[85141]: DEBUG nova.objects.instance [None req-2cbc5a55-c109-48fa-af33-f0de5eb77452 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Lazy-loading 'pci_requests' on Instance uuid bff3a84b-6ab5-4256-8a04-2d21a4ba20b3 {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:21:38 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:21:38 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:21:38 user nova-compute[85141]: INFO os_vif [None req-b88d16f6-7877-4ba6-8d2d-fe7f68d9855e tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:85:dd:4c,bridge_name='br-int',has_traffic_filtering=True,id=3ed9d2a6-c028-4b75-9023-95b1cfa982b6,network=Network(4e36c3d2-7d16-4305-a0a7-2358e1208df3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ed9d2a6-c0')
Nov 16 10:21:38 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b88d16f6-7877-4ba6-8d2d-fe7f68d9855e tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] [instance: 0b388b98-4e65-4258-bbe2-77e699321fb7] calling os-brick to detach iSCSI Volume {{(pid=85141) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 10:21:38 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-b88d16f6-7877-4ba6-8d2d-fe7f68d9855e tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51806b6080>, {'target_iqn': 'iqn.2010-10.org.openstack:ca5a51ee-cdb2-4efa-b7e5-8a97d0c99bf7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ercfVhZa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 10:21:38 user nova-compute[85141]: WARNING os_brick.initiator.connectors.base [None req-b88d16f6-7877-4ba6-8d2d-fe7f68d9855e tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 10:21:38 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-b88d16f6-7877-4ba6-8d2d-fe7f68d9855e tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 10:21:38 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-b88d16f6-7877-4ba6-8d2d-fe7f68d9855e tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 10:21:38 user nova-compute[85141]: DEBUG nova.objects.instance [None req-2cbc5a55-c109-48fa-af33-f0de5eb77452 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Lazy-loading 'numa_topology' on Instance uuid bff3a84b-6ab5-4256-8a04-2d21a4ba20b3 {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:21:38 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:21:38 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-2cbc5a55-c109-48fa-af33-f0de5eb77452 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=85141) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 10:21:38 user nova-compute[85141]: INFO nova.compute.claims [None req-2cbc5a55-c109-48fa-af33-f0de5eb77452 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] [instance: bff3a84b-6ab5-4256-8a04-2d21a4ba20b3] Claim successful on node user
Nov 16 10:21:38 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:21:38 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[03971499-acc7-45e2-8475-fc57614cab2f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3392fa71-5ceb-42f9-acb8-b9e69b8b1cfa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2f7784b4-2ba5-4085-9e17-877c754115c8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ca5a51ee-cdb2-4efa-b7e5-8a97d0c99bf7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7dc504e0-da46-4c57-a66d-8ae6ce9c733c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:21:38 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-b88d16f6-7877-4ba6-8d2d-fe7f68d9855e tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 10:21:38 user nova-compute[85141]: No targets found.
Nov 16 10:21:38 user nova-compute[85141]: iSNS:
Nov 16 10:21:38 user nova-compute[85141]: No targets found.
Nov 16 10:21:38 user nova-compute[85141]: STATIC:
Nov 16 10:21:38 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:3392fa71-5ceb-42f9-acb8-b9e69b8b1cfa
Nov 16 10:21:38 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:21:38 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:21:38 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee
Nov 16 10:21:38 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:21:38 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:21:38 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:2f7784b4-2ba5-4085-9e17-877c754115c8
Nov 16 10:21:38 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:21:38 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:21:38 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:ca5a51ee-cdb2-4efa-b7e5-8a97d0c99bf7
Nov 16 10:21:38 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:21:38 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:21:38 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:7dc504e0-da46-4c57-a66d-8ae6ce9c733c
Nov 16 10:21:38 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:21:38 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:21:38 user nova-compute[85141]: FIRMWARE:
Nov 16 10:21:38 user nova-compute[85141]: No targets found.
Nov 16 10:21:38 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:21:38 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-b88d16f6-7877-4ba6-8d2d-fe7f68d9855e tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 10:21:38 user nova-compute[85141]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 10:21:38 user nova-compute[85141]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=85141) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 10:21:38 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-b88d16f6-7877-4ba6-8d2d-fe7f68d9855e tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ca5a51ee-cdb2-4efa-b7e5-8a97d0c99bf7', 0)] {{(pid=85141) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 10:21:38 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:21:38 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:21:38 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[395c4098-7fc8-47e5-b229-d8791879be28]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2f7784b4-2ba5-4085-9e17-877c754115c8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3392fa71-5ceb-42f9-acb8-b9e69b8b1cfa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7dc504e0-da46-4c57-a66d-8ae6ce9c733c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ca5a51ee-cdb2-4efa-b7e5-8a97d0c99bf7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:21:38 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:21:38 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:21:38 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a6a311a-4ce0-4802-8b41-e37368508de6]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3392fa71-5ceb-42f9-acb8-b9e69b8b1cfa (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7784b4-2ba5-4085-9e17-877c754115c8 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca5a51ee-cdb2-4efa-b7e5-8a97d0c99bf7 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dc504e0-da46-4c57-a66d-8ae6ce9c733c (non-flash)\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:21:38 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-b88d16f6-7877-4ba6-8d2d-fe7f68d9855e tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)
Nov 16 10:21:38 user nova-compute[85141]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3392fa71-5ceb-42f9-acb8-b9e69b8b1cfa (non-flash)
Nov 16 10:21:38 user nova-compute[85141]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7784b4-2ba5-4085-9e17-877c754115c8 (non-flash)
Nov 16 10:21:38 user nova-compute[85141]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca5a51ee-cdb2-4efa-b7e5-8a97d0c99bf7 (non-flash)
Nov 16 10:21:38 user nova-compute[85141]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dc504e0-da46-4c57-a66d-8ae6ce9c733c (non-flash)
Nov 16 10:21:38 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:21:38 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-b88d16f6-7877-4ba6-8d2d-fe7f68d9855e tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)
Nov 16 10:21:38 user nova-compute[85141]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3392fa71-5ceb-42f9-acb8-b9e69b8b1cfa (non-flash)
Nov 16 10:21:38 user nova-compute[85141]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7784b4-2ba5-4085-9e17-877c754115c8 (non-flash)
Nov 16 10:21:38 user nova-compute[85141]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca5a51ee-cdb2-4efa-b7e5-8a97d0c99bf7 (non-flash)
Nov 16 10:21:38 user nova-compute[85141]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dc504e0-da46-4c57-a66d-8ae6ce9c733c (non-flash)
Nov 16 10:21:38 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 10:21:38 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-b88d16f6-7877-4ba6-8d2d-fe7f68d9855e tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f51a09b5bd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ca5a51ee-cdb2-4efa-b7e5-8a97d0c99bf7'): ({'sdf'}, set())}) {{(pid=85141) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 10:21:38 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-b88d16f6-7877-4ba6-8d2d-fe7f68d9855e tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Removing single pathed devices sdf {{(pid=85141) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 10:21:38 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:21:38 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:21:38 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[756cf210-da03-438b-9aba-ebaa5d0f08e3]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:21:38 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:21:38 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.020s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:21:38 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[3df8065f-5dff-44ba-b6de-5412b173cd57]: (4, ('ok\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:21:38 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-b88d16f6-7877-4ba6-8d2d-fe7f68d9855e tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Flushing IO for device /dev/sdf {{(pid=85141) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 10:21:38 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:21:38 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:21:38 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[32fdf46e-649d-4fbd-af00-86bbf7cd4b24]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:21:38 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-b88d16f6-7877-4ba6-8d2d-fe7f68d9855e tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=85141) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 10:21:38 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:21:38 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.049s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:21:38 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[e76e88f9-f060-4abf-baba-3ca28a10df3c]: (4, ('1', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:21:38 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-b88d16f6-7877-4ba6-8d2d-fe7f68d9855e tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=85141) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 10:21:38 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-b88d16f6-7877-4ba6-8d2d-fe7f68d9855e tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] SCSI volumes sdf have been removed. {{(pid=85141) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 10:21:38 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-b88d16f6-7877-4ba6-8d2d-fe7f68d9855e tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ca5a51ee-cdb2-4efa-b7e5-8a97d0c99bf7')] {{(pid=85141) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 10:21:38 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca5a51ee-cdb2-4efa-b7e5-8a97d0c99bf7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:21:38 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca5a51ee-cdb2-4efa-b7e5-8a97d0c99bf7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:21:38 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ab7f250-90e0-4ae6-86ce-3860c1e1a025]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:21:38 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-b88d16f6-7877-4ba6-8d2d-fe7f68d9855e tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:21:38 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca5a51ee-cdb2-4efa-b7e5-8a97d0c99bf7 -p 172.16.0.220:3260 --logout {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:21:38 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca5a51ee-cdb2-4efa-b7e5-8a97d0c99bf7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:21:38 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[4206c588-0427-4425-a444-9713467f8dbf]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:ca5a51ee-cdb2-4efa-b7e5-8a97d0c99bf7, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:ca5a51ee-cdb2-4efa-b7e5-8a97d0c99bf7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:21:38 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-b88d16f6-7877-4ba6-8d2d-fe7f68d9855e tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:ca5a51ee-cdb2-4efa-b7e5-8a97d0c99bf7, portal: 172.16.0.220,3260]
Nov 16 10:21:38 user nova-compute[85141]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:ca5a51ee-cdb2-4efa-b7e5-8a97d0c99bf7, portal: 172.16.0.220,3260] successful.
Nov 16 10:21:38 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:21:38 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca5a51ee-cdb2-4efa-b7e5-8a97d0c99bf7 -p 172.16.0.220:3260 --op delete {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:21:38 user nova-compute[85141]: DEBUG nova.network.neutron [None req-de9d0f76-e9eb-4864-aa68-4fdcadf98693 tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] [instance: e88874fe-b0a6-4292-8832-023f95e4f53c] Updating instance_info_cache with network_info: [{"id": "7bbea642-d504-433b-ae99-8e7159942751", "address": "fa:16:3e:6a:e8:c6", "network": {"id": "3fc8f327-8ef7-4b60-abf0-31d75e40478e", "bridge": "br-int", "label": "tempest-TestShelveInstance-452311162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fc33dd813c64594a3626d2e7dff09ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bbea642-d5", "ovs_interfaceid": "7bbea642-d504-433b-ae99-8e7159942751", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:21:38 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca5a51ee-cdb2-4efa-b7e5-8a97d0c99bf7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:21:38 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[04772433-91bd-4178-b93b-f6a504fc34f2]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:21:38 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-b88d16f6-7877-4ba6-8d2d-fe7f68d9855e tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:21:38 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-b88d16f6-7877-4ba6-8d2d-fe7f68d9855e tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.345s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 10:21:38 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-b88d16f6-7877-4ba6-8d2d-fe7f68d9855e tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] <== disconnect_volume: return (347ms) None {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 10:21:38 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b88d16f6-7877-4ba6-8d2d-fe7f68d9855e tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] [instance: 0b388b98-4e65-4258-bbe2-77e699321fb7] Disconnected iSCSI Volume {{(pid=85141) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 10:21:38 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-de9d0f76-e9eb-4864-aa68-4fdcadf98693 tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] Releasing lock "refresh_cache-e88874fe-b0a6-4292-8832-023f95e4f53c" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:21:38 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-de9d0f76-e9eb-4864-aa68-4fdcadf98693 tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] [instance: e88874fe-b0a6-4292-8832-023f95e4f53c] Creating instance directory {{(pid=85141) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 10:21:38 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-de9d0f76-e9eb-4864-aa68-4fdcadf98693 tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] [instance: e88874fe-b0a6-4292-8832-023f95e4f53c] Creating image(s)
Nov 16 10:21:38 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-de9d0f76-e9eb-4864-aa68-4fdcadf98693 tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] [instance: e88874fe-b0a6-4292-8832-023f95e4f53c] Did not create local disks {{(pid=85141) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 16 10:21:38 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-de9d0f76-e9eb-4864-aa68-4fdcadf98693 tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] [instance: e88874fe-b0a6-4292-8832-023f95e4f53c] Ensure instance console log exists: /opt/stack/data/nova/instances/e88874fe-b0a6-4292-8832-023f95e4f53c/console.log {{(pid=85141) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 10:21:38 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-de9d0f76-e9eb-4864-aa68-4fdcadf98693 tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:21:38 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-de9d0f76-e9eb-4864-aa68-4fdcadf98693 tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:21:38 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-de9d0f76-e9eb-4864-aa68-4fdcadf98693 tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:21:38 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-de9d0f76-e9eb-4864-aa68-4fdcadf98693 tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] [instance: e88874fe-b0a6-4292-8832-023f95e4f53c] Start _get_guest_xml network_info=[{"id": "7bbea642-d504-433b-ae99-8e7159942751", "address": "fa:16:3e:6a:e8:c6", "network": {"id": "3fc8f327-8ef7-4b60-abf0-31d75e40478e", "bridge": "br-int", "label": "tempest-TestShelveInstance-452311162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fc33dd813c64594a3626d2e7dff09ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bbea642-d5", "ovs_interfaceid": "7bbea642-d504-433b-ae99-8e7159942751", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:674f9ae8-6ab5-4ff2-b715-fe8807c34793', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qDxyoBhW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e88874fe-b0a6-4292-8832-023f95e4f53c', 'attached_at': '', 'detached_at': '', 'volume_id': '674f9ae8-6ab5-4ff2-b715-fe8807c34793', 'serial': '674f9ae8-6ab5-4ff2-b715-fe8807c34793'}, 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'attachment_id': 'f75fe213-a491-446f-ab4b-c6c48e986b5c', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=85141) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 10:21:38 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-b1aff09d-06c5-42d6-bae4-c2e2b95bed87 req-11ded88b-9d2b-4bf4-978b-b15c135b417c service nova] Acquired lock "refresh_cache-e88874fe-b0a6-4292-8832-023f95e4f53c" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:21:38 user nova-compute[85141]: DEBUG nova.network.neutron [req-b1aff09d-06c5-42d6-bae4-c2e2b95bed87 req-11ded88b-9d2b-4bf4-978b-b15c135b417c service nova] [instance: e88874fe-b0a6-4292-8832-023f95e4f53c] Refreshing network info cache for port 7bbea642-d504-433b-ae99-8e7159942751 {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 10:21:38 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-b88d16f6-7877-4ba6-8d2d-fe7f68d9855e tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] [instance: 0b388b98-4e65-4258-bbe2-77e699321fb7] Start _get_guest_xml network_info=[{"id": "3ed9d2a6-c028-4b75-9023-95b1cfa982b6", "address": "fa:16:3e:85:dd:4c", "network": {"id": "4e36c3d2-7d16-4305-a0a7-2358e1208df3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1030128743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2acc04e107d4a229c3580cf078a20f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ed9d2a6-c0", "ovs_interfaceid": "3ed9d2a6-c028-4b75-9023-95b1cfa982b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=bc4ca70f-a459-4d5c-a9e6-80f1948eb48b,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_options': None, 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'image_id': 'bc4ca70f-a459-4d5c-a9e6-80f1948eb48b'}], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ca5a51ee-cdb2-4efa-b7e5-8a97d0c99bf7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ercfVhZa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, 'status': 'reserved', 'instance': '0b388b98-4e65-4258-bbe2-77e699321fb7', 'attached_at': '', 'detached_at': '', 'volume_id': 'ca5a51ee-cdb2-4efa-b7e5-8a97d0c99bf7', 'serial': 'ca5a51ee-cdb2-4efa-b7e5-8a97d0c99bf7'}, 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'boot_index': None, 'attachment_id': '0cf7d9f1-d7ea-40e1-a185-112abb45db84', 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=85141) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 10:21:38 user nova-compute[85141]: DEBUG nova.objects.instance [None req-b88d16f6-7877-4ba6-8d2d-fe7f68d9855e tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Lazy-loading 'numa_topology' on Instance uuid 0b388b98-4e65-4258-bbe2-77e699321fb7 {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:21:38 user nova-compute[85141]: DEBUG nova.objects.base [None req-b88d16f6-7877-4ba6-8d2d-fe7f68d9855e tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Object Instance<0b388b98-4e65-4258-bbe2-77e699321fb7> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=85141) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 10:21:38 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-de9d0f76-e9eb-4864-aa68-4fdcadf98693 tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:21:38 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-de9d0f76-e9eb-4864-aa68-4fdcadf98693 tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:21:38 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-de9d0f76-e9eb-4864-aa68-4fdcadf98693 tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=85141) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 10:21:38 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-de9d0f76-e9eb-4864-aa68-4fdcadf98693 tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] CPU controller missing on host. {{(pid=85141) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 10:21:38 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-b88d16f6-7877-4ba6-8d2d-fe7f68d9855e tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:21:38 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-b88d16f6-7877-4ba6-8d2d-fe7f68d9855e tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:21:38 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-de9d0f76-e9eb-4864-aa68-4fdcadf98693 tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=85141) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 10:21:38 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-de9d0f76-e9eb-4864-aa68-4fdcadf98693 tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] CPU controller found on host. {{(pid=85141) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 10:21:38 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-de9d0f76-e9eb-4864-aa68-4fdcadf98693 tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=85141) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 10:21:38 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-de9d0f76-e9eb-4864-aa68-4fdcadf98693 tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T10:06:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 10:21:38 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-de9d0f76-e9eb-4864-aa68-4fdcadf98693 tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] Flavor limits 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 10:21:38 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-de9d0f76-e9eb-4864-aa68-4fdcadf98693 tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] Image limits 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 10:21:38 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-de9d0f76-e9eb-4864-aa68-4fdcadf98693 tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] Flavor pref 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 10:21:38 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-de9d0f76-e9eb-4864-aa68-4fdcadf98693 tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] Image pref 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 10:21:38 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-de9d0f76-e9eb-4864-aa68-4fdcadf98693 tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 10:21:38 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-de9d0f76-e9eb-4864-aa68-4fdcadf98693 tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 10:21:38 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-de9d0f76-e9eb-4864-aa68-4fdcadf98693 tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=85141) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 10:21:38 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-de9d0f76-e9eb-4864-aa68-4fdcadf98693 tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] Got 1 possible topologies {{(pid=85141) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 10:21:38 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-de9d0f76-e9eb-4864-aa68-4fdcadf98693 tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 10:21:38 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-de9d0f76-e9eb-4864-aa68-4fdcadf98693 tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 10:21:38 user nova-compute[85141]: DEBUG nova.objects.instance [None req-de9d0f76-e9eb-4864-aa68-4fdcadf98693 tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] Lazy-loading 'vcpu_model' on Instance uuid e88874fe-b0a6-4292-8832-023f95e4f53c {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:21:38 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-b88d16f6-7877-4ba6-8d2d-fe7f68d9855e tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=85141) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 10:21:38 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-b88d16f6-7877-4ba6-8d2d-fe7f68d9855e tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] CPU controller missing on host. {{(pid=85141) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 10:21:38 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-b88d16f6-7877-4ba6-8d2d-fe7f68d9855e tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=85141) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 10:21:38 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-b88d16f6-7877-4ba6-8d2d-fe7f68d9855e tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] CPU controller found on host. {{(pid=85141) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 10:21:38 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-b88d16f6-7877-4ba6-8d2d-fe7f68d9855e tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=85141) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 10:21:38 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-b88d16f6-7877-4ba6-8d2d-fe7f68d9855e tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T10:06:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=bc4ca70f-a459-4d5c-a9e6-80f1948eb48b,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 10:21:38 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-b88d16f6-7877-4ba6-8d2d-fe7f68d9855e tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Flavor limits 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 10:21:38 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-b88d16f6-7877-4ba6-8d2d-fe7f68d9855e tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Image limits 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 10:21:38 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-b88d16f6-7877-4ba6-8d2d-fe7f68d9855e tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Flavor pref 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 10:21:38 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-b88d16f6-7877-4ba6-8d2d-fe7f68d9855e tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Image pref 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 10:21:38 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-b88d16f6-7877-4ba6-8d2d-fe7f68d9855e tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 10:21:38 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-b88d16f6-7877-4ba6-8d2d-fe7f68d9855e tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 10:21:38 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-b88d16f6-7877-4ba6-8d2d-fe7f68d9855e tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=85141) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 10:21:38 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-b88d16f6-7877-4ba6-8d2d-fe7f68d9855e tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Got 1 possible topologies {{(pid=85141) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 10:21:38 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-b88d16f6-7877-4ba6-8d2d-fe7f68d9855e tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 10:21:38 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-b88d16f6-7877-4ba6-8d2d-fe7f68d9855e tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 10:21:38 user nova-compute[85141]: DEBUG nova.objects.instance [None req-b88d16f6-7877-4ba6-8d2d-fe7f68d9855e tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Lazy-loading 'vcpu_model' on Instance uuid 0b388b98-4e65-4258-bbe2-77e699321fb7 {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:21:38 user nova-compute[85141]: DEBUG nova.objects.base [None req-de9d0f76-e9eb-4864-aa68-4fdcadf98693 tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] Object Instance<e88874fe-b0a6-4292-8832-023f95e4f53c> lazy-loaded attributes: pci_requests,vcpu_model {{(pid=85141) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 10:21:38 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-de9d0f76-e9eb-4864-aa68-4fdcadf98693 tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] [instance: e88874fe-b0a6-4292-8832-023f95e4f53c] Calling os-brick to attach iSCSI Volume {{(pid=85141) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 10:21:38 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-de9d0f76-e9eb-4864-aa68-4fdcadf98693 tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51806b6080>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:674f9ae8-6ab5-4ff2-b715-fe8807c34793', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qDxyoBhW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 10:21:38 user nova-compute[85141]: WARNING os_brick.initiator.connectors.base [None req-de9d0f76-e9eb-4864-aa68-4fdcadf98693 tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 10:21:38 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-de9d0f76-e9eb-4864-aa68-4fdcadf98693 tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 10:21:38 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-de9d0f76-e9eb-4864-aa68-4fdcadf98693 tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 10:21:38 user nova-compute[85141]: WARNING os_brick.initiator.connectors.base [None req-de9d0f76-e9eb-4864-aa68-4fdcadf98693 tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 10:21:38 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-de9d0f76-e9eb-4864-aa68-4fdcadf98693 tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:674f9ae8-6ab5-4ff2-b715-fe8807c34793" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 10:21:38 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-de9d0f76-e9eb-4864-aa68-4fdcadf98693 tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:674f9ae8-6ab5-4ff2-b715-fe8807c34793" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 10:21:38 user nova-compute[85141]: INFO os_brick.initiator.connectors.iscsi [None req-de9d0f76-e9eb-4864-aa68-4fdcadf98693 tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 10:21:38 user nova-compute[85141]: DEBUG nova.objects.base [None req-b88d16f6-7877-4ba6-8d2d-fe7f68d9855e tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Object Instance<0b388b98-4e65-4258-bbe2-77e699321fb7> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=85141) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 10:21:38 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b88d16f6-7877-4ba6-8d2d-fe7f68d9855e tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] [instance: 0b388b98-4e65-4258-bbe2-77e699321fb7] Calling os-brick to attach iSCSI Volume {{(pid=85141) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 10:21:38 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-b88d16f6-7877-4ba6-8d2d-fe7f68d9855e tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51806b6080>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ca5a51ee-cdb2-4efa-b7e5-8a97d0c99bf7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ercfVhZa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 10:21:38 user nova-compute[85141]: WARNING os_brick.initiator.connectors.base [None req-b88d16f6-7877-4ba6-8d2d-fe7f68d9855e tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 10:21:38 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-b88d16f6-7877-4ba6-8d2d-fe7f68d9855e tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 10:21:38 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:674f9ae8-6ab5-4ff2-b715-fe8807c34793 -p 172.16.0.220:3260 {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:21:38 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:674f9ae8-6ab5-4ff2-b715-fe8807c34793 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:21:38 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[b43bdd3d-a5e3-4bf9-ab7a-b9eb985df34b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:21:38 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-de9d0f76-e9eb-4864-aa68-4fdcadf98693 tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 10:21:38 user nova-compute[85141]:  {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:21:38 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:674f9ae8-6ab5-4ff2-b715-fe8807c34793 -p 172.16.0.220:3260 --interface default --op new {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:21:38 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:674f9ae8-6ab5-4ff2-b715-fe8807c34793 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:21:38 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b9ec101-8498-4d6b-ad1d-fddde6776742]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:674f9ae8-6ab5-4ff2-b715-fe8807c34793] added\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:21:38 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-de9d0f76-e9eb-4864-aa68-4fdcadf98693 tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:674f9ae8-6ab5-4ff2-b715-fe8807c34793] added
Nov 16 10:21:38 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:21:38 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:674f9ae8-6ab5-4ff2-b715-fe8807c34793 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:21:38 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:674f9ae8-6ab5-4ff2-b715-fe8807c34793 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:21:38 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[21a6c0b1-c93e-472d-9445-ac55ee7d5311]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:21:38 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-de9d0f76-e9eb-4864-aa68-4fdcadf98693 tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:21:38 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:674f9ae8-6ab5-4ff2-b715-fe8807c34793 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:21:38 user nova-compute[85141]: DEBUG nova.compute.provider_tree [None req-2cbc5a55-c109-48fa-af33-f0de5eb77452 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Inventory has not changed in ProviderTree for provider: bf8e0fa1-16b6-408f-9203-c4cd63916272 {{(pid=85141) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 10:21:38 user nova-compute[85141]: DEBUG nova.scheduler.client.report [None req-2cbc5a55-c109-48fa-af33-f0de5eb77452 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Inventory has not changed for provider bf8e0fa1-16b6-408f-9203-c4cd63916272 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=85141) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 10:21:38 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:674f9ae8-6ab5-4ff2-b715-fe8807c34793 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:21:38 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[b30c71d0-c9af-45f5-a745-b50402c86a88]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:21:38 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-de9d0f76-e9eb-4864-aa68-4fdcadf98693 tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:21:38 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:674f9ae8-6ab5-4ff2-b715-fe8807c34793 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qDxyoBhW {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:21:38 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-2cbc5a55-c109-48fa-af33-f0de5eb77452 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.616s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:21:38 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:674f9ae8-6ab5-4ff2-b715-fe8807c34793 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qDxyoBhW" returned: 0 in 0.018s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:21:38 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e15d461-1ea8-40ea-a4de-1d0587a30df1]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:21:38 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-de9d0f76-e9eb-4864-aa68-4fdcadf98693 tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qDxyoBhW'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:21:38 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:674f9ae8-6ab5-4ff2-b715-fe8807c34793 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:21:38 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:674f9ae8-6ab5-4ff2-b715-fe8807c34793 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:21:38 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[36729b0d-771e-497a-b7c5-6f510966c4ae]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:21:38 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-de9d0f76-e9eb-4864-aa68-4fdcadf98693 tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:21:38 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:21:38 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:21:38 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[22daf229-bbc2-48ad-a5d7-f0664e41faed]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3392fa71-5ceb-42f9-acb8-b9e69b8b1cfa (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7784b4-2ba5-4085-9e17-877c754115c8 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dc504e0-da46-4c57-a66d-8ae6ce9c733c (non-flash)\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:21:38 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-de9d0f76-e9eb-4864-aa68-4fdcadf98693 tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)
Nov 16 10:21:38 user nova-compute[85141]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3392fa71-5ceb-42f9-acb8-b9e69b8b1cfa (non-flash)
Nov 16 10:21:38 user nova-compute[85141]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7784b4-2ba5-4085-9e17-877c754115c8 (non-flash)
Nov 16 10:21:38 user nova-compute[85141]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dc504e0-da46-4c57-a66d-8ae6ce9c733c (non-flash)
Nov 16 10:21:38 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:21:38 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-de9d0f76-e9eb-4864-aa68-4fdcadf98693 tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)
Nov 16 10:21:38 user nova-compute[85141]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3392fa71-5ceb-42f9-acb8-b9e69b8b1cfa (non-flash)
Nov 16 10:21:38 user nova-compute[85141]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7784b4-2ba5-4085-9e17-877c754115c8 (non-flash)
Nov 16 10:21:38 user nova-compute[85141]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dc504e0-da46-4c57-a66d-8ae6ce9c733c (non-flash)
Nov 16 10:21:38 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 10:21:38 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:674f9ae8-6ab5-4ff2-b715-fe8807c34793 -p 172.16.0.220:3260 --login {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:21:38 user nova-compute[85141]: INFO nova.network.neutron [None req-2cbc5a55-c109-48fa-af33-f0de5eb77452 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] [instance: bff3a84b-6ab5-4256-8a04-2d21a4ba20b3] Updating port 23ec0327-ca81-4524-8850-2c081e596d44 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 16 10:21:38 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:674f9ae8-6ab5-4ff2-b715-fe8807c34793 -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:21:38 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[f036c34f-7a94-4e06-9295-ffbdff3164a1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:674f9ae8-6ab5-4ff2-b715-fe8807c34793, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:674f9ae8-6ab5-4ff2-b715-fe8807c34793, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:21:38 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-de9d0f76-e9eb-4864-aa68-4fdcadf98693 tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:674f9ae8-6ab5-4ff2-b715-fe8807c34793, portal: 172.16.0.220,3260]
Nov 16 10:21:38 user nova-compute[85141]: Login to [iface: default, target: iqn.2010-10.org.openstack:674f9ae8-6ab5-4ff2-b715-fe8807c34793, portal: 172.16.0.220,3260] successful.
Nov 16 10:21:38 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:21:38 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:674f9ae8-6ab5-4ff2-b715-fe8807c34793 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:21:38 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:674f9ae8-6ab5-4ff2-b715-fe8807c34793 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:21:38 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[19f5199f-8e7d-478e-b3f0-edeea1c930b1]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:21:38 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-de9d0f76-e9eb-4864-aa68-4fdcadf98693 tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:21:38 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:21:39 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:21:39 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6e9fccf-4866-4c55-9e80-8e2a2ddda361]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3392fa71-5ceb-42f9-acb8-b9e69b8b1cfa (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7784b4-2ba5-4085-9e17-877c754115c8 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dc504e0-da46-4c57-a66d-8ae6ce9c733c (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:674f9ae8-6ab5-4ff2-b715-fe8807c34793 (non-flash)\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:21:39 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-de9d0f76-e9eb-4864-aa68-4fdcadf98693 tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)
Nov 16 10:21:39 user nova-compute[85141]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3392fa71-5ceb-42f9-acb8-b9e69b8b1cfa (non-flash)
Nov 16 10:21:39 user nova-compute[85141]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7784b4-2ba5-4085-9e17-877c754115c8 (non-flash)
Nov 16 10:21:39 user nova-compute[85141]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dc504e0-da46-4c57-a66d-8ae6ce9c733c (non-flash)
Nov 16 10:21:39 user nova-compute[85141]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:674f9ae8-6ab5-4ff2-b715-fe8807c34793 (non-flash)
Nov 16 10:21:39 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:21:39 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-de9d0f76-e9eb-4864-aa68-4fdcadf98693 tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)
Nov 16 10:21:39 user nova-compute[85141]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3392fa71-5ceb-42f9-acb8-b9e69b8b1cfa (non-flash)
Nov 16 10:21:39 user nova-compute[85141]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7784b4-2ba5-4085-9e17-877c754115c8 (non-flash)
Nov 16 10:21:39 user nova-compute[85141]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dc504e0-da46-4c57-a66d-8ae6ce9c733c (non-flash)
Nov 16 10:21:39 user nova-compute[85141]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:674f9ae8-6ab5-4ff2-b715-fe8807c34793 (non-flash)
Nov 16 10:21:39 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 10:21:39 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-de9d0f76-e9eb-4864-aa68-4fdcadf98693 tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:674f9ae8-6ab5-4ff2-b715-fe8807c34793" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.317s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 10:21:39 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-de9d0f76-e9eb-4864-aa68-4fdcadf98693 tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] Connected to 172.16.0.220:3260 {{(pid=85141) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 10:21:39 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-de9d0f76-e9eb-4864-aa68-4fdcadf98693 tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] HCTL ('37', '-', '-', 0) found on session 32 with lun 0 {{(pid=85141) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 10:21:39 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-de9d0f76-e9eb-4864-aa68-4fdcadf98693 tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=85141) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 10:21:39 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:21:39 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.019s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:21:39 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d56bd04-7935-46b5-ae28-0d576eb0ad13]: (4, ('- - 0', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:21:39 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-de9d0f76-e9eb-4864-aa68-4fdcadf98693 tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] Searching for a device in session 32 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=85141) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 10:21:39 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-de9d0f76-e9eb-4864-aa68-4fdcadf98693 tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:674f9ae8-6ab5-4ff2-b715-fe8807c34793', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qDxyoBhW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=85141) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 10:21:39 user nova-compute[85141]: DEBUG nova.network.neutron [req-b1aff09d-06c5-42d6-bae4-c2e2b95bed87 req-11ded88b-9d2b-4bf4-978b-b15c135b417c service nova] [instance: e88874fe-b0a6-4292-8832-023f95e4f53c] Updated VIF entry in instance network info cache for port 7bbea642-d504-433b-ae99-8e7159942751. {{(pid=85141) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 10:21:39 user nova-compute[85141]: DEBUG nova.network.neutron [req-b1aff09d-06c5-42d6-bae4-c2e2b95bed87 req-11ded88b-9d2b-4bf4-978b-b15c135b417c service nova] [instance: e88874fe-b0a6-4292-8832-023f95e4f53c] Updating instance_info_cache with network_info: [{"id": "7bbea642-d504-433b-ae99-8e7159942751", "address": "fa:16:3e:6a:e8:c6", "network": {"id": "3fc8f327-8ef7-4b60-abf0-31d75e40478e", "bridge": "br-int", "label": "tempest-TestShelveInstance-452311162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fc33dd813c64594a3626d2e7dff09ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bbea642-d5", "ovs_interfaceid": "7bbea642-d504-433b-ae99-8e7159942751", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:21:39 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-b1aff09d-06c5-42d6-bae4-c2e2b95bed87 req-11ded88b-9d2b-4bf4-978b-b15c135b417c service nova] Releasing lock "refresh_cache-e88874fe-b0a6-4292-8832-023f95e4f53c" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:21:39 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-2cbc5a55-c109-48fa-af33-f0de5eb77452 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Acquiring lock "refresh_cache-bff3a84b-6ab5-4256-8a04-2d21a4ba20b3" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:21:39 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-2cbc5a55-c109-48fa-af33-f0de5eb77452 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Acquired lock "refresh_cache-bff3a84b-6ab5-4256-8a04-2d21a4ba20b3" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:21:39 user nova-compute[85141]: DEBUG nova.network.neutron [None req-2cbc5a55-c109-48fa-af33-f0de5eb77452 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] [instance: bff3a84b-6ab5-4256-8a04-2d21a4ba20b3] Building network info cache for instance {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 10:21:40 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-de9d0f76-e9eb-4864-aa68-4fdcadf98693 tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.352s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 10:21:40 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-de9d0f76-e9eb-4864-aa68-4fdcadf98693 tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] <== connect_volume: return (1353ms) {'type': 'block', 'scsi_wwn': '26133636236623535', 'path': '/dev/sdf'} {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 10:21:40 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-de9d0f76-e9eb-4864-aa68-4fdcadf98693 tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] [instance: e88874fe-b0a6-4292-8832-023f95e4f53c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26133636236623535', 'path': '/dev/sdf'} {{(pid=85141) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 10:21:40 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-b88d16f6-7877-4ba6-8d2d-fe7f68d9855e tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.321s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 10:21:40 user nova-compute[85141]: WARNING os_brick.initiator.connectors.base [None req-b88d16f6-7877-4ba6-8d2d-fe7f68d9855e tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 10:21:40 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-b88d16f6-7877-4ba6-8d2d-fe7f68d9855e tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ca5a51ee-cdb2-4efa-b7e5-8a97d0c99bf7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 10:21:40 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-b88d16f6-7877-4ba6-8d2d-fe7f68d9855e tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ca5a51ee-cdb2-4efa-b7e5-8a97d0c99bf7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 10:21:40 user nova-compute[85141]: INFO os_brick.initiator.connectors.iscsi [None req-b88d16f6-7877-4ba6-8d2d-fe7f68d9855e tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 10:21:40 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca5a51ee-cdb2-4efa-b7e5-8a97d0c99bf7 -p 172.16.0.220:3260 {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:21:40 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca5a51ee-cdb2-4efa-b7e5-8a97d0c99bf7 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:21:40 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fdead60-6587-42f1-b8b0-78fbeaef6573]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:21:40 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-b88d16f6-7877-4ba6-8d2d-fe7f68d9855e tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 10:21:40 user nova-compute[85141]:  {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:21:40 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca5a51ee-cdb2-4efa-b7e5-8a97d0c99bf7 -p 172.16.0.220:3260 --interface default --op new {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:21:40 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-de9d0f76-e9eb-4864-aa68-4fdcadf98693 tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-16T10:17:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-2111105262',display_name='tempest-TestShelveInstance-server-2111105262',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-2111105262',id=24,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1696654997',keypairs=<?>,launch_index=0,launched_at=2023-11-16T10:18:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='5fc33dd813c64594a3626d2e7dff09ad',ramdisk_id='',reservation_id='r-7djljt23',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-289614798',owner_user_name='tempest-TestShelveInstance-289614798-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T10:21:30Z,user_data=None,user_id='462543c542ac4e84b99277f8cdd29807',uuid=e88874fe-b0a6-4292-8832-023f95e4f53c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "7bbea642-d504-433b-ae99-8e7159942751", "address": "fa:16:3e:6a:e8:c6", "network": {"id": "3fc8f327-8ef7-4b60-abf0-31d75e40478e", "bridge": "br-int", "label": "tempest-TestShelveInstance-452311162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fc33dd813c64594a3626d2e7dff09ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bbea642-d5", "ovs_interfaceid": "7bbea642-d504-433b-ae99-8e7159942751", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=85141) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 10:21:40 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-de9d0f76-e9eb-4864-aa68-4fdcadf98693 tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] Converting VIF {"id": "7bbea642-d504-433b-ae99-8e7159942751", "address": "fa:16:3e:6a:e8:c6", "network": {"id": "3fc8f327-8ef7-4b60-abf0-31d75e40478e", "bridge": "br-int", "label": "tempest-TestShelveInstance-452311162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fc33dd813c64594a3626d2e7dff09ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bbea642-d5", "ovs_interfaceid": "7bbea642-d504-433b-ae99-8e7159942751", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:21:40 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-de9d0f76-e9eb-4864-aa68-4fdcadf98693 tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6a:e8:c6,bridge_name='br-int',has_traffic_filtering=True,id=7bbea642-d504-433b-ae99-8e7159942751,network=Network(3fc8f327-8ef7-4b60-abf0-31d75e40478e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7bbea642-d5') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:21:40 user nova-compute[85141]: DEBUG nova.objects.instance [None req-de9d0f76-e9eb-4864-aa68-4fdcadf98693 tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] Lazy-loading 'pci_devices' on Instance uuid e88874fe-b0a6-4292-8832-023f95e4f53c {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:21:40 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca5a51ee-cdb2-4efa-b7e5-8a97d0c99bf7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:21:40 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a6b6e68-eaad-4703-bb81-f85408b8badd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ca5a51ee-cdb2-4efa-b7e5-8a97d0c99bf7] added\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:21:40 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-b88d16f6-7877-4ba6-8d2d-fe7f68d9855e tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ca5a51ee-cdb2-4efa-b7e5-8a97d0c99bf7] added
Nov 16 10:21:40 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:21:40 user nova-compute[85141]: DEBUG nova.objects.base [None req-de9d0f76-e9eb-4864-aa68-4fdcadf98693 tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] Object Instance<e88874fe-b0a6-4292-8832-023f95e4f53c> lazy-loaded attributes: pci_requests,vcpu_model,pci_devices {{(pid=85141) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 10:21:40 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-de9d0f76-e9eb-4864-aa68-4fdcadf98693 tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] [instance: e88874fe-b0a6-4292-8832-023f95e4f53c] End _get_guest_xml xml=<domain type="kvm">
Nov 16 10:21:40 user nova-compute[85141]:   <uuid>e88874fe-b0a6-4292-8832-023f95e4f53c</uuid>
Nov 16 10:21:40 user nova-compute[85141]:   <name>instance-00000018</name>
Nov 16 10:21:40 user nova-compute[85141]:   <memory>524288</memory>
Nov 16 10:21:40 user nova-compute[85141]:   <vcpu>1</vcpu>
Nov 16 10:21:40 user nova-compute[85141]:   <metadata>
Nov 16 10:21:40 user nova-compute[85141]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 10:21:40 user nova-compute[85141]:       <nova:package version="0.0.0"/>
Nov 16 10:21:40 user nova-compute[85141]:       <nova:name>tempest-TestShelveInstance-server-2111105262</nova:name>
Nov 16 10:21:40 user nova-compute[85141]:       <nova:creationTime>2023-11-16 10:21:38</nova:creationTime>
Nov 16 10:21:40 user nova-compute[85141]:       <nova:flavor name="m1.tiny">
Nov 16 10:21:40 user nova-compute[85141]:         <nova:memory>512</nova:memory>
Nov 16 10:21:40 user nova-compute[85141]:         <nova:disk>1</nova:disk>
Nov 16 10:21:40 user nova-compute[85141]:         <nova:swap>0</nova:swap>
Nov 16 10:21:40 user nova-compute[85141]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 10:21:40 user nova-compute[85141]:         <nova:vcpus>1</nova:vcpus>
Nov 16 10:21:40 user nova-compute[85141]:       </nova:flavor>
Nov 16 10:21:40 user nova-compute[85141]:       <nova:owner>
Nov 16 10:21:40 user nova-compute[85141]:         <nova:user uuid="462543c542ac4e84b99277f8cdd29807">tempest-TestShelveInstance-289614798-project-member</nova:user>
Nov 16 10:21:40 user nova-compute[85141]:         <nova:project uuid="5fc33dd813c64594a3626d2e7dff09ad">tempest-TestShelveInstance-289614798</nova:project>
Nov 16 10:21:40 user nova-compute[85141]:       </nova:owner>
Nov 16 10:21:40 user nova-compute[85141]:       <nova:ports>
Nov 16 10:21:40 user nova-compute[85141]:         <nova:port uuid="7bbea642-d504-433b-ae99-8e7159942751">
Nov 16 10:21:40 user nova-compute[85141]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 16 10:21:40 user nova-compute[85141]:         </nova:port>
Nov 16 10:21:40 user nova-compute[85141]:       </nova:ports>
Nov 16 10:21:40 user nova-compute[85141]:     </nova:instance>
Nov 16 10:21:40 user nova-compute[85141]:   </metadata>
Nov 16 10:21:40 user nova-compute[85141]:   <sysinfo type="smbios">
Nov 16 10:21:40 user nova-compute[85141]:     <system>
Nov 16 10:21:40 user nova-compute[85141]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 10:21:40 user nova-compute[85141]:       <entry name="product">OpenStack Nova</entry>
Nov 16 10:21:40 user nova-compute[85141]:       <entry name="version">0.0.0</entry>
Nov 16 10:21:40 user nova-compute[85141]:       <entry name="serial">e88874fe-b0a6-4292-8832-023f95e4f53c</entry>
Nov 16 10:21:40 user nova-compute[85141]:       <entry name="uuid">e88874fe-b0a6-4292-8832-023f95e4f53c</entry>
Nov 16 10:21:40 user nova-compute[85141]:       <entry name="family">Virtual Machine</entry>
Nov 16 10:21:40 user nova-compute[85141]:     </system>
Nov 16 10:21:40 user nova-compute[85141]:   </sysinfo>
Nov 16 10:21:40 user nova-compute[85141]:   <os>
Nov 16 10:21:40 user nova-compute[85141]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 10:21:40 user nova-compute[85141]:     <boot dev="hd"/>
Nov 16 10:21:40 user nova-compute[85141]:     <smbios mode="sysinfo"/>
Nov 16 10:21:40 user nova-compute[85141]:   </os>
Nov 16 10:21:40 user nova-compute[85141]:   <features>
Nov 16 10:21:40 user nova-compute[85141]:     <acpi/>
Nov 16 10:21:40 user nova-compute[85141]:     <apic/>
Nov 16 10:21:40 user nova-compute[85141]:     <vmcoreinfo/>
Nov 16 10:21:40 user nova-compute[85141]:   </features>
Nov 16 10:21:40 user nova-compute[85141]:   <clock offset="utc">
Nov 16 10:21:40 user nova-compute[85141]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 10:21:40 user nova-compute[85141]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 10:21:40 user nova-compute[85141]:     <timer name="hpet" present="no"/>
Nov 16 10:21:40 user nova-compute[85141]:   </clock>
Nov 16 10:21:40 user nova-compute[85141]:   <cpu mode="custom" match="exact">
Nov 16 10:21:40 user nova-compute[85141]:     <model>Nehalem</model>
Nov 16 10:21:40 user nova-compute[85141]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 10:21:40 user nova-compute[85141]:   </cpu>
Nov 16 10:21:40 user nova-compute[85141]:   <devices>
Nov 16 10:21:40 user nova-compute[85141]:     <disk type="block" device="disk">
Nov 16 10:21:40 user nova-compute[85141]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 10:21:40 user nova-compute[85141]:       <source dev="/dev/sdf"/>
Nov 16 10:21:40 user nova-compute[85141]:       <target dev="vda" bus="virtio"/>
Nov 16 10:21:40 user nova-compute[85141]:       <serial>674f9ae8-6ab5-4ff2-b715-fe8807c34793</serial>
Nov 16 10:21:40 user nova-compute[85141]:     </disk>
Nov 16 10:21:40 user nova-compute[85141]:     <interface type="ethernet">
Nov 16 10:21:40 user nova-compute[85141]:       <mac address="fa:16:3e:6a:e8:c6"/>
Nov 16 10:21:40 user nova-compute[85141]:       <model type="virtio"/>
Nov 16 10:21:40 user nova-compute[85141]:       <mtu size="1442"/>
Nov 16 10:21:40 user nova-compute[85141]:       <target dev="tap7bbea642-d5"/>
Nov 16 10:21:40 user nova-compute[85141]:     </interface>
Nov 16 10:21:40 user nova-compute[85141]:     <serial type="pty">
Nov 16 10:21:40 user nova-compute[85141]:       <log file="/opt/stack/data/nova/instances/e88874fe-b0a6-4292-8832-023f95e4f53c/console.log" append="off"/>
Nov 16 10:21:40 user nova-compute[85141]:     </serial>
Nov 16 10:21:40 user nova-compute[85141]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 10:21:40 user nova-compute[85141]:     <video>
Nov 16 10:21:40 user nova-compute[85141]:       <model type="virtio"/>
Nov 16 10:21:40 user nova-compute[85141]:     </video>
Nov 16 10:21:40 user nova-compute[85141]:     <rng model="virtio">
Nov 16 10:21:40 user nova-compute[85141]:       <backend model="random">/dev/urandom</backend>
Nov 16 10:21:40 user nova-compute[85141]:     </rng>
Nov 16 10:21:40 user nova-compute[85141]:     <controller type="usb" index="0" model="none"/>
Nov 16 10:21:40 user nova-compute[85141]:     <memballoon model="virtio">
Nov 16 10:21:40 user nova-compute[85141]:       <stats period="10"/>
Nov 16 10:21:40 user nova-compute[85141]:     </memballoon>
Nov 16 10:21:40 user nova-compute[85141]:   </devices>
Nov 16 10:21:40 user nova-compute[85141]: </domain>
Nov 16 10:21:40 user nova-compute[85141]:  {{(pid=85141) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 10:21:40 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-de9d0f76-e9eb-4864-aa68-4fdcadf98693 tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-16T10:17:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-2111105262',display_name='tempest-TestShelveInstance-server-2111105262',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-2111105262',id=24,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1696654997',keypairs=<?>,launch_index=0,launched_at=2023-11-16T10:18:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='5fc33dd813c64594a3626d2e7dff09ad',ramdisk_id='',reservation_id='r-7djljt23',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-289614798',owner_user_name='tempest-TestShelveInstance-289614798-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T10:21:30Z,user_data=None,user_id='462543c542ac4e84b99277f8cdd29807',uuid=e88874fe-b0a6-4292-8832-023f95e4f53c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "7bbea642-d504-433b-ae99-8e7159942751", "address": "fa:16:3e:6a:e8:c6", "network": {"id": "3fc8f327-8ef7-4b60-abf0-31d75e40478e", "bridge": "br-int", "label": "tempest-TestShelveInstance-452311162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fc33dd813c64594a3626d2e7dff09ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bbea642-d5", "ovs_interfaceid": "7bbea642-d504-433b-ae99-8e7159942751", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 10:21:40 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-de9d0f76-e9eb-4864-aa68-4fdcadf98693 tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] Converting VIF {"id": "7bbea642-d504-433b-ae99-8e7159942751", "address": "fa:16:3e:6a:e8:c6", "network": {"id": "3fc8f327-8ef7-4b60-abf0-31d75e40478e", "bridge": "br-int", "label": "tempest-TestShelveInstance-452311162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fc33dd813c64594a3626d2e7dff09ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bbea642-d5", "ovs_interfaceid": "7bbea642-d504-433b-ae99-8e7159942751", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:21:40 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-de9d0f76-e9eb-4864-aa68-4fdcadf98693 tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6a:e8:c6,bridge_name='br-int',has_traffic_filtering=True,id=7bbea642-d504-433b-ae99-8e7159942751,network=Network(3fc8f327-8ef7-4b60-abf0-31d75e40478e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7bbea642-d5') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:21:40 user nova-compute[85141]: DEBUG os_vif [None req-de9d0f76-e9eb-4864-aa68-4fdcadf98693 tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:e8:c6,bridge_name='br-int',has_traffic_filtering=True,id=7bbea642-d504-433b-ae99-8e7159942751,network=Network(3fc8f327-8ef7-4b60-abf0-31d75e40478e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7bbea642-d5') {{(pid=85141) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 10:21:40 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca5a51ee-cdb2-4efa-b7e5-8a97d0c99bf7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:21:40 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:21:40 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:21:40 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 10:21:40 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:21:40 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '279738f6-68c2-5eec-b55e-6c54fe32c174', '_type': 'linux-noop'}}, row=False) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:21:40 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:21:40 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:21:40 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7bbea642-d5, may_exist=True, interface_attrs={}) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:21:40 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7bbea642-d5, col_values=(('qos', UUID('3eb7a761-d8c3-4715-acf0-b8176a69ed02')),), if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:21:40 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7bbea642-d5, col_values=(('external_ids', {'iface-id': '7bbea642-d504-433b-ae99-8e7159942751', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6a:e8:c6', 'vm-uuid': 'e88874fe-b0a6-4292-8832-023f95e4f53c'}),), if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:21:40 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca5a51ee-cdb2-4efa-b7e5-8a97d0c99bf7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:21:40 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[385ca100-f489-42bf-82f1-9852ee141f98]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:21:40 user nova-compute[85141]: DEBUG nova.network.neutron [None req-2cbc5a55-c109-48fa-af33-f0de5eb77452 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] [instance: bff3a84b-6ab5-4256-8a04-2d21a4ba20b3] Updating instance_info_cache with network_info: [{"id": "23ec0327-ca81-4524-8850-2c081e596d44", "address": "fa:16:3e:e1:61:4a", "network": {"id": "4fb7c85e-c966-481d-b6f2-856a17ac8f7c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-81570496-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08ef12fb41a14ecd8abb84d4d69b7c27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23ec0327-ca", "ovs_interfaceid": "23ec0327-ca81-4524-8850-2c081e596d44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:21:40 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-b88d16f6-7877-4ba6-8d2d-fe7f68d9855e tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:21:40 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:21:40 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca5a51ee-cdb2-4efa-b7e5-8a97d0c99bf7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:21:40 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:21:40 user nova-compute[85141]: INFO os_vif [None req-de9d0f76-e9eb-4864-aa68-4fdcadf98693 tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:e8:c6,bridge_name='br-int',has_traffic_filtering=True,id=7bbea642-d504-433b-ae99-8e7159942751,network=Network(3fc8f327-8ef7-4b60-abf0-31d75e40478e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7bbea642-d5')
Nov 16 10:21:40 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-2cbc5a55-c109-48fa-af33-f0de5eb77452 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Releasing lock "refresh_cache-bff3a84b-6ab5-4256-8a04-2d21a4ba20b3" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:21:40 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-2cbc5a55-c109-48fa-af33-f0de5eb77452 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] [instance: bff3a84b-6ab5-4256-8a04-2d21a4ba20b3] Creating instance directory {{(pid=85141) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 10:21:40 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-2cbc5a55-c109-48fa-af33-f0de5eb77452 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] [instance: bff3a84b-6ab5-4256-8a04-2d21a4ba20b3] Creating image(s)
Nov 16 10:21:40 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-2cbc5a55-c109-48fa-af33-f0de5eb77452 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Acquiring lock "/opt/stack/data/nova/instances/bff3a84b-6ab5-4256-8a04-2d21a4ba20b3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:21:40 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-2cbc5a55-c109-48fa-af33-f0de5eb77452 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Lock "/opt/stack/data/nova/instances/bff3a84b-6ab5-4256-8a04-2d21a4ba20b3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:21:40 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-2cbc5a55-c109-48fa-af33-f0de5eb77452 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Lock "/opt/stack/data/nova/instances/bff3a84b-6ab5-4256-8a04-2d21a4ba20b3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:21:40 user nova-compute[85141]: DEBUG nova.objects.instance [None req-2cbc5a55-c109-48fa-af33-f0de5eb77452 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Lazy-loading 'trusted_certs' on Instance uuid bff3a84b-6ab5-4256-8a04-2d21a4ba20b3 {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:21:40 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca5a51ee-cdb2-4efa-b7e5-8a97d0c99bf7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:21:40 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[c51fe58b-b4a1-471e-b523-0ae0dfd10f00]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:21:40 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-b88d16f6-7877-4ba6-8d2d-fe7f68d9855e tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:21:40 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca5a51ee-cdb2-4efa-b7e5-8a97d0c99bf7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ercfVhZa {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:21:40 user nova-compute[85141]: DEBUG nova.objects.base [None req-2cbc5a55-c109-48fa-af33-f0de5eb77452 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Object Instance<bff3a84b-6ab5-4256-8a04-2d21a4ba20b3> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=85141) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 10:21:40 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-2cbc5a55-c109-48fa-af33-f0de5eb77452 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Acquiring lock "7e3d9019f7dd8ef3fdb6ca41a43cba4d9ba989b4" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:21:40 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-2cbc5a55-c109-48fa-af33-f0de5eb77452 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Lock "7e3d9019f7dd8ef3fdb6ca41a43cba4d9ba989b4" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:21:40 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca5a51ee-cdb2-4efa-b7e5-8a97d0c99bf7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ercfVhZa" returned: 0 in 0.027s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:21:40 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0d34c30-78c4-4d9e-8e35-7db2a3ff96f3]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:21:40 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-b88d16f6-7877-4ba6-8d2d-fe7f68d9855e tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ercfVhZa'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:21:40 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca5a51ee-cdb2-4efa-b7e5-8a97d0c99bf7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:21:40 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-de9d0f76-e9eb-4864-aa68-4fdcadf98693 tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] No BDM found with device name vda, not building metadata. {{(pid=85141) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 10:21:40 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-de9d0f76-e9eb-4864-aa68-4fdcadf98693 tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] No VIF found with MAC fa:16:3e:6a:e8:c6, not building metadata {{(pid=85141) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 10:21:40 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca5a51ee-cdb2-4efa-b7e5-8a97d0c99bf7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:21:40 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[27b331fc-863c-4b83-bc0f-268f16a8ba32]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:21:40 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-b88d16f6-7877-4ba6-8d2d-fe7f68d9855e tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:21:40 user nova-compute[85141]: DEBUG nova.compute.manager [req-58919734-7988-4a43-927e-3efa0142fff3 req-376aab39-99b3-4055-885a-34c62f4246da service nova] [instance: bff3a84b-6ab5-4256-8a04-2d21a4ba20b3] Received event network-changed-23ec0327-ca81-4524-8850-2c081e596d44 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:21:40 user nova-compute[85141]: DEBUG nova.compute.manager [req-58919734-7988-4a43-927e-3efa0142fff3 req-376aab39-99b3-4055-885a-34c62f4246da service nova] [instance: bff3a84b-6ab5-4256-8a04-2d21a4ba20b3] Refreshing instance network info cache due to event network-changed-23ec0327-ca81-4524-8850-2c081e596d44. {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 10:21:40 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-58919734-7988-4a43-927e-3efa0142fff3 req-376aab39-99b3-4055-885a-34c62f4246da service nova] Acquiring lock "refresh_cache-bff3a84b-6ab5-4256-8a04-2d21a4ba20b3" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:21:40 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-58919734-7988-4a43-927e-3efa0142fff3 req-376aab39-99b3-4055-885a-34c62f4246da service nova] Acquired lock "refresh_cache-bff3a84b-6ab5-4256-8a04-2d21a4ba20b3" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:21:40 user nova-compute[85141]: DEBUG nova.network.neutron [req-58919734-7988-4a43-927e-3efa0142fff3 req-376aab39-99b3-4055-885a-34c62f4246da service nova] [instance: bff3a84b-6ab5-4256-8a04-2d21a4ba20b3] Refreshing network info cache for port 23ec0327-ca81-4524-8850-2c081e596d44 {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 10:21:40 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:21:40 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:21:40 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[1524d2cc-1911-43d2-bd05-efaaf572af8d]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3392fa71-5ceb-42f9-acb8-b9e69b8b1cfa (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7784b4-2ba5-4085-9e17-877c754115c8 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dc504e0-da46-4c57-a66d-8ae6ce9c733c (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:674f9ae8-6ab5-4ff2-b715-fe8807c34793 (non-flash)\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:21:40 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-b88d16f6-7877-4ba6-8d2d-fe7f68d9855e tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)
Nov 16 10:21:40 user nova-compute[85141]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3392fa71-5ceb-42f9-acb8-b9e69b8b1cfa (non-flash)
Nov 16 10:21:40 user nova-compute[85141]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7784b4-2ba5-4085-9e17-877c754115c8 (non-flash)
Nov 16 10:21:40 user nova-compute[85141]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dc504e0-da46-4c57-a66d-8ae6ce9c733c (non-flash)
Nov 16 10:21:40 user nova-compute[85141]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:674f9ae8-6ab5-4ff2-b715-fe8807c34793 (non-flash)
Nov 16 10:21:40 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:21:40 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-b88d16f6-7877-4ba6-8d2d-fe7f68d9855e tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)
Nov 16 10:21:40 user nova-compute[85141]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3392fa71-5ceb-42f9-acb8-b9e69b8b1cfa (non-flash)
Nov 16 10:21:40 user nova-compute[85141]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7784b4-2ba5-4085-9e17-877c754115c8 (non-flash)
Nov 16 10:21:40 user nova-compute[85141]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dc504e0-da46-4c57-a66d-8ae6ce9c733c (non-flash)
Nov 16 10:21:40 user nova-compute[85141]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:674f9ae8-6ab5-4ff2-b715-fe8807c34793 (non-flash)
Nov 16 10:21:40 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 10:21:40 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca5a51ee-cdb2-4efa-b7e5-8a97d0c99bf7 -p 172.16.0.220:3260 --login {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:21:41 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-2cbc5a55-c109-48fa-af33-f0de5eb77452 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e3d9019f7dd8ef3fdb6ca41a43cba4d9ba989b4.part --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:21:41 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:21:41 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca5a51ee-cdb2-4efa-b7e5-8a97d0c99bf7 -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:21:41 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8c82f7f-ac06-4013-ac8e-b6576de4046b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ca5a51ee-cdb2-4efa-b7e5-8a97d0c99bf7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ca5a51ee-cdb2-4efa-b7e5-8a97d0c99bf7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:21:41 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:21:41 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-b88d16f6-7877-4ba6-8d2d-fe7f68d9855e tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ca5a51ee-cdb2-4efa-b7e5-8a97d0c99bf7, portal: 172.16.0.220,3260]
Nov 16 10:21:41 user nova-compute[85141]: Login to [iface: default, target: iqn.2010-10.org.openstack:ca5a51ee-cdb2-4efa-b7e5-8a97d0c99bf7, portal: 172.16.0.220,3260] successful.
Nov 16 10:21:41 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:21:41 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca5a51ee-cdb2-4efa-b7e5-8a97d0c99bf7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:21:41 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca5a51ee-cdb2-4efa-b7e5-8a97d0c99bf7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:21:41 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[a92434fa-609c-43fc-8a78-e1766a57360b]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:21:41 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-b88d16f6-7877-4ba6-8d2d-fe7f68d9855e tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:21:41 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:21:41 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:21:41 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd6c0e8b-85f4-4360-a71b-1d1188bbf3d3]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3392fa71-5ceb-42f9-acb8-b9e69b8b1cfa (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7784b4-2ba5-4085-9e17-877c754115c8 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dc504e0-da46-4c57-a66d-8ae6ce9c733c (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:674f9ae8-6ab5-4ff2-b715-fe8807c34793 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca5a51ee-cdb2-4efa-b7e5-8a97d0c99bf7 (non-flash)\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:21:41 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-b88d16f6-7877-4ba6-8d2d-fe7f68d9855e tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)
Nov 16 10:21:41 user nova-compute[85141]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3392fa71-5ceb-42f9-acb8-b9e69b8b1cfa (non-flash)
Nov 16 10:21:41 user nova-compute[85141]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7784b4-2ba5-4085-9e17-877c754115c8 (non-flash)
Nov 16 10:21:41 user nova-compute[85141]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dc504e0-da46-4c57-a66d-8ae6ce9c733c (non-flash)
Nov 16 10:21:41 user nova-compute[85141]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:674f9ae8-6ab5-4ff2-b715-fe8807c34793 (non-flash)
Nov 16 10:21:41 user nova-compute[85141]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca5a51ee-cdb2-4efa-b7e5-8a97d0c99bf7 (non-flash)
Nov 16 10:21:41 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:21:41 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-b88d16f6-7877-4ba6-8d2d-fe7f68d9855e tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)
Nov 16 10:21:41 user nova-compute[85141]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3392fa71-5ceb-42f9-acb8-b9e69b8b1cfa (non-flash)
Nov 16 10:21:41 user nova-compute[85141]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7784b4-2ba5-4085-9e17-877c754115c8 (non-flash)
Nov 16 10:21:41 user nova-compute[85141]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dc504e0-da46-4c57-a66d-8ae6ce9c733c (non-flash)
Nov 16 10:21:41 user nova-compute[85141]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:674f9ae8-6ab5-4ff2-b715-fe8807c34793 (non-flash)
Nov 16 10:21:41 user nova-compute[85141]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca5a51ee-cdb2-4efa-b7e5-8a97d0c99bf7 (non-flash)
Nov 16 10:21:41 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 10:21:41 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-b88d16f6-7877-4ba6-8d2d-fe7f68d9855e tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ca5a51ee-cdb2-4efa-b7e5-8a97d0c99bf7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.283s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 10:21:41 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-b88d16f6-7877-4ba6-8d2d-fe7f68d9855e tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Connected to 172.16.0.220:3260 {{(pid=85141) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 10:21:41 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-b88d16f6-7877-4ba6-8d2d-fe7f68d9855e tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] HCTL ('38', '-', '-', 0) found on session 33 with lun 0 {{(pid=85141) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 10:21:41 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-b88d16f6-7877-4ba6-8d2d-fe7f68d9855e tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=85141) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 10:21:41 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:21:41 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.020s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:21:41 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[989c7603-28e9-4f4a-9092-a1080fdf80b7]: (4, ('- - 0', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:21:41 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-b88d16f6-7877-4ba6-8d2d-fe7f68d9855e tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Searching for a device in session 33 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=85141) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 10:21:41 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-b88d16f6-7877-4ba6-8d2d-fe7f68d9855e tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:ca5a51ee-cdb2-4efa-b7e5-8a97d0c99bf7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ercfVhZa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=85141) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 10:21:41 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-2cbc5a55-c109-48fa-af33-f0de5eb77452 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e3d9019f7dd8ef3fdb6ca41a43cba4d9ba989b4.part --force-share --output=json" returned: 0 in 0.180s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:21:41 user nova-compute[85141]: DEBUG nova.virt.images [None req-2cbc5a55-c109-48fa-af33-f0de5eb77452 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] 1b4f956c-5533-48f0-bf16-1695e8e06e81 was qcow2, converting to raw {{(pid=85141) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 16 10:21:41 user nova-compute[85141]: DEBUG nova.privsep.utils [None req-2cbc5a55-c109-48fa-af33-f0de5eb77452 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=85141) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 16 10:21:41 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-2cbc5a55-c109-48fa-af33-f0de5eb77452 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/7e3d9019f7dd8ef3fdb6ca41a43cba4d9ba989b4.part /opt/stack/data/nova/instances/_base/7e3d9019f7dd8ef3fdb6ca41a43cba4d9ba989b4.converted {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:21:41 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:21:41 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:21:41 user nova-compute[85141]: DEBUG nova.network.neutron [req-58919734-7988-4a43-927e-3efa0142fff3 req-376aab39-99b3-4055-885a-34c62f4246da service nova] [instance: bff3a84b-6ab5-4256-8a04-2d21a4ba20b3] Updated VIF entry in instance network info cache for port 23ec0327-ca81-4524-8850-2c081e596d44. {{(pid=85141) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 10:21:41 user nova-compute[85141]: DEBUG nova.network.neutron [req-58919734-7988-4a43-927e-3efa0142fff3 req-376aab39-99b3-4055-885a-34c62f4246da service nova] [instance: bff3a84b-6ab5-4256-8a04-2d21a4ba20b3] Updating instance_info_cache with network_info: [{"id": "23ec0327-ca81-4524-8850-2c081e596d44", "address": "fa:16:3e:e1:61:4a", "network": {"id": "4fb7c85e-c966-481d-b6f2-856a17ac8f7c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-81570496-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08ef12fb41a14ecd8abb84d4d69b7c27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23ec0327-ca", "ovs_interfaceid": "23ec0327-ca81-4524-8850-2c081e596d44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:21:41 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-58919734-7988-4a43-927e-3efa0142fff3 req-376aab39-99b3-4055-885a-34c62f4246da service nova] Releasing lock "refresh_cache-bff3a84b-6ab5-4256-8a04-2d21a4ba20b3" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:21:41 user nova-compute[85141]: DEBUG nova.compute.manager [req-7015cb24-eeed-40d2-9058-078bc580f79f req-caf26751-88f3-489e-8a9d-16531b618f52 service nova] [instance: e88874fe-b0a6-4292-8832-023f95e4f53c] Received event network-vif-plugged-7bbea642-d504-433b-ae99-8e7159942751 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:21:41 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-7015cb24-eeed-40d2-9058-078bc580f79f req-caf26751-88f3-489e-8a9d-16531b618f52 service nova] Acquiring lock "e88874fe-b0a6-4292-8832-023f95e4f53c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:21:41 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-7015cb24-eeed-40d2-9058-078bc580f79f req-caf26751-88f3-489e-8a9d-16531b618f52 service nova] Lock "e88874fe-b0a6-4292-8832-023f95e4f53c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:21:41 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-7015cb24-eeed-40d2-9058-078bc580f79f req-caf26751-88f3-489e-8a9d-16531b618f52 service nova] Lock "e88874fe-b0a6-4292-8832-023f95e4f53c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:21:41 user nova-compute[85141]: DEBUG nova.compute.manager [req-7015cb24-eeed-40d2-9058-078bc580f79f req-caf26751-88f3-489e-8a9d-16531b618f52 service nova] [instance: e88874fe-b0a6-4292-8832-023f95e4f53c] No waiting events found dispatching network-vif-plugged-7bbea642-d504-433b-ae99-8e7159942751 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:21:41 user nova-compute[85141]: WARNING nova.compute.manager [req-7015cb24-eeed-40d2-9058-078bc580f79f req-caf26751-88f3-489e-8a9d-16531b618f52 service nova] [instance: e88874fe-b0a6-4292-8832-023f95e4f53c] Received unexpected event network-vif-plugged-7bbea642-d504-433b-ae99-8e7159942751 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 16 10:21:42 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-2cbc5a55-c109-48fa-af33-f0de5eb77452 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/7e3d9019f7dd8ef3fdb6ca41a43cba4d9ba989b4.part /opt/stack/data/nova/instances/_base/7e3d9019f7dd8ef3fdb6ca41a43cba4d9ba989b4.converted" returned: 0 in 0.682s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:21:42 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-2cbc5a55-c109-48fa-af33-f0de5eb77452 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e3d9019f7dd8ef3fdb6ca41a43cba4d9ba989b4.converted --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:21:42 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-2cbc5a55-c109-48fa-af33-f0de5eb77452 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e3d9019f7dd8ef3fdb6ca41a43cba4d9ba989b4.converted --force-share --output=json" returned: 0 in 0.173s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:21:42 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-2cbc5a55-c109-48fa-af33-f0de5eb77452 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Lock "7e3d9019f7dd8ef3fdb6ca41a43cba4d9ba989b4" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.120s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:21:42 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:21:42 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-2cbc5a55-c109-48fa-af33-f0de5eb77452 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e3d9019f7dd8ef3fdb6ca41a43cba4d9ba989b4 --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:21:42 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:21:42 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-b88d16f6-7877-4ba6-8d2d-fe7f68d9855e tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.337s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 10:21:42 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-b88d16f6-7877-4ba6-8d2d-fe7f68d9855e tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] <== connect_volume: return (3659ms) {'type': 'block', 'scsi_wwn': '23437373037316332', 'path': '/dev/sdg'} {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 10:21:42 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b88d16f6-7877-4ba6-8d2d-fe7f68d9855e tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] [instance: 0b388b98-4e65-4258-bbe2-77e699321fb7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23437373037316332', 'path': '/dev/sdg'} {{(pid=85141) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 10:21:42 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-b88d16f6-7877-4ba6-8d2d-fe7f68d9855e tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T10:17:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1602512664',display_name='tempest-AttachVolumeTestJSON-server-1602512664',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1602512664',id=23,image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAR6bF9nouUYoCi9ZNGh3nZGY5ofrnXVxXtSu/7Acr1EHKWGjXKYUGtrq2XimOt/E4akdnq6ZnUvHCruk4Zy5W8xPtBZmROYAs+9Sfqoh0p8jGC4Ld4F7tm19PX/QAMtvA==',key_name='tempest-keypair-1960067559',keypairs=<?>,launch_index=0,launched_at=2023-11-16T10:17:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='c2acc04e107d4a229c3580cf078a20f7',ramdisk_id='',reservation_id='r-ji9l4e80',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1609390288',owner_user_name='tempest-AttachVolumeTestJSON-1609390288-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T10:19:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f58409e5923c42b685d0a3ad0ab42974',uuid=0b388b98-4e65-4258-bbe2-77e699321fb7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "3ed9d2a6-c028-4b75-9023-95b1cfa982b6", "address": "fa:16:3e:85:dd:4c", "network": {"id": "4e36c3d2-7d16-4305-a0a7-2358e1208df3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1030128743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2acc04e107d4a229c3580cf078a20f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ed9d2a6-c0", "ovs_interfaceid": "3ed9d2a6-c028-4b75-9023-95b1cfa982b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=85141) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 10:21:42 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-b88d16f6-7877-4ba6-8d2d-fe7f68d9855e tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Converting VIF {"id": "3ed9d2a6-c028-4b75-9023-95b1cfa982b6", "address": "fa:16:3e:85:dd:4c", "network": {"id": "4e36c3d2-7d16-4305-a0a7-2358e1208df3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1030128743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2acc04e107d4a229c3580cf078a20f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ed9d2a6-c0", "ovs_interfaceid": "3ed9d2a6-c028-4b75-9023-95b1cfa982b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:21:42 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-b88d16f6-7877-4ba6-8d2d-fe7f68d9855e tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:85:dd:4c,bridge_name='br-int',has_traffic_filtering=True,id=3ed9d2a6-c028-4b75-9023-95b1cfa982b6,network=Network(4e36c3d2-7d16-4305-a0a7-2358e1208df3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ed9d2a6-c0') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:21:42 user nova-compute[85141]: DEBUG nova.objects.instance [None req-b88d16f6-7877-4ba6-8d2d-fe7f68d9855e tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Lazy-loading 'pci_devices' on Instance uuid 0b388b98-4e65-4258-bbe2-77e699321fb7 {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:21:42 user nova-compute[85141]: DEBUG nova.objects.base [None req-b88d16f6-7877-4ba6-8d2d-fe7f68d9855e tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Object Instance<0b388b98-4e65-4258-bbe2-77e699321fb7> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=85141) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 10:21:42 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-b88d16f6-7877-4ba6-8d2d-fe7f68d9855e tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] [instance: 0b388b98-4e65-4258-bbe2-77e699321fb7] End _get_guest_xml xml=<domain type="kvm">
Nov 16 10:21:42 user nova-compute[85141]:   <uuid>0b388b98-4e65-4258-bbe2-77e699321fb7</uuid>
Nov 16 10:21:42 user nova-compute[85141]:   <name>instance-00000017</name>
Nov 16 10:21:42 user nova-compute[85141]:   <memory>524288</memory>
Nov 16 10:21:42 user nova-compute[85141]:   <vcpu>1</vcpu>
Nov 16 10:21:42 user nova-compute[85141]:   <metadata>
Nov 16 10:21:42 user nova-compute[85141]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 10:21:42 user nova-compute[85141]:       <nova:package version="0.0.0"/>
Nov 16 10:21:42 user nova-compute[85141]:       <nova:name>tempest-AttachVolumeTestJSON-server-1602512664</nova:name>
Nov 16 10:21:42 user nova-compute[85141]:       <nova:creationTime>2023-11-16 10:21:38</nova:creationTime>
Nov 16 10:21:42 user nova-compute[85141]:       <nova:flavor name="m1.tiny">
Nov 16 10:21:42 user nova-compute[85141]:         <nova:memory>512</nova:memory>
Nov 16 10:21:42 user nova-compute[85141]:         <nova:disk>1</nova:disk>
Nov 16 10:21:42 user nova-compute[85141]:         <nova:swap>0</nova:swap>
Nov 16 10:21:42 user nova-compute[85141]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 10:21:42 user nova-compute[85141]:         <nova:vcpus>1</nova:vcpus>
Nov 16 10:21:42 user nova-compute[85141]:       </nova:flavor>
Nov 16 10:21:42 user nova-compute[85141]:       <nova:owner>
Nov 16 10:21:42 user nova-compute[85141]:         <nova:user uuid="f58409e5923c42b685d0a3ad0ab42974">tempest-AttachVolumeTestJSON-1609390288-project-member</nova:user>
Nov 16 10:21:42 user nova-compute[85141]:         <nova:project uuid="c2acc04e107d4a229c3580cf078a20f7">tempest-AttachVolumeTestJSON-1609390288</nova:project>
Nov 16 10:21:42 user nova-compute[85141]:       </nova:owner>
Nov 16 10:21:42 user nova-compute[85141]:       <nova:root type="image" uuid="bc4ca70f-a459-4d5c-a9e6-80f1948eb48b"/>
Nov 16 10:21:42 user nova-compute[85141]:       <nova:ports>
Nov 16 10:21:42 user nova-compute[85141]:         <nova:port uuid="3ed9d2a6-c028-4b75-9023-95b1cfa982b6">
Nov 16 10:21:42 user nova-compute[85141]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 16 10:21:42 user nova-compute[85141]:         </nova:port>
Nov 16 10:21:42 user nova-compute[85141]:       </nova:ports>
Nov 16 10:21:42 user nova-compute[85141]:     </nova:instance>
Nov 16 10:21:42 user nova-compute[85141]:   </metadata>
Nov 16 10:21:42 user nova-compute[85141]:   <sysinfo type="smbios">
Nov 16 10:21:42 user nova-compute[85141]:     <system>
Nov 16 10:21:42 user nova-compute[85141]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 10:21:42 user nova-compute[85141]:       <entry name="product">OpenStack Nova</entry>
Nov 16 10:21:42 user nova-compute[85141]:       <entry name="version">0.0.0</entry>
Nov 16 10:21:42 user nova-compute[85141]:       <entry name="serial">0b388b98-4e65-4258-bbe2-77e699321fb7</entry>
Nov 16 10:21:42 user nova-compute[85141]:       <entry name="uuid">0b388b98-4e65-4258-bbe2-77e699321fb7</entry>
Nov 16 10:21:42 user nova-compute[85141]:       <entry name="family">Virtual Machine</entry>
Nov 16 10:21:42 user nova-compute[85141]:     </system>
Nov 16 10:21:42 user nova-compute[85141]:   </sysinfo>
Nov 16 10:21:42 user nova-compute[85141]:   <os>
Nov 16 10:21:42 user nova-compute[85141]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 10:21:42 user nova-compute[85141]:     <boot dev="hd"/>
Nov 16 10:21:42 user nova-compute[85141]:     <smbios mode="sysinfo"/>
Nov 16 10:21:42 user nova-compute[85141]:   </os>
Nov 16 10:21:42 user nova-compute[85141]:   <features>
Nov 16 10:21:42 user nova-compute[85141]:     <acpi/>
Nov 16 10:21:42 user nova-compute[85141]:     <apic/>
Nov 16 10:21:42 user nova-compute[85141]:     <vmcoreinfo/>
Nov 16 10:21:42 user nova-compute[85141]:   </features>
Nov 16 10:21:42 user nova-compute[85141]:   <clock offset="utc">
Nov 16 10:21:42 user nova-compute[85141]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 10:21:42 user nova-compute[85141]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 10:21:42 user nova-compute[85141]:     <timer name="hpet" present="no"/>
Nov 16 10:21:42 user nova-compute[85141]:   </clock>
Nov 16 10:21:42 user nova-compute[85141]:   <cpu mode="custom" match="exact">
Nov 16 10:21:42 user nova-compute[85141]:     <model>Nehalem</model>
Nov 16 10:21:42 user nova-compute[85141]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 10:21:42 user nova-compute[85141]:   </cpu>
Nov 16 10:21:42 user nova-compute[85141]:   <devices>
Nov 16 10:21:42 user nova-compute[85141]:     <disk type="file" device="disk">
Nov 16 10:21:42 user nova-compute[85141]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 10:21:42 user nova-compute[85141]:       <source file="/opt/stack/data/nova/instances/0b388b98-4e65-4258-bbe2-77e699321fb7/disk"/>
Nov 16 10:21:42 user nova-compute[85141]:       <target dev="vda" bus="virtio"/>
Nov 16 10:21:42 user nova-compute[85141]:     </disk>
Nov 16 10:21:42 user nova-compute[85141]:     <disk type="block" device="disk">
Nov 16 10:21:42 user nova-compute[85141]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 10:21:42 user nova-compute[85141]:       <source dev="/dev/sdg"/>
Nov 16 10:21:42 user nova-compute[85141]:       <target dev="vdb" bus="virtio"/>
Nov 16 10:21:42 user nova-compute[85141]:       <serial>ca5a51ee-cdb2-4efa-b7e5-8a97d0c99bf7</serial>
Nov 16 10:21:42 user nova-compute[85141]:     </disk>
Nov 16 10:21:42 user nova-compute[85141]:     <interface type="ethernet">
Nov 16 10:21:42 user nova-compute[85141]:       <mac address="fa:16:3e:85:dd:4c"/>
Nov 16 10:21:42 user nova-compute[85141]:       <model type="virtio"/>
Nov 16 10:21:42 user nova-compute[85141]:       <mtu size="1442"/>
Nov 16 10:21:42 user nova-compute[85141]:       <target dev="tap3ed9d2a6-c0"/>
Nov 16 10:21:42 user nova-compute[85141]:     </interface>
Nov 16 10:21:42 user nova-compute[85141]:     <serial type="pty">
Nov 16 10:21:42 user nova-compute[85141]:       <log file="/opt/stack/data/nova/instances/0b388b98-4e65-4258-bbe2-77e699321fb7/console.log" append="off"/>
Nov 16 10:21:42 user nova-compute[85141]:     </serial>
Nov 16 10:21:42 user nova-compute[85141]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 10:21:42 user nova-compute[85141]:     <video>
Nov 16 10:21:42 user nova-compute[85141]:       <model type="virtio"/>
Nov 16 10:21:42 user nova-compute[85141]:     </video>
Nov 16 10:21:42 user nova-compute[85141]:     <rng model="virtio">
Nov 16 10:21:42 user nova-compute[85141]:       <backend model="random">/dev/urandom</backend>
Nov 16 10:21:42 user nova-compute[85141]:     </rng>
Nov 16 10:21:42 user nova-compute[85141]:     <controller type="usb" index="0" model="none"/>
Nov 16 10:21:42 user nova-compute[85141]:     <memballoon model="virtio">
Nov 16 10:21:42 user nova-compute[85141]:       <stats period="10"/>
Nov 16 10:21:42 user nova-compute[85141]:     </memballoon>
Nov 16 10:21:42 user nova-compute[85141]:   </devices>
Nov 16 10:21:42 user nova-compute[85141]: </domain>
Nov 16 10:21:42 user nova-compute[85141]:  {{(pid=85141) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 10:21:42 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-b88d16f6-7877-4ba6-8d2d-fe7f68d9855e tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b388b98-4e65-4258-bbe2-77e699321fb7/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:21:42 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-2cbc5a55-c109-48fa-af33-f0de5eb77452 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e3d9019f7dd8ef3fdb6ca41a43cba4d9ba989b4 --force-share --output=json" returned: 0 in 0.183s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:21:42 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-2cbc5a55-c109-48fa-af33-f0de5eb77452 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Acquiring lock "7e3d9019f7dd8ef3fdb6ca41a43cba4d9ba989b4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:21:42 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-2cbc5a55-c109-48fa-af33-f0de5eb77452 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Lock "7e3d9019f7dd8ef3fdb6ca41a43cba4d9ba989b4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:21:42 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-2cbc5a55-c109-48fa-af33-f0de5eb77452 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e3d9019f7dd8ef3fdb6ca41a43cba4d9ba989b4 --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:21:42 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-b88d16f6-7877-4ba6-8d2d-fe7f68d9855e tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b388b98-4e65-4258-bbe2-77e699321fb7/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:21:42 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-b88d16f6-7877-4ba6-8d2d-fe7f68d9855e tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b388b98-4e65-4258-bbe2-77e699321fb7/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:21:42 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-2cbc5a55-c109-48fa-af33-f0de5eb77452 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e3d9019f7dd8ef3fdb6ca41a43cba4d9ba989b4 --force-share --output=json" returned: 0 in 0.170s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:21:42 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-2cbc5a55-c109-48fa-af33-f0de5eb77452 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7e3d9019f7dd8ef3fdb6ca41a43cba4d9ba989b4,backing_fmt=raw /opt/stack/data/nova/instances/bff3a84b-6ab5-4256-8a04-2d21a4ba20b3/disk 1073741824 {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:21:42 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:21:42 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-2cbc5a55-c109-48fa-af33-f0de5eb77452 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7e3d9019f7dd8ef3fdb6ca41a43cba4d9ba989b4,backing_fmt=raw /opt/stack/data/nova/instances/bff3a84b-6ab5-4256-8a04-2d21a4ba20b3/disk 1073741824" returned: 0 in 0.050s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:21:42 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-2cbc5a55-c109-48fa-af33-f0de5eb77452 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Lock "7e3d9019f7dd8ef3fdb6ca41a43cba4d9ba989b4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.225s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:21:42 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-2cbc5a55-c109-48fa-af33-f0de5eb77452 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e3d9019f7dd8ef3fdb6ca41a43cba4d9ba989b4 --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:21:42 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-b88d16f6-7877-4ba6-8d2d-fe7f68d9855e tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b388b98-4e65-4258-bbe2-77e699321fb7/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:21:42 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-b88d16f6-7877-4ba6-8d2d-fe7f68d9855e tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=85141) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 10:21:42 user nova-compute[85141]: DEBUG nova.objects.instance [None req-b88d16f6-7877-4ba6-8d2d-fe7f68d9855e tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Lazy-loading 'trusted_certs' on Instance uuid 0b388b98-4e65-4258-bbe2-77e699321fb7 {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:21:42 user nova-compute[85141]: DEBUG nova.objects.base [None req-b88d16f6-7877-4ba6-8d2d-fe7f68d9855e tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Object Instance<0b388b98-4e65-4258-bbe2-77e699321fb7> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=85141) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 10:21:42 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-b88d16f6-7877-4ba6-8d2d-fe7f68d9855e tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:21:42 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-2cbc5a55-c109-48fa-af33-f0de5eb77452 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7e3d9019f7dd8ef3fdb6ca41a43cba4d9ba989b4 --force-share --output=json" returned: 0 in 0.167s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:21:42 user nova-compute[85141]: DEBUG nova.objects.instance [None req-2cbc5a55-c109-48fa-af33-f0de5eb77452 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Lazy-loading 'migration_context' on Instance uuid bff3a84b-6ab5-4256-8a04-2d21a4ba20b3 {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:21:42 user nova-compute[85141]: DEBUG nova.objects.base [None req-2cbc5a55-c109-48fa-af33-f0de5eb77452 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Object Instance<bff3a84b-6ab5-4256-8a04-2d21a4ba20b3> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=85141) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 10:21:42 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-2cbc5a55-c109-48fa-af33-f0de5eb77452 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] [instance: bff3a84b-6ab5-4256-8a04-2d21a4ba20b3] Rebasing disk image.
Nov 16 10:21:42 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-2cbc5a55-c109-48fa-af33-f0de5eb77452 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:21:43 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-b88d16f6-7877-4ba6-8d2d-fe7f68d9855e tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json" returned: 0 in 0.181s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:21:43 user nova-compute[85141]: DEBUG nova.virt.disk.api [None req-b88d16f6-7877-4ba6-8d2d-fe7f68d9855e tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0b388b98-4e65-4258-bbe2-77e699321fb7/disk. size=1073741824 {{(pid=85141) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 10:21:43 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-b88d16f6-7877-4ba6-8d2d-fe7f68d9855e tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b388b98-4e65-4258-bbe2-77e699321fb7/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:21:43 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-2cbc5a55-c109-48fa-af33-f0de5eb77452 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json" returned: 0 in 0.195s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:21:43 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-2cbc5a55-c109-48fa-af33-f0de5eb77452 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 -F raw /opt/stack/data/nova/instances/bff3a84b-6ab5-4256-8a04-2d21a4ba20b3/disk {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:21:43 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-b88d16f6-7877-4ba6-8d2d-fe7f68d9855e tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b388b98-4e65-4258-bbe2-77e699321fb7/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:21:43 user nova-compute[85141]: DEBUG nova.virt.disk.api [None req-b88d16f6-7877-4ba6-8d2d-fe7f68d9855e tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Cannot resize image /opt/stack/data/nova/instances/0b388b98-4e65-4258-bbe2-77e699321fb7/disk to a smaller size. {{(pid=85141) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 10:21:43 user nova-compute[85141]: DEBUG nova.objects.instance [None req-b88d16f6-7877-4ba6-8d2d-fe7f68d9855e tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Lazy-loading 'migration_context' on Instance uuid 0b388b98-4e65-4258-bbe2-77e699321fb7 {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:21:43 user nova-compute[85141]: DEBUG nova.objects.base [None req-b88d16f6-7877-4ba6-8d2d-fe7f68d9855e tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Object Instance<0b388b98-4e65-4258-bbe2-77e699321fb7> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=85141) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 10:21:43 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-b88d16f6-7877-4ba6-8d2d-fe7f68d9855e tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T10:17:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1602512664',display_name='tempest-AttachVolumeTestJSON-server-1602512664',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1602512664',id=23,image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAR6bF9nouUYoCi9ZNGh3nZGY5ofrnXVxXtSu/7Acr1EHKWGjXKYUGtrq2XimOt/E4akdnq6ZnUvHCruk4Zy5W8xPtBZmROYAs+9Sfqoh0p8jGC4Ld4F7tm19PX/QAMtvA==',key_name='tempest-keypair-1960067559',keypairs=<?>,launch_index=0,launched_at=2023-11-16T10:17:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='c2acc04e107d4a229c3580cf078a20f7',ramdisk_id='',reservation_id='r-ji9l4e80',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1609390288',owner_user_name='tempest-AttachVolumeTestJSON-1609390288-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T10:19:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f58409e5923c42b685d0a3ad0ab42974',uuid=0b388b98-4e65-4258-bbe2-77e699321fb7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "3ed9d2a6-c028-4b75-9023-95b1cfa982b6", "address": "fa:16:3e:85:dd:4c", "network": {"id": "4e36c3d2-7d16-4305-a0a7-2358e1208df3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1030128743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2acc04e107d4a229c3580cf078a20f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ed9d2a6-c0", "ovs_interfaceid": "3ed9d2a6-c028-4b75-9023-95b1cfa982b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 10:21:43 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-b88d16f6-7877-4ba6-8d2d-fe7f68d9855e tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Converting VIF {"id": "3ed9d2a6-c028-4b75-9023-95b1cfa982b6", "address": "fa:16:3e:85:dd:4c", "network": {"id": "4e36c3d2-7d16-4305-a0a7-2358e1208df3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1030128743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2acc04e107d4a229c3580cf078a20f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ed9d2a6-c0", "ovs_interfaceid": "3ed9d2a6-c028-4b75-9023-95b1cfa982b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:21:43 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-b88d16f6-7877-4ba6-8d2d-fe7f68d9855e tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:85:dd:4c,bridge_name='br-int',has_traffic_filtering=True,id=3ed9d2a6-c028-4b75-9023-95b1cfa982b6,network=Network(4e36c3d2-7d16-4305-a0a7-2358e1208df3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ed9d2a6-c0') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:21:43 user nova-compute[85141]: DEBUG os_vif [None req-b88d16f6-7877-4ba6-8d2d-fe7f68d9855e tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:85:dd:4c,bridge_name='br-int',has_traffic_filtering=True,id=3ed9d2a6-c028-4b75-9023-95b1cfa982b6,network=Network(4e36c3d2-7d16-4305-a0a7-2358e1208df3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ed9d2a6-c0') {{(pid=85141) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 10:21:43 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:21:43 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:21:43 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 10:21:43 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:21:43 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0d9404e5-c1b0-55b5-995e-7843afb8e8d3', '_type': 'linux-noop'}}, row=False) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:21:43 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:21:43 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:21:43 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:21:43 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:21:43 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3ed9d2a6-c0, may_exist=True, interface_attrs={}) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:21:43 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3ed9d2a6-c0, col_values=(('qos', UUID('b8aef809-1a73-4f62-aa83-46032c5cfb0d')),), if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:21:43 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3ed9d2a6-c0, col_values=(('external_ids', {'iface-id': '3ed9d2a6-c028-4b75-9023-95b1cfa982b6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:85:dd:4c', 'vm-uuid': '0b388b98-4e65-4258-bbe2-77e699321fb7'}),), if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:21:43 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:21:43 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:21:43 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:21:43 user nova-compute[85141]: INFO os_vif [None req-b88d16f6-7877-4ba6-8d2d-fe7f68d9855e tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:85:dd:4c,bridge_name='br-int',has_traffic_filtering=True,id=3ed9d2a6-c028-4b75-9023-95b1cfa982b6,network=Network(4e36c3d2-7d16-4305-a0a7-2358e1208df3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ed9d2a6-c0')
Nov 16 10:21:43 user nova-compute[85141]: DEBUG nova.compute.manager [None req-de9d0f76-e9eb-4864-aa68-4fdcadf98693 tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] [instance: e88874fe-b0a6-4292-8832-023f95e4f53c] Instance event wait completed in 0 seconds for  {{(pid=85141) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 10:21:43 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-de9d0f76-e9eb-4864-aa68-4fdcadf98693 tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] [instance: e88874fe-b0a6-4292-8832-023f95e4f53c] Guest created on hypervisor {{(pid=85141) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 10:21:43 user nova-compute[85141]: INFO nova.virt.libvirt.driver [-] [instance: e88874fe-b0a6-4292-8832-023f95e4f53c] Instance spawned successfully.
Nov 16 10:21:43 user nova-compute[85141]: DEBUG nova.compute.manager [None req-de9d0f76-e9eb-4864-aa68-4fdcadf98693 tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] [instance: e88874fe-b0a6-4292-8832-023f95e4f53c] Checking state {{(pid=85141) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 10:21:43 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-de9d0f76-e9eb-4864-aa68-4fdcadf98693 tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] Lock "e88874fe-b0a6-4292-8832-023f95e4f53c" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 14.226s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:21:44 user nova-compute[85141]: DEBUG nova.compute.manager [req-1e8fd817-22ac-4f96-865f-ff17c61f04d9 req-670d3efd-e8b0-4c60-a3e8-c95298a862ce service nova] [instance: e88874fe-b0a6-4292-8832-023f95e4f53c] Received event network-vif-plugged-7bbea642-d504-433b-ae99-8e7159942751 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:21:44 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-1e8fd817-22ac-4f96-865f-ff17c61f04d9 req-670d3efd-e8b0-4c60-a3e8-c95298a862ce service nova] Acquiring lock "e88874fe-b0a6-4292-8832-023f95e4f53c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:21:44 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-1e8fd817-22ac-4f96-865f-ff17c61f04d9 req-670d3efd-e8b0-4c60-a3e8-c95298a862ce service nova] Lock "e88874fe-b0a6-4292-8832-023f95e4f53c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:21:44 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-1e8fd817-22ac-4f96-865f-ff17c61f04d9 req-670d3efd-e8b0-4c60-a3e8-c95298a862ce service nova] Lock "e88874fe-b0a6-4292-8832-023f95e4f53c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:21:44 user nova-compute[85141]: DEBUG nova.compute.manager [req-1e8fd817-22ac-4f96-865f-ff17c61f04d9 req-670d3efd-e8b0-4c60-a3e8-c95298a862ce service nova] [instance: e88874fe-b0a6-4292-8832-023f95e4f53c] No waiting events found dispatching network-vif-plugged-7bbea642-d504-433b-ae99-8e7159942751 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:21:44 user nova-compute[85141]: WARNING nova.compute.manager [req-1e8fd817-22ac-4f96-865f-ff17c61f04d9 req-670d3efd-e8b0-4c60-a3e8-c95298a862ce service nova] [instance: e88874fe-b0a6-4292-8832-023f95e4f53c] Received unexpected event network-vif-plugged-7bbea642-d504-433b-ae99-8e7159942751 for instance with vm_state active and task_state None.
Nov 16 10:21:44 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:21:44 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:21:44 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:21:44 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:21:45 user nova-compute[85141]: DEBUG nova.compute.manager [req-697784c5-71c0-42b5-8770-cf8596913c15 req-f5a2319c-9255-4846-8cef-21f61419806c service nova] [instance: 0b388b98-4e65-4258-bbe2-77e699321fb7] Received event network-vif-plugged-3ed9d2a6-c028-4b75-9023-95b1cfa982b6 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:21:45 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-697784c5-71c0-42b5-8770-cf8596913c15 req-f5a2319c-9255-4846-8cef-21f61419806c service nova] Acquiring lock "0b388b98-4e65-4258-bbe2-77e699321fb7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:21:45 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-697784c5-71c0-42b5-8770-cf8596913c15 req-f5a2319c-9255-4846-8cef-21f61419806c service nova] Lock "0b388b98-4e65-4258-bbe2-77e699321fb7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:21:45 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-697784c5-71c0-42b5-8770-cf8596913c15 req-f5a2319c-9255-4846-8cef-21f61419806c service nova] Lock "0b388b98-4e65-4258-bbe2-77e699321fb7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:21:45 user nova-compute[85141]: DEBUG nova.compute.manager [req-697784c5-71c0-42b5-8770-cf8596913c15 req-f5a2319c-9255-4846-8cef-21f61419806c service nova] [instance: 0b388b98-4e65-4258-bbe2-77e699321fb7] No waiting events found dispatching network-vif-plugged-3ed9d2a6-c028-4b75-9023-95b1cfa982b6 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:21:45 user nova-compute[85141]: WARNING nova.compute.manager [req-697784c5-71c0-42b5-8770-cf8596913c15 req-f5a2319c-9255-4846-8cef-21f61419806c service nova] [instance: 0b388b98-4e65-4258-bbe2-77e699321fb7] Received unexpected event network-vif-plugged-3ed9d2a6-c028-4b75-9023-95b1cfa982b6 for instance with vm_state stopped and task_state powering-on.
Nov 16 10:21:45 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:21:45 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:21:45 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-2cbc5a55-c109-48fa-af33-f0de5eb77452 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 -F raw /opt/stack/data/nova/instances/bff3a84b-6ab5-4256-8a04-2d21a4ba20b3/disk" returned: 0 in 2.639s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:21:45 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-2cbc5a55-c109-48fa-af33-f0de5eb77452 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] [instance: bff3a84b-6ab5-4256-8a04-2d21a4ba20b3] Created local disks {{(pid=85141) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 10:21:45 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-2cbc5a55-c109-48fa-af33-f0de5eb77452 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] [instance: bff3a84b-6ab5-4256-8a04-2d21a4ba20b3] Ensure instance console log exists: /opt/stack/data/nova/instances/bff3a84b-6ab5-4256-8a04-2d21a4ba20b3/console.log {{(pid=85141) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 10:21:45 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-2cbc5a55-c109-48fa-af33-f0de5eb77452 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:21:45 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-2cbc5a55-c109-48fa-af33-f0de5eb77452 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:21:45 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-2cbc5a55-c109-48fa-af33-f0de5eb77452 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:21:45 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-2cbc5a55-c109-48fa-af33-f0de5eb77452 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] [instance: bff3a84b-6ab5-4256-8a04-2d21a4ba20b3] Start _get_guest_xml network_info=[{"id": "23ec0327-ca81-4524-8850-2c081e596d44", "address": "fa:16:3e:e1:61:4a", "network": {"id": "4fb7c85e-c966-481d-b6f2-856a17ac8f7c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-81570496-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08ef12fb41a14ecd8abb84d4d69b7c27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23ec0327-ca", "ovs_interfaceid": "23ec0327-ca81-4524-8850-2c081e596d44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8a8b2903a1eb451823497c8e460ac79',container_format='bare',created_at=2023-11-16T10:19:46Z,direct_url=<?>,disk_format='qcow2',id=1b4f956c-5533-48f0-bf16-1695e8e06e81,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-614284673-shelved',owner='08ef12fb41a14ecd8abb84d4d69b7c27',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-16T10:19:50Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_options': None, 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'image_id': 'bc4ca70f-a459-4d5c-a9e6-80f1948eb48b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=85141) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 10:21:46 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-2cbc5a55-c109-48fa-af33-f0de5eb77452 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:21:46 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-2cbc5a55-c109-48fa-af33-f0de5eb77452 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:21:46 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:21:46 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-2cbc5a55-c109-48fa-af33-f0de5eb77452 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=85141) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 10:21:46 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-2cbc5a55-c109-48fa-af33-f0de5eb77452 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] CPU controller missing on host. {{(pid=85141) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 10:21:46 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-2cbc5a55-c109-48fa-af33-f0de5eb77452 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=85141) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 10:21:46 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-2cbc5a55-c109-48fa-af33-f0de5eb77452 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] CPU controller found on host. {{(pid=85141) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 10:21:46 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-2cbc5a55-c109-48fa-af33-f0de5eb77452 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=85141) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 10:21:46 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-2cbc5a55-c109-48fa-af33-f0de5eb77452 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T10:06:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8a8b2903a1eb451823497c8e460ac79',container_format='bare',created_at=2023-11-16T10:19:46Z,direct_url=<?>,disk_format='qcow2',id=1b4f956c-5533-48f0-bf16-1695e8e06e81,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-614284673-shelved',owner='08ef12fb41a14ecd8abb84d4d69b7c27',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-16T10:19:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 10:21:46 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-2cbc5a55-c109-48fa-af33-f0de5eb77452 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Flavor limits 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 10:21:46 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-2cbc5a55-c109-48fa-af33-f0de5eb77452 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Image limits 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 10:21:46 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-2cbc5a55-c109-48fa-af33-f0de5eb77452 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Flavor pref 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 10:21:46 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-2cbc5a55-c109-48fa-af33-f0de5eb77452 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Image pref 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 10:21:46 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-2cbc5a55-c109-48fa-af33-f0de5eb77452 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 10:21:46 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-2cbc5a55-c109-48fa-af33-f0de5eb77452 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 10:21:46 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-2cbc5a55-c109-48fa-af33-f0de5eb77452 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=85141) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 10:21:46 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-2cbc5a55-c109-48fa-af33-f0de5eb77452 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Got 1 possible topologies {{(pid=85141) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 10:21:46 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-2cbc5a55-c109-48fa-af33-f0de5eb77452 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 10:21:46 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-2cbc5a55-c109-48fa-af33-f0de5eb77452 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 10:21:46 user nova-compute[85141]: DEBUG nova.objects.instance [None req-2cbc5a55-c109-48fa-af33-f0de5eb77452 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Lazy-loading 'vcpu_model' on Instance uuid bff3a84b-6ab5-4256-8a04-2d21a4ba20b3 {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:21:46 user nova-compute[85141]: DEBUG nova.objects.base [None req-2cbc5a55-c109-48fa-af33-f0de5eb77452 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Object Instance<bff3a84b-6ab5-4256-8a04-2d21a4ba20b3> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=85141) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 10:21:46 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-2cbc5a55-c109-48fa-af33-f0de5eb77452 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-16T10:17:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-614284673',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-614284673',id=25,image_ref='1b4f956c-5533-48f0-bf16-1695e8e06e81',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1229413697',keypairs=<?>,launch_index=0,launched_at=2023-11-16T10:18:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='08ef12fb41a14ecd8abb84d4d69b7c27',ramdisk_id='',reservation_id='r-m6x0xg39',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-958501663',owner_user_name='tempest-AttachVolumeShelveTestJSON-958501663-project-member',shelved_at='2023-11-16T10:19:50.343466',shelved_host='user',shelved_image_id='1b4f956c-5533-48f0-bf16-1695e8e06e81'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T10:21:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='baec48c887ae4a418e0ea7b32b05bc59',uuid=bff3a84b-6ab5-4256-8a04-2d21a4ba20b3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "23ec0327-ca81-4524-8850-2c081e596d44", "address": "fa:16:3e:e1:61:4a", "network": {"id": "4fb7c85e-c966-481d-b6f2-856a17ac8f7c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-81570496-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08ef12fb41a14ecd8abb84d4d69b7c27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23ec0327-ca", "ovs_interfaceid": "23ec0327-ca81-4524-8850-2c081e596d44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=85141) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 10:21:46 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-2cbc5a55-c109-48fa-af33-f0de5eb77452 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Converting VIF {"id": "23ec0327-ca81-4524-8850-2c081e596d44", "address": "fa:16:3e:e1:61:4a", "network": {"id": "4fb7c85e-c966-481d-b6f2-856a17ac8f7c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-81570496-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08ef12fb41a14ecd8abb84d4d69b7c27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23ec0327-ca", "ovs_interfaceid": "23ec0327-ca81-4524-8850-2c081e596d44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:21:46 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-2cbc5a55-c109-48fa-af33-f0de5eb77452 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:61:4a,bridge_name='br-int',has_traffic_filtering=True,id=23ec0327-ca81-4524-8850-2c081e596d44,network=Network(4fb7c85e-c966-481d-b6f2-856a17ac8f7c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23ec0327-ca') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:21:46 user nova-compute[85141]: DEBUG nova.objects.instance [None req-2cbc5a55-c109-48fa-af33-f0de5eb77452 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Lazy-loading 'pci_devices' on Instance uuid bff3a84b-6ab5-4256-8a04-2d21a4ba20b3 {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:21:46 user nova-compute[85141]: DEBUG nova.objects.base [None req-2cbc5a55-c109-48fa-af33-f0de5eb77452 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Object Instance<bff3a84b-6ab5-4256-8a04-2d21a4ba20b3> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=85141) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 10:21:46 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-2cbc5a55-c109-48fa-af33-f0de5eb77452 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] [instance: bff3a84b-6ab5-4256-8a04-2d21a4ba20b3] End _get_guest_xml xml=<domain type="kvm">
Nov 16 10:21:46 user nova-compute[85141]:   <uuid>bff3a84b-6ab5-4256-8a04-2d21a4ba20b3</uuid>
Nov 16 10:21:46 user nova-compute[85141]:   <name>instance-00000019</name>
Nov 16 10:21:46 user nova-compute[85141]:   <memory>524288</memory>
Nov 16 10:21:46 user nova-compute[85141]:   <vcpu>1</vcpu>
Nov 16 10:21:46 user nova-compute[85141]:   <metadata>
Nov 16 10:21:46 user nova-compute[85141]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 10:21:46 user nova-compute[85141]:       <nova:package version="0.0.0"/>
Nov 16 10:21:46 user nova-compute[85141]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-614284673</nova:name>
Nov 16 10:21:46 user nova-compute[85141]:       <nova:creationTime>2023-11-16 10:21:46</nova:creationTime>
Nov 16 10:21:46 user nova-compute[85141]:       <nova:flavor name="m1.tiny">
Nov 16 10:21:46 user nova-compute[85141]:         <nova:memory>512</nova:memory>
Nov 16 10:21:46 user nova-compute[85141]:         <nova:disk>1</nova:disk>
Nov 16 10:21:46 user nova-compute[85141]:         <nova:swap>0</nova:swap>
Nov 16 10:21:46 user nova-compute[85141]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 10:21:46 user nova-compute[85141]:         <nova:vcpus>1</nova:vcpus>
Nov 16 10:21:46 user nova-compute[85141]:       </nova:flavor>
Nov 16 10:21:46 user nova-compute[85141]:       <nova:owner>
Nov 16 10:21:46 user nova-compute[85141]:         <nova:user uuid="baec48c887ae4a418e0ea7b32b05bc59">tempest-AttachVolumeShelveTestJSON-958501663-project-member</nova:user>
Nov 16 10:21:46 user nova-compute[85141]:         <nova:project uuid="08ef12fb41a14ecd8abb84d4d69b7c27">tempest-AttachVolumeShelveTestJSON-958501663</nova:project>
Nov 16 10:21:46 user nova-compute[85141]:       </nova:owner>
Nov 16 10:21:46 user nova-compute[85141]:       <nova:root type="image" uuid="1b4f956c-5533-48f0-bf16-1695e8e06e81"/>
Nov 16 10:21:46 user nova-compute[85141]:       <nova:ports>
Nov 16 10:21:46 user nova-compute[85141]:         <nova:port uuid="23ec0327-ca81-4524-8850-2c081e596d44">
Nov 16 10:21:46 user nova-compute[85141]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 16 10:21:46 user nova-compute[85141]:         </nova:port>
Nov 16 10:21:46 user nova-compute[85141]:       </nova:ports>
Nov 16 10:21:46 user nova-compute[85141]:     </nova:instance>
Nov 16 10:21:46 user nova-compute[85141]:   </metadata>
Nov 16 10:21:46 user nova-compute[85141]:   <sysinfo type="smbios">
Nov 16 10:21:46 user nova-compute[85141]:     <system>
Nov 16 10:21:46 user nova-compute[85141]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 10:21:46 user nova-compute[85141]:       <entry name="product">OpenStack Nova</entry>
Nov 16 10:21:46 user nova-compute[85141]:       <entry name="version">0.0.0</entry>
Nov 16 10:21:46 user nova-compute[85141]:       <entry name="serial">bff3a84b-6ab5-4256-8a04-2d21a4ba20b3</entry>
Nov 16 10:21:46 user nova-compute[85141]:       <entry name="uuid">bff3a84b-6ab5-4256-8a04-2d21a4ba20b3</entry>
Nov 16 10:21:46 user nova-compute[85141]:       <entry name="family">Virtual Machine</entry>
Nov 16 10:21:46 user nova-compute[85141]:     </system>
Nov 16 10:21:46 user nova-compute[85141]:   </sysinfo>
Nov 16 10:21:46 user nova-compute[85141]:   <os>
Nov 16 10:21:46 user nova-compute[85141]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 10:21:46 user nova-compute[85141]:     <boot dev="hd"/>
Nov 16 10:21:46 user nova-compute[85141]:     <smbios mode="sysinfo"/>
Nov 16 10:21:46 user nova-compute[85141]:   </os>
Nov 16 10:21:46 user nova-compute[85141]:   <features>
Nov 16 10:21:46 user nova-compute[85141]:     <acpi/>
Nov 16 10:21:46 user nova-compute[85141]:     <apic/>
Nov 16 10:21:46 user nova-compute[85141]:     <vmcoreinfo/>
Nov 16 10:21:46 user nova-compute[85141]:   </features>
Nov 16 10:21:46 user nova-compute[85141]:   <clock offset="utc">
Nov 16 10:21:46 user nova-compute[85141]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 10:21:46 user nova-compute[85141]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 10:21:46 user nova-compute[85141]:     <timer name="hpet" present="no"/>
Nov 16 10:21:46 user nova-compute[85141]:   </clock>
Nov 16 10:21:46 user nova-compute[85141]:   <cpu mode="custom" match="exact">
Nov 16 10:21:46 user nova-compute[85141]:     <model>Nehalem</model>
Nov 16 10:21:46 user nova-compute[85141]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 10:21:46 user nova-compute[85141]:   </cpu>
Nov 16 10:21:46 user nova-compute[85141]:   <devices>
Nov 16 10:21:46 user nova-compute[85141]:     <disk type="file" device="disk">
Nov 16 10:21:46 user nova-compute[85141]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 10:21:46 user nova-compute[85141]:       <source file="/opt/stack/data/nova/instances/bff3a84b-6ab5-4256-8a04-2d21a4ba20b3/disk"/>
Nov 16 10:21:46 user nova-compute[85141]:       <target dev="vda" bus="virtio"/>
Nov 16 10:21:46 user nova-compute[85141]:     </disk>
Nov 16 10:21:46 user nova-compute[85141]:     <interface type="ethernet">
Nov 16 10:21:46 user nova-compute[85141]:       <mac address="fa:16:3e:e1:61:4a"/>
Nov 16 10:21:46 user nova-compute[85141]:       <model type="virtio"/>
Nov 16 10:21:46 user nova-compute[85141]:       <mtu size="1442"/>
Nov 16 10:21:46 user nova-compute[85141]:       <target dev="tap23ec0327-ca"/>
Nov 16 10:21:46 user nova-compute[85141]:     </interface>
Nov 16 10:21:46 user nova-compute[85141]:     <serial type="pty">
Nov 16 10:21:46 user nova-compute[85141]:       <log file="/opt/stack/data/nova/instances/bff3a84b-6ab5-4256-8a04-2d21a4ba20b3/console.log" append="off"/>
Nov 16 10:21:46 user nova-compute[85141]:     </serial>
Nov 16 10:21:46 user nova-compute[85141]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 10:21:46 user nova-compute[85141]:     <video>
Nov 16 10:21:46 user nova-compute[85141]:       <model type="virtio"/>
Nov 16 10:21:46 user nova-compute[85141]:     </video>
Nov 16 10:21:46 user nova-compute[85141]:     <rng model="virtio">
Nov 16 10:21:46 user nova-compute[85141]:       <backend model="random">/dev/urandom</backend>
Nov 16 10:21:46 user nova-compute[85141]:     </rng>
Nov 16 10:21:46 user nova-compute[85141]:     <controller type="usb" index="0" model="none"/>
Nov 16 10:21:46 user nova-compute[85141]:     <memballoon model="virtio">
Nov 16 10:21:46 user nova-compute[85141]:       <stats period="10"/>
Nov 16 10:21:46 user nova-compute[85141]:     </memballoon>
Nov 16 10:21:46 user nova-compute[85141]:   </devices>
Nov 16 10:21:46 user nova-compute[85141]: </domain>
Nov 16 10:21:46 user nova-compute[85141]:  {{(pid=85141) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 10:21:46 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-2cbc5a55-c109-48fa-af33-f0de5eb77452 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-16T10:17:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-614284673',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-614284673',id=25,image_ref='1b4f956c-5533-48f0-bf16-1695e8e06e81',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1229413697',keypairs=<?>,launch_index=0,launched_at=2023-11-16T10:18:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='08ef12fb41a14ecd8abb84d4d69b7c27',ramdisk_id='',reservation_id='r-m6x0xg39',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-958501663',owner_user_name='tempest-AttachVolumeShelveTestJSON-958501663-project-member',shelved_at='2023-11-16T10:19:50.343466',shelved_host='user',shelved_image_id='1b4f956c-5533-48f0-bf16-1695e8e06e81'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T10:21:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='baec48c887ae4a418e0ea7b32b05bc59',uuid=bff3a84b-6ab5-4256-8a04-2d21a4ba20b3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "23ec0327-ca81-4524-8850-2c081e596d44", "address": "fa:16:3e:e1:61:4a", "network": {"id": "4fb7c85e-c966-481d-b6f2-856a17ac8f7c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-81570496-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08ef12fb41a14ecd8abb84d4d69b7c27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23ec0327-ca", "ovs_interfaceid": "23ec0327-ca81-4524-8850-2c081e596d44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 10:21:46 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-2cbc5a55-c109-48fa-af33-f0de5eb77452 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Converting VIF {"id": "23ec0327-ca81-4524-8850-2c081e596d44", "address": "fa:16:3e:e1:61:4a", "network": {"id": "4fb7c85e-c966-481d-b6f2-856a17ac8f7c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-81570496-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08ef12fb41a14ecd8abb84d4d69b7c27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23ec0327-ca", "ovs_interfaceid": "23ec0327-ca81-4524-8850-2c081e596d44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:21:46 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-2cbc5a55-c109-48fa-af33-f0de5eb77452 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:61:4a,bridge_name='br-int',has_traffic_filtering=True,id=23ec0327-ca81-4524-8850-2c081e596d44,network=Network(4fb7c85e-c966-481d-b6f2-856a17ac8f7c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23ec0327-ca') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:21:46 user nova-compute[85141]: DEBUG os_vif [None req-2cbc5a55-c109-48fa-af33-f0de5eb77452 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:61:4a,bridge_name='br-int',has_traffic_filtering=True,id=23ec0327-ca81-4524-8850-2c081e596d44,network=Network(4fb7c85e-c966-481d-b6f2-856a17ac8f7c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23ec0327-ca') {{(pid=85141) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 10:21:46 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:21:46 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:21:46 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 10:21:46 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:21:46 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c43d069a-c7a3-5307-a553-0d436449db15', '_type': 'linux-noop'}}, row=False) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:21:46 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:21:46 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:21:46 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:21:46 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:21:46 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap23ec0327-ca, may_exist=True, interface_attrs={}) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:21:46 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap23ec0327-ca, col_values=(('qos', UUID('85fda8cb-3a97-461b-b292-93e3d09fdfdd')),), if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:21:46 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap23ec0327-ca, col_values=(('external_ids', {'iface-id': '23ec0327-ca81-4524-8850-2c081e596d44', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e1:61:4a', 'vm-uuid': 'bff3a84b-6ab5-4256-8a04-2d21a4ba20b3'}),), if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:21:46 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:21:46 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:21:46 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:21:46 user nova-compute[85141]: INFO os_vif [None req-2cbc5a55-c109-48fa-af33-f0de5eb77452 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:61:4a,bridge_name='br-int',has_traffic_filtering=True,id=23ec0327-ca81-4524-8850-2c081e596d44,network=Network(4fb7c85e-c966-481d-b6f2-856a17ac8f7c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23ec0327-ca')
Nov 16 10:21:46 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-2cbc5a55-c109-48fa-af33-f0de5eb77452 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] No BDM found with device name vda, not building metadata. {{(pid=85141) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 10:21:46 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-2cbc5a55-c109-48fa-af33-f0de5eb77452 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] No VIF found with MAC fa:16:3e:e1:61:4a, not building metadata {{(pid=85141) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 10:21:47 user nova-compute[85141]: DEBUG nova.compute.manager [req-22ff2022-28fb-4f9a-bc7b-6a2b4d8bf9ad req-9e11e926-1357-4926-bf9e-25d98e715008 service nova] [instance: 0b388b98-4e65-4258-bbe2-77e699321fb7] Received event network-vif-plugged-3ed9d2a6-c028-4b75-9023-95b1cfa982b6 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:21:47 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-22ff2022-28fb-4f9a-bc7b-6a2b4d8bf9ad req-9e11e926-1357-4926-bf9e-25d98e715008 service nova] Acquiring lock "0b388b98-4e65-4258-bbe2-77e699321fb7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:21:47 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-22ff2022-28fb-4f9a-bc7b-6a2b4d8bf9ad req-9e11e926-1357-4926-bf9e-25d98e715008 service nova] Lock "0b388b98-4e65-4258-bbe2-77e699321fb7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:21:47 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-22ff2022-28fb-4f9a-bc7b-6a2b4d8bf9ad req-9e11e926-1357-4926-bf9e-25d98e715008 service nova] Lock "0b388b98-4e65-4258-bbe2-77e699321fb7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:21:47 user nova-compute[85141]: DEBUG nova.compute.manager [req-22ff2022-28fb-4f9a-bc7b-6a2b4d8bf9ad req-9e11e926-1357-4926-bf9e-25d98e715008 service nova] [instance: 0b388b98-4e65-4258-bbe2-77e699321fb7] No waiting events found dispatching network-vif-plugged-3ed9d2a6-c028-4b75-9023-95b1cfa982b6 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:21:47 user nova-compute[85141]: WARNING nova.compute.manager [req-22ff2022-28fb-4f9a-bc7b-6a2b4d8bf9ad req-9e11e926-1357-4926-bf9e-25d98e715008 service nova] [instance: 0b388b98-4e65-4258-bbe2-77e699321fb7] Received unexpected event network-vif-plugged-3ed9d2a6-c028-4b75-9023-95b1cfa982b6 for instance with vm_state stopped and task_state powering-on.
Nov 16 10:21:47 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:21:47 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:21:47 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:21:47 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:21:47 user nova-compute[85141]: DEBUG nova.compute.manager [req-434ed72e-3f78-46b4-88a5-9f5009dc9bf4 req-d56e903c-f621-4323-b1b3-fbbd68e8f23c service nova] [instance: bff3a84b-6ab5-4256-8a04-2d21a4ba20b3] Received event network-vif-plugged-23ec0327-ca81-4524-8850-2c081e596d44 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:21:47 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-434ed72e-3f78-46b4-88a5-9f5009dc9bf4 req-d56e903c-f621-4323-b1b3-fbbd68e8f23c service nova] Acquiring lock "bff3a84b-6ab5-4256-8a04-2d21a4ba20b3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:21:47 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-434ed72e-3f78-46b4-88a5-9f5009dc9bf4 req-d56e903c-f621-4323-b1b3-fbbd68e8f23c service nova] Lock "bff3a84b-6ab5-4256-8a04-2d21a4ba20b3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:21:47 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-434ed72e-3f78-46b4-88a5-9f5009dc9bf4 req-d56e903c-f621-4323-b1b3-fbbd68e8f23c service nova] Lock "bff3a84b-6ab5-4256-8a04-2d21a4ba20b3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:21:47 user nova-compute[85141]: DEBUG nova.compute.manager [req-434ed72e-3f78-46b4-88a5-9f5009dc9bf4 req-d56e903c-f621-4323-b1b3-fbbd68e8f23c service nova] [instance: bff3a84b-6ab5-4256-8a04-2d21a4ba20b3] No waiting events found dispatching network-vif-plugged-23ec0327-ca81-4524-8850-2c081e596d44 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:21:47 user nova-compute[85141]: WARNING nova.compute.manager [req-434ed72e-3f78-46b4-88a5-9f5009dc9bf4 req-d56e903c-f621-4323-b1b3-fbbd68e8f23c service nova] [instance: bff3a84b-6ab5-4256-8a04-2d21a4ba20b3] Received unexpected event network-vif-plugged-23ec0327-ca81-4524-8850-2c081e596d44 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 16 10:21:47 user nova-compute[85141]: DEBUG nova.compute.manager [None req-b88d16f6-7877-4ba6-8d2d-fe7f68d9855e tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] [instance: 0b388b98-4e65-4258-bbe2-77e699321fb7] Instance event wait completed in 0 seconds for  {{(pid=85141) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 10:21:47 user nova-compute[85141]: INFO nova.virt.libvirt.driver [-] [instance: 0b388b98-4e65-4258-bbe2-77e699321fb7] Instance rebooted successfully.
Nov 16 10:21:47 user nova-compute[85141]: DEBUG nova.compute.manager [None req-b88d16f6-7877-4ba6-8d2d-fe7f68d9855e tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] [instance: 0b388b98-4e65-4258-bbe2-77e699321fb7] Checking state {{(pid=85141) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 10:21:48 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:21:48 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:21:48 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:21:48 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:21:49 user nova-compute[85141]: DEBUG nova.compute.manager [req-9824d98e-5254-4e14-8a5b-5f80a7effc73 req-908e2eb1-50cb-4f0c-a8e3-4c42cb526f80 service nova] [instance: bff3a84b-6ab5-4256-8a04-2d21a4ba20b3] Received event network-vif-plugged-23ec0327-ca81-4524-8850-2c081e596d44 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:21:49 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-9824d98e-5254-4e14-8a5b-5f80a7effc73 req-908e2eb1-50cb-4f0c-a8e3-4c42cb526f80 service nova] Acquiring lock "bff3a84b-6ab5-4256-8a04-2d21a4ba20b3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:21:49 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-9824d98e-5254-4e14-8a5b-5f80a7effc73 req-908e2eb1-50cb-4f0c-a8e3-4c42cb526f80 service nova] Lock "bff3a84b-6ab5-4256-8a04-2d21a4ba20b3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:21:49 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-9824d98e-5254-4e14-8a5b-5f80a7effc73 req-908e2eb1-50cb-4f0c-a8e3-4c42cb526f80 service nova] Lock "bff3a84b-6ab5-4256-8a04-2d21a4ba20b3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:21:49 user nova-compute[85141]: DEBUG nova.compute.manager [req-9824d98e-5254-4e14-8a5b-5f80a7effc73 req-908e2eb1-50cb-4f0c-a8e3-4c42cb526f80 service nova] [instance: bff3a84b-6ab5-4256-8a04-2d21a4ba20b3] No waiting events found dispatching network-vif-plugged-23ec0327-ca81-4524-8850-2c081e596d44 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:21:49 user nova-compute[85141]: WARNING nova.compute.manager [req-9824d98e-5254-4e14-8a5b-5f80a7effc73 req-908e2eb1-50cb-4f0c-a8e3-4c42cb526f80 service nova] [instance: bff3a84b-6ab5-4256-8a04-2d21a4ba20b3] Received unexpected event network-vif-plugged-23ec0327-ca81-4524-8850-2c081e596d44 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 16 10:21:50 user nova-compute[85141]: DEBUG nova.compute.manager [None req-2cbc5a55-c109-48fa-af33-f0de5eb77452 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] [instance: bff3a84b-6ab5-4256-8a04-2d21a4ba20b3] Instance event wait completed in 0 seconds for  {{(pid=85141) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 10:21:50 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-2cbc5a55-c109-48fa-af33-f0de5eb77452 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] [instance: bff3a84b-6ab5-4256-8a04-2d21a4ba20b3] Guest created on hypervisor {{(pid=85141) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 10:21:50 user nova-compute[85141]: INFO nova.virt.libvirt.driver [-] [instance: bff3a84b-6ab5-4256-8a04-2d21a4ba20b3] Instance spawned successfully.
Nov 16 10:21:50 user nova-compute[85141]: DEBUG nova.compute.manager [None req-2cbc5a55-c109-48fa-af33-f0de5eb77452 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] [instance: bff3a84b-6ab5-4256-8a04-2d21a4ba20b3] Checking state {{(pid=85141) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 10:21:50 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-2cbc5a55-c109-48fa-af33-f0de5eb77452 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Lock "bff3a84b-6ab5-4256-8a04-2d21a4ba20b3" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 12.487s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:21:50 user nova-compute[85141]: INFO nova.compute.manager [None req-2b5713f9-6798-443c-a2fc-9d5989e1471f tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] [instance: 4e214bbb-5bbb-4e6f-ac09-9cb1412f068b] Unrescuing
Nov 16 10:21:50 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-2b5713f9-6798-443c-a2fc-9d5989e1471f tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Acquiring lock "refresh_cache-4e214bbb-5bbb-4e6f-ac09-9cb1412f068b" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:21:50 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-2b5713f9-6798-443c-a2fc-9d5989e1471f tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Acquired lock "refresh_cache-4e214bbb-5bbb-4e6f-ac09-9cb1412f068b" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:21:50 user nova-compute[85141]: DEBUG nova.network.neutron [None req-2b5713f9-6798-443c-a2fc-9d5989e1471f tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] [instance: 4e214bbb-5bbb-4e6f-ac09-9cb1412f068b] Building network info cache for instance {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 10:21:51 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:21:51 user nova-compute[85141]: DEBUG nova.network.neutron [None req-2b5713f9-6798-443c-a2fc-9d5989e1471f tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] [instance: 4e214bbb-5bbb-4e6f-ac09-9cb1412f068b] Updating instance_info_cache with network_info: [{"id": "b0a1b07c-bdba-4ef8-893e-fb5dcdbac88c", "address": "fa:16:3e:b9:03:60", "network": {"id": "5b67a3fd-ef1e-4f2c-b6e0-31766ef39d30", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2137186235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09b520de67ac4290a4b779f50afeb1a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0a1b07c-bd", "ovs_interfaceid": "b0a1b07c-bdba-4ef8-893e-fb5dcdbac88c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:21:51 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-2b5713f9-6798-443c-a2fc-9d5989e1471f tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Releasing lock "refresh_cache-4e214bbb-5bbb-4e6f-ac09-9cb1412f068b" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:21:51 user nova-compute[85141]: DEBUG nova.objects.instance [None req-2b5713f9-6798-443c-a2fc-9d5989e1471f tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Lazy-loading 'flavor' on Instance uuid 4e214bbb-5bbb-4e6f-ac09-9cb1412f068b {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:21:51 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:21:51 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:21:52 user nova-compute[85141]: DEBUG nova.compute.manager [req-bc4799a2-7a0d-4877-86ad-23e62e572bc9 req-86e1a4ad-ff1b-4371-918a-131ceab9215d service nova] [instance: 4e214bbb-5bbb-4e6f-ac09-9cb1412f068b] Received event network-vif-unplugged-b0a1b07c-bdba-4ef8-893e-fb5dcdbac88c {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:21:52 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-bc4799a2-7a0d-4877-86ad-23e62e572bc9 req-86e1a4ad-ff1b-4371-918a-131ceab9215d service nova] Acquiring lock "4e214bbb-5bbb-4e6f-ac09-9cb1412f068b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:21:52 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-bc4799a2-7a0d-4877-86ad-23e62e572bc9 req-86e1a4ad-ff1b-4371-918a-131ceab9215d service nova] Lock "4e214bbb-5bbb-4e6f-ac09-9cb1412f068b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:21:52 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-bc4799a2-7a0d-4877-86ad-23e62e572bc9 req-86e1a4ad-ff1b-4371-918a-131ceab9215d service nova] Lock "4e214bbb-5bbb-4e6f-ac09-9cb1412f068b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:21:52 user nova-compute[85141]: DEBUG nova.compute.manager [req-bc4799a2-7a0d-4877-86ad-23e62e572bc9 req-86e1a4ad-ff1b-4371-918a-131ceab9215d service nova] [instance: 4e214bbb-5bbb-4e6f-ac09-9cb1412f068b] No waiting events found dispatching network-vif-unplugged-b0a1b07c-bdba-4ef8-893e-fb5dcdbac88c {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:21:52 user nova-compute[85141]: WARNING nova.compute.manager [req-bc4799a2-7a0d-4877-86ad-23e62e572bc9 req-86e1a4ad-ff1b-4371-918a-131ceab9215d service nova] [instance: 4e214bbb-5bbb-4e6f-ac09-9cb1412f068b] Received unexpected event network-vif-unplugged-b0a1b07c-bdba-4ef8-893e-fb5dcdbac88c for instance with vm_state rescued and task_state unrescuing.
Nov 16 10:21:52 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:21:52 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:21:52 user nova-compute[85141]: INFO nova.virt.libvirt.driver [-] [instance: 4e214bbb-5bbb-4e6f-ac09-9cb1412f068b] Instance destroyed successfully.
Nov 16 10:21:52 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:21:54 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:21:54 user nova-compute[85141]: DEBUG nova.compute.manager [req-9131d79a-7eb2-40e7-84b0-6d469ad79443 req-8e21c77c-4b15-4578-82b3-620cd4cbcd5d service nova] [instance: 4e214bbb-5bbb-4e6f-ac09-9cb1412f068b] Received event network-vif-plugged-b0a1b07c-bdba-4ef8-893e-fb5dcdbac88c {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:21:54 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-9131d79a-7eb2-40e7-84b0-6d469ad79443 req-8e21c77c-4b15-4578-82b3-620cd4cbcd5d service nova] Acquiring lock "4e214bbb-5bbb-4e6f-ac09-9cb1412f068b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:21:54 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-9131d79a-7eb2-40e7-84b0-6d469ad79443 req-8e21c77c-4b15-4578-82b3-620cd4cbcd5d service nova] Lock "4e214bbb-5bbb-4e6f-ac09-9cb1412f068b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:21:54 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-9131d79a-7eb2-40e7-84b0-6d469ad79443 req-8e21c77c-4b15-4578-82b3-620cd4cbcd5d service nova] Lock "4e214bbb-5bbb-4e6f-ac09-9cb1412f068b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:21:54 user nova-compute[85141]: DEBUG nova.compute.manager [req-9131d79a-7eb2-40e7-84b0-6d469ad79443 req-8e21c77c-4b15-4578-82b3-620cd4cbcd5d service nova] [instance: 4e214bbb-5bbb-4e6f-ac09-9cb1412f068b] No waiting events found dispatching network-vif-plugged-b0a1b07c-bdba-4ef8-893e-fb5dcdbac88c {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:21:54 user nova-compute[85141]: WARNING nova.compute.manager [req-9131d79a-7eb2-40e7-84b0-6d469ad79443 req-8e21c77c-4b15-4578-82b3-620cd4cbcd5d service nova] [instance: 4e214bbb-5bbb-4e6f-ac09-9cb1412f068b] Received unexpected event network-vif-plugged-b0a1b07c-bdba-4ef8-893e-fb5dcdbac88c for instance with vm_state rescued and task_state unrescuing.
Nov 16 10:21:54 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:21:54 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:21:54 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:21:54 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:21:56 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:21:56 user nova-compute[85141]: DEBUG nova.compute.manager [req-06e48249-bcaf-42db-a78b-dc867ffb2f31 req-0692134a-9c30-449c-a708-a01b75375d36 service nova] [instance: 4e214bbb-5bbb-4e6f-ac09-9cb1412f068b] Received event network-vif-plugged-b0a1b07c-bdba-4ef8-893e-fb5dcdbac88c {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:21:56 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-06e48249-bcaf-42db-a78b-dc867ffb2f31 req-0692134a-9c30-449c-a708-a01b75375d36 service nova] Acquiring lock "4e214bbb-5bbb-4e6f-ac09-9cb1412f068b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:21:56 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-06e48249-bcaf-42db-a78b-dc867ffb2f31 req-0692134a-9c30-449c-a708-a01b75375d36 service nova] Lock "4e214bbb-5bbb-4e6f-ac09-9cb1412f068b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:21:56 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-06e48249-bcaf-42db-a78b-dc867ffb2f31 req-0692134a-9c30-449c-a708-a01b75375d36 service nova] Lock "4e214bbb-5bbb-4e6f-ac09-9cb1412f068b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:21:56 user nova-compute[85141]: DEBUG nova.compute.manager [req-06e48249-bcaf-42db-a78b-dc867ffb2f31 req-0692134a-9c30-449c-a708-a01b75375d36 service nova] [instance: 4e214bbb-5bbb-4e6f-ac09-9cb1412f068b] No waiting events found dispatching network-vif-plugged-b0a1b07c-bdba-4ef8-893e-fb5dcdbac88c {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:21:56 user nova-compute[85141]: WARNING nova.compute.manager [req-06e48249-bcaf-42db-a78b-dc867ffb2f31 req-0692134a-9c30-449c-a708-a01b75375d36 service nova] [instance: 4e214bbb-5bbb-4e6f-ac09-9cb1412f068b] Received unexpected event network-vif-plugged-b0a1b07c-bdba-4ef8-893e-fb5dcdbac88c for instance with vm_state rescued and task_state unrescuing.
Nov 16 10:21:56 user nova-compute[85141]: DEBUG nova.compute.manager [req-06e48249-bcaf-42db-a78b-dc867ffb2f31 req-0692134a-9c30-449c-a708-a01b75375d36 service nova] [instance: 4e214bbb-5bbb-4e6f-ac09-9cb1412f068b] Received event network-vif-plugged-b0a1b07c-bdba-4ef8-893e-fb5dcdbac88c {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:21:56 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-06e48249-bcaf-42db-a78b-dc867ffb2f31 req-0692134a-9c30-449c-a708-a01b75375d36 service nova] Acquiring lock "4e214bbb-5bbb-4e6f-ac09-9cb1412f068b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:21:56 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-06e48249-bcaf-42db-a78b-dc867ffb2f31 req-0692134a-9c30-449c-a708-a01b75375d36 service nova] Lock "4e214bbb-5bbb-4e6f-ac09-9cb1412f068b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:21:56 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-06e48249-bcaf-42db-a78b-dc867ffb2f31 req-0692134a-9c30-449c-a708-a01b75375d36 service nova] Lock "4e214bbb-5bbb-4e6f-ac09-9cb1412f068b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:21:56 user nova-compute[85141]: DEBUG nova.compute.manager [req-06e48249-bcaf-42db-a78b-dc867ffb2f31 req-0692134a-9c30-449c-a708-a01b75375d36 service nova] [instance: 4e214bbb-5bbb-4e6f-ac09-9cb1412f068b] No waiting events found dispatching network-vif-plugged-b0a1b07c-bdba-4ef8-893e-fb5dcdbac88c {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:21:56 user nova-compute[85141]: WARNING nova.compute.manager [req-06e48249-bcaf-42db-a78b-dc867ffb2f31 req-0692134a-9c30-449c-a708-a01b75375d36 service nova] [instance: 4e214bbb-5bbb-4e6f-ac09-9cb1412f068b] Received unexpected event network-vif-plugged-b0a1b07c-bdba-4ef8-893e-fb5dcdbac88c for instance with vm_state rescued and task_state unrescuing.
Nov 16 10:21:56 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-082dec01-b40d-435a-93a1-ced45489fc10 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 2d7787a2-b8da-4d39-9b16-4c7bcb275f85 is timed out.
Nov 16 10:21:56 user nova-compute[85141]: DEBUG nova.compute.manager [None req-2b5713f9-6798-443c-a2fc-9d5989e1471f tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] [instance: 4e214bbb-5bbb-4e6f-ac09-9cb1412f068b] Checking state {{(pid=85141) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 10:21:56 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-082dec01-b40d-435a-93a1-ced45489fc10 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Successfully detached device vdb from instance 2d7787a2-b8da-4d39-9b16-4c7bcb275f85 from the live domain config.
Nov 16 10:21:56 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-082dec01-b40d-435a-93a1-ced45489fc10 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] [instance: 2d7787a2-b8da-4d39-9b16-4c7bcb275f85] calling os-brick to detach iSCSI Volume {{(pid=85141) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 10:21:56 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-082dec01-b40d-435a-93a1-ced45489fc10 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51806b6080>, {'target_iqn': 'iqn.2010-10.org.openstack:7dc504e0-da46-4c57-a66d-8ae6ce9c733c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iFVOdJIq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 10:21:56 user nova-compute[85141]: WARNING os_brick.initiator.connectors.base [None req-082dec01-b40d-435a-93a1-ced45489fc10 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 10:21:56 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-082dec01-b40d-435a-93a1-ced45489fc10 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 10:21:56 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-082dec01-b40d-435a-93a1-ced45489fc10 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 10:21:56 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:21:56 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:21:56 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[940a113d-2901-4ade-b631-0593fc87b081]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3392fa71-5ceb-42f9-acb8-b9e69b8b1cfa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2f7784b4-2ba5-4085-9e17-877c754115c8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ca5a51ee-cdb2-4efa-b7e5-8a97d0c99bf7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7dc504e0-da46-4c57-a66d-8ae6ce9c733c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:674f9ae8-6ab5-4ff2-b715-fe8807c34793\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:21:56 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-082dec01-b40d-435a-93a1-ced45489fc10 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 10:21:56 user nova-compute[85141]: No targets found.
Nov 16 10:21:56 user nova-compute[85141]: iSNS:
Nov 16 10:21:56 user nova-compute[85141]: No targets found.
Nov 16 10:21:56 user nova-compute[85141]: STATIC:
Nov 16 10:21:56 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:3392fa71-5ceb-42f9-acb8-b9e69b8b1cfa
Nov 16 10:21:56 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:21:56 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:21:56 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee
Nov 16 10:21:56 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:21:56 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:21:56 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:2f7784b4-2ba5-4085-9e17-877c754115c8
Nov 16 10:21:56 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:21:56 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:21:56 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:ca5a51ee-cdb2-4efa-b7e5-8a97d0c99bf7
Nov 16 10:21:56 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:21:56 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:21:56 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:7dc504e0-da46-4c57-a66d-8ae6ce9c733c
Nov 16 10:21:56 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:21:56 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:21:56 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:674f9ae8-6ab5-4ff2-b715-fe8807c34793
Nov 16 10:21:56 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:21:56 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:21:56 user nova-compute[85141]: FIRMWARE:
Nov 16 10:21:56 user nova-compute[85141]: No targets found.
Nov 16 10:21:56 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:21:56 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-082dec01-b40d-435a-93a1-ced45489fc10 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 10:21:56 user nova-compute[85141]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 10:21:56 user nova-compute[85141]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=85141) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 10:21:56 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-082dec01-b40d-435a-93a1-ced45489fc10 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7dc504e0-da46-4c57-a66d-8ae6ce9c733c', 0)] {{(pid=85141) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 10:21:56 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:21:56 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:21:56 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fb08baa-b90a-4fcb-8e49-5028d65628e8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2f7784b4-2ba5-4085-9e17-877c754115c8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3392fa71-5ceb-42f9-acb8-b9e69b8b1cfa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:674f9ae8-6ab5-4ff2-b715-fe8807c34793\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7dc504e0-da46-4c57-a66d-8ae6ce9c733c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ca5a51ee-cdb2-4efa-b7e5-8a97d0c99bf7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:21:56 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:21:56 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:21:56 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb3b7841-87bc-4926-b863-69b80f222221]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3392fa71-5ceb-42f9-acb8-b9e69b8b1cfa (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7784b4-2ba5-4085-9e17-877c754115c8 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dc504e0-da46-4c57-a66d-8ae6ce9c733c (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:674f9ae8-6ab5-4ff2-b715-fe8807c34793 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca5a51ee-cdb2-4efa-b7e5-8a97d0c99bf7 (non-flash)\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:21:56 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-082dec01-b40d-435a-93a1-ced45489fc10 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)
Nov 16 10:21:56 user nova-compute[85141]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3392fa71-5ceb-42f9-acb8-b9e69b8b1cfa (non-flash)
Nov 16 10:21:56 user nova-compute[85141]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7784b4-2ba5-4085-9e17-877c754115c8 (non-flash)
Nov 16 10:21:56 user nova-compute[85141]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dc504e0-da46-4c57-a66d-8ae6ce9c733c (non-flash)
Nov 16 10:21:56 user nova-compute[85141]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:674f9ae8-6ab5-4ff2-b715-fe8807c34793 (non-flash)
Nov 16 10:21:56 user nova-compute[85141]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca5a51ee-cdb2-4efa-b7e5-8a97d0c99bf7 (non-flash)
Nov 16 10:21:56 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:21:56 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-082dec01-b40d-435a-93a1-ced45489fc10 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)
Nov 16 10:21:56 user nova-compute[85141]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3392fa71-5ceb-42f9-acb8-b9e69b8b1cfa (non-flash)
Nov 16 10:21:56 user nova-compute[85141]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7784b4-2ba5-4085-9e17-877c754115c8 (non-flash)
Nov 16 10:21:56 user nova-compute[85141]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7dc504e0-da46-4c57-a66d-8ae6ce9c733c (non-flash)
Nov 16 10:21:56 user nova-compute[85141]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:674f9ae8-6ab5-4ff2-b715-fe8807c34793 (non-flash)
Nov 16 10:21:56 user nova-compute[85141]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca5a51ee-cdb2-4efa-b7e5-8a97d0c99bf7 (non-flash)
Nov 16 10:21:56 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 10:21:56 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-082dec01-b40d-435a-93a1-ced45489fc10 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f51606a92d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7dc504e0-da46-4c57-a66d-8ae6ce9c733c'): ({'sdb'}, set())}) {{(pid=85141) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 10:21:56 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-082dec01-b40d-435a-93a1-ced45489fc10 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Removing single pathed devices sdb {{(pid=85141) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 10:21:56 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:21:56 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:21:56 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a2bae72-9923-40e9-8067-ca2c4151a9be]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:21:56 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:21:56 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:21:56 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[7232b901-9f2a-4968-86d3-c6be2fdad3f0]: (4, ('ok\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:21:56 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-082dec01-b40d-435a-93a1-ced45489fc10 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Flushing IO for device /dev/sdb {{(pid=85141) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 10:21:56 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:21:56 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:21:56 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c0194cf-f135-4376-b7ad-87782630df41]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:21:56 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-082dec01-b40d-435a-93a1-ced45489fc10 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=85141) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 10:21:56 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:21:56 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.060s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:21:56 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[a71473ce-485a-47b5-ae5c-c8d3037d81be]: (4, ('1', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:21:56 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-082dec01-b40d-435a-93a1-ced45489fc10 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=85141) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 10:21:56 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-082dec01-b40d-435a-93a1-ced45489fc10 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] SCSI volumes sdb have been removed. {{(pid=85141) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 10:21:56 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-082dec01-b40d-435a-93a1-ced45489fc10 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7dc504e0-da46-4c57-a66d-8ae6ce9c733c')] {{(pid=85141) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 10:21:56 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7dc504e0-da46-4c57-a66d-8ae6ce9c733c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:21:56 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7dc504e0-da46-4c57-a66d-8ae6ce9c733c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:21:56 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[32d40d2e-4765-464a-916f-9643e71b9c8c]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:21:56 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-082dec01-b40d-435a-93a1-ced45489fc10 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:21:56 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7dc504e0-da46-4c57-a66d-8ae6ce9c733c -p 172.16.0.220:3260 --logout {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:21:56 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7dc504e0-da46-4c57-a66d-8ae6ce9c733c -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:21:56 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef8cc3df-f782-4b0f-b4b0-5f9f17174555]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:7dc504e0-da46-4c57-a66d-8ae6ce9c733c, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:7dc504e0-da46-4c57-a66d-8ae6ce9c733c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:21:56 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-082dec01-b40d-435a-93a1-ced45489fc10 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:7dc504e0-da46-4c57-a66d-8ae6ce9c733c, portal: 172.16.0.220,3260]
Nov 16 10:21:56 user nova-compute[85141]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:7dc504e0-da46-4c57-a66d-8ae6ce9c733c, portal: 172.16.0.220,3260] successful.
Nov 16 10:21:56 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:21:56 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7dc504e0-da46-4c57-a66d-8ae6ce9c733c -p 172.16.0.220:3260 --op delete {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:21:56 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7dc504e0-da46-4c57-a66d-8ae6ce9c733c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:21:56 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d41c69f-7065-46bf-8d26-366c8d3a3439]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:21:56 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-082dec01-b40d-435a-93a1-ced45489fc10 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:21:56 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-082dec01-b40d-435a-93a1-ced45489fc10 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.357s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 10:21:56 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-082dec01-b40d-435a-93a1-ced45489fc10 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] <== disconnect_volume: return (358ms) None {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 10:21:56 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-082dec01-b40d-435a-93a1-ced45489fc10 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] [instance: 2d7787a2-b8da-4d39-9b16-4c7bcb275f85] Disconnected iSCSI Volume {{(pid=85141) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 10:21:57 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:21:57 user nova-compute[85141]: DEBUG nova.objects.instance [None req-082dec01-b40d-435a-93a1-ced45489fc10 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Lazy-loading 'flavor' on Instance uuid 2d7787a2-b8da-4d39-9b16-4c7bcb275f85 {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:21:57 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-082dec01-b40d-435a-93a1-ced45489fc10 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Lock "2d7787a2-b8da-4d39-9b16-4c7bcb275f85" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.414s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:22:01 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:22:01 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-57e92c8d-01e0-4173-a67a-28f2c55a7d22 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] Acquiring lock "fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:22:01 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-57e92c8d-01e0-4173-a67a-28f2c55a7d22 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] Lock "fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:22:01 user nova-compute[85141]: INFO nova.compute.manager [None req-57e92c8d-01e0-4173-a67a-28f2c55a7d22 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] [instance: fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f] Detaching volume 3392fa71-5ceb-42f9-acb8-b9e69b8b1cfa
Nov 16 10:22:01 user nova-compute[85141]: INFO nova.virt.block_device [None req-57e92c8d-01e0-4173-a67a-28f2c55a7d22 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] [instance: fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f] Attempting to driver detach volume 3392fa71-5ceb-42f9-acb8-b9e69b8b1cfa from mountpoint /dev/vdb
Nov 16 10:22:01 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-57e92c8d-01e0-4173-a67a-28f2c55a7d22 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] Attempting to detach device vdb from instance fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f from the persistent domain config. {{(pid=85141) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 10:22:01 user nova-compute[85141]: DEBUG nova.virt.libvirt.guest [None req-57e92c8d-01e0-4173-a67a-28f2c55a7d22 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 10:22:01 user nova-compute[85141]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 10:22:01 user nova-compute[85141]:   <source dev="/dev/sdd"/>
Nov 16 10:22:01 user nova-compute[85141]:   <target dev="vdb" bus="virtio"/>
Nov 16 10:22:01 user nova-compute[85141]:   <serial>3392fa71-5ceb-42f9-acb8-b9e69b8b1cfa</serial>
Nov 16 10:22:01 user nova-compute[85141]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 10:22:01 user nova-compute[85141]: </disk>
Nov 16 10:22:01 user nova-compute[85141]:  {{(pid=85141) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 10:22:01 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-57e92c8d-01e0-4173-a67a-28f2c55a7d22 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] Successfully detached device vdb from instance fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f from the persistent domain config.
Nov 16 10:22:01 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-57e92c8d-01e0-4173-a67a-28f2c55a7d22 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f from the live domain config. {{(pid=85141) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 10:22:01 user nova-compute[85141]: DEBUG nova.virt.libvirt.guest [None req-57e92c8d-01e0-4173-a67a-28f2c55a7d22 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 10:22:01 user nova-compute[85141]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 10:22:01 user nova-compute[85141]:   <source dev="/dev/sdd"/>
Nov 16 10:22:01 user nova-compute[85141]:   <target dev="vdb" bus="virtio"/>
Nov 16 10:22:01 user nova-compute[85141]:   <serial>3392fa71-5ceb-42f9-acb8-b9e69b8b1cfa</serial>
Nov 16 10:22:01 user nova-compute[85141]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 10:22:01 user nova-compute[85141]: </disk>
Nov 16 10:22:01 user nova-compute[85141]:  {{(pid=85141) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 10:22:01 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-57e92c8d-01e0-4173-a67a-28f2c55a7d22 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f {{(pid=85141) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 10:22:02 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:22:06 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:22:07 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:22:11 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:22:12 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:22:16 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:22:17 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5e5b29e7-273b-4958-9a55-50a6d13fa467 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Acquiring lock "9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:22:17 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5e5b29e7-273b-4958-9a55-50a6d13fa467 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Lock "9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:22:17 user nova-compute[85141]: INFO nova.compute.manager [None req-5e5b29e7-273b-4958-9a55-50a6d13fa467 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] [instance: 9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008] Detaching volume 2f7784b4-2ba5-4085-9e17-877c754115c8
Nov 16 10:22:17 user nova-compute[85141]: INFO nova.virt.block_device [None req-5e5b29e7-273b-4958-9a55-50a6d13fa467 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] [instance: 9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008] Attempting to driver detach volume 2f7784b4-2ba5-4085-9e17-877c754115c8 from mountpoint /dev/vdb
Nov 16 10:22:17 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-5e5b29e7-273b-4958-9a55-50a6d13fa467 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Attempting to detach device vdb from instance 9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008 from the persistent domain config. {{(pid=85141) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 10:22:17 user nova-compute[85141]: DEBUG nova.virt.libvirt.guest [None req-5e5b29e7-273b-4958-9a55-50a6d13fa467 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 10:22:17 user nova-compute[85141]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 10:22:17 user nova-compute[85141]:   <source dev="/dev/sde"/>
Nov 16 10:22:17 user nova-compute[85141]:   <target dev="vdb" bus="virtio"/>
Nov 16 10:22:17 user nova-compute[85141]:   <serial>2f7784b4-2ba5-4085-9e17-877c754115c8</serial>
Nov 16 10:22:17 user nova-compute[85141]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 16 10:22:17 user nova-compute[85141]: </disk>
Nov 16 10:22:17 user nova-compute[85141]:  {{(pid=85141) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 10:22:17 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-5e5b29e7-273b-4958-9a55-50a6d13fa467 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Successfully detached device vdb from instance 9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008 from the persistent domain config.
Nov 16 10:22:17 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-5e5b29e7-273b-4958-9a55-50a6d13fa467 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008 from the live domain config. {{(pid=85141) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 10:22:17 user nova-compute[85141]: DEBUG nova.virt.libvirt.guest [None req-5e5b29e7-273b-4958-9a55-50a6d13fa467 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 10:22:17 user nova-compute[85141]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 10:22:17 user nova-compute[85141]:   <source dev="/dev/sde"/>
Nov 16 10:22:17 user nova-compute[85141]:   <target dev="vdb" bus="virtio"/>
Nov 16 10:22:17 user nova-compute[85141]:   <serial>2f7784b4-2ba5-4085-9e17-877c754115c8</serial>
Nov 16 10:22:17 user nova-compute[85141]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 16 10:22:17 user nova-compute[85141]: </disk>
Nov 16 10:22:17 user nova-compute[85141]:  {{(pid=85141) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 10:22:17 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-5e5b29e7-273b-4958-9a55-50a6d13fa467 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008 {{(pid=85141) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 10:22:17 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:22:21 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:22:21 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-57e92c8d-01e0-4173-a67a-28f2c55a7d22 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f is timed out.
Nov 16 10:22:21 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-57e92c8d-01e0-4173-a67a-28f2c55a7d22 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] Successfully detached device vdb from instance fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f from the live domain config.
Nov 16 10:22:21 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-57e92c8d-01e0-4173-a67a-28f2c55a7d22 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] [instance: fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f] calling os-brick to detach iSCSI Volume {{(pid=85141) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 10:22:21 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-57e92c8d-01e0-4173-a67a-28f2c55a7d22 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51806b6080>, {'target_iqn': 'iqn.2010-10.org.openstack:3392fa71-5ceb-42f9-acb8-b9e69b8b1cfa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'svSOAuQY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 10:22:21 user nova-compute[85141]: WARNING os_brick.initiator.connectors.base [None req-57e92c8d-01e0-4173-a67a-28f2c55a7d22 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 10:22:21 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-57e92c8d-01e0-4173-a67a-28f2c55a7d22 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 10:22:21 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-57e92c8d-01e0-4173-a67a-28f2c55a7d22 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 10:22:21 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:22:21 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:22:21 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc64c47b-2aa1-40ba-8267-75b46bd4746c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3392fa71-5ceb-42f9-acb8-b9e69b8b1cfa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2f7784b4-2ba5-4085-9e17-877c754115c8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ca5a51ee-cdb2-4efa-b7e5-8a97d0c99bf7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:674f9ae8-6ab5-4ff2-b715-fe8807c34793\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:22:21 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-57e92c8d-01e0-4173-a67a-28f2c55a7d22 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 10:22:21 user nova-compute[85141]: No targets found.
Nov 16 10:22:21 user nova-compute[85141]: iSNS:
Nov 16 10:22:21 user nova-compute[85141]: No targets found.
Nov 16 10:22:21 user nova-compute[85141]: STATIC:
Nov 16 10:22:21 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:3392fa71-5ceb-42f9-acb8-b9e69b8b1cfa
Nov 16 10:22:21 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:22:21 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:22:21 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee
Nov 16 10:22:21 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:22:21 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:22:21 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:2f7784b4-2ba5-4085-9e17-877c754115c8
Nov 16 10:22:21 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:22:21 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:22:21 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:ca5a51ee-cdb2-4efa-b7e5-8a97d0c99bf7
Nov 16 10:22:21 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:22:21 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:22:21 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:674f9ae8-6ab5-4ff2-b715-fe8807c34793
Nov 16 10:22:21 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:22:21 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:22:21 user nova-compute[85141]: FIRMWARE:
Nov 16 10:22:21 user nova-compute[85141]: No targets found.
Nov 16 10:22:21 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:22:21 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-57e92c8d-01e0-4173-a67a-28f2c55a7d22 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 10:22:21 user nova-compute[85141]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 10:22:21 user nova-compute[85141]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=85141) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 10:22:21 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-57e92c8d-01e0-4173-a67a-28f2c55a7d22 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3392fa71-5ceb-42f9-acb8-b9e69b8b1cfa', 0)] {{(pid=85141) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 10:22:21 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:22:21 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:22:21 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[9128dcc2-2a7f-4b1f-8d87-ad566e289004]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2f7784b4-2ba5-4085-9e17-877c754115c8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3392fa71-5ceb-42f9-acb8-b9e69b8b1cfa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:674f9ae8-6ab5-4ff2-b715-fe8807c34793\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ca5a51ee-cdb2-4efa-b7e5-8a97d0c99bf7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:22:21 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:22:21 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:22:21 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[f64820a2-1cf0-4dc3-927e-0a528304f274]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3392fa71-5ceb-42f9-acb8-b9e69b8b1cfa (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7784b4-2ba5-4085-9e17-877c754115c8 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:674f9ae8-6ab5-4ff2-b715-fe8807c34793 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca5a51ee-cdb2-4efa-b7e5-8a97d0c99bf7 (non-flash)\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:22:21 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-57e92c8d-01e0-4173-a67a-28f2c55a7d22 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)
Nov 16 10:22:21 user nova-compute[85141]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3392fa71-5ceb-42f9-acb8-b9e69b8b1cfa (non-flash)
Nov 16 10:22:21 user nova-compute[85141]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7784b4-2ba5-4085-9e17-877c754115c8 (non-flash)
Nov 16 10:22:21 user nova-compute[85141]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:674f9ae8-6ab5-4ff2-b715-fe8807c34793 (non-flash)
Nov 16 10:22:21 user nova-compute[85141]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca5a51ee-cdb2-4efa-b7e5-8a97d0c99bf7 (non-flash)
Nov 16 10:22:21 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:22:21 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-57e92c8d-01e0-4173-a67a-28f2c55a7d22 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)
Nov 16 10:22:21 user nova-compute[85141]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3392fa71-5ceb-42f9-acb8-b9e69b8b1cfa (non-flash)
Nov 16 10:22:21 user nova-compute[85141]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7784b4-2ba5-4085-9e17-877c754115c8 (non-flash)
Nov 16 10:22:21 user nova-compute[85141]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:674f9ae8-6ab5-4ff2-b715-fe8807c34793 (non-flash)
Nov 16 10:22:21 user nova-compute[85141]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca5a51ee-cdb2-4efa-b7e5-8a97d0c99bf7 (non-flash)
Nov 16 10:22:21 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 10:22:21 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-57e92c8d-01e0-4173-a67a-28f2c55a7d22 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f51802abe20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3392fa71-5ceb-42f9-acb8-b9e69b8b1cfa'): ({'sdd'}, set())}) {{(pid=85141) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 10:22:21 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-57e92c8d-01e0-4173-a67a-28f2c55a7d22 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] Removing single pathed devices sdd {{(pid=85141) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 10:22:21 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:22:21 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:22:21 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[05ed26ef-796e-46e8-a2d9-27ff16c15198]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:22:21 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:22:21 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:22:21 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[310a309b-4f45-405b-bbc5-af9a4403fa63]: (4, ('ok\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:22:21 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-57e92c8d-01e0-4173-a67a-28f2c55a7d22 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] Flushing IO for device /dev/sdd {{(pid=85141) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 10:22:21 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:22:21 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:22:21 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[662c1290-438c-4efa-9a5d-e64f3a7f6722]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:22:21 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-57e92c8d-01e0-4173-a67a-28f2c55a7d22 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=85141) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 10:22:21 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:22:22 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.051s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:22:22 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[3304ba27-5796-4148-b9c5-df85f4525af8]: (4, ('1', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:22:22 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-57e92c8d-01e0-4173-a67a-28f2c55a7d22 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=85141) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 10:22:22 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-57e92c8d-01e0-4173-a67a-28f2c55a7d22 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] SCSI volumes sdd have been removed. {{(pid=85141) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 10:22:22 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-57e92c8d-01e0-4173-a67a-28f2c55a7d22 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3392fa71-5ceb-42f9-acb8-b9e69b8b1cfa')] {{(pid=85141) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 10:22:22 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3392fa71-5ceb-42f9-acb8-b9e69b8b1cfa -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:22:22 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3392fa71-5ceb-42f9-acb8-b9e69b8b1cfa -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:22:22 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[01186f3c-33c7-4c44-b88a-390cc9da69ea]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:22:22 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-57e92c8d-01e0-4173-a67a-28f2c55a7d22 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:22:22 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3392fa71-5ceb-42f9-acb8-b9e69b8b1cfa -p 172.16.0.220:3260 --logout {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:22:22 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3392fa71-5ceb-42f9-acb8-b9e69b8b1cfa -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:22:22 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[af455a19-6931-4688-940d-dc1ba5b17d3c]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:3392fa71-5ceb-42f9-acb8-b9e69b8b1cfa, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:3392fa71-5ceb-42f9-acb8-b9e69b8b1cfa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:22:22 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-57e92c8d-01e0-4173-a67a-28f2c55a7d22 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:3392fa71-5ceb-42f9-acb8-b9e69b8b1cfa, portal: 172.16.0.220,3260]
Nov 16 10:22:22 user nova-compute[85141]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:3392fa71-5ceb-42f9-acb8-b9e69b8b1cfa, portal: 172.16.0.220,3260] successful.
Nov 16 10:22:22 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:22:22 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3392fa71-5ceb-42f9-acb8-b9e69b8b1cfa -p 172.16.0.220:3260 --op delete {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:22:22 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3392fa71-5ceb-42f9-acb8-b9e69b8b1cfa -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:22:22 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ab5ff2d-c184-4e90-8f9c-6ce2fa8ed656]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:22:22 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-57e92c8d-01e0-4173-a67a-28f2c55a7d22 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:22:22 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-57e92c8d-01e0-4173-a67a-28f2c55a7d22 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.318s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 10:22:22 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-57e92c8d-01e0-4173-a67a-28f2c55a7d22 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] <== disconnect_volume: return (320ms) None {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 10:22:22 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-57e92c8d-01e0-4173-a67a-28f2c55a7d22 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] [instance: fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f] Disconnected iSCSI Volume {{(pid=85141) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 10:22:22 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:22:22 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:22:22 user nova-compute[85141]: DEBUG nova.objects.instance [None req-57e92c8d-01e0-4173-a67a-28f2c55a7d22 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] Lazy-loading 'flavor' on Instance uuid fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:22:22 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-57e92c8d-01e0-4173-a67a-28f2c55a7d22 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] Lock "fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.644s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:22:24 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:22:26 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:22:27 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:22:27 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Starting heal instance info cache {{(pid=85141) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 10:22:27 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Acquiring lock "refresh_cache-b24c3954-06ff-4e15-9e43-c65d1dae7a5d" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:22:27 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Acquired lock "refresh_cache-b24c3954-06ff-4e15-9e43-c65d1dae7a5d" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:22:27 user nova-compute[85141]: DEBUG nova.network.neutron [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] [instance: b24c3954-06ff-4e15-9e43-c65d1dae7a5d] Forcefully refreshing network info cache for instance {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 10:22:27 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:22:27 user nova-compute[85141]: DEBUG nova.network.neutron [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] [instance: b24c3954-06ff-4e15-9e43-c65d1dae7a5d] Updating instance_info_cache with network_info: [{"id": "6becb779-bd08-4a40-bb56-3b8f03d1f844", "address": "fa:16:3e:ca:42:7f", "network": {"id": "5b67a3fd-ef1e-4f2c-b6e0-31766ef39d30", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2137186235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09b520de67ac4290a4b779f50afeb1a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6becb779-bd", "ovs_interfaceid": "6becb779-bd08-4a40-bb56-3b8f03d1f844", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:22:27 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Releasing lock "refresh_cache-b24c3954-06ff-4e15-9e43-c65d1dae7a5d" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:22:27 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] [instance: b24c3954-06ff-4e15-9e43-c65d1dae7a5d] Updated the network info_cache for instance {{(pid=85141) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 10:22:28 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-1b9558df-a068-4824-bf93-53ae10a57b33 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Acquiring lock "2d7787a2-b8da-4d39-9b16-4c7bcb275f85" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:22:28 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-1b9558df-a068-4824-bf93-53ae10a57b33 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Lock "2d7787a2-b8da-4d39-9b16-4c7bcb275f85" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:22:28 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-1b9558df-a068-4824-bf93-53ae10a57b33 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Acquiring lock "2d7787a2-b8da-4d39-9b16-4c7bcb275f85-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:22:28 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-1b9558df-a068-4824-bf93-53ae10a57b33 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Lock "2d7787a2-b8da-4d39-9b16-4c7bcb275f85-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:22:28 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-1b9558df-a068-4824-bf93-53ae10a57b33 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Lock "2d7787a2-b8da-4d39-9b16-4c7bcb275f85-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:22:28 user nova-compute[85141]: INFO nova.compute.manager [None req-1b9558df-a068-4824-bf93-53ae10a57b33 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] [instance: 2d7787a2-b8da-4d39-9b16-4c7bcb275f85] Terminating instance
Nov 16 10:22:28 user nova-compute[85141]: DEBUG nova.compute.manager [None req-1b9558df-a068-4824-bf93-53ae10a57b33 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] [instance: 2d7787a2-b8da-4d39-9b16-4c7bcb275f85] Start destroying the instance on the hypervisor. {{(pid=85141) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 10:22:28 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:22:28 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:22:28 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:22:28 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:22:28 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:22:28 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:22:28 user nova-compute[85141]: DEBUG nova.compute.manager [req-22378543-5785-4e89-b449-56d6e2d42f5c req-82360a83-75f2-4e65-a2e9-a2331e325776 service nova] [instance: 2d7787a2-b8da-4d39-9b16-4c7bcb275f85] Received event network-vif-unplugged-3f553883-eaa0-4a7e-8e31-1170241a0236 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:22:28 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-22378543-5785-4e89-b449-56d6e2d42f5c req-82360a83-75f2-4e65-a2e9-a2331e325776 service nova] Acquiring lock "2d7787a2-b8da-4d39-9b16-4c7bcb275f85-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:22:28 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-22378543-5785-4e89-b449-56d6e2d42f5c req-82360a83-75f2-4e65-a2e9-a2331e325776 service nova] Lock "2d7787a2-b8da-4d39-9b16-4c7bcb275f85-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:22:28 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-22378543-5785-4e89-b449-56d6e2d42f5c req-82360a83-75f2-4e65-a2e9-a2331e325776 service nova] Lock "2d7787a2-b8da-4d39-9b16-4c7bcb275f85-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:22:28 user nova-compute[85141]: DEBUG nova.compute.manager [req-22378543-5785-4e89-b449-56d6e2d42f5c req-82360a83-75f2-4e65-a2e9-a2331e325776 service nova] [instance: 2d7787a2-b8da-4d39-9b16-4c7bcb275f85] No waiting events found dispatching network-vif-unplugged-3f553883-eaa0-4a7e-8e31-1170241a0236 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:22:28 user nova-compute[85141]: DEBUG nova.compute.manager [req-22378543-5785-4e89-b449-56d6e2d42f5c req-82360a83-75f2-4e65-a2e9-a2331e325776 service nova] [instance: 2d7787a2-b8da-4d39-9b16-4c7bcb275f85] Received event network-vif-unplugged-3f553883-eaa0-4a7e-8e31-1170241a0236 for instance with task_state deleting. {{(pid=85141) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 10:22:28 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:22:28 user nova-compute[85141]: INFO nova.virt.libvirt.driver [-] [instance: 2d7787a2-b8da-4d39-9b16-4c7bcb275f85] Instance destroyed successfully.
Nov 16 10:22:28 user nova-compute[85141]: DEBUG nova.objects.instance [None req-1b9558df-a068-4824-bf93-53ae10a57b33 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Lazy-loading 'resources' on Instance uuid 2d7787a2-b8da-4d39-9b16-4c7bcb275f85 {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:22:28 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-1b9558df-a068-4824-bf93-53ae10a57b33 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T10:17:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1258419633',display_name='tempest-TestMinimumBasicScenario-server-1258419633',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1258419633',id=22,image_ref='e960df59-53b9-475b-b762-72c61c99e0eb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBItDkOA9C0uJPf9LijOMkhRvGGhUREdg5zYTmAP8Jr2q5TskNTHRCZQqwtHRWI5QTrlnhI5kKcYXRZFhe3aqQnbfNkSahjTY0HHASfhQQbujcaJQTG8nSUyM5nxOwF6+5g==',key_name='tempest-TestMinimumBasicScenario-2119154314',keypairs=<?>,launch_index=0,launched_at=2023-11-16T10:17:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b4e4f57f79564d2fbcb8080bf8f1c5c0',ramdisk_id='',reservation_id='r-3bxzxj23',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e960df59-53b9-475b-b762-72c61c99e0eb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-766472507',owner_user_name='tempest-TestMinimumBasicScenario-766472507-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T10:19:52Z,user_data=None,user_id='f8792b5cbd0845299dc396f922399980',uuid=2d7787a2-b8da-4d39-9b16-4c7bcb275f85,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3f553883-eaa0-4a7e-8e31-1170241a0236", "address": "fa:16:3e:1c:29:6f", "network": {"id": "436477fd-9294-4297-bfb3-405564823fa0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1068749207-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4e4f57f79564d2fbcb8080bf8f1c5c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f553883-ea", "ovs_interfaceid": "3f553883-eaa0-4a7e-8e31-1170241a0236", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 10:22:28 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-1b9558df-a068-4824-bf93-53ae10a57b33 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Converting VIF {"id": "3f553883-eaa0-4a7e-8e31-1170241a0236", "address": "fa:16:3e:1c:29:6f", "network": {"id": "436477fd-9294-4297-bfb3-405564823fa0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1068749207-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4e4f57f79564d2fbcb8080bf8f1c5c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f553883-ea", "ovs_interfaceid": "3f553883-eaa0-4a7e-8e31-1170241a0236", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:22:28 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-1b9558df-a068-4824-bf93-53ae10a57b33 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1c:29:6f,bridge_name='br-int',has_traffic_filtering=True,id=3f553883-eaa0-4a7e-8e31-1170241a0236,network=Network(436477fd-9294-4297-bfb3-405564823fa0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f553883-ea') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:22:28 user nova-compute[85141]: DEBUG os_vif [None req-1b9558df-a068-4824-bf93-53ae10a57b33 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1c:29:6f,bridge_name='br-int',has_traffic_filtering=True,id=3f553883-eaa0-4a7e-8e31-1170241a0236,network=Network(436477fd-9294-4297-bfb3-405564823fa0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f553883-ea') {{(pid=85141) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 10:22:28 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:22:28 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3f553883-ea, bridge=br-int, if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:22:28 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:22:28 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:22:28 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=15c82592-e54f-40d0-94f4-1c596a63b7ca) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:22:28 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:22:28 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:22:28 user nova-compute[85141]: INFO os_vif [None req-1b9558df-a068-4824-bf93-53ae10a57b33 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1c:29:6f,bridge_name='br-int',has_traffic_filtering=True,id=3f553883-eaa0-4a7e-8e31-1170241a0236,network=Network(436477fd-9294-4297-bfb3-405564823fa0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f553883-ea')
Nov 16 10:22:28 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-1b9558df-a068-4824-bf93-53ae10a57b33 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] [instance: 2d7787a2-b8da-4d39-9b16-4c7bcb275f85] Deleting instance files /opt/stack/data/nova/instances/2d7787a2-b8da-4d39-9b16-4c7bcb275f85_del
Nov 16 10:22:28 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-1b9558df-a068-4824-bf93-53ae10a57b33 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] [instance: 2d7787a2-b8da-4d39-9b16-4c7bcb275f85] Deletion of /opt/stack/data/nova/instances/2d7787a2-b8da-4d39-9b16-4c7bcb275f85_del complete
Nov 16 10:22:28 user nova-compute[85141]: INFO nova.compute.manager [None req-1b9558df-a068-4824-bf93-53ae10a57b33 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] [instance: 2d7787a2-b8da-4d39-9b16-4c7bcb275f85] Took 0.67 seconds to destroy the instance on the hypervisor.
Nov 16 10:22:28 user nova-compute[85141]: DEBUG oslo.service.loopingcall [None req-1b9558df-a068-4824-bf93-53ae10a57b33 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=85141) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 10:22:28 user nova-compute[85141]: DEBUG nova.compute.manager [-] [instance: 2d7787a2-b8da-4d39-9b16-4c7bcb275f85] Deallocating network for instance {{(pid=85141) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 10:22:28 user nova-compute[85141]: DEBUG nova.network.neutron [-] [instance: 2d7787a2-b8da-4d39-9b16-4c7bcb275f85] deallocate_for_instance() {{(pid=85141) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 10:22:29 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:22:29 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=85141) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 10:22:29 user nova-compute[85141]: DEBUG nova.network.neutron [-] [instance: 2d7787a2-b8da-4d39-9b16-4c7bcb275f85] Updating instance_info_cache with network_info: [] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:22:29 user nova-compute[85141]: INFO nova.compute.manager [-] [instance: 2d7787a2-b8da-4d39-9b16-4c7bcb275f85] Took 0.38 seconds to deallocate network for instance.
Nov 16 10:22:29 user nova-compute[85141]: DEBUG nova.compute.manager [req-14727b51-63de-4a45-a8d0-efd03ac2a3b8 req-e3039b77-54a5-48eb-a9a3-e5cff758eba2 service nova] [instance: 2d7787a2-b8da-4d39-9b16-4c7bcb275f85] Received event network-vif-deleted-3f553883-eaa0-4a7e-8e31-1170241a0236 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:22:29 user nova-compute[85141]: INFO nova.compute.manager [req-14727b51-63de-4a45-a8d0-efd03ac2a3b8 req-e3039b77-54a5-48eb-a9a3-e5cff758eba2 service nova] [instance: 2d7787a2-b8da-4d39-9b16-4c7bcb275f85] Neutron deleted interface 3f553883-eaa0-4a7e-8e31-1170241a0236; detaching it from the instance and deleting it from the info cache
Nov 16 10:22:29 user nova-compute[85141]: DEBUG nova.network.neutron [req-14727b51-63de-4a45-a8d0-efd03ac2a3b8 req-e3039b77-54a5-48eb-a9a3-e5cff758eba2 service nova] [instance: 2d7787a2-b8da-4d39-9b16-4c7bcb275f85] Updating instance_info_cache with network_info: [] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:22:29 user nova-compute[85141]: DEBUG nova.compute.manager [req-14727b51-63de-4a45-a8d0-efd03ac2a3b8 req-e3039b77-54a5-48eb-a9a3-e5cff758eba2 service nova] [instance: 2d7787a2-b8da-4d39-9b16-4c7bcb275f85] Detach interface failed, port_id=3f553883-eaa0-4a7e-8e31-1170241a0236, reason: Instance 2d7787a2-b8da-4d39-9b16-4c7bcb275f85 could not be found. {{(pid=85141) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 16 10:22:29 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-1b9558df-a068-4824-bf93-53ae10a57b33 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:22:29 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-1b9558df-a068-4824-bf93-53ae10a57b33 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:22:29 user nova-compute[85141]: DEBUG nova.compute.provider_tree [None req-1b9558df-a068-4824-bf93-53ae10a57b33 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Inventory has not changed in ProviderTree for provider: bf8e0fa1-16b6-408f-9203-c4cd63916272 {{(pid=85141) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 10:22:29 user nova-compute[85141]: DEBUG nova.scheduler.client.report [None req-1b9558df-a068-4824-bf93-53ae10a57b33 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Inventory has not changed for provider bf8e0fa1-16b6-408f-9203-c4cd63916272 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=85141) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 10:22:29 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-1b9558df-a068-4824-bf93-53ae10a57b33 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.377s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:22:29 user nova-compute[85141]: INFO nova.scheduler.client.report [None req-1b9558df-a068-4824-bf93-53ae10a57b33 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Deleted allocations for instance 2d7787a2-b8da-4d39-9b16-4c7bcb275f85
Nov 16 10:22:29 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-1b9558df-a068-4824-bf93-53ae10a57b33 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Lock "2d7787a2-b8da-4d39-9b16-4c7bcb275f85" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.605s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:22:30 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:22:30 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager.update_available_resource {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:22:30 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:22:30 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:22:30 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:22:30 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Auditing locally available compute resources for user (node: user) {{(pid=85141) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 10:22:30 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:22:30 user nova-compute[85141]: DEBUG nova.compute.manager [req-907b28d8-39c3-43dc-811d-1525208a60f4 req-5b469fa4-6557-4daa-9a7f-ba24f6ae643d service nova] [instance: 2d7787a2-b8da-4d39-9b16-4c7bcb275f85] Received event network-vif-plugged-3f553883-eaa0-4a7e-8e31-1170241a0236 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:22:30 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-907b28d8-39c3-43dc-811d-1525208a60f4 req-5b469fa4-6557-4daa-9a7f-ba24f6ae643d service nova] Acquiring lock "2d7787a2-b8da-4d39-9b16-4c7bcb275f85-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:22:30 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-907b28d8-39c3-43dc-811d-1525208a60f4 req-5b469fa4-6557-4daa-9a7f-ba24f6ae643d service nova] Lock "2d7787a2-b8da-4d39-9b16-4c7bcb275f85-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:22:30 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-907b28d8-39c3-43dc-811d-1525208a60f4 req-5b469fa4-6557-4daa-9a7f-ba24f6ae643d service nova] Lock "2d7787a2-b8da-4d39-9b16-4c7bcb275f85-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:22:30 user nova-compute[85141]: DEBUG nova.compute.manager [req-907b28d8-39c3-43dc-811d-1525208a60f4 req-5b469fa4-6557-4daa-9a7f-ba24f6ae643d service nova] [instance: 2d7787a2-b8da-4d39-9b16-4c7bcb275f85] No waiting events found dispatching network-vif-plugged-3f553883-eaa0-4a7e-8e31-1170241a0236 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:22:30 user nova-compute[85141]: WARNING nova.compute.manager [req-907b28d8-39c3-43dc-811d-1525208a60f4 req-5b469fa4-6557-4daa-9a7f-ba24f6ae643d service nova] [instance: 2d7787a2-b8da-4d39-9b16-4c7bcb275f85] Received unexpected event network-vif-plugged-3f553883-eaa0-4a7e-8e31-1170241a0236 for instance with vm_state deleted and task_state None.
Nov 16 10:22:30 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:22:30 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:22:30 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:22:30 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d842f90e-663b-4c95-9d7c-d092d2bac41f/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:22:31 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d842f90e-663b-4c95-9d7c-d092d2bac41f/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:22:31 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d842f90e-663b-4c95-9d7c-d092d2bac41f/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:22:31 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d842f90e-663b-4c95-9d7c-d092d2bac41f/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:22:31 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bff3a84b-6ab5-4256-8a04-2d21a4ba20b3/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:22:31 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bff3a84b-6ab5-4256-8a04-2d21a4ba20b3/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:22:31 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bff3a84b-6ab5-4256-8a04-2d21a4ba20b3/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:22:31 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bff3a84b-6ab5-4256-8a04-2d21a4ba20b3/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:22:31 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e214bbb-5bbb-4e6f-ac09-9cb1412f068b/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:22:31 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e214bbb-5bbb-4e6f-ac09-9cb1412f068b/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:22:31 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e214bbb-5bbb-4e6f-ac09-9cb1412f068b/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:22:31 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e214bbb-5bbb-4e6f-ac09-9cb1412f068b/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:22:31 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11986c5b-6914-491e-8e71-983ab6b13c6e/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:22:32 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11986c5b-6914-491e-8e71-983ab6b13c6e/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:22:32 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11986c5b-6914-491e-8e71-983ab6b13c6e/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:22:32 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11986c5b-6914-491e-8e71-983ab6b13c6e/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:22:32 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2e7cb0b-61b6-4d23-9b20-f8b437c7884e/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:22:32 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2e7cb0b-61b6-4d23-9b20-f8b437c7884e/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:22:32 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2e7cb0b-61b6-4d23-9b20-f8b437c7884e/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:22:32 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:22:32 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2e7cb0b-61b6-4d23-9b20-f8b437c7884e/disk --force-share --output=json" returned: 0 in 0.268s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:22:32 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b24c3954-06ff-4e15-9e43-c65d1dae7a5d/disk.rescue --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:22:33 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b24c3954-06ff-4e15-9e43-c65d1dae7a5d/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:22:33 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b24c3954-06ff-4e15-9e43-c65d1dae7a5d/disk.rescue --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:22:33 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b24c3954-06ff-4e15-9e43-c65d1dae7a5d/disk.rescue --force-share --output=json" returned: 0 in 0.189s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:22:33 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b24c3954-06ff-4e15-9e43-c65d1dae7a5d/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:22:33 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b24c3954-06ff-4e15-9e43-c65d1dae7a5d/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:22:33 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b24c3954-06ff-4e15-9e43-c65d1dae7a5d/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:22:33 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b24c3954-06ff-4e15-9e43-c65d1dae7a5d/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:22:33 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=85141) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 10:22:33 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b388b98-4e65-4258-bbe2-77e699321fb7/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:22:33 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b388b98-4e65-4258-bbe2-77e699321fb7/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:22:33 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b388b98-4e65-4258-bbe2-77e699321fb7/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:22:33 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:22:33 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b388b98-4e65-4258-bbe2-77e699321fb7/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:22:33 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=85141) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 10:22:33 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/059d6974-bd0c-4f73-91fc-8202ebda4238/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:22:34 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/059d6974-bd0c-4f73-91fc-8202ebda4238/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:22:34 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/059d6974-bd0c-4f73-91fc-8202ebda4238/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:22:34 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/059d6974-bd0c-4f73-91fc-8202ebda4238/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:22:34 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:22:34 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:22:34 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:22:34 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:22:34 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=85141) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 10:22:35 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:22:35 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:22:35 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Hypervisor/Node resource view: name=user free_ram=7286MB free_disk=24.836082458496094GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=85141) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 10:22:35 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:22:35 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:22:35 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance d842f90e-663b-4c95-9d7c-d092d2bac41f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:22:35 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance f01dc8cf-1a69-4618-a15d-0c1075157f05 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:22:35 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance 059d6974-bd0c-4f73-91fc-8202ebda4238 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:22:35 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance 4e214bbb-5bbb-4e6f-ac09-9cb1412f068b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:22:35 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance b24c3954-06ff-4e15-9e43-c65d1dae7a5d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:22:35 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:22:35 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance 9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:22:35 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance 0b388b98-4e65-4258-bbe2-77e699321fb7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:22:35 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance 11986c5b-6914-491e-8e71-983ab6b13c6e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:22:35 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance b2e7cb0b-61b6-4d23-9b20-f8b437c7884e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:22:35 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance e88874fe-b0a6-4292-8832-023f95e4f53c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:22:35 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance bff3a84b-6ab5-4256-8a04-2d21a4ba20b3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:22:35 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=85141) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 10:22:35 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=85141) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 10:22:35 user nova-compute[85141]: DEBUG nova.compute.provider_tree [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Inventory has not changed in ProviderTree for provider: bf8e0fa1-16b6-408f-9203-c4cd63916272 {{(pid=85141) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 10:22:35 user nova-compute[85141]: DEBUG nova.scheduler.client.report [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Inventory has not changed for provider bf8e0fa1-16b6-408f-9203-c4cd63916272 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=85141) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 10:22:35 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Compute_service record updated for user:user {{(pid=85141) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 10:22:35 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.530s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:22:37 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-5e5b29e7-273b-4958-9a55-50a6d13fa467 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008 is timed out.
Nov 16 10:22:37 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-5e5b29e7-273b-4958-9a55-50a6d13fa467 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Successfully detached device vdb from instance 9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008 from the live domain config.
Nov 16 10:22:37 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5e5b29e7-273b-4958-9a55-50a6d13fa467 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] [instance: 9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008] calling os-brick to detach iSCSI Volume {{(pid=85141) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 10:22:37 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e5b29e7-273b-4958-9a55-50a6d13fa467 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51806b6080>, {'target_iqn': 'iqn.2010-10.org.openstack:2f7784b4-2ba5-4085-9e17-877c754115c8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yEORChLP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 10:22:37 user nova-compute[85141]: WARNING os_brick.initiator.connectors.base [None req-5e5b29e7-273b-4958-9a55-50a6d13fa467 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 10:22:37 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-5e5b29e7-273b-4958-9a55-50a6d13fa467 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 10:22:37 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-5e5b29e7-273b-4958-9a55-50a6d13fa467 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 10:22:37 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:22:37 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:22:37 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8a224a8-3832-49bf-adfa-83be4d2d9715]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2f7784b4-2ba5-4085-9e17-877c754115c8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ca5a51ee-cdb2-4efa-b7e5-8a97d0c99bf7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:674f9ae8-6ab5-4ff2-b715-fe8807c34793\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:22:37 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e5b29e7-273b-4958-9a55-50a6d13fa467 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 10:22:37 user nova-compute[85141]: No targets found.
Nov 16 10:22:37 user nova-compute[85141]: iSNS:
Nov 16 10:22:37 user nova-compute[85141]: No targets found.
Nov 16 10:22:37 user nova-compute[85141]: STATIC:
Nov 16 10:22:37 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee
Nov 16 10:22:37 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:22:37 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:22:37 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:2f7784b4-2ba5-4085-9e17-877c754115c8
Nov 16 10:22:37 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:22:37 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:22:37 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:ca5a51ee-cdb2-4efa-b7e5-8a97d0c99bf7
Nov 16 10:22:37 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:22:37 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:22:37 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:674f9ae8-6ab5-4ff2-b715-fe8807c34793
Nov 16 10:22:37 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:22:37 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:22:37 user nova-compute[85141]: FIRMWARE:
Nov 16 10:22:37 user nova-compute[85141]: No targets found.
Nov 16 10:22:37 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:22:37 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e5b29e7-273b-4958-9a55-50a6d13fa467 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 10:22:37 user nova-compute[85141]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 10:22:37 user nova-compute[85141]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=85141) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 10:22:37 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e5b29e7-273b-4958-9a55-50a6d13fa467 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2f7784b4-2ba5-4085-9e17-877c754115c8', 0)] {{(pid=85141) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 10:22:37 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:22:37 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:22:37 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d710d44-6357-4c9c-9a03-321206b5d0cd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2f7784b4-2ba5-4085-9e17-877c754115c8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:674f9ae8-6ab5-4ff2-b715-fe8807c34793\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ca5a51ee-cdb2-4efa-b7e5-8a97d0c99bf7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:22:37 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:22:37 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:22:37 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ab7c2b8-9e37-4a55-b1fa-79aa49065cc4]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7784b4-2ba5-4085-9e17-877c754115c8 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:674f9ae8-6ab5-4ff2-b715-fe8807c34793 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca5a51ee-cdb2-4efa-b7e5-8a97d0c99bf7 (non-flash)\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:22:37 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e5b29e7-273b-4958-9a55-50a6d13fa467 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)
Nov 16 10:22:37 user nova-compute[85141]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7784b4-2ba5-4085-9e17-877c754115c8 (non-flash)
Nov 16 10:22:37 user nova-compute[85141]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:674f9ae8-6ab5-4ff2-b715-fe8807c34793 (non-flash)
Nov 16 10:22:37 user nova-compute[85141]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca5a51ee-cdb2-4efa-b7e5-8a97d0c99bf7 (non-flash)
Nov 16 10:22:37 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:22:37 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e5b29e7-273b-4958-9a55-50a6d13fa467 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)
Nov 16 10:22:37 user nova-compute[85141]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f7784b4-2ba5-4085-9e17-877c754115c8 (non-flash)
Nov 16 10:22:37 user nova-compute[85141]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:674f9ae8-6ab5-4ff2-b715-fe8807c34793 (non-flash)
Nov 16 10:22:37 user nova-compute[85141]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca5a51ee-cdb2-4efa-b7e5-8a97d0c99bf7 (non-flash)
Nov 16 10:22:37 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 10:22:37 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e5b29e7-273b-4958-9a55-50a6d13fa467 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f516065b9a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2f7784b4-2ba5-4085-9e17-877c754115c8'): ({'sde'}, set())}) {{(pid=85141) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 10:22:37 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-5e5b29e7-273b-4958-9a55-50a6d13fa467 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Removing single pathed devices sde {{(pid=85141) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 10:22:37 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:22:37 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:22:37 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[d77051db-d17b-42b1-bf10-c3d2f7dc7c3e]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:22:37 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:22:37 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.017s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:22:37 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f8dd6c5-c9e1-431d-b4b4-1aa4cc200f5a]: (4, ('ok\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:22:37 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-5e5b29e7-273b-4958-9a55-50a6d13fa467 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Flushing IO for device /dev/sde {{(pid=85141) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 10:22:37 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:22:37 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.012s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:22:37 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[95c5dd51-0209-4c68-a340-e4223323764b]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:22:37 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-5e5b29e7-273b-4958-9a55-50a6d13fa467 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=85141) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 10:22:37 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:22:37 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.043s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:22:37 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[0118306e-adb4-4cb2-b6ca-48b87f8efb28]: (4, ('1', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:22:37 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-5e5b29e7-273b-4958-9a55-50a6d13fa467 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=85141) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 10:22:37 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-5e5b29e7-273b-4958-9a55-50a6d13fa467 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] SCSI volumes sde have been removed. {{(pid=85141) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 10:22:37 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e5b29e7-273b-4958-9a55-50a6d13fa467 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2f7784b4-2ba5-4085-9e17-877c754115c8')] {{(pid=85141) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 10:22:37 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f7784b4-2ba5-4085-9e17-877c754115c8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:22:37 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f7784b4-2ba5-4085-9e17-877c754115c8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:22:37 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d7b6569-bfe7-4e8b-9f4c-db46ed5fdd3b]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:22:37 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e5b29e7-273b-4958-9a55-50a6d13fa467 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:22:37 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f7784b4-2ba5-4085-9e17-877c754115c8 -p 172.16.0.220:3260 --logout {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:22:37 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f7784b4-2ba5-4085-9e17-877c754115c8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:22:37 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8785020-a28a-42e0-bcb4-1badb4d09321]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:2f7784b4-2ba5-4085-9e17-877c754115c8, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:2f7784b4-2ba5-4085-9e17-877c754115c8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:22:37 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e5b29e7-273b-4958-9a55-50a6d13fa467 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:2f7784b4-2ba5-4085-9e17-877c754115c8, portal: 172.16.0.220,3260]
Nov 16 10:22:37 user nova-compute[85141]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:2f7784b4-2ba5-4085-9e17-877c754115c8, portal: 172.16.0.220,3260] successful.
Nov 16 10:22:37 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:22:37 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f7784b4-2ba5-4085-9e17-877c754115c8 -p 172.16.0.220:3260 --op delete {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:22:37 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f7784b4-2ba5-4085-9e17-877c754115c8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:22:37 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f511dd6-d122-445d-be9e-26b86d3a0bb4]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:22:37 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e5b29e7-273b-4958-9a55-50a6d13fa467 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:22:38 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-5e5b29e7-273b-4958-9a55-50a6d13fa467 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.296s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 10:22:38 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e5b29e7-273b-4958-9a55-50a6d13fa467 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] <== disconnect_volume: return (303ms) None {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 10:22:38 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5e5b29e7-273b-4958-9a55-50a6d13fa467 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] [instance: 9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008] Disconnected iSCSI Volume {{(pid=85141) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 10:22:38 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:22:38 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:22:38 user nova-compute[85141]: DEBUG nova.objects.instance [None req-5e5b29e7-273b-4958-9a55-50a6d13fa467 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Lazy-loading 'flavor' on Instance uuid 9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008 {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:22:38 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5e5b29e7-273b-4958-9a55-50a6d13fa467 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Lock "9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.677s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:22:38 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:22:43 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:22:47 user nova-compute[85141]: DEBUG nova.compute.manager [req-e7d60efd-3ca1-43ea-9b10-7bb1d4e79fdf req-fec2c5bc-5934-4754-b351-e151d8acf6f8 service nova] [instance: b2e7cb0b-61b6-4d23-9b20-f8b437c7884e] Received event network-changed-3bcbe73a-3c72-4cfe-ab83-141399d14845 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:22:47 user nova-compute[85141]: DEBUG nova.compute.manager [req-e7d60efd-3ca1-43ea-9b10-7bb1d4e79fdf req-fec2c5bc-5934-4754-b351-e151d8acf6f8 service nova] [instance: b2e7cb0b-61b6-4d23-9b20-f8b437c7884e] Refreshing instance network info cache due to event network-changed-3bcbe73a-3c72-4cfe-ab83-141399d14845. {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 10:22:47 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-e7d60efd-3ca1-43ea-9b10-7bb1d4e79fdf req-fec2c5bc-5934-4754-b351-e151d8acf6f8 service nova] Acquiring lock "refresh_cache-b2e7cb0b-61b6-4d23-9b20-f8b437c7884e" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:22:47 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-e7d60efd-3ca1-43ea-9b10-7bb1d4e79fdf req-fec2c5bc-5934-4754-b351-e151d8acf6f8 service nova] Acquired lock "refresh_cache-b2e7cb0b-61b6-4d23-9b20-f8b437c7884e" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:22:47 user nova-compute[85141]: DEBUG nova.network.neutron [req-e7d60efd-3ca1-43ea-9b10-7bb1d4e79fdf req-fec2c5bc-5934-4754-b351-e151d8acf6f8 service nova] [instance: b2e7cb0b-61b6-4d23-9b20-f8b437c7884e] Refreshing network info cache for port 3bcbe73a-3c72-4cfe-ab83-141399d14845 {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 10:22:47 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-dd444688-efcb-4197-a8ba-fd9291931b8a tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Acquiring lock "b2e7cb0b-61b6-4d23-9b20-f8b437c7884e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:22:47 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-dd444688-efcb-4197-a8ba-fd9291931b8a tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Lock "b2e7cb0b-61b6-4d23-9b20-f8b437c7884e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:22:47 user nova-compute[85141]: DEBUG nova.objects.instance [None req-dd444688-efcb-4197-a8ba-fd9291931b8a tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Lazy-loading 'flavor' on Instance uuid b2e7cb0b-61b6-4d23-9b20-f8b437c7884e {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:22:47 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-dd444688-efcb-4197-a8ba-fd9291931b8a tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] [instance: b2e7cb0b-61b6-4d23-9b20-f8b437c7884e] Ignoring supplied device name: /dev/vdb
Nov 16 10:22:47 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-dd444688-efcb-4197-a8ba-fd9291931b8a tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Lock "b2e7cb0b-61b6-4d23-9b20-f8b437c7884e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:22:47 user nova-compute[85141]: DEBUG nova.network.neutron [req-e7d60efd-3ca1-43ea-9b10-7bb1d4e79fdf req-fec2c5bc-5934-4754-b351-e151d8acf6f8 service nova] [instance: b2e7cb0b-61b6-4d23-9b20-f8b437c7884e] Updated VIF entry in instance network info cache for port 3bcbe73a-3c72-4cfe-ab83-141399d14845. {{(pid=85141) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 10:22:47 user nova-compute[85141]: DEBUG nova.network.neutron [req-e7d60efd-3ca1-43ea-9b10-7bb1d4e79fdf req-fec2c5bc-5934-4754-b351-e151d8acf6f8 service nova] [instance: b2e7cb0b-61b6-4d23-9b20-f8b437c7884e] Updating instance_info_cache with network_info: [{"id": "3bcbe73a-3c72-4cfe-ab83-141399d14845", "address": "fa:16:3e:3b:92:0e", "network": {"id": "d791d4f1-ec4b-4db3-ae9a-471f071206eb", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-369109742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a0984b7ef0346768c3231b9ab00fb57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bcbe73a-3c", "ovs_interfaceid": "3bcbe73a-3c72-4cfe-ab83-141399d14845", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:22:47 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-e7d60efd-3ca1-43ea-9b10-7bb1d4e79fdf req-fec2c5bc-5934-4754-b351-e151d8acf6f8 service nova] Releasing lock "refresh_cache-b2e7cb0b-61b6-4d23-9b20-f8b437c7884e" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:22:47 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:22:47 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-dd444688-efcb-4197-a8ba-fd9291931b8a tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Acquiring lock "b2e7cb0b-61b6-4d23-9b20-f8b437c7884e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:22:47 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-dd444688-efcb-4197-a8ba-fd9291931b8a tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Lock "b2e7cb0b-61b6-4d23-9b20-f8b437c7884e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:22:47 user nova-compute[85141]: INFO nova.compute.manager [None req-dd444688-efcb-4197-a8ba-fd9291931b8a tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] [instance: b2e7cb0b-61b6-4d23-9b20-f8b437c7884e] Attaching volume f7e99a5e-b380-4ab3-8af6-d78248719e89 to /dev/vdb
Nov 16 10:22:47 user nova-compute[85141]: DEBUG os_brick.utils [None req-dd444688-efcb-4197-a8ba-fd9291931b8a tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 10:22:47 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:22:47 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:22:47 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[77d9d387-9508-4326-b338-abf55759ab78]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c7834de5c295\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:22:47 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:22:47 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:22:47 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[69d2580b-1196-47c0-b30b-36fdc9007b79]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:22:47 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:22:47 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:22:47 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[80024710-bfa3-4878-bad4-b0e5524ee56a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:22:47 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0a115ff-90d5-4b06-b7aa-a7ad6dadb29e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:22:47 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-dd444688-efcb-4197-a8ba-fd9291931b8a tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Running cmd (subprocess): nvme version {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:22:47 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-dd444688-efcb-4197-a8ba-fd9291931b8a tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] 'nvme version' failed. Not Retrying. {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 10:22:47 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.nvmeof [None req-dd444688-efcb-4197-a8ba-fd9291931b8a tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] nvme not present on system {{(pid=85141) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 10:22:47 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:22:47 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 10:22:47 user nova-compute[85141]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 10:22:47 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[359aad90-91e8-4b13-aee6-ca17182354af]: (4, '') {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:22:47 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.lightos [None req-dd444688-efcb-4197-a8ba-fd9291931b8a tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=85141) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 10:22:47 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.lightos [None req-dd444688-efcb-4197-a8ba-fd9291931b8a tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=85141) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 10:22:47 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.lightos [None req-dd444688-efcb-4197-a8ba-fd9291931b8a tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] LIGHTOS: no hostnqn found. {{(pid=85141) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 10:22:47 user nova-compute[85141]: DEBUG os_brick.utils [None req-dd444688-efcb-4197-a8ba-fd9291931b8a tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c7834de5c295', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 10:22:47 user nova-compute[85141]: DEBUG nova.virt.block_device [None req-dd444688-efcb-4197-a8ba-fd9291931b8a tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] [instance: b2e7cb0b-61b6-4d23-9b20-f8b437c7884e] Updating existing volume attachment record: fd23f51d-7ad1-44f9-8fc1-f82fcd72fa24 {{(pid=85141) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 10:22:48 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:22:49 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-d51f959a-5949-412d-91d8-6f027376ad5d tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Acquiring lock "abe5d4b7-a0d7-40e3-b630-0de746ddb55b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:22:49 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-d51f959a-5949-412d-91d8-6f027376ad5d tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Lock "abe5d4b7-a0d7-40e3-b630-0de746ddb55b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:22:49 user nova-compute[85141]: DEBUG nova.compute.manager [None req-d51f959a-5949-412d-91d8-6f027376ad5d tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] [instance: abe5d4b7-a0d7-40e3-b630-0de746ddb55b] Starting instance... {{(pid=85141) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 10:22:49 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-d51f959a-5949-412d-91d8-6f027376ad5d tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:22:49 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-d51f959a-5949-412d-91d8-6f027376ad5d tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:22:49 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-d51f959a-5949-412d-91d8-6f027376ad5d tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=85141) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 10:22:49 user nova-compute[85141]: INFO nova.compute.claims [None req-d51f959a-5949-412d-91d8-6f027376ad5d tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] [instance: abe5d4b7-a0d7-40e3-b630-0de746ddb55b] Claim successful on node user
Nov 16 10:22:50 user nova-compute[85141]: DEBUG nova.compute.provider_tree [None req-d51f959a-5949-412d-91d8-6f027376ad5d tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Inventory has not changed in ProviderTree for provider: bf8e0fa1-16b6-408f-9203-c4cd63916272 {{(pid=85141) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 10:22:50 user nova-compute[85141]: DEBUG nova.scheduler.client.report [None req-d51f959a-5949-412d-91d8-6f027376ad5d tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Inventory has not changed for provider bf8e0fa1-16b6-408f-9203-c4cd63916272 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=85141) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 10:22:50 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-d51f959a-5949-412d-91d8-6f027376ad5d tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.543s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:22:50 user nova-compute[85141]: DEBUG nova.compute.manager [None req-d51f959a-5949-412d-91d8-6f027376ad5d tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] [instance: abe5d4b7-a0d7-40e3-b630-0de746ddb55b] Start building networks asynchronously for instance. {{(pid=85141) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 10:22:50 user nova-compute[85141]: DEBUG nova.compute.manager [None req-d51f959a-5949-412d-91d8-6f027376ad5d tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] [instance: abe5d4b7-a0d7-40e3-b630-0de746ddb55b] Allocating IP information in the background. {{(pid=85141) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 10:22:50 user nova-compute[85141]: DEBUG nova.network.neutron [None req-d51f959a-5949-412d-91d8-6f027376ad5d tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] [instance: abe5d4b7-a0d7-40e3-b630-0de746ddb55b] allocate_for_instance() {{(pid=85141) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 10:22:50 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-d51f959a-5949-412d-91d8-6f027376ad5d tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] [instance: abe5d4b7-a0d7-40e3-b630-0de746ddb55b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 10:22:50 user nova-compute[85141]: DEBUG nova.compute.manager [None req-d51f959a-5949-412d-91d8-6f027376ad5d tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] [instance: abe5d4b7-a0d7-40e3-b630-0de746ddb55b] Start building block device mappings for instance. {{(pid=85141) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 10:22:50 user nova-compute[85141]: DEBUG nova.policy [None req-d51f959a-5949-412d-91d8-6f027376ad5d tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ffe6ceff3cc346b59b4fbf294b9fc1a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733b504d4dbe4f028963cf2c197f0064', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85141) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 10:22:50 user nova-compute[85141]: INFO nova.virt.block_device [None req-d51f959a-5949-412d-91d8-6f027376ad5d tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] [instance: abe5d4b7-a0d7-40e3-b630-0de746ddb55b] Booting with volume-backed-image bc4ca70f-a459-4d5c-a9e6-80f1948eb48b at /dev/vda
Nov 16 10:22:51 user nova-compute[85141]: DEBUG nova.network.neutron [None req-d51f959a-5949-412d-91d8-6f027376ad5d tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] [instance: abe5d4b7-a0d7-40e3-b630-0de746ddb55b] Successfully created port: e583d579-7583-4f41-b0f1-b3241b6af956 {{(pid=85141) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 10:22:51 user nova-compute[85141]: DEBUG nova.network.neutron [None req-d51f959a-5949-412d-91d8-6f027376ad5d tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] [instance: abe5d4b7-a0d7-40e3-b630-0de746ddb55b] Successfully updated port: e583d579-7583-4f41-b0f1-b3241b6af956 {{(pid=85141) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 10:22:51 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-d51f959a-5949-412d-91d8-6f027376ad5d tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Acquiring lock "refresh_cache-abe5d4b7-a0d7-40e3-b630-0de746ddb55b" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:22:51 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-d51f959a-5949-412d-91d8-6f027376ad5d tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Acquired lock "refresh_cache-abe5d4b7-a0d7-40e3-b630-0de746ddb55b" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:22:51 user nova-compute[85141]: DEBUG nova.network.neutron [None req-d51f959a-5949-412d-91d8-6f027376ad5d tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] [instance: abe5d4b7-a0d7-40e3-b630-0de746ddb55b] Building network info cache for instance {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 10:22:51 user nova-compute[85141]: DEBUG nova.compute.manager [req-dee2bcf8-b3c1-4289-8f51-2f1ccc2e28c9 req-63228013-3be6-4dbc-8790-4526345867d4 service nova] [instance: abe5d4b7-a0d7-40e3-b630-0de746ddb55b] Received event network-changed-e583d579-7583-4f41-b0f1-b3241b6af956 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:22:51 user nova-compute[85141]: DEBUG nova.compute.manager [req-dee2bcf8-b3c1-4289-8f51-2f1ccc2e28c9 req-63228013-3be6-4dbc-8790-4526345867d4 service nova] [instance: abe5d4b7-a0d7-40e3-b630-0de746ddb55b] Refreshing instance network info cache due to event network-changed-e583d579-7583-4f41-b0f1-b3241b6af956. {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 10:22:51 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-dee2bcf8-b3c1-4289-8f51-2f1ccc2e28c9 req-63228013-3be6-4dbc-8790-4526345867d4 service nova] Acquiring lock "refresh_cache-abe5d4b7-a0d7-40e3-b630-0de746ddb55b" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:22:51 user nova-compute[85141]: DEBUG nova.network.neutron [None req-d51f959a-5949-412d-91d8-6f027376ad5d tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] [instance: abe5d4b7-a0d7-40e3-b630-0de746ddb55b] Instance cache missing network info. {{(pid=85141) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 10:22:51 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-17b7c49c-c0a8-4c6a-b6f0-c87911a953a6 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] Acquiring lock "fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:22:51 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-17b7c49c-c0a8-4c6a-b6f0-c87911a953a6 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] Lock "fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:22:51 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-17b7c49c-c0a8-4c6a-b6f0-c87911a953a6 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] Acquiring lock "fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:22:51 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-17b7c49c-c0a8-4c6a-b6f0-c87911a953a6 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] Lock "fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:22:51 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-17b7c49c-c0a8-4c6a-b6f0-c87911a953a6 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] Lock "fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:22:51 user nova-compute[85141]: INFO nova.compute.manager [None req-17b7c49c-c0a8-4c6a-b6f0-c87911a953a6 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] [instance: fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f] Terminating instance
Nov 16 10:22:51 user nova-compute[85141]: DEBUG nova.compute.manager [None req-17b7c49c-c0a8-4c6a-b6f0-c87911a953a6 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] [instance: fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f] Start destroying the instance on the hypervisor. {{(pid=85141) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 10:22:52 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:22:52 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:22:52 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:22:52 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:22:52 user nova-compute[85141]: DEBUG nova.network.neutron [None req-d51f959a-5949-412d-91d8-6f027376ad5d tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] [instance: abe5d4b7-a0d7-40e3-b630-0de746ddb55b] Updating instance_info_cache with network_info: [{"id": "e583d579-7583-4f41-b0f1-b3241b6af956", "address": "fa:16:3e:4d:24:64", "network": {"id": "e40e4bd2-4277-40b1-9451-1c8365ffa488", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1333036447-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "733b504d4dbe4f028963cf2c197f0064", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape583d579-75", "ovs_interfaceid": "e583d579-7583-4f41-b0f1-b3241b6af956", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:22:52 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-d51f959a-5949-412d-91d8-6f027376ad5d tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Releasing lock "refresh_cache-abe5d4b7-a0d7-40e3-b630-0de746ddb55b" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:22:52 user nova-compute[85141]: DEBUG nova.compute.manager [None req-d51f959a-5949-412d-91d8-6f027376ad5d tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] [instance: abe5d4b7-a0d7-40e3-b630-0de746ddb55b] Instance network_info: |[{"id": "e583d579-7583-4f41-b0f1-b3241b6af956", "address": "fa:16:3e:4d:24:64", "network": {"id": "e40e4bd2-4277-40b1-9451-1c8365ffa488", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1333036447-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "733b504d4dbe4f028963cf2c197f0064", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape583d579-75", "ovs_interfaceid": "e583d579-7583-4f41-b0f1-b3241b6af956", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=85141) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 10:22:52 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-dee2bcf8-b3c1-4289-8f51-2f1ccc2e28c9 req-63228013-3be6-4dbc-8790-4526345867d4 service nova] Acquired lock "refresh_cache-abe5d4b7-a0d7-40e3-b630-0de746ddb55b" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:22:52 user nova-compute[85141]: DEBUG nova.network.neutron [req-dee2bcf8-b3c1-4289-8f51-2f1ccc2e28c9 req-63228013-3be6-4dbc-8790-4526345867d4 service nova] [instance: abe5d4b7-a0d7-40e3-b630-0de746ddb55b] Refreshing network info cache for port e583d579-7583-4f41-b0f1-b3241b6af956 {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 10:22:52 user nova-compute[85141]: DEBUG nova.compute.manager [req-7accaa49-5709-4f3a-a033-efaab19eae32 req-33a777d5-1f6c-4a77-a072-9a47ba926aad service nova] [instance: fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f] Received event network-vif-unplugged-cc62aa76-c6d3-42a2-bf2a-7241919a5fc4 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:22:52 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-7accaa49-5709-4f3a-a033-efaab19eae32 req-33a777d5-1f6c-4a77-a072-9a47ba926aad service nova] Acquiring lock "fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:22:52 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-7accaa49-5709-4f3a-a033-efaab19eae32 req-33a777d5-1f6c-4a77-a072-9a47ba926aad service nova] Lock "fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:22:52 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-7accaa49-5709-4f3a-a033-efaab19eae32 req-33a777d5-1f6c-4a77-a072-9a47ba926aad service nova] Lock "fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:22:52 user nova-compute[85141]: DEBUG nova.compute.manager [req-7accaa49-5709-4f3a-a033-efaab19eae32 req-33a777d5-1f6c-4a77-a072-9a47ba926aad service nova] [instance: fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f] No waiting events found dispatching network-vif-unplugged-cc62aa76-c6d3-42a2-bf2a-7241919a5fc4 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:22:52 user nova-compute[85141]: DEBUG nova.compute.manager [req-7accaa49-5709-4f3a-a033-efaab19eae32 req-33a777d5-1f6c-4a77-a072-9a47ba926aad service nova] [instance: fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f] Received event network-vif-unplugged-cc62aa76-c6d3-42a2-bf2a-7241919a5fc4 for instance with task_state deleting. {{(pid=85141) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 10:22:52 user nova-compute[85141]: DEBUG nova.network.neutron [req-dee2bcf8-b3c1-4289-8f51-2f1ccc2e28c9 req-63228013-3be6-4dbc-8790-4526345867d4 service nova] [instance: abe5d4b7-a0d7-40e3-b630-0de746ddb55b] Updated VIF entry in instance network info cache for port e583d579-7583-4f41-b0f1-b3241b6af956. {{(pid=85141) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 10:22:52 user nova-compute[85141]: DEBUG nova.network.neutron [req-dee2bcf8-b3c1-4289-8f51-2f1ccc2e28c9 req-63228013-3be6-4dbc-8790-4526345867d4 service nova] [instance: abe5d4b7-a0d7-40e3-b630-0de746ddb55b] Updating instance_info_cache with network_info: [{"id": "e583d579-7583-4f41-b0f1-b3241b6af956", "address": "fa:16:3e:4d:24:64", "network": {"id": "e40e4bd2-4277-40b1-9451-1c8365ffa488", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1333036447-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "733b504d4dbe4f028963cf2c197f0064", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape583d579-75", "ovs_interfaceid": "e583d579-7583-4f41-b0f1-b3241b6af956", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:22:52 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-dee2bcf8-b3c1-4289-8f51-2f1ccc2e28c9 req-63228013-3be6-4dbc-8790-4526345867d4 service nova] Releasing lock "refresh_cache-abe5d4b7-a0d7-40e3-b630-0de746ddb55b" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:22:52 user nova-compute[85141]: INFO nova.virt.libvirt.driver [-] [instance: fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f] Instance destroyed successfully.
Nov 16 10:22:52 user nova-compute[85141]: DEBUG nova.objects.instance [None req-17b7c49c-c0a8-4c6a-b6f0-c87911a953a6 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] Lazy-loading 'resources' on Instance uuid fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:22:52 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-17b7c49c-c0a8-4c6a-b6f0-c87911a953a6 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T10:15:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-675096085',display_name='tempest-ServerStableDeviceRescueTest-server-675096085',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-675096085',id=19,image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDy6W/eGM5RIOL9sRQS4LaKkBVIMYLDkobB3fvhz5SdWZrhWPoji+Lbru+de1gziqrO+W/0HhQiWO7dkjKIiUJZL6ldxRiGA5rCsMCcnOQwbGGZ5zFupHppDTFvdF4wPCw==',key_name='tempest-keypair-756270117',keypairs=<?>,launch_index=0,launched_at=2023-11-16T10:19:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0cdf22a86934481196276e29c2cdb48b',ramdisk_id='',reservation_id='r-4s0k8n8m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-692155468',owner_user_name='tempest-ServerStableDeviceRescueTest-692155468-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T10:21:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9e95eddbeebf4768bc04632d5a94003a',uuid=fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cc62aa76-c6d3-42a2-bf2a-7241919a5fc4", "address": "fa:16:3e:3b:bc:05", "network": {"id": "434cf325-212a-4f85-9779-7791dc1c678f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-248496413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cdf22a86934481196276e29c2cdb48b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc62aa76-c6", "ovs_interfaceid": "cc62aa76-c6d3-42a2-bf2a-7241919a5fc4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 10:22:52 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-17b7c49c-c0a8-4c6a-b6f0-c87911a953a6 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] Converting VIF {"id": "cc62aa76-c6d3-42a2-bf2a-7241919a5fc4", "address": "fa:16:3e:3b:bc:05", "network": {"id": "434cf325-212a-4f85-9779-7791dc1c678f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-248496413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0cdf22a86934481196276e29c2cdb48b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc62aa76-c6", "ovs_interfaceid": "cc62aa76-c6d3-42a2-bf2a-7241919a5fc4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:22:52 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-17b7c49c-c0a8-4c6a-b6f0-c87911a953a6 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3b:bc:05,bridge_name='br-int',has_traffic_filtering=True,id=cc62aa76-c6d3-42a2-bf2a-7241919a5fc4,network=Network(434cf325-212a-4f85-9779-7791dc1c678f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc62aa76-c6') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:22:52 user nova-compute[85141]: DEBUG os_vif [None req-17b7c49c-c0a8-4c6a-b6f0-c87911a953a6 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3b:bc:05,bridge_name='br-int',has_traffic_filtering=True,id=cc62aa76-c6d3-42a2-bf2a-7241919a5fc4,network=Network(434cf325-212a-4f85-9779-7791dc1c678f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc62aa76-c6') {{(pid=85141) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 10:22:52 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:22:52 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcc62aa76-c6, bridge=br-int, if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:22:52 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:22:52 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:22:52 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:22:52 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=df249894-a335-4a6e-96fe-b816c9e0b667) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:22:52 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:22:52 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:22:52 user nova-compute[85141]: INFO os_vif [None req-17b7c49c-c0a8-4c6a-b6f0-c87911a953a6 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3b:bc:05,bridge_name='br-int',has_traffic_filtering=True,id=cc62aa76-c6d3-42a2-bf2a-7241919a5fc4,network=Network(434cf325-212a-4f85-9779-7791dc1c678f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc62aa76-c6')
Nov 16 10:22:52 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-17b7c49c-c0a8-4c6a-b6f0-c87911a953a6 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] [instance: fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f] Deleting instance files /opt/stack/data/nova/instances/fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f_del
Nov 16 10:22:52 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-17b7c49c-c0a8-4c6a-b6f0-c87911a953a6 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] [instance: fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f] Deletion of /opt/stack/data/nova/instances/fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f_del complete
Nov 16 10:22:52 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:22:52 user nova-compute[85141]: INFO nova.compute.manager [None req-17b7c49c-c0a8-4c6a-b6f0-c87911a953a6 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] [instance: fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 16 10:22:52 user nova-compute[85141]: DEBUG oslo.service.loopingcall [None req-17b7c49c-c0a8-4c6a-b6f0-c87911a953a6 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=85141) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 10:22:52 user nova-compute[85141]: DEBUG nova.compute.manager [-] [instance: fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f] Deallocating network for instance {{(pid=85141) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 10:22:52 user nova-compute[85141]: DEBUG nova.network.neutron [-] [instance: fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f] deallocate_for_instance() {{(pid=85141) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 10:22:53 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dd444688-efcb-4197-a8ba-fd9291931b8a tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] [instance: b2e7cb0b-61b6-4d23-9b20-f8b437c7884e] Calling os-brick to attach iSCSI Volume {{(pid=85141) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 10:22:53 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd444688-efcb-4197-a8ba-fd9291931b8a tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51806b6080>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f7e99a5e-b380-4ab3-8af6-d78248719e89', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HpEozlgS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 10:22:53 user nova-compute[85141]: WARNING os_brick.initiator.connectors.base [None req-dd444688-efcb-4197-a8ba-fd9291931b8a tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 10:22:53 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-dd444688-efcb-4197-a8ba-fd9291931b8a tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 10:22:53 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-dd444688-efcb-4197-a8ba-fd9291931b8a tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 10:22:53 user nova-compute[85141]: WARNING os_brick.initiator.connectors.base [None req-dd444688-efcb-4197-a8ba-fd9291931b8a tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 10:22:53 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-dd444688-efcb-4197-a8ba-fd9291931b8a tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f7e99a5e-b380-4ab3-8af6-d78248719e89" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 10:22:53 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-dd444688-efcb-4197-a8ba-fd9291931b8a tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f7e99a5e-b380-4ab3-8af6-d78248719e89" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 10:22:53 user nova-compute[85141]: INFO os_brick.initiator.connectors.iscsi [None req-dd444688-efcb-4197-a8ba-fd9291931b8a tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 10:22:53 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7e99a5e-b380-4ab3-8af6-d78248719e89 -p 172.16.0.220:3260 {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:22:53 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7e99a5e-b380-4ab3-8af6-d78248719e89 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:22:53 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7a0a35d-720f-461b-964b-3dff1bce0027]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:22:53 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd444688-efcb-4197-a8ba-fd9291931b8a tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 10:22:53 user nova-compute[85141]:  {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:22:53 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7e99a5e-b380-4ab3-8af6-d78248719e89 -p 172.16.0.220:3260 --interface default --op new {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:22:53 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7e99a5e-b380-4ab3-8af6-d78248719e89 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:22:53 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[b50c5a35-f7b1-4e66-a759-13fa408b5b07]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f7e99a5e-b380-4ab3-8af6-d78248719e89] added\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:22:53 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd444688-efcb-4197-a8ba-fd9291931b8a tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f7e99a5e-b380-4ab3-8af6-d78248719e89] added
Nov 16 10:22:53 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:22:53 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7e99a5e-b380-4ab3-8af6-d78248719e89 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:22:53 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7e99a5e-b380-4ab3-8af6-d78248719e89 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:22:53 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[199254ec-d5ff-4062-ac3b-f5d501a90055]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:22:53 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd444688-efcb-4197-a8ba-fd9291931b8a tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:22:53 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7e99a5e-b380-4ab3-8af6-d78248719e89 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:22:53 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7e99a5e-b380-4ab3-8af6-d78248719e89 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:22:53 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac78a665-d56d-4df2-8de2-a2d5de6a2d28]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:22:53 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd444688-efcb-4197-a8ba-fd9291931b8a tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:22:53 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7e99a5e-b380-4ab3-8af6-d78248719e89 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HpEozlgS {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:22:53 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7e99a5e-b380-4ab3-8af6-d78248719e89 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HpEozlgS" returned: 0 in 0.016s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:22:53 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[59a0b74f-50cb-46bf-9688-e48e4fd79de9]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:22:53 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd444688-efcb-4197-a8ba-fd9291931b8a tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HpEozlgS'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:22:53 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7e99a5e-b380-4ab3-8af6-d78248719e89 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:22:53 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7e99a5e-b380-4ab3-8af6-d78248719e89 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:22:53 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[15f51cb5-cacf-4a71-9da0-000b1372646e]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:22:53 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd444688-efcb-4197-a8ba-fd9291931b8a tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:22:53 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:22:53 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:22:53 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[133e4a0c-3576-444b-97c6-6c61f64d8748]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:674f9ae8-6ab5-4ff2-b715-fe8807c34793 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca5a51ee-cdb2-4efa-b7e5-8a97d0c99bf7 (non-flash)\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:22:53 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd444688-efcb-4197-a8ba-fd9291931b8a tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)
Nov 16 10:22:53 user nova-compute[85141]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:674f9ae8-6ab5-4ff2-b715-fe8807c34793 (non-flash)
Nov 16 10:22:53 user nova-compute[85141]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca5a51ee-cdb2-4efa-b7e5-8a97d0c99bf7 (non-flash)
Nov 16 10:22:53 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:22:53 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd444688-efcb-4197-a8ba-fd9291931b8a tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)
Nov 16 10:22:53 user nova-compute[85141]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:674f9ae8-6ab5-4ff2-b715-fe8807c34793 (non-flash)
Nov 16 10:22:53 user nova-compute[85141]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca5a51ee-cdb2-4efa-b7e5-8a97d0c99bf7 (non-flash)
Nov 16 10:22:53 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 10:22:53 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7e99a5e-b380-4ab3-8af6-d78248719e89 -p 172.16.0.220:3260 --login {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:22:53 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7e99a5e-b380-4ab3-8af6-d78248719e89 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:22:53 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[69c39ec2-21c6-4c2d-8ed6-53485dc22ab5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f7e99a5e-b380-4ab3-8af6-d78248719e89, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f7e99a5e-b380-4ab3-8af6-d78248719e89, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:22:53 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd444688-efcb-4197-a8ba-fd9291931b8a tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f7e99a5e-b380-4ab3-8af6-d78248719e89, portal: 172.16.0.220,3260]
Nov 16 10:22:53 user nova-compute[85141]: Login to [iface: default, target: iqn.2010-10.org.openstack:f7e99a5e-b380-4ab3-8af6-d78248719e89, portal: 172.16.0.220,3260] successful.
Nov 16 10:22:53 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:22:53 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7e99a5e-b380-4ab3-8af6-d78248719e89 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:22:53 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7e99a5e-b380-4ab3-8af6-d78248719e89 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:22:53 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[c15ffd60-3763-46a7-80cb-fabbc7f77fb7]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:22:53 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd444688-efcb-4197-a8ba-fd9291931b8a tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:22:53 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:22:53 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:22:53 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c0ff439-9395-4ca2-9842-a93b47e49a8f]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:674f9ae8-6ab5-4ff2-b715-fe8807c34793 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca5a51ee-cdb2-4efa-b7e5-8a97d0c99bf7 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7e99a5e-b380-4ab3-8af6-d78248719e89 (non-flash)\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:22:53 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd444688-efcb-4197-a8ba-fd9291931b8a tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)
Nov 16 10:22:53 user nova-compute[85141]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:674f9ae8-6ab5-4ff2-b715-fe8807c34793 (non-flash)
Nov 16 10:22:53 user nova-compute[85141]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca5a51ee-cdb2-4efa-b7e5-8a97d0c99bf7 (non-flash)
Nov 16 10:22:53 user nova-compute[85141]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7e99a5e-b380-4ab3-8af6-d78248719e89 (non-flash)
Nov 16 10:22:53 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:22:53 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd444688-efcb-4197-a8ba-fd9291931b8a tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)
Nov 16 10:22:53 user nova-compute[85141]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:674f9ae8-6ab5-4ff2-b715-fe8807c34793 (non-flash)
Nov 16 10:22:53 user nova-compute[85141]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca5a51ee-cdb2-4efa-b7e5-8a97d0c99bf7 (non-flash)
Nov 16 10:22:53 user nova-compute[85141]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7e99a5e-b380-4ab3-8af6-d78248719e89 (non-flash)
Nov 16 10:22:53 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 10:22:53 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-dd444688-efcb-4197-a8ba-fd9291931b8a tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f7e99a5e-b380-4ab3-8af6-d78248719e89" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.284s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 10:22:53 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd444688-efcb-4197-a8ba-fd9291931b8a tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Connected to 172.16.0.220:3260 {{(pid=85141) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 10:22:53 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-dd444688-efcb-4197-a8ba-fd9291931b8a tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] HCTL ('33', '-', '-', 0) found on session 34 with lun 0 {{(pid=85141) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 10:22:53 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-dd444688-efcb-4197-a8ba-fd9291931b8a tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=85141) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 10:22:53 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:22:53 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:22:53 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[894b64ea-6ca6-4d18-a12e-4bd488160ce3]: (4, ('- - 0', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:22:53 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-dd444688-efcb-4197-a8ba-fd9291931b8a tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Searching for a device in session 34 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=85141) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 10:22:53 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd444688-efcb-4197-a8ba-fd9291931b8a tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:f7e99a5e-b380-4ab3-8af6-d78248719e89', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HpEozlgS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=85141) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 10:22:53 user nova-compute[85141]: DEBUG nova.network.neutron [-] [instance: fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f] Updating instance_info_cache with network_info: [] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:22:53 user nova-compute[85141]: INFO nova.compute.manager [-] [instance: fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f] Took 0.75 seconds to deallocate network for instance.
Nov 16 10:22:53 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-17b7c49c-c0a8-4c6a-b6f0-c87911a953a6 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:22:53 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-17b7c49c-c0a8-4c6a-b6f0-c87911a953a6 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:22:53 user nova-compute[85141]: DEBUG nova.compute.manager [req-7b4b7427-ed1f-4caf-a320-842f6556ffa0 req-157b4a87-fca9-4559-bb92-0fa181f049a2 service nova] [instance: fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f] Received event network-vif-deleted-cc62aa76-c6d3-42a2-bf2a-7241919a5fc4 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:22:53 user nova-compute[85141]: DEBUG nova.compute.provider_tree [None req-17b7c49c-c0a8-4c6a-b6f0-c87911a953a6 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] Inventory has not changed in ProviderTree for provider: bf8e0fa1-16b6-408f-9203-c4cd63916272 {{(pid=85141) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 10:22:53 user nova-compute[85141]: DEBUG nova.scheduler.client.report [None req-17b7c49c-c0a8-4c6a-b6f0-c87911a953a6 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] Inventory has not changed for provider bf8e0fa1-16b6-408f-9203-c4cd63916272 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=85141) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 10:22:53 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-17b7c49c-c0a8-4c6a-b6f0-c87911a953a6 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.379s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:22:54 user nova-compute[85141]: INFO nova.scheduler.client.report [None req-17b7c49c-c0a8-4c6a-b6f0-c87911a953a6 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] Deleted allocations for instance fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f
Nov 16 10:22:54 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-17b7c49c-c0a8-4c6a-b6f0-c87911a953a6 tempest-ServerStableDeviceRescueTest-692155468 tempest-ServerStableDeviceRescueTest-692155468-project-member] Lock "fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.216s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:22:54 user nova-compute[85141]: DEBUG nova.compute.manager [req-9c6663c9-5724-4437-ab4a-b0b793d4d369 req-837e3f6d-0a63-4ab0-bb57-596222e54d54 service nova] [instance: fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f] Received event network-vif-plugged-cc62aa76-c6d3-42a2-bf2a-7241919a5fc4 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:22:54 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-9c6663c9-5724-4437-ab4a-b0b793d4d369 req-837e3f6d-0a63-4ab0-bb57-596222e54d54 service nova] Acquiring lock "fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:22:54 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-9c6663c9-5724-4437-ab4a-b0b793d4d369 req-837e3f6d-0a63-4ab0-bb57-596222e54d54 service nova] Lock "fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:22:54 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-9c6663c9-5724-4437-ab4a-b0b793d4d369 req-837e3f6d-0a63-4ab0-bb57-596222e54d54 service nova] Lock "fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:22:54 user nova-compute[85141]: DEBUG nova.compute.manager [req-9c6663c9-5724-4437-ab4a-b0b793d4d369 req-837e3f6d-0a63-4ab0-bb57-596222e54d54 service nova] [instance: fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f] No waiting events found dispatching network-vif-plugged-cc62aa76-c6d3-42a2-bf2a-7241919a5fc4 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:22:54 user nova-compute[85141]: WARNING nova.compute.manager [req-9c6663c9-5724-4437-ab4a-b0b793d4d369 req-837e3f6d-0a63-4ab0-bb57-596222e54d54 service nova] [instance: fcdeb679-3be6-4f0a-a2f2-800b9fef4b3f] Received unexpected event network-vif-plugged-cc62aa76-c6d3-42a2-bf2a-7241919a5fc4 for instance with vm_state deleted and task_state None.
Nov 16 10:22:54 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-dd444688-efcb-4197-a8ba-fd9291931b8a tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.322s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 10:22:54 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd444688-efcb-4197-a8ba-fd9291931b8a tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] <== connect_volume: return (1323ms) {'type': 'block', 'scsi_wwn': '26563316661383439', 'path': '/dev/sdb'} {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 10:22:54 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dd444688-efcb-4197-a8ba-fd9291931b8a tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] [instance: b2e7cb0b-61b6-4d23-9b20-f8b437c7884e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26563316661383439', 'path': '/dev/sdb'} {{(pid=85141) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 10:22:54 user nova-compute[85141]: DEBUG nova.objects.instance [None req-dd444688-efcb-4197-a8ba-fd9291931b8a tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Lazy-loading 'flavor' on Instance uuid b2e7cb0b-61b6-4d23-9b20-f8b437c7884e {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:22:54 user nova-compute[85141]: DEBUG nova.virt.libvirt.guest [None req-dd444688-efcb-4197-a8ba-fd9291931b8a tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 10:22:54 user nova-compute[85141]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 10:22:54 user nova-compute[85141]:   <source dev="/dev/sdb"/>
Nov 16 10:22:54 user nova-compute[85141]:   <target dev="vdb" bus="virtio"/>
Nov 16 10:22:54 user nova-compute[85141]:   <serial>f7e99a5e-b380-4ab3-8af6-d78248719e89</serial>
Nov 16 10:22:54 user nova-compute[85141]: </disk>
Nov 16 10:22:54 user nova-compute[85141]:  {{(pid=85141) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 10:22:54 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-dd444688-efcb-4197-a8ba-fd9291931b8a tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] No BDM found with device name vda, not building metadata. {{(pid=85141) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 10:22:54 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-dd444688-efcb-4197-a8ba-fd9291931b8a tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] No BDM found with device name vdb, not building metadata. {{(pid=85141) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 10:22:54 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-dd444688-efcb-4197-a8ba-fd9291931b8a tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] No VIF found with MAC fa:16:3e:3b:92:0e, not building metadata {{(pid=85141) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 10:22:55 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-dd444688-efcb-4197-a8ba-fd9291931b8a tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Lock "b2e7cb0b-61b6-4d23-9b20-f8b437c7884e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.272s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:22:56 user nova-compute[85141]: DEBUG os_brick.utils [None req-d51f959a-5949-412d-91d8-6f027376ad5d tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 10:22:56 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:22:56 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:22:56 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[26a62346-48f6-4afb-83fc-cbaee8b47591]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c7834de5c295\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:22:56 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:22:56 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:22:56 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aae0772-0871-42d2-9981-187cc68b2a91]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:22:56 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:22:56 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:22:56 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a24eaf5-fad0-4bc6-b9e1-9b45055f0f9b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:22:56 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7134f81-1104-46bd-9528-1362757ec107]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:22:56 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-d51f959a-5949-412d-91d8-6f027376ad5d tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Running cmd (subprocess): nvme version {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:22:56 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-d51f959a-5949-412d-91d8-6f027376ad5d tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] 'nvme version' failed. Not Retrying. {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 10:22:56 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d51f959a-5949-412d-91d8-6f027376ad5d tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] nvme not present on system {{(pid=85141) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 10:22:56 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:22:56 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 10:22:56 user nova-compute[85141]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 10:22:56 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7df7a7b-b5c1-4026-8078-4647053466dd]: (4, '') {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:22:56 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.lightos [None req-d51f959a-5949-412d-91d8-6f027376ad5d tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=85141) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 10:22:56 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.lightos [None req-d51f959a-5949-412d-91d8-6f027376ad5d tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=85141) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 10:22:56 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.lightos [None req-d51f959a-5949-412d-91d8-6f027376ad5d tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] LIGHTOS: no hostnqn found. {{(pid=85141) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 10:22:56 user nova-compute[85141]: DEBUG os_brick.utils [None req-d51f959a-5949-412d-91d8-6f027376ad5d tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] <== get_connector_properties: return (111ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c7834de5c295', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 10:22:56 user nova-compute[85141]: DEBUG nova.virt.block_device [None req-d51f959a-5949-412d-91d8-6f027376ad5d tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] [instance: abe5d4b7-a0d7-40e3-b630-0de746ddb55b] Updating existing volume attachment record: 11c14e5b-5e86-4d82-98ab-7094af60d951 {{(pid=85141) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 10:22:57 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:22:57 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:23:01 user nova-compute[85141]: DEBUG nova.compute.manager [None req-d51f959a-5949-412d-91d8-6f027376ad5d tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] [instance: abe5d4b7-a0d7-40e3-b630-0de746ddb55b] Start spawning the instance on the hypervisor. {{(pid=85141) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 10:23:01 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-d51f959a-5949-412d-91d8-6f027376ad5d tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] [instance: abe5d4b7-a0d7-40e3-b630-0de746ddb55b] Creating instance directory {{(pid=85141) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 10:23:01 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-d51f959a-5949-412d-91d8-6f027376ad5d tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] [instance: abe5d4b7-a0d7-40e3-b630-0de746ddb55b] Creating image(s)
Nov 16 10:23:01 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-d51f959a-5949-412d-91d8-6f027376ad5d tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] [instance: abe5d4b7-a0d7-40e3-b630-0de746ddb55b] Did not create local disks {{(pid=85141) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 16 10:23:01 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-d51f959a-5949-412d-91d8-6f027376ad5d tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] [instance: abe5d4b7-a0d7-40e3-b630-0de746ddb55b] Ensure instance console log exists: /opt/stack/data/nova/instances/abe5d4b7-a0d7-40e3-b630-0de746ddb55b/console.log {{(pid=85141) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 10:23:01 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-d51f959a-5949-412d-91d8-6f027376ad5d tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:23:01 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-d51f959a-5949-412d-91d8-6f027376ad5d tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:23:01 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-d51f959a-5949-412d-91d8-6f027376ad5d tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:23:01 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-d51f959a-5949-412d-91d8-6f027376ad5d tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] [instance: abe5d4b7-a0d7-40e3-b630-0de746ddb55b] Start _get_guest_xml network_info=[{"id": "e583d579-7583-4f41-b0f1-b3241b6af956", "address": "fa:16:3e:4d:24:64", "network": {"id": "e40e4bd2-4277-40b1-9451-1c8365ffa488", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1333036447-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "733b504d4dbe4f028963cf2c197f0064", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape583d579-75", "ovs_interfaceid": "e583d579-7583-4f41-b0f1-b3241b6af956", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T10:06:42Z,direct_url=<?>,disk_format='qcow2',id=bc4ca70f-a459-4d5c-a9e6-80f1948eb48b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1044631a5fe84ce8904864a7024049fa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T10:06:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:11a6a15b-38c1-4e7e-b8fa-2feb6789e775', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WtUCwYzB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'abe5d4b7-a0d7-40e3-b630-0de746ddb55b', 'attached_at': '', 'detached_at': '', 'volume_id': '11a6a15b-38c1-4e7e-b8fa-2feb6789e775', 'serial': '11a6a15b-38c1-4e7e-b8fa-2feb6789e775'}, 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'attachment_id': '11c14e5b-5e86-4d82-98ab-7094af60d951', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=85141) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 10:23:01 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-d51f959a-5949-412d-91d8-6f027376ad5d tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:23:01 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-d51f959a-5949-412d-91d8-6f027376ad5d tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:23:01 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-d51f959a-5949-412d-91d8-6f027376ad5d tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=85141) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 10:23:01 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-d51f959a-5949-412d-91d8-6f027376ad5d tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] CPU controller missing on host. {{(pid=85141) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 10:23:01 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-d51f959a-5949-412d-91d8-6f027376ad5d tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=85141) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 10:23:01 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-d51f959a-5949-412d-91d8-6f027376ad5d tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] CPU controller found on host. {{(pid=85141) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 10:23:01 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-d51f959a-5949-412d-91d8-6f027376ad5d tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=85141) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 10:23:01 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-d51f959a-5949-412d-91d8-6f027376ad5d tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T10:06:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T10:06:42Z,direct_url=<?>,disk_format='qcow2',id=bc4ca70f-a459-4d5c-a9e6-80f1948eb48b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1044631a5fe84ce8904864a7024049fa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T10:06:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 10:23:01 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-d51f959a-5949-412d-91d8-6f027376ad5d tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Flavor limits 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 10:23:01 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-d51f959a-5949-412d-91d8-6f027376ad5d tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Image limits 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 10:23:01 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-d51f959a-5949-412d-91d8-6f027376ad5d tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Flavor pref 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 10:23:01 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-d51f959a-5949-412d-91d8-6f027376ad5d tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Image pref 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 10:23:01 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-d51f959a-5949-412d-91d8-6f027376ad5d tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 10:23:01 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-d51f959a-5949-412d-91d8-6f027376ad5d tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 10:23:01 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-d51f959a-5949-412d-91d8-6f027376ad5d tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=85141) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 10:23:01 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-d51f959a-5949-412d-91d8-6f027376ad5d tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Got 1 possible topologies {{(pid=85141) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 10:23:01 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-d51f959a-5949-412d-91d8-6f027376ad5d tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 10:23:01 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-d51f959a-5949-412d-91d8-6f027376ad5d tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 10:23:01 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d51f959a-5949-412d-91d8-6f027376ad5d tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] [instance: abe5d4b7-a0d7-40e3-b630-0de746ddb55b] Calling os-brick to attach iSCSI Volume {{(pid=85141) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 10:23:01 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-d51f959a-5949-412d-91d8-6f027376ad5d tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51806b6080>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:11a6a15b-38c1-4e7e-b8fa-2feb6789e775', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WtUCwYzB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 10:23:01 user nova-compute[85141]: WARNING os_brick.initiator.connectors.base [None req-d51f959a-5949-412d-91d8-6f027376ad5d tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 10:23:01 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-d51f959a-5949-412d-91d8-6f027376ad5d tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 10:23:01 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-d51f959a-5949-412d-91d8-6f027376ad5d tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 10:23:01 user nova-compute[85141]: WARNING os_brick.initiator.connectors.base [None req-d51f959a-5949-412d-91d8-6f027376ad5d tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 10:23:01 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-d51f959a-5949-412d-91d8-6f027376ad5d tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:11a6a15b-38c1-4e7e-b8fa-2feb6789e775" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 10:23:01 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-d51f959a-5949-412d-91d8-6f027376ad5d tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:11a6a15b-38c1-4e7e-b8fa-2feb6789e775" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 10:23:01 user nova-compute[85141]: INFO os_brick.initiator.connectors.iscsi [None req-d51f959a-5949-412d-91d8-6f027376ad5d tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 10:23:01 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11a6a15b-38c1-4e7e-b8fa-2feb6789e775 -p 172.16.0.220:3260 {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:23:01 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11a6a15b-38c1-4e7e-b8fa-2feb6789e775 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:23:01 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b650723-de57-46e1-86e0-f60e7dc3b859]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:23:01 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-d51f959a-5949-412d-91d8-6f027376ad5d tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 10:23:01 user nova-compute[85141]:  {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:23:01 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11a6a15b-38c1-4e7e-b8fa-2feb6789e775 -p 172.16.0.220:3260 --interface default --op new {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:23:01 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11a6a15b-38c1-4e7e-b8fa-2feb6789e775 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:23:01 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[d13da189-73a7-4e37-9dac-515e18f1ea25]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:11a6a15b-38c1-4e7e-b8fa-2feb6789e775] added\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:23:01 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-d51f959a-5949-412d-91d8-6f027376ad5d tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:11a6a15b-38c1-4e7e-b8fa-2feb6789e775] added
Nov 16 10:23:01 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:23:01 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11a6a15b-38c1-4e7e-b8fa-2feb6789e775 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:23:01 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11a6a15b-38c1-4e7e-b8fa-2feb6789e775 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:23:01 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b8e5487-14a3-49ec-a1a4-000090bd7b84]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:23:01 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-d51f959a-5949-412d-91d8-6f027376ad5d tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:23:01 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11a6a15b-38c1-4e7e-b8fa-2feb6789e775 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:23:01 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11a6a15b-38c1-4e7e-b8fa-2feb6789e775 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:23:01 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e7804ee-241c-4dd1-baf8-6f662d3e6369]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:23:01 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-d51f959a-5949-412d-91d8-6f027376ad5d tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:23:01 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11a6a15b-38c1-4e7e-b8fa-2feb6789e775 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WtUCwYzB {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:23:01 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11a6a15b-38c1-4e7e-b8fa-2feb6789e775 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WtUCwYzB" returned: 0 in 0.018s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:23:01 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[a248c89b-8c3c-49cb-bd95-61455e1d255c]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:23:01 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-d51f959a-5949-412d-91d8-6f027376ad5d tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WtUCwYzB'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:23:01 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11a6a15b-38c1-4e7e-b8fa-2feb6789e775 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:23:01 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11a6a15b-38c1-4e7e-b8fa-2feb6789e775 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:23:01 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[17118200-b0fe-4cf3-bc58-b485f5c0b0e4]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:23:01 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-d51f959a-5949-412d-91d8-6f027376ad5d tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:23:01 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:23:01 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:23:01 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dee5889-fc91-45d1-a014-f1419ef2c7af]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:674f9ae8-6ab5-4ff2-b715-fe8807c34793 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca5a51ee-cdb2-4efa-b7e5-8a97d0c99bf7 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7e99a5e-b380-4ab3-8af6-d78248719e89 (non-flash)\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:23:01 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-d51f959a-5949-412d-91d8-6f027376ad5d tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)
Nov 16 10:23:01 user nova-compute[85141]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:674f9ae8-6ab5-4ff2-b715-fe8807c34793 (non-flash)
Nov 16 10:23:01 user nova-compute[85141]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca5a51ee-cdb2-4efa-b7e5-8a97d0c99bf7 (non-flash)
Nov 16 10:23:01 user nova-compute[85141]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7e99a5e-b380-4ab3-8af6-d78248719e89 (non-flash)
Nov 16 10:23:01 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:23:01 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-d51f959a-5949-412d-91d8-6f027376ad5d tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)
Nov 16 10:23:01 user nova-compute[85141]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:674f9ae8-6ab5-4ff2-b715-fe8807c34793 (non-flash)
Nov 16 10:23:01 user nova-compute[85141]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca5a51ee-cdb2-4efa-b7e5-8a97d0c99bf7 (non-flash)
Nov 16 10:23:01 user nova-compute[85141]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7e99a5e-b380-4ab3-8af6-d78248719e89 (non-flash)
Nov 16 10:23:01 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 10:23:01 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11a6a15b-38c1-4e7e-b8fa-2feb6789e775 -p 172.16.0.220:3260 --login {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:23:01 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11a6a15b-38c1-4e7e-b8fa-2feb6789e775 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:23:01 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[00ff167c-5d94-41fb-831f-1c54078c87fc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:11a6a15b-38c1-4e7e-b8fa-2feb6789e775, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:11a6a15b-38c1-4e7e-b8fa-2feb6789e775, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:23:01 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-d51f959a-5949-412d-91d8-6f027376ad5d tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:11a6a15b-38c1-4e7e-b8fa-2feb6789e775, portal: 172.16.0.220,3260]
Nov 16 10:23:01 user nova-compute[85141]: Login to [iface: default, target: iqn.2010-10.org.openstack:11a6a15b-38c1-4e7e-b8fa-2feb6789e775, portal: 172.16.0.220,3260] successful.
Nov 16 10:23:01 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:23:01 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11a6a15b-38c1-4e7e-b8fa-2feb6789e775 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:23:01 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11a6a15b-38c1-4e7e-b8fa-2feb6789e775 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:23:01 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ceeea5e-5dba-4dec-af02-76f353894d35]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:23:01 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-d51f959a-5949-412d-91d8-6f027376ad5d tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:23:01 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:23:01 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:23:01 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[e872b2c6-dc87-44f5-94be-c92257d995f0]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:674f9ae8-6ab5-4ff2-b715-fe8807c34793 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca5a51ee-cdb2-4efa-b7e5-8a97d0c99bf7 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7e99a5e-b380-4ab3-8af6-d78248719e89 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11a6a15b-38c1-4e7e-b8fa-2feb6789e775 (non-flash)\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:23:01 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-d51f959a-5949-412d-91d8-6f027376ad5d tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)
Nov 16 10:23:01 user nova-compute[85141]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:674f9ae8-6ab5-4ff2-b715-fe8807c34793 (non-flash)
Nov 16 10:23:01 user nova-compute[85141]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca5a51ee-cdb2-4efa-b7e5-8a97d0c99bf7 (non-flash)
Nov 16 10:23:01 user nova-compute[85141]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7e99a5e-b380-4ab3-8af6-d78248719e89 (non-flash)
Nov 16 10:23:01 user nova-compute[85141]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11a6a15b-38c1-4e7e-b8fa-2feb6789e775 (non-flash)
Nov 16 10:23:01 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:23:01 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-d51f959a-5949-412d-91d8-6f027376ad5d tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)
Nov 16 10:23:01 user nova-compute[85141]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:674f9ae8-6ab5-4ff2-b715-fe8807c34793 (non-flash)
Nov 16 10:23:01 user nova-compute[85141]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca5a51ee-cdb2-4efa-b7e5-8a97d0c99bf7 (non-flash)
Nov 16 10:23:01 user nova-compute[85141]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7e99a5e-b380-4ab3-8af6-d78248719e89 (non-flash)
Nov 16 10:23:01 user nova-compute[85141]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11a6a15b-38c1-4e7e-b8fa-2feb6789e775 (non-flash)
Nov 16 10:23:01 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 10:23:01 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-d51f959a-5949-412d-91d8-6f027376ad5d tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:11a6a15b-38c1-4e7e-b8fa-2feb6789e775" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.284s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 10:23:01 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-d51f959a-5949-412d-91d8-6f027376ad5d tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Connected to 172.16.0.220:3260 {{(pid=85141) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 10:23:01 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-d51f959a-5949-412d-91d8-6f027376ad5d tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] HCTL ('35', '-', '-', 0) found on session 35 with lun 0 {{(pid=85141) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 10:23:01 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-d51f959a-5949-412d-91d8-6f027376ad5d tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=85141) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 10:23:01 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:23:01 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:23:01 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee6b3c21-f199-4bea-af23-bfc5585823f5]: (4, ('- - 0', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:23:01 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-d51f959a-5949-412d-91d8-6f027376ad5d tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Searching for a device in session 35 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=85141) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 10:23:01 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-d51f959a-5949-412d-91d8-6f027376ad5d tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:11a6a15b-38c1-4e7e-b8fa-2feb6789e775', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WtUCwYzB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=85141) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 10:23:02 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:23:02 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:23:02 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-d51f959a-5949-412d-91d8-6f027376ad5d tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.317s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 10:23:02 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-d51f959a-5949-412d-91d8-6f027376ad5d tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] <== connect_volume: return (1319ms) {'type': 'block', 'scsi_wwn': '26637656466636334', 'path': '/dev/sdd'} {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 10:23:02 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d51f959a-5949-412d-91d8-6f027376ad5d tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] [instance: abe5d4b7-a0d7-40e3-b630-0de746ddb55b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26637656466636334', 'path': '/dev/sdd'} {{(pid=85141) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 10:23:02 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-d51f959a-5949-412d-91d8-6f027376ad5d tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T10:22:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-845278396',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-845278396',id=28,image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='733b504d4dbe4f028963cf2c197f0064',ramdisk_id='',reservation_id='r-qwti326h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-742384119',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T10:22:51Z,user_data=None,user_id='ffe6ceff3cc346b59b4fbf294b9fc1a3',uuid=abe5d4b7-a0d7-40e3-b630-0de746ddb55b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e583d579-7583-4f41-b0f1-b3241b6af956", "address": "fa:16:3e:4d:24:64", "network": {"id": "e40e4bd2-4277-40b1-9451-1c8365ffa488", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1333036447-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "733b504d4dbe4f028963cf2c197f0064", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape583d579-75", "ovs_interfaceid": "e583d579-7583-4f41-b0f1-b3241b6af956", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=85141) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 10:23:02 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-d51f959a-5949-412d-91d8-6f027376ad5d tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Converting VIF {"id": "e583d579-7583-4f41-b0f1-b3241b6af956", "address": "fa:16:3e:4d:24:64", "network": {"id": "e40e4bd2-4277-40b1-9451-1c8365ffa488", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1333036447-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "733b504d4dbe4f028963cf2c197f0064", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape583d579-75", "ovs_interfaceid": "e583d579-7583-4f41-b0f1-b3241b6af956", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:23:02 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-d51f959a-5949-412d-91d8-6f027376ad5d tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4d:24:64,bridge_name='br-int',has_traffic_filtering=True,id=e583d579-7583-4f41-b0f1-b3241b6af956,network=Network(e40e4bd2-4277-40b1-9451-1c8365ffa488),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape583d579-75') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:23:02 user nova-compute[85141]: DEBUG nova.objects.instance [None req-d51f959a-5949-412d-91d8-6f027376ad5d tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Lazy-loading 'pci_devices' on Instance uuid abe5d4b7-a0d7-40e3-b630-0de746ddb55b {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:23:02 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-d51f959a-5949-412d-91d8-6f027376ad5d tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] [instance: abe5d4b7-a0d7-40e3-b630-0de746ddb55b] End _get_guest_xml xml=<domain type="kvm">
Nov 16 10:23:02 user nova-compute[85141]:   <uuid>abe5d4b7-a0d7-40e3-b630-0de746ddb55b</uuid>
Nov 16 10:23:02 user nova-compute[85141]:   <name>instance-0000001c</name>
Nov 16 10:23:02 user nova-compute[85141]:   <memory>524288</memory>
Nov 16 10:23:02 user nova-compute[85141]:   <vcpu>1</vcpu>
Nov 16 10:23:02 user nova-compute[85141]:   <metadata>
Nov 16 10:23:02 user nova-compute[85141]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 10:23:02 user nova-compute[85141]:       <nova:package version="0.0.0"/>
Nov 16 10:23:02 user nova-compute[85141]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-845278396</nova:name>
Nov 16 10:23:02 user nova-compute[85141]:       <nova:creationTime>2023-11-16 10:23:01</nova:creationTime>
Nov 16 10:23:02 user nova-compute[85141]:       <nova:flavor name="m1.tiny">
Nov 16 10:23:02 user nova-compute[85141]:         <nova:memory>512</nova:memory>
Nov 16 10:23:02 user nova-compute[85141]:         <nova:disk>1</nova:disk>
Nov 16 10:23:02 user nova-compute[85141]:         <nova:swap>0</nova:swap>
Nov 16 10:23:02 user nova-compute[85141]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 10:23:02 user nova-compute[85141]:         <nova:vcpus>1</nova:vcpus>
Nov 16 10:23:02 user nova-compute[85141]:       </nova:flavor>
Nov 16 10:23:02 user nova-compute[85141]:       <nova:owner>
Nov 16 10:23:02 user nova-compute[85141]:         <nova:user uuid="ffe6ceff3cc346b59b4fbf294b9fc1a3">tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member</nova:user>
Nov 16 10:23:02 user nova-compute[85141]:         <nova:project uuid="733b504d4dbe4f028963cf2c197f0064">tempest-ServerBootFromVolumeStableRescueTest-742384119</nova:project>
Nov 16 10:23:02 user nova-compute[85141]:       </nova:owner>
Nov 16 10:23:02 user nova-compute[85141]:       <nova:root type="image" uuid="bc4ca70f-a459-4d5c-a9e6-80f1948eb48b"/>
Nov 16 10:23:02 user nova-compute[85141]:       <nova:ports>
Nov 16 10:23:02 user nova-compute[85141]:         <nova:port uuid="e583d579-7583-4f41-b0f1-b3241b6af956">
Nov 16 10:23:02 user nova-compute[85141]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 16 10:23:02 user nova-compute[85141]:         </nova:port>
Nov 16 10:23:02 user nova-compute[85141]:       </nova:ports>
Nov 16 10:23:02 user nova-compute[85141]:     </nova:instance>
Nov 16 10:23:02 user nova-compute[85141]:   </metadata>
Nov 16 10:23:02 user nova-compute[85141]:   <sysinfo type="smbios">
Nov 16 10:23:02 user nova-compute[85141]:     <system>
Nov 16 10:23:02 user nova-compute[85141]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 10:23:02 user nova-compute[85141]:       <entry name="product">OpenStack Nova</entry>
Nov 16 10:23:02 user nova-compute[85141]:       <entry name="version">0.0.0</entry>
Nov 16 10:23:02 user nova-compute[85141]:       <entry name="serial">abe5d4b7-a0d7-40e3-b630-0de746ddb55b</entry>
Nov 16 10:23:02 user nova-compute[85141]:       <entry name="uuid">abe5d4b7-a0d7-40e3-b630-0de746ddb55b</entry>
Nov 16 10:23:02 user nova-compute[85141]:       <entry name="family">Virtual Machine</entry>
Nov 16 10:23:02 user nova-compute[85141]:     </system>
Nov 16 10:23:02 user nova-compute[85141]:   </sysinfo>
Nov 16 10:23:02 user nova-compute[85141]:   <os>
Nov 16 10:23:02 user nova-compute[85141]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 10:23:02 user nova-compute[85141]:     <boot dev="hd"/>
Nov 16 10:23:02 user nova-compute[85141]:     <smbios mode="sysinfo"/>
Nov 16 10:23:02 user nova-compute[85141]:   </os>
Nov 16 10:23:02 user nova-compute[85141]:   <features>
Nov 16 10:23:02 user nova-compute[85141]:     <acpi/>
Nov 16 10:23:02 user nova-compute[85141]:     <apic/>
Nov 16 10:23:02 user nova-compute[85141]:     <vmcoreinfo/>
Nov 16 10:23:02 user nova-compute[85141]:   </features>
Nov 16 10:23:02 user nova-compute[85141]:   <clock offset="utc">
Nov 16 10:23:02 user nova-compute[85141]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 10:23:02 user nova-compute[85141]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 10:23:02 user nova-compute[85141]:     <timer name="hpet" present="no"/>
Nov 16 10:23:02 user nova-compute[85141]:   </clock>
Nov 16 10:23:02 user nova-compute[85141]:   <cpu mode="custom" match="exact">
Nov 16 10:23:02 user nova-compute[85141]:     <model>Nehalem</model>
Nov 16 10:23:02 user nova-compute[85141]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 10:23:02 user nova-compute[85141]:   </cpu>
Nov 16 10:23:02 user nova-compute[85141]:   <devices>
Nov 16 10:23:02 user nova-compute[85141]:     <disk type="block" device="disk">
Nov 16 10:23:02 user nova-compute[85141]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 10:23:02 user nova-compute[85141]:       <source dev="/dev/sdd"/>
Nov 16 10:23:02 user nova-compute[85141]:       <target dev="vda" bus="virtio"/>
Nov 16 10:23:02 user nova-compute[85141]:       <serial>11a6a15b-38c1-4e7e-b8fa-2feb6789e775</serial>
Nov 16 10:23:02 user nova-compute[85141]:     </disk>
Nov 16 10:23:02 user nova-compute[85141]:     <interface type="ethernet">
Nov 16 10:23:02 user nova-compute[85141]:       <mac address="fa:16:3e:4d:24:64"/>
Nov 16 10:23:02 user nova-compute[85141]:       <model type="virtio"/>
Nov 16 10:23:02 user nova-compute[85141]:       <mtu size="1442"/>
Nov 16 10:23:02 user nova-compute[85141]:       <target dev="tape583d579-75"/>
Nov 16 10:23:02 user nova-compute[85141]:     </interface>
Nov 16 10:23:02 user nova-compute[85141]:     <serial type="pty">
Nov 16 10:23:02 user nova-compute[85141]:       <log file="/opt/stack/data/nova/instances/abe5d4b7-a0d7-40e3-b630-0de746ddb55b/console.log" append="off"/>
Nov 16 10:23:02 user nova-compute[85141]:     </serial>
Nov 16 10:23:02 user nova-compute[85141]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 10:23:02 user nova-compute[85141]:     <video>
Nov 16 10:23:02 user nova-compute[85141]:       <model type="virtio"/>
Nov 16 10:23:02 user nova-compute[85141]:     </video>
Nov 16 10:23:02 user nova-compute[85141]:     <rng model="virtio">
Nov 16 10:23:02 user nova-compute[85141]:       <backend model="random">/dev/urandom</backend>
Nov 16 10:23:02 user nova-compute[85141]:     </rng>
Nov 16 10:23:02 user nova-compute[85141]:     <controller type="usb" index="0" model="none"/>
Nov 16 10:23:02 user nova-compute[85141]:     <memballoon model="virtio">
Nov 16 10:23:02 user nova-compute[85141]:       <stats period="10"/>
Nov 16 10:23:02 user nova-compute[85141]:     </memballoon>
Nov 16 10:23:02 user nova-compute[85141]:   </devices>
Nov 16 10:23:02 user nova-compute[85141]: </domain>
Nov 16 10:23:02 user nova-compute[85141]:  {{(pid=85141) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 10:23:02 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-d51f959a-5949-412d-91d8-6f027376ad5d tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T10:22:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-845278396',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-845278396',id=28,image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='733b504d4dbe4f028963cf2c197f0064',ramdisk_id='',reservation_id='r-qwti326h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-742384119',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T10:22:51Z,user_data=None,user_id='ffe6ceff3cc346b59b4fbf294b9fc1a3',uuid=abe5d4b7-a0d7-40e3-b630-0de746ddb55b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e583d579-7583-4f41-b0f1-b3241b6af956", "address": "fa:16:3e:4d:24:64", "network": {"id": "e40e4bd2-4277-40b1-9451-1c8365ffa488", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1333036447-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "733b504d4dbe4f028963cf2c197f0064", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape583d579-75", "ovs_interfaceid": "e583d579-7583-4f41-b0f1-b3241b6af956", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 10:23:02 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-d51f959a-5949-412d-91d8-6f027376ad5d tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Converting VIF {"id": "e583d579-7583-4f41-b0f1-b3241b6af956", "address": "fa:16:3e:4d:24:64", "network": {"id": "e40e4bd2-4277-40b1-9451-1c8365ffa488", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1333036447-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "733b504d4dbe4f028963cf2c197f0064", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape583d579-75", "ovs_interfaceid": "e583d579-7583-4f41-b0f1-b3241b6af956", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:23:02 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-d51f959a-5949-412d-91d8-6f027376ad5d tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4d:24:64,bridge_name='br-int',has_traffic_filtering=True,id=e583d579-7583-4f41-b0f1-b3241b6af956,network=Network(e40e4bd2-4277-40b1-9451-1c8365ffa488),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape583d579-75') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:23:02 user nova-compute[85141]: DEBUG os_vif [None req-d51f959a-5949-412d-91d8-6f027376ad5d tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:24:64,bridge_name='br-int',has_traffic_filtering=True,id=e583d579-7583-4f41-b0f1-b3241b6af956,network=Network(e40e4bd2-4277-40b1-9451-1c8365ffa488),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape583d579-75') {{(pid=85141) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 10:23:02 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:23:02 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:23:02 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 10:23:02 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:23:02 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '206341a0-a7ea-520f-a8bc-c6278e48ee50', '_type': 'linux-noop'}}, row=False) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:23:02 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:23:02 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:23:02 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:23:02 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape583d579-75, may_exist=True, interface_attrs={}) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:23:02 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape583d579-75, col_values=(('qos', UUID('f71ea205-5141-460a-8b98-7d482838c250')),), if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:23:02 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape583d579-75, col_values=(('external_ids', {'iface-id': 'e583d579-7583-4f41-b0f1-b3241b6af956', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4d:24:64', 'vm-uuid': 'abe5d4b7-a0d7-40e3-b630-0de746ddb55b'}),), if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:23:02 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:23:02 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:23:03 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:23:03 user nova-compute[85141]: INFO os_vif [None req-d51f959a-5949-412d-91d8-6f027376ad5d tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:24:64,bridge_name='br-int',has_traffic_filtering=True,id=e583d579-7583-4f41-b0f1-b3241b6af956,network=Network(e40e4bd2-4277-40b1-9451-1c8365ffa488),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape583d579-75')
Nov 16 10:23:03 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-d51f959a-5949-412d-91d8-6f027376ad5d tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] No BDM found with device name vda, not building metadata. {{(pid=85141) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 10:23:03 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-d51f959a-5949-412d-91d8-6f027376ad5d tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] No VIF found with MAC fa:16:3e:4d:24:64, not building metadata {{(pid=85141) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 10:23:04 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:23:04 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:23:04 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:23:04 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:23:04 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:23:04 user nova-compute[85141]: DEBUG nova.compute.manager [req-277e8a9c-7715-46b4-85c9-75739184cd73 req-d4e03027-00ee-408e-82ca-4c2aa2f0163e service nova] [instance: abe5d4b7-a0d7-40e3-b630-0de746ddb55b] Received event network-vif-plugged-e583d579-7583-4f41-b0f1-b3241b6af956 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:23:04 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-277e8a9c-7715-46b4-85c9-75739184cd73 req-d4e03027-00ee-408e-82ca-4c2aa2f0163e service nova] Acquiring lock "abe5d4b7-a0d7-40e3-b630-0de746ddb55b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:23:04 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-277e8a9c-7715-46b4-85c9-75739184cd73 req-d4e03027-00ee-408e-82ca-4c2aa2f0163e service nova] Lock "abe5d4b7-a0d7-40e3-b630-0de746ddb55b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:23:04 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-277e8a9c-7715-46b4-85c9-75739184cd73 req-d4e03027-00ee-408e-82ca-4c2aa2f0163e service nova] Lock "abe5d4b7-a0d7-40e3-b630-0de746ddb55b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:23:04 user nova-compute[85141]: DEBUG nova.compute.manager [req-277e8a9c-7715-46b4-85c9-75739184cd73 req-d4e03027-00ee-408e-82ca-4c2aa2f0163e service nova] [instance: abe5d4b7-a0d7-40e3-b630-0de746ddb55b] No waiting events found dispatching network-vif-plugged-e583d579-7583-4f41-b0f1-b3241b6af956 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:23:04 user nova-compute[85141]: WARNING nova.compute.manager [req-277e8a9c-7715-46b4-85c9-75739184cd73 req-d4e03027-00ee-408e-82ca-4c2aa2f0163e service nova] [instance: abe5d4b7-a0d7-40e3-b630-0de746ddb55b] Received unexpected event network-vif-plugged-e583d579-7583-4f41-b0f1-b3241b6af956 for instance with vm_state building and task_state spawning.
Nov 16 10:23:06 user nova-compute[85141]: DEBUG nova.compute.manager [None req-d51f959a-5949-412d-91d8-6f027376ad5d tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] [instance: abe5d4b7-a0d7-40e3-b630-0de746ddb55b] Instance event wait completed in 0 seconds for  {{(pid=85141) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 10:23:06 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-d51f959a-5949-412d-91d8-6f027376ad5d tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] [instance: abe5d4b7-a0d7-40e3-b630-0de746ddb55b] Guest created on hypervisor {{(pid=85141) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 10:23:06 user nova-compute[85141]: INFO nova.virt.libvirt.driver [-] [instance: abe5d4b7-a0d7-40e3-b630-0de746ddb55b] Instance spawned successfully.
Nov 16 10:23:06 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-d51f959a-5949-412d-91d8-6f027376ad5d tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] [instance: abe5d4b7-a0d7-40e3-b630-0de746ddb55b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 10:23:06 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-d51f959a-5949-412d-91d8-6f027376ad5d tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] [instance: abe5d4b7-a0d7-40e3-b630-0de746ddb55b] Found default for hw_cdrom_bus of ide {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:23:06 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-d51f959a-5949-412d-91d8-6f027376ad5d tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] [instance: abe5d4b7-a0d7-40e3-b630-0de746ddb55b] Found default for hw_disk_bus of virtio {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:23:06 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-d51f959a-5949-412d-91d8-6f027376ad5d tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] [instance: abe5d4b7-a0d7-40e3-b630-0de746ddb55b] Found default for hw_input_bus of None {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:23:06 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-d51f959a-5949-412d-91d8-6f027376ad5d tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] [instance: abe5d4b7-a0d7-40e3-b630-0de746ddb55b] Found default for hw_pointer_model of None {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:23:06 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-d51f959a-5949-412d-91d8-6f027376ad5d tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] [instance: abe5d4b7-a0d7-40e3-b630-0de746ddb55b] Found default for hw_video_model of virtio {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:23:06 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-d51f959a-5949-412d-91d8-6f027376ad5d tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] [instance: abe5d4b7-a0d7-40e3-b630-0de746ddb55b] Found default for hw_vif_model of virtio {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:23:06 user nova-compute[85141]: INFO nova.compute.manager [None req-d51f959a-5949-412d-91d8-6f027376ad5d tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] [instance: abe5d4b7-a0d7-40e3-b630-0de746ddb55b] Took 4.98 seconds to spawn the instance on the hypervisor.
Nov 16 10:23:06 user nova-compute[85141]: DEBUG nova.compute.manager [None req-d51f959a-5949-412d-91d8-6f027376ad5d tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] [instance: abe5d4b7-a0d7-40e3-b630-0de746ddb55b] Checking state {{(pid=85141) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 10:23:06 user nova-compute[85141]: INFO nova.compute.manager [None req-d51f959a-5949-412d-91d8-6f027376ad5d tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] [instance: abe5d4b7-a0d7-40e3-b630-0de746ddb55b] Took 16.76 seconds to build instance.
Nov 16 10:23:06 user nova-compute[85141]: DEBUG nova.compute.manager [req-e9d3c2fa-0b37-419c-87f5-48ab94cca9bf req-722d5515-761b-437d-8072-c900a22c5439 service nova] [instance: abe5d4b7-a0d7-40e3-b630-0de746ddb55b] Received event network-vif-plugged-e583d579-7583-4f41-b0f1-b3241b6af956 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:23:06 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-e9d3c2fa-0b37-419c-87f5-48ab94cca9bf req-722d5515-761b-437d-8072-c900a22c5439 service nova] Acquiring lock "abe5d4b7-a0d7-40e3-b630-0de746ddb55b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:23:06 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-e9d3c2fa-0b37-419c-87f5-48ab94cca9bf req-722d5515-761b-437d-8072-c900a22c5439 service nova] Lock "abe5d4b7-a0d7-40e3-b630-0de746ddb55b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:23:06 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-e9d3c2fa-0b37-419c-87f5-48ab94cca9bf req-722d5515-761b-437d-8072-c900a22c5439 service nova] Lock "abe5d4b7-a0d7-40e3-b630-0de746ddb55b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:23:06 user nova-compute[85141]: DEBUG nova.compute.manager [req-e9d3c2fa-0b37-419c-87f5-48ab94cca9bf req-722d5515-761b-437d-8072-c900a22c5439 service nova] [instance: abe5d4b7-a0d7-40e3-b630-0de746ddb55b] No waiting events found dispatching network-vif-plugged-e583d579-7583-4f41-b0f1-b3241b6af956 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:23:06 user nova-compute[85141]: WARNING nova.compute.manager [req-e9d3c2fa-0b37-419c-87f5-48ab94cca9bf req-722d5515-761b-437d-8072-c900a22c5439 service nova] [instance: abe5d4b7-a0d7-40e3-b630-0de746ddb55b] Received unexpected event network-vif-plugged-e583d579-7583-4f41-b0f1-b3241b6af956 for instance with vm_state active and task_state None.
Nov 16 10:23:06 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-d51f959a-5949-412d-91d8-6f027376ad5d tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Lock "abe5d4b7-a0d7-40e3-b630-0de746ddb55b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.891s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:23:07 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-ca410ddc-b1b8-41d7-98de-63b92e623b90 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Acquiring lock "9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:23:07 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-ca410ddc-b1b8-41d7-98de-63b92e623b90 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Lock "9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:23:07 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-ca410ddc-b1b8-41d7-98de-63b92e623b90 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Acquiring lock "9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:23:07 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-ca410ddc-b1b8-41d7-98de-63b92e623b90 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Lock "9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:23:07 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-ca410ddc-b1b8-41d7-98de-63b92e623b90 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Lock "9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:23:07 user nova-compute[85141]: INFO nova.compute.manager [None req-ca410ddc-b1b8-41d7-98de-63b92e623b90 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] [instance: 9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008] Terminating instance
Nov 16 10:23:07 user nova-compute[85141]: DEBUG nova.compute.manager [None req-ca410ddc-b1b8-41d7-98de-63b92e623b90 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] [instance: 9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008] Start destroying the instance on the hypervisor. {{(pid=85141) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 10:23:07 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:23:07 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:23:07 user nova-compute[85141]: DEBUG nova.compute.manager [req-b20e4e7f-61df-49dd-be57-335b2b1d7e91 req-950d77cf-bbce-4b6d-bf54-3f17cc9b66a6 service nova] [instance: 9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008] Received event network-vif-unplugged-6e352298-a803-4a3c-8f40-dc88ee03687f {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:23:07 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-b20e4e7f-61df-49dd-be57-335b2b1d7e91 req-950d77cf-bbce-4b6d-bf54-3f17cc9b66a6 service nova] Acquiring lock "9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:23:07 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-b20e4e7f-61df-49dd-be57-335b2b1d7e91 req-950d77cf-bbce-4b6d-bf54-3f17cc9b66a6 service nova] Lock "9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:23:07 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-b20e4e7f-61df-49dd-be57-335b2b1d7e91 req-950d77cf-bbce-4b6d-bf54-3f17cc9b66a6 service nova] Lock "9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:23:07 user nova-compute[85141]: DEBUG nova.compute.manager [req-b20e4e7f-61df-49dd-be57-335b2b1d7e91 req-950d77cf-bbce-4b6d-bf54-3f17cc9b66a6 service nova] [instance: 9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008] No waiting events found dispatching network-vif-unplugged-6e352298-a803-4a3c-8f40-dc88ee03687f {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:23:07 user nova-compute[85141]: DEBUG nova.compute.manager [req-b20e4e7f-61df-49dd-be57-335b2b1d7e91 req-950d77cf-bbce-4b6d-bf54-3f17cc9b66a6 service nova] [instance: 9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008] Received event network-vif-unplugged-6e352298-a803-4a3c-8f40-dc88ee03687f for instance with task_state deleting. {{(pid=85141) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 10:23:07 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:23:07 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:23:07 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:23:07 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:23:08 user nova-compute[85141]: INFO nova.virt.libvirt.driver [-] [instance: 9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008] Instance destroyed successfully.
Nov 16 10:23:08 user nova-compute[85141]: DEBUG nova.objects.instance [None req-ca410ddc-b1b8-41d7-98de-63b92e623b90 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Lazy-loading 'resources' on Instance uuid 9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008 {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:23:08 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-ca410ddc-b1b8-41d7-98de-63b92e623b90 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-16T10:17:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1065707614',display_name='tempest-ServerActionsTestOtherA-server-1206991665',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1065707614',id=21,image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLYW31ovczNyLDED4yKs9dsdr/XSErfr1XRe8heGwagMSLKlZc0gAr6TCWuL5DKCAIkQKMPHxCnrx6sG+CmW97Y7nMFFBSlsHjdgZoOxsnNiaYYiicSNNLBDSCW1u0DNWw==',key_name='tempest-keypair-1951575816',keypairs=<?>,launch_index=0,launched_at=2023-11-16T10:19:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='879fa3f4dfc34726b20149b8a7db22dc',ramdisk_id='',reservation_id='r-0bhqn0jn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1137992555',owner_user_name='tempest-ServerActionsTestOtherA-1137992555-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T10:19:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e95802a919de4345add493a8d7873e48',uuid=9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6e352298-a803-4a3c-8f40-dc88ee03687f", "address": "fa:16:3e:ab:ca:9e", "network": {"id": "859d1f09-56c4-4c2b-b2c3-02b1938e8dbf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1562516834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "879fa3f4dfc34726b20149b8a7db22dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e352298-a8", "ovs_interfaceid": "6e352298-a803-4a3c-8f40-dc88ee03687f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 10:23:08 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-ca410ddc-b1b8-41d7-98de-63b92e623b90 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Converting VIF {"id": "6e352298-a803-4a3c-8f40-dc88ee03687f", "address": "fa:16:3e:ab:ca:9e", "network": {"id": "859d1f09-56c4-4c2b-b2c3-02b1938e8dbf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1562516834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "879fa3f4dfc34726b20149b8a7db22dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e352298-a8", "ovs_interfaceid": "6e352298-a803-4a3c-8f40-dc88ee03687f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:23:08 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-ca410ddc-b1b8-41d7-98de-63b92e623b90 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ab:ca:9e,bridge_name='br-int',has_traffic_filtering=True,id=6e352298-a803-4a3c-8f40-dc88ee03687f,network=Network(859d1f09-56c4-4c2b-b2c3-02b1938e8dbf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e352298-a8') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:23:08 user nova-compute[85141]: DEBUG os_vif [None req-ca410ddc-b1b8-41d7-98de-63b92e623b90 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ab:ca:9e,bridge_name='br-int',has_traffic_filtering=True,id=6e352298-a803-4a3c-8f40-dc88ee03687f,network=Network(859d1f09-56c4-4c2b-b2c3-02b1938e8dbf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e352298-a8') {{(pid=85141) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 10:23:08 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:23:08 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6e352298-a8, bridge=br-int, if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:23:08 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:23:08 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:23:08 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:23:08 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=25897e87-86b6-4bc8-9490-c1ca40bbf2e8) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:23:08 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:23:08 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:23:08 user nova-compute[85141]: INFO os_vif [None req-ca410ddc-b1b8-41d7-98de-63b92e623b90 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ab:ca:9e,bridge_name='br-int',has_traffic_filtering=True,id=6e352298-a803-4a3c-8f40-dc88ee03687f,network=Network(859d1f09-56c4-4c2b-b2c3-02b1938e8dbf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e352298-a8')
Nov 16 10:23:08 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-ca410ddc-b1b8-41d7-98de-63b92e623b90 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] [instance: 9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008] Deleting instance files /opt/stack/data/nova/instances/9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008_del
Nov 16 10:23:08 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-ca410ddc-b1b8-41d7-98de-63b92e623b90 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] [instance: 9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008] Deletion of /opt/stack/data/nova/instances/9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008_del complete
Nov 16 10:23:08 user nova-compute[85141]: INFO nova.compute.manager [None req-ca410ddc-b1b8-41d7-98de-63b92e623b90 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] [instance: 9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008] Took 0.93 seconds to destroy the instance on the hypervisor.
Nov 16 10:23:08 user nova-compute[85141]: DEBUG oslo.service.loopingcall [None req-ca410ddc-b1b8-41d7-98de-63b92e623b90 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=85141) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 10:23:08 user nova-compute[85141]: DEBUG nova.compute.manager [-] [instance: 9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008] Deallocating network for instance {{(pid=85141) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 10:23:08 user nova-compute[85141]: DEBUG nova.network.neutron [-] [instance: 9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008] deallocate_for_instance() {{(pid=85141) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 10:23:09 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-2e2c2be3-e415-4489-b717-ee3053c1fc82 tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Acquiring lock "b2e7cb0b-61b6-4d23-9b20-f8b437c7884e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:23:09 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-2e2c2be3-e415-4489-b717-ee3053c1fc82 tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Lock "b2e7cb0b-61b6-4d23-9b20-f8b437c7884e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:23:09 user nova-compute[85141]: INFO nova.compute.manager [None req-2e2c2be3-e415-4489-b717-ee3053c1fc82 tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] [instance: b2e7cb0b-61b6-4d23-9b20-f8b437c7884e] Detaching volume f7e99a5e-b380-4ab3-8af6-d78248719e89
Nov 16 10:23:09 user nova-compute[85141]: INFO nova.virt.block_device [None req-2e2c2be3-e415-4489-b717-ee3053c1fc82 tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] [instance: b2e7cb0b-61b6-4d23-9b20-f8b437c7884e] Attempting to driver detach volume f7e99a5e-b380-4ab3-8af6-d78248719e89 from mountpoint /dev/vdb
Nov 16 10:23:09 user nova-compute[85141]: DEBUG nova.network.neutron [-] [instance: 9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008] Updating instance_info_cache with network_info: [] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:23:09 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-2e2c2be3-e415-4489-b717-ee3053c1fc82 tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Attempting to detach device vdb from instance b2e7cb0b-61b6-4d23-9b20-f8b437c7884e from the persistent domain config. {{(pid=85141) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 10:23:09 user nova-compute[85141]: DEBUG nova.virt.libvirt.guest [None req-2e2c2be3-e415-4489-b717-ee3053c1fc82 tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 10:23:09 user nova-compute[85141]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 10:23:09 user nova-compute[85141]:   <source dev="/dev/sdb"/>
Nov 16 10:23:09 user nova-compute[85141]:   <target dev="vdb" bus="virtio"/>
Nov 16 10:23:09 user nova-compute[85141]:   <serial>f7e99a5e-b380-4ab3-8af6-d78248719e89</serial>
Nov 16 10:23:09 user nova-compute[85141]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 10:23:09 user nova-compute[85141]: </disk>
Nov 16 10:23:09 user nova-compute[85141]:  {{(pid=85141) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 10:23:09 user nova-compute[85141]: INFO nova.compute.manager [-] [instance: 9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008] Took 0.85 seconds to deallocate network for instance.
Nov 16 10:23:09 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-e742a3c0-da97-43a9-b143-deaacd9c334e tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Acquiring lock "b2e7cb0b-61b6-4d23-9b20-f8b437c7884e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:23:09 user nova-compute[85141]: DEBUG nova.compute.manager [req-af0c450d-fefc-4ea6-950b-1c57133f90e7 req-6f541fa2-fda9-4a2c-b998-f777db78ec48 service nova] [instance: 9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008] Received event network-vif-deleted-6e352298-a803-4a3c-8f40-dc88ee03687f {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:23:09 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-2e2c2be3-e415-4489-b717-ee3053c1fc82 tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Successfully detached device vdb from instance b2e7cb0b-61b6-4d23-9b20-f8b437c7884e from the persistent domain config.
Nov 16 10:23:09 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-2e2c2be3-e415-4489-b717-ee3053c1fc82 tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b2e7cb0b-61b6-4d23-9b20-f8b437c7884e from the live domain config. {{(pid=85141) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 10:23:09 user nova-compute[85141]: DEBUG nova.virt.libvirt.guest [None req-2e2c2be3-e415-4489-b717-ee3053c1fc82 tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 10:23:09 user nova-compute[85141]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 10:23:09 user nova-compute[85141]:   <source dev="/dev/sdb"/>
Nov 16 10:23:09 user nova-compute[85141]:   <target dev="vdb" bus="virtio"/>
Nov 16 10:23:09 user nova-compute[85141]:   <serial>f7e99a5e-b380-4ab3-8af6-d78248719e89</serial>
Nov 16 10:23:09 user nova-compute[85141]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 10:23:09 user nova-compute[85141]: </disk>
Nov 16 10:23:09 user nova-compute[85141]:  {{(pid=85141) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 10:23:09 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-ca410ddc-b1b8-41d7-98de-63b92e623b90 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:23:09 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-ca410ddc-b1b8-41d7-98de-63b92e623b90 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:23:09 user nova-compute[85141]: DEBUG nova.compute.provider_tree [None req-ca410ddc-b1b8-41d7-98de-63b92e623b90 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Inventory has not changed in ProviderTree for provider: bf8e0fa1-16b6-408f-9203-c4cd63916272 {{(pid=85141) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 10:23:09 user nova-compute[85141]: DEBUG nova.scheduler.client.report [None req-ca410ddc-b1b8-41d7-98de-63b92e623b90 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Inventory has not changed for provider bf8e0fa1-16b6-408f-9203-c4cd63916272 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=85141) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 10:23:09 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-ca410ddc-b1b8-41d7-98de-63b92e623b90 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.403s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:23:09 user nova-compute[85141]: INFO nova.scheduler.client.report [None req-ca410ddc-b1b8-41d7-98de-63b92e623b90 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Deleted allocations for instance 9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008
Nov 16 10:23:09 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-2e2c2be3-e415-4489-b717-ee3053c1fc82 tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b2e7cb0b-61b6-4d23-9b20-f8b437c7884e {{(pid=85141) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 10:23:09 user nova-compute[85141]: DEBUG nova.compute.manager [req-4d176116-e275-40af-8f6c-ca8d8b732815 req-2b314946-f8f2-4414-9149-bc3f37261c4b service nova] [instance: 9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008] Received event network-vif-plugged-6e352298-a803-4a3c-8f40-dc88ee03687f {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:23:09 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-4d176116-e275-40af-8f6c-ca8d8b732815 req-2b314946-f8f2-4414-9149-bc3f37261c4b service nova] Acquiring lock "9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:23:09 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-4d176116-e275-40af-8f6c-ca8d8b732815 req-2b314946-f8f2-4414-9149-bc3f37261c4b service nova] Lock "9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:23:09 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-4d176116-e275-40af-8f6c-ca8d8b732815 req-2b314946-f8f2-4414-9149-bc3f37261c4b service nova] Lock "9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:23:09 user nova-compute[85141]: DEBUG nova.compute.manager [req-4d176116-e275-40af-8f6c-ca8d8b732815 req-2b314946-f8f2-4414-9149-bc3f37261c4b service nova] [instance: 9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008] No waiting events found dispatching network-vif-plugged-6e352298-a803-4a3c-8f40-dc88ee03687f {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:23:09 user nova-compute[85141]: WARNING nova.compute.manager [req-4d176116-e275-40af-8f6c-ca8d8b732815 req-2b314946-f8f2-4414-9149-bc3f37261c4b service nova] [instance: 9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008] Received unexpected event network-vif-plugged-6e352298-a803-4a3c-8f40-dc88ee03687f for instance with vm_state deleted and task_state None.
Nov 16 10:23:09 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-ca410ddc-b1b8-41d7-98de-63b92e623b90 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Lock "9cdcc7d9-0ae7-4422-9ce2-0cf71c5e0008" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.433s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:23:13 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:23:18 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:23:20 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:23:20 user nova-compute[85141]: DEBUG nova.compute.manager [req-5d6c906c-2765-40bf-9a8b-a0cfd414cb52 req-bf94edc0-0ee6-40bc-abdd-6f702980ed55 service nova] [instance: e88874fe-b0a6-4292-8832-023f95e4f53c] Received event network-changed-7bbea642-d504-433b-ae99-8e7159942751 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:23:20 user nova-compute[85141]: DEBUG nova.compute.manager [req-5d6c906c-2765-40bf-9a8b-a0cfd414cb52 req-bf94edc0-0ee6-40bc-abdd-6f702980ed55 service nova] [instance: e88874fe-b0a6-4292-8832-023f95e4f53c] Refreshing instance network info cache due to event network-changed-7bbea642-d504-433b-ae99-8e7159942751. {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 10:23:20 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-5d6c906c-2765-40bf-9a8b-a0cfd414cb52 req-bf94edc0-0ee6-40bc-abdd-6f702980ed55 service nova] Acquiring lock "refresh_cache-e88874fe-b0a6-4292-8832-023f95e4f53c" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:23:20 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-5d6c906c-2765-40bf-9a8b-a0cfd414cb52 req-bf94edc0-0ee6-40bc-abdd-6f702980ed55 service nova] Acquired lock "refresh_cache-e88874fe-b0a6-4292-8832-023f95e4f53c" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:23:20 user nova-compute[85141]: DEBUG nova.network.neutron [req-5d6c906c-2765-40bf-9a8b-a0cfd414cb52 req-bf94edc0-0ee6-40bc-abdd-6f702980ed55 service nova] [instance: e88874fe-b0a6-4292-8832-023f95e4f53c] Refreshing network info cache for port 7bbea642-d504-433b-ae99-8e7159942751 {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 10:23:21 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-9ae35f01-1622-4cb7-b9c0-6279ab5c80fe tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] Acquiring lock "e88874fe-b0a6-4292-8832-023f95e4f53c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:23:21 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-9ae35f01-1622-4cb7-b9c0-6279ab5c80fe tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] Lock "e88874fe-b0a6-4292-8832-023f95e4f53c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:23:21 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-9ae35f01-1622-4cb7-b9c0-6279ab5c80fe tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] Acquiring lock "e88874fe-b0a6-4292-8832-023f95e4f53c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:23:21 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-9ae35f01-1622-4cb7-b9c0-6279ab5c80fe tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] Lock "e88874fe-b0a6-4292-8832-023f95e4f53c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:23:21 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-9ae35f01-1622-4cb7-b9c0-6279ab5c80fe tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] Lock "e88874fe-b0a6-4292-8832-023f95e4f53c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:23:21 user nova-compute[85141]: INFO nova.compute.manager [None req-9ae35f01-1622-4cb7-b9c0-6279ab5c80fe tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] [instance: e88874fe-b0a6-4292-8832-023f95e4f53c] Terminating instance
Nov 16 10:23:21 user nova-compute[85141]: DEBUG nova.compute.manager [None req-9ae35f01-1622-4cb7-b9c0-6279ab5c80fe tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] [instance: e88874fe-b0a6-4292-8832-023f95e4f53c] Start destroying the instance on the hypervisor. {{(pid=85141) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 10:23:21 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:23:21 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:23:21 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:23:21 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:23:21 user nova-compute[85141]: DEBUG nova.network.neutron [req-5d6c906c-2765-40bf-9a8b-a0cfd414cb52 req-bf94edc0-0ee6-40bc-abdd-6f702980ed55 service nova] [instance: e88874fe-b0a6-4292-8832-023f95e4f53c] Updated VIF entry in instance network info cache for port 7bbea642-d504-433b-ae99-8e7159942751. {{(pid=85141) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 10:23:21 user nova-compute[85141]: DEBUG nova.network.neutron [req-5d6c906c-2765-40bf-9a8b-a0cfd414cb52 req-bf94edc0-0ee6-40bc-abdd-6f702980ed55 service nova] [instance: e88874fe-b0a6-4292-8832-023f95e4f53c] Updating instance_info_cache with network_info: [{"id": "7bbea642-d504-433b-ae99-8e7159942751", "address": "fa:16:3e:6a:e8:c6", "network": {"id": "3fc8f327-8ef7-4b60-abf0-31d75e40478e", "bridge": "br-int", "label": "tempest-TestShelveInstance-452311162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fc33dd813c64594a3626d2e7dff09ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bbea642-d5", "ovs_interfaceid": "7bbea642-d504-433b-ae99-8e7159942751", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:23:21 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-5d6c906c-2765-40bf-9a8b-a0cfd414cb52 req-bf94edc0-0ee6-40bc-abdd-6f702980ed55 service nova] Releasing lock "refresh_cache-e88874fe-b0a6-4292-8832-023f95e4f53c" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:23:21 user nova-compute[85141]: INFO nova.virt.libvirt.driver [-] [instance: e88874fe-b0a6-4292-8832-023f95e4f53c] Instance destroyed successfully.
Nov 16 10:23:21 user nova-compute[85141]: DEBUG nova.objects.instance [None req-9ae35f01-1622-4cb7-b9c0-6279ab5c80fe tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] Lazy-loading 'resources' on Instance uuid e88874fe-b0a6-4292-8832-023f95e4f53c {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:23:21 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-9ae35f01-1622-4cb7-b9c0-6279ab5c80fe tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-16T10:17:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-2111105262',display_name='tempest-TestShelveInstance-server-2111105262',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-2111105262',id=24,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBfWaK0ZY9CcidWmK2fKQywgej86dJ2hf+UK4R5TPd7pgcpe0Smv+B/1pPMISWG/EAcRok8hWGEmbvkAXnZfkTd4Ehr6r8dlkWNbm3jRYnDsKSJPOJlCYlPCFvR/gAoWpQ==',key_name='tempest-TestShelveInstance-1696654997',keypairs=<?>,launch_index=0,launched_at=2023-11-16T10:21:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5fc33dd813c64594a3626d2e7dff09ad',ramdisk_id='',reservation_id='r-7djljt23',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-289614798',owner_user_name='tempest-TestShelveInstance-289614798-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T10:21:44Z,user_data=None,user_id='462543c542ac4e84b99277f8cdd29807',uuid=e88874fe-b0a6-4292-8832-023f95e4f53c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7bbea642-d504-433b-ae99-8e7159942751", "address": "fa:16:3e:6a:e8:c6", "network": {"id": "3fc8f327-8ef7-4b60-abf0-31d75e40478e", "bridge": "br-int", "label": "tempest-TestShelveInstance-452311162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fc33dd813c64594a3626d2e7dff09ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bbea642-d5", "ovs_interfaceid": "7bbea642-d504-433b-ae99-8e7159942751", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 10:23:21 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-9ae35f01-1622-4cb7-b9c0-6279ab5c80fe tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] Converting VIF {"id": "7bbea642-d504-433b-ae99-8e7159942751", "address": "fa:16:3e:6a:e8:c6", "network": {"id": "3fc8f327-8ef7-4b60-abf0-31d75e40478e", "bridge": "br-int", "label": "tempest-TestShelveInstance-452311162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fc33dd813c64594a3626d2e7dff09ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bbea642-d5", "ovs_interfaceid": "7bbea642-d504-433b-ae99-8e7159942751", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:23:21 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-9ae35f01-1622-4cb7-b9c0-6279ab5c80fe tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6a:e8:c6,bridge_name='br-int',has_traffic_filtering=True,id=7bbea642-d504-433b-ae99-8e7159942751,network=Network(3fc8f327-8ef7-4b60-abf0-31d75e40478e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7bbea642-d5') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:23:21 user nova-compute[85141]: DEBUG os_vif [None req-9ae35f01-1622-4cb7-b9c0-6279ab5c80fe tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:e8:c6,bridge_name='br-int',has_traffic_filtering=True,id=7bbea642-d504-433b-ae99-8e7159942751,network=Network(3fc8f327-8ef7-4b60-abf0-31d75e40478e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7bbea642-d5') {{(pid=85141) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 10:23:21 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:23:21 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7bbea642-d5, bridge=br-int, if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:23:21 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:23:21 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:23:21 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:23:21 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3eb7a761-d8c3-4715-acf0-b8176a69ed02) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:23:21 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:23:21 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:23:21 user nova-compute[85141]: INFO os_vif [None req-9ae35f01-1622-4cb7-b9c0-6279ab5c80fe tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:e8:c6,bridge_name='br-int',has_traffic_filtering=True,id=7bbea642-d504-433b-ae99-8e7159942751,network=Network(3fc8f327-8ef7-4b60-abf0-31d75e40478e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7bbea642-d5')
Nov 16 10:23:21 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ae35f01-1622-4cb7-b9c0-6279ab5c80fe tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] [instance: e88874fe-b0a6-4292-8832-023f95e4f53c] calling os-brick to detach iSCSI Volume {{(pid=85141) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 10:23:21 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ae35f01-1622-4cb7-b9c0-6279ab5c80fe tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51806b6080>, {'target_iqn': 'iqn.2010-10.org.openstack:674f9ae8-6ab5-4ff2-b715-fe8807c34793', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qDxyoBhW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 10:23:21 user nova-compute[85141]: WARNING os_brick.initiator.connectors.base [None req-9ae35f01-1622-4cb7-b9c0-6279ab5c80fe tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 10:23:21 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-9ae35f01-1622-4cb7-b9c0-6279ab5c80fe tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 10:23:21 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-9ae35f01-1622-4cb7-b9c0-6279ab5c80fe tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 10:23:21 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:23:21 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:23:21 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[ada3cb38-5f82-4c5e-b042-7d8fe3ff672a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f7e99a5e-b380-4ab3-8af6-d78248719e89\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ca5a51ee-cdb2-4efa-b7e5-8a97d0c99bf7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:11a6a15b-38c1-4e7e-b8fa-2feb6789e775\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:674f9ae8-6ab5-4ff2-b715-fe8807c34793\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:23:21 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ae35f01-1622-4cb7-b9c0-6279ab5c80fe tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 10:23:21 user nova-compute[85141]: No targets found.
Nov 16 10:23:21 user nova-compute[85141]: iSNS:
Nov 16 10:23:21 user nova-compute[85141]: No targets found.
Nov 16 10:23:21 user nova-compute[85141]: STATIC:
Nov 16 10:23:21 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:f7e99a5e-b380-4ab3-8af6-d78248719e89
Nov 16 10:23:21 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:23:21 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:23:21 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee
Nov 16 10:23:21 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:23:21 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:23:21 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:ca5a51ee-cdb2-4efa-b7e5-8a97d0c99bf7
Nov 16 10:23:21 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:23:21 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:23:21 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:11a6a15b-38c1-4e7e-b8fa-2feb6789e775
Nov 16 10:23:21 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:23:21 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:23:21 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:674f9ae8-6ab5-4ff2-b715-fe8807c34793
Nov 16 10:23:21 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:23:21 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:23:21 user nova-compute[85141]: FIRMWARE:
Nov 16 10:23:21 user nova-compute[85141]: No targets found.
Nov 16 10:23:21 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:23:21 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ae35f01-1622-4cb7-b9c0-6279ab5c80fe tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 10:23:21 user nova-compute[85141]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 10:23:21 user nova-compute[85141]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=85141) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 10:23:21 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ae35f01-1622-4cb7-b9c0-6279ab5c80fe tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:674f9ae8-6ab5-4ff2-b715-fe8807c34793', 0)] {{(pid=85141) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 10:23:21 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:23:21 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:23:21 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[11c34d38-c151-4210-8552-d5fcc8c509df]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:11a6a15b-38c1-4e7e-b8fa-2feb6789e775\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:674f9ae8-6ab5-4ff2-b715-fe8807c34793\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ca5a51ee-cdb2-4efa-b7e5-8a97d0c99bf7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f7e99a5e-b380-4ab3-8af6-d78248719e89\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:23:21 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:23:21 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:23:21 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b748a7b-7134-4abd-8e1e-6d8233319f1c]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:674f9ae8-6ab5-4ff2-b715-fe8807c34793 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca5a51ee-cdb2-4efa-b7e5-8a97d0c99bf7 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7e99a5e-b380-4ab3-8af6-d78248719e89 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11a6a15b-38c1-4e7e-b8fa-2feb6789e775 (non-flash)\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:23:21 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ae35f01-1622-4cb7-b9c0-6279ab5c80fe tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)
Nov 16 10:23:21 user nova-compute[85141]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:674f9ae8-6ab5-4ff2-b715-fe8807c34793 (non-flash)
Nov 16 10:23:21 user nova-compute[85141]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca5a51ee-cdb2-4efa-b7e5-8a97d0c99bf7 (non-flash)
Nov 16 10:23:21 user nova-compute[85141]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7e99a5e-b380-4ab3-8af6-d78248719e89 (non-flash)
Nov 16 10:23:21 user nova-compute[85141]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11a6a15b-38c1-4e7e-b8fa-2feb6789e775 (non-flash)
Nov 16 10:23:21 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:23:21 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ae35f01-1622-4cb7-b9c0-6279ab5c80fe tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)
Nov 16 10:23:21 user nova-compute[85141]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:674f9ae8-6ab5-4ff2-b715-fe8807c34793 (non-flash)
Nov 16 10:23:21 user nova-compute[85141]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca5a51ee-cdb2-4efa-b7e5-8a97d0c99bf7 (non-flash)
Nov 16 10:23:21 user nova-compute[85141]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7e99a5e-b380-4ab3-8af6-d78248719e89 (non-flash)
Nov 16 10:23:21 user nova-compute[85141]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11a6a15b-38c1-4e7e-b8fa-2feb6789e775 (non-flash)
Nov 16 10:23:21 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 10:23:21 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ae35f01-1622-4cb7-b9c0-6279ab5c80fe tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f516073ca60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:674f9ae8-6ab5-4ff2-b715-fe8807c34793'): ({'sdf'}, set())}) {{(pid=85141) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 10:23:21 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-9ae35f01-1622-4cb7-b9c0-6279ab5c80fe tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] Removing single pathed devices sdf {{(pid=85141) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 10:23:21 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:23:21 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:23:21 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[935e7a95-d1d9-4a9e-b9ee-ce6249f0b931]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:23:21 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:23:21 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.018s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:23:21 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b4bded5-7102-48fd-9e7c-db0ffa6a68e8]: (4, ('ok\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:23:21 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-9ae35f01-1622-4cb7-b9c0-6279ab5c80fe tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] Flushing IO for device /dev/sdf {{(pid=85141) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 10:23:21 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:23:21 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.015s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:23:21 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe2981c3-51ab-4681-b4a8-ebf9ce0065a3]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:23:21 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-9ae35f01-1622-4cb7-b9c0-6279ab5c80fe tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=85141) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 10:23:21 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:23:22 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.049s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:23:22 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[6986bf21-7818-419d-8f4f-a47f3c2873a2]: (4, ('1', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:23:22 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-9ae35f01-1622-4cb7-b9c0-6279ab5c80fe tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=85141) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 10:23:22 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-9ae35f01-1622-4cb7-b9c0-6279ab5c80fe tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] SCSI volumes sdf have been removed. {{(pid=85141) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 10:23:22 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ae35f01-1622-4cb7-b9c0-6279ab5c80fe tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:674f9ae8-6ab5-4ff2-b715-fe8807c34793')] {{(pid=85141) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 10:23:22 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:674f9ae8-6ab5-4ff2-b715-fe8807c34793 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:23:22 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:674f9ae8-6ab5-4ff2-b715-fe8807c34793 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:23:22 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[20d0a993-8295-4032-9c23-c7906c739aff]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:23:22 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ae35f01-1622-4cb7-b9c0-6279ab5c80fe tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:23:22 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:674f9ae8-6ab5-4ff2-b715-fe8807c34793 -p 172.16.0.220:3260 --logout {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:23:22 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:674f9ae8-6ab5-4ff2-b715-fe8807c34793 -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:23:22 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee186e77-2ab5-4ef1-811b-3ab24cb9381a]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:674f9ae8-6ab5-4ff2-b715-fe8807c34793, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:674f9ae8-6ab5-4ff2-b715-fe8807c34793, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:23:22 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ae35f01-1622-4cb7-b9c0-6279ab5c80fe tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:674f9ae8-6ab5-4ff2-b715-fe8807c34793, portal: 172.16.0.220,3260]
Nov 16 10:23:22 user nova-compute[85141]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:674f9ae8-6ab5-4ff2-b715-fe8807c34793, portal: 172.16.0.220,3260] successful.
Nov 16 10:23:22 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:23:22 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:674f9ae8-6ab5-4ff2-b715-fe8807c34793 -p 172.16.0.220:3260 --op delete {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:23:22 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:674f9ae8-6ab5-4ff2-b715-fe8807c34793 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:23:22 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[bed4b53c-c3c4-4376-99b1-3047f12ebe23]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:23:22 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ae35f01-1622-4cb7-b9c0-6279ab5c80fe tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:23:22 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-9ae35f01-1622-4cb7-b9c0-6279ab5c80fe tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.344s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 10:23:22 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ae35f01-1622-4cb7-b9c0-6279ab5c80fe tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] <== disconnect_volume: return (346ms) None {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 10:23:22 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ae35f01-1622-4cb7-b9c0-6279ab5c80fe tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] [instance: e88874fe-b0a6-4292-8832-023f95e4f53c] Disconnected iSCSI Volume {{(pid=85141) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 10:23:22 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-9ae35f01-1622-4cb7-b9c0-6279ab5c80fe tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] [instance: e88874fe-b0a6-4292-8832-023f95e4f53c] Deleting instance files /opt/stack/data/nova/instances/e88874fe-b0a6-4292-8832-023f95e4f53c_del
Nov 16 10:23:22 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-9ae35f01-1622-4cb7-b9c0-6279ab5c80fe tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] [instance: e88874fe-b0a6-4292-8832-023f95e4f53c] Deletion of /opt/stack/data/nova/instances/e88874fe-b0a6-4292-8832-023f95e4f53c_del complete
Nov 16 10:23:22 user nova-compute[85141]: INFO nova.compute.manager [None req-9ae35f01-1622-4cb7-b9c0-6279ab5c80fe tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] [instance: e88874fe-b0a6-4292-8832-023f95e4f53c] Took 1.21 seconds to destroy the instance on the hypervisor.
Nov 16 10:23:22 user nova-compute[85141]: DEBUG oslo.service.loopingcall [None req-9ae35f01-1622-4cb7-b9c0-6279ab5c80fe tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=85141) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 10:23:22 user nova-compute[85141]: DEBUG nova.compute.manager [-] [instance: e88874fe-b0a6-4292-8832-023f95e4f53c] Deallocating network for instance {{(pid=85141) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 10:23:22 user nova-compute[85141]: DEBUG nova.network.neutron [-] [instance: e88874fe-b0a6-4292-8832-023f95e4f53c] deallocate_for_instance() {{(pid=85141) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 10:23:22 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-88a47c9b-c41c-4ba5-9152-b5a0dda3ba68 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Acquiring lock "17480138-4b61-43f7-92a5-db065f7d1696" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:23:22 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-88a47c9b-c41c-4ba5-9152-b5a0dda3ba68 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Lock "17480138-4b61-43f7-92a5-db065f7d1696" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:23:22 user nova-compute[85141]: DEBUG nova.compute.manager [None req-88a47c9b-c41c-4ba5-9152-b5a0dda3ba68 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] [instance: 17480138-4b61-43f7-92a5-db065f7d1696] Starting instance... {{(pid=85141) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 10:23:22 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:23:22 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-88a47c9b-c41c-4ba5-9152-b5a0dda3ba68 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:23:22 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-88a47c9b-c41c-4ba5-9152-b5a0dda3ba68 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:23:22 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-88a47c9b-c41c-4ba5-9152-b5a0dda3ba68 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=85141) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 10:23:22 user nova-compute[85141]: INFO nova.compute.claims [None req-88a47c9b-c41c-4ba5-9152-b5a0dda3ba68 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] [instance: 17480138-4b61-43f7-92a5-db065f7d1696] Claim successful on node user
Nov 16 10:23:22 user nova-compute[85141]: DEBUG nova.network.neutron [-] [instance: e88874fe-b0a6-4292-8832-023f95e4f53c] Updating instance_info_cache with network_info: [] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:23:22 user nova-compute[85141]: DEBUG nova.compute.manager [req-6bd27993-056c-4d59-85ff-8b298a607b27 req-f6c029a5-e3ac-4106-b725-df8408d9618a service nova] [instance: e88874fe-b0a6-4292-8832-023f95e4f53c] Received event network-vif-unplugged-7bbea642-d504-433b-ae99-8e7159942751 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:23:22 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-6bd27993-056c-4d59-85ff-8b298a607b27 req-f6c029a5-e3ac-4106-b725-df8408d9618a service nova] Acquiring lock "e88874fe-b0a6-4292-8832-023f95e4f53c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:23:22 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-6bd27993-056c-4d59-85ff-8b298a607b27 req-f6c029a5-e3ac-4106-b725-df8408d9618a service nova] Lock "e88874fe-b0a6-4292-8832-023f95e4f53c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:23:22 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-6bd27993-056c-4d59-85ff-8b298a607b27 req-f6c029a5-e3ac-4106-b725-df8408d9618a service nova] Lock "e88874fe-b0a6-4292-8832-023f95e4f53c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:23:22 user nova-compute[85141]: DEBUG nova.compute.manager [req-6bd27993-056c-4d59-85ff-8b298a607b27 req-f6c029a5-e3ac-4106-b725-df8408d9618a service nova] [instance: e88874fe-b0a6-4292-8832-023f95e4f53c] No waiting events found dispatching network-vif-unplugged-7bbea642-d504-433b-ae99-8e7159942751 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:23:22 user nova-compute[85141]: DEBUG nova.compute.manager [req-6bd27993-056c-4d59-85ff-8b298a607b27 req-f6c029a5-e3ac-4106-b725-df8408d9618a service nova] [instance: e88874fe-b0a6-4292-8832-023f95e4f53c] Received event network-vif-unplugged-7bbea642-d504-433b-ae99-8e7159942751 for instance with task_state deleting. {{(pid=85141) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 10:23:22 user nova-compute[85141]: DEBUG nova.compute.manager [req-6bd27993-056c-4d59-85ff-8b298a607b27 req-f6c029a5-e3ac-4106-b725-df8408d9618a service nova] [instance: e88874fe-b0a6-4292-8832-023f95e4f53c] Received event network-vif-plugged-7bbea642-d504-433b-ae99-8e7159942751 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:23:22 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-6bd27993-056c-4d59-85ff-8b298a607b27 req-f6c029a5-e3ac-4106-b725-df8408d9618a service nova] Acquiring lock "e88874fe-b0a6-4292-8832-023f95e4f53c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:23:22 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-6bd27993-056c-4d59-85ff-8b298a607b27 req-f6c029a5-e3ac-4106-b725-df8408d9618a service nova] Lock "e88874fe-b0a6-4292-8832-023f95e4f53c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:23:22 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-6bd27993-056c-4d59-85ff-8b298a607b27 req-f6c029a5-e3ac-4106-b725-df8408d9618a service nova] Lock "e88874fe-b0a6-4292-8832-023f95e4f53c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:23:22 user nova-compute[85141]: DEBUG nova.compute.manager [req-6bd27993-056c-4d59-85ff-8b298a607b27 req-f6c029a5-e3ac-4106-b725-df8408d9618a service nova] [instance: e88874fe-b0a6-4292-8832-023f95e4f53c] No waiting events found dispatching network-vif-plugged-7bbea642-d504-433b-ae99-8e7159942751 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:23:22 user nova-compute[85141]: WARNING nova.compute.manager [req-6bd27993-056c-4d59-85ff-8b298a607b27 req-f6c029a5-e3ac-4106-b725-df8408d9618a service nova] [instance: e88874fe-b0a6-4292-8832-023f95e4f53c] Received unexpected event network-vif-plugged-7bbea642-d504-433b-ae99-8e7159942751 for instance with vm_state active and task_state deleting.
Nov 16 10:23:22 user nova-compute[85141]: INFO nova.compute.manager [-] [instance: e88874fe-b0a6-4292-8832-023f95e4f53c] Took 0.75 seconds to deallocate network for instance.
Nov 16 10:23:22 user nova-compute[85141]: DEBUG nova.compute.manager [req-e3f94a0a-c78c-4bfa-b82e-d6c2b46727b6 req-c2dd5cb6-fbbc-4196-835c-9a412a6e2343 service nova] [instance: e88874fe-b0a6-4292-8832-023f95e4f53c] Received event network-vif-deleted-7bbea642-d504-433b-ae99-8e7159942751 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:23:22 user nova-compute[85141]: INFO nova.compute.manager [req-e3f94a0a-c78c-4bfa-b82e-d6c2b46727b6 req-c2dd5cb6-fbbc-4196-835c-9a412a6e2343 service nova] [instance: e88874fe-b0a6-4292-8832-023f95e4f53c] Neutron deleted interface 7bbea642-d504-433b-ae99-8e7159942751; detaching it from the instance and deleting it from the info cache
Nov 16 10:23:22 user nova-compute[85141]: DEBUG nova.network.neutron [req-e3f94a0a-c78c-4bfa-b82e-d6c2b46727b6 req-c2dd5cb6-fbbc-4196-835c-9a412a6e2343 service nova] [instance: e88874fe-b0a6-4292-8832-023f95e4f53c] Updating instance_info_cache with network_info: [] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:23:23 user nova-compute[85141]: DEBUG nova.compute.manager [req-e3f94a0a-c78c-4bfa-b82e-d6c2b46727b6 req-c2dd5cb6-fbbc-4196-835c-9a412a6e2343 service nova] [instance: e88874fe-b0a6-4292-8832-023f95e4f53c] Detach interface failed, port_id=7bbea642-d504-433b-ae99-8e7159942751, reason: Instance e88874fe-b0a6-4292-8832-023f95e4f53c could not be found. {{(pid=85141) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 16 10:23:23 user nova-compute[85141]: DEBUG nova.compute.provider_tree [None req-88a47c9b-c41c-4ba5-9152-b5a0dda3ba68 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Inventory has not changed in ProviderTree for provider: bf8e0fa1-16b6-408f-9203-c4cd63916272 {{(pid=85141) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 10:23:23 user nova-compute[85141]: DEBUG nova.scheduler.client.report [None req-88a47c9b-c41c-4ba5-9152-b5a0dda3ba68 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Inventory has not changed for provider bf8e0fa1-16b6-408f-9203-c4cd63916272 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=85141) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 10:23:23 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-88a47c9b-c41c-4ba5-9152-b5a0dda3ba68 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.440s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:23:23 user nova-compute[85141]: DEBUG nova.compute.manager [None req-88a47c9b-c41c-4ba5-9152-b5a0dda3ba68 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] [instance: 17480138-4b61-43f7-92a5-db065f7d1696] Start building networks asynchronously for instance. {{(pid=85141) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 10:23:23 user nova-compute[85141]: DEBUG nova.compute.manager [None req-88a47c9b-c41c-4ba5-9152-b5a0dda3ba68 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] [instance: 17480138-4b61-43f7-92a5-db065f7d1696] Allocating IP information in the background. {{(pid=85141) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 10:23:23 user nova-compute[85141]: DEBUG nova.network.neutron [None req-88a47c9b-c41c-4ba5-9152-b5a0dda3ba68 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] [instance: 17480138-4b61-43f7-92a5-db065f7d1696] allocate_for_instance() {{(pid=85141) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 10:23:23 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-88a47c9b-c41c-4ba5-9152-b5a0dda3ba68 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] [instance: 17480138-4b61-43f7-92a5-db065f7d1696] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 10:23:23 user nova-compute[85141]: DEBUG nova.compute.manager [None req-88a47c9b-c41c-4ba5-9152-b5a0dda3ba68 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] [instance: 17480138-4b61-43f7-92a5-db065f7d1696] Start building block device mappings for instance. {{(pid=85141) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 10:23:23 user nova-compute[85141]: DEBUG nova.policy [None req-88a47c9b-c41c-4ba5-9152-b5a0dda3ba68 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f8792b5cbd0845299dc396f922399980', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e4f57f79564d2fbcb8080bf8f1c5c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85141) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 10:23:23 user nova-compute[85141]: DEBUG nova.compute.manager [None req-88a47c9b-c41c-4ba5-9152-b5a0dda3ba68 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] [instance: 17480138-4b61-43f7-92a5-db065f7d1696] Start spawning the instance on the hypervisor. {{(pid=85141) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 10:23:23 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-88a47c9b-c41c-4ba5-9152-b5a0dda3ba68 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] [instance: 17480138-4b61-43f7-92a5-db065f7d1696] Creating instance directory {{(pid=85141) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 10:23:23 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-88a47c9b-c41c-4ba5-9152-b5a0dda3ba68 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] [instance: 17480138-4b61-43f7-92a5-db065f7d1696] Creating image(s)
Nov 16 10:23:23 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-88a47c9b-c41c-4ba5-9152-b5a0dda3ba68 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Acquiring lock "/opt/stack/data/nova/instances/17480138-4b61-43f7-92a5-db065f7d1696/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:23:23 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-88a47c9b-c41c-4ba5-9152-b5a0dda3ba68 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Lock "/opt/stack/data/nova/instances/17480138-4b61-43f7-92a5-db065f7d1696/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:23:23 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-88a47c9b-c41c-4ba5-9152-b5a0dda3ba68 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Lock "/opt/stack/data/nova/instances/17480138-4b61-43f7-92a5-db065f7d1696/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:23:23 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-88a47c9b-c41c-4ba5-9152-b5a0dda3ba68 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Acquiring lock "279e5d84701f1534a3df2996953f72e24e38b198" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:23:23 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-88a47c9b-c41c-4ba5-9152-b5a0dda3ba68 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Lock "279e5d84701f1534a3df2996953f72e24e38b198" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:23:23 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-88a47c9b-c41c-4ba5-9152-b5a0dda3ba68 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/279e5d84701f1534a3df2996953f72e24e38b198.part --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:23:23 user nova-compute[85141]: INFO nova.compute.manager [None req-9ae35f01-1622-4cb7-b9c0-6279ab5c80fe tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] [instance: e88874fe-b0a6-4292-8832-023f95e4f53c] Took 0.96 seconds to detach 1 volumes for instance.
Nov 16 10:23:23 user nova-compute[85141]: DEBUG nova.network.neutron [None req-88a47c9b-c41c-4ba5-9152-b5a0dda3ba68 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] [instance: 17480138-4b61-43f7-92a5-db065f7d1696] Successfully created port: 6082a650-3a4c-4393-b6ab-8cbc97d751cb {{(pid=85141) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 10:23:23 user nova-compute[85141]: DEBUG nova.compute.manager [None req-9ae35f01-1622-4cb7-b9c0-6279ab5c80fe tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] [instance: e88874fe-b0a6-4292-8832-023f95e4f53c] Deleting volume: 674f9ae8-6ab5-4ff2-b715-fe8807c34793 {{(pid=85141) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 16 10:23:24 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-9ae35f01-1622-4cb7-b9c0-6279ab5c80fe tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:23:24 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-9ae35f01-1622-4cb7-b9c0-6279ab5c80fe tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:23:24 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-88a47c9b-c41c-4ba5-9152-b5a0dda3ba68 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/279e5d84701f1534a3df2996953f72e24e38b198.part --force-share --output=json" returned: 0 in 0.189s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:23:24 user nova-compute[85141]: DEBUG nova.virt.images [None req-88a47c9b-c41c-4ba5-9152-b5a0dda3ba68 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] 02a606ba-ede1-407d-a705-3096965845d4 was qcow2, converting to raw {{(pid=85141) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 16 10:23:24 user nova-compute[85141]: DEBUG nova.privsep.utils [None req-88a47c9b-c41c-4ba5-9152-b5a0dda3ba68 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=85141) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 16 10:23:24 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-88a47c9b-c41c-4ba5-9152-b5a0dda3ba68 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/279e5d84701f1534a3df2996953f72e24e38b198.part /opt/stack/data/nova/instances/_base/279e5d84701f1534a3df2996953f72e24e38b198.converted {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:23:24 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-88a47c9b-c41c-4ba5-9152-b5a0dda3ba68 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/279e5d84701f1534a3df2996953f72e24e38b198.part /opt/stack/data/nova/instances/_base/279e5d84701f1534a3df2996953f72e24e38b198.converted" returned: 0 in 0.368s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:23:24 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-88a47c9b-c41c-4ba5-9152-b5a0dda3ba68 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/279e5d84701f1534a3df2996953f72e24e38b198.converted --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:23:24 user nova-compute[85141]: DEBUG nova.compute.provider_tree [None req-9ae35f01-1622-4cb7-b9c0-6279ab5c80fe tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] Inventory has not changed in ProviderTree for provider: bf8e0fa1-16b6-408f-9203-c4cd63916272 {{(pid=85141) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 10:23:24 user nova-compute[85141]: DEBUG nova.network.neutron [None req-88a47c9b-c41c-4ba5-9152-b5a0dda3ba68 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] [instance: 17480138-4b61-43f7-92a5-db065f7d1696] Successfully updated port: 6082a650-3a4c-4393-b6ab-8cbc97d751cb {{(pid=85141) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 10:23:24 user nova-compute[85141]: DEBUG nova.scheduler.client.report [None req-9ae35f01-1622-4cb7-b9c0-6279ab5c80fe tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] Inventory has not changed for provider bf8e0fa1-16b6-408f-9203-c4cd63916272 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=85141) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 10:23:24 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-88a47c9b-c41c-4ba5-9152-b5a0dda3ba68 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Acquiring lock "refresh_cache-17480138-4b61-43f7-92a5-db065f7d1696" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:23:24 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-88a47c9b-c41c-4ba5-9152-b5a0dda3ba68 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Acquired lock "refresh_cache-17480138-4b61-43f7-92a5-db065f7d1696" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:23:24 user nova-compute[85141]: DEBUG nova.network.neutron [None req-88a47c9b-c41c-4ba5-9152-b5a0dda3ba68 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] [instance: 17480138-4b61-43f7-92a5-db065f7d1696] Building network info cache for instance {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 10:23:24 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-9ae35f01-1622-4cb7-b9c0-6279ab5c80fe tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.560s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:23:24 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-88a47c9b-c41c-4ba5-9152-b5a0dda3ba68 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/279e5d84701f1534a3df2996953f72e24e38b198.converted --force-share --output=json" returned: 0 in 0.183s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:23:24 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-88a47c9b-c41c-4ba5-9152-b5a0dda3ba68 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Lock "279e5d84701f1534a3df2996953f72e24e38b198" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.170s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:23:24 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-88a47c9b-c41c-4ba5-9152-b5a0dda3ba68 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/279e5d84701f1534a3df2996953f72e24e38b198 --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:23:24 user nova-compute[85141]: INFO nova.scheduler.client.report [None req-9ae35f01-1622-4cb7-b9c0-6279ab5c80fe tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] Deleted allocations for instance e88874fe-b0a6-4292-8832-023f95e4f53c
Nov 16 10:23:24 user nova-compute[85141]: DEBUG nova.network.neutron [None req-88a47c9b-c41c-4ba5-9152-b5a0dda3ba68 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] [instance: 17480138-4b61-43f7-92a5-db065f7d1696] Instance cache missing network info. {{(pid=85141) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 10:23:24 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-9ae35f01-1622-4cb7-b9c0-6279ab5c80fe tempest-TestShelveInstance-289614798 tempest-TestShelveInstance-289614798-project-member] Lock "e88874fe-b0a6-4292-8832-023f95e4f53c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.806s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:23:24 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-88a47c9b-c41c-4ba5-9152-b5a0dda3ba68 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/279e5d84701f1534a3df2996953f72e24e38b198 --force-share --output=json" returned: 0 in 0.188s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:23:24 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-88a47c9b-c41c-4ba5-9152-b5a0dda3ba68 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Acquiring lock "279e5d84701f1534a3df2996953f72e24e38b198" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:23:24 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-88a47c9b-c41c-4ba5-9152-b5a0dda3ba68 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Lock "279e5d84701f1534a3df2996953f72e24e38b198" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:23:24 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-88a47c9b-c41c-4ba5-9152-b5a0dda3ba68 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/279e5d84701f1534a3df2996953f72e24e38b198 --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:23:24 user nova-compute[85141]: DEBUG nova.network.neutron [None req-88a47c9b-c41c-4ba5-9152-b5a0dda3ba68 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] [instance: 17480138-4b61-43f7-92a5-db065f7d1696] Updating instance_info_cache with network_info: [{"id": "6082a650-3a4c-4393-b6ab-8cbc97d751cb", "address": "fa:16:3e:9f:52:3b", "network": {"id": "436477fd-9294-4297-bfb3-405564823fa0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1068749207-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4e4f57f79564d2fbcb8080bf8f1c5c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6082a650-3a", "ovs_interfaceid": "6082a650-3a4c-4393-b6ab-8cbc97d751cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:23:25 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-88a47c9b-c41c-4ba5-9152-b5a0dda3ba68 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Releasing lock "refresh_cache-17480138-4b61-43f7-92a5-db065f7d1696" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:23:25 user nova-compute[85141]: DEBUG nova.compute.manager [None req-88a47c9b-c41c-4ba5-9152-b5a0dda3ba68 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] [instance: 17480138-4b61-43f7-92a5-db065f7d1696] Instance network_info: |[{"id": "6082a650-3a4c-4393-b6ab-8cbc97d751cb", "address": "fa:16:3e:9f:52:3b", "network": {"id": "436477fd-9294-4297-bfb3-405564823fa0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1068749207-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4e4f57f79564d2fbcb8080bf8f1c5c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6082a650-3a", "ovs_interfaceid": "6082a650-3a4c-4393-b6ab-8cbc97d751cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=85141) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 10:23:25 user nova-compute[85141]: DEBUG nova.compute.manager [req-6641bdb7-be18-4780-a05f-5c6a6c86f763 req-9a4da90c-2ea4-498f-aa89-6b57a6e8a8b6 service nova] [instance: 17480138-4b61-43f7-92a5-db065f7d1696] Received event network-changed-6082a650-3a4c-4393-b6ab-8cbc97d751cb {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:23:25 user nova-compute[85141]: DEBUG nova.compute.manager [req-6641bdb7-be18-4780-a05f-5c6a6c86f763 req-9a4da90c-2ea4-498f-aa89-6b57a6e8a8b6 service nova] [instance: 17480138-4b61-43f7-92a5-db065f7d1696] Refreshing instance network info cache due to event network-changed-6082a650-3a4c-4393-b6ab-8cbc97d751cb. {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 10:23:25 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-6641bdb7-be18-4780-a05f-5c6a6c86f763 req-9a4da90c-2ea4-498f-aa89-6b57a6e8a8b6 service nova] Acquiring lock "refresh_cache-17480138-4b61-43f7-92a5-db065f7d1696" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:23:25 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-6641bdb7-be18-4780-a05f-5c6a6c86f763 req-9a4da90c-2ea4-498f-aa89-6b57a6e8a8b6 service nova] Acquired lock "refresh_cache-17480138-4b61-43f7-92a5-db065f7d1696" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:23:25 user nova-compute[85141]: DEBUG nova.network.neutron [req-6641bdb7-be18-4780-a05f-5c6a6c86f763 req-9a4da90c-2ea4-498f-aa89-6b57a6e8a8b6 service nova] [instance: 17480138-4b61-43f7-92a5-db065f7d1696] Refreshing network info cache for port 6082a650-3a4c-4393-b6ab-8cbc97d751cb {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 10:23:25 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-88a47c9b-c41c-4ba5-9152-b5a0dda3ba68 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/279e5d84701f1534a3df2996953f72e24e38b198 --force-share --output=json" returned: 0 in 0.180s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:23:25 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-88a47c9b-c41c-4ba5-9152-b5a0dda3ba68 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/279e5d84701f1534a3df2996953f72e24e38b198,backing_fmt=raw /opt/stack/data/nova/instances/17480138-4b61-43f7-92a5-db065f7d1696/disk 1073741824 {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:23:25 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-88a47c9b-c41c-4ba5-9152-b5a0dda3ba68 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/279e5d84701f1534a3df2996953f72e24e38b198,backing_fmt=raw /opt/stack/data/nova/instances/17480138-4b61-43f7-92a5-db065f7d1696/disk 1073741824" returned: 0 in 0.058s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:23:25 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-88a47c9b-c41c-4ba5-9152-b5a0dda3ba68 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Lock "279e5d84701f1534a3df2996953f72e24e38b198" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.243s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:23:25 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-88a47c9b-c41c-4ba5-9152-b5a0dda3ba68 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/279e5d84701f1534a3df2996953f72e24e38b198 --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:23:25 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-88a47c9b-c41c-4ba5-9152-b5a0dda3ba68 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/279e5d84701f1534a3df2996953f72e24e38b198 --force-share --output=json" returned: 0 in 0.174s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:23:25 user nova-compute[85141]: DEBUG nova.virt.disk.api [None req-88a47c9b-c41c-4ba5-9152-b5a0dda3ba68 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Checking if we can resize image /opt/stack/data/nova/instances/17480138-4b61-43f7-92a5-db065f7d1696/disk. size=1073741824 {{(pid=85141) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 10:23:25 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-88a47c9b-c41c-4ba5-9152-b5a0dda3ba68 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17480138-4b61-43f7-92a5-db065f7d1696/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:23:25 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:23:25 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-88a47c9b-c41c-4ba5-9152-b5a0dda3ba68 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17480138-4b61-43f7-92a5-db065f7d1696/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:23:25 user nova-compute[85141]: DEBUG nova.virt.disk.api [None req-88a47c9b-c41c-4ba5-9152-b5a0dda3ba68 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Cannot resize image /opt/stack/data/nova/instances/17480138-4b61-43f7-92a5-db065f7d1696/disk to a smaller size. {{(pid=85141) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 10:23:25 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-88a47c9b-c41c-4ba5-9152-b5a0dda3ba68 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] [instance: 17480138-4b61-43f7-92a5-db065f7d1696] Created local disks {{(pid=85141) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 10:23:25 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-88a47c9b-c41c-4ba5-9152-b5a0dda3ba68 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] [instance: 17480138-4b61-43f7-92a5-db065f7d1696] Ensure instance console log exists: /opt/stack/data/nova/instances/17480138-4b61-43f7-92a5-db065f7d1696/console.log {{(pid=85141) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 10:23:25 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-88a47c9b-c41c-4ba5-9152-b5a0dda3ba68 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:23:25 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-88a47c9b-c41c-4ba5-9152-b5a0dda3ba68 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:23:25 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-88a47c9b-c41c-4ba5-9152-b5a0dda3ba68 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:23:25 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-88a47c9b-c41c-4ba5-9152-b5a0dda3ba68 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] [instance: 17480138-4b61-43f7-92a5-db065f7d1696] Start _get_guest_xml network_info=[{"id": "6082a650-3a4c-4393-b6ab-8cbc97d751cb", "address": "fa:16:3e:9f:52:3b", "network": {"id": "436477fd-9294-4297-bfb3-405564823fa0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1068749207-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4e4f57f79564d2fbcb8080bf8f1c5c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6082a650-3a", "ovs_interfaceid": "6082a650-3a4c-4393-b6ab-8cbc97d751cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T10:23:19Z,direct_url=<?>,disk_format='qcow2',id=02a606ba-ede1-407d-a705-3096965845d4,min_disk=0,min_ram=0,name='tempest-scenario-img--503093530',owner='b4e4f57f79564d2fbcb8080bf8f1c5c0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T10:23:21Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_options': None, 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'image_id': '02a606ba-ede1-407d-a705-3096965845d4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=85141) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 10:23:25 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-88a47c9b-c41c-4ba5-9152-b5a0dda3ba68 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:23:25 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-88a47c9b-c41c-4ba5-9152-b5a0dda3ba68 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:23:25 user nova-compute[85141]: DEBUG nova.network.neutron [req-6641bdb7-be18-4780-a05f-5c6a6c86f763 req-9a4da90c-2ea4-498f-aa89-6b57a6e8a8b6 service nova] [instance: 17480138-4b61-43f7-92a5-db065f7d1696] Updated VIF entry in instance network info cache for port 6082a650-3a4c-4393-b6ab-8cbc97d751cb. {{(pid=85141) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 10:23:25 user nova-compute[85141]: DEBUG nova.network.neutron [req-6641bdb7-be18-4780-a05f-5c6a6c86f763 req-9a4da90c-2ea4-498f-aa89-6b57a6e8a8b6 service nova] [instance: 17480138-4b61-43f7-92a5-db065f7d1696] Updating instance_info_cache with network_info: [{"id": "6082a650-3a4c-4393-b6ab-8cbc97d751cb", "address": "fa:16:3e:9f:52:3b", "network": {"id": "436477fd-9294-4297-bfb3-405564823fa0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1068749207-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4e4f57f79564d2fbcb8080bf8f1c5c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6082a650-3a", "ovs_interfaceid": "6082a650-3a4c-4393-b6ab-8cbc97d751cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:23:25 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-88a47c9b-c41c-4ba5-9152-b5a0dda3ba68 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=85141) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 10:23:25 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-88a47c9b-c41c-4ba5-9152-b5a0dda3ba68 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] CPU controller missing on host. {{(pid=85141) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 10:23:25 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-88a47c9b-c41c-4ba5-9152-b5a0dda3ba68 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=85141) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 10:23:25 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-88a47c9b-c41c-4ba5-9152-b5a0dda3ba68 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] CPU controller found on host. {{(pid=85141) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 10:23:25 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-88a47c9b-c41c-4ba5-9152-b5a0dda3ba68 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=85141) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 10:23:25 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-88a47c9b-c41c-4ba5-9152-b5a0dda3ba68 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T10:06:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T10:23:19Z,direct_url=<?>,disk_format='qcow2',id=02a606ba-ede1-407d-a705-3096965845d4,min_disk=0,min_ram=0,name='tempest-scenario-img--503093530',owner='b4e4f57f79564d2fbcb8080bf8f1c5c0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T10:23:21Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 10:23:25 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-88a47c9b-c41c-4ba5-9152-b5a0dda3ba68 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Flavor limits 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 10:23:25 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-88a47c9b-c41c-4ba5-9152-b5a0dda3ba68 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Image limits 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 10:23:25 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-88a47c9b-c41c-4ba5-9152-b5a0dda3ba68 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Flavor pref 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 10:23:25 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-88a47c9b-c41c-4ba5-9152-b5a0dda3ba68 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Image pref 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 10:23:25 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-88a47c9b-c41c-4ba5-9152-b5a0dda3ba68 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 10:23:25 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-88a47c9b-c41c-4ba5-9152-b5a0dda3ba68 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 10:23:25 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-88a47c9b-c41c-4ba5-9152-b5a0dda3ba68 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=85141) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 10:23:25 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-88a47c9b-c41c-4ba5-9152-b5a0dda3ba68 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Got 1 possible topologies {{(pid=85141) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 10:23:25 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-88a47c9b-c41c-4ba5-9152-b5a0dda3ba68 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 10:23:25 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-88a47c9b-c41c-4ba5-9152-b5a0dda3ba68 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 10:23:25 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-88a47c9b-c41c-4ba5-9152-b5a0dda3ba68 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T10:23:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1016408900',display_name='tempest-TestMinimumBasicScenario-server-1016408900',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1016408900',id=29,image_ref='02a606ba-ede1-407d-a705-3096965845d4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM5QAu9tmIiG19cYFLnKY14lKb1asapUwyzieFSgmsXZ5HIBmKcOtLkuG9D0Q+roR/DuIPKPcyBbi0aHUfveomJ+iiD6VjcU+CQiQpu6xXsDlRfjOeGe+hceqhGiZhbY2A==',key_name='tempest-TestMinimumBasicScenario-1095224120',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b4e4f57f79564d2fbcb8080bf8f1c5c0',ramdisk_id='',reservation_id='r-bermcl2h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='02a606ba-ede1-407d-a705-3096965845d4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-766472507',owner_user_name='tempest-TestMinimumBasicScenario-766472507-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T10:23:23Z,user_data=None,user_id='f8792b5cbd0845299dc396f922399980',uuid=17480138-4b61-43f7-92a5-db065f7d1696,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6082a650-3a4c-4393-b6ab-8cbc97d751cb", "address": "fa:16:3e:9f:52:3b", "network": {"id": "436477fd-9294-4297-bfb3-405564823fa0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1068749207-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4e4f57f79564d2fbcb8080bf8f1c5c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6082a650-3a", "ovs_interfaceid": "6082a650-3a4c-4393-b6ab-8cbc97d751cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=85141) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 10:23:25 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-88a47c9b-c41c-4ba5-9152-b5a0dda3ba68 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Converting VIF {"id": "6082a650-3a4c-4393-b6ab-8cbc97d751cb", "address": "fa:16:3e:9f:52:3b", "network": {"id": "436477fd-9294-4297-bfb3-405564823fa0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1068749207-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4e4f57f79564d2fbcb8080bf8f1c5c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6082a650-3a", "ovs_interfaceid": "6082a650-3a4c-4393-b6ab-8cbc97d751cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:23:25 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-88a47c9b-c41c-4ba5-9152-b5a0dda3ba68 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9f:52:3b,bridge_name='br-int',has_traffic_filtering=True,id=6082a650-3a4c-4393-b6ab-8cbc97d751cb,network=Network(436477fd-9294-4297-bfb3-405564823fa0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6082a650-3a') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:23:25 user nova-compute[85141]: DEBUG nova.objects.instance [None req-88a47c9b-c41c-4ba5-9152-b5a0dda3ba68 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Lazy-loading 'pci_devices' on Instance uuid 17480138-4b61-43f7-92a5-db065f7d1696 {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:23:25 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-6641bdb7-be18-4780-a05f-5c6a6c86f763 req-9a4da90c-2ea4-498f-aa89-6b57a6e8a8b6 service nova] Releasing lock "refresh_cache-17480138-4b61-43f7-92a5-db065f7d1696" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:23:25 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-88a47c9b-c41c-4ba5-9152-b5a0dda3ba68 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] [instance: 17480138-4b61-43f7-92a5-db065f7d1696] End _get_guest_xml xml=<domain type="kvm">
Nov 16 10:23:25 user nova-compute[85141]:   <uuid>17480138-4b61-43f7-92a5-db065f7d1696</uuid>
Nov 16 10:23:25 user nova-compute[85141]:   <name>instance-0000001d</name>
Nov 16 10:23:25 user nova-compute[85141]:   <memory>524288</memory>
Nov 16 10:23:25 user nova-compute[85141]:   <vcpu>1</vcpu>
Nov 16 10:23:25 user nova-compute[85141]:   <metadata>
Nov 16 10:23:25 user nova-compute[85141]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 10:23:25 user nova-compute[85141]:       <nova:package version="0.0.0"/>
Nov 16 10:23:25 user nova-compute[85141]:       <nova:name>tempest-TestMinimumBasicScenario-server-1016408900</nova:name>
Nov 16 10:23:25 user nova-compute[85141]:       <nova:creationTime>2023-11-16 10:23:25</nova:creationTime>
Nov 16 10:23:25 user nova-compute[85141]:       <nova:flavor name="m1.tiny">
Nov 16 10:23:25 user nova-compute[85141]:         <nova:memory>512</nova:memory>
Nov 16 10:23:25 user nova-compute[85141]:         <nova:disk>1</nova:disk>
Nov 16 10:23:25 user nova-compute[85141]:         <nova:swap>0</nova:swap>
Nov 16 10:23:25 user nova-compute[85141]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 10:23:25 user nova-compute[85141]:         <nova:vcpus>1</nova:vcpus>
Nov 16 10:23:25 user nova-compute[85141]:       </nova:flavor>
Nov 16 10:23:25 user nova-compute[85141]:       <nova:owner>
Nov 16 10:23:25 user nova-compute[85141]:         <nova:user uuid="f8792b5cbd0845299dc396f922399980">tempest-TestMinimumBasicScenario-766472507-project-member</nova:user>
Nov 16 10:23:25 user nova-compute[85141]:         <nova:project uuid="b4e4f57f79564d2fbcb8080bf8f1c5c0">tempest-TestMinimumBasicScenario-766472507</nova:project>
Nov 16 10:23:25 user nova-compute[85141]:       </nova:owner>
Nov 16 10:23:25 user nova-compute[85141]:       <nova:root type="image" uuid="02a606ba-ede1-407d-a705-3096965845d4"/>
Nov 16 10:23:25 user nova-compute[85141]:       <nova:ports>
Nov 16 10:23:25 user nova-compute[85141]:         <nova:port uuid="6082a650-3a4c-4393-b6ab-8cbc97d751cb">
Nov 16 10:23:25 user nova-compute[85141]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 16 10:23:25 user nova-compute[85141]:         </nova:port>
Nov 16 10:23:25 user nova-compute[85141]:       </nova:ports>
Nov 16 10:23:25 user nova-compute[85141]:     </nova:instance>
Nov 16 10:23:25 user nova-compute[85141]:   </metadata>
Nov 16 10:23:25 user nova-compute[85141]:   <sysinfo type="smbios">
Nov 16 10:23:25 user nova-compute[85141]:     <system>
Nov 16 10:23:25 user nova-compute[85141]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 10:23:25 user nova-compute[85141]:       <entry name="product">OpenStack Nova</entry>
Nov 16 10:23:25 user nova-compute[85141]:       <entry name="version">0.0.0</entry>
Nov 16 10:23:25 user nova-compute[85141]:       <entry name="serial">17480138-4b61-43f7-92a5-db065f7d1696</entry>
Nov 16 10:23:25 user nova-compute[85141]:       <entry name="uuid">17480138-4b61-43f7-92a5-db065f7d1696</entry>
Nov 16 10:23:25 user nova-compute[85141]:       <entry name="family">Virtual Machine</entry>
Nov 16 10:23:25 user nova-compute[85141]:     </system>
Nov 16 10:23:25 user nova-compute[85141]:   </sysinfo>
Nov 16 10:23:25 user nova-compute[85141]:   <os>
Nov 16 10:23:25 user nova-compute[85141]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 10:23:25 user nova-compute[85141]:     <boot dev="hd"/>
Nov 16 10:23:25 user nova-compute[85141]:     <smbios mode="sysinfo"/>
Nov 16 10:23:25 user nova-compute[85141]:   </os>
Nov 16 10:23:25 user nova-compute[85141]:   <features>
Nov 16 10:23:25 user nova-compute[85141]:     <acpi/>
Nov 16 10:23:25 user nova-compute[85141]:     <apic/>
Nov 16 10:23:25 user nova-compute[85141]:     <vmcoreinfo/>
Nov 16 10:23:25 user nova-compute[85141]:   </features>
Nov 16 10:23:25 user nova-compute[85141]:   <clock offset="utc">
Nov 16 10:23:25 user nova-compute[85141]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 10:23:25 user nova-compute[85141]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 10:23:25 user nova-compute[85141]:     <timer name="hpet" present="no"/>
Nov 16 10:23:25 user nova-compute[85141]:   </clock>
Nov 16 10:23:25 user nova-compute[85141]:   <cpu mode="custom" match="exact">
Nov 16 10:23:25 user nova-compute[85141]:     <model>Nehalem</model>
Nov 16 10:23:25 user nova-compute[85141]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 10:23:25 user nova-compute[85141]:   </cpu>
Nov 16 10:23:25 user nova-compute[85141]:   <devices>
Nov 16 10:23:25 user nova-compute[85141]:     <disk type="file" device="disk">
Nov 16 10:23:25 user nova-compute[85141]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 10:23:25 user nova-compute[85141]:       <source file="/opt/stack/data/nova/instances/17480138-4b61-43f7-92a5-db065f7d1696/disk"/>
Nov 16 10:23:25 user nova-compute[85141]:       <target dev="vda" bus="virtio"/>
Nov 16 10:23:25 user nova-compute[85141]:     </disk>
Nov 16 10:23:25 user nova-compute[85141]:     <interface type="ethernet">
Nov 16 10:23:25 user nova-compute[85141]:       <mac address="fa:16:3e:9f:52:3b"/>
Nov 16 10:23:25 user nova-compute[85141]:       <model type="virtio"/>
Nov 16 10:23:25 user nova-compute[85141]:       <mtu size="1442"/>
Nov 16 10:23:25 user nova-compute[85141]:       <target dev="tap6082a650-3a"/>
Nov 16 10:23:25 user nova-compute[85141]:     </interface>
Nov 16 10:23:25 user nova-compute[85141]:     <serial type="pty">
Nov 16 10:23:25 user nova-compute[85141]:       <log file="/opt/stack/data/nova/instances/17480138-4b61-43f7-92a5-db065f7d1696/console.log" append="off"/>
Nov 16 10:23:25 user nova-compute[85141]:     </serial>
Nov 16 10:23:25 user nova-compute[85141]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 10:23:25 user nova-compute[85141]:     <video>
Nov 16 10:23:25 user nova-compute[85141]:       <model type="virtio"/>
Nov 16 10:23:25 user nova-compute[85141]:     </video>
Nov 16 10:23:25 user nova-compute[85141]:     <rng model="virtio">
Nov 16 10:23:25 user nova-compute[85141]:       <backend model="random">/dev/urandom</backend>
Nov 16 10:23:25 user nova-compute[85141]:     </rng>
Nov 16 10:23:25 user nova-compute[85141]:     <controller type="usb" index="0" model="none"/>
Nov 16 10:23:25 user nova-compute[85141]:     <memballoon model="virtio">
Nov 16 10:23:25 user nova-compute[85141]:       <stats period="10"/>
Nov 16 10:23:25 user nova-compute[85141]:     </memballoon>
Nov 16 10:23:25 user nova-compute[85141]:   </devices>
Nov 16 10:23:25 user nova-compute[85141]: </domain>
Nov 16 10:23:25 user nova-compute[85141]:  {{(pid=85141) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 10:23:25 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-88a47c9b-c41c-4ba5-9152-b5a0dda3ba68 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T10:23:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1016408900',display_name='tempest-TestMinimumBasicScenario-server-1016408900',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1016408900',id=29,image_ref='02a606ba-ede1-407d-a705-3096965845d4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM5QAu9tmIiG19cYFLnKY14lKb1asapUwyzieFSgmsXZ5HIBmKcOtLkuG9D0Q+roR/DuIPKPcyBbi0aHUfveomJ+iiD6VjcU+CQiQpu6xXsDlRfjOeGe+hceqhGiZhbY2A==',key_name='tempest-TestMinimumBasicScenario-1095224120',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b4e4f57f79564d2fbcb8080bf8f1c5c0',ramdisk_id='',reservation_id='r-bermcl2h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='02a606ba-ede1-407d-a705-3096965845d4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-766472507',owner_user_name='tempest-TestMinimumBasicScenario-766472507-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T10:23:23Z,user_data=None,user_id='f8792b5cbd0845299dc396f922399980',uuid=17480138-4b61-43f7-92a5-db065f7d1696,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6082a650-3a4c-4393-b6ab-8cbc97d751cb", "address": "fa:16:3e:9f:52:3b", "network": {"id": "436477fd-9294-4297-bfb3-405564823fa0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1068749207-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4e4f57f79564d2fbcb8080bf8f1c5c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6082a650-3a", "ovs_interfaceid": "6082a650-3a4c-4393-b6ab-8cbc97d751cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 10:23:25 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-88a47c9b-c41c-4ba5-9152-b5a0dda3ba68 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Converting VIF {"id": "6082a650-3a4c-4393-b6ab-8cbc97d751cb", "address": "fa:16:3e:9f:52:3b", "network": {"id": "436477fd-9294-4297-bfb3-405564823fa0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1068749207-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4e4f57f79564d2fbcb8080bf8f1c5c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6082a650-3a", "ovs_interfaceid": "6082a650-3a4c-4393-b6ab-8cbc97d751cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:23:25 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-88a47c9b-c41c-4ba5-9152-b5a0dda3ba68 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9f:52:3b,bridge_name='br-int',has_traffic_filtering=True,id=6082a650-3a4c-4393-b6ab-8cbc97d751cb,network=Network(436477fd-9294-4297-bfb3-405564823fa0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6082a650-3a') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:23:25 user nova-compute[85141]: DEBUG os_vif [None req-88a47c9b-c41c-4ba5-9152-b5a0dda3ba68 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:52:3b,bridge_name='br-int',has_traffic_filtering=True,id=6082a650-3a4c-4393-b6ab-8cbc97d751cb,network=Network(436477fd-9294-4297-bfb3-405564823fa0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6082a650-3a') {{(pid=85141) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 10:23:25 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:23:25 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:23:25 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 10:23:25 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:23:25 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'dc69cbfd-c253-5924-9005-6466d7c01bfc', '_type': 'linux-noop'}}, row=False) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:23:25 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:23:25 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:23:25 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:23:25 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6082a650-3a, may_exist=True, interface_attrs={}) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:23:25 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6082a650-3a, col_values=(('qos', UUID('b3d4f04e-550a-4a64-8c28-7317b6961892')),), if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:23:25 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6082a650-3a, col_values=(('external_ids', {'iface-id': '6082a650-3a4c-4393-b6ab-8cbc97d751cb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9f:52:3b', 'vm-uuid': '17480138-4b61-43f7-92a5-db065f7d1696'}),), if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:23:25 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:23:25 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:23:25 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:23:25 user nova-compute[85141]: INFO os_vif [None req-88a47c9b-c41c-4ba5-9152-b5a0dda3ba68 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:52:3b,bridge_name='br-int',has_traffic_filtering=True,id=6082a650-3a4c-4393-b6ab-8cbc97d751cb,network=Network(436477fd-9294-4297-bfb3-405564823fa0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6082a650-3a')
Nov 16 10:23:25 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-88a47c9b-c41c-4ba5-9152-b5a0dda3ba68 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] No BDM found with device name vda, not building metadata. {{(pid=85141) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 10:23:25 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-88a47c9b-c41c-4ba5-9152-b5a0dda3ba68 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] No VIF found with MAC fa:16:3e:9f:52:3b, not building metadata {{(pid=85141) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 10:23:26 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:23:26 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:23:26 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:23:26 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:23:27 user nova-compute[85141]: DEBUG nova.compute.manager [req-7cc38635-f678-4e5f-aa58-ce7b57c091df req-2a6ab537-4da6-4bc7-b525-103510ac3c73 service nova] [instance: 17480138-4b61-43f7-92a5-db065f7d1696] Received event network-vif-plugged-6082a650-3a4c-4393-b6ab-8cbc97d751cb {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:23:27 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-7cc38635-f678-4e5f-aa58-ce7b57c091df req-2a6ab537-4da6-4bc7-b525-103510ac3c73 service nova] Acquiring lock "17480138-4b61-43f7-92a5-db065f7d1696-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:23:27 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-7cc38635-f678-4e5f-aa58-ce7b57c091df req-2a6ab537-4da6-4bc7-b525-103510ac3c73 service nova] Lock "17480138-4b61-43f7-92a5-db065f7d1696-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:23:27 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-7cc38635-f678-4e5f-aa58-ce7b57c091df req-2a6ab537-4da6-4bc7-b525-103510ac3c73 service nova] Lock "17480138-4b61-43f7-92a5-db065f7d1696-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:23:27 user nova-compute[85141]: DEBUG nova.compute.manager [req-7cc38635-f678-4e5f-aa58-ce7b57c091df req-2a6ab537-4da6-4bc7-b525-103510ac3c73 service nova] [instance: 17480138-4b61-43f7-92a5-db065f7d1696] No waiting events found dispatching network-vif-plugged-6082a650-3a4c-4393-b6ab-8cbc97d751cb {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:23:27 user nova-compute[85141]: WARNING nova.compute.manager [req-7cc38635-f678-4e5f-aa58-ce7b57c091df req-2a6ab537-4da6-4bc7-b525-103510ac3c73 service nova] [instance: 17480138-4b61-43f7-92a5-db065f7d1696] Received unexpected event network-vif-plugged-6082a650-3a4c-4393-b6ab-8cbc97d751cb for instance with vm_state building and task_state spawning.
Nov 16 10:23:27 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:23:27 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:23:27 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:23:27 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:23:27 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:23:28 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-8224a117-207e-4d75-bf10-b175c39b7b31 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Acquiring lock "bff3a84b-6ab5-4256-8a04-2d21a4ba20b3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:23:28 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-8224a117-207e-4d75-bf10-b175c39b7b31 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Lock "bff3a84b-6ab5-4256-8a04-2d21a4ba20b3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:23:28 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-8224a117-207e-4d75-bf10-b175c39b7b31 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Acquiring lock "bff3a84b-6ab5-4256-8a04-2d21a4ba20b3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:23:28 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-8224a117-207e-4d75-bf10-b175c39b7b31 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Lock "bff3a84b-6ab5-4256-8a04-2d21a4ba20b3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:23:28 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-8224a117-207e-4d75-bf10-b175c39b7b31 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Lock "bff3a84b-6ab5-4256-8a04-2d21a4ba20b3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:23:28 user nova-compute[85141]: INFO nova.compute.manager [None req-8224a117-207e-4d75-bf10-b175c39b7b31 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] [instance: bff3a84b-6ab5-4256-8a04-2d21a4ba20b3] Terminating instance
Nov 16 10:23:28 user nova-compute[85141]: DEBUG nova.compute.manager [None req-8224a117-207e-4d75-bf10-b175c39b7b31 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] [instance: bff3a84b-6ab5-4256-8a04-2d21a4ba20b3] Start destroying the instance on the hypervisor. {{(pid=85141) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 10:23:28 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:23:28 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:23:28 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:23:28 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:23:28 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-e4a28fe4-8541-4944-bf00-149747aa14b0 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Acquiring lock "0b388b98-4e65-4258-bbe2-77e699321fb7" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:23:28 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-e4a28fe4-8541-4944-bf00-149747aa14b0 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Lock "0b388b98-4e65-4258-bbe2-77e699321fb7" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:23:28 user nova-compute[85141]: INFO nova.compute.manager [None req-e4a28fe4-8541-4944-bf00-149747aa14b0 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] [instance: 0b388b98-4e65-4258-bbe2-77e699321fb7] Detaching volume ca5a51ee-cdb2-4efa-b7e5-8a97d0c99bf7
Nov 16 10:23:28 user nova-compute[85141]: INFO nova.virt.block_device [None req-e4a28fe4-8541-4944-bf00-149747aa14b0 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] [instance: 0b388b98-4e65-4258-bbe2-77e699321fb7] Attempting to driver detach volume ca5a51ee-cdb2-4efa-b7e5-8a97d0c99bf7 from mountpoint /dev/vdb
Nov 16 10:23:28 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-e4a28fe4-8541-4944-bf00-149747aa14b0 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Attempting to detach device vdb from instance 0b388b98-4e65-4258-bbe2-77e699321fb7 from the persistent domain config. {{(pid=85141) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 10:23:28 user nova-compute[85141]: DEBUG nova.virt.libvirt.guest [None req-e4a28fe4-8541-4944-bf00-149747aa14b0 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 10:23:28 user nova-compute[85141]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 10:23:28 user nova-compute[85141]:   <source dev="/dev/sdg"/>
Nov 16 10:23:28 user nova-compute[85141]:   <target dev="vdb" bus="virtio"/>
Nov 16 10:23:28 user nova-compute[85141]:   <serial>ca5a51ee-cdb2-4efa-b7e5-8a97d0c99bf7</serial>
Nov 16 10:23:28 user nova-compute[85141]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 16 10:23:28 user nova-compute[85141]: </disk>
Nov 16 10:23:28 user nova-compute[85141]:  {{(pid=85141) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 10:23:28 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-e4a28fe4-8541-4944-bf00-149747aa14b0 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Successfully detached device vdb from instance 0b388b98-4e65-4258-bbe2-77e699321fb7 from the persistent domain config.
Nov 16 10:23:28 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-e4a28fe4-8541-4944-bf00-149747aa14b0 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0b388b98-4e65-4258-bbe2-77e699321fb7 from the live domain config. {{(pid=85141) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 10:23:28 user nova-compute[85141]: DEBUG nova.virt.libvirt.guest [None req-e4a28fe4-8541-4944-bf00-149747aa14b0 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 10:23:28 user nova-compute[85141]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 10:23:28 user nova-compute[85141]:   <source dev="/dev/sdg"/>
Nov 16 10:23:28 user nova-compute[85141]:   <target dev="vdb" bus="virtio"/>
Nov 16 10:23:28 user nova-compute[85141]:   <serial>ca5a51ee-cdb2-4efa-b7e5-8a97d0c99bf7</serial>
Nov 16 10:23:28 user nova-compute[85141]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 16 10:23:28 user nova-compute[85141]: </disk>
Nov 16 10:23:28 user nova-compute[85141]:  {{(pid=85141) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 10:23:29 user nova-compute[85141]: DEBUG nova.compute.manager [None req-88a47c9b-c41c-4ba5-9152-b5a0dda3ba68 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] [instance: 17480138-4b61-43f7-92a5-db065f7d1696] Instance event wait completed in 0 seconds for  {{(pid=85141) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 10:23:29 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-88a47c9b-c41c-4ba5-9152-b5a0dda3ba68 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] [instance: 17480138-4b61-43f7-92a5-db065f7d1696] Guest created on hypervisor {{(pid=85141) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 10:23:29 user nova-compute[85141]: INFO nova.virt.libvirt.driver [-] [instance: 17480138-4b61-43f7-92a5-db065f7d1696] Instance spawned successfully.
Nov 16 10:23:29 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-88a47c9b-c41c-4ba5-9152-b5a0dda3ba68 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] [instance: 17480138-4b61-43f7-92a5-db065f7d1696] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 10:23:29 user nova-compute[85141]: DEBUG nova.compute.manager [req-d97c9fe4-f9fc-47f1-a2eb-c7e7c10a7114 req-c2ea1f6b-2292-4a72-9cc9-3fbf1843803b service nova] [instance: bff3a84b-6ab5-4256-8a04-2d21a4ba20b3] Received event network-vif-unplugged-23ec0327-ca81-4524-8850-2c081e596d44 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:23:29 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-d97c9fe4-f9fc-47f1-a2eb-c7e7c10a7114 req-c2ea1f6b-2292-4a72-9cc9-3fbf1843803b service nova] Acquiring lock "bff3a84b-6ab5-4256-8a04-2d21a4ba20b3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:23:29 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-d97c9fe4-f9fc-47f1-a2eb-c7e7c10a7114 req-c2ea1f6b-2292-4a72-9cc9-3fbf1843803b service nova] Lock "bff3a84b-6ab5-4256-8a04-2d21a4ba20b3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:23:29 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-d97c9fe4-f9fc-47f1-a2eb-c7e7c10a7114 req-c2ea1f6b-2292-4a72-9cc9-3fbf1843803b service nova] Lock "bff3a84b-6ab5-4256-8a04-2d21a4ba20b3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:23:29 user nova-compute[85141]: DEBUG nova.compute.manager [req-d97c9fe4-f9fc-47f1-a2eb-c7e7c10a7114 req-c2ea1f6b-2292-4a72-9cc9-3fbf1843803b service nova] [instance: bff3a84b-6ab5-4256-8a04-2d21a4ba20b3] No waiting events found dispatching network-vif-unplugged-23ec0327-ca81-4524-8850-2c081e596d44 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:23:29 user nova-compute[85141]: DEBUG nova.compute.manager [req-d97c9fe4-f9fc-47f1-a2eb-c7e7c10a7114 req-c2ea1f6b-2292-4a72-9cc9-3fbf1843803b service nova] [instance: bff3a84b-6ab5-4256-8a04-2d21a4ba20b3] Received event network-vif-unplugged-23ec0327-ca81-4524-8850-2c081e596d44 for instance with task_state deleting. {{(pid=85141) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 10:23:29 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-88a47c9b-c41c-4ba5-9152-b5a0dda3ba68 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] [instance: 17480138-4b61-43f7-92a5-db065f7d1696] Found default for hw_cdrom_bus of ide {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:23:29 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-88a47c9b-c41c-4ba5-9152-b5a0dda3ba68 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] [instance: 17480138-4b61-43f7-92a5-db065f7d1696] Found default for hw_disk_bus of virtio {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:23:29 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-88a47c9b-c41c-4ba5-9152-b5a0dda3ba68 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] [instance: 17480138-4b61-43f7-92a5-db065f7d1696] Found default for hw_input_bus of None {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:23:29 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-88a47c9b-c41c-4ba5-9152-b5a0dda3ba68 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] [instance: 17480138-4b61-43f7-92a5-db065f7d1696] Found default for hw_pointer_model of None {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:23:29 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-88a47c9b-c41c-4ba5-9152-b5a0dda3ba68 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] [instance: 17480138-4b61-43f7-92a5-db065f7d1696] Found default for hw_video_model of virtio {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:23:29 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-88a47c9b-c41c-4ba5-9152-b5a0dda3ba68 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] [instance: 17480138-4b61-43f7-92a5-db065f7d1696] Found default for hw_vif_model of virtio {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:23:29 user nova-compute[85141]: DEBUG nova.compute.manager [req-77974ed7-736f-461f-aff6-4b12bf03b168 req-1a2fe6ec-9b03-4dcf-8557-f85857040c63 service nova] [instance: 17480138-4b61-43f7-92a5-db065f7d1696] Received event network-vif-plugged-6082a650-3a4c-4393-b6ab-8cbc97d751cb {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:23:29 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-77974ed7-736f-461f-aff6-4b12bf03b168 req-1a2fe6ec-9b03-4dcf-8557-f85857040c63 service nova] Acquiring lock "17480138-4b61-43f7-92a5-db065f7d1696-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:23:29 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-77974ed7-736f-461f-aff6-4b12bf03b168 req-1a2fe6ec-9b03-4dcf-8557-f85857040c63 service nova] Lock "17480138-4b61-43f7-92a5-db065f7d1696-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:23:29 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-77974ed7-736f-461f-aff6-4b12bf03b168 req-1a2fe6ec-9b03-4dcf-8557-f85857040c63 service nova] Lock "17480138-4b61-43f7-92a5-db065f7d1696-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:23:29 user nova-compute[85141]: DEBUG nova.compute.manager [req-77974ed7-736f-461f-aff6-4b12bf03b168 req-1a2fe6ec-9b03-4dcf-8557-f85857040c63 service nova] [instance: 17480138-4b61-43f7-92a5-db065f7d1696] No waiting events found dispatching network-vif-plugged-6082a650-3a4c-4393-b6ab-8cbc97d751cb {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:23:29 user nova-compute[85141]: WARNING nova.compute.manager [req-77974ed7-736f-461f-aff6-4b12bf03b168 req-1a2fe6ec-9b03-4dcf-8557-f85857040c63 service nova] [instance: 17480138-4b61-43f7-92a5-db065f7d1696] Received unexpected event network-vif-plugged-6082a650-3a4c-4393-b6ab-8cbc97d751cb for instance with vm_state building and task_state spawning.
Nov 16 10:23:29 user nova-compute[85141]: INFO nova.compute.manager [None req-88a47c9b-c41c-4ba5-9152-b5a0dda3ba68 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] [instance: 17480138-4b61-43f7-92a5-db065f7d1696] Took 5.82 seconds to spawn the instance on the hypervisor.
Nov 16 10:23:29 user nova-compute[85141]: DEBUG nova.compute.manager [None req-88a47c9b-c41c-4ba5-9152-b5a0dda3ba68 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] [instance: 17480138-4b61-43f7-92a5-db065f7d1696] Checking state {{(pid=85141) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 10:23:29 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:23:29 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Starting heal instance info cache {{(pid=85141) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 10:23:29 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Didn't find any instances for network info cache update. {{(pid=85141) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 16 10:23:29 user nova-compute[85141]: INFO nova.compute.manager [None req-88a47c9b-c41c-4ba5-9152-b5a0dda3ba68 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] [instance: 17480138-4b61-43f7-92a5-db065f7d1696] Took 6.56 seconds to build instance.
Nov 16 10:23:29 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-88a47c9b-c41c-4ba5-9152-b5a0dda3ba68 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Lock "17480138-4b61-43f7-92a5-db065f7d1696" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.650s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:23:29 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-e4a28fe4-8541-4944-bf00-149747aa14b0 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0b388b98-4e65-4258-bbe2-77e699321fb7 {{(pid=85141) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 10:23:29 user nova-compute[85141]: INFO nova.virt.libvirt.driver [-] [instance: bff3a84b-6ab5-4256-8a04-2d21a4ba20b3] Instance destroyed successfully.
Nov 16 10:23:29 user nova-compute[85141]: DEBUG nova.objects.instance [None req-8224a117-207e-4d75-bf10-b175c39b7b31 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Lazy-loading 'resources' on Instance uuid bff3a84b-6ab5-4256-8a04-2d21a4ba20b3 {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:23:29 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-8224a117-207e-4d75-bf10-b175c39b7b31 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-16T10:17:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-614284673',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-614284673',id=25,image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPrlp76Olur0ZBpPoZ4m3G4Hwg5TXY71OdfaQUGbHoElIxC/z9jY6d0topldSFOLBvCWRDtLDl17PNg8CQuntmhvUqsl16M2lr6nhPkJ/90Htz0ywDAC3fTsHsTT9yVpJQ==',key_name='tempest-keypair-1229413697',keypairs=<?>,launch_index=0,launched_at=2023-11-16T10:21:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='08ef12fb41a14ecd8abb84d4d69b7c27',ramdisk_id='',reservation_id='r-m6x0xg39',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-958501663',owner_user_name='tempest-AttachVolumeShelveTestJSON-958501663-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T10:21:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='baec48c887ae4a418e0ea7b32b05bc59',uuid=bff3a84b-6ab5-4256-8a04-2d21a4ba20b3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "23ec0327-ca81-4524-8850-2c081e596d44", "address": "fa:16:3e:e1:61:4a", "network": {"id": "4fb7c85e-c966-481d-b6f2-856a17ac8f7c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-81570496-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08ef12fb41a14ecd8abb84d4d69b7c27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23ec0327-ca", "ovs_interfaceid": "23ec0327-ca81-4524-8850-2c081e596d44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 10:23:29 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-8224a117-207e-4d75-bf10-b175c39b7b31 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Converting VIF {"id": "23ec0327-ca81-4524-8850-2c081e596d44", "address": "fa:16:3e:e1:61:4a", "network": {"id": "4fb7c85e-c966-481d-b6f2-856a17ac8f7c", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-81570496-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08ef12fb41a14ecd8abb84d4d69b7c27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23ec0327-ca", "ovs_interfaceid": "23ec0327-ca81-4524-8850-2c081e596d44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:23:29 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-8224a117-207e-4d75-bf10-b175c39b7b31 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:61:4a,bridge_name='br-int',has_traffic_filtering=True,id=23ec0327-ca81-4524-8850-2c081e596d44,network=Network(4fb7c85e-c966-481d-b6f2-856a17ac8f7c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23ec0327-ca') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:23:29 user nova-compute[85141]: DEBUG os_vif [None req-8224a117-207e-4d75-bf10-b175c39b7b31 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:61:4a,bridge_name='br-int',has_traffic_filtering=True,id=23ec0327-ca81-4524-8850-2c081e596d44,network=Network(4fb7c85e-c966-481d-b6f2-856a17ac8f7c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23ec0327-ca') {{(pid=85141) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 10:23:29 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:23:29 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap23ec0327-ca, bridge=br-int, if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:23:29 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:23:29 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:23:29 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:23:29 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=85fda8cb-3a97-461b-b292-93e3d09fdfdd) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:23:29 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:23:29 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:23:29 user nova-compute[85141]: INFO os_vif [None req-8224a117-207e-4d75-bf10-b175c39b7b31 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:61:4a,bridge_name='br-int',has_traffic_filtering=True,id=23ec0327-ca81-4524-8850-2c081e596d44,network=Network(4fb7c85e-c966-481d-b6f2-856a17ac8f7c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23ec0327-ca')
Nov 16 10:23:29 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-8224a117-207e-4d75-bf10-b175c39b7b31 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] [instance: bff3a84b-6ab5-4256-8a04-2d21a4ba20b3] Deleting instance files /opt/stack/data/nova/instances/bff3a84b-6ab5-4256-8a04-2d21a4ba20b3_del
Nov 16 10:23:29 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-8224a117-207e-4d75-bf10-b175c39b7b31 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] [instance: bff3a84b-6ab5-4256-8a04-2d21a4ba20b3] Deletion of /opt/stack/data/nova/instances/bff3a84b-6ab5-4256-8a04-2d21a4ba20b3_del complete
Nov 16 10:23:29 user nova-compute[85141]: INFO nova.compute.manager [None req-8224a117-207e-4d75-bf10-b175c39b7b31 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] [instance: bff3a84b-6ab5-4256-8a04-2d21a4ba20b3] Took 1.14 seconds to destroy the instance on the hypervisor.
Nov 16 10:23:29 user nova-compute[85141]: DEBUG oslo.service.loopingcall [None req-8224a117-207e-4d75-bf10-b175c39b7b31 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=85141) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 10:23:29 user nova-compute[85141]: DEBUG nova.compute.manager [-] [instance: bff3a84b-6ab5-4256-8a04-2d21a4ba20b3] Deallocating network for instance {{(pid=85141) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 10:23:29 user nova-compute[85141]: DEBUG nova.network.neutron [-] [instance: bff3a84b-6ab5-4256-8a04-2d21a4ba20b3] deallocate_for_instance() {{(pid=85141) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 10:23:29 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-2e2c2be3-e415-4489-b717-ee3053c1fc82 tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance b2e7cb0b-61b6-4d23-9b20-f8b437c7884e is timed out.
Nov 16 10:23:29 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-2e2c2be3-e415-4489-b717-ee3053c1fc82 tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Successfully detached device vdb from instance b2e7cb0b-61b6-4d23-9b20-f8b437c7884e from the live domain config.
Nov 16 10:23:29 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2e2c2be3-e415-4489-b717-ee3053c1fc82 tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] [instance: b2e7cb0b-61b6-4d23-9b20-f8b437c7884e] calling os-brick to detach iSCSI Volume {{(pid=85141) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 10:23:29 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e2c2be3-e415-4489-b717-ee3053c1fc82 tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51806b6080>, {'target_iqn': 'iqn.2010-10.org.openstack:f7e99a5e-b380-4ab3-8af6-d78248719e89', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HpEozlgS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 10:23:29 user nova-compute[85141]: WARNING os_brick.initiator.connectors.base [None req-2e2c2be3-e415-4489-b717-ee3053c1fc82 tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 10:23:29 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-2e2c2be3-e415-4489-b717-ee3053c1fc82 tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 10:23:29 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-2e2c2be3-e415-4489-b717-ee3053c1fc82 tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 10:23:29 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:23:29 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:23:29 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[63ec8b2a-7ae3-4a2f-b0f4-2a69652a32c1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f7e99a5e-b380-4ab3-8af6-d78248719e89\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ca5a51ee-cdb2-4efa-b7e5-8a97d0c99bf7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:11a6a15b-38c1-4e7e-b8fa-2feb6789e775\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:23:29 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e2c2be3-e415-4489-b717-ee3053c1fc82 tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 10:23:29 user nova-compute[85141]: No targets found.
Nov 16 10:23:29 user nova-compute[85141]: iSNS:
Nov 16 10:23:29 user nova-compute[85141]: No targets found.
Nov 16 10:23:29 user nova-compute[85141]: STATIC:
Nov 16 10:23:29 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:f7e99a5e-b380-4ab3-8af6-d78248719e89
Nov 16 10:23:29 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:23:29 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:23:29 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee
Nov 16 10:23:29 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:23:29 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:23:29 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:ca5a51ee-cdb2-4efa-b7e5-8a97d0c99bf7
Nov 16 10:23:29 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:23:29 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:23:29 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:11a6a15b-38c1-4e7e-b8fa-2feb6789e775
Nov 16 10:23:29 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:23:29 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:23:29 user nova-compute[85141]: FIRMWARE:
Nov 16 10:23:29 user nova-compute[85141]: No targets found.
Nov 16 10:23:29 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:23:29 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e2c2be3-e415-4489-b717-ee3053c1fc82 tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 10:23:29 user nova-compute[85141]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 10:23:29 user nova-compute[85141]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=85141) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 10:23:29 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e2c2be3-e415-4489-b717-ee3053c1fc82 tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f7e99a5e-b380-4ab3-8af6-d78248719e89', 0)] {{(pid=85141) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 10:23:29 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:23:29 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:23:29 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[151fdce8-150b-4320-9848-837851406250]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:11a6a15b-38c1-4e7e-b8fa-2feb6789e775\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ca5a51ee-cdb2-4efa-b7e5-8a97d0c99bf7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f7e99a5e-b380-4ab3-8af6-d78248719e89\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:23:29 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:23:29 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:23:29 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[9261dbfb-c7cf-47cc-a47d-cae435b01482]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca5a51ee-cdb2-4efa-b7e5-8a97d0c99bf7 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7e99a5e-b380-4ab3-8af6-d78248719e89 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11a6a15b-38c1-4e7e-b8fa-2feb6789e775 (non-flash)\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:23:29 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e2c2be3-e415-4489-b717-ee3053c1fc82 tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)
Nov 16 10:23:29 user nova-compute[85141]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca5a51ee-cdb2-4efa-b7e5-8a97d0c99bf7 (non-flash)
Nov 16 10:23:29 user nova-compute[85141]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7e99a5e-b380-4ab3-8af6-d78248719e89 (non-flash)
Nov 16 10:23:29 user nova-compute[85141]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11a6a15b-38c1-4e7e-b8fa-2feb6789e775 (non-flash)
Nov 16 10:23:29 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:23:29 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e2c2be3-e415-4489-b717-ee3053c1fc82 tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)
Nov 16 10:23:29 user nova-compute[85141]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca5a51ee-cdb2-4efa-b7e5-8a97d0c99bf7 (non-flash)
Nov 16 10:23:29 user nova-compute[85141]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7e99a5e-b380-4ab3-8af6-d78248719e89 (non-flash)
Nov 16 10:23:29 user nova-compute[85141]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11a6a15b-38c1-4e7e-b8fa-2feb6789e775 (non-flash)
Nov 16 10:23:29 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 10:23:29 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e2c2be3-e415-4489-b717-ee3053c1fc82 tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f516075d090>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f7e99a5e-b380-4ab3-8af6-d78248719e89'): ({'sdb'}, set())}) {{(pid=85141) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 10:23:29 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-2e2c2be3-e415-4489-b717-ee3053c1fc82 tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Removing single pathed devices sdb {{(pid=85141) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 10:23:29 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:23:29 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:23:29 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[8917e0b4-e683-4af5-b727-57c8e830aa0f]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:23:29 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:23:29 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:23:29 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[f428282f-329c-42c3-8741-80f8cdce4f3b]: (4, ('ok\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:23:29 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-2e2c2be3-e415-4489-b717-ee3053c1fc82 tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Flushing IO for device /dev/sdb {{(pid=85141) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 10:23:29 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:23:29 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.019s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:23:29 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[51ca21d7-4027-497f-8d87-0a9ab202159d]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:23:29 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-2e2c2be3-e415-4489-b717-ee3053c1fc82 tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=85141) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 10:23:29 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:23:29 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.048s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:23:29 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[47e4ad13-c368-4d91-a01b-407f9a1ba8b8]: (4, ('1', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:23:29 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-2e2c2be3-e415-4489-b717-ee3053c1fc82 tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=85141) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 10:23:29 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-2e2c2be3-e415-4489-b717-ee3053c1fc82 tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] SCSI volumes sdb have been removed. {{(pid=85141) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 10:23:29 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e2c2be3-e415-4489-b717-ee3053c1fc82 tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f7e99a5e-b380-4ab3-8af6-d78248719e89')] {{(pid=85141) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 10:23:29 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7e99a5e-b380-4ab3-8af6-d78248719e89 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:23:29 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7e99a5e-b380-4ab3-8af6-d78248719e89 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:23:29 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[42e69ec4-e7f8-457d-ac43-61c0d7d7b54d]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:23:29 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e2c2be3-e415-4489-b717-ee3053c1fc82 tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:23:29 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7e99a5e-b380-4ab3-8af6-d78248719e89 -p 172.16.0.220:3260 --logout {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:23:30 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7e99a5e-b380-4ab3-8af6-d78248719e89 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:23:30 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[34928c87-1239-4863-995d-4573e0795b36]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:f7e99a5e-b380-4ab3-8af6-d78248719e89, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:f7e99a5e-b380-4ab3-8af6-d78248719e89, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:23:30 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e2c2be3-e415-4489-b717-ee3053c1fc82 tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:f7e99a5e-b380-4ab3-8af6-d78248719e89, portal: 172.16.0.220,3260]
Nov 16 10:23:30 user nova-compute[85141]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:f7e99a5e-b380-4ab3-8af6-d78248719e89, portal: 172.16.0.220,3260] successful.
Nov 16 10:23:30 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:23:30 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7e99a5e-b380-4ab3-8af6-d78248719e89 -p 172.16.0.220:3260 --op delete {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:23:30 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7e99a5e-b380-4ab3-8af6-d78248719e89 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:23:30 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[509d48b8-ac0c-4316-923b-2cb136d65479]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:23:30 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e2c2be3-e415-4489-b717-ee3053c1fc82 tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:23:30 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-2e2c2be3-e415-4489-b717-ee3053c1fc82 tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.327s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 10:23:30 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e2c2be3-e415-4489-b717-ee3053c1fc82 tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] <== disconnect_volume: return (328ms) None {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 10:23:30 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2e2c2be3-e415-4489-b717-ee3053c1fc82 tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] [instance: b2e7cb0b-61b6-4d23-9b20-f8b437c7884e] Disconnected iSCSI Volume {{(pid=85141) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 10:23:30 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:23:30 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:23:30 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:23:30 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=85141) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 10:23:30 user nova-compute[85141]: DEBUG nova.network.neutron [-] [instance: bff3a84b-6ab5-4256-8a04-2d21a4ba20b3] Updating instance_info_cache with network_info: [] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:23:30 user nova-compute[85141]: INFO nova.compute.manager [-] [instance: bff3a84b-6ab5-4256-8a04-2d21a4ba20b3] Took 0.81 seconds to deallocate network for instance.
Nov 16 10:23:30 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-8224a117-207e-4d75-bf10-b175c39b7b31 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:23:30 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-8224a117-207e-4d75-bf10-b175c39b7b31 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:23:30 user nova-compute[85141]: DEBUG nova.compute.provider_tree [None req-8224a117-207e-4d75-bf10-b175c39b7b31 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Inventory has not changed in ProviderTree for provider: bf8e0fa1-16b6-408f-9203-c4cd63916272 {{(pid=85141) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 10:23:30 user nova-compute[85141]: DEBUG nova.scheduler.client.report [None req-8224a117-207e-4d75-bf10-b175c39b7b31 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Inventory has not changed for provider bf8e0fa1-16b6-408f-9203-c4cd63916272 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=85141) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 10:23:30 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-8224a117-207e-4d75-bf10-b175c39b7b31 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.320s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:23:30 user nova-compute[85141]: DEBUG nova.objects.instance [None req-2e2c2be3-e415-4489-b717-ee3053c1fc82 tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Lazy-loading 'flavor' on Instance uuid b2e7cb0b-61b6-4d23-9b20-f8b437c7884e {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:23:30 user nova-compute[85141]: INFO nova.scheduler.client.report [None req-8224a117-207e-4d75-bf10-b175c39b7b31 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Deleted allocations for instance bff3a84b-6ab5-4256-8a04-2d21a4ba20b3
Nov 16 10:23:30 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-2e2c2be3-e415-4489-b717-ee3053c1fc82 tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Lock "b2e7cb0b-61b6-4d23-9b20-f8b437c7884e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.877s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:23:30 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-e742a3c0-da97-43a9-b143-deaacd9c334e tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Lock "b2e7cb0b-61b6-4d23-9b20-f8b437c7884e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.716s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:23:30 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-e742a3c0-da97-43a9-b143-deaacd9c334e tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Acquiring lock "b2e7cb0b-61b6-4d23-9b20-f8b437c7884e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:23:30 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-e742a3c0-da97-43a9-b143-deaacd9c334e tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Lock "b2e7cb0b-61b6-4d23-9b20-f8b437c7884e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:23:30 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-e742a3c0-da97-43a9-b143-deaacd9c334e tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Lock "b2e7cb0b-61b6-4d23-9b20-f8b437c7884e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:23:30 user nova-compute[85141]: INFO nova.compute.manager [None req-e742a3c0-da97-43a9-b143-deaacd9c334e tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] [instance: b2e7cb0b-61b6-4d23-9b20-f8b437c7884e] Terminating instance
Nov 16 10:23:30 user nova-compute[85141]: DEBUG nova.compute.manager [None req-e742a3c0-da97-43a9-b143-deaacd9c334e tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] [instance: b2e7cb0b-61b6-4d23-9b20-f8b437c7884e] Start destroying the instance on the hypervisor. {{(pid=85141) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 10:23:31 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-8224a117-207e-4d75-bf10-b175c39b7b31 tempest-AttachVolumeShelveTestJSON-958501663 tempest-AttachVolumeShelveTestJSON-958501663-project-member] Lock "bff3a84b-6ab5-4256-8a04-2d21a4ba20b3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.472s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:23:31 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:23:31 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:23:31 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:23:31 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:23:31 user nova-compute[85141]: DEBUG nova.compute.manager [req-33cd39f0-6ad4-4549-a31f-33b73da9f717 req-6c95e088-c4d6-48ab-85a7-d57f0f1446d4 service nova] [instance: bff3a84b-6ab5-4256-8a04-2d21a4ba20b3] Received event network-vif-plugged-23ec0327-ca81-4524-8850-2c081e596d44 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:23:31 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-33cd39f0-6ad4-4549-a31f-33b73da9f717 req-6c95e088-c4d6-48ab-85a7-d57f0f1446d4 service nova] Acquiring lock "bff3a84b-6ab5-4256-8a04-2d21a4ba20b3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:23:31 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-33cd39f0-6ad4-4549-a31f-33b73da9f717 req-6c95e088-c4d6-48ab-85a7-d57f0f1446d4 service nova] Lock "bff3a84b-6ab5-4256-8a04-2d21a4ba20b3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:23:31 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-33cd39f0-6ad4-4549-a31f-33b73da9f717 req-6c95e088-c4d6-48ab-85a7-d57f0f1446d4 service nova] Lock "bff3a84b-6ab5-4256-8a04-2d21a4ba20b3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:23:31 user nova-compute[85141]: DEBUG nova.compute.manager [req-33cd39f0-6ad4-4549-a31f-33b73da9f717 req-6c95e088-c4d6-48ab-85a7-d57f0f1446d4 service nova] [instance: bff3a84b-6ab5-4256-8a04-2d21a4ba20b3] No waiting events found dispatching network-vif-plugged-23ec0327-ca81-4524-8850-2c081e596d44 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:23:31 user nova-compute[85141]: WARNING nova.compute.manager [req-33cd39f0-6ad4-4549-a31f-33b73da9f717 req-6c95e088-c4d6-48ab-85a7-d57f0f1446d4 service nova] [instance: bff3a84b-6ab5-4256-8a04-2d21a4ba20b3] Received unexpected event network-vif-plugged-23ec0327-ca81-4524-8850-2c081e596d44 for instance with vm_state deleted and task_state None.
Nov 16 10:23:31 user nova-compute[85141]: DEBUG nova.compute.manager [req-33cd39f0-6ad4-4549-a31f-33b73da9f717 req-6c95e088-c4d6-48ab-85a7-d57f0f1446d4 service nova] [instance: b2e7cb0b-61b6-4d23-9b20-f8b437c7884e] Received event network-vif-unplugged-3bcbe73a-3c72-4cfe-ab83-141399d14845 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:23:31 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-33cd39f0-6ad4-4549-a31f-33b73da9f717 req-6c95e088-c4d6-48ab-85a7-d57f0f1446d4 service nova] Acquiring lock "b2e7cb0b-61b6-4d23-9b20-f8b437c7884e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:23:31 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-33cd39f0-6ad4-4549-a31f-33b73da9f717 req-6c95e088-c4d6-48ab-85a7-d57f0f1446d4 service nova] Lock "b2e7cb0b-61b6-4d23-9b20-f8b437c7884e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:23:31 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-33cd39f0-6ad4-4549-a31f-33b73da9f717 req-6c95e088-c4d6-48ab-85a7-d57f0f1446d4 service nova] Lock "b2e7cb0b-61b6-4d23-9b20-f8b437c7884e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:23:31 user nova-compute[85141]: DEBUG nova.compute.manager [req-33cd39f0-6ad4-4549-a31f-33b73da9f717 req-6c95e088-c4d6-48ab-85a7-d57f0f1446d4 service nova] [instance: b2e7cb0b-61b6-4d23-9b20-f8b437c7884e] No waiting events found dispatching network-vif-unplugged-3bcbe73a-3c72-4cfe-ab83-141399d14845 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:23:31 user nova-compute[85141]: DEBUG nova.compute.manager [req-33cd39f0-6ad4-4549-a31f-33b73da9f717 req-6c95e088-c4d6-48ab-85a7-d57f0f1446d4 service nova] [instance: b2e7cb0b-61b6-4d23-9b20-f8b437c7884e] Received event network-vif-unplugged-3bcbe73a-3c72-4cfe-ab83-141399d14845 for instance with task_state deleting. {{(pid=85141) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 10:23:31 user nova-compute[85141]: DEBUG nova.compute.manager [req-b78eef39-088c-4d34-b7e5-fbf8771a207d req-abf06959-4ed0-4c55-8704-ad0a77b59039 service nova] [instance: bff3a84b-6ab5-4256-8a04-2d21a4ba20b3] Received event network-vif-deleted-23ec0327-ca81-4524-8850-2c081e596d44 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:23:31 user nova-compute[85141]: INFO nova.virt.libvirt.driver [-] [instance: b2e7cb0b-61b6-4d23-9b20-f8b437c7884e] Instance destroyed successfully.
Nov 16 10:23:31 user nova-compute[85141]: DEBUG nova.objects.instance [None req-e742a3c0-da97-43a9-b143-deaacd9c334e tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Lazy-loading 'resources' on Instance uuid b2e7cb0b-61b6-4d23-9b20-f8b437c7884e {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:23:31 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-e742a3c0-da97-43a9-b143-deaacd9c334e tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T10:20:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1956397478',display_name='tempest-VolumesSnapshotTestJSON-instance-1956397478',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1956397478',id=27,image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIJwgK7S/TnfN9KdqKlCDZxOGWZvg+h9uYyzv3uFXEs786hFNFnbmIGbZUIjQO8hpuLETHuXoPMh7iTV6dYhp4F1npHiYx7ZrMCeT5+mKmp0Vig12TwhLp1GA+Ut5KW9VQ==',key_name='tempest-keypair-2059313003',keypairs=<?>,launch_index=0,launched_at=2023-11-16T10:21:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6a0984b7ef0346768c3231b9ab00fb57',ramdisk_id='',reservation_id='r-fp7ehq9z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-790088929',owner_user_name='tempest-VolumesSnapshotTestJSON-790088929-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T10:21:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eb874e8c071f4305a1de443f23f5df95',uuid=b2e7cb0b-61b6-4d23-9b20-f8b437c7884e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3bcbe73a-3c72-4cfe-ab83-141399d14845", "address": "fa:16:3e:3b:92:0e", "network": {"id": "d791d4f1-ec4b-4db3-ae9a-471f071206eb", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-369109742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a0984b7ef0346768c3231b9ab00fb57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bcbe73a-3c", "ovs_interfaceid": "3bcbe73a-3c72-4cfe-ab83-141399d14845", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 10:23:31 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-e742a3c0-da97-43a9-b143-deaacd9c334e tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Converting VIF {"id": "3bcbe73a-3c72-4cfe-ab83-141399d14845", "address": "fa:16:3e:3b:92:0e", "network": {"id": "d791d4f1-ec4b-4db3-ae9a-471f071206eb", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-369109742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a0984b7ef0346768c3231b9ab00fb57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bcbe73a-3c", "ovs_interfaceid": "3bcbe73a-3c72-4cfe-ab83-141399d14845", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:23:31 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-e742a3c0-da97-43a9-b143-deaacd9c334e tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3b:92:0e,bridge_name='br-int',has_traffic_filtering=True,id=3bcbe73a-3c72-4cfe-ab83-141399d14845,network=Network(d791d4f1-ec4b-4db3-ae9a-471f071206eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3bcbe73a-3c') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:23:31 user nova-compute[85141]: DEBUG os_vif [None req-e742a3c0-da97-43a9-b143-deaacd9c334e tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3b:92:0e,bridge_name='br-int',has_traffic_filtering=True,id=3bcbe73a-3c72-4cfe-ab83-141399d14845,network=Network(d791d4f1-ec4b-4db3-ae9a-471f071206eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3bcbe73a-3c') {{(pid=85141) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 10:23:31 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:23:31 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3bcbe73a-3c, bridge=br-int, if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:23:31 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:23:31 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:23:31 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5b11cfdb-f944-4ad7-b47a-994e28a159f9) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:23:31 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:23:31 user nova-compute[85141]: INFO os_vif [None req-e742a3c0-da97-43a9-b143-deaacd9c334e tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3b:92:0e,bridge_name='br-int',has_traffic_filtering=True,id=3bcbe73a-3c72-4cfe-ab83-141399d14845,network=Network(d791d4f1-ec4b-4db3-ae9a-471f071206eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3bcbe73a-3c')
Nov 16 10:23:31 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e742a3c0-da97-43a9-b143-deaacd9c334e tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] [instance: b2e7cb0b-61b6-4d23-9b20-f8b437c7884e] calling os-brick to detach iSCSI Volume {{(pid=85141) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 10:23:31 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-e742a3c0-da97-43a9-b143-deaacd9c334e tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51806b6080>, {'target_iqn': 'iqn.2010-10.org.openstack:f7e99a5e-b380-4ab3-8af6-d78248719e89', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HpEozlgS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 10:23:31 user nova-compute[85141]: WARNING os_brick.initiator.connectors.base [None req-e742a3c0-da97-43a9-b143-deaacd9c334e tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 10:23:31 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-e742a3c0-da97-43a9-b143-deaacd9c334e tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 10:23:31 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-e742a3c0-da97-43a9-b143-deaacd9c334e tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 10:23:31 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:23:31 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:23:31 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[63e04034-277e-431f-80ce-7d2a23dab3d0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ca5a51ee-cdb2-4efa-b7e5-8a97d0c99bf7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:11a6a15b-38c1-4e7e-b8fa-2feb6789e775\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:23:31 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-e742a3c0-da97-43a9-b143-deaacd9c334e tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 10:23:31 user nova-compute[85141]: No targets found.
Nov 16 10:23:31 user nova-compute[85141]: iSNS:
Nov 16 10:23:31 user nova-compute[85141]: No targets found.
Nov 16 10:23:31 user nova-compute[85141]: STATIC:
Nov 16 10:23:31 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee
Nov 16 10:23:31 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:23:31 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:23:31 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:ca5a51ee-cdb2-4efa-b7e5-8a97d0c99bf7
Nov 16 10:23:31 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:23:31 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:23:31 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:11a6a15b-38c1-4e7e-b8fa-2feb6789e775
Nov 16 10:23:31 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:23:31 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:23:31 user nova-compute[85141]: FIRMWARE:
Nov 16 10:23:31 user nova-compute[85141]: No targets found.
Nov 16 10:23:31 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:23:31 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-e742a3c0-da97-43a9-b143-deaacd9c334e tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 10:23:31 user nova-compute[85141]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 10:23:31 user nova-compute[85141]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=85141) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 10:23:31 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-e742a3c0-da97-43a9-b143-deaacd9c334e tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f7e99a5e-b380-4ab3-8af6-d78248719e89', 0)] {{(pid=85141) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 10:23:31 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:23:31 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:23:31 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9e4190e-9c01-4f93-84ee-02ca44abccc3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:11a6a15b-38c1-4e7e-b8fa-2feb6789e775\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ca5a51ee-cdb2-4efa-b7e5-8a97d0c99bf7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:23:31 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:23:31 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:23:31 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[18b9daa5-eafe-479a-9122-cfd162c8c218]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca5a51ee-cdb2-4efa-b7e5-8a97d0c99bf7 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11a6a15b-38c1-4e7e-b8fa-2feb6789e775 (non-flash)\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:23:31 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-e742a3c0-da97-43a9-b143-deaacd9c334e tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)
Nov 16 10:23:31 user nova-compute[85141]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca5a51ee-cdb2-4efa-b7e5-8a97d0c99bf7 (non-flash)
Nov 16 10:23:31 user nova-compute[85141]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11a6a15b-38c1-4e7e-b8fa-2feb6789e775 (non-flash)
Nov 16 10:23:31 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:23:31 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-e742a3c0-da97-43a9-b143-deaacd9c334e tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)
Nov 16 10:23:31 user nova-compute[85141]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca5a51ee-cdb2-4efa-b7e5-8a97d0c99bf7 (non-flash)
Nov 16 10:23:31 user nova-compute[85141]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11a6a15b-38c1-4e7e-b8fa-2feb6789e775 (non-flash)
Nov 16 10:23:31 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 10:23:31 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-e742a3c0-da97-43a9-b143-deaacd9c334e tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f51802ab2e0>, {}) {{(pid=85141) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 10:23:31 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-e742a3c0-da97-43a9-b143-deaacd9c334e tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Disconnecting from: [] {{(pid=85141) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 10:23:31 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-e742a3c0-da97-43a9-b143-deaacd9c334e tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.068s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 10:23:31 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-e742a3c0-da97-43a9-b143-deaacd9c334e tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] <== disconnect_volume: return (69ms) None {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 10:23:31 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e742a3c0-da97-43a9-b143-deaacd9c334e tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] [instance: b2e7cb0b-61b6-4d23-9b20-f8b437c7884e] Disconnected iSCSI Volume {{(pid=85141) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 10:23:31 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-e742a3c0-da97-43a9-b143-deaacd9c334e tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] [instance: b2e7cb0b-61b6-4d23-9b20-f8b437c7884e] Deleting instance files /opt/stack/data/nova/instances/b2e7cb0b-61b6-4d23-9b20-f8b437c7884e_del
Nov 16 10:23:31 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-e742a3c0-da97-43a9-b143-deaacd9c334e tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] [instance: b2e7cb0b-61b6-4d23-9b20-f8b437c7884e] Deletion of /opt/stack/data/nova/instances/b2e7cb0b-61b6-4d23-9b20-f8b437c7884e_del complete
Nov 16 10:23:31 user nova-compute[85141]: INFO nova.compute.manager [None req-e742a3c0-da97-43a9-b143-deaacd9c334e tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] [instance: b2e7cb0b-61b6-4d23-9b20-f8b437c7884e] Took 0.97 seconds to destroy the instance on the hypervisor.
Nov 16 10:23:31 user nova-compute[85141]: DEBUG oslo.service.loopingcall [None req-e742a3c0-da97-43a9-b143-deaacd9c334e tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=85141) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 10:23:31 user nova-compute[85141]: DEBUG nova.compute.manager [-] [instance: b2e7cb0b-61b6-4d23-9b20-f8b437c7884e] Deallocating network for instance {{(pid=85141) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 10:23:31 user nova-compute[85141]: DEBUG nova.network.neutron [-] [instance: b2e7cb0b-61b6-4d23-9b20-f8b437c7884e] deallocate_for_instance() {{(pid=85141) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 10:23:32 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:23:32 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager.update_available_resource {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:23:32 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:23:32 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:23:32 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:23:32 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Auditing locally available compute resources for user (node: user) {{(pid=85141) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 10:23:32 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d842f90e-663b-4c95-9d7c-d092d2bac41f/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:23:32 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:23:32 user nova-compute[85141]: DEBUG nova.network.neutron [-] [instance: b2e7cb0b-61b6-4d23-9b20-f8b437c7884e] Updating instance_info_cache with network_info: [] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:23:32 user nova-compute[85141]: INFO nova.compute.manager [-] [instance: b2e7cb0b-61b6-4d23-9b20-f8b437c7884e] Took 0.93 seconds to deallocate network for instance.
Nov 16 10:23:32 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d842f90e-663b-4c95-9d7c-d092d2bac41f/disk --force-share --output=json" returned: 0 in 0.289s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:23:32 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d842f90e-663b-4c95-9d7c-d092d2bac41f/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:23:32 user nova-compute[85141]: WARNING nova.volume.cinder [None req-e742a3c0-da97-43a9-b143-deaacd9c334e tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Attachment fd23f51d-7ad1-44f9-8fc1-f82fcd72fa24 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = fd23f51d-7ad1-44f9-8fc1-f82fcd72fa24. (HTTP 404) (Request-ID: req-4e06af44-df3e-4d84-b4c6-a523f043cbbb)
Nov 16 10:23:32 user nova-compute[85141]: INFO nova.compute.manager [None req-e742a3c0-da97-43a9-b143-deaacd9c334e tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] [instance: b2e7cb0b-61b6-4d23-9b20-f8b437c7884e] Took 0.06 seconds to detach 1 volumes for instance.
Nov 16 10:23:33 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-e742a3c0-da97-43a9-b143-deaacd9c334e tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:23:33 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-e742a3c0-da97-43a9-b143-deaacd9c334e tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:23:33 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d842f90e-663b-4c95-9d7c-d092d2bac41f/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:23:33 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=85141) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 10:23:33 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e214bbb-5bbb-4e6f-ac09-9cb1412f068b/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:23:33 user nova-compute[85141]: DEBUG nova.compute.manager [req-948d0bb1-811f-4cc0-9977-95e457be8dc0 req-a5fe9696-5c9b-4e79-89df-cf7848f9a090 service nova] [instance: b2e7cb0b-61b6-4d23-9b20-f8b437c7884e] Received event network-vif-plugged-3bcbe73a-3c72-4cfe-ab83-141399d14845 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:23:33 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-948d0bb1-811f-4cc0-9977-95e457be8dc0 req-a5fe9696-5c9b-4e79-89df-cf7848f9a090 service nova] Acquiring lock "b2e7cb0b-61b6-4d23-9b20-f8b437c7884e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:23:33 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-948d0bb1-811f-4cc0-9977-95e457be8dc0 req-a5fe9696-5c9b-4e79-89df-cf7848f9a090 service nova] Lock "b2e7cb0b-61b6-4d23-9b20-f8b437c7884e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:23:33 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-948d0bb1-811f-4cc0-9977-95e457be8dc0 req-a5fe9696-5c9b-4e79-89df-cf7848f9a090 service nova] Lock "b2e7cb0b-61b6-4d23-9b20-f8b437c7884e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:23:33 user nova-compute[85141]: DEBUG nova.compute.manager [req-948d0bb1-811f-4cc0-9977-95e457be8dc0 req-a5fe9696-5c9b-4e79-89df-cf7848f9a090 service nova] [instance: b2e7cb0b-61b6-4d23-9b20-f8b437c7884e] No waiting events found dispatching network-vif-plugged-3bcbe73a-3c72-4cfe-ab83-141399d14845 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:23:33 user nova-compute[85141]: WARNING nova.compute.manager [req-948d0bb1-811f-4cc0-9977-95e457be8dc0 req-a5fe9696-5c9b-4e79-89df-cf7848f9a090 service nova] [instance: b2e7cb0b-61b6-4d23-9b20-f8b437c7884e] Received unexpected event network-vif-plugged-3bcbe73a-3c72-4cfe-ab83-141399d14845 for instance with vm_state deleted and task_state None.
Nov 16 10:23:33 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e214bbb-5bbb-4e6f-ac09-9cb1412f068b/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:23:33 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e214bbb-5bbb-4e6f-ac09-9cb1412f068b/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:23:33 user nova-compute[85141]: DEBUG nova.compute.manager [req-dde1ab13-932f-4d19-9284-2d964753c8ad req-203c58a9-43b4-4ae0-8c0c-d5f0d403a602 service nova] [instance: b2e7cb0b-61b6-4d23-9b20-f8b437c7884e] Received event network-vif-deleted-3bcbe73a-3c72-4cfe-ab83-141399d14845 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:23:33 user nova-compute[85141]: DEBUG nova.compute.provider_tree [None req-e742a3c0-da97-43a9-b143-deaacd9c334e tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Inventory has not changed in ProviderTree for provider: bf8e0fa1-16b6-408f-9203-c4cd63916272 {{(pid=85141) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 10:23:33 user nova-compute[85141]: DEBUG nova.scheduler.client.report [None req-e742a3c0-da97-43a9-b143-deaacd9c334e tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Inventory has not changed for provider bf8e0fa1-16b6-408f-9203-c4cd63916272 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=85141) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 10:23:33 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-e742a3c0-da97-43a9-b143-deaacd9c334e tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.538s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:23:33 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e214bbb-5bbb-4e6f-ac09-9cb1412f068b/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:23:33 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11986c5b-6914-491e-8e71-983ab6b13c6e/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:23:33 user nova-compute[85141]: INFO nova.scheduler.client.report [None req-e742a3c0-da97-43a9-b143-deaacd9c334e tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Deleted allocations for instance b2e7cb0b-61b6-4d23-9b20-f8b437c7884e
Nov 16 10:23:33 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-e742a3c0-da97-43a9-b143-deaacd9c334e tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Lock "b2e7cb0b-61b6-4d23-9b20-f8b437c7884e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.811s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:23:33 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11986c5b-6914-491e-8e71-983ab6b13c6e/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:23:33 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11986c5b-6914-491e-8e71-983ab6b13c6e/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:23:34 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11986c5b-6914-491e-8e71-983ab6b13c6e/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:23:34 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b24c3954-06ff-4e15-9e43-c65d1dae7a5d/disk.rescue --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:23:34 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b24c3954-06ff-4e15-9e43-c65d1dae7a5d/disk.rescue --force-share --output=json" returned: 0 in 0.190s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:23:34 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b24c3954-06ff-4e15-9e43-c65d1dae7a5d/disk.rescue --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:23:34 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b24c3954-06ff-4e15-9e43-c65d1dae7a5d/disk.rescue --force-share --output=json" returned: 0 in 0.183s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:23:34 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b24c3954-06ff-4e15-9e43-c65d1dae7a5d/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:23:34 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b24c3954-06ff-4e15-9e43-c65d1dae7a5d/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:23:34 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b24c3954-06ff-4e15-9e43-c65d1dae7a5d/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:23:34 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b24c3954-06ff-4e15-9e43-c65d1dae7a5d/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:23:34 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=85141) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 10:23:34 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b388b98-4e65-4258-bbe2-77e699321fb7/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:23:34 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b388b98-4e65-4258-bbe2-77e699321fb7/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:23:34 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b388b98-4e65-4258-bbe2-77e699321fb7/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:23:35 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b388b98-4e65-4258-bbe2-77e699321fb7/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:23:35 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/059d6974-bd0c-4f73-91fc-8202ebda4238/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:23:35 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/059d6974-bd0c-4f73-91fc-8202ebda4238/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:23:35 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/059d6974-bd0c-4f73-91fc-8202ebda4238/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:23:35 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/059d6974-bd0c-4f73-91fc-8202ebda4238/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:23:35 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17480138-4b61-43f7-92a5-db065f7d1696/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:23:35 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17480138-4b61-43f7-92a5-db065f7d1696/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:23:35 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17480138-4b61-43f7-92a5-db065f7d1696/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:23:35 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17480138-4b61-43f7-92a5-db065f7d1696/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:23:36 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:23:36 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:23:36 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Hypervisor/Node resource view: name=user free_ram=7803MB free_disk=25.019840240478516GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=85141) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 10:23:36 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:23:36 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:23:36 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance d842f90e-663b-4c95-9d7c-d092d2bac41f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:23:36 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance f01dc8cf-1a69-4618-a15d-0c1075157f05 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:23:36 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance 059d6974-bd0c-4f73-91fc-8202ebda4238 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:23:36 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance 4e214bbb-5bbb-4e6f-ac09-9cb1412f068b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:23:36 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance b24c3954-06ff-4e15-9e43-c65d1dae7a5d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:23:36 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance 0b388b98-4e65-4258-bbe2-77e699321fb7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:23:36 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance 11986c5b-6914-491e-8e71-983ab6b13c6e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:23:36 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance abe5d4b7-a0d7-40e3-b630-0de746ddb55b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:23:36 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance 17480138-4b61-43f7-92a5-db065f7d1696 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:23:36 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=85141) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 10:23:36 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=85141) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 10:23:36 user nova-compute[85141]: DEBUG nova.compute.provider_tree [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Inventory has not changed in ProviderTree for provider: bf8e0fa1-16b6-408f-9203-c4cd63916272 {{(pid=85141) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 10:23:36 user nova-compute[85141]: DEBUG nova.scheduler.client.report [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Inventory has not changed for provider bf8e0fa1-16b6-408f-9203-c4cd63916272 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=85141) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 10:23:36 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:23:36 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Compute_service record updated for user:user {{(pid=85141) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 10:23:36 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.454s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:23:37 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:23:38 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:23:38 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:23:41 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:23:45 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-01a88649-b914-40cf-b340-ded4bd099824 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Acquiring lock "463034ff-14ce-477a-9642-4d86aa6f9cd9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:23:45 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-01a88649-b914-40cf-b340-ded4bd099824 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Lock "463034ff-14ce-477a-9642-4d86aa6f9cd9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:23:45 user nova-compute[85141]: DEBUG nova.compute.manager [None req-01a88649-b914-40cf-b340-ded4bd099824 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] [instance: 463034ff-14ce-477a-9642-4d86aa6f9cd9] Starting instance... {{(pid=85141) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 10:23:45 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-01a88649-b914-40cf-b340-ded4bd099824 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:23:45 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-01a88649-b914-40cf-b340-ded4bd099824 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:23:45 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-01a88649-b914-40cf-b340-ded4bd099824 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=85141) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 10:23:45 user nova-compute[85141]: INFO nova.compute.claims [None req-01a88649-b914-40cf-b340-ded4bd099824 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] [instance: 463034ff-14ce-477a-9642-4d86aa6f9cd9] Claim successful on node user
Nov 16 10:23:45 user nova-compute[85141]: DEBUG nova.compute.provider_tree [None req-01a88649-b914-40cf-b340-ded4bd099824 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Inventory has not changed in ProviderTree for provider: bf8e0fa1-16b6-408f-9203-c4cd63916272 {{(pid=85141) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 10:23:45 user nova-compute[85141]: DEBUG nova.scheduler.client.report [None req-01a88649-b914-40cf-b340-ded4bd099824 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Inventory has not changed for provider bf8e0fa1-16b6-408f-9203-c4cd63916272 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=85141) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 10:23:46 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-01a88649-b914-40cf-b340-ded4bd099824 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.386s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:23:46 user nova-compute[85141]: DEBUG nova.compute.manager [None req-01a88649-b914-40cf-b340-ded4bd099824 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] [instance: 463034ff-14ce-477a-9642-4d86aa6f9cd9] Start building networks asynchronously for instance. {{(pid=85141) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 10:23:46 user nova-compute[85141]: DEBUG nova.compute.manager [None req-01a88649-b914-40cf-b340-ded4bd099824 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] [instance: 463034ff-14ce-477a-9642-4d86aa6f9cd9] Allocating IP information in the background. {{(pid=85141) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 10:23:46 user nova-compute[85141]: DEBUG nova.network.neutron [None req-01a88649-b914-40cf-b340-ded4bd099824 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] [instance: 463034ff-14ce-477a-9642-4d86aa6f9cd9] allocate_for_instance() {{(pid=85141) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 10:23:46 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-01a88649-b914-40cf-b340-ded4bd099824 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] [instance: 463034ff-14ce-477a-9642-4d86aa6f9cd9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 10:23:46 user nova-compute[85141]: DEBUG nova.compute.manager [None req-01a88649-b914-40cf-b340-ded4bd099824 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] [instance: 463034ff-14ce-477a-9642-4d86aa6f9cd9] Start building block device mappings for instance. {{(pid=85141) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 10:23:46 user nova-compute[85141]: DEBUG nova.policy [None req-01a88649-b914-40cf-b340-ded4bd099824 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '76d4eaf5cef745c3bf3ae07068338b1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b520de67ac4290a4b779f50afeb1a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85141) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 10:23:46 user nova-compute[85141]: DEBUG nova.compute.manager [None req-01a88649-b914-40cf-b340-ded4bd099824 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] [instance: 463034ff-14ce-477a-9642-4d86aa6f9cd9] Start spawning the instance on the hypervisor. {{(pid=85141) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 10:23:46 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-01a88649-b914-40cf-b340-ded4bd099824 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] [instance: 463034ff-14ce-477a-9642-4d86aa6f9cd9] Creating instance directory {{(pid=85141) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 10:23:46 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-01a88649-b914-40cf-b340-ded4bd099824 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] [instance: 463034ff-14ce-477a-9642-4d86aa6f9cd9] Creating image(s)
Nov 16 10:23:46 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-01a88649-b914-40cf-b340-ded4bd099824 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Acquiring lock "/opt/stack/data/nova/instances/463034ff-14ce-477a-9642-4d86aa6f9cd9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:23:46 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-01a88649-b914-40cf-b340-ded4bd099824 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Lock "/opt/stack/data/nova/instances/463034ff-14ce-477a-9642-4d86aa6f9cd9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:23:46 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-01a88649-b914-40cf-b340-ded4bd099824 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Lock "/opt/stack/data/nova/instances/463034ff-14ce-477a-9642-4d86aa6f9cd9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:23:46 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-01a88649-b914-40cf-b340-ded4bd099824 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:23:46 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-01a88649-b914-40cf-b340-ded4bd099824 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json" returned: 0 in 0.175s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:23:46 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-01a88649-b914-40cf-b340-ded4bd099824 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Acquiring lock "60a78556fb399ed4a41bc3ca4bccf77c96d8e811" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:23:46 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-01a88649-b914-40cf-b340-ded4bd099824 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Lock "60a78556fb399ed4a41bc3ca4bccf77c96d8e811" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:23:46 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-01a88649-b914-40cf-b340-ded4bd099824 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:23:46 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-01a88649-b914-40cf-b340-ded4bd099824 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json" returned: 0 in 0.179s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:23:46 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-01a88649-b914-40cf-b340-ded4bd099824 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811,backing_fmt=raw /opt/stack/data/nova/instances/463034ff-14ce-477a-9642-4d86aa6f9cd9/disk 1073741824 {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:23:46 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-01a88649-b914-40cf-b340-ded4bd099824 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811,backing_fmt=raw /opt/stack/data/nova/instances/463034ff-14ce-477a-9642-4d86aa6f9cd9/disk 1073741824" returned: 0 in 0.058s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:23:46 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-01a88649-b914-40cf-b340-ded4bd099824 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Lock "60a78556fb399ed4a41bc3ca4bccf77c96d8e811" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.245s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:23:46 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-01a88649-b914-40cf-b340-ded4bd099824 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:23:46 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:23:46 user nova-compute[85141]: DEBUG nova.network.neutron [None req-01a88649-b914-40cf-b340-ded4bd099824 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] [instance: 463034ff-14ce-477a-9642-4d86aa6f9cd9] Successfully created port: 121bbc09-53cf-4586-8585-655079b4c49b {{(pid=85141) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 10:23:46 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-01a88649-b914-40cf-b340-ded4bd099824 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json" returned: 0 in 0.207s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:23:46 user nova-compute[85141]: DEBUG nova.virt.disk.api [None req-01a88649-b914-40cf-b340-ded4bd099824 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Checking if we can resize image /opt/stack/data/nova/instances/463034ff-14ce-477a-9642-4d86aa6f9cd9/disk. size=1073741824 {{(pid=85141) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 10:23:46 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-01a88649-b914-40cf-b340-ded4bd099824 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/463034ff-14ce-477a-9642-4d86aa6f9cd9/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:23:47 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-01a88649-b914-40cf-b340-ded4bd099824 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/463034ff-14ce-477a-9642-4d86aa6f9cd9/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:23:47 user nova-compute[85141]: DEBUG nova.virt.disk.api [None req-01a88649-b914-40cf-b340-ded4bd099824 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Cannot resize image /opt/stack/data/nova/instances/463034ff-14ce-477a-9642-4d86aa6f9cd9/disk to a smaller size. {{(pid=85141) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 10:23:47 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-01a88649-b914-40cf-b340-ded4bd099824 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] [instance: 463034ff-14ce-477a-9642-4d86aa6f9cd9] Created local disks {{(pid=85141) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 10:23:47 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-01a88649-b914-40cf-b340-ded4bd099824 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] [instance: 463034ff-14ce-477a-9642-4d86aa6f9cd9] Ensure instance console log exists: /opt/stack/data/nova/instances/463034ff-14ce-477a-9642-4d86aa6f9cd9/console.log {{(pid=85141) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 10:23:47 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-01a88649-b914-40cf-b340-ded4bd099824 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:23:47 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-01a88649-b914-40cf-b340-ded4bd099824 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:23:47 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-01a88649-b914-40cf-b340-ded4bd099824 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:23:47 user nova-compute[85141]: DEBUG nova.network.neutron [None req-01a88649-b914-40cf-b340-ded4bd099824 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] [instance: 463034ff-14ce-477a-9642-4d86aa6f9cd9] Successfully updated port: 121bbc09-53cf-4586-8585-655079b4c49b {{(pid=85141) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 10:23:47 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-01a88649-b914-40cf-b340-ded4bd099824 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Acquiring lock "refresh_cache-463034ff-14ce-477a-9642-4d86aa6f9cd9" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:23:47 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-01a88649-b914-40cf-b340-ded4bd099824 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Acquired lock "refresh_cache-463034ff-14ce-477a-9642-4d86aa6f9cd9" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:23:47 user nova-compute[85141]: DEBUG nova.network.neutron [None req-01a88649-b914-40cf-b340-ded4bd099824 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] [instance: 463034ff-14ce-477a-9642-4d86aa6f9cd9] Building network info cache for instance {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 10:23:47 user nova-compute[85141]: DEBUG nova.compute.manager [req-9119c2cd-0e1c-4f3f-b2a7-3ba6c5d10f7c req-5b089d93-6659-4dfb-8978-3f2454c69e28 service nova] [instance: 463034ff-14ce-477a-9642-4d86aa6f9cd9] Received event network-changed-121bbc09-53cf-4586-8585-655079b4c49b {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:23:47 user nova-compute[85141]: DEBUG nova.compute.manager [req-9119c2cd-0e1c-4f3f-b2a7-3ba6c5d10f7c req-5b089d93-6659-4dfb-8978-3f2454c69e28 service nova] [instance: 463034ff-14ce-477a-9642-4d86aa6f9cd9] Refreshing instance network info cache due to event network-changed-121bbc09-53cf-4586-8585-655079b4c49b. {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 10:23:47 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-9119c2cd-0e1c-4f3f-b2a7-3ba6c5d10f7c req-5b089d93-6659-4dfb-8978-3f2454c69e28 service nova] Acquiring lock "refresh_cache-463034ff-14ce-477a-9642-4d86aa6f9cd9" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:23:47 user nova-compute[85141]: DEBUG nova.network.neutron [None req-01a88649-b914-40cf-b340-ded4bd099824 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] [instance: 463034ff-14ce-477a-9642-4d86aa6f9cd9] Instance cache missing network info. {{(pid=85141) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 10:23:47 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:23:47 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:23:47 user nova-compute[85141]: DEBUG nova.network.neutron [None req-01a88649-b914-40cf-b340-ded4bd099824 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] [instance: 463034ff-14ce-477a-9642-4d86aa6f9cd9] Updating instance_info_cache with network_info: [{"id": "121bbc09-53cf-4586-8585-655079b4c49b", "address": "fa:16:3e:b0:77:d5", "network": {"id": "5b67a3fd-ef1e-4f2c-b6e0-31766ef39d30", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2137186235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09b520de67ac4290a4b779f50afeb1a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap121bbc09-53", "ovs_interfaceid": "121bbc09-53cf-4586-8585-655079b4c49b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:23:48 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-01a88649-b914-40cf-b340-ded4bd099824 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Releasing lock "refresh_cache-463034ff-14ce-477a-9642-4d86aa6f9cd9" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:23:48 user nova-compute[85141]: DEBUG nova.compute.manager [None req-01a88649-b914-40cf-b340-ded4bd099824 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] [instance: 463034ff-14ce-477a-9642-4d86aa6f9cd9] Instance network_info: |[{"id": "121bbc09-53cf-4586-8585-655079b4c49b", "address": "fa:16:3e:b0:77:d5", "network": {"id": "5b67a3fd-ef1e-4f2c-b6e0-31766ef39d30", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2137186235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09b520de67ac4290a4b779f50afeb1a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap121bbc09-53", "ovs_interfaceid": "121bbc09-53cf-4586-8585-655079b4c49b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=85141) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 10:23:48 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-9119c2cd-0e1c-4f3f-b2a7-3ba6c5d10f7c req-5b089d93-6659-4dfb-8978-3f2454c69e28 service nova] Acquired lock "refresh_cache-463034ff-14ce-477a-9642-4d86aa6f9cd9" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:23:48 user nova-compute[85141]: DEBUG nova.network.neutron [req-9119c2cd-0e1c-4f3f-b2a7-3ba6c5d10f7c req-5b089d93-6659-4dfb-8978-3f2454c69e28 service nova] [instance: 463034ff-14ce-477a-9642-4d86aa6f9cd9] Refreshing network info cache for port 121bbc09-53cf-4586-8585-655079b4c49b {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 10:23:48 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-01a88649-b914-40cf-b340-ded4bd099824 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] [instance: 463034ff-14ce-477a-9642-4d86aa6f9cd9] Start _get_guest_xml network_info=[{"id": "121bbc09-53cf-4586-8585-655079b4c49b", "address": "fa:16:3e:b0:77:d5", "network": {"id": "5b67a3fd-ef1e-4f2c-b6e0-31766ef39d30", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2137186235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09b520de67ac4290a4b779f50afeb1a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap121bbc09-53", "ovs_interfaceid": "121bbc09-53cf-4586-8585-655079b4c49b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T10:06:42Z,direct_url=<?>,disk_format='qcow2',id=bc4ca70f-a459-4d5c-a9e6-80f1948eb48b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1044631a5fe84ce8904864a7024049fa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T10:06:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_options': None, 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'image_id': 'bc4ca70f-a459-4d5c-a9e6-80f1948eb48b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=85141) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 10:23:48 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-01a88649-b914-40cf-b340-ded4bd099824 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:23:48 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-01a88649-b914-40cf-b340-ded4bd099824 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:23:48 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-01a88649-b914-40cf-b340-ded4bd099824 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=85141) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 10:23:48 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-01a88649-b914-40cf-b340-ded4bd099824 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] CPU controller missing on host. {{(pid=85141) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 10:23:48 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-01a88649-b914-40cf-b340-ded4bd099824 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=85141) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 10:23:48 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-01a88649-b914-40cf-b340-ded4bd099824 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] CPU controller found on host. {{(pid=85141) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 10:23:48 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-01a88649-b914-40cf-b340-ded4bd099824 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=85141) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 10:23:48 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-01a88649-b914-40cf-b340-ded4bd099824 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T10:06:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T10:06:42Z,direct_url=<?>,disk_format='qcow2',id=bc4ca70f-a459-4d5c-a9e6-80f1948eb48b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1044631a5fe84ce8904864a7024049fa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T10:06:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 10:23:48 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-01a88649-b914-40cf-b340-ded4bd099824 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Flavor limits 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 10:23:48 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-01a88649-b914-40cf-b340-ded4bd099824 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Image limits 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 10:23:48 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-01a88649-b914-40cf-b340-ded4bd099824 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Flavor pref 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 10:23:48 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-01a88649-b914-40cf-b340-ded4bd099824 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Image pref 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 10:23:48 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-01a88649-b914-40cf-b340-ded4bd099824 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 10:23:48 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-01a88649-b914-40cf-b340-ded4bd099824 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 10:23:48 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-01a88649-b914-40cf-b340-ded4bd099824 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=85141) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 10:23:48 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-01a88649-b914-40cf-b340-ded4bd099824 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Got 1 possible topologies {{(pid=85141) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 10:23:48 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-01a88649-b914-40cf-b340-ded4bd099824 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 10:23:48 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-01a88649-b914-40cf-b340-ded4bd099824 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 10:23:48 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-01a88649-b914-40cf-b340-ded4bd099824 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T10:23:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-574895759',display_name='tempest-ServerRescueNegativeTestJSON-server-574895759',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-574895759',id=30,image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPy9eDkAgUcYCfTGhKLJIwUDyptUWD0jpoBJdtiaupfL19VFNXv7ziT8DtfeHqgz7E4YFUN6fJXfeX4wrZlUO//q/m/KCWJdqM1qmRa4ROfNjPo1wV8qmxBxFoKuN0LXfA==',key_name='tempest-keypair-392930711',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='09b520de67ac4290a4b779f50afeb1a4',ramdisk_id='',reservation_id='r-a1f5xtl2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-2068988845',owner_user_name='tempest-ServerRescueNegativeTestJSON-2068988845-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T10:23:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='76d4eaf5cef745c3bf3ae07068338b1a',uuid=463034ff-14ce-477a-9642-4d86aa6f9cd9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "121bbc09-53cf-4586-8585-655079b4c49b", "address": "fa:16:3e:b0:77:d5", "network": {"id": "5b67a3fd-ef1e-4f2c-b6e0-31766ef39d30", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2137186235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09b520de67ac4290a4b779f50afeb1a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap121bbc09-53", "ovs_interfaceid": "121bbc09-53cf-4586-8585-655079b4c49b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=85141) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 10:23:48 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-01a88649-b914-40cf-b340-ded4bd099824 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Converting VIF {"id": "121bbc09-53cf-4586-8585-655079b4c49b", "address": "fa:16:3e:b0:77:d5", "network": {"id": "5b67a3fd-ef1e-4f2c-b6e0-31766ef39d30", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2137186235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09b520de67ac4290a4b779f50afeb1a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap121bbc09-53", "ovs_interfaceid": "121bbc09-53cf-4586-8585-655079b4c49b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:23:48 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-01a88649-b914-40cf-b340-ded4bd099824 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:77:d5,bridge_name='br-int',has_traffic_filtering=True,id=121bbc09-53cf-4586-8585-655079b4c49b,network=Network(5b67a3fd-ef1e-4f2c-b6e0-31766ef39d30),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap121bbc09-53') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:23:48 user nova-compute[85141]: DEBUG nova.objects.instance [None req-01a88649-b914-40cf-b340-ded4bd099824 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Lazy-loading 'pci_devices' on Instance uuid 463034ff-14ce-477a-9642-4d86aa6f9cd9 {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:23:48 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-01a88649-b914-40cf-b340-ded4bd099824 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] [instance: 463034ff-14ce-477a-9642-4d86aa6f9cd9] End _get_guest_xml xml=<domain type="kvm">
Nov 16 10:23:48 user nova-compute[85141]:   <uuid>463034ff-14ce-477a-9642-4d86aa6f9cd9</uuid>
Nov 16 10:23:48 user nova-compute[85141]:   <name>instance-0000001e</name>
Nov 16 10:23:48 user nova-compute[85141]:   <memory>524288</memory>
Nov 16 10:23:48 user nova-compute[85141]:   <vcpu>1</vcpu>
Nov 16 10:23:48 user nova-compute[85141]:   <metadata>
Nov 16 10:23:48 user nova-compute[85141]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 10:23:48 user nova-compute[85141]:       <nova:package version="0.0.0"/>
Nov 16 10:23:48 user nova-compute[85141]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-574895759</nova:name>
Nov 16 10:23:48 user nova-compute[85141]:       <nova:creationTime>2023-11-16 10:23:48</nova:creationTime>
Nov 16 10:23:48 user nova-compute[85141]:       <nova:flavor name="m1.tiny">
Nov 16 10:23:48 user nova-compute[85141]:         <nova:memory>512</nova:memory>
Nov 16 10:23:48 user nova-compute[85141]:         <nova:disk>1</nova:disk>
Nov 16 10:23:48 user nova-compute[85141]:         <nova:swap>0</nova:swap>
Nov 16 10:23:48 user nova-compute[85141]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 10:23:48 user nova-compute[85141]:         <nova:vcpus>1</nova:vcpus>
Nov 16 10:23:48 user nova-compute[85141]:       </nova:flavor>
Nov 16 10:23:48 user nova-compute[85141]:       <nova:owner>
Nov 16 10:23:48 user nova-compute[85141]:         <nova:user uuid="76d4eaf5cef745c3bf3ae07068338b1a">tempest-ServerRescueNegativeTestJSON-2068988845-project-member</nova:user>
Nov 16 10:23:48 user nova-compute[85141]:         <nova:project uuid="09b520de67ac4290a4b779f50afeb1a4">tempest-ServerRescueNegativeTestJSON-2068988845</nova:project>
Nov 16 10:23:48 user nova-compute[85141]:       </nova:owner>
Nov 16 10:23:48 user nova-compute[85141]:       <nova:root type="image" uuid="bc4ca70f-a459-4d5c-a9e6-80f1948eb48b"/>
Nov 16 10:23:48 user nova-compute[85141]:       <nova:ports>
Nov 16 10:23:48 user nova-compute[85141]:         <nova:port uuid="121bbc09-53cf-4586-8585-655079b4c49b">
Nov 16 10:23:48 user nova-compute[85141]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 16 10:23:48 user nova-compute[85141]:         </nova:port>
Nov 16 10:23:48 user nova-compute[85141]:       </nova:ports>
Nov 16 10:23:48 user nova-compute[85141]:     </nova:instance>
Nov 16 10:23:48 user nova-compute[85141]:   </metadata>
Nov 16 10:23:48 user nova-compute[85141]:   <sysinfo type="smbios">
Nov 16 10:23:48 user nova-compute[85141]:     <system>
Nov 16 10:23:48 user nova-compute[85141]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 10:23:48 user nova-compute[85141]:       <entry name="product">OpenStack Nova</entry>
Nov 16 10:23:48 user nova-compute[85141]:       <entry name="version">0.0.0</entry>
Nov 16 10:23:48 user nova-compute[85141]:       <entry name="serial">463034ff-14ce-477a-9642-4d86aa6f9cd9</entry>
Nov 16 10:23:48 user nova-compute[85141]:       <entry name="uuid">463034ff-14ce-477a-9642-4d86aa6f9cd9</entry>
Nov 16 10:23:48 user nova-compute[85141]:       <entry name="family">Virtual Machine</entry>
Nov 16 10:23:48 user nova-compute[85141]:     </system>
Nov 16 10:23:48 user nova-compute[85141]:   </sysinfo>
Nov 16 10:23:48 user nova-compute[85141]:   <os>
Nov 16 10:23:48 user nova-compute[85141]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 10:23:48 user nova-compute[85141]:     <boot dev="hd"/>
Nov 16 10:23:48 user nova-compute[85141]:     <smbios mode="sysinfo"/>
Nov 16 10:23:48 user nova-compute[85141]:   </os>
Nov 16 10:23:48 user nova-compute[85141]:   <features>
Nov 16 10:23:48 user nova-compute[85141]:     <acpi/>
Nov 16 10:23:48 user nova-compute[85141]:     <apic/>
Nov 16 10:23:48 user nova-compute[85141]:     <vmcoreinfo/>
Nov 16 10:23:48 user nova-compute[85141]:   </features>
Nov 16 10:23:48 user nova-compute[85141]:   <clock offset="utc">
Nov 16 10:23:48 user nova-compute[85141]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 10:23:48 user nova-compute[85141]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 10:23:48 user nova-compute[85141]:     <timer name="hpet" present="no"/>
Nov 16 10:23:48 user nova-compute[85141]:   </clock>
Nov 16 10:23:48 user nova-compute[85141]:   <cpu mode="custom" match="exact">
Nov 16 10:23:48 user nova-compute[85141]:     <model>Nehalem</model>
Nov 16 10:23:48 user nova-compute[85141]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 10:23:48 user nova-compute[85141]:   </cpu>
Nov 16 10:23:48 user nova-compute[85141]:   <devices>
Nov 16 10:23:48 user nova-compute[85141]:     <disk type="file" device="disk">
Nov 16 10:23:48 user nova-compute[85141]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 10:23:48 user nova-compute[85141]:       <source file="/opt/stack/data/nova/instances/463034ff-14ce-477a-9642-4d86aa6f9cd9/disk"/>
Nov 16 10:23:48 user nova-compute[85141]:       <target dev="vda" bus="virtio"/>
Nov 16 10:23:48 user nova-compute[85141]:     </disk>
Nov 16 10:23:48 user nova-compute[85141]:     <interface type="ethernet">
Nov 16 10:23:48 user nova-compute[85141]:       <mac address="fa:16:3e:b0:77:d5"/>
Nov 16 10:23:48 user nova-compute[85141]:       <model type="virtio"/>
Nov 16 10:23:48 user nova-compute[85141]:       <mtu size="1442"/>
Nov 16 10:23:48 user nova-compute[85141]:       <target dev="tap121bbc09-53"/>
Nov 16 10:23:48 user nova-compute[85141]:     </interface>
Nov 16 10:23:48 user nova-compute[85141]:     <serial type="pty">
Nov 16 10:23:48 user nova-compute[85141]:       <log file="/opt/stack/data/nova/instances/463034ff-14ce-477a-9642-4d86aa6f9cd9/console.log" append="off"/>
Nov 16 10:23:48 user nova-compute[85141]:     </serial>
Nov 16 10:23:48 user nova-compute[85141]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 10:23:48 user nova-compute[85141]:     <video>
Nov 16 10:23:48 user nova-compute[85141]:       <model type="virtio"/>
Nov 16 10:23:48 user nova-compute[85141]:     </video>
Nov 16 10:23:48 user nova-compute[85141]:     <rng model="virtio">
Nov 16 10:23:48 user nova-compute[85141]:       <backend model="random">/dev/urandom</backend>
Nov 16 10:23:48 user nova-compute[85141]:     </rng>
Nov 16 10:23:48 user nova-compute[85141]:     <controller type="usb" index="0" model="none"/>
Nov 16 10:23:48 user nova-compute[85141]:     <memballoon model="virtio">
Nov 16 10:23:48 user nova-compute[85141]:       <stats period="10"/>
Nov 16 10:23:48 user nova-compute[85141]:     </memballoon>
Nov 16 10:23:48 user nova-compute[85141]:   </devices>
Nov 16 10:23:48 user nova-compute[85141]: </domain>
Nov 16 10:23:48 user nova-compute[85141]:  {{(pid=85141) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 10:23:48 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-01a88649-b914-40cf-b340-ded4bd099824 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T10:23:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-574895759',display_name='tempest-ServerRescueNegativeTestJSON-server-574895759',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-574895759',id=30,image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPy9eDkAgUcYCfTGhKLJIwUDyptUWD0jpoBJdtiaupfL19VFNXv7ziT8DtfeHqgz7E4YFUN6fJXfeX4wrZlUO//q/m/KCWJdqM1qmRa4ROfNjPo1wV8qmxBxFoKuN0LXfA==',key_name='tempest-keypair-392930711',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='09b520de67ac4290a4b779f50afeb1a4',ramdisk_id='',reservation_id='r-a1f5xtl2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-2068988845',owner_user_name='tempest-ServerRescueNegativeTestJSON-2068988845-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T10:23:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='76d4eaf5cef745c3bf3ae07068338b1a',uuid=463034ff-14ce-477a-9642-4d86aa6f9cd9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "121bbc09-53cf-4586-8585-655079b4c49b", "address": "fa:16:3e:b0:77:d5", "network": {"id": "5b67a3fd-ef1e-4f2c-b6e0-31766ef39d30", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2137186235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09b520de67ac4290a4b779f50afeb1a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap121bbc09-53", "ovs_interfaceid": "121bbc09-53cf-4586-8585-655079b4c49b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 10:23:48 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-01a88649-b914-40cf-b340-ded4bd099824 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Converting VIF {"id": "121bbc09-53cf-4586-8585-655079b4c49b", "address": "fa:16:3e:b0:77:d5", "network": {"id": "5b67a3fd-ef1e-4f2c-b6e0-31766ef39d30", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2137186235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09b520de67ac4290a4b779f50afeb1a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap121bbc09-53", "ovs_interfaceid": "121bbc09-53cf-4586-8585-655079b4c49b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:23:48 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-01a88649-b914-40cf-b340-ded4bd099824 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:77:d5,bridge_name='br-int',has_traffic_filtering=True,id=121bbc09-53cf-4586-8585-655079b4c49b,network=Network(5b67a3fd-ef1e-4f2c-b6e0-31766ef39d30),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap121bbc09-53') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:23:48 user nova-compute[85141]: DEBUG os_vif [None req-01a88649-b914-40cf-b340-ded4bd099824 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:77:d5,bridge_name='br-int',has_traffic_filtering=True,id=121bbc09-53cf-4586-8585-655079b4c49b,network=Network(5b67a3fd-ef1e-4f2c-b6e0-31766ef39d30),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap121bbc09-53') {{(pid=85141) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 10:23:48 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:23:48 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:23:48 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 10:23:48 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:23:48 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '287ef6d6-bd9a-5e06-a609-8d9e3dcb304a', '_type': 'linux-noop'}}, row=False) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:23:48 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:23:48 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:23:48 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap121bbc09-53, may_exist=True, interface_attrs={}) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:23:48 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap121bbc09-53, col_values=(('qos', UUID('d29664a6-e262-49d5-8560-f9e8578769f4')),), if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:23:48 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap121bbc09-53, col_values=(('external_ids', {'iface-id': '121bbc09-53cf-4586-8585-655079b4c49b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b0:77:d5', 'vm-uuid': '463034ff-14ce-477a-9642-4d86aa6f9cd9'}),), if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:23:48 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:23:48 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:23:48 user nova-compute[85141]: INFO os_vif [None req-01a88649-b914-40cf-b340-ded4bd099824 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:77:d5,bridge_name='br-int',has_traffic_filtering=True,id=121bbc09-53cf-4586-8585-655079b4c49b,network=Network(5b67a3fd-ef1e-4f2c-b6e0-31766ef39d30),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap121bbc09-53')
Nov 16 10:23:48 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-01a88649-b914-40cf-b340-ded4bd099824 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] No BDM found with device name vda, not building metadata. {{(pid=85141) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 10:23:48 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-01a88649-b914-40cf-b340-ded4bd099824 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] No VIF found with MAC fa:16:3e:b0:77:d5, not building metadata {{(pid=85141) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 10:23:48 user nova-compute[85141]: DEBUG nova.network.neutron [req-9119c2cd-0e1c-4f3f-b2a7-3ba6c5d10f7c req-5b089d93-6659-4dfb-8978-3f2454c69e28 service nova] [instance: 463034ff-14ce-477a-9642-4d86aa6f9cd9] Updated VIF entry in instance network info cache for port 121bbc09-53cf-4586-8585-655079b4c49b. {{(pid=85141) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 10:23:48 user nova-compute[85141]: DEBUG nova.network.neutron [req-9119c2cd-0e1c-4f3f-b2a7-3ba6c5d10f7c req-5b089d93-6659-4dfb-8978-3f2454c69e28 service nova] [instance: 463034ff-14ce-477a-9642-4d86aa6f9cd9] Updating instance_info_cache with network_info: [{"id": "121bbc09-53cf-4586-8585-655079b4c49b", "address": "fa:16:3e:b0:77:d5", "network": {"id": "5b67a3fd-ef1e-4f2c-b6e0-31766ef39d30", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2137186235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09b520de67ac4290a4b779f50afeb1a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap121bbc09-53", "ovs_interfaceid": "121bbc09-53cf-4586-8585-655079b4c49b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:23:48 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-9119c2cd-0e1c-4f3f-b2a7-3ba6c5d10f7c req-5b089d93-6659-4dfb-8978-3f2454c69e28 service nova] Releasing lock "refresh_cache-463034ff-14ce-477a-9642-4d86aa6f9cd9" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:23:49 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:23:49 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:23:49 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:23:49 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-e4a28fe4-8541-4944-bf00-149747aa14b0 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 0b388b98-4e65-4258-bbe2-77e699321fb7 is timed out.
Nov 16 10:23:49 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-e4a28fe4-8541-4944-bf00-149747aa14b0 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Successfully detached device vdb from instance 0b388b98-4e65-4258-bbe2-77e699321fb7 from the live domain config.
Nov 16 10:23:49 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e4a28fe4-8541-4944-bf00-149747aa14b0 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] [instance: 0b388b98-4e65-4258-bbe2-77e699321fb7] calling os-brick to detach iSCSI Volume {{(pid=85141) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 10:23:49 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4a28fe4-8541-4944-bf00-149747aa14b0 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51806b6080>, {'target_iqn': 'iqn.2010-10.org.openstack:ca5a51ee-cdb2-4efa-b7e5-8a97d0c99bf7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ercfVhZa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 10:23:49 user nova-compute[85141]: WARNING os_brick.initiator.connectors.base [None req-e4a28fe4-8541-4944-bf00-149747aa14b0 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 10:23:49 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-e4a28fe4-8541-4944-bf00-149747aa14b0 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 10:23:49 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-e4a28fe4-8541-4944-bf00-149747aa14b0 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 10:23:49 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:23:49 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:23:49 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8bdf025-ca5e-4f05-9b89-8c560f229bd1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ca5a51ee-cdb2-4efa-b7e5-8a97d0c99bf7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:11a6a15b-38c1-4e7e-b8fa-2feb6789e775\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:23:49 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4a28fe4-8541-4944-bf00-149747aa14b0 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 10:23:49 user nova-compute[85141]: No targets found.
Nov 16 10:23:49 user nova-compute[85141]: iSNS:
Nov 16 10:23:49 user nova-compute[85141]: No targets found.
Nov 16 10:23:49 user nova-compute[85141]: STATIC:
Nov 16 10:23:49 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee
Nov 16 10:23:49 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:23:49 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:23:49 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:ca5a51ee-cdb2-4efa-b7e5-8a97d0c99bf7
Nov 16 10:23:49 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:23:49 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:23:49 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:11a6a15b-38c1-4e7e-b8fa-2feb6789e775
Nov 16 10:23:49 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:23:49 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:23:49 user nova-compute[85141]: FIRMWARE:
Nov 16 10:23:49 user nova-compute[85141]: No targets found.
Nov 16 10:23:49 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:23:49 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4a28fe4-8541-4944-bf00-149747aa14b0 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 10:23:49 user nova-compute[85141]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 10:23:49 user nova-compute[85141]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=85141) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 10:23:49 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4a28fe4-8541-4944-bf00-149747aa14b0 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ca5a51ee-cdb2-4efa-b7e5-8a97d0c99bf7', 0)] {{(pid=85141) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 10:23:49 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:23:49 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:23:49 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[17087c90-51b6-4cc0-9356-07b1d7124d5e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:11a6a15b-38c1-4e7e-b8fa-2feb6789e775\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ca5a51ee-cdb2-4efa-b7e5-8a97d0c99bf7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:23:49 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:23:49 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:23:49 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[282ce350-aef5-46bd-822d-6568b3ebcd75]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca5a51ee-cdb2-4efa-b7e5-8a97d0c99bf7 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11a6a15b-38c1-4e7e-b8fa-2feb6789e775 (non-flash)\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:23:49 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4a28fe4-8541-4944-bf00-149747aa14b0 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)
Nov 16 10:23:49 user nova-compute[85141]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca5a51ee-cdb2-4efa-b7e5-8a97d0c99bf7 (non-flash)
Nov 16 10:23:49 user nova-compute[85141]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11a6a15b-38c1-4e7e-b8fa-2feb6789e775 (non-flash)
Nov 16 10:23:49 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:23:49 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4a28fe4-8541-4944-bf00-149747aa14b0 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)
Nov 16 10:23:49 user nova-compute[85141]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca5a51ee-cdb2-4efa-b7e5-8a97d0c99bf7 (non-flash)
Nov 16 10:23:49 user nova-compute[85141]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11a6a15b-38c1-4e7e-b8fa-2feb6789e775 (non-flash)
Nov 16 10:23:49 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 10:23:49 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4a28fe4-8541-4944-bf00-149747aa14b0 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f518054d240>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ca5a51ee-cdb2-4efa-b7e5-8a97d0c99bf7'): ({'sdg'}, set())}) {{(pid=85141) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 10:23:49 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-e4a28fe4-8541-4944-bf00-149747aa14b0 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Removing single pathed devices sdg {{(pid=85141) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 10:23:49 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:23:49 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:23:49 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[06aaf764-be99-40bd-b3f7-fbb3a210bc53]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:23:49 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:23:49 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.018s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:23:49 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[d784dc93-56cc-4f6b-b69e-55ac9a87b6f6]: (4, ('ok\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:23:49 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-e4a28fe4-8541-4944-bf00-149747aa14b0 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Flushing IO for device /dev/sdg {{(pid=85141) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 10:23:49 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:23:49 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.015s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:23:49 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[18a5a569-6d16-46fb-8869-ac5584e60d02]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:23:49 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-e4a28fe4-8541-4944-bf00-149747aa14b0 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=85141) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 10:23:49 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:23:49 user nova-compute[85141]: DEBUG nova.compute.manager [req-d5f19184-facf-46c4-a97b-ef4646c2974f req-d6249d94-0fbd-4e28-a1a0-24116618181e service nova] [instance: 463034ff-14ce-477a-9642-4d86aa6f9cd9] Received event network-vif-plugged-121bbc09-53cf-4586-8585-655079b4c49b {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:23:49 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-d5f19184-facf-46c4-a97b-ef4646c2974f req-d6249d94-0fbd-4e28-a1a0-24116618181e service nova] Acquiring lock "463034ff-14ce-477a-9642-4d86aa6f9cd9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:23:49 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-d5f19184-facf-46c4-a97b-ef4646c2974f req-d6249d94-0fbd-4e28-a1a0-24116618181e service nova] Lock "463034ff-14ce-477a-9642-4d86aa6f9cd9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:23:49 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-d5f19184-facf-46c4-a97b-ef4646c2974f req-d6249d94-0fbd-4e28-a1a0-24116618181e service nova] Lock "463034ff-14ce-477a-9642-4d86aa6f9cd9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:23:49 user nova-compute[85141]: DEBUG nova.compute.manager [req-d5f19184-facf-46c4-a97b-ef4646c2974f req-d6249d94-0fbd-4e28-a1a0-24116618181e service nova] [instance: 463034ff-14ce-477a-9642-4d86aa6f9cd9] No waiting events found dispatching network-vif-plugged-121bbc09-53cf-4586-8585-655079b4c49b {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:23:49 user nova-compute[85141]: WARNING nova.compute.manager [req-d5f19184-facf-46c4-a97b-ef4646c2974f req-d6249d94-0fbd-4e28-a1a0-24116618181e service nova] [instance: 463034ff-14ce-477a-9642-4d86aa6f9cd9] Received unexpected event network-vif-plugged-121bbc09-53cf-4586-8585-655079b4c49b for instance with vm_state building and task_state spawning.
Nov 16 10:23:49 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.044s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:23:49 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[55b9fc83-ea8e-43f1-8769-570f344aa1d2]: (4, ('1', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:23:49 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-e4a28fe4-8541-4944-bf00-149747aa14b0 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=85141) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 10:23:49 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-e4a28fe4-8541-4944-bf00-149747aa14b0 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] SCSI volumes sdg have been removed. {{(pid=85141) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 10:23:49 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4a28fe4-8541-4944-bf00-149747aa14b0 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ca5a51ee-cdb2-4efa-b7e5-8a97d0c99bf7')] {{(pid=85141) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 10:23:49 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca5a51ee-cdb2-4efa-b7e5-8a97d0c99bf7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:23:49 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca5a51ee-cdb2-4efa-b7e5-8a97d0c99bf7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.034s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:23:49 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0ee41f8-f52b-4887-8c0d-78bbffe6fae9]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:23:49 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4a28fe4-8541-4944-bf00-149747aa14b0 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:23:49 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca5a51ee-cdb2-4efa-b7e5-8a97d0c99bf7 -p 172.16.0.220:3260 --logout {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:23:49 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:23:49 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:23:49 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca5a51ee-cdb2-4efa-b7e5-8a97d0c99bf7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:23:49 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3f6a8cb-d394-4921-af4d-9d962e954ef8]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:ca5a51ee-cdb2-4efa-b7e5-8a97d0c99bf7, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:ca5a51ee-cdb2-4efa-b7e5-8a97d0c99bf7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:23:49 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4a28fe4-8541-4944-bf00-149747aa14b0 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:ca5a51ee-cdb2-4efa-b7e5-8a97d0c99bf7, portal: 172.16.0.220,3260]
Nov 16 10:23:49 user nova-compute[85141]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:ca5a51ee-cdb2-4efa-b7e5-8a97d0c99bf7, portal: 172.16.0.220,3260] successful.
Nov 16 10:23:49 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:23:49 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca5a51ee-cdb2-4efa-b7e5-8a97d0c99bf7 -p 172.16.0.220:3260 --op delete {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:23:49 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca5a51ee-cdb2-4efa-b7e5-8a97d0c99bf7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:23:49 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5115d40-0b42-4b6c-a0c6-adba3e24644b]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:23:49 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4a28fe4-8541-4944-bf00-149747aa14b0 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:23:49 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-e4a28fe4-8541-4944-bf00-149747aa14b0 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.328s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 10:23:49 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4a28fe4-8541-4944-bf00-149747aa14b0 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] <== disconnect_volume: return (329ms) None {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 10:23:49 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e4a28fe4-8541-4944-bf00-149747aa14b0 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] [instance: 0b388b98-4e65-4258-bbe2-77e699321fb7] Disconnected iSCSI Volume {{(pid=85141) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 10:23:50 user nova-compute[85141]: DEBUG nova.objects.instance [None req-e4a28fe4-8541-4944-bf00-149747aa14b0 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Lazy-loading 'flavor' on Instance uuid 0b388b98-4e65-4258-bbe2-77e699321fb7 {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:23:50 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-e4a28fe4-8541-4944-bf00-149747aa14b0 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Lock "0b388b98-4e65-4258-bbe2-77e699321fb7" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.967s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:23:51 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-cc5155cc-38ba-458f-8981-3fced655ba90 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Acquiring lock "0b388b98-4e65-4258-bbe2-77e699321fb7" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:23:51 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-cc5155cc-38ba-458f-8981-3fced655ba90 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Lock "0b388b98-4e65-4258-bbe2-77e699321fb7" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:23:51 user nova-compute[85141]: DEBUG nova.compute.manager [None req-cc5155cc-38ba-458f-8981-3fced655ba90 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] [instance: 0b388b98-4e65-4258-bbe2-77e699321fb7] Checking state {{(pid=85141) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 10:23:51 user nova-compute[85141]: DEBUG nova.compute.manager [None req-cc5155cc-38ba-458f-8981-3fced655ba90 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] [instance: 0b388b98-4e65-4258-bbe2-77e699321fb7] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=85141) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Nov 16 10:23:51 user nova-compute[85141]: DEBUG nova.objects.instance [None req-cc5155cc-38ba-458f-8981-3fced655ba90 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Lazy-loading 'flavor' on Instance uuid 0b388b98-4e65-4258-bbe2-77e699321fb7 {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:23:51 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:23:51 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:23:51 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:23:51 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:23:51 user nova-compute[85141]: DEBUG nova.compute.manager [None req-01a88649-b914-40cf-b340-ded4bd099824 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] [instance: 463034ff-14ce-477a-9642-4d86aa6f9cd9] Instance event wait completed in 0 seconds for  {{(pid=85141) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 10:23:51 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-01a88649-b914-40cf-b340-ded4bd099824 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] [instance: 463034ff-14ce-477a-9642-4d86aa6f9cd9] Guest created on hypervisor {{(pid=85141) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 10:23:51 user nova-compute[85141]: INFO nova.virt.libvirt.driver [-] [instance: 463034ff-14ce-477a-9642-4d86aa6f9cd9] Instance spawned successfully.
Nov 16 10:23:51 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-01a88649-b914-40cf-b340-ded4bd099824 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] [instance: 463034ff-14ce-477a-9642-4d86aa6f9cd9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 10:23:51 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-01a88649-b914-40cf-b340-ded4bd099824 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] [instance: 463034ff-14ce-477a-9642-4d86aa6f9cd9] Found default for hw_cdrom_bus of ide {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:23:51 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-01a88649-b914-40cf-b340-ded4bd099824 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] [instance: 463034ff-14ce-477a-9642-4d86aa6f9cd9] Found default for hw_disk_bus of virtio {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:23:51 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-01a88649-b914-40cf-b340-ded4bd099824 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] [instance: 463034ff-14ce-477a-9642-4d86aa6f9cd9] Found default for hw_input_bus of None {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:23:51 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-01a88649-b914-40cf-b340-ded4bd099824 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] [instance: 463034ff-14ce-477a-9642-4d86aa6f9cd9] Found default for hw_pointer_model of None {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:23:51 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-01a88649-b914-40cf-b340-ded4bd099824 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] [instance: 463034ff-14ce-477a-9642-4d86aa6f9cd9] Found default for hw_video_model of virtio {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:23:51 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-01a88649-b914-40cf-b340-ded4bd099824 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] [instance: 463034ff-14ce-477a-9642-4d86aa6f9cd9] Found default for hw_vif_model of virtio {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:23:51 user nova-compute[85141]: DEBUG nova.compute.manager [req-937f13ec-673e-49aa-87dc-92e889cb294d req-319cbc07-6e4a-409e-bdd5-bb7432e56856 service nova] [instance: 463034ff-14ce-477a-9642-4d86aa6f9cd9] Received event network-vif-plugged-121bbc09-53cf-4586-8585-655079b4c49b {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:23:51 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-937f13ec-673e-49aa-87dc-92e889cb294d req-319cbc07-6e4a-409e-bdd5-bb7432e56856 service nova] Acquiring lock "463034ff-14ce-477a-9642-4d86aa6f9cd9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:23:51 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-937f13ec-673e-49aa-87dc-92e889cb294d req-319cbc07-6e4a-409e-bdd5-bb7432e56856 service nova] Lock "463034ff-14ce-477a-9642-4d86aa6f9cd9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:23:51 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-937f13ec-673e-49aa-87dc-92e889cb294d req-319cbc07-6e4a-409e-bdd5-bb7432e56856 service nova] Lock "463034ff-14ce-477a-9642-4d86aa6f9cd9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:23:51 user nova-compute[85141]: DEBUG nova.compute.manager [req-937f13ec-673e-49aa-87dc-92e889cb294d req-319cbc07-6e4a-409e-bdd5-bb7432e56856 service nova] [instance: 463034ff-14ce-477a-9642-4d86aa6f9cd9] No waiting events found dispatching network-vif-plugged-121bbc09-53cf-4586-8585-655079b4c49b {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:23:51 user nova-compute[85141]: WARNING nova.compute.manager [req-937f13ec-673e-49aa-87dc-92e889cb294d req-319cbc07-6e4a-409e-bdd5-bb7432e56856 service nova] [instance: 463034ff-14ce-477a-9642-4d86aa6f9cd9] Received unexpected event network-vif-plugged-121bbc09-53cf-4586-8585-655079b4c49b for instance with vm_state building and task_state spawning.
Nov 16 10:23:51 user nova-compute[85141]: INFO nova.compute.manager [None req-01a88649-b914-40cf-b340-ded4bd099824 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] [instance: 463034ff-14ce-477a-9642-4d86aa6f9cd9] Took 5.58 seconds to spawn the instance on the hypervisor.
Nov 16 10:23:51 user nova-compute[85141]: DEBUG nova.compute.manager [None req-01a88649-b914-40cf-b340-ded4bd099824 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] [instance: 463034ff-14ce-477a-9642-4d86aa6f9cd9] Checking state {{(pid=85141) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 10:23:51 user nova-compute[85141]: INFO nova.compute.manager [None req-01a88649-b914-40cf-b340-ded4bd099824 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] [instance: 463034ff-14ce-477a-9642-4d86aa6f9cd9] Took 6.35 seconds to build instance.
Nov 16 10:23:51 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-01a88649-b914-40cf-b340-ded4bd099824 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Lock "463034ff-14ce-477a-9642-4d86aa6f9cd9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.446s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:23:52 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:23:52 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:23:52 user nova-compute[85141]: INFO nova.virt.libvirt.driver [-] [instance: 0b388b98-4e65-4258-bbe2-77e699321fb7] Instance destroyed successfully.
Nov 16 10:23:52 user nova-compute[85141]: DEBUG nova.compute.manager [None req-cc5155cc-38ba-458f-8981-3fced655ba90 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] [instance: 0b388b98-4e65-4258-bbe2-77e699321fb7] Checking state {{(pid=85141) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 10:23:52 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-cc5155cc-38ba-458f-8981-3fced655ba90 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Lock "0b388b98-4e65-4258-bbe2-77e699321fb7" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.857s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:23:52 user nova-compute[85141]: DEBUG nova.compute.manager [req-44520896-9eb4-410c-9f0c-e21bc7dc27aa req-078b0080-7437-4cdf-aef1-a3e26e41d864 service nova] [instance: 0b388b98-4e65-4258-bbe2-77e699321fb7] Received event network-vif-unplugged-3ed9d2a6-c028-4b75-9023-95b1cfa982b6 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:23:52 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-44520896-9eb4-410c-9f0c-e21bc7dc27aa req-078b0080-7437-4cdf-aef1-a3e26e41d864 service nova] Acquiring lock "0b388b98-4e65-4258-bbe2-77e699321fb7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:23:52 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-44520896-9eb4-410c-9f0c-e21bc7dc27aa req-078b0080-7437-4cdf-aef1-a3e26e41d864 service nova] Lock "0b388b98-4e65-4258-bbe2-77e699321fb7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:23:52 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-44520896-9eb4-410c-9f0c-e21bc7dc27aa req-078b0080-7437-4cdf-aef1-a3e26e41d864 service nova] Lock "0b388b98-4e65-4258-bbe2-77e699321fb7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:23:52 user nova-compute[85141]: DEBUG nova.compute.manager [req-44520896-9eb4-410c-9f0c-e21bc7dc27aa req-078b0080-7437-4cdf-aef1-a3e26e41d864 service nova] [instance: 0b388b98-4e65-4258-bbe2-77e699321fb7] No waiting events found dispatching network-vif-unplugged-3ed9d2a6-c028-4b75-9023-95b1cfa982b6 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:23:52 user nova-compute[85141]: WARNING nova.compute.manager [req-44520896-9eb4-410c-9f0c-e21bc7dc27aa req-078b0080-7437-4cdf-aef1-a3e26e41d864 service nova] [instance: 0b388b98-4e65-4258-bbe2-77e699321fb7] Received unexpected event network-vif-unplugged-3ed9d2a6-c028-4b75-9023-95b1cfa982b6 for instance with vm_state stopped and task_state None.
Nov 16 10:23:52 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:23:53 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:23:53 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:23:54 user nova-compute[85141]: DEBUG nova.compute.manager [req-ed8a92e6-1078-454e-bf8f-1e1a10a8c1c4 req-d25e5078-e28f-4d54-9238-bd613a4c2574 service nova] [instance: 0b388b98-4e65-4258-bbe2-77e699321fb7] Received event network-vif-plugged-3ed9d2a6-c028-4b75-9023-95b1cfa982b6 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:23:54 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-ed8a92e6-1078-454e-bf8f-1e1a10a8c1c4 req-d25e5078-e28f-4d54-9238-bd613a4c2574 service nova] Acquiring lock "0b388b98-4e65-4258-bbe2-77e699321fb7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:23:54 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-ed8a92e6-1078-454e-bf8f-1e1a10a8c1c4 req-d25e5078-e28f-4d54-9238-bd613a4c2574 service nova] Lock "0b388b98-4e65-4258-bbe2-77e699321fb7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:23:54 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-ed8a92e6-1078-454e-bf8f-1e1a10a8c1c4 req-d25e5078-e28f-4d54-9238-bd613a4c2574 service nova] Lock "0b388b98-4e65-4258-bbe2-77e699321fb7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:23:54 user nova-compute[85141]: DEBUG nova.compute.manager [req-ed8a92e6-1078-454e-bf8f-1e1a10a8c1c4 req-d25e5078-e28f-4d54-9238-bd613a4c2574 service nova] [instance: 0b388b98-4e65-4258-bbe2-77e699321fb7] No waiting events found dispatching network-vif-plugged-3ed9d2a6-c028-4b75-9023-95b1cfa982b6 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:23:54 user nova-compute[85141]: WARNING nova.compute.manager [req-ed8a92e6-1078-454e-bf8f-1e1a10a8c1c4 req-d25e5078-e28f-4d54-9238-bd613a4c2574 service nova] [instance: 0b388b98-4e65-4258-bbe2-77e699321fb7] Received unexpected event network-vif-plugged-3ed9d2a6-c028-4b75-9023-95b1cfa982b6 for instance with vm_state stopped and task_state None.
Nov 16 10:23:55 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:23:56 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-92fa6448-77a5-4d6a-98eb-98ecef802693 tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] Acquiring lock "5a507c85-0369-48ea-8858-3e7d346b4cb0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:23:56 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-92fa6448-77a5-4d6a-98eb-98ecef802693 tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] Lock "5a507c85-0369-48ea-8858-3e7d346b4cb0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:23:56 user nova-compute[85141]: DEBUG nova.compute.manager [None req-92fa6448-77a5-4d6a-98eb-98ecef802693 tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] [instance: 5a507c85-0369-48ea-8858-3e7d346b4cb0] Starting instance... {{(pid=85141) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 10:23:56 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-92fa6448-77a5-4d6a-98eb-98ecef802693 tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:23:56 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-92fa6448-77a5-4d6a-98eb-98ecef802693 tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:23:56 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-92fa6448-77a5-4d6a-98eb-98ecef802693 tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=85141) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 10:23:56 user nova-compute[85141]: INFO nova.compute.claims [None req-92fa6448-77a5-4d6a-98eb-98ecef802693 tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] [instance: 5a507c85-0369-48ea-8858-3e7d346b4cb0] Claim successful on node user
Nov 16 10:23:57 user nova-compute[85141]: DEBUG nova.compute.provider_tree [None req-92fa6448-77a5-4d6a-98eb-98ecef802693 tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] Inventory has not changed in ProviderTree for provider: bf8e0fa1-16b6-408f-9203-c4cd63916272 {{(pid=85141) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 10:23:57 user nova-compute[85141]: DEBUG nova.scheduler.client.report [None req-92fa6448-77a5-4d6a-98eb-98ecef802693 tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] Inventory has not changed for provider bf8e0fa1-16b6-408f-9203-c4cd63916272 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=85141) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 10:23:57 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-92fa6448-77a5-4d6a-98eb-98ecef802693 tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.439s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:23:57 user nova-compute[85141]: DEBUG nova.compute.manager [None req-92fa6448-77a5-4d6a-98eb-98ecef802693 tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] [instance: 5a507c85-0369-48ea-8858-3e7d346b4cb0] Start building networks asynchronously for instance. {{(pid=85141) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 10:23:57 user nova-compute[85141]: DEBUG nova.compute.manager [None req-92fa6448-77a5-4d6a-98eb-98ecef802693 tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] [instance: 5a507c85-0369-48ea-8858-3e7d346b4cb0] Allocating IP information in the background. {{(pid=85141) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 10:23:57 user nova-compute[85141]: DEBUG nova.network.neutron [None req-92fa6448-77a5-4d6a-98eb-98ecef802693 tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] [instance: 5a507c85-0369-48ea-8858-3e7d346b4cb0] allocate_for_instance() {{(pid=85141) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 10:23:57 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-92fa6448-77a5-4d6a-98eb-98ecef802693 tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] [instance: 5a507c85-0369-48ea-8858-3e7d346b4cb0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 10:23:57 user nova-compute[85141]: DEBUG nova.compute.manager [None req-92fa6448-77a5-4d6a-98eb-98ecef802693 tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] [instance: 5a507c85-0369-48ea-8858-3e7d346b4cb0] Start building block device mappings for instance. {{(pid=85141) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 10:23:57 user nova-compute[85141]: DEBUG nova.policy [None req-92fa6448-77a5-4d6a-98eb-98ecef802693 tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a7b52c2f46234602ae4925447a7d39a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e4ebd46b4243c09f88927532b610f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85141) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 10:23:57 user nova-compute[85141]: DEBUG nova.compute.manager [None req-92fa6448-77a5-4d6a-98eb-98ecef802693 tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] [instance: 5a507c85-0369-48ea-8858-3e7d346b4cb0] Start spawning the instance on the hypervisor. {{(pid=85141) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 10:23:57 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-92fa6448-77a5-4d6a-98eb-98ecef802693 tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] [instance: 5a507c85-0369-48ea-8858-3e7d346b4cb0] Creating instance directory {{(pid=85141) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 10:23:57 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-92fa6448-77a5-4d6a-98eb-98ecef802693 tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] [instance: 5a507c85-0369-48ea-8858-3e7d346b4cb0] Creating image(s)
Nov 16 10:23:57 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-92fa6448-77a5-4d6a-98eb-98ecef802693 tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] Acquiring lock "/opt/stack/data/nova/instances/5a507c85-0369-48ea-8858-3e7d346b4cb0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:23:57 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-92fa6448-77a5-4d6a-98eb-98ecef802693 tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] Lock "/opt/stack/data/nova/instances/5a507c85-0369-48ea-8858-3e7d346b4cb0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:23:57 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-92fa6448-77a5-4d6a-98eb-98ecef802693 tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] Lock "/opt/stack/data/nova/instances/5a507c85-0369-48ea-8858-3e7d346b4cb0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:23:57 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-92fa6448-77a5-4d6a-98eb-98ecef802693 tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:23:57 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:23:57 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-92fa6448-77a5-4d6a-98eb-98ecef802693 tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json" returned: 0 in 0.242s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:23:57 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-92fa6448-77a5-4d6a-98eb-98ecef802693 tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] Acquiring lock "60a78556fb399ed4a41bc3ca4bccf77c96d8e811" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:23:57 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-92fa6448-77a5-4d6a-98eb-98ecef802693 tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] Lock "60a78556fb399ed4a41bc3ca4bccf77c96d8e811" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:23:57 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-92fa6448-77a5-4d6a-98eb-98ecef802693 tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:23:58 user nova-compute[85141]: DEBUG nova.network.neutron [None req-92fa6448-77a5-4d6a-98eb-98ecef802693 tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] [instance: 5a507c85-0369-48ea-8858-3e7d346b4cb0] Successfully created port: 47904c84-f39f-4d8e-9675-0d8a535e3799 {{(pid=85141) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 10:23:58 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-92fa6448-77a5-4d6a-98eb-98ecef802693 tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json" returned: 0 in 0.195s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:23:58 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-92fa6448-77a5-4d6a-98eb-98ecef802693 tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811,backing_fmt=raw /opt/stack/data/nova/instances/5a507c85-0369-48ea-8858-3e7d346b4cb0/disk 1073741824 {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:23:58 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-92fa6448-77a5-4d6a-98eb-98ecef802693 tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811,backing_fmt=raw /opt/stack/data/nova/instances/5a507c85-0369-48ea-8858-3e7d346b4cb0/disk 1073741824" returned: 0 in 0.060s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:23:58 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-92fa6448-77a5-4d6a-98eb-98ecef802693 tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] Lock "60a78556fb399ed4a41bc3ca4bccf77c96d8e811" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.264s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:23:58 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-92fa6448-77a5-4d6a-98eb-98ecef802693 tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:23:58 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:23:58 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-92fa6448-77a5-4d6a-98eb-98ecef802693 tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json" returned: 0 in 0.180s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:23:58 user nova-compute[85141]: DEBUG nova.virt.disk.api [None req-92fa6448-77a5-4d6a-98eb-98ecef802693 tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5a507c85-0369-48ea-8858-3e7d346b4cb0/disk. size=1073741824 {{(pid=85141) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 10:23:58 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-92fa6448-77a5-4d6a-98eb-98ecef802693 tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a507c85-0369-48ea-8858-3e7d346b4cb0/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:23:58 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-92fa6448-77a5-4d6a-98eb-98ecef802693 tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a507c85-0369-48ea-8858-3e7d346b4cb0/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:23:58 user nova-compute[85141]: DEBUG nova.virt.disk.api [None req-92fa6448-77a5-4d6a-98eb-98ecef802693 tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] Cannot resize image /opt/stack/data/nova/instances/5a507c85-0369-48ea-8858-3e7d346b4cb0/disk to a smaller size. {{(pid=85141) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 10:23:58 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-92fa6448-77a5-4d6a-98eb-98ecef802693 tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] [instance: 5a507c85-0369-48ea-8858-3e7d346b4cb0] Created local disks {{(pid=85141) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 10:23:58 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-92fa6448-77a5-4d6a-98eb-98ecef802693 tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] [instance: 5a507c85-0369-48ea-8858-3e7d346b4cb0] Ensure instance console log exists: /opt/stack/data/nova/instances/5a507c85-0369-48ea-8858-3e7d346b4cb0/console.log {{(pid=85141) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 10:23:58 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-92fa6448-77a5-4d6a-98eb-98ecef802693 tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:23:58 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-92fa6448-77a5-4d6a-98eb-98ecef802693 tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:23:58 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-92fa6448-77a5-4d6a-98eb-98ecef802693 tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:23:58 user nova-compute[85141]: DEBUG nova.network.neutron [None req-92fa6448-77a5-4d6a-98eb-98ecef802693 tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] [instance: 5a507c85-0369-48ea-8858-3e7d346b4cb0] Successfully updated port: 47904c84-f39f-4d8e-9675-0d8a535e3799 {{(pid=85141) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 10:23:58 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-92fa6448-77a5-4d6a-98eb-98ecef802693 tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] Acquiring lock "refresh_cache-5a507c85-0369-48ea-8858-3e7d346b4cb0" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:23:58 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-92fa6448-77a5-4d6a-98eb-98ecef802693 tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] Acquired lock "refresh_cache-5a507c85-0369-48ea-8858-3e7d346b4cb0" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:23:58 user nova-compute[85141]: DEBUG nova.network.neutron [None req-92fa6448-77a5-4d6a-98eb-98ecef802693 tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] [instance: 5a507c85-0369-48ea-8858-3e7d346b4cb0] Building network info cache for instance {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 10:23:58 user nova-compute[85141]: DEBUG nova.compute.manager [req-8090fe66-0bc4-4bc7-bc67-7a9e8a4dbfa4 req-4cd43516-acb6-4110-8d8a-4470982ef3c9 service nova] [instance: 5a507c85-0369-48ea-8858-3e7d346b4cb0] Received event network-changed-47904c84-f39f-4d8e-9675-0d8a535e3799 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:23:58 user nova-compute[85141]: DEBUG nova.compute.manager [req-8090fe66-0bc4-4bc7-bc67-7a9e8a4dbfa4 req-4cd43516-acb6-4110-8d8a-4470982ef3c9 service nova] [instance: 5a507c85-0369-48ea-8858-3e7d346b4cb0] Refreshing instance network info cache due to event network-changed-47904c84-f39f-4d8e-9675-0d8a535e3799. {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 10:23:58 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-8090fe66-0bc4-4bc7-bc67-7a9e8a4dbfa4 req-4cd43516-acb6-4110-8d8a-4470982ef3c9 service nova] Acquiring lock "refresh_cache-5a507c85-0369-48ea-8858-3e7d346b4cb0" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:23:58 user nova-compute[85141]: DEBUG nova.network.neutron [None req-92fa6448-77a5-4d6a-98eb-98ecef802693 tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] [instance: 5a507c85-0369-48ea-8858-3e7d346b4cb0] Instance cache missing network info. {{(pid=85141) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 10:23:58 user nova-compute[85141]: DEBUG nova.network.neutron [None req-92fa6448-77a5-4d6a-98eb-98ecef802693 tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] [instance: 5a507c85-0369-48ea-8858-3e7d346b4cb0] Updating instance_info_cache with network_info: [{"id": "47904c84-f39f-4d8e-9675-0d8a535e3799", "address": "fa:16:3e:a7:9b:4f", "network": {"id": "a75d923b-3849-49c0-ba13-f8b356efda8f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1113409976-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79e4ebd46b4243c09f88927532b610f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47904c84-f3", "ovs_interfaceid": "47904c84-f39f-4d8e-9675-0d8a535e3799", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:23:58 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-92fa6448-77a5-4d6a-98eb-98ecef802693 tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] Releasing lock "refresh_cache-5a507c85-0369-48ea-8858-3e7d346b4cb0" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:23:58 user nova-compute[85141]: DEBUG nova.compute.manager [None req-92fa6448-77a5-4d6a-98eb-98ecef802693 tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] [instance: 5a507c85-0369-48ea-8858-3e7d346b4cb0] Instance network_info: |[{"id": "47904c84-f39f-4d8e-9675-0d8a535e3799", "address": "fa:16:3e:a7:9b:4f", "network": {"id": "a75d923b-3849-49c0-ba13-f8b356efda8f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1113409976-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79e4ebd46b4243c09f88927532b610f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47904c84-f3", "ovs_interfaceid": "47904c84-f39f-4d8e-9675-0d8a535e3799", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=85141) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 10:23:58 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-8090fe66-0bc4-4bc7-bc67-7a9e8a4dbfa4 req-4cd43516-acb6-4110-8d8a-4470982ef3c9 service nova] Acquired lock "refresh_cache-5a507c85-0369-48ea-8858-3e7d346b4cb0" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:23:58 user nova-compute[85141]: DEBUG nova.network.neutron [req-8090fe66-0bc4-4bc7-bc67-7a9e8a4dbfa4 req-4cd43516-acb6-4110-8d8a-4470982ef3c9 service nova] [instance: 5a507c85-0369-48ea-8858-3e7d346b4cb0] Refreshing network info cache for port 47904c84-f39f-4d8e-9675-0d8a535e3799 {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 10:23:58 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-92fa6448-77a5-4d6a-98eb-98ecef802693 tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] [instance: 5a507c85-0369-48ea-8858-3e7d346b4cb0] Start _get_guest_xml network_info=[{"id": "47904c84-f39f-4d8e-9675-0d8a535e3799", "address": "fa:16:3e:a7:9b:4f", "network": {"id": "a75d923b-3849-49c0-ba13-f8b356efda8f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1113409976-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79e4ebd46b4243c09f88927532b610f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47904c84-f3", "ovs_interfaceid": "47904c84-f39f-4d8e-9675-0d8a535e3799", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T10:06:42Z,direct_url=<?>,disk_format='qcow2',id=bc4ca70f-a459-4d5c-a9e6-80f1948eb48b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1044631a5fe84ce8904864a7024049fa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T10:06:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_options': None, 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'image_id': 'bc4ca70f-a459-4d5c-a9e6-80f1948eb48b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=85141) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 10:23:58 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-92fa6448-77a5-4d6a-98eb-98ecef802693 tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:23:58 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-92fa6448-77a5-4d6a-98eb-98ecef802693 tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:23:58 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-92fa6448-77a5-4d6a-98eb-98ecef802693 tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=85141) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 10:23:58 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-92fa6448-77a5-4d6a-98eb-98ecef802693 tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] CPU controller missing on host. {{(pid=85141) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 10:23:58 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-92fa6448-77a5-4d6a-98eb-98ecef802693 tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=85141) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 10:23:58 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-92fa6448-77a5-4d6a-98eb-98ecef802693 tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] CPU controller found on host. {{(pid=85141) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 10:23:58 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-92fa6448-77a5-4d6a-98eb-98ecef802693 tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=85141) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 10:23:58 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-92fa6448-77a5-4d6a-98eb-98ecef802693 tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T10:06:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T10:06:42Z,direct_url=<?>,disk_format='qcow2',id=bc4ca70f-a459-4d5c-a9e6-80f1948eb48b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1044631a5fe84ce8904864a7024049fa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T10:06:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 10:23:58 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-92fa6448-77a5-4d6a-98eb-98ecef802693 tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] Flavor limits 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 10:23:58 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-92fa6448-77a5-4d6a-98eb-98ecef802693 tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] Image limits 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 10:23:58 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-92fa6448-77a5-4d6a-98eb-98ecef802693 tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] Flavor pref 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 10:23:58 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-92fa6448-77a5-4d6a-98eb-98ecef802693 tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] Image pref 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 10:23:58 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-92fa6448-77a5-4d6a-98eb-98ecef802693 tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 10:23:58 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-92fa6448-77a5-4d6a-98eb-98ecef802693 tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 10:23:58 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-92fa6448-77a5-4d6a-98eb-98ecef802693 tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=85141) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 10:23:58 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-92fa6448-77a5-4d6a-98eb-98ecef802693 tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] Got 1 possible topologies {{(pid=85141) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 10:23:58 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-92fa6448-77a5-4d6a-98eb-98ecef802693 tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 10:23:58 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-92fa6448-77a5-4d6a-98eb-98ecef802693 tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 10:23:59 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-92fa6448-77a5-4d6a-98eb-98ecef802693 tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T10:23:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-849506790',display_name='tempest-ServersNegativeTestJSON-server-849506790',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-849506790',id=31,image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='79e4ebd46b4243c09f88927532b610f0',ramdisk_id='',reservation_id='r-u0a4vcl3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1452286076',owner_user_name='tempest-ServersNegativeTestJSON-1452286076-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T10:23:58Z,user_data=None,user_id='a7b52c2f46234602ae4925447a7d39a0',uuid=5a507c85-0369-48ea-8858-3e7d346b4cb0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "47904c84-f39f-4d8e-9675-0d8a535e3799", "address": "fa:16:3e:a7:9b:4f", "network": {"id": "a75d923b-3849-49c0-ba13-f8b356efda8f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1113409976-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79e4ebd46b4243c09f88927532b610f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47904c84-f3", "ovs_interfaceid": "47904c84-f39f-4d8e-9675-0d8a535e3799", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=85141) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 10:23:59 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-92fa6448-77a5-4d6a-98eb-98ecef802693 tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] Converting VIF {"id": "47904c84-f39f-4d8e-9675-0d8a535e3799", "address": "fa:16:3e:a7:9b:4f", "network": {"id": "a75d923b-3849-49c0-ba13-f8b356efda8f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1113409976-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79e4ebd46b4243c09f88927532b610f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47904c84-f3", "ovs_interfaceid": "47904c84-f39f-4d8e-9675-0d8a535e3799", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:23:59 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-92fa6448-77a5-4d6a-98eb-98ecef802693 tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:9b:4f,bridge_name='br-int',has_traffic_filtering=True,id=47904c84-f39f-4d8e-9675-0d8a535e3799,network=Network(a75d923b-3849-49c0-ba13-f8b356efda8f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47904c84-f3') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:23:59 user nova-compute[85141]: DEBUG nova.objects.instance [None req-92fa6448-77a5-4d6a-98eb-98ecef802693 tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] Lazy-loading 'pci_devices' on Instance uuid 5a507c85-0369-48ea-8858-3e7d346b4cb0 {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:23:59 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-92fa6448-77a5-4d6a-98eb-98ecef802693 tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] [instance: 5a507c85-0369-48ea-8858-3e7d346b4cb0] End _get_guest_xml xml=<domain type="kvm">
Nov 16 10:23:59 user nova-compute[85141]:   <uuid>5a507c85-0369-48ea-8858-3e7d346b4cb0</uuid>
Nov 16 10:23:59 user nova-compute[85141]:   <name>instance-0000001f</name>
Nov 16 10:23:59 user nova-compute[85141]:   <memory>524288</memory>
Nov 16 10:23:59 user nova-compute[85141]:   <vcpu>1</vcpu>
Nov 16 10:23:59 user nova-compute[85141]:   <metadata>
Nov 16 10:23:59 user nova-compute[85141]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 10:23:59 user nova-compute[85141]:       <nova:package version="0.0.0"/>
Nov 16 10:23:59 user nova-compute[85141]:       <nova:name>tempest-ServersNegativeTestJSON-server-849506790</nova:name>
Nov 16 10:23:59 user nova-compute[85141]:       <nova:creationTime>2023-11-16 10:23:58</nova:creationTime>
Nov 16 10:23:59 user nova-compute[85141]:       <nova:flavor name="m1.tiny">
Nov 16 10:23:59 user nova-compute[85141]:         <nova:memory>512</nova:memory>
Nov 16 10:23:59 user nova-compute[85141]:         <nova:disk>1</nova:disk>
Nov 16 10:23:59 user nova-compute[85141]:         <nova:swap>0</nova:swap>
Nov 16 10:23:59 user nova-compute[85141]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 10:23:59 user nova-compute[85141]:         <nova:vcpus>1</nova:vcpus>
Nov 16 10:23:59 user nova-compute[85141]:       </nova:flavor>
Nov 16 10:23:59 user nova-compute[85141]:       <nova:owner>
Nov 16 10:23:59 user nova-compute[85141]:         <nova:user uuid="a7b52c2f46234602ae4925447a7d39a0">tempest-ServersNegativeTestJSON-1452286076-project-member</nova:user>
Nov 16 10:23:59 user nova-compute[85141]:         <nova:project uuid="79e4ebd46b4243c09f88927532b610f0">tempest-ServersNegativeTestJSON-1452286076</nova:project>
Nov 16 10:23:59 user nova-compute[85141]:       </nova:owner>
Nov 16 10:23:59 user nova-compute[85141]:       <nova:root type="image" uuid="bc4ca70f-a459-4d5c-a9e6-80f1948eb48b"/>
Nov 16 10:23:59 user nova-compute[85141]:       <nova:ports>
Nov 16 10:23:59 user nova-compute[85141]:         <nova:port uuid="47904c84-f39f-4d8e-9675-0d8a535e3799">
Nov 16 10:23:59 user nova-compute[85141]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 16 10:23:59 user nova-compute[85141]:         </nova:port>
Nov 16 10:23:59 user nova-compute[85141]:       </nova:ports>
Nov 16 10:23:59 user nova-compute[85141]:     </nova:instance>
Nov 16 10:23:59 user nova-compute[85141]:   </metadata>
Nov 16 10:23:59 user nova-compute[85141]:   <sysinfo type="smbios">
Nov 16 10:23:59 user nova-compute[85141]:     <system>
Nov 16 10:23:59 user nova-compute[85141]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 10:23:59 user nova-compute[85141]:       <entry name="product">OpenStack Nova</entry>
Nov 16 10:23:59 user nova-compute[85141]:       <entry name="version">0.0.0</entry>
Nov 16 10:23:59 user nova-compute[85141]:       <entry name="serial">5a507c85-0369-48ea-8858-3e7d346b4cb0</entry>
Nov 16 10:23:59 user nova-compute[85141]:       <entry name="uuid">5a507c85-0369-48ea-8858-3e7d346b4cb0</entry>
Nov 16 10:23:59 user nova-compute[85141]:       <entry name="family">Virtual Machine</entry>
Nov 16 10:23:59 user nova-compute[85141]:     </system>
Nov 16 10:23:59 user nova-compute[85141]:   </sysinfo>
Nov 16 10:23:59 user nova-compute[85141]:   <os>
Nov 16 10:23:59 user nova-compute[85141]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 10:23:59 user nova-compute[85141]:     <boot dev="hd"/>
Nov 16 10:23:59 user nova-compute[85141]:     <smbios mode="sysinfo"/>
Nov 16 10:23:59 user nova-compute[85141]:   </os>
Nov 16 10:23:59 user nova-compute[85141]:   <features>
Nov 16 10:23:59 user nova-compute[85141]:     <acpi/>
Nov 16 10:23:59 user nova-compute[85141]:     <apic/>
Nov 16 10:23:59 user nova-compute[85141]:     <vmcoreinfo/>
Nov 16 10:23:59 user nova-compute[85141]:   </features>
Nov 16 10:23:59 user nova-compute[85141]:   <clock offset="utc">
Nov 16 10:23:59 user nova-compute[85141]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 10:23:59 user nova-compute[85141]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 10:23:59 user nova-compute[85141]:     <timer name="hpet" present="no"/>
Nov 16 10:23:59 user nova-compute[85141]:   </clock>
Nov 16 10:23:59 user nova-compute[85141]:   <cpu mode="custom" match="exact">
Nov 16 10:23:59 user nova-compute[85141]:     <model>Nehalem</model>
Nov 16 10:23:59 user nova-compute[85141]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 10:23:59 user nova-compute[85141]:   </cpu>
Nov 16 10:23:59 user nova-compute[85141]:   <devices>
Nov 16 10:23:59 user nova-compute[85141]:     <disk type="file" device="disk">
Nov 16 10:23:59 user nova-compute[85141]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 10:23:59 user nova-compute[85141]:       <source file="/opt/stack/data/nova/instances/5a507c85-0369-48ea-8858-3e7d346b4cb0/disk"/>
Nov 16 10:23:59 user nova-compute[85141]:       <target dev="vda" bus="virtio"/>
Nov 16 10:23:59 user nova-compute[85141]:     </disk>
Nov 16 10:23:59 user nova-compute[85141]:     <interface type="ethernet">
Nov 16 10:23:59 user nova-compute[85141]:       <mac address="fa:16:3e:a7:9b:4f"/>
Nov 16 10:23:59 user nova-compute[85141]:       <model type="virtio"/>
Nov 16 10:23:59 user nova-compute[85141]:       <mtu size="1442"/>
Nov 16 10:23:59 user nova-compute[85141]:       <target dev="tap47904c84-f3"/>
Nov 16 10:23:59 user nova-compute[85141]:     </interface>
Nov 16 10:23:59 user nova-compute[85141]:     <serial type="pty">
Nov 16 10:23:59 user nova-compute[85141]:       <log file="/opt/stack/data/nova/instances/5a507c85-0369-48ea-8858-3e7d346b4cb0/console.log" append="off"/>
Nov 16 10:23:59 user nova-compute[85141]:     </serial>
Nov 16 10:23:59 user nova-compute[85141]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 10:23:59 user nova-compute[85141]:     <video>
Nov 16 10:23:59 user nova-compute[85141]:       <model type="virtio"/>
Nov 16 10:23:59 user nova-compute[85141]:     </video>
Nov 16 10:23:59 user nova-compute[85141]:     <rng model="virtio">
Nov 16 10:23:59 user nova-compute[85141]:       <backend model="random">/dev/urandom</backend>
Nov 16 10:23:59 user nova-compute[85141]:     </rng>
Nov 16 10:23:59 user nova-compute[85141]:     <controller type="usb" index="0" model="none"/>
Nov 16 10:23:59 user nova-compute[85141]:     <memballoon model="virtio">
Nov 16 10:23:59 user nova-compute[85141]:       <stats period="10"/>
Nov 16 10:23:59 user nova-compute[85141]:     </memballoon>
Nov 16 10:23:59 user nova-compute[85141]:   </devices>
Nov 16 10:23:59 user nova-compute[85141]: </domain>
Nov 16 10:23:59 user nova-compute[85141]:  {{(pid=85141) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 10:23:59 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-92fa6448-77a5-4d6a-98eb-98ecef802693 tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T10:23:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-849506790',display_name='tempest-ServersNegativeTestJSON-server-849506790',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-849506790',id=31,image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='79e4ebd46b4243c09f88927532b610f0',ramdisk_id='',reservation_id='r-u0a4vcl3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1452286076',owner_user_name='tempest-ServersNegativeTestJSON-1452286076-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T10:23:58Z,user_data=None,user_id='a7b52c2f46234602ae4925447a7d39a0',uuid=5a507c85-0369-48ea-8858-3e7d346b4cb0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "47904c84-f39f-4d8e-9675-0d8a535e3799", "address": "fa:16:3e:a7:9b:4f", "network": {"id": "a75d923b-3849-49c0-ba13-f8b356efda8f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1113409976-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79e4ebd46b4243c09f88927532b610f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47904c84-f3", "ovs_interfaceid": "47904c84-f39f-4d8e-9675-0d8a535e3799", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 10:23:59 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-92fa6448-77a5-4d6a-98eb-98ecef802693 tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] Converting VIF {"id": "47904c84-f39f-4d8e-9675-0d8a535e3799", "address": "fa:16:3e:a7:9b:4f", "network": {"id": "a75d923b-3849-49c0-ba13-f8b356efda8f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1113409976-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79e4ebd46b4243c09f88927532b610f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47904c84-f3", "ovs_interfaceid": "47904c84-f39f-4d8e-9675-0d8a535e3799", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:23:59 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-92fa6448-77a5-4d6a-98eb-98ecef802693 tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:9b:4f,bridge_name='br-int',has_traffic_filtering=True,id=47904c84-f39f-4d8e-9675-0d8a535e3799,network=Network(a75d923b-3849-49c0-ba13-f8b356efda8f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47904c84-f3') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:23:59 user nova-compute[85141]: DEBUG os_vif [None req-92fa6448-77a5-4d6a-98eb-98ecef802693 tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:9b:4f,bridge_name='br-int',has_traffic_filtering=True,id=47904c84-f39f-4d8e-9675-0d8a535e3799,network=Network(a75d923b-3849-49c0-ba13-f8b356efda8f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47904c84-f3') {{(pid=85141) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 10:23:59 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:23:59 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:23:59 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 10:23:59 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:23:59 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6d302c44-072f-58ca-9d4e-54f3bbf2b958', '_type': 'linux-noop'}}, row=False) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:23:59 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:23:59 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:23:59 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:23:59 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:23:59 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap47904c84-f3, may_exist=True, interface_attrs={}) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:23:59 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap47904c84-f3, col_values=(('qos', UUID('ba0c7d05-f753-4586-a4ff-84a0886b76ab')),), if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:23:59 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap47904c84-f3, col_values=(('external_ids', {'iface-id': '47904c84-f39f-4d8e-9675-0d8a535e3799', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a7:9b:4f', 'vm-uuid': '5a507c85-0369-48ea-8858-3e7d346b4cb0'}),), if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:23:59 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:23:59 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:23:59 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:23:59 user nova-compute[85141]: INFO os_vif [None req-92fa6448-77a5-4d6a-98eb-98ecef802693 tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:9b:4f,bridge_name='br-int',has_traffic_filtering=True,id=47904c84-f39f-4d8e-9675-0d8a535e3799,network=Network(a75d923b-3849-49c0-ba13-f8b356efda8f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47904c84-f3')
Nov 16 10:23:59 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-92fa6448-77a5-4d6a-98eb-98ecef802693 tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] No BDM found with device name vda, not building metadata. {{(pid=85141) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 10:23:59 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-92fa6448-77a5-4d6a-98eb-98ecef802693 tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] No VIF found with MAC fa:16:3e:a7:9b:4f, not building metadata {{(pid=85141) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 10:23:59 user nova-compute[85141]: DEBUG nova.network.neutron [req-8090fe66-0bc4-4bc7-bc67-7a9e8a4dbfa4 req-4cd43516-acb6-4110-8d8a-4470982ef3c9 service nova] [instance: 5a507c85-0369-48ea-8858-3e7d346b4cb0] Updated VIF entry in instance network info cache for port 47904c84-f39f-4d8e-9675-0d8a535e3799. {{(pid=85141) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 10:23:59 user nova-compute[85141]: DEBUG nova.network.neutron [req-8090fe66-0bc4-4bc7-bc67-7a9e8a4dbfa4 req-4cd43516-acb6-4110-8d8a-4470982ef3c9 service nova] [instance: 5a507c85-0369-48ea-8858-3e7d346b4cb0] Updating instance_info_cache with network_info: [{"id": "47904c84-f39f-4d8e-9675-0d8a535e3799", "address": "fa:16:3e:a7:9b:4f", "network": {"id": "a75d923b-3849-49c0-ba13-f8b356efda8f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1113409976-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79e4ebd46b4243c09f88927532b610f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47904c84-f3", "ovs_interfaceid": "47904c84-f39f-4d8e-9675-0d8a535e3799", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:23:59 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-8090fe66-0bc4-4bc7-bc67-7a9e8a4dbfa4 req-4cd43516-acb6-4110-8d8a-4470982ef3c9 service nova] Releasing lock "refresh_cache-5a507c85-0369-48ea-8858-3e7d346b4cb0" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:24:00 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:24:00 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:24:00 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:24:00 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:24:00 user nova-compute[85141]: DEBUG nova.compute.manager [req-b5796567-153a-4822-9b1e-b5d16557f28d req-8ca2fe9b-e02c-40c4-b51f-83cb0dfd47f5 service nova] [instance: 5a507c85-0369-48ea-8858-3e7d346b4cb0] Received event network-vif-plugged-47904c84-f39f-4d8e-9675-0d8a535e3799 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:24:00 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-b5796567-153a-4822-9b1e-b5d16557f28d req-8ca2fe9b-e02c-40c4-b51f-83cb0dfd47f5 service nova] Acquiring lock "5a507c85-0369-48ea-8858-3e7d346b4cb0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:24:00 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-b5796567-153a-4822-9b1e-b5d16557f28d req-8ca2fe9b-e02c-40c4-b51f-83cb0dfd47f5 service nova] Lock "5a507c85-0369-48ea-8858-3e7d346b4cb0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:24:00 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-b5796567-153a-4822-9b1e-b5d16557f28d req-8ca2fe9b-e02c-40c4-b51f-83cb0dfd47f5 service nova] Lock "5a507c85-0369-48ea-8858-3e7d346b4cb0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:24:00 user nova-compute[85141]: DEBUG nova.compute.manager [req-b5796567-153a-4822-9b1e-b5d16557f28d req-8ca2fe9b-e02c-40c4-b51f-83cb0dfd47f5 service nova] [instance: 5a507c85-0369-48ea-8858-3e7d346b4cb0] No waiting events found dispatching network-vif-plugged-47904c84-f39f-4d8e-9675-0d8a535e3799 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:24:00 user nova-compute[85141]: WARNING nova.compute.manager [req-b5796567-153a-4822-9b1e-b5d16557f28d req-8ca2fe9b-e02c-40c4-b51f-83cb0dfd47f5 service nova] [instance: 5a507c85-0369-48ea-8858-3e7d346b4cb0] Received unexpected event network-vif-plugged-47904c84-f39f-4d8e-9675-0d8a535e3799 for instance with vm_state building and task_state spawning.
Nov 16 10:24:01 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:24:01 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:24:01 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:24:01 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:24:01 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:24:02 user nova-compute[85141]: DEBUG nova.compute.manager [None req-92fa6448-77a5-4d6a-98eb-98ecef802693 tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] [instance: 5a507c85-0369-48ea-8858-3e7d346b4cb0] Instance event wait completed in 0 seconds for  {{(pid=85141) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 10:24:02 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-92fa6448-77a5-4d6a-98eb-98ecef802693 tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] [instance: 5a507c85-0369-48ea-8858-3e7d346b4cb0] Guest created on hypervisor {{(pid=85141) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 10:24:02 user nova-compute[85141]: INFO nova.virt.libvirt.driver [-] [instance: 5a507c85-0369-48ea-8858-3e7d346b4cb0] Instance spawned successfully.
Nov 16 10:24:02 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-92fa6448-77a5-4d6a-98eb-98ecef802693 tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] [instance: 5a507c85-0369-48ea-8858-3e7d346b4cb0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 10:24:02 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-92fa6448-77a5-4d6a-98eb-98ecef802693 tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] [instance: 5a507c85-0369-48ea-8858-3e7d346b4cb0] Found default for hw_cdrom_bus of ide {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:24:02 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-92fa6448-77a5-4d6a-98eb-98ecef802693 tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] [instance: 5a507c85-0369-48ea-8858-3e7d346b4cb0] Found default for hw_disk_bus of virtio {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:24:02 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-92fa6448-77a5-4d6a-98eb-98ecef802693 tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] [instance: 5a507c85-0369-48ea-8858-3e7d346b4cb0] Found default for hw_input_bus of None {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:24:02 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-92fa6448-77a5-4d6a-98eb-98ecef802693 tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] [instance: 5a507c85-0369-48ea-8858-3e7d346b4cb0] Found default for hw_pointer_model of None {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:24:02 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-92fa6448-77a5-4d6a-98eb-98ecef802693 tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] [instance: 5a507c85-0369-48ea-8858-3e7d346b4cb0] Found default for hw_video_model of virtio {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:24:02 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-92fa6448-77a5-4d6a-98eb-98ecef802693 tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] [instance: 5a507c85-0369-48ea-8858-3e7d346b4cb0] Found default for hw_vif_model of virtio {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:24:02 user nova-compute[85141]: INFO nova.compute.manager [None req-92fa6448-77a5-4d6a-98eb-98ecef802693 tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] [instance: 5a507c85-0369-48ea-8858-3e7d346b4cb0] Took 5.09 seconds to spawn the instance on the hypervisor.
Nov 16 10:24:02 user nova-compute[85141]: DEBUG nova.compute.manager [None req-92fa6448-77a5-4d6a-98eb-98ecef802693 tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] [instance: 5a507c85-0369-48ea-8858-3e7d346b4cb0] Checking state {{(pid=85141) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 10:24:02 user nova-compute[85141]: DEBUG nova.compute.manager [req-563b765b-47eb-4b94-b447-06c37965e636 req-0f203a72-cce3-415c-8999-7154a0613161 service nova] [instance: 5a507c85-0369-48ea-8858-3e7d346b4cb0] Received event network-vif-plugged-47904c84-f39f-4d8e-9675-0d8a535e3799 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:24:02 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-563b765b-47eb-4b94-b447-06c37965e636 req-0f203a72-cce3-415c-8999-7154a0613161 service nova] Acquiring lock "5a507c85-0369-48ea-8858-3e7d346b4cb0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:24:02 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-563b765b-47eb-4b94-b447-06c37965e636 req-0f203a72-cce3-415c-8999-7154a0613161 service nova] Lock "5a507c85-0369-48ea-8858-3e7d346b4cb0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:24:02 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-563b765b-47eb-4b94-b447-06c37965e636 req-0f203a72-cce3-415c-8999-7154a0613161 service nova] Lock "5a507c85-0369-48ea-8858-3e7d346b4cb0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:24:02 user nova-compute[85141]: DEBUG nova.compute.manager [req-563b765b-47eb-4b94-b447-06c37965e636 req-0f203a72-cce3-415c-8999-7154a0613161 service nova] [instance: 5a507c85-0369-48ea-8858-3e7d346b4cb0] No waiting events found dispatching network-vif-plugged-47904c84-f39f-4d8e-9675-0d8a535e3799 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:24:02 user nova-compute[85141]: WARNING nova.compute.manager [req-563b765b-47eb-4b94-b447-06c37965e636 req-0f203a72-cce3-415c-8999-7154a0613161 service nova] [instance: 5a507c85-0369-48ea-8858-3e7d346b4cb0] Received unexpected event network-vif-plugged-47904c84-f39f-4d8e-9675-0d8a535e3799 for instance with vm_state building and task_state spawning.
Nov 16 10:24:02 user nova-compute[85141]: INFO nova.compute.manager [None req-92fa6448-77a5-4d6a-98eb-98ecef802693 tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] [instance: 5a507c85-0369-48ea-8858-3e7d346b4cb0] Took 5.83 seconds to build instance.
Nov 16 10:24:02 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:24:02 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-92fa6448-77a5-4d6a-98eb-98ecef802693 tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] Lock "5a507c85-0369-48ea-8858-3e7d346b4cb0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.928s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:24:04 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:24:07 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:24:09 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:24:12 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-4e85357a-7c94-4095-8fbb-792999bdb97b tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Acquiring lock "d7dfe34a-f7ba-44b3-8898-634338161a23" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:24:12 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-4e85357a-7c94-4095-8fbb-792999bdb97b tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Lock "d7dfe34a-f7ba-44b3-8898-634338161a23" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:24:12 user nova-compute[85141]: DEBUG nova.compute.manager [None req-4e85357a-7c94-4095-8fbb-792999bdb97b tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] [instance: d7dfe34a-f7ba-44b3-8898-634338161a23] Starting instance... {{(pid=85141) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 10:24:12 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-4e85357a-7c94-4095-8fbb-792999bdb97b tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:24:12 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-4e85357a-7c94-4095-8fbb-792999bdb97b tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:24:12 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-4e85357a-7c94-4095-8fbb-792999bdb97b tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=85141) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 10:24:12 user nova-compute[85141]: INFO nova.compute.claims [None req-4e85357a-7c94-4095-8fbb-792999bdb97b tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] [instance: d7dfe34a-f7ba-44b3-8898-634338161a23] Claim successful on node user
Nov 16 10:24:12 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:24:13 user nova-compute[85141]: DEBUG nova.compute.provider_tree [None req-4e85357a-7c94-4095-8fbb-792999bdb97b tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Inventory has not changed in ProviderTree for provider: bf8e0fa1-16b6-408f-9203-c4cd63916272 {{(pid=85141) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 10:24:13 user nova-compute[85141]: DEBUG nova.scheduler.client.report [None req-4e85357a-7c94-4095-8fbb-792999bdb97b tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Inventory has not changed for provider bf8e0fa1-16b6-408f-9203-c4cd63916272 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=85141) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 10:24:13 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-4e85357a-7c94-4095-8fbb-792999bdb97b tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.755s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:24:13 user nova-compute[85141]: DEBUG nova.compute.manager [None req-4e85357a-7c94-4095-8fbb-792999bdb97b tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] [instance: d7dfe34a-f7ba-44b3-8898-634338161a23] Start building networks asynchronously for instance. {{(pid=85141) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 10:24:13 user nova-compute[85141]: DEBUG nova.compute.manager [None req-4e85357a-7c94-4095-8fbb-792999bdb97b tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] [instance: d7dfe34a-f7ba-44b3-8898-634338161a23] Allocating IP information in the background. {{(pid=85141) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 10:24:13 user nova-compute[85141]: DEBUG nova.network.neutron [None req-4e85357a-7c94-4095-8fbb-792999bdb97b tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] [instance: d7dfe34a-f7ba-44b3-8898-634338161a23] allocate_for_instance() {{(pid=85141) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 10:24:13 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-4e85357a-7c94-4095-8fbb-792999bdb97b tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] [instance: d7dfe34a-f7ba-44b3-8898-634338161a23] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 10:24:13 user nova-compute[85141]: DEBUG nova.compute.manager [None req-4e85357a-7c94-4095-8fbb-792999bdb97b tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] [instance: d7dfe34a-f7ba-44b3-8898-634338161a23] Start building block device mappings for instance. {{(pid=85141) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 10:24:13 user nova-compute[85141]: DEBUG nova.policy [None req-4e85357a-7c94-4095-8fbb-792999bdb97b tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'eb874e8c071f4305a1de443f23f5df95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a0984b7ef0346768c3231b9ab00fb57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85141) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 10:24:13 user nova-compute[85141]: DEBUG nova.compute.manager [None req-4e85357a-7c94-4095-8fbb-792999bdb97b tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] [instance: d7dfe34a-f7ba-44b3-8898-634338161a23] Start spawning the instance on the hypervisor. {{(pid=85141) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 10:24:13 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-4e85357a-7c94-4095-8fbb-792999bdb97b tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] [instance: d7dfe34a-f7ba-44b3-8898-634338161a23] Creating instance directory {{(pid=85141) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 10:24:13 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-4e85357a-7c94-4095-8fbb-792999bdb97b tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] [instance: d7dfe34a-f7ba-44b3-8898-634338161a23] Creating image(s)
Nov 16 10:24:13 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-4e85357a-7c94-4095-8fbb-792999bdb97b tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Acquiring lock "/opt/stack/data/nova/instances/d7dfe34a-f7ba-44b3-8898-634338161a23/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:24:13 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-4e85357a-7c94-4095-8fbb-792999bdb97b tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Lock "/opt/stack/data/nova/instances/d7dfe34a-f7ba-44b3-8898-634338161a23/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:24:13 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-4e85357a-7c94-4095-8fbb-792999bdb97b tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Lock "/opt/stack/data/nova/instances/d7dfe34a-f7ba-44b3-8898-634338161a23/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:24:13 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-4e85357a-7c94-4095-8fbb-792999bdb97b tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:24:14 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:24:14 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-4e85357a-7c94-4095-8fbb-792999bdb97b tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json" returned: 0 in 0.203s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:24:14 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-4e85357a-7c94-4095-8fbb-792999bdb97b tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Acquiring lock "60a78556fb399ed4a41bc3ca4bccf77c96d8e811" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:24:14 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-4e85357a-7c94-4095-8fbb-792999bdb97b tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Lock "60a78556fb399ed4a41bc3ca4bccf77c96d8e811" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:24:14 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-4e85357a-7c94-4095-8fbb-792999bdb97b tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:24:14 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-4e85357a-7c94-4095-8fbb-792999bdb97b tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json" returned: 0 in 0.189s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:24:14 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-4e85357a-7c94-4095-8fbb-792999bdb97b tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811,backing_fmt=raw /opt/stack/data/nova/instances/d7dfe34a-f7ba-44b3-8898-634338161a23/disk 1073741824 {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:24:14 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-4e85357a-7c94-4095-8fbb-792999bdb97b tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811,backing_fmt=raw /opt/stack/data/nova/instances/d7dfe34a-f7ba-44b3-8898-634338161a23/disk 1073741824" returned: 0 in 0.049s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:24:14 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-4e85357a-7c94-4095-8fbb-792999bdb97b tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Lock "60a78556fb399ed4a41bc3ca4bccf77c96d8e811" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.247s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:24:14 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-4e85357a-7c94-4095-8fbb-792999bdb97b tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:24:14 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-4e85357a-7c94-4095-8fbb-792999bdb97b tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json" returned: 0 in 0.194s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:24:14 user nova-compute[85141]: DEBUG nova.virt.disk.api [None req-4e85357a-7c94-4095-8fbb-792999bdb97b tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d7dfe34a-f7ba-44b3-8898-634338161a23/disk. size=1073741824 {{(pid=85141) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 10:24:14 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-4e85357a-7c94-4095-8fbb-792999bdb97b tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7dfe34a-f7ba-44b3-8898-634338161a23/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:24:14 user nova-compute[85141]: DEBUG nova.network.neutron [None req-4e85357a-7c94-4095-8fbb-792999bdb97b tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] [instance: d7dfe34a-f7ba-44b3-8898-634338161a23] Successfully created port: 401df940-fd58-48b0-89f4-5083130952d5 {{(pid=85141) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 10:24:14 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-4e85357a-7c94-4095-8fbb-792999bdb97b tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7dfe34a-f7ba-44b3-8898-634338161a23/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:24:14 user nova-compute[85141]: DEBUG nova.virt.disk.api [None req-4e85357a-7c94-4095-8fbb-792999bdb97b tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Cannot resize image /opt/stack/data/nova/instances/d7dfe34a-f7ba-44b3-8898-634338161a23/disk to a smaller size. {{(pid=85141) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 10:24:14 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-4e85357a-7c94-4095-8fbb-792999bdb97b tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] [instance: d7dfe34a-f7ba-44b3-8898-634338161a23] Created local disks {{(pid=85141) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 10:24:14 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-4e85357a-7c94-4095-8fbb-792999bdb97b tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] [instance: d7dfe34a-f7ba-44b3-8898-634338161a23] Ensure instance console log exists: /opt/stack/data/nova/instances/d7dfe34a-f7ba-44b3-8898-634338161a23/console.log {{(pid=85141) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 10:24:14 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-4e85357a-7c94-4095-8fbb-792999bdb97b tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:24:14 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-4e85357a-7c94-4095-8fbb-792999bdb97b tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:24:14 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-4e85357a-7c94-4095-8fbb-792999bdb97b tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:24:14 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:24:15 user nova-compute[85141]: DEBUG nova.network.neutron [None req-4e85357a-7c94-4095-8fbb-792999bdb97b tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] [instance: d7dfe34a-f7ba-44b3-8898-634338161a23] Successfully updated port: 401df940-fd58-48b0-89f4-5083130952d5 {{(pid=85141) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 10:24:15 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-4e85357a-7c94-4095-8fbb-792999bdb97b tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Acquiring lock "refresh_cache-d7dfe34a-f7ba-44b3-8898-634338161a23" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:24:15 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-4e85357a-7c94-4095-8fbb-792999bdb97b tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Acquired lock "refresh_cache-d7dfe34a-f7ba-44b3-8898-634338161a23" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:24:15 user nova-compute[85141]: DEBUG nova.network.neutron [None req-4e85357a-7c94-4095-8fbb-792999bdb97b tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] [instance: d7dfe34a-f7ba-44b3-8898-634338161a23] Building network info cache for instance {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 10:24:15 user nova-compute[85141]: DEBUG nova.compute.manager [req-0dc979fc-a740-4921-b0f2-f89c520bba57 req-f9f052b2-fc99-4ae4-bd84-9916e0f82fd4 service nova] [instance: d7dfe34a-f7ba-44b3-8898-634338161a23] Received event network-changed-401df940-fd58-48b0-89f4-5083130952d5 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:24:15 user nova-compute[85141]: DEBUG nova.compute.manager [req-0dc979fc-a740-4921-b0f2-f89c520bba57 req-f9f052b2-fc99-4ae4-bd84-9916e0f82fd4 service nova] [instance: d7dfe34a-f7ba-44b3-8898-634338161a23] Refreshing instance network info cache due to event network-changed-401df940-fd58-48b0-89f4-5083130952d5. {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 10:24:15 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-0dc979fc-a740-4921-b0f2-f89c520bba57 req-f9f052b2-fc99-4ae4-bd84-9916e0f82fd4 service nova] Acquiring lock "refresh_cache-d7dfe34a-f7ba-44b3-8898-634338161a23" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:24:15 user nova-compute[85141]: DEBUG nova.network.neutron [None req-4e85357a-7c94-4095-8fbb-792999bdb97b tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] [instance: d7dfe34a-f7ba-44b3-8898-634338161a23] Instance cache missing network info. {{(pid=85141) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 10:24:15 user nova-compute[85141]: DEBUG nova.network.neutron [None req-4e85357a-7c94-4095-8fbb-792999bdb97b tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] [instance: d7dfe34a-f7ba-44b3-8898-634338161a23] Updating instance_info_cache with network_info: [{"id": "401df940-fd58-48b0-89f4-5083130952d5", "address": "fa:16:3e:1e:59:2e", "network": {"id": "d791d4f1-ec4b-4db3-ae9a-471f071206eb", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-369109742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a0984b7ef0346768c3231b9ab00fb57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap401df940-fd", "ovs_interfaceid": "401df940-fd58-48b0-89f4-5083130952d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:24:15 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-4e85357a-7c94-4095-8fbb-792999bdb97b tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Releasing lock "refresh_cache-d7dfe34a-f7ba-44b3-8898-634338161a23" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:24:15 user nova-compute[85141]: DEBUG nova.compute.manager [None req-4e85357a-7c94-4095-8fbb-792999bdb97b tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] [instance: d7dfe34a-f7ba-44b3-8898-634338161a23] Instance network_info: |[{"id": "401df940-fd58-48b0-89f4-5083130952d5", "address": "fa:16:3e:1e:59:2e", "network": {"id": "d791d4f1-ec4b-4db3-ae9a-471f071206eb", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-369109742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a0984b7ef0346768c3231b9ab00fb57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap401df940-fd", "ovs_interfaceid": "401df940-fd58-48b0-89f4-5083130952d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=85141) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 10:24:15 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-0dc979fc-a740-4921-b0f2-f89c520bba57 req-f9f052b2-fc99-4ae4-bd84-9916e0f82fd4 service nova] Acquired lock "refresh_cache-d7dfe34a-f7ba-44b3-8898-634338161a23" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:24:15 user nova-compute[85141]: DEBUG nova.network.neutron [req-0dc979fc-a740-4921-b0f2-f89c520bba57 req-f9f052b2-fc99-4ae4-bd84-9916e0f82fd4 service nova] [instance: d7dfe34a-f7ba-44b3-8898-634338161a23] Refreshing network info cache for port 401df940-fd58-48b0-89f4-5083130952d5 {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 10:24:15 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-4e85357a-7c94-4095-8fbb-792999bdb97b tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] [instance: d7dfe34a-f7ba-44b3-8898-634338161a23] Start _get_guest_xml network_info=[{"id": "401df940-fd58-48b0-89f4-5083130952d5", "address": "fa:16:3e:1e:59:2e", "network": {"id": "d791d4f1-ec4b-4db3-ae9a-471f071206eb", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-369109742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a0984b7ef0346768c3231b9ab00fb57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap401df940-fd", "ovs_interfaceid": "401df940-fd58-48b0-89f4-5083130952d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T10:06:42Z,direct_url=<?>,disk_format='qcow2',id=bc4ca70f-a459-4d5c-a9e6-80f1948eb48b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1044631a5fe84ce8904864a7024049fa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T10:06:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_options': None, 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'image_id': 'bc4ca70f-a459-4d5c-a9e6-80f1948eb48b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=85141) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 10:24:15 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-4e85357a-7c94-4095-8fbb-792999bdb97b tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:24:15 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-4e85357a-7c94-4095-8fbb-792999bdb97b tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:24:15 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-4e85357a-7c94-4095-8fbb-792999bdb97b tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=85141) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 10:24:15 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-4e85357a-7c94-4095-8fbb-792999bdb97b tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] CPU controller missing on host. {{(pid=85141) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 10:24:15 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-4e85357a-7c94-4095-8fbb-792999bdb97b tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=85141) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 10:24:15 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-4e85357a-7c94-4095-8fbb-792999bdb97b tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] CPU controller found on host. {{(pid=85141) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 10:24:15 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-4e85357a-7c94-4095-8fbb-792999bdb97b tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=85141) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 10:24:15 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-4e85357a-7c94-4095-8fbb-792999bdb97b tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T10:06:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T10:06:42Z,direct_url=<?>,disk_format='qcow2',id=bc4ca70f-a459-4d5c-a9e6-80f1948eb48b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1044631a5fe84ce8904864a7024049fa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T10:06:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 10:24:15 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-4e85357a-7c94-4095-8fbb-792999bdb97b tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Flavor limits 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 10:24:15 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-4e85357a-7c94-4095-8fbb-792999bdb97b tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Image limits 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 10:24:15 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-4e85357a-7c94-4095-8fbb-792999bdb97b tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Flavor pref 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 10:24:15 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-4e85357a-7c94-4095-8fbb-792999bdb97b tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Image pref 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 10:24:15 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-4e85357a-7c94-4095-8fbb-792999bdb97b tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 10:24:15 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-4e85357a-7c94-4095-8fbb-792999bdb97b tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 10:24:15 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-4e85357a-7c94-4095-8fbb-792999bdb97b tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=85141) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 10:24:15 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-4e85357a-7c94-4095-8fbb-792999bdb97b tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Got 1 possible topologies {{(pid=85141) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 10:24:15 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-4e85357a-7c94-4095-8fbb-792999bdb97b tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 10:24:15 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-4e85357a-7c94-4095-8fbb-792999bdb97b tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 10:24:15 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-4e85357a-7c94-4095-8fbb-792999bdb97b tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T10:24:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-454057559',display_name='tempest-VolumesSnapshotTestJSON-instance-454057559',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-454057559',id=32,image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFvceMg7UP8xvNyrSavrKskF+lFeWK8f4QMgCeiS7/XawkQcsVT/zpfrUPenlNfCnn9QfeCu6Id4NfS6DcdUpYgQ4mMn7IU9vasremdvX6QkF0SCshLi30D3X/getVQb8Q==',key_name='tempest-keypair-36388301',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6a0984b7ef0346768c3231b9ab00fb57',ramdisk_id='',reservation_id='r-3z9vidhl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-790088929',owner_user_name='tempest-VolumesSnapshotTestJSON-790088929-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T10:24:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eb874e8c071f4305a1de443f23f5df95',uuid=d7dfe34a-f7ba-44b3-8898-634338161a23,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "401df940-fd58-48b0-89f4-5083130952d5", "address": "fa:16:3e:1e:59:2e", "network": {"id": "d791d4f1-ec4b-4db3-ae9a-471f071206eb", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-369109742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a0984b7ef0346768c3231b9ab00fb57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap401df940-fd", "ovs_interfaceid": "401df940-fd58-48b0-89f4-5083130952d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=85141) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 10:24:15 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-4e85357a-7c94-4095-8fbb-792999bdb97b tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Converting VIF {"id": "401df940-fd58-48b0-89f4-5083130952d5", "address": "fa:16:3e:1e:59:2e", "network": {"id": "d791d4f1-ec4b-4db3-ae9a-471f071206eb", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-369109742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a0984b7ef0346768c3231b9ab00fb57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap401df940-fd", "ovs_interfaceid": "401df940-fd58-48b0-89f4-5083130952d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:24:15 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-4e85357a-7c94-4095-8fbb-792999bdb97b tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1e:59:2e,bridge_name='br-int',has_traffic_filtering=True,id=401df940-fd58-48b0-89f4-5083130952d5,network=Network(d791d4f1-ec4b-4db3-ae9a-471f071206eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap401df940-fd') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:24:15 user nova-compute[85141]: DEBUG nova.objects.instance [None req-4e85357a-7c94-4095-8fbb-792999bdb97b tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Lazy-loading 'pci_devices' on Instance uuid d7dfe34a-f7ba-44b3-8898-634338161a23 {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:24:15 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-4e85357a-7c94-4095-8fbb-792999bdb97b tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] [instance: d7dfe34a-f7ba-44b3-8898-634338161a23] End _get_guest_xml xml=<domain type="kvm">
Nov 16 10:24:15 user nova-compute[85141]:   <uuid>d7dfe34a-f7ba-44b3-8898-634338161a23</uuid>
Nov 16 10:24:15 user nova-compute[85141]:   <name>instance-00000020</name>
Nov 16 10:24:15 user nova-compute[85141]:   <memory>524288</memory>
Nov 16 10:24:15 user nova-compute[85141]:   <vcpu>1</vcpu>
Nov 16 10:24:15 user nova-compute[85141]:   <metadata>
Nov 16 10:24:15 user nova-compute[85141]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 10:24:15 user nova-compute[85141]:       <nova:package version="0.0.0"/>
Nov 16 10:24:15 user nova-compute[85141]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-454057559</nova:name>
Nov 16 10:24:15 user nova-compute[85141]:       <nova:creationTime>2023-11-16 10:24:15</nova:creationTime>
Nov 16 10:24:15 user nova-compute[85141]:       <nova:flavor name="m1.tiny">
Nov 16 10:24:15 user nova-compute[85141]:         <nova:memory>512</nova:memory>
Nov 16 10:24:15 user nova-compute[85141]:         <nova:disk>1</nova:disk>
Nov 16 10:24:15 user nova-compute[85141]:         <nova:swap>0</nova:swap>
Nov 16 10:24:15 user nova-compute[85141]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 10:24:15 user nova-compute[85141]:         <nova:vcpus>1</nova:vcpus>
Nov 16 10:24:15 user nova-compute[85141]:       </nova:flavor>
Nov 16 10:24:15 user nova-compute[85141]:       <nova:owner>
Nov 16 10:24:15 user nova-compute[85141]:         <nova:user uuid="eb874e8c071f4305a1de443f23f5df95">tempest-VolumesSnapshotTestJSON-790088929-project-member</nova:user>
Nov 16 10:24:15 user nova-compute[85141]:         <nova:project uuid="6a0984b7ef0346768c3231b9ab00fb57">tempest-VolumesSnapshotTestJSON-790088929</nova:project>
Nov 16 10:24:15 user nova-compute[85141]:       </nova:owner>
Nov 16 10:24:15 user nova-compute[85141]:       <nova:root type="image" uuid="bc4ca70f-a459-4d5c-a9e6-80f1948eb48b"/>
Nov 16 10:24:15 user nova-compute[85141]:       <nova:ports>
Nov 16 10:24:15 user nova-compute[85141]:         <nova:port uuid="401df940-fd58-48b0-89f4-5083130952d5">
Nov 16 10:24:15 user nova-compute[85141]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 16 10:24:15 user nova-compute[85141]:         </nova:port>
Nov 16 10:24:15 user nova-compute[85141]:       </nova:ports>
Nov 16 10:24:15 user nova-compute[85141]:     </nova:instance>
Nov 16 10:24:15 user nova-compute[85141]:   </metadata>
Nov 16 10:24:15 user nova-compute[85141]:   <sysinfo type="smbios">
Nov 16 10:24:15 user nova-compute[85141]:     <system>
Nov 16 10:24:15 user nova-compute[85141]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 10:24:15 user nova-compute[85141]:       <entry name="product">OpenStack Nova</entry>
Nov 16 10:24:15 user nova-compute[85141]:       <entry name="version">0.0.0</entry>
Nov 16 10:24:15 user nova-compute[85141]:       <entry name="serial">d7dfe34a-f7ba-44b3-8898-634338161a23</entry>
Nov 16 10:24:15 user nova-compute[85141]:       <entry name="uuid">d7dfe34a-f7ba-44b3-8898-634338161a23</entry>
Nov 16 10:24:15 user nova-compute[85141]:       <entry name="family">Virtual Machine</entry>
Nov 16 10:24:15 user nova-compute[85141]:     </system>
Nov 16 10:24:15 user nova-compute[85141]:   </sysinfo>
Nov 16 10:24:15 user nova-compute[85141]:   <os>
Nov 16 10:24:15 user nova-compute[85141]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 10:24:15 user nova-compute[85141]:     <boot dev="hd"/>
Nov 16 10:24:15 user nova-compute[85141]:     <smbios mode="sysinfo"/>
Nov 16 10:24:15 user nova-compute[85141]:   </os>
Nov 16 10:24:15 user nova-compute[85141]:   <features>
Nov 16 10:24:15 user nova-compute[85141]:     <acpi/>
Nov 16 10:24:15 user nova-compute[85141]:     <apic/>
Nov 16 10:24:15 user nova-compute[85141]:     <vmcoreinfo/>
Nov 16 10:24:15 user nova-compute[85141]:   </features>
Nov 16 10:24:15 user nova-compute[85141]:   <clock offset="utc">
Nov 16 10:24:15 user nova-compute[85141]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 10:24:15 user nova-compute[85141]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 10:24:15 user nova-compute[85141]:     <timer name="hpet" present="no"/>
Nov 16 10:24:15 user nova-compute[85141]:   </clock>
Nov 16 10:24:15 user nova-compute[85141]:   <cpu mode="custom" match="exact">
Nov 16 10:24:15 user nova-compute[85141]:     <model>Nehalem</model>
Nov 16 10:24:15 user nova-compute[85141]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 10:24:15 user nova-compute[85141]:   </cpu>
Nov 16 10:24:15 user nova-compute[85141]:   <devices>
Nov 16 10:24:15 user nova-compute[85141]:     <disk type="file" device="disk">
Nov 16 10:24:15 user nova-compute[85141]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 10:24:15 user nova-compute[85141]:       <source file="/opt/stack/data/nova/instances/d7dfe34a-f7ba-44b3-8898-634338161a23/disk"/>
Nov 16 10:24:15 user nova-compute[85141]:       <target dev="vda" bus="virtio"/>
Nov 16 10:24:15 user nova-compute[85141]:     </disk>
Nov 16 10:24:15 user nova-compute[85141]:     <interface type="ethernet">
Nov 16 10:24:15 user nova-compute[85141]:       <mac address="fa:16:3e:1e:59:2e"/>
Nov 16 10:24:15 user nova-compute[85141]:       <model type="virtio"/>
Nov 16 10:24:15 user nova-compute[85141]:       <mtu size="1442"/>
Nov 16 10:24:15 user nova-compute[85141]:       <target dev="tap401df940-fd"/>
Nov 16 10:24:15 user nova-compute[85141]:     </interface>
Nov 16 10:24:15 user nova-compute[85141]:     <serial type="pty">
Nov 16 10:24:15 user nova-compute[85141]:       <log file="/opt/stack/data/nova/instances/d7dfe34a-f7ba-44b3-8898-634338161a23/console.log" append="off"/>
Nov 16 10:24:15 user nova-compute[85141]:     </serial>
Nov 16 10:24:15 user nova-compute[85141]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 10:24:15 user nova-compute[85141]:     <video>
Nov 16 10:24:15 user nova-compute[85141]:       <model type="virtio"/>
Nov 16 10:24:15 user nova-compute[85141]:     </video>
Nov 16 10:24:15 user nova-compute[85141]:     <rng model="virtio">
Nov 16 10:24:15 user nova-compute[85141]:       <backend model="random">/dev/urandom</backend>
Nov 16 10:24:15 user nova-compute[85141]:     </rng>
Nov 16 10:24:15 user nova-compute[85141]:     <controller type="usb" index="0" model="none"/>
Nov 16 10:24:15 user nova-compute[85141]:     <memballoon model="virtio">
Nov 16 10:24:15 user nova-compute[85141]:       <stats period="10"/>
Nov 16 10:24:15 user nova-compute[85141]:     </memballoon>
Nov 16 10:24:15 user nova-compute[85141]:   </devices>
Nov 16 10:24:15 user nova-compute[85141]: </domain>
Nov 16 10:24:15 user nova-compute[85141]:  {{(pid=85141) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 10:24:15 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-4e85357a-7c94-4095-8fbb-792999bdb97b tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T10:24:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-454057559',display_name='tempest-VolumesSnapshotTestJSON-instance-454057559',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-454057559',id=32,image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFvceMg7UP8xvNyrSavrKskF+lFeWK8f4QMgCeiS7/XawkQcsVT/zpfrUPenlNfCnn9QfeCu6Id4NfS6DcdUpYgQ4mMn7IU9vasremdvX6QkF0SCshLi30D3X/getVQb8Q==',key_name='tempest-keypair-36388301',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6a0984b7ef0346768c3231b9ab00fb57',ramdisk_id='',reservation_id='r-3z9vidhl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-790088929',owner_user_name='tempest-VolumesSnapshotTestJSON-790088929-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T10:24:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eb874e8c071f4305a1de443f23f5df95',uuid=d7dfe34a-f7ba-44b3-8898-634338161a23,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "401df940-fd58-48b0-89f4-5083130952d5", "address": "fa:16:3e:1e:59:2e", "network": {"id": "d791d4f1-ec4b-4db3-ae9a-471f071206eb", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-369109742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a0984b7ef0346768c3231b9ab00fb57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap401df940-fd", "ovs_interfaceid": "401df940-fd58-48b0-89f4-5083130952d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 10:24:15 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-4e85357a-7c94-4095-8fbb-792999bdb97b tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Converting VIF {"id": "401df940-fd58-48b0-89f4-5083130952d5", "address": "fa:16:3e:1e:59:2e", "network": {"id": "d791d4f1-ec4b-4db3-ae9a-471f071206eb", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-369109742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a0984b7ef0346768c3231b9ab00fb57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap401df940-fd", "ovs_interfaceid": "401df940-fd58-48b0-89f4-5083130952d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:24:15 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-4e85357a-7c94-4095-8fbb-792999bdb97b tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1e:59:2e,bridge_name='br-int',has_traffic_filtering=True,id=401df940-fd58-48b0-89f4-5083130952d5,network=Network(d791d4f1-ec4b-4db3-ae9a-471f071206eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap401df940-fd') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:24:15 user nova-compute[85141]: DEBUG os_vif [None req-4e85357a-7c94-4095-8fbb-792999bdb97b tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:59:2e,bridge_name='br-int',has_traffic_filtering=True,id=401df940-fd58-48b0-89f4-5083130952d5,network=Network(d791d4f1-ec4b-4db3-ae9a-471f071206eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap401df940-fd') {{(pid=85141) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 10:24:15 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:24:15 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:24:15 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 10:24:15 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:24:15 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5b944ca5-a6e6-5341-9a8b-800a656fb116', '_type': 'linux-noop'}}, row=False) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:24:15 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:24:15 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:24:15 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:24:15 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:24:15 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap401df940-fd, may_exist=True, interface_attrs={}) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:24:15 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap401df940-fd, col_values=(('qos', UUID('091e84f0-9af6-4bf8-a8fb-c8c4dae72f6f')),), if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:24:15 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap401df940-fd, col_values=(('external_ids', {'iface-id': '401df940-fd58-48b0-89f4-5083130952d5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1e:59:2e', 'vm-uuid': 'd7dfe34a-f7ba-44b3-8898-634338161a23'}),), if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:24:15 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:24:15 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:24:15 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:24:15 user nova-compute[85141]: INFO os_vif [None req-4e85357a-7c94-4095-8fbb-792999bdb97b tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:59:2e,bridge_name='br-int',has_traffic_filtering=True,id=401df940-fd58-48b0-89f4-5083130952d5,network=Network(d791d4f1-ec4b-4db3-ae9a-471f071206eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap401df940-fd')
Nov 16 10:24:15 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-4e85357a-7c94-4095-8fbb-792999bdb97b tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] No BDM found with device name vda, not building metadata. {{(pid=85141) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 10:24:15 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-4e85357a-7c94-4095-8fbb-792999bdb97b tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] No VIF found with MAC fa:16:3e:1e:59:2e, not building metadata {{(pid=85141) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 10:24:16 user nova-compute[85141]: DEBUG nova.network.neutron [req-0dc979fc-a740-4921-b0f2-f89c520bba57 req-f9f052b2-fc99-4ae4-bd84-9916e0f82fd4 service nova] [instance: d7dfe34a-f7ba-44b3-8898-634338161a23] Updated VIF entry in instance network info cache for port 401df940-fd58-48b0-89f4-5083130952d5. {{(pid=85141) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 10:24:16 user nova-compute[85141]: DEBUG nova.network.neutron [req-0dc979fc-a740-4921-b0f2-f89c520bba57 req-f9f052b2-fc99-4ae4-bd84-9916e0f82fd4 service nova] [instance: d7dfe34a-f7ba-44b3-8898-634338161a23] Updating instance_info_cache with network_info: [{"id": "401df940-fd58-48b0-89f4-5083130952d5", "address": "fa:16:3e:1e:59:2e", "network": {"id": "d791d4f1-ec4b-4db3-ae9a-471f071206eb", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-369109742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a0984b7ef0346768c3231b9ab00fb57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap401df940-fd", "ovs_interfaceid": "401df940-fd58-48b0-89f4-5083130952d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:24:16 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-0dc979fc-a740-4921-b0f2-f89c520bba57 req-f9f052b2-fc99-4ae4-bd84-9916e0f82fd4 service nova] Releasing lock "refresh_cache-d7dfe34a-f7ba-44b3-8898-634338161a23" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:24:17 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:24:17 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:24:17 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:24:17 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:24:17 user nova-compute[85141]: DEBUG nova.compute.manager [req-e6529da0-3b4e-488f-b881-c6ac8924817c req-b793aeac-eb2c-428f-8b9a-70d28d61142e service nova] [instance: d7dfe34a-f7ba-44b3-8898-634338161a23] Received event network-vif-plugged-401df940-fd58-48b0-89f4-5083130952d5 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:24:17 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-e6529da0-3b4e-488f-b881-c6ac8924817c req-b793aeac-eb2c-428f-8b9a-70d28d61142e service nova] Acquiring lock "d7dfe34a-f7ba-44b3-8898-634338161a23-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:24:17 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-e6529da0-3b4e-488f-b881-c6ac8924817c req-b793aeac-eb2c-428f-8b9a-70d28d61142e service nova] Lock "d7dfe34a-f7ba-44b3-8898-634338161a23-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:24:17 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-e6529da0-3b4e-488f-b881-c6ac8924817c req-b793aeac-eb2c-428f-8b9a-70d28d61142e service nova] Lock "d7dfe34a-f7ba-44b3-8898-634338161a23-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:24:17 user nova-compute[85141]: DEBUG nova.compute.manager [req-e6529da0-3b4e-488f-b881-c6ac8924817c req-b793aeac-eb2c-428f-8b9a-70d28d61142e service nova] [instance: d7dfe34a-f7ba-44b3-8898-634338161a23] No waiting events found dispatching network-vif-plugged-401df940-fd58-48b0-89f4-5083130952d5 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:24:17 user nova-compute[85141]: WARNING nova.compute.manager [req-e6529da0-3b4e-488f-b881-c6ac8924817c req-b793aeac-eb2c-428f-8b9a-70d28d61142e service nova] [instance: d7dfe34a-f7ba-44b3-8898-634338161a23] Received unexpected event network-vif-plugged-401df940-fd58-48b0-89f4-5083130952d5 for instance with vm_state building and task_state spawning.
Nov 16 10:24:17 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:24:17 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:24:17 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:24:17 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:24:18 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:24:19 user nova-compute[85141]: DEBUG nova.compute.manager [None req-4e85357a-7c94-4095-8fbb-792999bdb97b tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] [instance: d7dfe34a-f7ba-44b3-8898-634338161a23] Instance event wait completed in 0 seconds for  {{(pid=85141) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 10:24:19 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-4e85357a-7c94-4095-8fbb-792999bdb97b tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] [instance: d7dfe34a-f7ba-44b3-8898-634338161a23] Guest created on hypervisor {{(pid=85141) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 10:24:19 user nova-compute[85141]: INFO nova.virt.libvirt.driver [-] [instance: d7dfe34a-f7ba-44b3-8898-634338161a23] Instance spawned successfully.
Nov 16 10:24:19 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-4e85357a-7c94-4095-8fbb-792999bdb97b tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] [instance: d7dfe34a-f7ba-44b3-8898-634338161a23] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 10:24:19 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-4e85357a-7c94-4095-8fbb-792999bdb97b tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] [instance: d7dfe34a-f7ba-44b3-8898-634338161a23] Found default for hw_cdrom_bus of ide {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:24:19 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-4e85357a-7c94-4095-8fbb-792999bdb97b tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] [instance: d7dfe34a-f7ba-44b3-8898-634338161a23] Found default for hw_disk_bus of virtio {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:24:19 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-4e85357a-7c94-4095-8fbb-792999bdb97b tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] [instance: d7dfe34a-f7ba-44b3-8898-634338161a23] Found default for hw_input_bus of None {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:24:19 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-4e85357a-7c94-4095-8fbb-792999bdb97b tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] [instance: d7dfe34a-f7ba-44b3-8898-634338161a23] Found default for hw_pointer_model of None {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:24:19 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-4e85357a-7c94-4095-8fbb-792999bdb97b tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] [instance: d7dfe34a-f7ba-44b3-8898-634338161a23] Found default for hw_video_model of virtio {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:24:19 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-4e85357a-7c94-4095-8fbb-792999bdb97b tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] [instance: d7dfe34a-f7ba-44b3-8898-634338161a23] Found default for hw_vif_model of virtio {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:24:19 user nova-compute[85141]: INFO nova.compute.manager [None req-4e85357a-7c94-4095-8fbb-792999bdb97b tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] [instance: d7dfe34a-f7ba-44b3-8898-634338161a23] Took 5.59 seconds to spawn the instance on the hypervisor.
Nov 16 10:24:19 user nova-compute[85141]: DEBUG nova.compute.manager [None req-4e85357a-7c94-4095-8fbb-792999bdb97b tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] [instance: d7dfe34a-f7ba-44b3-8898-634338161a23] Checking state {{(pid=85141) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 10:24:19 user nova-compute[85141]: DEBUG nova.compute.manager [req-b7a52ae5-778d-4234-a95b-cde0b458b898 req-a3f1d269-e7ec-4b3d-8040-75196422c35a service nova] [instance: d7dfe34a-f7ba-44b3-8898-634338161a23] Received event network-vif-plugged-401df940-fd58-48b0-89f4-5083130952d5 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:24:19 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-b7a52ae5-778d-4234-a95b-cde0b458b898 req-a3f1d269-e7ec-4b3d-8040-75196422c35a service nova] Acquiring lock "d7dfe34a-f7ba-44b3-8898-634338161a23-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:24:19 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-b7a52ae5-778d-4234-a95b-cde0b458b898 req-a3f1d269-e7ec-4b3d-8040-75196422c35a service nova] Lock "d7dfe34a-f7ba-44b3-8898-634338161a23-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:24:19 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-b7a52ae5-778d-4234-a95b-cde0b458b898 req-a3f1d269-e7ec-4b3d-8040-75196422c35a service nova] Lock "d7dfe34a-f7ba-44b3-8898-634338161a23-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:24:19 user nova-compute[85141]: DEBUG nova.compute.manager [req-b7a52ae5-778d-4234-a95b-cde0b458b898 req-a3f1d269-e7ec-4b3d-8040-75196422c35a service nova] [instance: d7dfe34a-f7ba-44b3-8898-634338161a23] No waiting events found dispatching network-vif-plugged-401df940-fd58-48b0-89f4-5083130952d5 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:24:19 user nova-compute[85141]: WARNING nova.compute.manager [req-b7a52ae5-778d-4234-a95b-cde0b458b898 req-a3f1d269-e7ec-4b3d-8040-75196422c35a service nova] [instance: d7dfe34a-f7ba-44b3-8898-634338161a23] Received unexpected event network-vif-plugged-401df940-fd58-48b0-89f4-5083130952d5 for instance with vm_state building and task_state spawning.
Nov 16 10:24:19 user nova-compute[85141]: INFO nova.compute.manager [None req-4e85357a-7c94-4095-8fbb-792999bdb97b tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] [instance: d7dfe34a-f7ba-44b3-8898-634338161a23] Took 6.81 seconds to build instance.
Nov 16 10:24:19 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-4e85357a-7c94-4095-8fbb-792999bdb97b tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Lock "d7dfe34a-f7ba-44b3-8898-634338161a23" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.907s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:24:20 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:24:22 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:24:22 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:24:24 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:24:24 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:24:25 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:24:25 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:24:26 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:24:27 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:24:27 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:24:29 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:24:29 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Starting heal instance info cache {{(pid=85141) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 10:24:29 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Rebuilding the list of instances to heal {{(pid=85141) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 10:24:29 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Acquiring lock "refresh_cache-d842f90e-663b-4c95-9d7c-d092d2bac41f" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:24:29 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Acquired lock "refresh_cache-d842f90e-663b-4c95-9d7c-d092d2bac41f" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:24:29 user nova-compute[85141]: DEBUG nova.network.neutron [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] [instance: d842f90e-663b-4c95-9d7c-d092d2bac41f] Forcefully refreshing network info cache for instance {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 10:24:29 user nova-compute[85141]: DEBUG nova.objects.instance [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lazy-loading 'info_cache' on Instance uuid d842f90e-663b-4c95-9d7c-d092d2bac41f {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:24:29 user nova-compute[85141]: DEBUG nova.network.neutron [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] [instance: d842f90e-663b-4c95-9d7c-d092d2bac41f] Updating instance_info_cache with network_info: [{"id": "6ce8849e-50a1-4b8a-bf75-1016ef3c2315", "address": "fa:16:3e:a2:a8:01", "network": {"id": "e40e4bd2-4277-40b1-9451-1c8365ffa488", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1333036447-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "733b504d4dbe4f028963cf2c197f0064", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ce8849e-50", "ovs_interfaceid": "6ce8849e-50a1-4b8a-bf75-1016ef3c2315", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:24:29 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Releasing lock "refresh_cache-d842f90e-663b-4c95-9d7c-d092d2bac41f" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:24:29 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] [instance: d842f90e-663b-4c95-9d7c-d092d2bac41f] Updated the network info_cache for instance {{(pid=85141) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 10:24:30 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:24:30 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=85141) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 10:24:30 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:24:30 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:24:32 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:24:32 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:24:32 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:24:32 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:24:34 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:24:34 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:24:34 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager.update_available_resource {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:24:34 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:24:34 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:24:34 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:24:34 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Auditing locally available compute resources for user (node: user) {{(pid=85141) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 10:24:34 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d842f90e-663b-4c95-9d7c-d092d2bac41f/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:24:34 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d842f90e-663b-4c95-9d7c-d092d2bac41f/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:24:34 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d842f90e-663b-4c95-9d7c-d092d2bac41f/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:24:34 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d842f90e-663b-4c95-9d7c-d092d2bac41f/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:24:34 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=85141) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 10:24:34 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/463034ff-14ce-477a-9642-4d86aa6f9cd9/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:24:35 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/463034ff-14ce-477a-9642-4d86aa6f9cd9/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:24:35 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/463034ff-14ce-477a-9642-4d86aa6f9cd9/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:24:35 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/463034ff-14ce-477a-9642-4d86aa6f9cd9/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:24:35 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e214bbb-5bbb-4e6f-ac09-9cb1412f068b/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:24:35 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e214bbb-5bbb-4e6f-ac09-9cb1412f068b/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:24:35 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e214bbb-5bbb-4e6f-ac09-9cb1412f068b/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:24:35 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e214bbb-5bbb-4e6f-ac09-9cb1412f068b/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:24:35 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11986c5b-6914-491e-8e71-983ab6b13c6e/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:24:35 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:24:35 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11986c5b-6914-491e-8e71-983ab6b13c6e/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:24:35 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11986c5b-6914-491e-8e71-983ab6b13c6e/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:24:36 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11986c5b-6914-491e-8e71-983ab6b13c6e/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:24:36 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7dfe34a-f7ba-44b3-8898-634338161a23/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:24:36 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7dfe34a-f7ba-44b3-8898-634338161a23/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:24:36 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7dfe34a-f7ba-44b3-8898-634338161a23/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:24:36 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7dfe34a-f7ba-44b3-8898-634338161a23/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:24:36 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b24c3954-06ff-4e15-9e43-c65d1dae7a5d/disk.rescue --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:24:36 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b24c3954-06ff-4e15-9e43-c65d1dae7a5d/disk.rescue --force-share --output=json" returned: 0 in 0.191s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:24:36 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b24c3954-06ff-4e15-9e43-c65d1dae7a5d/disk.rescue --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:24:36 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b24c3954-06ff-4e15-9e43-c65d1dae7a5d/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:24:36 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b24c3954-06ff-4e15-9e43-c65d1dae7a5d/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:24:37 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b24c3954-06ff-4e15-9e43-c65d1dae7a5d/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:24:37 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b24c3954-06ff-4e15-9e43-c65d1dae7a5d/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:24:37 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b24c3954-06ff-4e15-9e43-c65d1dae7a5d/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:24:37 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=85141) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 10:24:37 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b388b98-4e65-4258-bbe2-77e699321fb7/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:24:37 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b388b98-4e65-4258-bbe2-77e699321fb7/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:24:37 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b388b98-4e65-4258-bbe2-77e699321fb7/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:24:37 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b388b98-4e65-4258-bbe2-77e699321fb7/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:24:37 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/059d6974-bd0c-4f73-91fc-8202ebda4238/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:24:37 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:24:37 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/059d6974-bd0c-4f73-91fc-8202ebda4238/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:24:37 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/059d6974-bd0c-4f73-91fc-8202ebda4238/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:24:38 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/059d6974-bd0c-4f73-91fc-8202ebda4238/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:24:38 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17480138-4b61-43f7-92a5-db065f7d1696/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:24:38 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17480138-4b61-43f7-92a5-db065f7d1696/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:24:38 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17480138-4b61-43f7-92a5-db065f7d1696/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:24:38 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17480138-4b61-43f7-92a5-db065f7d1696/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:24:38 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a507c85-0369-48ea-8858-3e7d346b4cb0/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:24:38 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a507c85-0369-48ea-8858-3e7d346b4cb0/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:24:38 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a507c85-0369-48ea-8858-3e7d346b4cb0/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:24:38 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a507c85-0369-48ea-8858-3e7d346b4cb0/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:24:39 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:24:39 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:24:39 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Hypervisor/Node resource view: name=user free_ram=7434MB free_disk=24.8946533203125GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=85141) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 10:24:39 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:24:39 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:24:39 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance d842f90e-663b-4c95-9d7c-d092d2bac41f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:24:39 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance f01dc8cf-1a69-4618-a15d-0c1075157f05 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:24:39 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance 059d6974-bd0c-4f73-91fc-8202ebda4238 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:24:39 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance 4e214bbb-5bbb-4e6f-ac09-9cb1412f068b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:24:39 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance b24c3954-06ff-4e15-9e43-c65d1dae7a5d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:24:39 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance 0b388b98-4e65-4258-bbe2-77e699321fb7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:24:39 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance 11986c5b-6914-491e-8e71-983ab6b13c6e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:24:39 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance abe5d4b7-a0d7-40e3-b630-0de746ddb55b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:24:39 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance 17480138-4b61-43f7-92a5-db065f7d1696 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:24:39 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance 463034ff-14ce-477a-9642-4d86aa6f9cd9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:24:39 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance 5a507c85-0369-48ea-8858-3e7d346b4cb0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:24:39 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance d7dfe34a-f7ba-44b3-8898-634338161a23 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:24:39 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=85141) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 10:24:39 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=85141) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 10:24:39 user nova-compute[85141]: DEBUG nova.compute.provider_tree [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Inventory has not changed in ProviderTree for provider: bf8e0fa1-16b6-408f-9203-c4cd63916272 {{(pid=85141) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 10:24:39 user nova-compute[85141]: DEBUG nova.scheduler.client.report [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Inventory has not changed for provider bf8e0fa1-16b6-408f-9203-c4cd63916272 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=85141) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 10:24:39 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Compute_service record updated for user:user {{(pid=85141) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 10:24:39 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.513s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:24:40 user nova-compute[85141]: INFO nova.compute.manager [None req-9ff250f7-a5e6-480c-b053-a351f2b26297 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] [instance: abe5d4b7-a0d7-40e3-b630-0de746ddb55b] Rescuing
Nov 16 10:24:40 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-9ff250f7-a5e6-480c-b053-a351f2b26297 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Acquiring lock "refresh_cache-abe5d4b7-a0d7-40e3-b630-0de746ddb55b" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:24:40 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-9ff250f7-a5e6-480c-b053-a351f2b26297 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Acquired lock "refresh_cache-abe5d4b7-a0d7-40e3-b630-0de746ddb55b" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:24:40 user nova-compute[85141]: DEBUG nova.network.neutron [None req-9ff250f7-a5e6-480c-b053-a351f2b26297 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] [instance: abe5d4b7-a0d7-40e3-b630-0de746ddb55b] Building network info cache for instance {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 10:24:40 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-13d0dcf3-3045-416f-b172-0205186032e1 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Acquiring lock "dfe84cd6-628a-484e-b266-34e2abe890f2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:24:40 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-13d0dcf3-3045-416f-b172-0205186032e1 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Lock "dfe84cd6-628a-484e-b266-34e2abe890f2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:24:40 user nova-compute[85141]: DEBUG nova.compute.manager [None req-13d0dcf3-3045-416f-b172-0205186032e1 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: dfe84cd6-628a-484e-b266-34e2abe890f2] Starting instance... {{(pid=85141) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 10:24:40 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:24:40 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-13d0dcf3-3045-416f-b172-0205186032e1 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:24:40 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-13d0dcf3-3045-416f-b172-0205186032e1 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:24:40 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-13d0dcf3-3045-416f-b172-0205186032e1 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=85141) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 10:24:40 user nova-compute[85141]: INFO nova.compute.claims [None req-13d0dcf3-3045-416f-b172-0205186032e1 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: dfe84cd6-628a-484e-b266-34e2abe890f2] Claim successful on node user
Nov 16 10:24:41 user nova-compute[85141]: DEBUG nova.network.neutron [None req-9ff250f7-a5e6-480c-b053-a351f2b26297 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] [instance: abe5d4b7-a0d7-40e3-b630-0de746ddb55b] Updating instance_info_cache with network_info: [{"id": "e583d579-7583-4f41-b0f1-b3241b6af956", "address": "fa:16:3e:4d:24:64", "network": {"id": "e40e4bd2-4277-40b1-9451-1c8365ffa488", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1333036447-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "733b504d4dbe4f028963cf2c197f0064", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape583d579-75", "ovs_interfaceid": "e583d579-7583-4f41-b0f1-b3241b6af956", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:24:41 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-9ff250f7-a5e6-480c-b053-a351f2b26297 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Releasing lock "refresh_cache-abe5d4b7-a0d7-40e3-b630-0de746ddb55b" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:24:41 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:24:41 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:24:41 user nova-compute[85141]: DEBUG nova.compute.provider_tree [None req-13d0dcf3-3045-416f-b172-0205186032e1 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Inventory has not changed in ProviderTree for provider: bf8e0fa1-16b6-408f-9203-c4cd63916272 {{(pid=85141) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 10:24:41 user nova-compute[85141]: DEBUG nova.compute.manager [req-2c3817a8-3172-4040-a4dc-4a9c88e91922 req-c6fcb64c-9c8d-439c-869a-8844f6005d26 service nova] [instance: abe5d4b7-a0d7-40e3-b630-0de746ddb55b] Received event network-vif-unplugged-e583d579-7583-4f41-b0f1-b3241b6af956 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:24:41 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-2c3817a8-3172-4040-a4dc-4a9c88e91922 req-c6fcb64c-9c8d-439c-869a-8844f6005d26 service nova] Acquiring lock "abe5d4b7-a0d7-40e3-b630-0de746ddb55b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:24:41 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-2c3817a8-3172-4040-a4dc-4a9c88e91922 req-c6fcb64c-9c8d-439c-869a-8844f6005d26 service nova] Lock "abe5d4b7-a0d7-40e3-b630-0de746ddb55b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:24:41 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-2c3817a8-3172-4040-a4dc-4a9c88e91922 req-c6fcb64c-9c8d-439c-869a-8844f6005d26 service nova] Lock "abe5d4b7-a0d7-40e3-b630-0de746ddb55b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:24:41 user nova-compute[85141]: DEBUG nova.compute.manager [req-2c3817a8-3172-4040-a4dc-4a9c88e91922 req-c6fcb64c-9c8d-439c-869a-8844f6005d26 service nova] [instance: abe5d4b7-a0d7-40e3-b630-0de746ddb55b] No waiting events found dispatching network-vif-unplugged-e583d579-7583-4f41-b0f1-b3241b6af956 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:24:41 user nova-compute[85141]: WARNING nova.compute.manager [req-2c3817a8-3172-4040-a4dc-4a9c88e91922 req-c6fcb64c-9c8d-439c-869a-8844f6005d26 service nova] [instance: abe5d4b7-a0d7-40e3-b630-0de746ddb55b] Received unexpected event network-vif-unplugged-e583d579-7583-4f41-b0f1-b3241b6af956 for instance with vm_state active and task_state rescuing.
Nov 16 10:24:41 user nova-compute[85141]: DEBUG nova.scheduler.client.report [None req-13d0dcf3-3045-416f-b172-0205186032e1 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Inventory has not changed for provider bf8e0fa1-16b6-408f-9203-c4cd63916272 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=85141) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 10:24:41 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-13d0dcf3-3045-416f-b172-0205186032e1 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.616s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:24:41 user nova-compute[85141]: DEBUG nova.compute.manager [None req-13d0dcf3-3045-416f-b172-0205186032e1 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: dfe84cd6-628a-484e-b266-34e2abe890f2] Start building networks asynchronously for instance. {{(pid=85141) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 10:24:41 user nova-compute[85141]: DEBUG nova.compute.manager [None req-13d0dcf3-3045-416f-b172-0205186032e1 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: dfe84cd6-628a-484e-b266-34e2abe890f2] Allocating IP information in the background. {{(pid=85141) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 10:24:41 user nova-compute[85141]: DEBUG nova.network.neutron [None req-13d0dcf3-3045-416f-b172-0205186032e1 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: dfe84cd6-628a-484e-b266-34e2abe890f2] allocate_for_instance() {{(pid=85141) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 10:24:41 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:24:41 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-13d0dcf3-3045-416f-b172-0205186032e1 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: dfe84cd6-628a-484e-b266-34e2abe890f2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 10:24:41 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:24:41 user nova-compute[85141]: DEBUG nova.compute.manager [None req-13d0dcf3-3045-416f-b172-0205186032e1 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: dfe84cd6-628a-484e-b266-34e2abe890f2] Start building block device mappings for instance. {{(pid=85141) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 10:24:41 user nova-compute[85141]: INFO nova.virt.block_device [None req-13d0dcf3-3045-416f-b172-0205186032e1 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: dfe84cd6-628a-484e-b266-34e2abe890f2] Booting with volume snapshot 0d49c522-759f-48dc-8164-390ed92045f3 at /dev/vda
Nov 16 10:24:41 user nova-compute[85141]: DEBUG nova.policy [None req-13d0dcf3-3045-416f-b172-0205186032e1 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7261b57c36904fcda87a9ea32d4b5b31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aec3bb9fe5e6446590900b5adf65df0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85141) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 10:24:41 user nova-compute[85141]: INFO nova.virt.libvirt.driver [-] [instance: abe5d4b7-a0d7-40e3-b630-0de746ddb55b] Instance destroyed successfully.
Nov 16 10:24:41 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-9ff250f7-a5e6-480c-b053-a351f2b26297 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] [instance: abe5d4b7-a0d7-40e3-b630-0de746ddb55b] Attempting a stable device rescue
Nov 16 10:24:42 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-9ff250f7-a5e6-480c-b053-a351f2b26297 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=85141) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 16 10:24:42 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-9ff250f7-a5e6-480c-b053-a351f2b26297 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] [instance: abe5d4b7-a0d7-40e3-b630-0de746ddb55b] Instance directory exists: not creating {{(pid=85141) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 16 10:24:42 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-9ff250f7-a5e6-480c-b053-a351f2b26297 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] [instance: abe5d4b7-a0d7-40e3-b630-0de746ddb55b] Creating image(s)
Nov 16 10:24:42 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-9ff250f7-a5e6-480c-b053-a351f2b26297 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Acquiring lock "/opt/stack/data/nova/instances/abe5d4b7-a0d7-40e3-b630-0de746ddb55b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:24:42 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-9ff250f7-a5e6-480c-b053-a351f2b26297 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Lock "/opt/stack/data/nova/instances/abe5d4b7-a0d7-40e3-b630-0de746ddb55b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:24:42 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-9ff250f7-a5e6-480c-b053-a351f2b26297 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Lock "/opt/stack/data/nova/instances/abe5d4b7-a0d7-40e3-b630-0de746ddb55b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:24:42 user nova-compute[85141]: DEBUG nova.objects.instance [None req-9ff250f7-a5e6-480c-b053-a351f2b26297 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Lazy-loading 'trusted_certs' on Instance uuid abe5d4b7-a0d7-40e3-b630-0de746ddb55b {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:24:42 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-9ff250f7-a5e6-480c-b053-a351f2b26297 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Acquiring lock "cb4033c0fb0aba32891cc069d8e652296ef669a3" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:24:42 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-9ff250f7-a5e6-480c-b053-a351f2b26297 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Lock "cb4033c0fb0aba32891cc069d8e652296ef669a3" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:24:43 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-9ff250f7-a5e6-480c-b053-a351f2b26297 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cb4033c0fb0aba32891cc069d8e652296ef669a3.part --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:24:43 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:24:43 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:24:43 user nova-compute[85141]: DEBUG nova.network.neutron [None req-13d0dcf3-3045-416f-b172-0205186032e1 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: dfe84cd6-628a-484e-b266-34e2abe890f2] Successfully created port: e3463cf8-10c0-4465-95d8-28248f06c3c1 {{(pid=85141) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 10:24:43 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-9ff250f7-a5e6-480c-b053-a351f2b26297 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cb4033c0fb0aba32891cc069d8e652296ef669a3.part --force-share --output=json" returned: 0 in 0.189s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:24:43 user nova-compute[85141]: DEBUG nova.virt.images [None req-9ff250f7-a5e6-480c-b053-a351f2b26297 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] b8cfc97a-7753-4684-9ba7-4742d01ad9df was qcow2, converting to raw {{(pid=85141) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 16 10:24:43 user nova-compute[85141]: DEBUG nova.privsep.utils [None req-9ff250f7-a5e6-480c-b053-a351f2b26297 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=85141) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 16 10:24:43 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-9ff250f7-a5e6-480c-b053-a351f2b26297 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/cb4033c0fb0aba32891cc069d8e652296ef669a3.part /opt/stack/data/nova/instances/_base/cb4033c0fb0aba32891cc069d8e652296ef669a3.converted {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:24:43 user nova-compute[85141]: DEBUG nova.compute.manager [req-81f04a68-c654-4844-b462-fd033a66ad62 req-43941824-75e5-47f2-af81-30f0cdead87a service nova] [instance: abe5d4b7-a0d7-40e3-b630-0de746ddb55b] Received event network-vif-plugged-e583d579-7583-4f41-b0f1-b3241b6af956 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:24:43 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-81f04a68-c654-4844-b462-fd033a66ad62 req-43941824-75e5-47f2-af81-30f0cdead87a service nova] Acquiring lock "abe5d4b7-a0d7-40e3-b630-0de746ddb55b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:24:43 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-81f04a68-c654-4844-b462-fd033a66ad62 req-43941824-75e5-47f2-af81-30f0cdead87a service nova] Lock "abe5d4b7-a0d7-40e3-b630-0de746ddb55b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:24:43 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-81f04a68-c654-4844-b462-fd033a66ad62 req-43941824-75e5-47f2-af81-30f0cdead87a service nova] Lock "abe5d4b7-a0d7-40e3-b630-0de746ddb55b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:24:43 user nova-compute[85141]: DEBUG nova.compute.manager [req-81f04a68-c654-4844-b462-fd033a66ad62 req-43941824-75e5-47f2-af81-30f0cdead87a service nova] [instance: abe5d4b7-a0d7-40e3-b630-0de746ddb55b] No waiting events found dispatching network-vif-plugged-e583d579-7583-4f41-b0f1-b3241b6af956 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:24:43 user nova-compute[85141]: WARNING nova.compute.manager [req-81f04a68-c654-4844-b462-fd033a66ad62 req-43941824-75e5-47f2-af81-30f0cdead87a service nova] [instance: abe5d4b7-a0d7-40e3-b630-0de746ddb55b] Received unexpected event network-vif-plugged-e583d579-7583-4f41-b0f1-b3241b6af956 for instance with vm_state active and task_state rescuing.
Nov 16 10:24:43 user nova-compute[85141]: DEBUG os_brick.utils [None req-13d0dcf3-3045-416f-b172-0205186032e1 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 10:24:43 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:24:43 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:24:43 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[f10597b4-dc58-454a-bccb-fea9b3ec024e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c7834de5c295\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:24:43 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:24:43 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:24:43 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[343b93c1-9adf-44ad-b6d5-2aba02f470d6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:24:43 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:24:43 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:24:43 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a598a26-81fe-4b99-a3bd-b9fd2b48f6fd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:24:43 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b3f99ee-70df-4bec-9a6a-09f9268f8429]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:24:43 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-13d0dcf3-3045-416f-b172-0205186032e1 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Running cmd (subprocess): nvme version {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:24:43 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-13d0dcf3-3045-416f-b172-0205186032e1 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] 'nvme version' failed. Not Retrying. {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 10:24:43 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.nvmeof [None req-13d0dcf3-3045-416f-b172-0205186032e1 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] nvme not present on system {{(pid=85141) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 10:24:43 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:24:43 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 10:24:43 user nova-compute[85141]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 10:24:43 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[e808a283-7094-4146-b7af-5528b6b4ff0c]: (4, '') {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:24:43 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.lightos [None req-13d0dcf3-3045-416f-b172-0205186032e1 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=85141) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 10:24:43 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.lightos [None req-13d0dcf3-3045-416f-b172-0205186032e1 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=85141) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 10:24:43 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.lightos [None req-13d0dcf3-3045-416f-b172-0205186032e1 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] LIGHTOS: no hostnqn found. {{(pid=85141) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 10:24:43 user nova-compute[85141]: DEBUG os_brick.utils [None req-13d0dcf3-3045-416f-b172-0205186032e1 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c7834de5c295', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 10:24:43 user nova-compute[85141]: DEBUG nova.virt.block_device [None req-13d0dcf3-3045-416f-b172-0205186032e1 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: dfe84cd6-628a-484e-b266-34e2abe890f2] Updating existing volume attachment record: 14e523d1-b794-4e49-a813-eb6aa8210a82 {{(pid=85141) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 10:24:44 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-9ff250f7-a5e6-480c-b053-a351f2b26297 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/cb4033c0fb0aba32891cc069d8e652296ef669a3.part /opt/stack/data/nova/instances/_base/cb4033c0fb0aba32891cc069d8e652296ef669a3.converted" returned: 0 in 0.553s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:24:44 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-9ff250f7-a5e6-480c-b053-a351f2b26297 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cb4033c0fb0aba32891cc069d8e652296ef669a3.converted --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:24:44 user nova-compute[85141]: DEBUG nova.network.neutron [None req-13d0dcf3-3045-416f-b172-0205186032e1 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: dfe84cd6-628a-484e-b266-34e2abe890f2] Successfully updated port: e3463cf8-10c0-4465-95d8-28248f06c3c1 {{(pid=85141) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 10:24:44 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-13d0dcf3-3045-416f-b172-0205186032e1 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Acquiring lock "refresh_cache-dfe84cd6-628a-484e-b266-34e2abe890f2" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:24:44 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-13d0dcf3-3045-416f-b172-0205186032e1 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Acquired lock "refresh_cache-dfe84cd6-628a-484e-b266-34e2abe890f2" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:24:44 user nova-compute[85141]: DEBUG nova.network.neutron [None req-13d0dcf3-3045-416f-b172-0205186032e1 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: dfe84cd6-628a-484e-b266-34e2abe890f2] Building network info cache for instance {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 10:24:44 user nova-compute[85141]: DEBUG nova.network.neutron [None req-13d0dcf3-3045-416f-b172-0205186032e1 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: dfe84cd6-628a-484e-b266-34e2abe890f2] Instance cache missing network info. {{(pid=85141) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 10:24:44 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-9ff250f7-a5e6-480c-b053-a351f2b26297 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cb4033c0fb0aba32891cc069d8e652296ef669a3.converted --force-share --output=json" returned: 0 in 0.188s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:24:44 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-9ff250f7-a5e6-480c-b053-a351f2b26297 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Lock "cb4033c0fb0aba32891cc069d8e652296ef669a3" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.174s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:24:44 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-9ff250f7-a5e6-480c-b053-a351f2b26297 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Acquiring lock "cb4033c0fb0aba32891cc069d8e652296ef669a3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:24:44 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-9ff250f7-a5e6-480c-b053-a351f2b26297 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Lock "cb4033c0fb0aba32891cc069d8e652296ef669a3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:24:44 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-9ff250f7-a5e6-480c-b053-a351f2b26297 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cb4033c0fb0aba32891cc069d8e652296ef669a3 --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:24:44 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-9ff250f7-a5e6-480c-b053-a351f2b26297 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cb4033c0fb0aba32891cc069d8e652296ef669a3 --force-share --output=json" returned: 0 in 0.191s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:24:44 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-9ff250f7-a5e6-480c-b053-a351f2b26297 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cb4033c0fb0aba32891cc069d8e652296ef669a3,backing_fmt=raw /opt/stack/data/nova/instances/abe5d4b7-a0d7-40e3-b630-0de746ddb55b/disk.rescue {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:24:44 user nova-compute[85141]: DEBUG nova.network.neutron [None req-13d0dcf3-3045-416f-b172-0205186032e1 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: dfe84cd6-628a-484e-b266-34e2abe890f2] Updating instance_info_cache with network_info: [{"id": "e3463cf8-10c0-4465-95d8-28248f06c3c1", "address": "fa:16:3e:66:21:97", "network": {"id": "b8ada47f-9721-4358-ac4f-0305f06dbbb8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1663922860-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aec3bb9fe5e6446590900b5adf65df0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3463cf8-10", "ovs_interfaceid": "e3463cf8-10c0-4465-95d8-28248f06c3c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:24:44 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-9ff250f7-a5e6-480c-b053-a351f2b26297 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cb4033c0fb0aba32891cc069d8e652296ef669a3,backing_fmt=raw /opt/stack/data/nova/instances/abe5d4b7-a0d7-40e3-b630-0de746ddb55b/disk.rescue" returned: 0 in 0.067s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:24:44 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-9ff250f7-a5e6-480c-b053-a351f2b26297 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Lock "cb4033c0fb0aba32891cc069d8e652296ef669a3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.262s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:24:44 user nova-compute[85141]: DEBUG nova.objects.instance [None req-9ff250f7-a5e6-480c-b053-a351f2b26297 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Lazy-loading 'migration_context' on Instance uuid abe5d4b7-a0d7-40e3-b630-0de746ddb55b {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:24:44 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-13d0dcf3-3045-416f-b172-0205186032e1 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Releasing lock "refresh_cache-dfe84cd6-628a-484e-b266-34e2abe890f2" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:24:44 user nova-compute[85141]: DEBUG nova.compute.manager [None req-13d0dcf3-3045-416f-b172-0205186032e1 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: dfe84cd6-628a-484e-b266-34e2abe890f2] Instance network_info: |[{"id": "e3463cf8-10c0-4465-95d8-28248f06c3c1", "address": "fa:16:3e:66:21:97", "network": {"id": "b8ada47f-9721-4358-ac4f-0305f06dbbb8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1663922860-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aec3bb9fe5e6446590900b5adf65df0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3463cf8-10", "ovs_interfaceid": "e3463cf8-10c0-4465-95d8-28248f06c3c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=85141) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 10:24:44 user nova-compute[85141]: DEBUG nova.objects.base [None req-9ff250f7-a5e6-480c-b053-a351f2b26297 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Object Instance<abe5d4b7-a0d7-40e3-b630-0de746ddb55b> lazy-loaded attributes: trusted_certs,migration_context {{(pid=85141) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 10:24:44 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-9ff250f7-a5e6-480c-b053-a351f2b26297 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] [instance: abe5d4b7-a0d7-40e3-b630-0de746ddb55b] Created local disks {{(pid=85141) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 10:24:44 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-9ff250f7-a5e6-480c-b053-a351f2b26297 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] [instance: abe5d4b7-a0d7-40e3-b630-0de746ddb55b] Start _get_guest_xml network_info=[{"id": "e583d579-7583-4f41-b0f1-b3241b6af956", "address": "fa:16:3e:4d:24:64", "network": {"id": "e40e4bd2-4277-40b1-9451-1c8365ffa488", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1333036447-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1333036447-network", "vif_mac": "fa:16:3e:4d:24:64"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "733b504d4dbe4f028963cf2c197f0064", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape583d579-75", "ovs_interfaceid": "e583d579-7583-4f41-b0f1-b3241b6af956", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T10:06:42Z,direct_url=<?>,disk_format='qcow2',id=bc4ca70f-a459-4d5c-a9e6-80f1948eb48b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1044631a5fe84ce8904864a7024049fa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T10:06:44Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'b8cfc97a-7753-4684-9ba7-4742d01ad9df', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:11a6a15b-38c1-4e7e-b8fa-2feb6789e775', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WtUCwYzB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': 'abe5d4b7-a0d7-40e3-b630-0de746ddb55b', 'attached_at': '', 'detached_at': '', 'volume_id': '11a6a15b-38c1-4e7e-b8fa-2feb6789e775', 'serial': '11a6a15b-38c1-4e7e-b8fa-2feb6789e775'}, 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'attachment_id': '11c14e5b-5e86-4d82-98ab-7094af60d951', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=85141) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 10:24:44 user nova-compute[85141]: DEBUG nova.objects.instance [None req-9ff250f7-a5e6-480c-b053-a351f2b26297 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Lazy-loading 'resources' on Instance uuid abe5d4b7-a0d7-40e3-b630-0de746ddb55b {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:24:44 user nova-compute[85141]: DEBUG nova.objects.base [None req-9ff250f7-a5e6-480c-b053-a351f2b26297 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Object Instance<abe5d4b7-a0d7-40e3-b630-0de746ddb55b> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=85141) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 10:24:44 user nova-compute[85141]: DEBUG nova.objects.instance [None req-9ff250f7-a5e6-480c-b053-a351f2b26297 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Lazy-loading 'numa_topology' on Instance uuid abe5d4b7-a0d7-40e3-b630-0de746ddb55b {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:24:44 user nova-compute[85141]: DEBUG nova.objects.base [None req-9ff250f7-a5e6-480c-b053-a351f2b26297 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Object Instance<abe5d4b7-a0d7-40e3-b630-0de746ddb55b> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=85141) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 10:24:44 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-9ff250f7-a5e6-480c-b053-a351f2b26297 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:24:44 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-9ff250f7-a5e6-480c-b053-a351f2b26297 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:24:44 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-9ff250f7-a5e6-480c-b053-a351f2b26297 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=85141) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 10:24:44 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-9ff250f7-a5e6-480c-b053-a351f2b26297 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] CPU controller missing on host. {{(pid=85141) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 10:24:44 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-9ff250f7-a5e6-480c-b053-a351f2b26297 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=85141) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 10:24:44 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-9ff250f7-a5e6-480c-b053-a351f2b26297 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] CPU controller found on host. {{(pid=85141) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 10:24:44 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-9ff250f7-a5e6-480c-b053-a351f2b26297 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=85141) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 10:24:44 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-9ff250f7-a5e6-480c-b053-a351f2b26297 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T10:06:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T10:06:42Z,direct_url=<?>,disk_format='qcow2',id=bc4ca70f-a459-4d5c-a9e6-80f1948eb48b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1044631a5fe84ce8904864a7024049fa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T10:06:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 10:24:44 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-9ff250f7-a5e6-480c-b053-a351f2b26297 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Flavor limits 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 10:24:44 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-9ff250f7-a5e6-480c-b053-a351f2b26297 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Image limits 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 10:24:44 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-9ff250f7-a5e6-480c-b053-a351f2b26297 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Flavor pref 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 10:24:44 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-9ff250f7-a5e6-480c-b053-a351f2b26297 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Image pref 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 10:24:44 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-9ff250f7-a5e6-480c-b053-a351f2b26297 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 10:24:44 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-9ff250f7-a5e6-480c-b053-a351f2b26297 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 10:24:44 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-9ff250f7-a5e6-480c-b053-a351f2b26297 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=85141) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 10:24:44 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-9ff250f7-a5e6-480c-b053-a351f2b26297 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Got 1 possible topologies {{(pid=85141) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 10:24:44 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-9ff250f7-a5e6-480c-b053-a351f2b26297 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 10:24:44 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-9ff250f7-a5e6-480c-b053-a351f2b26297 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 10:24:44 user nova-compute[85141]: DEBUG nova.objects.instance [None req-9ff250f7-a5e6-480c-b053-a351f2b26297 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Lazy-loading 'vcpu_model' on Instance uuid abe5d4b7-a0d7-40e3-b630-0de746ddb55b {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:24:44 user nova-compute[85141]: DEBUG nova.objects.base [None req-9ff250f7-a5e6-480c-b053-a351f2b26297 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Object Instance<abe5d4b7-a0d7-40e3-b630-0de746ddb55b> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=85141) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 10:24:44 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ff250f7-a5e6-480c-b053-a351f2b26297 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] [instance: abe5d4b7-a0d7-40e3-b630-0de746ddb55b] Calling os-brick to attach iSCSI Volume {{(pid=85141) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 10:24:44 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ff250f7-a5e6-480c-b053-a351f2b26297 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51806b6080>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:11a6a15b-38c1-4e7e-b8fa-2feb6789e775', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WtUCwYzB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 10:24:44 user nova-compute[85141]: WARNING os_brick.initiator.connectors.base [None req-9ff250f7-a5e6-480c-b053-a351f2b26297 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 10:24:44 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-9ff250f7-a5e6-480c-b053-a351f2b26297 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 10:24:44 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-9ff250f7-a5e6-480c-b053-a351f2b26297 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 10:24:44 user nova-compute[85141]: WARNING os_brick.initiator.connectors.base [None req-9ff250f7-a5e6-480c-b053-a351f2b26297 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 10:24:44 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-9ff250f7-a5e6-480c-b053-a351f2b26297 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:11a6a15b-38c1-4e7e-b8fa-2feb6789e775" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 10:24:44 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-9ff250f7-a5e6-480c-b053-a351f2b26297 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:11a6a15b-38c1-4e7e-b8fa-2feb6789e775" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 10:24:44 user nova-compute[85141]: INFO os_brick.initiator.connectors.iscsi [None req-9ff250f7-a5e6-480c-b053-a351f2b26297 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 10:24:44 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11a6a15b-38c1-4e7e-b8fa-2feb6789e775 -p 172.16.0.220:3260 {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:24:44 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11a6a15b-38c1-4e7e-b8fa-2feb6789e775 -p 172.16.0.220:3260" returned: 0 in 0.017s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:24:44 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[d95b90d0-41c5-476c-ae5a-89ba8ff49fe8]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:11a6a15b-38c1-4e7e-b8fa-2feb6789e775\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = WtUCwYzB\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:24:44 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ff250f7-a5e6-480c-b053-a351f2b26297 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 16 10:24:44 user nova-compute[85141]: node.name = iqn.2010-10.org.openstack:11a6a15b-38c1-4e7e-b8fa-2feb6789e775
Nov 16 10:24:44 user nova-compute[85141]: node.tpgt = -1
Nov 16 10:24:44 user nova-compute[85141]: node.startup = automatic
Nov 16 10:24:44 user nova-compute[85141]: node.leading_login = No
Nov 16 10:24:44 user nova-compute[85141]: iface.iscsi_ifacename = default
Nov 16 10:24:44 user nova-compute[85141]: iface.net_ifacename = <empty>
Nov 16 10:24:44 user nova-compute[85141]: iface.ipaddress = <empty>
Nov 16 10:24:44 user nova-compute[85141]: iface.prefix_len = 0
Nov 16 10:24:44 user nova-compute[85141]: iface.hwaddress = <empty>
Nov 16 10:24:44 user nova-compute[85141]: iface.transport_name = tcp
Nov 16 10:24:44 user nova-compute[85141]: iface.initiatorname = <empty>
Nov 16 10:24:44 user nova-compute[85141]: iface.state = <empty>
Nov 16 10:24:44 user nova-compute[85141]: iface.vlan_id = 0
Nov 16 10:24:44 user nova-compute[85141]: iface.vlan_priority = 0
Nov 16 10:24:44 user nova-compute[85141]: iface.vlan_state = <empty>
Nov 16 10:24:44 user nova-compute[85141]: iface.iface_num = 0
Nov 16 10:24:44 user nova-compute[85141]: iface.mtu = 0
Nov 16 10:24:44 user nova-compute[85141]: iface.port = 0
Nov 16 10:24:44 user nova-compute[85141]: iface.bootproto = <empty>
Nov 16 10:24:44 user nova-compute[85141]: iface.subnet_mask = <empty>
Nov 16 10:24:44 user nova-compute[85141]: iface.gateway = <empty>
Nov 16 10:24:44 user nova-compute[85141]: iface.dhcp_alt_client_id_state = <empty>
Nov 16 10:24:44 user nova-compute[85141]: iface.dhcp_alt_client_id = <empty>
Nov 16 10:24:44 user nova-compute[85141]: iface.dhcp_dns = <empty>
Nov 16 10:24:44 user nova-compute[85141]: iface.dhcp_learn_iqn = <empty>
Nov 16 10:24:44 user nova-compute[85141]: iface.dhcp_req_vendor_id_state = <empty>
Nov 16 10:24:44 user nova-compute[85141]: iface.dhcp_vendor_id_state = <empty>
Nov 16 10:24:44 user nova-compute[85141]: iface.dhcp_vendor_id = <empty>
Nov 16 10:24:44 user nova-compute[85141]: iface.dhcp_slp_da = <empty>
Nov 16 10:24:44 user nova-compute[85141]: iface.fragmentation = <empty>
Nov 16 10:24:44 user nova-compute[85141]: iface.gratuitous_arp = <empty>
Nov 16 10:24:44 user nova-compute[85141]: iface.incoming_forwarding = <empty>
Nov 16 10:24:44 user nova-compute[85141]: iface.tos_state = <empty>
Nov 16 10:24:44 user nova-compute[85141]: iface.tos = 0
Nov 16 10:24:44 user nova-compute[85141]: iface.ttl = 0
Nov 16 10:24:44 user nova-compute[85141]: iface.delayed_ack = <empty>
Nov 16 10:24:44 user nova-compute[85141]: iface.tcp_nagle = <empty>
Nov 16 10:24:44 user nova-compute[85141]: iface.tcp_wsf_state = <empty>
Nov 16 10:24:44 user nova-compute[85141]: iface.tcp_wsf = 0
Nov 16 10:24:44 user nova-compute[85141]: iface.tcp_timer_scale = 0
Nov 16 10:24:44 user nova-compute[85141]: iface.tcp_timestamp = <empty>
Nov 16 10:24:44 user nova-compute[85141]: iface.redirect = <empty>
Nov 16 10:24:44 user nova-compute[85141]: iface.def_task_mgmt_timeout = 0
Nov 16 10:24:44 user nova-compute[85141]: iface.header_digest = <empty>
Nov 16 10:24:44 user nova-compute[85141]: iface.data_digest = <empty>
Nov 16 10:24:44 user nova-compute[85141]: iface.immediate_data = <empty>
Nov 16 10:24:44 user nova-compute[85141]: iface.initial_r2t = <empty>
Nov 16 10:24:44 user nova-compute[85141]: iface.data_seq_inorder = <empty>
Nov 16 10:24:44 user nova-compute[85141]: iface.data_pdu_inorder = <empty>
Nov 16 10:24:44 user nova-compute[85141]: iface.erl = 0
Nov 16 10:24:44 user nova-compute[85141]: iface.max_receive_data_len = 0
Nov 16 10:24:44 user nova-compute[85141]: iface.first_burst_len = 0
Nov 16 10:24:44 user nova-compute[85141]: iface.max_outstanding_r2t = 0
Nov 16 10:24:44 user nova-compute[85141]: iface.max_burst_len = 0
Nov 16 10:24:44 user nova-compute[85141]: iface.chap_auth = <empty>
Nov 16 10:24:44 user nova-compute[85141]: iface.bidi_chap = <empty>
Nov 16 10:24:44 user nova-compute[85141]: iface.strict_login_compliance = <empty>
Nov 16 10:24:44 user nova-compute[85141]: iface.discovery_auth = <empty>
Nov 16 10:24:44 user nova-compute[85141]: iface.discovery_logout = <empty>
Nov 16 10:24:44 user nova-compute[85141]: node.discovery_address = <empty>
Nov 16 10:24:44 user nova-compute[85141]: node.discovery_port = 0
Nov 16 10:24:44 user nova-compute[85141]: node.discovery_type = static
Nov 16 10:24:44 user nova-compute[85141]: node.session.initial_cmdsn = 0
Nov 16 10:24:44 user nova-compute[85141]: node.session.initial_login_retry_max = 8
Nov 16 10:24:44 user nova-compute[85141]: node.session.xmit_thread_priority = -20
Nov 16 10:24:44 user nova-compute[85141]: node.session.cmds_max = 128
Nov 16 10:24:44 user nova-compute[85141]: node.session.queue_depth = 32
Nov 16 10:24:44 user nova-compute[85141]: node.session.nr_sessions = 1
Nov 16 10:24:44 user nova-compute[85141]: node.session.auth.authmethod = CHAP
Nov 16 10:24:44 user nova-compute[85141]: node.session.auth.username = WtUCwYzB
Nov 16 10:24:44 user nova-compute[85141]: node.session.auth.password = ***
Nov 16 10:24:44 user nova-compute[85141]: node.session.auth.username_in = <empty>
Nov 16 10:24:44 user nova-compute[85141]: node.session.auth.password_in = <empty>
Nov 16 10:24:44 user nova-compute[85141]: node.session.auth.chap_algs = MD5
Nov 16 10:24:44 user nova-compute[85141]: node.session.timeo.replacement_timeout = 120
Nov 16 10:24:44 user nova-compute[85141]: node.session.err_timeo.abort_timeout = 15
Nov 16 10:24:44 user nova-compute[85141]: node.session.err_timeo.lu_reset_timeout = 30
Nov 16 10:24:44 user nova-compute[85141]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 16 10:24:44 user nova-compute[85141]: node.session.err_timeo.host_reset_timeout = 60
Nov 16 10:24:44 user nova-compute[85141]: node.session.iscsi.FastAbort = Yes
Nov 16 10:24:44 user nova-compute[85141]: node.session.iscsi.InitialR2T = No
Nov 16 10:24:44 user nova-compute[85141]: node.session.iscsi.ImmediateData = Yes
Nov 16 10:24:44 user nova-compute[85141]: node.session.iscsi.FirstBurstLength = 262144
Nov 16 10:24:44 user nova-compute[85141]: node.session.iscsi.MaxBurstLength = 16776192
Nov 16 10:24:44 user nova-compute[85141]: node.session.iscsi.DefaultTime2Retain = 0
Nov 16 10:24:44 user nova-compute[85141]: node.session.iscsi.DefaultTime2Wait = 2
Nov 16 10:24:44 user nova-compute[85141]: node.session.iscsi.MaxConnections = 1
Nov 16 10:24:44 user nova-compute[85141]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 16 10:24:44 user nova-compute[85141]: node.session.iscsi.ERL = 0
Nov 16 10:24:44 user nova-compute[85141]: node.session.scan = manual
Nov 16 10:24:44 user nova-compute[85141]: node.session.reopen_max = 0
Nov 16 10:24:44 user nova-compute[85141]: node.conn[0].address = 172.16.0.220
Nov 16 10:24:44 user nova-compute[85141]: node.conn[0].port = 3260
Nov 16 10:24:44 user nova-compute[85141]: node.conn[0].startup = manual
Nov 16 10:24:44 user nova-compute[85141]: node.conn[0].tcp.window_size = 524288
Nov 16 10:24:44 user nova-compute[85141]: node.conn[0].tcp.type_of_service = 0
Nov 16 10:24:44 user nova-compute[85141]: node.conn[0].timeo.logout_timeout = 15
Nov 16 10:24:44 user nova-compute[85141]: node.conn[0].timeo.login_timeout = 15
Nov 16 10:24:44 user nova-compute[85141]: node.conn[0].timeo.auth_timeout = 45
Nov 16 10:24:44 user nova-compute[85141]: node.conn[0].timeo.noop_out_interval = 5
Nov 16 10:24:44 user nova-compute[85141]: node.conn[0].timeo.noop_out_timeout = 5
Nov 16 10:24:44 user nova-compute[85141]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 16 10:24:44 user nova-compute[85141]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 16 10:24:44 user nova-compute[85141]: node.conn[0].iscsi.HeaderDigest = None
Nov 16 10:24:44 user nova-compute[85141]: node.conn[0].iscsi.DataDigest = None
Nov 16 10:24:44 user nova-compute[85141]: node.conn[0].iscsi.IFMarker = No
Nov 16 10:24:44 user nova-compute[85141]: node.conn[0].iscsi.OFMarker = No
Nov 16 10:24:44 user nova-compute[85141]: # END RECORD
Nov 16 10:24:44 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:24:44 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11a6a15b-38c1-4e7e-b8fa-2feb6789e775 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:24:44 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11a6a15b-38c1-4e7e-b8fa-2feb6789e775 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:24:44 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a6b3378-2589-474c-afab-448a9d467148]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:24:44 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ff250f7-a5e6-480c-b053-a351f2b26297 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:24:44 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11a6a15b-38c1-4e7e-b8fa-2feb6789e775 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:24:44 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11a6a15b-38c1-4e7e-b8fa-2feb6789e775 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:24:44 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[80312c16-766e-4942-bd64-31f9b52bc645]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:24:44 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ff250f7-a5e6-480c-b053-a351f2b26297 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:24:44 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11a6a15b-38c1-4e7e-b8fa-2feb6789e775 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WtUCwYzB {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:24:44 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11a6a15b-38c1-4e7e-b8fa-2feb6789e775 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WtUCwYzB" returned: 0 in 0.021s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:24:44 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[a19e8de4-271b-4dab-a2d6-ea23de871e8e]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:24:44 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ff250f7-a5e6-480c-b053-a351f2b26297 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WtUCwYzB'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:24:44 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11a6a15b-38c1-4e7e-b8fa-2feb6789e775 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:24:44 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11a6a15b-38c1-4e7e-b8fa-2feb6789e775 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:24:44 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c65be1c-2798-4d17-9ca7-c2bb9d664ecb]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:24:44 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ff250f7-a5e6-480c-b053-a351f2b26297 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:24:44 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:24:44 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:24:44 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cac7976-4264-4835-b4fa-f4d946590276]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11a6a15b-38c1-4e7e-b8fa-2feb6789e775 (non-flash)\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:24:44 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ff250f7-a5e6-480c-b053-a351f2b26297 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)
Nov 16 10:24:44 user nova-compute[85141]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11a6a15b-38c1-4e7e-b8fa-2feb6789e775 (non-flash)
Nov 16 10:24:44 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:24:44 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ff250f7-a5e6-480c-b053-a351f2b26297 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)
Nov 16 10:24:44 user nova-compute[85141]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11a6a15b-38c1-4e7e-b8fa-2feb6789e775 (non-flash)
Nov 16 10:24:44 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 10:24:44 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-9ff250f7-a5e6-480c-b053-a351f2b26297 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:11a6a15b-38c1-4e7e-b8fa-2feb6789e775" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.132s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 10:24:44 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ff250f7-a5e6-480c-b053-a351f2b26297 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Connected to 172.16.0.220:3260 {{(pid=85141) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 10:24:44 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-9ff250f7-a5e6-480c-b053-a351f2b26297 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] HCTL ('35', '0', '0', 0) found on session 35 with lun 0 {{(pid=85141) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 10:24:44 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-9ff250f7-a5e6-480c-b053-a351f2b26297 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Scanning host 35 c: 0, t: 0, l: 0) {{(pid=85141) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 10:24:44 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:24:44 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.014s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:24:44 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[40d99378-5ee2-41bf-ab4a-9fc59cee0fe3]: (4, ('0 0 0', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:24:44 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-9ff250f7-a5e6-480c-b053-a351f2b26297 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Searching for a device in session 35 and hctl ('35', '0', '0', 0) yield: sdd {{(pid=85141) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 10:24:44 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ff250f7-a5e6-480c-b053-a351f2b26297 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:11a6a15b-38c1-4e7e-b8fa-2feb6789e775', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WtUCwYzB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=85141) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 10:24:44 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-9ff250f7-a5e6-480c-b053-a351f2b26297 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.155s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 10:24:44 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ff250f7-a5e6-480c-b053-a351f2b26297 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] <== connect_volume: return (157ms) {'type': 'block', 'scsi_wwn': '26637656466636334', 'path': '/dev/sdd'} {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 10:24:44 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ff250f7-a5e6-480c-b053-a351f2b26297 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] [instance: abe5d4b7-a0d7-40e3-b630-0de746ddb55b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26637656466636334', 'path': '/dev/sdd'} {{(pid=85141) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 10:24:44 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-9ff250f7-a5e6-480c-b053-a351f2b26297 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T10:22:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-845278396',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-845278396',id=28,image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-16T10:23:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='733b504d4dbe4f028963cf2c197f0064',ramdisk_id='',reservation_id='r-qwti326h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-742384119',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T10:23:07Z,user_data=None,user_id='ffe6ceff3cc346b59b4fbf294b9fc1a3',uuid=abe5d4b7-a0d7-40e3-b630-0de746ddb55b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e583d579-7583-4f41-b0f1-b3241b6af956", "address": "fa:16:3e:4d:24:64", "network": {"id": "e40e4bd2-4277-40b1-9451-1c8365ffa488", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1333036447-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1333036447-network", "vif_mac": "fa:16:3e:4d:24:64"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "733b504d4dbe4f028963cf2c197f0064", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape583d579-75", "ovs_interfaceid": "e583d579-7583-4f41-b0f1-b3241b6af956", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=85141) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 10:24:44 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-9ff250f7-a5e6-480c-b053-a351f2b26297 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Converting VIF {"id": "e583d579-7583-4f41-b0f1-b3241b6af956", "address": "fa:16:3e:4d:24:64", "network": {"id": "e40e4bd2-4277-40b1-9451-1c8365ffa488", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1333036447-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1333036447-network", "vif_mac": "fa:16:3e:4d:24:64"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "733b504d4dbe4f028963cf2c197f0064", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape583d579-75", "ovs_interfaceid": "e583d579-7583-4f41-b0f1-b3241b6af956", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:24:44 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-9ff250f7-a5e6-480c-b053-a351f2b26297 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4d:24:64,bridge_name='br-int',has_traffic_filtering=True,id=e583d579-7583-4f41-b0f1-b3241b6af956,network=Network(e40e4bd2-4277-40b1-9451-1c8365ffa488),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape583d579-75') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:24:44 user nova-compute[85141]: DEBUG nova.objects.instance [None req-9ff250f7-a5e6-480c-b053-a351f2b26297 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Lazy-loading 'pci_devices' on Instance uuid abe5d4b7-a0d7-40e3-b630-0de746ddb55b {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:24:44 user nova-compute[85141]: DEBUG nova.objects.base [None req-9ff250f7-a5e6-480c-b053-a351f2b26297 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Object Instance<abe5d4b7-a0d7-40e3-b630-0de746ddb55b> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=85141) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 10:24:44 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-9ff250f7-a5e6-480c-b053-a351f2b26297 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] [instance: abe5d4b7-a0d7-40e3-b630-0de746ddb55b] End _get_guest_xml xml=<domain type="kvm">
Nov 16 10:24:44 user nova-compute[85141]:   <uuid>abe5d4b7-a0d7-40e3-b630-0de746ddb55b</uuid>
Nov 16 10:24:44 user nova-compute[85141]:   <name>instance-0000001c</name>
Nov 16 10:24:44 user nova-compute[85141]:   <memory>524288</memory>
Nov 16 10:24:44 user nova-compute[85141]:   <vcpu>1</vcpu>
Nov 16 10:24:44 user nova-compute[85141]:   <metadata>
Nov 16 10:24:44 user nova-compute[85141]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 10:24:44 user nova-compute[85141]:       <nova:package version="0.0.0"/>
Nov 16 10:24:44 user nova-compute[85141]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-845278396</nova:name>
Nov 16 10:24:44 user nova-compute[85141]:       <nova:creationTime>2023-11-16 10:24:44</nova:creationTime>
Nov 16 10:24:44 user nova-compute[85141]:       <nova:flavor name="m1.tiny">
Nov 16 10:24:44 user nova-compute[85141]:         <nova:memory>512</nova:memory>
Nov 16 10:24:44 user nova-compute[85141]:         <nova:disk>1</nova:disk>
Nov 16 10:24:44 user nova-compute[85141]:         <nova:swap>0</nova:swap>
Nov 16 10:24:44 user nova-compute[85141]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 10:24:44 user nova-compute[85141]:         <nova:vcpus>1</nova:vcpus>
Nov 16 10:24:44 user nova-compute[85141]:       </nova:flavor>
Nov 16 10:24:44 user nova-compute[85141]:       <nova:owner>
Nov 16 10:24:44 user nova-compute[85141]:         <nova:user uuid="ffe6ceff3cc346b59b4fbf294b9fc1a3">tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member</nova:user>
Nov 16 10:24:44 user nova-compute[85141]:         <nova:project uuid="733b504d4dbe4f028963cf2c197f0064">tempest-ServerBootFromVolumeStableRescueTest-742384119</nova:project>
Nov 16 10:24:44 user nova-compute[85141]:       </nova:owner>
Nov 16 10:24:44 user nova-compute[85141]:       <nova:root type="image" uuid="bc4ca70f-a459-4d5c-a9e6-80f1948eb48b"/>
Nov 16 10:24:44 user nova-compute[85141]:       <nova:ports>
Nov 16 10:24:44 user nova-compute[85141]:         <nova:port uuid="e583d579-7583-4f41-b0f1-b3241b6af956">
Nov 16 10:24:44 user nova-compute[85141]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 16 10:24:44 user nova-compute[85141]:         </nova:port>
Nov 16 10:24:44 user nova-compute[85141]:       </nova:ports>
Nov 16 10:24:44 user nova-compute[85141]:     </nova:instance>
Nov 16 10:24:44 user nova-compute[85141]:   </metadata>
Nov 16 10:24:44 user nova-compute[85141]:   <sysinfo type="smbios">
Nov 16 10:24:44 user nova-compute[85141]:     <system>
Nov 16 10:24:44 user nova-compute[85141]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 10:24:44 user nova-compute[85141]:       <entry name="product">OpenStack Nova</entry>
Nov 16 10:24:44 user nova-compute[85141]:       <entry name="version">0.0.0</entry>
Nov 16 10:24:44 user nova-compute[85141]:       <entry name="serial">abe5d4b7-a0d7-40e3-b630-0de746ddb55b</entry>
Nov 16 10:24:44 user nova-compute[85141]:       <entry name="uuid">abe5d4b7-a0d7-40e3-b630-0de746ddb55b</entry>
Nov 16 10:24:44 user nova-compute[85141]:       <entry name="family">Virtual Machine</entry>
Nov 16 10:24:44 user nova-compute[85141]:     </system>
Nov 16 10:24:44 user nova-compute[85141]:   </sysinfo>
Nov 16 10:24:44 user nova-compute[85141]:   <os>
Nov 16 10:24:44 user nova-compute[85141]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 10:24:44 user nova-compute[85141]:     <smbios mode="sysinfo"/>
Nov 16 10:24:44 user nova-compute[85141]:   </os>
Nov 16 10:24:44 user nova-compute[85141]:   <features>
Nov 16 10:24:44 user nova-compute[85141]:     <acpi/>
Nov 16 10:24:44 user nova-compute[85141]:     <apic/>
Nov 16 10:24:44 user nova-compute[85141]:     <vmcoreinfo/>
Nov 16 10:24:44 user nova-compute[85141]:   </features>
Nov 16 10:24:44 user nova-compute[85141]:   <clock offset="utc">
Nov 16 10:24:44 user nova-compute[85141]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 10:24:44 user nova-compute[85141]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 10:24:44 user nova-compute[85141]:     <timer name="hpet" present="no"/>
Nov 16 10:24:44 user nova-compute[85141]:   </clock>
Nov 16 10:24:44 user nova-compute[85141]:   <cpu mode="custom" match="exact">
Nov 16 10:24:44 user nova-compute[85141]:     <model>Nehalem</model>
Nov 16 10:24:44 user nova-compute[85141]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 10:24:44 user nova-compute[85141]:   </cpu>
Nov 16 10:24:44 user nova-compute[85141]:   <devices>
Nov 16 10:24:44 user nova-compute[85141]:     <disk type="block" device="disk">
Nov 16 10:24:44 user nova-compute[85141]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 10:24:44 user nova-compute[85141]:       <source dev="/dev/sdd"/>
Nov 16 10:24:44 user nova-compute[85141]:       <target dev="vda" bus="virtio"/>
Nov 16 10:24:44 user nova-compute[85141]:       <serial>11a6a15b-38c1-4e7e-b8fa-2feb6789e775</serial>
Nov 16 10:24:44 user nova-compute[85141]:     </disk>
Nov 16 10:24:44 user nova-compute[85141]:     <disk type="file" device="disk">
Nov 16 10:24:44 user nova-compute[85141]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 10:24:44 user nova-compute[85141]:       <source file="/opt/stack/data/nova/instances/abe5d4b7-a0d7-40e3-b630-0de746ddb55b/disk.rescue"/>
Nov 16 10:24:44 user nova-compute[85141]:       <target dev="vdb" bus="virtio"/>
Nov 16 10:24:44 user nova-compute[85141]:       <boot order="1"/>
Nov 16 10:24:44 user nova-compute[85141]:     </disk>
Nov 16 10:24:44 user nova-compute[85141]:     <interface type="ethernet">
Nov 16 10:24:44 user nova-compute[85141]:       <mac address="fa:16:3e:4d:24:64"/>
Nov 16 10:24:44 user nova-compute[85141]:       <model type="virtio"/>
Nov 16 10:24:44 user nova-compute[85141]:       <mtu size="1442"/>
Nov 16 10:24:44 user nova-compute[85141]:       <target dev="tape583d579-75"/>
Nov 16 10:24:44 user nova-compute[85141]:     </interface>
Nov 16 10:24:44 user nova-compute[85141]:     <serial type="pty">
Nov 16 10:24:44 user nova-compute[85141]:       <log file="/opt/stack/data/nova/instances/abe5d4b7-a0d7-40e3-b630-0de746ddb55b/console.log" append="off"/>
Nov 16 10:24:44 user nova-compute[85141]:     </serial>
Nov 16 10:24:44 user nova-compute[85141]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 10:24:44 user nova-compute[85141]:     <video>
Nov 16 10:24:44 user nova-compute[85141]:       <model type="virtio"/>
Nov 16 10:24:44 user nova-compute[85141]:     </video>
Nov 16 10:24:44 user nova-compute[85141]:     <rng model="virtio">
Nov 16 10:24:44 user nova-compute[85141]:       <backend model="random">/dev/urandom</backend>
Nov 16 10:24:44 user nova-compute[85141]:     </rng>
Nov 16 10:24:44 user nova-compute[85141]:     <controller type="usb" index="0" model="none"/>
Nov 16 10:24:44 user nova-compute[85141]:     <memballoon model="virtio">
Nov 16 10:24:44 user nova-compute[85141]:       <stats period="10"/>
Nov 16 10:24:44 user nova-compute[85141]:     </memballoon>
Nov 16 10:24:44 user nova-compute[85141]:   </devices>
Nov 16 10:24:44 user nova-compute[85141]: </domain>
Nov 16 10:24:44 user nova-compute[85141]:  {{(pid=85141) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 10:24:44 user nova-compute[85141]: INFO nova.virt.libvirt.driver [-] [instance: abe5d4b7-a0d7-40e3-b630-0de746ddb55b] Instance destroyed successfully.
Nov 16 10:24:44 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-9ff250f7-a5e6-480c-b053-a351f2b26297 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] No BDM found with device name vda, not building metadata. {{(pid=85141) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 10:24:44 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-9ff250f7-a5e6-480c-b053-a351f2b26297 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] No BDM found with device name vdb, not building metadata. {{(pid=85141) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 10:24:44 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-9ff250f7-a5e6-480c-b053-a351f2b26297 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] No VIF found with MAC fa:16:3e:4d:24:64, not building metadata {{(pid=85141) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 10:24:45 user nova-compute[85141]: DEBUG nova.compute.manager [req-52a5aea7-ac2c-4469-94f5-4d5d6b048c92 req-d8eda50a-774e-4fcc-8d0b-8b8ff904b20d service nova] [instance: dfe84cd6-628a-484e-b266-34e2abe890f2] Received event network-changed-e3463cf8-10c0-4465-95d8-28248f06c3c1 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:24:45 user nova-compute[85141]: DEBUG nova.compute.manager [req-52a5aea7-ac2c-4469-94f5-4d5d6b048c92 req-d8eda50a-774e-4fcc-8d0b-8b8ff904b20d service nova] [instance: dfe84cd6-628a-484e-b266-34e2abe890f2] Refreshing instance network info cache due to event network-changed-e3463cf8-10c0-4465-95d8-28248f06c3c1. {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 10:24:45 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-52a5aea7-ac2c-4469-94f5-4d5d6b048c92 req-d8eda50a-774e-4fcc-8d0b-8b8ff904b20d service nova] Acquiring lock "refresh_cache-dfe84cd6-628a-484e-b266-34e2abe890f2" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:24:45 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-52a5aea7-ac2c-4469-94f5-4d5d6b048c92 req-d8eda50a-774e-4fcc-8d0b-8b8ff904b20d service nova] Acquired lock "refresh_cache-dfe84cd6-628a-484e-b266-34e2abe890f2" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:24:45 user nova-compute[85141]: DEBUG nova.network.neutron [req-52a5aea7-ac2c-4469-94f5-4d5d6b048c92 req-d8eda50a-774e-4fcc-8d0b-8b8ff904b20d service nova] [instance: dfe84cd6-628a-484e-b266-34e2abe890f2] Refreshing network info cache for port e3463cf8-10c0-4465-95d8-28248f06c3c1 {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 10:24:45 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:24:46 user nova-compute[85141]: DEBUG nova.network.neutron [req-52a5aea7-ac2c-4469-94f5-4d5d6b048c92 req-d8eda50a-774e-4fcc-8d0b-8b8ff904b20d service nova] [instance: dfe84cd6-628a-484e-b266-34e2abe890f2] Updated VIF entry in instance network info cache for port e3463cf8-10c0-4465-95d8-28248f06c3c1. {{(pid=85141) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 10:24:46 user nova-compute[85141]: DEBUG nova.network.neutron [req-52a5aea7-ac2c-4469-94f5-4d5d6b048c92 req-d8eda50a-774e-4fcc-8d0b-8b8ff904b20d service nova] [instance: dfe84cd6-628a-484e-b266-34e2abe890f2] Updating instance_info_cache with network_info: [{"id": "e3463cf8-10c0-4465-95d8-28248f06c3c1", "address": "fa:16:3e:66:21:97", "network": {"id": "b8ada47f-9721-4358-ac4f-0305f06dbbb8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1663922860-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aec3bb9fe5e6446590900b5adf65df0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3463cf8-10", "ovs_interfaceid": "e3463cf8-10c0-4465-95d8-28248f06c3c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:24:46 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-52a5aea7-ac2c-4469-94f5-4d5d6b048c92 req-d8eda50a-774e-4fcc-8d0b-8b8ff904b20d service nova] Releasing lock "refresh_cache-dfe84cd6-628a-484e-b266-34e2abe890f2" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:24:46 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:24:46 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:24:46 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:24:46 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:24:46 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:24:46 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:24:46 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:24:47 user nova-compute[85141]: DEBUG nova.compute.manager [req-843aafcb-edbb-46d8-a4f7-7e5db40dcf98 req-477b1077-f296-4165-ae7e-681ad51c5da5 service nova] [instance: abe5d4b7-a0d7-40e3-b630-0de746ddb55b] Received event network-vif-plugged-e583d579-7583-4f41-b0f1-b3241b6af956 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:24:47 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-843aafcb-edbb-46d8-a4f7-7e5db40dcf98 req-477b1077-f296-4165-ae7e-681ad51c5da5 service nova] Acquiring lock "abe5d4b7-a0d7-40e3-b630-0de746ddb55b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:24:47 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-843aafcb-edbb-46d8-a4f7-7e5db40dcf98 req-477b1077-f296-4165-ae7e-681ad51c5da5 service nova] Lock "abe5d4b7-a0d7-40e3-b630-0de746ddb55b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:24:47 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-843aafcb-edbb-46d8-a4f7-7e5db40dcf98 req-477b1077-f296-4165-ae7e-681ad51c5da5 service nova] Lock "abe5d4b7-a0d7-40e3-b630-0de746ddb55b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:24:47 user nova-compute[85141]: DEBUG nova.compute.manager [req-843aafcb-edbb-46d8-a4f7-7e5db40dcf98 req-477b1077-f296-4165-ae7e-681ad51c5da5 service nova] [instance: abe5d4b7-a0d7-40e3-b630-0de746ddb55b] No waiting events found dispatching network-vif-plugged-e583d579-7583-4f41-b0f1-b3241b6af956 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:24:47 user nova-compute[85141]: WARNING nova.compute.manager [req-843aafcb-edbb-46d8-a4f7-7e5db40dcf98 req-477b1077-f296-4165-ae7e-681ad51c5da5 service nova] [instance: abe5d4b7-a0d7-40e3-b630-0de746ddb55b] Received unexpected event network-vif-plugged-e583d579-7583-4f41-b0f1-b3241b6af956 for instance with vm_state active and task_state rescuing.
Nov 16 10:24:47 user nova-compute[85141]: DEBUG nova.compute.manager [req-843aafcb-edbb-46d8-a4f7-7e5db40dcf98 req-477b1077-f296-4165-ae7e-681ad51c5da5 service nova] [instance: abe5d4b7-a0d7-40e3-b630-0de746ddb55b] Received event network-vif-plugged-e583d579-7583-4f41-b0f1-b3241b6af956 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:24:47 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-843aafcb-edbb-46d8-a4f7-7e5db40dcf98 req-477b1077-f296-4165-ae7e-681ad51c5da5 service nova] Acquiring lock "abe5d4b7-a0d7-40e3-b630-0de746ddb55b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:24:47 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-843aafcb-edbb-46d8-a4f7-7e5db40dcf98 req-477b1077-f296-4165-ae7e-681ad51c5da5 service nova] Lock "abe5d4b7-a0d7-40e3-b630-0de746ddb55b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:24:47 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-843aafcb-edbb-46d8-a4f7-7e5db40dcf98 req-477b1077-f296-4165-ae7e-681ad51c5da5 service nova] Lock "abe5d4b7-a0d7-40e3-b630-0de746ddb55b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:24:47 user nova-compute[85141]: DEBUG nova.compute.manager [req-843aafcb-edbb-46d8-a4f7-7e5db40dcf98 req-477b1077-f296-4165-ae7e-681ad51c5da5 service nova] [instance: abe5d4b7-a0d7-40e3-b630-0de746ddb55b] No waiting events found dispatching network-vif-plugged-e583d579-7583-4f41-b0f1-b3241b6af956 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:24:47 user nova-compute[85141]: WARNING nova.compute.manager [req-843aafcb-edbb-46d8-a4f7-7e5db40dcf98 req-477b1077-f296-4165-ae7e-681ad51c5da5 service nova] [instance: abe5d4b7-a0d7-40e3-b630-0de746ddb55b] Received unexpected event network-vif-plugged-e583d579-7583-4f41-b0f1-b3241b6af956 for instance with vm_state active and task_state rescuing.
Nov 16 10:24:47 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:24:48 user nova-compute[85141]: DEBUG nova.compute.manager [None req-9ff250f7-a5e6-480c-b053-a351f2b26297 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] [instance: abe5d4b7-a0d7-40e3-b630-0de746ddb55b] Checking state {{(pid=85141) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 10:24:49 user nova-compute[85141]: DEBUG nova.compute.manager [None req-13d0dcf3-3045-416f-b172-0205186032e1 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: dfe84cd6-628a-484e-b266-34e2abe890f2] Start spawning the instance on the hypervisor. {{(pid=85141) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 10:24:49 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-13d0dcf3-3045-416f-b172-0205186032e1 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: dfe84cd6-628a-484e-b266-34e2abe890f2] Creating instance directory {{(pid=85141) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 10:24:49 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-13d0dcf3-3045-416f-b172-0205186032e1 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: dfe84cd6-628a-484e-b266-34e2abe890f2] Creating image(s)
Nov 16 10:24:49 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-13d0dcf3-3045-416f-b172-0205186032e1 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: dfe84cd6-628a-484e-b266-34e2abe890f2] Did not create local disks {{(pid=85141) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 16 10:24:49 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-13d0dcf3-3045-416f-b172-0205186032e1 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: dfe84cd6-628a-484e-b266-34e2abe890f2] Ensure instance console log exists: /opt/stack/data/nova/instances/dfe84cd6-628a-484e-b266-34e2abe890f2/console.log {{(pid=85141) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 10:24:49 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-13d0dcf3-3045-416f-b172-0205186032e1 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:24:49 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-13d0dcf3-3045-416f-b172-0205186032e1 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:24:49 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-13d0dcf3-3045-416f-b172-0205186032e1 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:24:49 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-13d0dcf3-3045-416f-b172-0205186032e1 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: dfe84cd6-628a-484e-b266-34e2abe890f2] Start _get_guest_xml network_info=[{"id": "e3463cf8-10c0-4465-95d8-28248f06c3c1", "address": "fa:16:3e:66:21:97", "network": {"id": "b8ada47f-9721-4358-ac4f-0305f06dbbb8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1663922860-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aec3bb9fe5e6446590900b5adf65df0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3463cf8-10", "ovs_interfaceid": "e3463cf8-10c0-4465-95d8-28248f06c3c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:9bc0a873-d872-4f63-9af6-b4ac71162eeb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jxsmXgGt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'dfe84cd6-628a-484e-b266-34e2abe890f2', 'attached_at': '', 'detached_at': '', 'volume_id': '9bc0a873-d872-4f63-9af6-b4ac71162eeb', 'serial': '9bc0a873-d872-4f63-9af6-b4ac71162eeb'}, 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'attachment_id': '14e523d1-b794-4e49-a813-eb6aa8210a82', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=85141) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 10:24:49 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-13d0dcf3-3045-416f-b172-0205186032e1 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:24:49 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-13d0dcf3-3045-416f-b172-0205186032e1 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:24:49 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-13d0dcf3-3045-416f-b172-0205186032e1 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=85141) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 10:24:49 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-13d0dcf3-3045-416f-b172-0205186032e1 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] CPU controller missing on host. {{(pid=85141) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 10:24:49 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-13d0dcf3-3045-416f-b172-0205186032e1 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=85141) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 10:24:49 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-13d0dcf3-3045-416f-b172-0205186032e1 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] CPU controller found on host. {{(pid=85141) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 10:24:49 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-13d0dcf3-3045-416f-b172-0205186032e1 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=85141) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 10:24:49 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-13d0dcf3-3045-416f-b172-0205186032e1 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T10:06:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 10:24:49 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-13d0dcf3-3045-416f-b172-0205186032e1 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Flavor limits 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 10:24:49 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-13d0dcf3-3045-416f-b172-0205186032e1 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Image limits 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 10:24:49 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-13d0dcf3-3045-416f-b172-0205186032e1 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Flavor pref 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 10:24:49 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-13d0dcf3-3045-416f-b172-0205186032e1 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Image pref 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 10:24:49 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-13d0dcf3-3045-416f-b172-0205186032e1 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 10:24:49 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-13d0dcf3-3045-416f-b172-0205186032e1 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 10:24:49 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-13d0dcf3-3045-416f-b172-0205186032e1 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=85141) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 10:24:49 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-13d0dcf3-3045-416f-b172-0205186032e1 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Got 1 possible topologies {{(pid=85141) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 10:24:49 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-13d0dcf3-3045-416f-b172-0205186032e1 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 10:24:49 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-13d0dcf3-3045-416f-b172-0205186032e1 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 10:24:49 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-13d0dcf3-3045-416f-b172-0205186032e1 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: dfe84cd6-628a-484e-b266-34e2abe890f2] Calling os-brick to attach iSCSI Volume {{(pid=85141) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 10:24:49 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-13d0dcf3-3045-416f-b172-0205186032e1 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51806b6080>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9bc0a873-d872-4f63-9af6-b4ac71162eeb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jxsmXgGt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 10:24:49 user nova-compute[85141]: WARNING os_brick.initiator.connectors.base [None req-13d0dcf3-3045-416f-b172-0205186032e1 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 10:24:49 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-13d0dcf3-3045-416f-b172-0205186032e1 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 10:24:49 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-13d0dcf3-3045-416f-b172-0205186032e1 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 10:24:49 user nova-compute[85141]: WARNING os_brick.initiator.connectors.base [None req-13d0dcf3-3045-416f-b172-0205186032e1 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 10:24:49 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-13d0dcf3-3045-416f-b172-0205186032e1 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9bc0a873-d872-4f63-9af6-b4ac71162eeb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 10:24:49 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-13d0dcf3-3045-416f-b172-0205186032e1 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9bc0a873-d872-4f63-9af6-b4ac71162eeb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 10:24:49 user nova-compute[85141]: INFO os_brick.initiator.connectors.iscsi [None req-13d0dcf3-3045-416f-b172-0205186032e1 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 10:24:49 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9bc0a873-d872-4f63-9af6-b4ac71162eeb -p 172.16.0.220:3260 {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:24:49 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9bc0a873-d872-4f63-9af6-b4ac71162eeb -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:24:49 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5eb4e24-0d62-4517-894b-189f053bd09f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:24:49 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-13d0dcf3-3045-416f-b172-0205186032e1 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 10:24:49 user nova-compute[85141]:  {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:24:49 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9bc0a873-d872-4f63-9af6-b4ac71162eeb -p 172.16.0.220:3260 --interface default --op new {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:24:49 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9bc0a873-d872-4f63-9af6-b4ac71162eeb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:24:49 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[94d07be5-ab22-4058-a843-414439f91f61]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9bc0a873-d872-4f63-9af6-b4ac71162eeb] added\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:24:49 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-13d0dcf3-3045-416f-b172-0205186032e1 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9bc0a873-d872-4f63-9af6-b4ac71162eeb] added
Nov 16 10:24:49 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:24:49 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9bc0a873-d872-4f63-9af6-b4ac71162eeb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:24:49 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9bc0a873-d872-4f63-9af6-b4ac71162eeb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:24:49 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[d888985f-8e9d-46a0-9126-bc1501b9cfb8]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:24:49 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-13d0dcf3-3045-416f-b172-0205186032e1 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:24:49 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9bc0a873-d872-4f63-9af6-b4ac71162eeb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:24:49 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9bc0a873-d872-4f63-9af6-b4ac71162eeb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:24:49 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[83e4ebce-5489-4039-8aa7-8dd6c27eace4]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:24:49 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-13d0dcf3-3045-416f-b172-0205186032e1 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:24:49 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9bc0a873-d872-4f63-9af6-b4ac71162eeb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jxsmXgGt {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:24:49 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9bc0a873-d872-4f63-9af6-b4ac71162eeb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jxsmXgGt" returned: 0 in 0.017s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:24:49 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[553e3eb9-2fc8-4018-a3d9-21331feaf6d7]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:24:49 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-13d0dcf3-3045-416f-b172-0205186032e1 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jxsmXgGt'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:24:49 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9bc0a873-d872-4f63-9af6-b4ac71162eeb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:24:49 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9bc0a873-d872-4f63-9af6-b4ac71162eeb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.028s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:24:49 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b905cbb-49e6-4fd0-bfb6-d1fd65841ea4]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:24:49 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-13d0dcf3-3045-416f-b172-0205186032e1 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:24:49 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:24:49 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:24:49 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8c5bd1b-9edb-4f12-bd42-c72c5ffb5e47]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11a6a15b-38c1-4e7e-b8fa-2feb6789e775 (non-flash)\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:24:49 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-13d0dcf3-3045-416f-b172-0205186032e1 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)
Nov 16 10:24:49 user nova-compute[85141]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11a6a15b-38c1-4e7e-b8fa-2feb6789e775 (non-flash)
Nov 16 10:24:49 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:24:49 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-13d0dcf3-3045-416f-b172-0205186032e1 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)
Nov 16 10:24:49 user nova-compute[85141]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11a6a15b-38c1-4e7e-b8fa-2feb6789e775 (non-flash)
Nov 16 10:24:49 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 10:24:49 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9bc0a873-d872-4f63-9af6-b4ac71162eeb -p 172.16.0.220:3260 --login {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:24:49 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9bc0a873-d872-4f63-9af6-b4ac71162eeb -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:24:49 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[8209f1c0-8084-4ef8-8243-d6795252a573]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9bc0a873-d872-4f63-9af6-b4ac71162eeb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9bc0a873-d872-4f63-9af6-b4ac71162eeb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:24:49 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-13d0dcf3-3045-416f-b172-0205186032e1 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9bc0a873-d872-4f63-9af6-b4ac71162eeb, portal: 172.16.0.220,3260]
Nov 16 10:24:49 user nova-compute[85141]: Login to [iface: default, target: iqn.2010-10.org.openstack:9bc0a873-d872-4f63-9af6-b4ac71162eeb, portal: 172.16.0.220,3260] successful.
Nov 16 10:24:49 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:24:49 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9bc0a873-d872-4f63-9af6-b4ac71162eeb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:24:49 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9bc0a873-d872-4f63-9af6-b4ac71162eeb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:24:49 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[1113a550-69b2-4ade-bb3f-a7180610ade7]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:24:49 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-13d0dcf3-3045-416f-b172-0205186032e1 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:24:49 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:24:49 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:24:49 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf543637-6705-4dbd-a8ab-ceb957f3944f]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11a6a15b-38c1-4e7e-b8fa-2feb6789e775 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bc0a873-d872-4f63-9af6-b4ac71162eeb (non-flash)\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:24:49 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-13d0dcf3-3045-416f-b172-0205186032e1 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)
Nov 16 10:24:49 user nova-compute[85141]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11a6a15b-38c1-4e7e-b8fa-2feb6789e775 (non-flash)
Nov 16 10:24:49 user nova-compute[85141]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bc0a873-d872-4f63-9af6-b4ac71162eeb (non-flash)
Nov 16 10:24:49 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:24:49 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-13d0dcf3-3045-416f-b172-0205186032e1 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)
Nov 16 10:24:49 user nova-compute[85141]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11a6a15b-38c1-4e7e-b8fa-2feb6789e775 (non-flash)
Nov 16 10:24:49 user nova-compute[85141]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bc0a873-d872-4f63-9af6-b4ac71162eeb (non-flash)
Nov 16 10:24:49 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 10:24:49 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-13d0dcf3-3045-416f-b172-0205186032e1 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9bc0a873-d872-4f63-9af6-b4ac71162eeb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.285s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 10:24:49 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-13d0dcf3-3045-416f-b172-0205186032e1 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Connected to 172.16.0.220:3260 {{(pid=85141) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 10:24:49 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-13d0dcf3-3045-416f-b172-0205186032e1 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] HCTL ('33', '-', '-', 0) found on session 36 with lun 0 {{(pid=85141) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 10:24:49 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-13d0dcf3-3045-416f-b172-0205186032e1 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=85141) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 10:24:49 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:24:49 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:24:49 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d8ef276-8591-45e1-ab34-fa2c3dad5a83]: (4, ('- - 0', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:24:49 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-13d0dcf3-3045-416f-b172-0205186032e1 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Searching for a device in session 36 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=85141) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 10:24:49 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-13d0dcf3-3045-416f-b172-0205186032e1 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:9bc0a873-d872-4f63-9af6-b4ac71162eeb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jxsmXgGt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=85141) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 10:24:50 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-13d0dcf3-3045-416f-b172-0205186032e1 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.326s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 10:24:50 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-13d0dcf3-3045-416f-b172-0205186032e1 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] <== connect_volume: return (1327ms) {'type': 'block', 'scsi_wwn': '26236616531613364', 'path': '/dev/sdb'} {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 10:24:50 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-13d0dcf3-3045-416f-b172-0205186032e1 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: dfe84cd6-628a-484e-b266-34e2abe890f2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26236616531613364', 'path': '/dev/sdb'} {{(pid=85141) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 10:24:50 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-13d0dcf3-3045-416f-b172-0205186032e1 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T10:24:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-821229199',display_name='tempest-TestVolumeBootPattern-server-821229199',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-821229199',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aec3bb9fe5e6446590900b5adf65df0f',ramdisk_id='',reservation_id='r-ls7raevm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1979039357',owner_user_name='tempest-TestVolumeBootPattern-1979039357-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T10:24:42Z,user_data=None,user_id='7261b57c36904fcda87a9ea32d4b5b31',uuid=dfe84cd6-628a-484e-b266-34e2abe890f2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e3463cf8-10c0-4465-95d8-28248f06c3c1", "address": "fa:16:3e:66:21:97", "network": {"id": "b8ada47f-9721-4358-ac4f-0305f06dbbb8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1663922860-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aec3bb9fe5e6446590900b5adf65df0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3463cf8-10", "ovs_interfaceid": "e3463cf8-10c0-4465-95d8-28248f06c3c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=85141) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 10:24:50 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-13d0dcf3-3045-416f-b172-0205186032e1 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Converting VIF {"id": "e3463cf8-10c0-4465-95d8-28248f06c3c1", "address": "fa:16:3e:66:21:97", "network": {"id": "b8ada47f-9721-4358-ac4f-0305f06dbbb8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1663922860-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aec3bb9fe5e6446590900b5adf65df0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3463cf8-10", "ovs_interfaceid": "e3463cf8-10c0-4465-95d8-28248f06c3c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:24:50 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-13d0dcf3-3045-416f-b172-0205186032e1 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:66:21:97,bridge_name='br-int',has_traffic_filtering=True,id=e3463cf8-10c0-4465-95d8-28248f06c3c1,network=Network(b8ada47f-9721-4358-ac4f-0305f06dbbb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3463cf8-10') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:24:50 user nova-compute[85141]: DEBUG nova.objects.instance [None req-13d0dcf3-3045-416f-b172-0205186032e1 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Lazy-loading 'pci_devices' on Instance uuid dfe84cd6-628a-484e-b266-34e2abe890f2 {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:24:50 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-13d0dcf3-3045-416f-b172-0205186032e1 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: dfe84cd6-628a-484e-b266-34e2abe890f2] End _get_guest_xml xml=<domain type="kvm">
Nov 16 10:24:50 user nova-compute[85141]:   <uuid>dfe84cd6-628a-484e-b266-34e2abe890f2</uuid>
Nov 16 10:24:50 user nova-compute[85141]:   <name>instance-00000021</name>
Nov 16 10:24:50 user nova-compute[85141]:   <memory>524288</memory>
Nov 16 10:24:50 user nova-compute[85141]:   <vcpu>1</vcpu>
Nov 16 10:24:50 user nova-compute[85141]:   <metadata>
Nov 16 10:24:50 user nova-compute[85141]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 10:24:50 user nova-compute[85141]:       <nova:package version="0.0.0"/>
Nov 16 10:24:50 user nova-compute[85141]:       <nova:name>tempest-TestVolumeBootPattern-server-821229199</nova:name>
Nov 16 10:24:50 user nova-compute[85141]:       <nova:creationTime>2023-11-16 10:24:49</nova:creationTime>
Nov 16 10:24:50 user nova-compute[85141]:       <nova:flavor name="m1.tiny">
Nov 16 10:24:50 user nova-compute[85141]:         <nova:memory>512</nova:memory>
Nov 16 10:24:50 user nova-compute[85141]:         <nova:disk>1</nova:disk>
Nov 16 10:24:50 user nova-compute[85141]:         <nova:swap>0</nova:swap>
Nov 16 10:24:50 user nova-compute[85141]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 10:24:50 user nova-compute[85141]:         <nova:vcpus>1</nova:vcpus>
Nov 16 10:24:50 user nova-compute[85141]:       </nova:flavor>
Nov 16 10:24:50 user nova-compute[85141]:       <nova:owner>
Nov 16 10:24:50 user nova-compute[85141]:         <nova:user uuid="7261b57c36904fcda87a9ea32d4b5b31">tempest-TestVolumeBootPattern-1979039357-project-member</nova:user>
Nov 16 10:24:50 user nova-compute[85141]:         <nova:project uuid="aec3bb9fe5e6446590900b5adf65df0f">tempest-TestVolumeBootPattern-1979039357</nova:project>
Nov 16 10:24:50 user nova-compute[85141]:       </nova:owner>
Nov 16 10:24:50 user nova-compute[85141]:       <nova:ports>
Nov 16 10:24:50 user nova-compute[85141]:         <nova:port uuid="e3463cf8-10c0-4465-95d8-28248f06c3c1">
Nov 16 10:24:50 user nova-compute[85141]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 16 10:24:50 user nova-compute[85141]:         </nova:port>
Nov 16 10:24:50 user nova-compute[85141]:       </nova:ports>
Nov 16 10:24:50 user nova-compute[85141]:     </nova:instance>
Nov 16 10:24:50 user nova-compute[85141]:   </metadata>
Nov 16 10:24:50 user nova-compute[85141]:   <sysinfo type="smbios">
Nov 16 10:24:50 user nova-compute[85141]:     <system>
Nov 16 10:24:50 user nova-compute[85141]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 10:24:50 user nova-compute[85141]:       <entry name="product">OpenStack Nova</entry>
Nov 16 10:24:50 user nova-compute[85141]:       <entry name="version">0.0.0</entry>
Nov 16 10:24:50 user nova-compute[85141]:       <entry name="serial">dfe84cd6-628a-484e-b266-34e2abe890f2</entry>
Nov 16 10:24:50 user nova-compute[85141]:       <entry name="uuid">dfe84cd6-628a-484e-b266-34e2abe890f2</entry>
Nov 16 10:24:50 user nova-compute[85141]:       <entry name="family">Virtual Machine</entry>
Nov 16 10:24:50 user nova-compute[85141]:     </system>
Nov 16 10:24:50 user nova-compute[85141]:   </sysinfo>
Nov 16 10:24:50 user nova-compute[85141]:   <os>
Nov 16 10:24:50 user nova-compute[85141]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 10:24:50 user nova-compute[85141]:     <boot dev="hd"/>
Nov 16 10:24:50 user nova-compute[85141]:     <smbios mode="sysinfo"/>
Nov 16 10:24:50 user nova-compute[85141]:   </os>
Nov 16 10:24:50 user nova-compute[85141]:   <features>
Nov 16 10:24:50 user nova-compute[85141]:     <acpi/>
Nov 16 10:24:50 user nova-compute[85141]:     <apic/>
Nov 16 10:24:50 user nova-compute[85141]:     <vmcoreinfo/>
Nov 16 10:24:50 user nova-compute[85141]:   </features>
Nov 16 10:24:50 user nova-compute[85141]:   <clock offset="utc">
Nov 16 10:24:50 user nova-compute[85141]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 10:24:50 user nova-compute[85141]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 10:24:50 user nova-compute[85141]:     <timer name="hpet" present="no"/>
Nov 16 10:24:50 user nova-compute[85141]:   </clock>
Nov 16 10:24:50 user nova-compute[85141]:   <cpu mode="custom" match="exact">
Nov 16 10:24:50 user nova-compute[85141]:     <model>Nehalem</model>
Nov 16 10:24:50 user nova-compute[85141]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 10:24:50 user nova-compute[85141]:   </cpu>
Nov 16 10:24:50 user nova-compute[85141]:   <devices>
Nov 16 10:24:50 user nova-compute[85141]:     <disk type="block" device="disk">
Nov 16 10:24:50 user nova-compute[85141]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 10:24:50 user nova-compute[85141]:       <source dev="/dev/sdb"/>
Nov 16 10:24:50 user nova-compute[85141]:       <target dev="vda" bus="virtio"/>
Nov 16 10:24:50 user nova-compute[85141]:       <serial>9bc0a873-d872-4f63-9af6-b4ac71162eeb</serial>
Nov 16 10:24:50 user nova-compute[85141]:     </disk>
Nov 16 10:24:50 user nova-compute[85141]:     <interface type="ethernet">
Nov 16 10:24:50 user nova-compute[85141]:       <mac address="fa:16:3e:66:21:97"/>
Nov 16 10:24:50 user nova-compute[85141]:       <model type="virtio"/>
Nov 16 10:24:50 user nova-compute[85141]:       <mtu size="1442"/>
Nov 16 10:24:50 user nova-compute[85141]:       <target dev="tape3463cf8-10"/>
Nov 16 10:24:50 user nova-compute[85141]:     </interface>
Nov 16 10:24:50 user nova-compute[85141]:     <serial type="pty">
Nov 16 10:24:50 user nova-compute[85141]:       <log file="/opt/stack/data/nova/instances/dfe84cd6-628a-484e-b266-34e2abe890f2/console.log" append="off"/>
Nov 16 10:24:50 user nova-compute[85141]:     </serial>
Nov 16 10:24:50 user nova-compute[85141]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 10:24:50 user nova-compute[85141]:     <video>
Nov 16 10:24:50 user nova-compute[85141]:       <model type="virtio"/>
Nov 16 10:24:50 user nova-compute[85141]:     </video>
Nov 16 10:24:50 user nova-compute[85141]:     <rng model="virtio">
Nov 16 10:24:50 user nova-compute[85141]:       <backend model="random">/dev/urandom</backend>
Nov 16 10:24:50 user nova-compute[85141]:     </rng>
Nov 16 10:24:50 user nova-compute[85141]:     <controller type="usb" index="0" model="none"/>
Nov 16 10:24:50 user nova-compute[85141]:     <memballoon model="virtio">
Nov 16 10:24:50 user nova-compute[85141]:       <stats period="10"/>
Nov 16 10:24:50 user nova-compute[85141]:     </memballoon>
Nov 16 10:24:50 user nova-compute[85141]:   </devices>
Nov 16 10:24:50 user nova-compute[85141]: </domain>
Nov 16 10:24:50 user nova-compute[85141]:  {{(pid=85141) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 10:24:50 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-13d0dcf3-3045-416f-b172-0205186032e1 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T10:24:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-821229199',display_name='tempest-TestVolumeBootPattern-server-821229199',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-821229199',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aec3bb9fe5e6446590900b5adf65df0f',ramdisk_id='',reservation_id='r-ls7raevm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1979039357',owner_user_name='tempest-TestVolumeBootPattern-1979039357-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T10:24:42Z,user_data=None,user_id='7261b57c36904fcda87a9ea32d4b5b31',uuid=dfe84cd6-628a-484e-b266-34e2abe890f2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e3463cf8-10c0-4465-95d8-28248f06c3c1", "address": "fa:16:3e:66:21:97", "network": {"id": "b8ada47f-9721-4358-ac4f-0305f06dbbb8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1663922860-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aec3bb9fe5e6446590900b5adf65df0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3463cf8-10", "ovs_interfaceid": "e3463cf8-10c0-4465-95d8-28248f06c3c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 10:24:50 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-13d0dcf3-3045-416f-b172-0205186032e1 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Converting VIF {"id": "e3463cf8-10c0-4465-95d8-28248f06c3c1", "address": "fa:16:3e:66:21:97", "network": {"id": "b8ada47f-9721-4358-ac4f-0305f06dbbb8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1663922860-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aec3bb9fe5e6446590900b5adf65df0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3463cf8-10", "ovs_interfaceid": "e3463cf8-10c0-4465-95d8-28248f06c3c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:24:50 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-13d0dcf3-3045-416f-b172-0205186032e1 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:66:21:97,bridge_name='br-int',has_traffic_filtering=True,id=e3463cf8-10c0-4465-95d8-28248f06c3c1,network=Network(b8ada47f-9721-4358-ac4f-0305f06dbbb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3463cf8-10') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:24:50 user nova-compute[85141]: DEBUG os_vif [None req-13d0dcf3-3045-416f-b172-0205186032e1 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:21:97,bridge_name='br-int',has_traffic_filtering=True,id=e3463cf8-10c0-4465-95d8-28248f06c3c1,network=Network(b8ada47f-9721-4358-ac4f-0305f06dbbb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3463cf8-10') {{(pid=85141) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 10:24:50 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:24:50 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:24:50 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 10:24:50 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:24:50 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9825e50c-f760-5a34-a01f-c138c526bd99', '_type': 'linux-noop'}}, row=False) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:24:50 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:24:50 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:24:50 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:24:50 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:24:50 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape3463cf8-10, may_exist=True, interface_attrs={}) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:24:50 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape3463cf8-10, col_values=(('qos', UUID('847d8c3e-55c7-4874-9601-4e8aa3a81efb')),), if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:24:50 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape3463cf8-10, col_values=(('external_ids', {'iface-id': 'e3463cf8-10c0-4465-95d8-28248f06c3c1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:66:21:97', 'vm-uuid': 'dfe84cd6-628a-484e-b266-34e2abe890f2'}),), if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:24:50 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:24:50 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:24:50 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:24:50 user nova-compute[85141]: INFO os_vif [None req-13d0dcf3-3045-416f-b172-0205186032e1 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:21:97,bridge_name='br-int',has_traffic_filtering=True,id=e3463cf8-10c0-4465-95d8-28248f06c3c1,network=Network(b8ada47f-9721-4358-ac4f-0305f06dbbb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3463cf8-10')
Nov 16 10:24:50 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-13d0dcf3-3045-416f-b172-0205186032e1 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] No BDM found with device name vda, not building metadata. {{(pid=85141) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 10:24:50 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-13d0dcf3-3045-416f-b172-0205186032e1 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] No VIF found with MAC fa:16:3e:66:21:97, not building metadata {{(pid=85141) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 10:24:52 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:24:52 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:24:52 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:24:52 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:24:52 user nova-compute[85141]: DEBUG nova.compute.manager [req-63f0c77f-2299-45ec-841e-003bb1ad0fd9 req-56e57fd4-4811-4dd0-9f2b-06351a0fd949 service nova] [instance: dfe84cd6-628a-484e-b266-34e2abe890f2] Received event network-vif-plugged-e3463cf8-10c0-4465-95d8-28248f06c3c1 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:24:52 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-63f0c77f-2299-45ec-841e-003bb1ad0fd9 req-56e57fd4-4811-4dd0-9f2b-06351a0fd949 service nova] Acquiring lock "dfe84cd6-628a-484e-b266-34e2abe890f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:24:52 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-63f0c77f-2299-45ec-841e-003bb1ad0fd9 req-56e57fd4-4811-4dd0-9f2b-06351a0fd949 service nova] Lock "dfe84cd6-628a-484e-b266-34e2abe890f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:24:52 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-63f0c77f-2299-45ec-841e-003bb1ad0fd9 req-56e57fd4-4811-4dd0-9f2b-06351a0fd949 service nova] Lock "dfe84cd6-628a-484e-b266-34e2abe890f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:24:52 user nova-compute[85141]: DEBUG nova.compute.manager [req-63f0c77f-2299-45ec-841e-003bb1ad0fd9 req-56e57fd4-4811-4dd0-9f2b-06351a0fd949 service nova] [instance: dfe84cd6-628a-484e-b266-34e2abe890f2] No waiting events found dispatching network-vif-plugged-e3463cf8-10c0-4465-95d8-28248f06c3c1 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:24:52 user nova-compute[85141]: WARNING nova.compute.manager [req-63f0c77f-2299-45ec-841e-003bb1ad0fd9 req-56e57fd4-4811-4dd0-9f2b-06351a0fd949 service nova] [instance: dfe84cd6-628a-484e-b266-34e2abe890f2] Received unexpected event network-vif-plugged-e3463cf8-10c0-4465-95d8-28248f06c3c1 for instance with vm_state building and task_state spawning.
Nov 16 10:24:52 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:24:52 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:24:52 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:24:52 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:24:53 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:24:54 user nova-compute[85141]: DEBUG nova.compute.manager [req-c5efca91-32b7-4b93-bcde-c84c95043ce8 req-1a692d39-a4d3-4cd5-bf0e-9361b10a0d27 service nova] [instance: dfe84cd6-628a-484e-b266-34e2abe890f2] Received event network-vif-plugged-e3463cf8-10c0-4465-95d8-28248f06c3c1 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:24:54 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-c5efca91-32b7-4b93-bcde-c84c95043ce8 req-1a692d39-a4d3-4cd5-bf0e-9361b10a0d27 service nova] Acquiring lock "dfe84cd6-628a-484e-b266-34e2abe890f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:24:54 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-c5efca91-32b7-4b93-bcde-c84c95043ce8 req-1a692d39-a4d3-4cd5-bf0e-9361b10a0d27 service nova] Lock "dfe84cd6-628a-484e-b266-34e2abe890f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:24:54 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-c5efca91-32b7-4b93-bcde-c84c95043ce8 req-1a692d39-a4d3-4cd5-bf0e-9361b10a0d27 service nova] Lock "dfe84cd6-628a-484e-b266-34e2abe890f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:24:54 user nova-compute[85141]: DEBUG nova.compute.manager [req-c5efca91-32b7-4b93-bcde-c84c95043ce8 req-1a692d39-a4d3-4cd5-bf0e-9361b10a0d27 service nova] [instance: dfe84cd6-628a-484e-b266-34e2abe890f2] No waiting events found dispatching network-vif-plugged-e3463cf8-10c0-4465-95d8-28248f06c3c1 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:24:54 user nova-compute[85141]: WARNING nova.compute.manager [req-c5efca91-32b7-4b93-bcde-c84c95043ce8 req-1a692d39-a4d3-4cd5-bf0e-9361b10a0d27 service nova] [instance: dfe84cd6-628a-484e-b266-34e2abe890f2] Received unexpected event network-vif-plugged-e3463cf8-10c0-4465-95d8-28248f06c3c1 for instance with vm_state building and task_state spawning.
Nov 16 10:24:54 user nova-compute[85141]: DEBUG nova.compute.manager [None req-13d0dcf3-3045-416f-b172-0205186032e1 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: dfe84cd6-628a-484e-b266-34e2abe890f2] Instance event wait completed in 0 seconds for  {{(pid=85141) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 10:24:54 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-13d0dcf3-3045-416f-b172-0205186032e1 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: dfe84cd6-628a-484e-b266-34e2abe890f2] Guest created on hypervisor {{(pid=85141) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 10:24:54 user nova-compute[85141]: INFO nova.virt.libvirt.driver [-] [instance: dfe84cd6-628a-484e-b266-34e2abe890f2] Instance spawned successfully.
Nov 16 10:24:54 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-13d0dcf3-3045-416f-b172-0205186032e1 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: dfe84cd6-628a-484e-b266-34e2abe890f2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 10:24:54 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-13d0dcf3-3045-416f-b172-0205186032e1 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: dfe84cd6-628a-484e-b266-34e2abe890f2] Found default for hw_cdrom_bus of ide {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:24:54 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-13d0dcf3-3045-416f-b172-0205186032e1 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: dfe84cd6-628a-484e-b266-34e2abe890f2] Found default for hw_disk_bus of virtio {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:24:54 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-13d0dcf3-3045-416f-b172-0205186032e1 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: dfe84cd6-628a-484e-b266-34e2abe890f2] Found default for hw_input_bus of None {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:24:54 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-13d0dcf3-3045-416f-b172-0205186032e1 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: dfe84cd6-628a-484e-b266-34e2abe890f2] Found default for hw_pointer_model of None {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:24:54 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-13d0dcf3-3045-416f-b172-0205186032e1 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: dfe84cd6-628a-484e-b266-34e2abe890f2] Found default for hw_video_model of virtio {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:24:54 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-13d0dcf3-3045-416f-b172-0205186032e1 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: dfe84cd6-628a-484e-b266-34e2abe890f2] Found default for hw_vif_model of virtio {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:24:54 user nova-compute[85141]: INFO nova.compute.manager [None req-13d0dcf3-3045-416f-b172-0205186032e1 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: dfe84cd6-628a-484e-b266-34e2abe890f2] Took 5.62 seconds to spawn the instance on the hypervisor.
Nov 16 10:24:54 user nova-compute[85141]: DEBUG nova.compute.manager [None req-13d0dcf3-3045-416f-b172-0205186032e1 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: dfe84cd6-628a-484e-b266-34e2abe890f2] Checking state {{(pid=85141) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 10:24:54 user nova-compute[85141]: INFO nova.compute.manager [None req-13d0dcf3-3045-416f-b172-0205186032e1 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: dfe84cd6-628a-484e-b266-34e2abe890f2] Took 13.98 seconds to build instance.
Nov 16 10:24:54 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-13d0dcf3-3045-416f-b172-0205186032e1 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Lock "dfe84cd6-628a-484e-b266-34e2abe890f2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.081s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:24:55 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:24:57 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:25:00 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:25:02 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:25:03 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:25:05 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-9160053b-a51e-4dd2-b256-ec3f62db25f1 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Acquiring lock "bc76703d-9243-4277-9b13-d6f9639cd1bb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:25:05 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-9160053b-a51e-4dd2-b256-ec3f62db25f1 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Lock "bc76703d-9243-4277-9b13-d6f9639cd1bb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:25:05 user nova-compute[85141]: DEBUG nova.compute.manager [None req-9160053b-a51e-4dd2-b256-ec3f62db25f1 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] [instance: bc76703d-9243-4277-9b13-d6f9639cd1bb] Starting instance... {{(pid=85141) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 10:25:05 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-9160053b-a51e-4dd2-b256-ec3f62db25f1 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:25:05 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-9160053b-a51e-4dd2-b256-ec3f62db25f1 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:25:05 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-9160053b-a51e-4dd2-b256-ec3f62db25f1 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=85141) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 10:25:05 user nova-compute[85141]: INFO nova.compute.claims [None req-9160053b-a51e-4dd2-b256-ec3f62db25f1 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] [instance: bc76703d-9243-4277-9b13-d6f9639cd1bb] Claim successful on node user
Nov 16 10:25:05 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:25:05 user nova-compute[85141]: DEBUG nova.compute.provider_tree [None req-9160053b-a51e-4dd2-b256-ec3f62db25f1 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Inventory has not changed in ProviderTree for provider: bf8e0fa1-16b6-408f-9203-c4cd63916272 {{(pid=85141) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 10:25:05 user nova-compute[85141]: DEBUG nova.scheduler.client.report [None req-9160053b-a51e-4dd2-b256-ec3f62db25f1 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Inventory has not changed for provider bf8e0fa1-16b6-408f-9203-c4cd63916272 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=85141) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 10:25:05 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-9160053b-a51e-4dd2-b256-ec3f62db25f1 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.475s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:25:05 user nova-compute[85141]: DEBUG nova.compute.manager [None req-9160053b-a51e-4dd2-b256-ec3f62db25f1 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] [instance: bc76703d-9243-4277-9b13-d6f9639cd1bb] Start building networks asynchronously for instance. {{(pid=85141) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 10:25:05 user nova-compute[85141]: DEBUG nova.compute.manager [None req-9160053b-a51e-4dd2-b256-ec3f62db25f1 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] [instance: bc76703d-9243-4277-9b13-d6f9639cd1bb] Allocating IP information in the background. {{(pid=85141) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 10:25:05 user nova-compute[85141]: DEBUG nova.network.neutron [None req-9160053b-a51e-4dd2-b256-ec3f62db25f1 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] [instance: bc76703d-9243-4277-9b13-d6f9639cd1bb] allocate_for_instance() {{(pid=85141) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 10:25:05 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:25:06 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-9160053b-a51e-4dd2-b256-ec3f62db25f1 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] [instance: bc76703d-9243-4277-9b13-d6f9639cd1bb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 10:25:06 user nova-compute[85141]: DEBUG nova.compute.manager [None req-9160053b-a51e-4dd2-b256-ec3f62db25f1 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] [instance: bc76703d-9243-4277-9b13-d6f9639cd1bb] Start building block device mappings for instance. {{(pid=85141) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 10:25:06 user nova-compute[85141]: INFO nova.virt.block_device [None req-9160053b-a51e-4dd2-b256-ec3f62db25f1 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] [instance: bc76703d-9243-4277-9b13-d6f9639cd1bb] Booting with volume 2006a77c-e5e8-4ec5-8de5-a0f9505c429a at /dev/vda
Nov 16 10:25:06 user nova-compute[85141]: DEBUG os_brick.utils [None req-9160053b-a51e-4dd2-b256-ec3f62db25f1 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 10:25:06 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:25:06 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:25:06 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[b367a435-dca6-4ced-b32d-5522c6215d88]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c7834de5c295\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:25:06 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:25:06 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.026s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:25:06 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[f97b3e0f-e134-45db-8b00-a9bf1f364954]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:25:06 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:25:06 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.026s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:25:06 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7ff07fd-b8bf-4292-b411-bb21f95b7257]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:25:06 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f6448fa-cfc1-420b-b337-18422edf5ed7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:25:06 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-9160053b-a51e-4dd2-b256-ec3f62db25f1 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Running cmd (subprocess): nvme version {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:25:06 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-9160053b-a51e-4dd2-b256-ec3f62db25f1 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] 'nvme version' failed. Not Retrying. {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 10:25:06 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9160053b-a51e-4dd2-b256-ec3f62db25f1 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] nvme not present on system {{(pid=85141) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 10:25:06 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:25:06 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 10:25:06 user nova-compute[85141]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 10:25:06 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[67d593ec-406b-466c-9821-989a498e4429]: (4, '') {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:25:06 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.lightos [None req-9160053b-a51e-4dd2-b256-ec3f62db25f1 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=85141) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 10:25:06 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.lightos [None req-9160053b-a51e-4dd2-b256-ec3f62db25f1 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=85141) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 10:25:06 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.lightos [None req-9160053b-a51e-4dd2-b256-ec3f62db25f1 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] LIGHTOS: no hostnqn found. {{(pid=85141) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 10:25:06 user nova-compute[85141]: DEBUG os_brick.utils [None req-9160053b-a51e-4dd2-b256-ec3f62db25f1 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] <== get_connector_properties: return (172ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c7834de5c295', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 10:25:06 user nova-compute[85141]: DEBUG nova.virt.block_device [None req-9160053b-a51e-4dd2-b256-ec3f62db25f1 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] [instance: bc76703d-9243-4277-9b13-d6f9639cd1bb] Updating existing volume attachment record: 594baafa-72d6-4c3c-a529-329ab83a72a1 {{(pid=85141) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 10:25:06 user nova-compute[85141]: DEBUG nova.policy [None req-9160053b-a51e-4dd2-b256-ec3f62db25f1 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e95802a919de4345add493a8d7873e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '879fa3f4dfc34726b20149b8a7db22dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85141) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 10:25:07 user nova-compute[85141]: DEBUG nova.network.neutron [None req-9160053b-a51e-4dd2-b256-ec3f62db25f1 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] [instance: bc76703d-9243-4277-9b13-d6f9639cd1bb] Successfully created port: fbf147e2-d8e0-4cb5-8ec5-79756fc53140 {{(pid=85141) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 10:25:07 user nova-compute[85141]: DEBUG nova.network.neutron [None req-9160053b-a51e-4dd2-b256-ec3f62db25f1 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] [instance: bc76703d-9243-4277-9b13-d6f9639cd1bb] Successfully updated port: fbf147e2-d8e0-4cb5-8ec5-79756fc53140 {{(pid=85141) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 10:25:07 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-9160053b-a51e-4dd2-b256-ec3f62db25f1 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Acquiring lock "refresh_cache-bc76703d-9243-4277-9b13-d6f9639cd1bb" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:25:07 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-9160053b-a51e-4dd2-b256-ec3f62db25f1 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Acquired lock "refresh_cache-bc76703d-9243-4277-9b13-d6f9639cd1bb" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:25:07 user nova-compute[85141]: DEBUG nova.network.neutron [None req-9160053b-a51e-4dd2-b256-ec3f62db25f1 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] [instance: bc76703d-9243-4277-9b13-d6f9639cd1bb] Building network info cache for instance {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 10:25:07 user nova-compute[85141]: DEBUG nova.compute.manager [req-843e0d51-9eaa-42ba-b2af-095f08b0b8ce req-f026ba44-7971-4bc6-91fe-777121b26e86 service nova] [instance: bc76703d-9243-4277-9b13-d6f9639cd1bb] Received event network-changed-fbf147e2-d8e0-4cb5-8ec5-79756fc53140 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:25:07 user nova-compute[85141]: DEBUG nova.compute.manager [req-843e0d51-9eaa-42ba-b2af-095f08b0b8ce req-f026ba44-7971-4bc6-91fe-777121b26e86 service nova] [instance: bc76703d-9243-4277-9b13-d6f9639cd1bb] Refreshing instance network info cache due to event network-changed-fbf147e2-d8e0-4cb5-8ec5-79756fc53140. {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 10:25:07 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-843e0d51-9eaa-42ba-b2af-095f08b0b8ce req-f026ba44-7971-4bc6-91fe-777121b26e86 service nova] Acquiring lock "refresh_cache-bc76703d-9243-4277-9b13-d6f9639cd1bb" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:25:07 user nova-compute[85141]: DEBUG nova.network.neutron [None req-9160053b-a51e-4dd2-b256-ec3f62db25f1 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] [instance: bc76703d-9243-4277-9b13-d6f9639cd1bb] Instance cache missing network info. {{(pid=85141) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 10:25:07 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:25:08 user nova-compute[85141]: DEBUG nova.network.neutron [None req-9160053b-a51e-4dd2-b256-ec3f62db25f1 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] [instance: bc76703d-9243-4277-9b13-d6f9639cd1bb] Updating instance_info_cache with network_info: [{"id": "fbf147e2-d8e0-4cb5-8ec5-79756fc53140", "address": "fa:16:3e:a1:42:09", "network": {"id": "859d1f09-56c4-4c2b-b2c3-02b1938e8dbf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1562516834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "879fa3f4dfc34726b20149b8a7db22dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbf147e2-d8", "ovs_interfaceid": "fbf147e2-d8e0-4cb5-8ec5-79756fc53140", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:25:08 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-9160053b-a51e-4dd2-b256-ec3f62db25f1 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Releasing lock "refresh_cache-bc76703d-9243-4277-9b13-d6f9639cd1bb" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:25:08 user nova-compute[85141]: DEBUG nova.compute.manager [None req-9160053b-a51e-4dd2-b256-ec3f62db25f1 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] [instance: bc76703d-9243-4277-9b13-d6f9639cd1bb] Instance network_info: |[{"id": "fbf147e2-d8e0-4cb5-8ec5-79756fc53140", "address": "fa:16:3e:a1:42:09", "network": {"id": "859d1f09-56c4-4c2b-b2c3-02b1938e8dbf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1562516834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "879fa3f4dfc34726b20149b8a7db22dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbf147e2-d8", "ovs_interfaceid": "fbf147e2-d8e0-4cb5-8ec5-79756fc53140", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=85141) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 10:25:08 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-843e0d51-9eaa-42ba-b2af-095f08b0b8ce req-f026ba44-7971-4bc6-91fe-777121b26e86 service nova] Acquired lock "refresh_cache-bc76703d-9243-4277-9b13-d6f9639cd1bb" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:25:08 user nova-compute[85141]: DEBUG nova.network.neutron [req-843e0d51-9eaa-42ba-b2af-095f08b0b8ce req-f026ba44-7971-4bc6-91fe-777121b26e86 service nova] [instance: bc76703d-9243-4277-9b13-d6f9639cd1bb] Refreshing network info cache for port fbf147e2-d8e0-4cb5-8ec5-79756fc53140 {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 10:25:08 user nova-compute[85141]: DEBUG nova.network.neutron [req-843e0d51-9eaa-42ba-b2af-095f08b0b8ce req-f026ba44-7971-4bc6-91fe-777121b26e86 service nova] [instance: bc76703d-9243-4277-9b13-d6f9639cd1bb] Updated VIF entry in instance network info cache for port fbf147e2-d8e0-4cb5-8ec5-79756fc53140. {{(pid=85141) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 10:25:08 user nova-compute[85141]: DEBUG nova.network.neutron [req-843e0d51-9eaa-42ba-b2af-095f08b0b8ce req-f026ba44-7971-4bc6-91fe-777121b26e86 service nova] [instance: bc76703d-9243-4277-9b13-d6f9639cd1bb] Updating instance_info_cache with network_info: [{"id": "fbf147e2-d8e0-4cb5-8ec5-79756fc53140", "address": "fa:16:3e:a1:42:09", "network": {"id": "859d1f09-56c4-4c2b-b2c3-02b1938e8dbf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1562516834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "879fa3f4dfc34726b20149b8a7db22dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbf147e2-d8", "ovs_interfaceid": "fbf147e2-d8e0-4cb5-8ec5-79756fc53140", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:25:08 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-843e0d51-9eaa-42ba-b2af-095f08b0b8ce req-f026ba44-7971-4bc6-91fe-777121b26e86 service nova] Releasing lock "refresh_cache-bc76703d-9243-4277-9b13-d6f9639cd1bb" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:25:10 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:25:10 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:25:12 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:25:12 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:25:13 user nova-compute[85141]: DEBUG nova.compute.manager [None req-9160053b-a51e-4dd2-b256-ec3f62db25f1 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] [instance: bc76703d-9243-4277-9b13-d6f9639cd1bb] Start spawning the instance on the hypervisor. {{(pid=85141) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 10:25:13 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-9160053b-a51e-4dd2-b256-ec3f62db25f1 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] [instance: bc76703d-9243-4277-9b13-d6f9639cd1bb] Creating instance directory {{(pid=85141) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 10:25:13 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-9160053b-a51e-4dd2-b256-ec3f62db25f1 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] [instance: bc76703d-9243-4277-9b13-d6f9639cd1bb] Creating image(s)
Nov 16 10:25:13 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-9160053b-a51e-4dd2-b256-ec3f62db25f1 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] [instance: bc76703d-9243-4277-9b13-d6f9639cd1bb] Did not create local disks {{(pid=85141) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 16 10:25:13 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-9160053b-a51e-4dd2-b256-ec3f62db25f1 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] [instance: bc76703d-9243-4277-9b13-d6f9639cd1bb] Ensure instance console log exists: /opt/stack/data/nova/instances/bc76703d-9243-4277-9b13-d6f9639cd1bb/console.log {{(pid=85141) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 10:25:13 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-9160053b-a51e-4dd2-b256-ec3f62db25f1 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:25:13 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-9160053b-a51e-4dd2-b256-ec3f62db25f1 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:25:13 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-9160053b-a51e-4dd2-b256-ec3f62db25f1 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:25:13 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-9160053b-a51e-4dd2-b256-ec3f62db25f1 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] [instance: bc76703d-9243-4277-9b13-d6f9639cd1bb] Start _get_guest_xml network_info=[{"id": "fbf147e2-d8e0-4cb5-8ec5-79756fc53140", "address": "fa:16:3e:a1:42:09", "network": {"id": "859d1f09-56c4-4c2b-b2c3-02b1938e8dbf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1562516834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "879fa3f4dfc34726b20149b8a7db22dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbf147e2-d8", "ovs_interfaceid": "fbf147e2-d8e0-4cb5-8ec5-79756fc53140", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2006a77c-e5e8-4ec5-8de5-a0f9505c429a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vdtqwVjE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'bc76703d-9243-4277-9b13-d6f9639cd1bb', 'attached_at': '', 'detached_at': '', 'volume_id': '2006a77c-e5e8-4ec5-8de5-a0f9505c429a', 'serial': '2006a77c-e5e8-4ec5-8de5-a0f9505c429a'}, 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'attachment_id': '594baafa-72d6-4c3c-a529-329ab83a72a1', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=85141) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 10:25:13 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-9160053b-a51e-4dd2-b256-ec3f62db25f1 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:25:13 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-9160053b-a51e-4dd2-b256-ec3f62db25f1 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:25:13 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-9160053b-a51e-4dd2-b256-ec3f62db25f1 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=85141) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 10:25:13 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-9160053b-a51e-4dd2-b256-ec3f62db25f1 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] CPU controller missing on host. {{(pid=85141) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 10:25:13 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-9160053b-a51e-4dd2-b256-ec3f62db25f1 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=85141) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 10:25:13 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-9160053b-a51e-4dd2-b256-ec3f62db25f1 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] CPU controller found on host. {{(pid=85141) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 10:25:13 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-9160053b-a51e-4dd2-b256-ec3f62db25f1 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=85141) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 10:25:13 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-9160053b-a51e-4dd2-b256-ec3f62db25f1 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T10:06:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 10:25:13 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-9160053b-a51e-4dd2-b256-ec3f62db25f1 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Flavor limits 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 10:25:13 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-9160053b-a51e-4dd2-b256-ec3f62db25f1 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Image limits 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 10:25:13 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-9160053b-a51e-4dd2-b256-ec3f62db25f1 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Flavor pref 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 10:25:13 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-9160053b-a51e-4dd2-b256-ec3f62db25f1 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Image pref 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 10:25:13 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-9160053b-a51e-4dd2-b256-ec3f62db25f1 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 10:25:13 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-9160053b-a51e-4dd2-b256-ec3f62db25f1 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 10:25:13 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-9160053b-a51e-4dd2-b256-ec3f62db25f1 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=85141) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 10:25:13 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-9160053b-a51e-4dd2-b256-ec3f62db25f1 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Got 1 possible topologies {{(pid=85141) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 10:25:13 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-9160053b-a51e-4dd2-b256-ec3f62db25f1 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 10:25:13 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-9160053b-a51e-4dd2-b256-ec3f62db25f1 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 10:25:13 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9160053b-a51e-4dd2-b256-ec3f62db25f1 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] [instance: bc76703d-9243-4277-9b13-d6f9639cd1bb] Calling os-brick to attach iSCSI Volume {{(pid=85141) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 10:25:13 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-9160053b-a51e-4dd2-b256-ec3f62db25f1 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51806b6080>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2006a77c-e5e8-4ec5-8de5-a0f9505c429a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vdtqwVjE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 10:25:13 user nova-compute[85141]: WARNING os_brick.initiator.connectors.base [None req-9160053b-a51e-4dd2-b256-ec3f62db25f1 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 10:25:13 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-9160053b-a51e-4dd2-b256-ec3f62db25f1 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 10:25:13 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-9160053b-a51e-4dd2-b256-ec3f62db25f1 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 10:25:13 user nova-compute[85141]: WARNING os_brick.initiator.connectors.base [None req-9160053b-a51e-4dd2-b256-ec3f62db25f1 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 10:25:13 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-9160053b-a51e-4dd2-b256-ec3f62db25f1 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2006a77c-e5e8-4ec5-8de5-a0f9505c429a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 10:25:13 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-9160053b-a51e-4dd2-b256-ec3f62db25f1 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2006a77c-e5e8-4ec5-8de5-a0f9505c429a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 10:25:13 user nova-compute[85141]: INFO os_brick.initiator.connectors.iscsi [None req-9160053b-a51e-4dd2-b256-ec3f62db25f1 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 10:25:13 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2006a77c-e5e8-4ec5-8de5-a0f9505c429a -p 172.16.0.220:3260 {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:25:13 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-eaf2c923-c735-42ce-87bf-80c05bbdb5d5 tempest-VolumesActionsTest-511249111 tempest-VolumesActionsTest-511249111-project-member] Acquiring lock "2b4347a0-a9f0-4e4c-9d7a-30d984fa35a9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:25:13 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-eaf2c923-c735-42ce-87bf-80c05bbdb5d5 tempest-VolumesActionsTest-511249111 tempest-VolumesActionsTest-511249111-project-member] Lock "2b4347a0-a9f0-4e4c-9d7a-30d984fa35a9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:25:13 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2006a77c-e5e8-4ec5-8de5-a0f9505c429a -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:25:13 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d0746df-a544-448c-a31f-bbcdc5a988a3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:25:13 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-9160053b-a51e-4dd2-b256-ec3f62db25f1 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 10:25:13 user nova-compute[85141]:  {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:25:13 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2006a77c-e5e8-4ec5-8de5-a0f9505c429a -p 172.16.0.220:3260 --interface default --op new {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:25:13 user nova-compute[85141]: DEBUG nova.compute.manager [None req-eaf2c923-c735-42ce-87bf-80c05bbdb5d5 tempest-VolumesActionsTest-511249111 tempest-VolumesActionsTest-511249111-project-member] [instance: 2b4347a0-a9f0-4e4c-9d7a-30d984fa35a9] Starting instance... {{(pid=85141) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 10:25:13 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2006a77c-e5e8-4ec5-8de5-a0f9505c429a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:25:13 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0b074d8-3250-4b53-b3a8-d810c5f321a2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2006a77c-e5e8-4ec5-8de5-a0f9505c429a] added\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:25:13 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-9160053b-a51e-4dd2-b256-ec3f62db25f1 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2006a77c-e5e8-4ec5-8de5-a0f9505c429a] added
Nov 16 10:25:13 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:25:13 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2006a77c-e5e8-4ec5-8de5-a0f9505c429a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:25:13 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2006a77c-e5e8-4ec5-8de5-a0f9505c429a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:25:13 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[02e0813e-422f-49ac-bf4e-db42074bdad7]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:25:13 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-9160053b-a51e-4dd2-b256-ec3f62db25f1 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:25:13 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2006a77c-e5e8-4ec5-8de5-a0f9505c429a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:25:13 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2006a77c-e5e8-4ec5-8de5-a0f9505c429a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.030s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:25:13 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fcfa796-f3c9-40c5-a4ff-86d2df1e40e1]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:25:13 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-9160053b-a51e-4dd2-b256-ec3f62db25f1 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:25:13 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2006a77c-e5e8-4ec5-8de5-a0f9505c429a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vdtqwVjE {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:25:13 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-eaf2c923-c735-42ce-87bf-80c05bbdb5d5 tempest-VolumesActionsTest-511249111 tempest-VolumesActionsTest-511249111-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:25:13 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-eaf2c923-c735-42ce-87bf-80c05bbdb5d5 tempest-VolumesActionsTest-511249111 tempest-VolumesActionsTest-511249111-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:25:13 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-eaf2c923-c735-42ce-87bf-80c05bbdb5d5 tempest-VolumesActionsTest-511249111 tempest-VolumesActionsTest-511249111-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=85141) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 10:25:13 user nova-compute[85141]: INFO nova.compute.claims [None req-eaf2c923-c735-42ce-87bf-80c05bbdb5d5 tempest-VolumesActionsTest-511249111 tempest-VolumesActionsTest-511249111-project-member] [instance: 2b4347a0-a9f0-4e4c-9d7a-30d984fa35a9] Claim successful on node user
Nov 16 10:25:13 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2006a77c-e5e8-4ec5-8de5-a0f9505c429a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vdtqwVjE" returned: 0 in 0.019s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:25:13 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f8daa01-7bee-47f5-82f2-763b263b2682]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:25:13 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-9160053b-a51e-4dd2-b256-ec3f62db25f1 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vdtqwVjE'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:25:13 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2006a77c-e5e8-4ec5-8de5-a0f9505c429a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:25:13 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2006a77c-e5e8-4ec5-8de5-a0f9505c429a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:25:13 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[8058e133-ec25-4d49-99ec-184aaf3355ec]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:25:13 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-9160053b-a51e-4dd2-b256-ec3f62db25f1 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:25:13 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:25:13 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:25:13 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[b75da827-878e-41b3-9b3d-80cd9d63b64d]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11a6a15b-38c1-4e7e-b8fa-2feb6789e775 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bc0a873-d872-4f63-9af6-b4ac71162eeb (non-flash)\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:25:13 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-9160053b-a51e-4dd2-b256-ec3f62db25f1 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)
Nov 16 10:25:13 user nova-compute[85141]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11a6a15b-38c1-4e7e-b8fa-2feb6789e775 (non-flash)
Nov 16 10:25:13 user nova-compute[85141]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bc0a873-d872-4f63-9af6-b4ac71162eeb (non-flash)
Nov 16 10:25:13 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:25:13 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-9160053b-a51e-4dd2-b256-ec3f62db25f1 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)
Nov 16 10:25:13 user nova-compute[85141]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11a6a15b-38c1-4e7e-b8fa-2feb6789e775 (non-flash)
Nov 16 10:25:13 user nova-compute[85141]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bc0a873-d872-4f63-9af6-b4ac71162eeb (non-flash)
Nov 16 10:25:13 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 10:25:13 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2006a77c-e5e8-4ec5-8de5-a0f9505c429a -p 172.16.0.220:3260 --login {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:25:13 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2006a77c-e5e8-4ec5-8de5-a0f9505c429a -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:25:13 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[3671129a-d008-471d-b38d-fe5ef48b6e20]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2006a77c-e5e8-4ec5-8de5-a0f9505c429a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2006a77c-e5e8-4ec5-8de5-a0f9505c429a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:25:13 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-9160053b-a51e-4dd2-b256-ec3f62db25f1 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2006a77c-e5e8-4ec5-8de5-a0f9505c429a, portal: 172.16.0.220,3260]
Nov 16 10:25:13 user nova-compute[85141]: Login to [iface: default, target: iqn.2010-10.org.openstack:2006a77c-e5e8-4ec5-8de5-a0f9505c429a, portal: 172.16.0.220,3260] successful.
Nov 16 10:25:13 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:25:13 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2006a77c-e5e8-4ec5-8de5-a0f9505c429a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:25:13 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2006a77c-e5e8-4ec5-8de5-a0f9505c429a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:25:13 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[014e07e5-a857-4072-b0f1-559c85de124a]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:25:13 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-9160053b-a51e-4dd2-b256-ec3f62db25f1 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:25:13 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:25:13 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:25:13 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[adb15787-7a8f-46de-8eda-07af043d0f7f]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11a6a15b-38c1-4e7e-b8fa-2feb6789e775 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bc0a873-d872-4f63-9af6-b4ac71162eeb (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2006a77c-e5e8-4ec5-8de5-a0f9505c429a (non-flash)\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:25:13 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-9160053b-a51e-4dd2-b256-ec3f62db25f1 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)
Nov 16 10:25:13 user nova-compute[85141]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11a6a15b-38c1-4e7e-b8fa-2feb6789e775 (non-flash)
Nov 16 10:25:13 user nova-compute[85141]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bc0a873-d872-4f63-9af6-b4ac71162eeb (non-flash)
Nov 16 10:25:13 user nova-compute[85141]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2006a77c-e5e8-4ec5-8de5-a0f9505c429a (non-flash)
Nov 16 10:25:13 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:25:13 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-9160053b-a51e-4dd2-b256-ec3f62db25f1 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)
Nov 16 10:25:13 user nova-compute[85141]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11a6a15b-38c1-4e7e-b8fa-2feb6789e775 (non-flash)
Nov 16 10:25:13 user nova-compute[85141]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bc0a873-d872-4f63-9af6-b4ac71162eeb (non-flash)
Nov 16 10:25:13 user nova-compute[85141]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2006a77c-e5e8-4ec5-8de5-a0f9505c429a (non-flash)
Nov 16 10:25:13 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 10:25:13 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-9160053b-a51e-4dd2-b256-ec3f62db25f1 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2006a77c-e5e8-4ec5-8de5-a0f9505c429a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.313s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 10:25:13 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-9160053b-a51e-4dd2-b256-ec3f62db25f1 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Connected to 172.16.0.220:3260 {{(pid=85141) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 10:25:13 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-9160053b-a51e-4dd2-b256-ec3f62db25f1 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] HCTL ('36', '-', '-', 0) found on session 37 with lun 0 {{(pid=85141) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 10:25:13 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-9160053b-a51e-4dd2-b256-ec3f62db25f1 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=85141) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 10:25:13 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:25:13 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.072s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:25:13 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[96be48d0-7377-461d-9d98-e7912b16a145]: (4, ('- - 0', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:25:13 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-9160053b-a51e-4dd2-b256-ec3f62db25f1 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Searching for a device in session 37 and hctl ['36', '*', '*', 0] yield: None {{(pid=85141) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 10:25:14 user nova-compute[85141]: DEBUG nova.compute.provider_tree [None req-eaf2c923-c735-42ce-87bf-80c05bbdb5d5 tempest-VolumesActionsTest-511249111 tempest-VolumesActionsTest-511249111-project-member] Inventory has not changed in ProviderTree for provider: bf8e0fa1-16b6-408f-9203-c4cd63916272 {{(pid=85141) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 10:25:14 user nova-compute[85141]: DEBUG nova.scheduler.client.report [None req-eaf2c923-c735-42ce-87bf-80c05bbdb5d5 tempest-VolumesActionsTest-511249111 tempest-VolumesActionsTest-511249111-project-member] Inventory has not changed for provider bf8e0fa1-16b6-408f-9203-c4cd63916272 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=85141) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 10:25:14 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-eaf2c923-c735-42ce-87bf-80c05bbdb5d5 tempest-VolumesActionsTest-511249111 tempest-VolumesActionsTest-511249111-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.589s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:25:14 user nova-compute[85141]: DEBUG nova.compute.manager [None req-eaf2c923-c735-42ce-87bf-80c05bbdb5d5 tempest-VolumesActionsTest-511249111 tempest-VolumesActionsTest-511249111-project-member] [instance: 2b4347a0-a9f0-4e4c-9d7a-30d984fa35a9] Start building networks asynchronously for instance. {{(pid=85141) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 10:25:14 user nova-compute[85141]: DEBUG nova.compute.manager [None req-eaf2c923-c735-42ce-87bf-80c05bbdb5d5 tempest-VolumesActionsTest-511249111 tempest-VolumesActionsTest-511249111-project-member] [instance: 2b4347a0-a9f0-4e4c-9d7a-30d984fa35a9] Allocating IP information in the background. {{(pid=85141) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 10:25:14 user nova-compute[85141]: DEBUG nova.network.neutron [None req-eaf2c923-c735-42ce-87bf-80c05bbdb5d5 tempest-VolumesActionsTest-511249111 tempest-VolumesActionsTest-511249111-project-member] [instance: 2b4347a0-a9f0-4e4c-9d7a-30d984fa35a9] allocate_for_instance() {{(pid=85141) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 10:25:14 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-eaf2c923-c735-42ce-87bf-80c05bbdb5d5 tempest-VolumesActionsTest-511249111 tempest-VolumesActionsTest-511249111-project-member] [instance: 2b4347a0-a9f0-4e4c-9d7a-30d984fa35a9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 10:25:14 user nova-compute[85141]: DEBUG nova.compute.manager [None req-eaf2c923-c735-42ce-87bf-80c05bbdb5d5 tempest-VolumesActionsTest-511249111 tempest-VolumesActionsTest-511249111-project-member] [instance: 2b4347a0-a9f0-4e4c-9d7a-30d984fa35a9] Start building block device mappings for instance. {{(pid=85141) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 10:25:14 user nova-compute[85141]: DEBUG nova.policy [None req-eaf2c923-c735-42ce-87bf-80c05bbdb5d5 tempest-VolumesActionsTest-511249111 tempest-VolumesActionsTest-511249111-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e7bfe97b6b494d969ab1d6fe766563e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d645d18547849f8ad9e1035b7e7f71a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85141) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 10:25:14 user nova-compute[85141]: DEBUG nova.compute.manager [None req-eaf2c923-c735-42ce-87bf-80c05bbdb5d5 tempest-VolumesActionsTest-511249111 tempest-VolumesActionsTest-511249111-project-member] [instance: 2b4347a0-a9f0-4e4c-9d7a-30d984fa35a9] Start spawning the instance on the hypervisor. {{(pid=85141) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 10:25:14 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-eaf2c923-c735-42ce-87bf-80c05bbdb5d5 tempest-VolumesActionsTest-511249111 tempest-VolumesActionsTest-511249111-project-member] [instance: 2b4347a0-a9f0-4e4c-9d7a-30d984fa35a9] Creating instance directory {{(pid=85141) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 10:25:14 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-eaf2c923-c735-42ce-87bf-80c05bbdb5d5 tempest-VolumesActionsTest-511249111 tempest-VolumesActionsTest-511249111-project-member] [instance: 2b4347a0-a9f0-4e4c-9d7a-30d984fa35a9] Creating image(s)
Nov 16 10:25:14 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-eaf2c923-c735-42ce-87bf-80c05bbdb5d5 tempest-VolumesActionsTest-511249111 tempest-VolumesActionsTest-511249111-project-member] Acquiring lock "/opt/stack/data/nova/instances/2b4347a0-a9f0-4e4c-9d7a-30d984fa35a9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:25:14 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-eaf2c923-c735-42ce-87bf-80c05bbdb5d5 tempest-VolumesActionsTest-511249111 tempest-VolumesActionsTest-511249111-project-member] Lock "/opt/stack/data/nova/instances/2b4347a0-a9f0-4e4c-9d7a-30d984fa35a9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:25:14 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-eaf2c923-c735-42ce-87bf-80c05bbdb5d5 tempest-VolumesActionsTest-511249111 tempest-VolumesActionsTest-511249111-project-member] Lock "/opt/stack/data/nova/instances/2b4347a0-a9f0-4e4c-9d7a-30d984fa35a9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:25:14 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-eaf2c923-c735-42ce-87bf-80c05bbdb5d5 tempest-VolumesActionsTest-511249111 tempest-VolumesActionsTest-511249111-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:25:14 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-eaf2c923-c735-42ce-87bf-80c05bbdb5d5 tempest-VolumesActionsTest-511249111 tempest-VolumesActionsTest-511249111-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json" returned: 0 in 0.199s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:25:14 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-eaf2c923-c735-42ce-87bf-80c05bbdb5d5 tempest-VolumesActionsTest-511249111 tempest-VolumesActionsTest-511249111-project-member] Acquiring lock "60a78556fb399ed4a41bc3ca4bccf77c96d8e811" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:25:14 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-eaf2c923-c735-42ce-87bf-80c05bbdb5d5 tempest-VolumesActionsTest-511249111 tempest-VolumesActionsTest-511249111-project-member] Lock "60a78556fb399ed4a41bc3ca4bccf77c96d8e811" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:25:14 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-eaf2c923-c735-42ce-87bf-80c05bbdb5d5 tempest-VolumesActionsTest-511249111 tempest-VolumesActionsTest-511249111-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:25:14 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-eaf2c923-c735-42ce-87bf-80c05bbdb5d5 tempest-VolumesActionsTest-511249111 tempest-VolumesActionsTest-511249111-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json" returned: 0 in 0.178s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:25:14 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-eaf2c923-c735-42ce-87bf-80c05bbdb5d5 tempest-VolumesActionsTest-511249111 tempest-VolumesActionsTest-511249111-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811,backing_fmt=raw /opt/stack/data/nova/instances/2b4347a0-a9f0-4e4c-9d7a-30d984fa35a9/disk 1073741824 {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:25:14 user nova-compute[85141]: DEBUG nova.network.neutron [None req-eaf2c923-c735-42ce-87bf-80c05bbdb5d5 tempest-VolumesActionsTest-511249111 tempest-VolumesActionsTest-511249111-project-member] [instance: 2b4347a0-a9f0-4e4c-9d7a-30d984fa35a9] Successfully created port: bec27503-c534-4783-a7e9-a3a882a7590c {{(pid=85141) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 10:25:14 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-eaf2c923-c735-42ce-87bf-80c05bbdb5d5 tempest-VolumesActionsTest-511249111 tempest-VolumesActionsTest-511249111-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811,backing_fmt=raw /opt/stack/data/nova/instances/2b4347a0-a9f0-4e4c-9d7a-30d984fa35a9/disk 1073741824" returned: 0 in 0.049s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:25:14 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-eaf2c923-c735-42ce-87bf-80c05bbdb5d5 tempest-VolumesActionsTest-511249111 tempest-VolumesActionsTest-511249111-project-member] Lock "60a78556fb399ed4a41bc3ca4bccf77c96d8e811" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.232s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:25:14 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-eaf2c923-c735-42ce-87bf-80c05bbdb5d5 tempest-VolumesActionsTest-511249111 tempest-VolumesActionsTest-511249111-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:25:14 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-9160053b-a51e-4dd2-b256-ec3f62db25f1 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Searching for a device in session 37 and hctl ['36', '*', '*', 0] yield: sde {{(pid=85141) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 10:25:14 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-9160053b-a51e-4dd2-b256-ec3f62db25f1 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:2006a77c-e5e8-4ec5-8de5-a0f9505c429a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vdtqwVjE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=85141) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 10:25:14 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-9160053b-a51e-4dd2-b256-ec3f62db25f1 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.408s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 10:25:14 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-9160053b-a51e-4dd2-b256-ec3f62db25f1 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] <== connect_volume: return (1409ms) {'type': 'block', 'scsi_wwn': '23838366537646236', 'path': '/dev/sde'} {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 10:25:14 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9160053b-a51e-4dd2-b256-ec3f62db25f1 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] [instance: bc76703d-9243-4277-9b13-d6f9639cd1bb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23838366537646236', 'path': '/dev/sde'} {{(pid=85141) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 10:25:14 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-9160053b-a51e-4dd2-b256-ec3f62db25f1 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T10:25:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-331499197',display_name='tempest-ServerActionsTestOtherA-server-331499197',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-331499197',id=34,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFB91nOE4JIg0PQZ9Fq9iMRTb/Qm6bpwHSXAkC8g5YxG6awy4b4nS0XAfWSm4O4f40Blu3eMfyuYdZY8eI6KFpQYslLrgvG2jeJNbK6AHNNiLWxDV8sQbQZDDAy7NeOUMQ==',key_name='tempest-keypair-799272913',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='879fa3f4dfc34726b20149b8a7db22dc',ramdisk_id='',reservation_id='r-01yoy1pt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1137992555',owner_user_name='tempest-ServerActionsTestOtherA-1137992555-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T10:25:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e95802a919de4345add493a8d7873e48',uuid=bc76703d-9243-4277-9b13-d6f9639cd1bb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fbf147e2-d8e0-4cb5-8ec5-79756fc53140", "address": "fa:16:3e:a1:42:09", "network": {"id": "859d1f09-56c4-4c2b-b2c3-02b1938e8dbf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1562516834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "879fa3f4dfc34726b20149b8a7db22dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbf147e2-d8", "ovs_interfaceid": "fbf147e2-d8e0-4cb5-8ec5-79756fc53140", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=85141) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 10:25:14 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-9160053b-a51e-4dd2-b256-ec3f62db25f1 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Converting VIF {"id": "fbf147e2-d8e0-4cb5-8ec5-79756fc53140", "address": "fa:16:3e:a1:42:09", "network": {"id": "859d1f09-56c4-4c2b-b2c3-02b1938e8dbf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1562516834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "879fa3f4dfc34726b20149b8a7db22dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbf147e2-d8", "ovs_interfaceid": "fbf147e2-d8e0-4cb5-8ec5-79756fc53140", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:25:14 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-9160053b-a51e-4dd2-b256-ec3f62db25f1 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a1:42:09,bridge_name='br-int',has_traffic_filtering=True,id=fbf147e2-d8e0-4cb5-8ec5-79756fc53140,network=Network(859d1f09-56c4-4c2b-b2c3-02b1938e8dbf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfbf147e2-d8') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:25:14 user nova-compute[85141]: DEBUG nova.objects.instance [None req-9160053b-a51e-4dd2-b256-ec3f62db25f1 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Lazy-loading 'pci_devices' on Instance uuid bc76703d-9243-4277-9b13-d6f9639cd1bb {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:25:14 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-9160053b-a51e-4dd2-b256-ec3f62db25f1 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] [instance: bc76703d-9243-4277-9b13-d6f9639cd1bb] End _get_guest_xml xml=<domain type="kvm">
Nov 16 10:25:14 user nova-compute[85141]:   <uuid>bc76703d-9243-4277-9b13-d6f9639cd1bb</uuid>
Nov 16 10:25:14 user nova-compute[85141]:   <name>instance-00000022</name>
Nov 16 10:25:14 user nova-compute[85141]:   <memory>524288</memory>
Nov 16 10:25:14 user nova-compute[85141]:   <vcpu>1</vcpu>
Nov 16 10:25:14 user nova-compute[85141]:   <metadata>
Nov 16 10:25:14 user nova-compute[85141]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 10:25:14 user nova-compute[85141]:       <nova:package version="0.0.0"/>
Nov 16 10:25:14 user nova-compute[85141]:       <nova:name>tempest-ServerActionsTestOtherA-server-331499197</nova:name>
Nov 16 10:25:14 user nova-compute[85141]:       <nova:creationTime>2023-11-16 10:25:13</nova:creationTime>
Nov 16 10:25:14 user nova-compute[85141]:       <nova:flavor name="m1.tiny">
Nov 16 10:25:14 user nova-compute[85141]:         <nova:memory>512</nova:memory>
Nov 16 10:25:14 user nova-compute[85141]:         <nova:disk>1</nova:disk>
Nov 16 10:25:14 user nova-compute[85141]:         <nova:swap>0</nova:swap>
Nov 16 10:25:14 user nova-compute[85141]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 10:25:14 user nova-compute[85141]:         <nova:vcpus>1</nova:vcpus>
Nov 16 10:25:14 user nova-compute[85141]:       </nova:flavor>
Nov 16 10:25:14 user nova-compute[85141]:       <nova:owner>
Nov 16 10:25:14 user nova-compute[85141]:         <nova:user uuid="e95802a919de4345add493a8d7873e48">tempest-ServerActionsTestOtherA-1137992555-project-member</nova:user>
Nov 16 10:25:14 user nova-compute[85141]:         <nova:project uuid="879fa3f4dfc34726b20149b8a7db22dc">tempest-ServerActionsTestOtherA-1137992555</nova:project>
Nov 16 10:25:14 user nova-compute[85141]:       </nova:owner>
Nov 16 10:25:14 user nova-compute[85141]:       <nova:ports>
Nov 16 10:25:14 user nova-compute[85141]:         <nova:port uuid="fbf147e2-d8e0-4cb5-8ec5-79756fc53140">
Nov 16 10:25:14 user nova-compute[85141]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 16 10:25:14 user nova-compute[85141]:         </nova:port>
Nov 16 10:25:14 user nova-compute[85141]:       </nova:ports>
Nov 16 10:25:14 user nova-compute[85141]:     </nova:instance>
Nov 16 10:25:14 user nova-compute[85141]:   </metadata>
Nov 16 10:25:14 user nova-compute[85141]:   <sysinfo type="smbios">
Nov 16 10:25:14 user nova-compute[85141]:     <system>
Nov 16 10:25:14 user nova-compute[85141]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 10:25:14 user nova-compute[85141]:       <entry name="product">OpenStack Nova</entry>
Nov 16 10:25:14 user nova-compute[85141]:       <entry name="version">0.0.0</entry>
Nov 16 10:25:14 user nova-compute[85141]:       <entry name="serial">bc76703d-9243-4277-9b13-d6f9639cd1bb</entry>
Nov 16 10:25:14 user nova-compute[85141]:       <entry name="uuid">bc76703d-9243-4277-9b13-d6f9639cd1bb</entry>
Nov 16 10:25:14 user nova-compute[85141]:       <entry name="family">Virtual Machine</entry>
Nov 16 10:25:14 user nova-compute[85141]:     </system>
Nov 16 10:25:14 user nova-compute[85141]:   </sysinfo>
Nov 16 10:25:14 user nova-compute[85141]:   <os>
Nov 16 10:25:14 user nova-compute[85141]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 10:25:14 user nova-compute[85141]:     <boot dev="hd"/>
Nov 16 10:25:14 user nova-compute[85141]:     <smbios mode="sysinfo"/>
Nov 16 10:25:14 user nova-compute[85141]:   </os>
Nov 16 10:25:14 user nova-compute[85141]:   <features>
Nov 16 10:25:14 user nova-compute[85141]:     <acpi/>
Nov 16 10:25:14 user nova-compute[85141]:     <apic/>
Nov 16 10:25:14 user nova-compute[85141]:     <vmcoreinfo/>
Nov 16 10:25:14 user nova-compute[85141]:   </features>
Nov 16 10:25:14 user nova-compute[85141]:   <clock offset="utc">
Nov 16 10:25:14 user nova-compute[85141]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 10:25:14 user nova-compute[85141]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 10:25:14 user nova-compute[85141]:     <timer name="hpet" present="no"/>
Nov 16 10:25:14 user nova-compute[85141]:   </clock>
Nov 16 10:25:14 user nova-compute[85141]:   <cpu mode="custom" match="exact">
Nov 16 10:25:14 user nova-compute[85141]:     <model>Nehalem</model>
Nov 16 10:25:14 user nova-compute[85141]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 10:25:14 user nova-compute[85141]:   </cpu>
Nov 16 10:25:14 user nova-compute[85141]:   <devices>
Nov 16 10:25:14 user nova-compute[85141]:     <disk type="block" device="disk">
Nov 16 10:25:14 user nova-compute[85141]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 10:25:14 user nova-compute[85141]:       <source dev="/dev/sde"/>
Nov 16 10:25:14 user nova-compute[85141]:       <target dev="vda" bus="virtio"/>
Nov 16 10:25:14 user nova-compute[85141]:       <serial>2006a77c-e5e8-4ec5-8de5-a0f9505c429a</serial>
Nov 16 10:25:14 user nova-compute[85141]:     </disk>
Nov 16 10:25:14 user nova-compute[85141]:     <interface type="ethernet">
Nov 16 10:25:14 user nova-compute[85141]:       <mac address="fa:16:3e:a1:42:09"/>
Nov 16 10:25:14 user nova-compute[85141]:       <model type="virtio"/>
Nov 16 10:25:14 user nova-compute[85141]:       <mtu size="1442"/>
Nov 16 10:25:14 user nova-compute[85141]:       <target dev="tapfbf147e2-d8"/>
Nov 16 10:25:14 user nova-compute[85141]:     </interface>
Nov 16 10:25:14 user nova-compute[85141]:     <serial type="pty">
Nov 16 10:25:14 user nova-compute[85141]:       <log file="/opt/stack/data/nova/instances/bc76703d-9243-4277-9b13-d6f9639cd1bb/console.log" append="off"/>
Nov 16 10:25:14 user nova-compute[85141]:     </serial>
Nov 16 10:25:14 user nova-compute[85141]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 10:25:14 user nova-compute[85141]:     <video>
Nov 16 10:25:14 user nova-compute[85141]:       <model type="virtio"/>
Nov 16 10:25:14 user nova-compute[85141]:     </video>
Nov 16 10:25:14 user nova-compute[85141]:     <rng model="virtio">
Nov 16 10:25:14 user nova-compute[85141]:       <backend model="random">/dev/urandom</backend>
Nov 16 10:25:14 user nova-compute[85141]:     </rng>
Nov 16 10:25:14 user nova-compute[85141]:     <controller type="usb" index="0" model="none"/>
Nov 16 10:25:14 user nova-compute[85141]:     <memballoon model="virtio">
Nov 16 10:25:14 user nova-compute[85141]:       <stats period="10"/>
Nov 16 10:25:14 user nova-compute[85141]:     </memballoon>
Nov 16 10:25:14 user nova-compute[85141]:   </devices>
Nov 16 10:25:14 user nova-compute[85141]: </domain>
Nov 16 10:25:14 user nova-compute[85141]:  {{(pid=85141) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 10:25:14 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-9160053b-a51e-4dd2-b256-ec3f62db25f1 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T10:25:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-331499197',display_name='tempest-ServerActionsTestOtherA-server-331499197',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-331499197',id=34,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFB91nOE4JIg0PQZ9Fq9iMRTb/Qm6bpwHSXAkC8g5YxG6awy4b4nS0XAfWSm4O4f40Blu3eMfyuYdZY8eI6KFpQYslLrgvG2jeJNbK6AHNNiLWxDV8sQbQZDDAy7NeOUMQ==',key_name='tempest-keypair-799272913',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='879fa3f4dfc34726b20149b8a7db22dc',ramdisk_id='',reservation_id='r-01yoy1pt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1137992555',owner_user_name='tempest-ServerActionsTestOtherA-1137992555-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T10:25:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e95802a919de4345add493a8d7873e48',uuid=bc76703d-9243-4277-9b13-d6f9639cd1bb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fbf147e2-d8e0-4cb5-8ec5-79756fc53140", "address": "fa:16:3e:a1:42:09", "network": {"id": "859d1f09-56c4-4c2b-b2c3-02b1938e8dbf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1562516834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "879fa3f4dfc34726b20149b8a7db22dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbf147e2-d8", "ovs_interfaceid": "fbf147e2-d8e0-4cb5-8ec5-79756fc53140", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 10:25:14 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-9160053b-a51e-4dd2-b256-ec3f62db25f1 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Converting VIF {"id": "fbf147e2-d8e0-4cb5-8ec5-79756fc53140", "address": "fa:16:3e:a1:42:09", "network": {"id": "859d1f09-56c4-4c2b-b2c3-02b1938e8dbf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1562516834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "879fa3f4dfc34726b20149b8a7db22dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbf147e2-d8", "ovs_interfaceid": "fbf147e2-d8e0-4cb5-8ec5-79756fc53140", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:25:14 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-9160053b-a51e-4dd2-b256-ec3f62db25f1 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a1:42:09,bridge_name='br-int',has_traffic_filtering=True,id=fbf147e2-d8e0-4cb5-8ec5-79756fc53140,network=Network(859d1f09-56c4-4c2b-b2c3-02b1938e8dbf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfbf147e2-d8') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:25:14 user nova-compute[85141]: DEBUG os_vif [None req-9160053b-a51e-4dd2-b256-ec3f62db25f1 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a1:42:09,bridge_name='br-int',has_traffic_filtering=True,id=fbf147e2-d8e0-4cb5-8ec5-79756fc53140,network=Network(859d1f09-56c4-4c2b-b2c3-02b1938e8dbf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfbf147e2-d8') {{(pid=85141) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 10:25:14 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:25:14 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:25:14 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 10:25:14 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:25:14 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '65de3341-fe7b-5fad-a360-1f0e869a3463', '_type': 'linux-noop'}}, row=False) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:25:14 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:25:14 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:25:14 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:25:14 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:25:14 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfbf147e2-d8, may_exist=True, interface_attrs={}) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:25:14 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfbf147e2-d8, col_values=(('qos', UUID('6f187b70-cd36-4bb9-a335-ff4b4e3298a0')),), if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:25:14 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfbf147e2-d8, col_values=(('external_ids', {'iface-id': 'fbf147e2-d8e0-4cb5-8ec5-79756fc53140', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a1:42:09', 'vm-uuid': 'bc76703d-9243-4277-9b13-d6f9639cd1bb'}),), if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:25:14 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:25:14 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:25:14 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:25:14 user nova-compute[85141]: INFO os_vif [None req-9160053b-a51e-4dd2-b256-ec3f62db25f1 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a1:42:09,bridge_name='br-int',has_traffic_filtering=True,id=fbf147e2-d8e0-4cb5-8ec5-79756fc53140,network=Network(859d1f09-56c4-4c2b-b2c3-02b1938e8dbf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfbf147e2-d8')
Nov 16 10:25:14 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-eaf2c923-c735-42ce-87bf-80c05bbdb5d5 tempest-VolumesActionsTest-511249111 tempest-VolumesActionsTest-511249111-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json" returned: 0 in 0.183s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:25:14 user nova-compute[85141]: DEBUG nova.virt.disk.api [None req-eaf2c923-c735-42ce-87bf-80c05bbdb5d5 tempest-VolumesActionsTest-511249111 tempest-VolumesActionsTest-511249111-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2b4347a0-a9f0-4e4c-9d7a-30d984fa35a9/disk. size=1073741824 {{(pid=85141) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 10:25:14 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-eaf2c923-c735-42ce-87bf-80c05bbdb5d5 tempest-VolumesActionsTest-511249111 tempest-VolumesActionsTest-511249111-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b4347a0-a9f0-4e4c-9d7a-30d984fa35a9/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:25:15 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-9160053b-a51e-4dd2-b256-ec3f62db25f1 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] No BDM found with device name vda, not building metadata. {{(pid=85141) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 10:25:15 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-9160053b-a51e-4dd2-b256-ec3f62db25f1 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] No VIF found with MAC fa:16:3e:a1:42:09, not building metadata {{(pid=85141) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 10:25:15 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-eaf2c923-c735-42ce-87bf-80c05bbdb5d5 tempest-VolumesActionsTest-511249111 tempest-VolumesActionsTest-511249111-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b4347a0-a9f0-4e4c-9d7a-30d984fa35a9/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:25:15 user nova-compute[85141]: DEBUG nova.virt.disk.api [None req-eaf2c923-c735-42ce-87bf-80c05bbdb5d5 tempest-VolumesActionsTest-511249111 tempest-VolumesActionsTest-511249111-project-member] Cannot resize image /opt/stack/data/nova/instances/2b4347a0-a9f0-4e4c-9d7a-30d984fa35a9/disk to a smaller size. {{(pid=85141) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 10:25:15 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-eaf2c923-c735-42ce-87bf-80c05bbdb5d5 tempest-VolumesActionsTest-511249111 tempest-VolumesActionsTest-511249111-project-member] [instance: 2b4347a0-a9f0-4e4c-9d7a-30d984fa35a9] Created local disks {{(pid=85141) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 10:25:15 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-eaf2c923-c735-42ce-87bf-80c05bbdb5d5 tempest-VolumesActionsTest-511249111 tempest-VolumesActionsTest-511249111-project-member] [instance: 2b4347a0-a9f0-4e4c-9d7a-30d984fa35a9] Ensure instance console log exists: /opt/stack/data/nova/instances/2b4347a0-a9f0-4e4c-9d7a-30d984fa35a9/console.log {{(pid=85141) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 10:25:15 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-eaf2c923-c735-42ce-87bf-80c05bbdb5d5 tempest-VolumesActionsTest-511249111 tempest-VolumesActionsTest-511249111-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:25:15 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-eaf2c923-c735-42ce-87bf-80c05bbdb5d5 tempest-VolumesActionsTest-511249111 tempest-VolumesActionsTest-511249111-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:25:15 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-eaf2c923-c735-42ce-87bf-80c05bbdb5d5 tempest-VolumesActionsTest-511249111 tempest-VolumesActionsTest-511249111-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:25:15 user nova-compute[85141]: DEBUG nova.network.neutron [None req-eaf2c923-c735-42ce-87bf-80c05bbdb5d5 tempest-VolumesActionsTest-511249111 tempest-VolumesActionsTest-511249111-project-member] [instance: 2b4347a0-a9f0-4e4c-9d7a-30d984fa35a9] Successfully updated port: bec27503-c534-4783-a7e9-a3a882a7590c {{(pid=85141) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 10:25:15 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-eaf2c923-c735-42ce-87bf-80c05bbdb5d5 tempest-VolumesActionsTest-511249111 tempest-VolumesActionsTest-511249111-project-member] Acquiring lock "refresh_cache-2b4347a0-a9f0-4e4c-9d7a-30d984fa35a9" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:25:15 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-eaf2c923-c735-42ce-87bf-80c05bbdb5d5 tempest-VolumesActionsTest-511249111 tempest-VolumesActionsTest-511249111-project-member] Acquired lock "refresh_cache-2b4347a0-a9f0-4e4c-9d7a-30d984fa35a9" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:25:15 user nova-compute[85141]: DEBUG nova.network.neutron [None req-eaf2c923-c735-42ce-87bf-80c05bbdb5d5 tempest-VolumesActionsTest-511249111 tempest-VolumesActionsTest-511249111-project-member] [instance: 2b4347a0-a9f0-4e4c-9d7a-30d984fa35a9] Building network info cache for instance {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 10:25:15 user nova-compute[85141]: DEBUG nova.compute.manager [req-d478e9fe-aa71-463a-94ed-b77a85baef31 req-614d73f5-8a75-4d2b-aba5-58ad3b25887d service nova] [instance: 2b4347a0-a9f0-4e4c-9d7a-30d984fa35a9] Received event network-changed-bec27503-c534-4783-a7e9-a3a882a7590c {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:25:15 user nova-compute[85141]: DEBUG nova.compute.manager [req-d478e9fe-aa71-463a-94ed-b77a85baef31 req-614d73f5-8a75-4d2b-aba5-58ad3b25887d service nova] [instance: 2b4347a0-a9f0-4e4c-9d7a-30d984fa35a9] Refreshing instance network info cache due to event network-changed-bec27503-c534-4783-a7e9-a3a882a7590c. {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 10:25:15 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-d478e9fe-aa71-463a-94ed-b77a85baef31 req-614d73f5-8a75-4d2b-aba5-58ad3b25887d service nova] Acquiring lock "refresh_cache-2b4347a0-a9f0-4e4c-9d7a-30d984fa35a9" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:25:15 user nova-compute[85141]: DEBUG nova.network.neutron [None req-eaf2c923-c735-42ce-87bf-80c05bbdb5d5 tempest-VolumesActionsTest-511249111 tempest-VolumesActionsTest-511249111-project-member] [instance: 2b4347a0-a9f0-4e4c-9d7a-30d984fa35a9] Instance cache missing network info. {{(pid=85141) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 10:25:15 user nova-compute[85141]: DEBUG nova.network.neutron [None req-eaf2c923-c735-42ce-87bf-80c05bbdb5d5 tempest-VolumesActionsTest-511249111 tempest-VolumesActionsTest-511249111-project-member] [instance: 2b4347a0-a9f0-4e4c-9d7a-30d984fa35a9] Updating instance_info_cache with network_info: [{"id": "bec27503-c534-4783-a7e9-a3a882a7590c", "address": "fa:16:3e:79:9d:06", "network": {"id": "5bb45ec6-2255-4d0a-b503-097a9d8ad0df", "bridge": "br-int", "label": "tempest-VolumesActionsTest-115729215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d645d18547849f8ad9e1035b7e7f71a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbec27503-c5", "ovs_interfaceid": "bec27503-c534-4783-a7e9-a3a882a7590c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:25:15 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-fcca7a63-8289-4bed-bd93-b073bc8e7280 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Acquiring lock "17480138-4b61-43f7-92a5-db065f7d1696" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:25:15 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-fcca7a63-8289-4bed-bd93-b073bc8e7280 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Lock "17480138-4b61-43f7-92a5-db065f7d1696" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.003s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:25:15 user nova-compute[85141]: DEBUG nova.objects.instance [None req-fcca7a63-8289-4bed-bd93-b073bc8e7280 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Lazy-loading 'flavor' on Instance uuid 17480138-4b61-43f7-92a5-db065f7d1696 {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:25:16 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-eaf2c923-c735-42ce-87bf-80c05bbdb5d5 tempest-VolumesActionsTest-511249111 tempest-VolumesActionsTest-511249111-project-member] Releasing lock "refresh_cache-2b4347a0-a9f0-4e4c-9d7a-30d984fa35a9" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:25:16 user nova-compute[85141]: DEBUG nova.compute.manager [None req-eaf2c923-c735-42ce-87bf-80c05bbdb5d5 tempest-VolumesActionsTest-511249111 tempest-VolumesActionsTest-511249111-project-member] [instance: 2b4347a0-a9f0-4e4c-9d7a-30d984fa35a9] Instance network_info: |[{"id": "bec27503-c534-4783-a7e9-a3a882a7590c", "address": "fa:16:3e:79:9d:06", "network": {"id": "5bb45ec6-2255-4d0a-b503-097a9d8ad0df", "bridge": "br-int", "label": "tempest-VolumesActionsTest-115729215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d645d18547849f8ad9e1035b7e7f71a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbec27503-c5", "ovs_interfaceid": "bec27503-c534-4783-a7e9-a3a882a7590c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=85141) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 10:25:16 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-d478e9fe-aa71-463a-94ed-b77a85baef31 req-614d73f5-8a75-4d2b-aba5-58ad3b25887d service nova] Acquired lock "refresh_cache-2b4347a0-a9f0-4e4c-9d7a-30d984fa35a9" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:25:16 user nova-compute[85141]: DEBUG nova.network.neutron [req-d478e9fe-aa71-463a-94ed-b77a85baef31 req-614d73f5-8a75-4d2b-aba5-58ad3b25887d service nova] [instance: 2b4347a0-a9f0-4e4c-9d7a-30d984fa35a9] Refreshing network info cache for port bec27503-c534-4783-a7e9-a3a882a7590c {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 10:25:16 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-eaf2c923-c735-42ce-87bf-80c05bbdb5d5 tempest-VolumesActionsTest-511249111 tempest-VolumesActionsTest-511249111-project-member] [instance: 2b4347a0-a9f0-4e4c-9d7a-30d984fa35a9] Start _get_guest_xml network_info=[{"id": "bec27503-c534-4783-a7e9-a3a882a7590c", "address": "fa:16:3e:79:9d:06", "network": {"id": "5bb45ec6-2255-4d0a-b503-097a9d8ad0df", "bridge": "br-int", "label": "tempest-VolumesActionsTest-115729215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d645d18547849f8ad9e1035b7e7f71a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbec27503-c5", "ovs_interfaceid": "bec27503-c534-4783-a7e9-a3a882a7590c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T10:06:42Z,direct_url=<?>,disk_format='qcow2',id=bc4ca70f-a459-4d5c-a9e6-80f1948eb48b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1044631a5fe84ce8904864a7024049fa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T10:06:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_options': None, 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'image_id': 'bc4ca70f-a459-4d5c-a9e6-80f1948eb48b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=85141) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 10:25:16 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-fcca7a63-8289-4bed-bd93-b073bc8e7280 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Lock "17480138-4b61-43f7-92a5-db065f7d1696" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.087s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:25:16 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-eaf2c923-c735-42ce-87bf-80c05bbdb5d5 tempest-VolumesActionsTest-511249111 tempest-VolumesActionsTest-511249111-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:25:16 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-eaf2c923-c735-42ce-87bf-80c05bbdb5d5 tempest-VolumesActionsTest-511249111 tempest-VolumesActionsTest-511249111-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:25:16 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-eaf2c923-c735-42ce-87bf-80c05bbdb5d5 tempest-VolumesActionsTest-511249111 tempest-VolumesActionsTest-511249111-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=85141) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 10:25:16 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-eaf2c923-c735-42ce-87bf-80c05bbdb5d5 tempest-VolumesActionsTest-511249111 tempest-VolumesActionsTest-511249111-project-member] CPU controller missing on host. {{(pid=85141) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 10:25:16 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-eaf2c923-c735-42ce-87bf-80c05bbdb5d5 tempest-VolumesActionsTest-511249111 tempest-VolumesActionsTest-511249111-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=85141) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 10:25:16 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-eaf2c923-c735-42ce-87bf-80c05bbdb5d5 tempest-VolumesActionsTest-511249111 tempest-VolumesActionsTest-511249111-project-member] CPU controller found on host. {{(pid=85141) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 10:25:16 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-eaf2c923-c735-42ce-87bf-80c05bbdb5d5 tempest-VolumesActionsTest-511249111 tempest-VolumesActionsTest-511249111-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=85141) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 10:25:16 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-eaf2c923-c735-42ce-87bf-80c05bbdb5d5 tempest-VolumesActionsTest-511249111 tempest-VolumesActionsTest-511249111-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T10:06:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T10:06:42Z,direct_url=<?>,disk_format='qcow2',id=bc4ca70f-a459-4d5c-a9e6-80f1948eb48b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1044631a5fe84ce8904864a7024049fa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T10:06:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 10:25:16 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-eaf2c923-c735-42ce-87bf-80c05bbdb5d5 tempest-VolumesActionsTest-511249111 tempest-VolumesActionsTest-511249111-project-member] Flavor limits 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 10:25:16 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-eaf2c923-c735-42ce-87bf-80c05bbdb5d5 tempest-VolumesActionsTest-511249111 tempest-VolumesActionsTest-511249111-project-member] Image limits 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 10:25:16 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-eaf2c923-c735-42ce-87bf-80c05bbdb5d5 tempest-VolumesActionsTest-511249111 tempest-VolumesActionsTest-511249111-project-member] Flavor pref 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 10:25:16 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-eaf2c923-c735-42ce-87bf-80c05bbdb5d5 tempest-VolumesActionsTest-511249111 tempest-VolumesActionsTest-511249111-project-member] Image pref 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 10:25:16 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-eaf2c923-c735-42ce-87bf-80c05bbdb5d5 tempest-VolumesActionsTest-511249111 tempest-VolumesActionsTest-511249111-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 10:25:16 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-eaf2c923-c735-42ce-87bf-80c05bbdb5d5 tempest-VolumesActionsTest-511249111 tempest-VolumesActionsTest-511249111-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 10:25:16 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-eaf2c923-c735-42ce-87bf-80c05bbdb5d5 tempest-VolumesActionsTest-511249111 tempest-VolumesActionsTest-511249111-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=85141) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 10:25:16 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-eaf2c923-c735-42ce-87bf-80c05bbdb5d5 tempest-VolumesActionsTest-511249111 tempest-VolumesActionsTest-511249111-project-member] Got 1 possible topologies {{(pid=85141) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 10:25:16 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-eaf2c923-c735-42ce-87bf-80c05bbdb5d5 tempest-VolumesActionsTest-511249111 tempest-VolumesActionsTest-511249111-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 10:25:16 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-eaf2c923-c735-42ce-87bf-80c05bbdb5d5 tempest-VolumesActionsTest-511249111 tempest-VolumesActionsTest-511249111-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 10:25:16 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-eaf2c923-c735-42ce-87bf-80c05bbdb5d5 tempest-VolumesActionsTest-511249111 tempest-VolumesActionsTest-511249111-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T10:25:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1306621481',display_name='tempest-VolumesActionsTest-instance-1306621481',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1306621481',id=35,image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0d645d18547849f8ad9e1035b7e7f71a',ramdisk_id='',reservation_id='r-0dbebm31',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-511249111',owner_user_name='tempest-VolumesActionsTest-511249111-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T10:25:14Z,user_data=None,user_id='e7bfe97b6b494d969ab1d6fe766563e8',uuid=2b4347a0-a9f0-4e4c-9d7a-30d984fa35a9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bec27503-c534-4783-a7e9-a3a882a7590c", "address": "fa:16:3e:79:9d:06", "network": {"id": "5bb45ec6-2255-4d0a-b503-097a9d8ad0df", "bridge": "br-int", "label": "tempest-VolumesActionsTest-115729215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d645d18547849f8ad9e1035b7e7f71a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbec27503-c5", "ovs_interfaceid": "bec27503-c534-4783-a7e9-a3a882a7590c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=85141) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 10:25:16 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-eaf2c923-c735-42ce-87bf-80c05bbdb5d5 tempest-VolumesActionsTest-511249111 tempest-VolumesActionsTest-511249111-project-member] Converting VIF {"id": "bec27503-c534-4783-a7e9-a3a882a7590c", "address": "fa:16:3e:79:9d:06", "network": {"id": "5bb45ec6-2255-4d0a-b503-097a9d8ad0df", "bridge": "br-int", "label": "tempest-VolumesActionsTest-115729215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d645d18547849f8ad9e1035b7e7f71a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbec27503-c5", "ovs_interfaceid": "bec27503-c534-4783-a7e9-a3a882a7590c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:25:16 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-eaf2c923-c735-42ce-87bf-80c05bbdb5d5 tempest-VolumesActionsTest-511249111 tempest-VolumesActionsTest-511249111-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:9d:06,bridge_name='br-int',has_traffic_filtering=True,id=bec27503-c534-4783-a7e9-a3a882a7590c,network=Network(5bb45ec6-2255-4d0a-b503-097a9d8ad0df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbec27503-c5') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:25:16 user nova-compute[85141]: DEBUG nova.objects.instance [None req-eaf2c923-c735-42ce-87bf-80c05bbdb5d5 tempest-VolumesActionsTest-511249111 tempest-VolumesActionsTest-511249111-project-member] Lazy-loading 'pci_devices' on Instance uuid 2b4347a0-a9f0-4e4c-9d7a-30d984fa35a9 {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:25:16 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-eaf2c923-c735-42ce-87bf-80c05bbdb5d5 tempest-VolumesActionsTest-511249111 tempest-VolumesActionsTest-511249111-project-member] [instance: 2b4347a0-a9f0-4e4c-9d7a-30d984fa35a9] End _get_guest_xml xml=<domain type="kvm">
Nov 16 10:25:16 user nova-compute[85141]:   <uuid>2b4347a0-a9f0-4e4c-9d7a-30d984fa35a9</uuid>
Nov 16 10:25:16 user nova-compute[85141]:   <name>instance-00000023</name>
Nov 16 10:25:16 user nova-compute[85141]:   <memory>524288</memory>
Nov 16 10:25:16 user nova-compute[85141]:   <vcpu>1</vcpu>
Nov 16 10:25:16 user nova-compute[85141]:   <metadata>
Nov 16 10:25:16 user nova-compute[85141]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 10:25:16 user nova-compute[85141]:       <nova:package version="0.0.0"/>
Nov 16 10:25:16 user nova-compute[85141]:       <nova:name>tempest-VolumesActionsTest-instance-1306621481</nova:name>
Nov 16 10:25:16 user nova-compute[85141]:       <nova:creationTime>2023-11-16 10:25:16</nova:creationTime>
Nov 16 10:25:16 user nova-compute[85141]:       <nova:flavor name="m1.tiny">
Nov 16 10:25:16 user nova-compute[85141]:         <nova:memory>512</nova:memory>
Nov 16 10:25:16 user nova-compute[85141]:         <nova:disk>1</nova:disk>
Nov 16 10:25:16 user nova-compute[85141]:         <nova:swap>0</nova:swap>
Nov 16 10:25:16 user nova-compute[85141]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 10:25:16 user nova-compute[85141]:         <nova:vcpus>1</nova:vcpus>
Nov 16 10:25:16 user nova-compute[85141]:       </nova:flavor>
Nov 16 10:25:16 user nova-compute[85141]:       <nova:owner>
Nov 16 10:25:16 user nova-compute[85141]:         <nova:user uuid="e7bfe97b6b494d969ab1d6fe766563e8">tempest-VolumesActionsTest-511249111-project-member</nova:user>
Nov 16 10:25:16 user nova-compute[85141]:         <nova:project uuid="0d645d18547849f8ad9e1035b7e7f71a">tempest-VolumesActionsTest-511249111</nova:project>
Nov 16 10:25:16 user nova-compute[85141]:       </nova:owner>
Nov 16 10:25:16 user nova-compute[85141]:       <nova:root type="image" uuid="bc4ca70f-a459-4d5c-a9e6-80f1948eb48b"/>
Nov 16 10:25:16 user nova-compute[85141]:       <nova:ports>
Nov 16 10:25:16 user nova-compute[85141]:         <nova:port uuid="bec27503-c534-4783-a7e9-a3a882a7590c">
Nov 16 10:25:16 user nova-compute[85141]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 16 10:25:16 user nova-compute[85141]:         </nova:port>
Nov 16 10:25:16 user nova-compute[85141]:       </nova:ports>
Nov 16 10:25:16 user nova-compute[85141]:     </nova:instance>
Nov 16 10:25:16 user nova-compute[85141]:   </metadata>
Nov 16 10:25:16 user nova-compute[85141]:   <sysinfo type="smbios">
Nov 16 10:25:16 user nova-compute[85141]:     <system>
Nov 16 10:25:16 user nova-compute[85141]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 10:25:16 user nova-compute[85141]:       <entry name="product">OpenStack Nova</entry>
Nov 16 10:25:16 user nova-compute[85141]:       <entry name="version">0.0.0</entry>
Nov 16 10:25:16 user nova-compute[85141]:       <entry name="serial">2b4347a0-a9f0-4e4c-9d7a-30d984fa35a9</entry>
Nov 16 10:25:16 user nova-compute[85141]:       <entry name="uuid">2b4347a0-a9f0-4e4c-9d7a-30d984fa35a9</entry>
Nov 16 10:25:16 user nova-compute[85141]:       <entry name="family">Virtual Machine</entry>
Nov 16 10:25:16 user nova-compute[85141]:     </system>
Nov 16 10:25:16 user nova-compute[85141]:   </sysinfo>
Nov 16 10:25:16 user nova-compute[85141]:   <os>
Nov 16 10:25:16 user nova-compute[85141]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 10:25:16 user nova-compute[85141]:     <boot dev="hd"/>
Nov 16 10:25:16 user nova-compute[85141]:     <smbios mode="sysinfo"/>
Nov 16 10:25:16 user nova-compute[85141]:   </os>
Nov 16 10:25:16 user nova-compute[85141]:   <features>
Nov 16 10:25:16 user nova-compute[85141]:     <acpi/>
Nov 16 10:25:16 user nova-compute[85141]:     <apic/>
Nov 16 10:25:16 user nova-compute[85141]:     <vmcoreinfo/>
Nov 16 10:25:16 user nova-compute[85141]:   </features>
Nov 16 10:25:16 user nova-compute[85141]:   <clock offset="utc">
Nov 16 10:25:16 user nova-compute[85141]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 10:25:16 user nova-compute[85141]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 10:25:16 user nova-compute[85141]:     <timer name="hpet" present="no"/>
Nov 16 10:25:16 user nova-compute[85141]:   </clock>
Nov 16 10:25:16 user nova-compute[85141]:   <cpu mode="custom" match="exact">
Nov 16 10:25:16 user nova-compute[85141]:     <model>Nehalem</model>
Nov 16 10:25:16 user nova-compute[85141]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 10:25:16 user nova-compute[85141]:   </cpu>
Nov 16 10:25:16 user nova-compute[85141]:   <devices>
Nov 16 10:25:16 user nova-compute[85141]:     <disk type="file" device="disk">
Nov 16 10:25:16 user nova-compute[85141]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 10:25:16 user nova-compute[85141]:       <source file="/opt/stack/data/nova/instances/2b4347a0-a9f0-4e4c-9d7a-30d984fa35a9/disk"/>
Nov 16 10:25:16 user nova-compute[85141]:       <target dev="vda" bus="virtio"/>
Nov 16 10:25:16 user nova-compute[85141]:     </disk>
Nov 16 10:25:16 user nova-compute[85141]:     <interface type="ethernet">
Nov 16 10:25:16 user nova-compute[85141]:       <mac address="fa:16:3e:79:9d:06"/>
Nov 16 10:25:16 user nova-compute[85141]:       <model type="virtio"/>
Nov 16 10:25:16 user nova-compute[85141]:       <mtu size="1442"/>
Nov 16 10:25:16 user nova-compute[85141]:       <target dev="tapbec27503-c5"/>
Nov 16 10:25:16 user nova-compute[85141]:     </interface>
Nov 16 10:25:16 user nova-compute[85141]:     <serial type="pty">
Nov 16 10:25:16 user nova-compute[85141]:       <log file="/opt/stack/data/nova/instances/2b4347a0-a9f0-4e4c-9d7a-30d984fa35a9/console.log" append="off"/>
Nov 16 10:25:16 user nova-compute[85141]:     </serial>
Nov 16 10:25:16 user nova-compute[85141]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 10:25:16 user nova-compute[85141]:     <video>
Nov 16 10:25:16 user nova-compute[85141]:       <model type="virtio"/>
Nov 16 10:25:16 user nova-compute[85141]:     </video>
Nov 16 10:25:16 user nova-compute[85141]:     <rng model="virtio">
Nov 16 10:25:16 user nova-compute[85141]:       <backend model="random">/dev/urandom</backend>
Nov 16 10:25:16 user nova-compute[85141]:     </rng>
Nov 16 10:25:16 user nova-compute[85141]:     <controller type="usb" index="0" model="none"/>
Nov 16 10:25:16 user nova-compute[85141]:     <memballoon model="virtio">
Nov 16 10:25:16 user nova-compute[85141]:       <stats period="10"/>
Nov 16 10:25:16 user nova-compute[85141]:     </memballoon>
Nov 16 10:25:16 user nova-compute[85141]:   </devices>
Nov 16 10:25:16 user nova-compute[85141]: </domain>
Nov 16 10:25:16 user nova-compute[85141]:  {{(pid=85141) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 10:25:16 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-eaf2c923-c735-42ce-87bf-80c05bbdb5d5 tempest-VolumesActionsTest-511249111 tempest-VolumesActionsTest-511249111-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T10:25:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1306621481',display_name='tempest-VolumesActionsTest-instance-1306621481',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1306621481',id=35,image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0d645d18547849f8ad9e1035b7e7f71a',ramdisk_id='',reservation_id='r-0dbebm31',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-511249111',owner_user_name='tempest-VolumesActionsTest-511249111-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T10:25:14Z,user_data=None,user_id='e7bfe97b6b494d969ab1d6fe766563e8',uuid=2b4347a0-a9f0-4e4c-9d7a-30d984fa35a9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bec27503-c534-4783-a7e9-a3a882a7590c", "address": "fa:16:3e:79:9d:06", "network": {"id": "5bb45ec6-2255-4d0a-b503-097a9d8ad0df", "bridge": "br-int", "label": "tempest-VolumesActionsTest-115729215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d645d18547849f8ad9e1035b7e7f71a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbec27503-c5", "ovs_interfaceid": "bec27503-c534-4783-a7e9-a3a882a7590c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 10:25:16 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-eaf2c923-c735-42ce-87bf-80c05bbdb5d5 tempest-VolumesActionsTest-511249111 tempest-VolumesActionsTest-511249111-project-member] Converting VIF {"id": "bec27503-c534-4783-a7e9-a3a882a7590c", "address": "fa:16:3e:79:9d:06", "network": {"id": "5bb45ec6-2255-4d0a-b503-097a9d8ad0df", "bridge": "br-int", "label": "tempest-VolumesActionsTest-115729215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d645d18547849f8ad9e1035b7e7f71a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbec27503-c5", "ovs_interfaceid": "bec27503-c534-4783-a7e9-a3a882a7590c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:25:16 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-eaf2c923-c735-42ce-87bf-80c05bbdb5d5 tempest-VolumesActionsTest-511249111 tempest-VolumesActionsTest-511249111-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:9d:06,bridge_name='br-int',has_traffic_filtering=True,id=bec27503-c534-4783-a7e9-a3a882a7590c,network=Network(5bb45ec6-2255-4d0a-b503-097a9d8ad0df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbec27503-c5') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:25:16 user nova-compute[85141]: DEBUG os_vif [None req-eaf2c923-c735-42ce-87bf-80c05bbdb5d5 tempest-VolumesActionsTest-511249111 tempest-VolumesActionsTest-511249111-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:9d:06,bridge_name='br-int',has_traffic_filtering=True,id=bec27503-c534-4783-a7e9-a3a882a7590c,network=Network(5bb45ec6-2255-4d0a-b503-097a9d8ad0df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbec27503-c5') {{(pid=85141) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 10:25:16 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:25:16 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:25:16 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 10:25:16 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:25:16 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f8705963-3077-528a-ab6b-951d4d2c3eae', '_type': 'linux-noop'}}, row=False) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:25:16 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:25:16 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:25:16 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:25:16 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:25:16 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbec27503-c5, may_exist=True, interface_attrs={}) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:25:16 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbec27503-c5, col_values=(('qos', UUID('0f56cd7b-79ef-478f-b60d-dd750a52efde')),), if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:25:16 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbec27503-c5, col_values=(('external_ids', {'iface-id': 'bec27503-c534-4783-a7e9-a3a882a7590c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:79:9d:06', 'vm-uuid': '2b4347a0-a9f0-4e4c-9d7a-30d984fa35a9'}),), if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:25:16 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:25:16 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:25:16 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:25:16 user nova-compute[85141]: INFO os_vif [None req-eaf2c923-c735-42ce-87bf-80c05bbdb5d5 tempest-VolumesActionsTest-511249111 tempest-VolumesActionsTest-511249111-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:9d:06,bridge_name='br-int',has_traffic_filtering=True,id=bec27503-c534-4783-a7e9-a3a882a7590c,network=Network(5bb45ec6-2255-4d0a-b503-097a9d8ad0df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbec27503-c5')
Nov 16 10:25:16 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-eaf2c923-c735-42ce-87bf-80c05bbdb5d5 tempest-VolumesActionsTest-511249111 tempest-VolumesActionsTest-511249111-project-member] No BDM found with device name vda, not building metadata. {{(pid=85141) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 10:25:16 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-eaf2c923-c735-42ce-87bf-80c05bbdb5d5 tempest-VolumesActionsTest-511249111 tempest-VolumesActionsTest-511249111-project-member] No VIF found with MAC fa:16:3e:79:9d:06, not building metadata {{(pid=85141) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 10:25:16 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-fcca7a63-8289-4bed-bd93-b073bc8e7280 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Acquiring lock "17480138-4b61-43f7-92a5-db065f7d1696" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:25:16 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-fcca7a63-8289-4bed-bd93-b073bc8e7280 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Lock "17480138-4b61-43f7-92a5-db065f7d1696" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:25:16 user nova-compute[85141]: INFO nova.compute.manager [None req-fcca7a63-8289-4bed-bd93-b073bc8e7280 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] [instance: 17480138-4b61-43f7-92a5-db065f7d1696] Attaching volume bb96bfcd-cecc-452f-bc3b-61b7daf72599 to /dev/vdb
Nov 16 10:25:16 user nova-compute[85141]: DEBUG os_brick.utils [None req-fcca7a63-8289-4bed-bd93-b073bc8e7280 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 10:25:16 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:25:16 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:25:16 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fa2aa22-79e8-497f-b142-f2ff44d57a54]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c7834de5c295\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:25:16 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:25:16 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:25:16 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf5bb264-8421-4945-8ebc-6a3aa5ae3c9d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:25:16 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:25:16 user nova-compute[85141]: DEBUG nova.network.neutron [req-d478e9fe-aa71-463a-94ed-b77a85baef31 req-614d73f5-8a75-4d2b-aba5-58ad3b25887d service nova] [instance: 2b4347a0-a9f0-4e4c-9d7a-30d984fa35a9] Updated VIF entry in instance network info cache for port bec27503-c534-4783-a7e9-a3a882a7590c. {{(pid=85141) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 10:25:16 user nova-compute[85141]: DEBUG nova.network.neutron [req-d478e9fe-aa71-463a-94ed-b77a85baef31 req-614d73f5-8a75-4d2b-aba5-58ad3b25887d service nova] [instance: 2b4347a0-a9f0-4e4c-9d7a-30d984fa35a9] Updating instance_info_cache with network_info: [{"id": "bec27503-c534-4783-a7e9-a3a882a7590c", "address": "fa:16:3e:79:9d:06", "network": {"id": "5bb45ec6-2255-4d0a-b503-097a9d8ad0df", "bridge": "br-int", "label": "tempest-VolumesActionsTest-115729215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d645d18547849f8ad9e1035b7e7f71a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbec27503-c5", "ovs_interfaceid": "bec27503-c534-4783-a7e9-a3a882a7590c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:25:16 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:25:16 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[158d5728-f27d-45ce-ae06-d0b8ce4f2277]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:25:16 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e51068c-bedd-4473-9622-020b29d84d03]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:25:16 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-fcca7a63-8289-4bed-bd93-b073bc8e7280 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Running cmd (subprocess): nvme version {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:25:16 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-fcca7a63-8289-4bed-bd93-b073bc8e7280 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] 'nvme version' failed. Not Retrying. {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 10:25:16 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:25:16 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fcca7a63-8289-4bed-bd93-b073bc8e7280 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] nvme not present on system {{(pid=85141) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 10:25:16 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-d478e9fe-aa71-463a-94ed-b77a85baef31 req-614d73f5-8a75-4d2b-aba5-58ad3b25887d service nova] Releasing lock "refresh_cache-2b4347a0-a9f0-4e4c-9d7a-30d984fa35a9" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:25:16 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:25:16 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 10:25:16 user nova-compute[85141]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 10:25:16 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a745293-896e-4282-923a-caf3f484ecff]: (4, '') {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:25:16 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.lightos [None req-fcca7a63-8289-4bed-bd93-b073bc8e7280 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=85141) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 10:25:16 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.lightos [None req-fcca7a63-8289-4bed-bd93-b073bc8e7280 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=85141) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 10:25:16 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.lightos [None req-fcca7a63-8289-4bed-bd93-b073bc8e7280 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] LIGHTOS: no hostnqn found. {{(pid=85141) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 10:25:16 user nova-compute[85141]: DEBUG os_brick.utils [None req-fcca7a63-8289-4bed-bd93-b073bc8e7280 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c7834de5c295', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 10:25:16 user nova-compute[85141]: DEBUG nova.virt.block_device [None req-fcca7a63-8289-4bed-bd93-b073bc8e7280 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] [instance: 17480138-4b61-43f7-92a5-db065f7d1696] Updating existing volume attachment record: e492f678-27c6-4ab8-a0c9-47d5757d3dac {{(pid=85141) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 10:25:16 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:25:16 user nova-compute[85141]: DEBUG nova.compute.manager [req-4716d326-6c95-44d2-b495-728cf97586cd req-78fd3b3a-266c-420d-90b6-964616caa2a2 service nova] [instance: bc76703d-9243-4277-9b13-d6f9639cd1bb] Received event network-vif-plugged-fbf147e2-d8e0-4cb5-8ec5-79756fc53140 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:25:16 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-4716d326-6c95-44d2-b495-728cf97586cd req-78fd3b3a-266c-420d-90b6-964616caa2a2 service nova] Acquiring lock "bc76703d-9243-4277-9b13-d6f9639cd1bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:25:16 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-4716d326-6c95-44d2-b495-728cf97586cd req-78fd3b3a-266c-420d-90b6-964616caa2a2 service nova] Lock "bc76703d-9243-4277-9b13-d6f9639cd1bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:25:16 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-4716d326-6c95-44d2-b495-728cf97586cd req-78fd3b3a-266c-420d-90b6-964616caa2a2 service nova] Lock "bc76703d-9243-4277-9b13-d6f9639cd1bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:25:16 user nova-compute[85141]: DEBUG nova.compute.manager [req-4716d326-6c95-44d2-b495-728cf97586cd req-78fd3b3a-266c-420d-90b6-964616caa2a2 service nova] [instance: bc76703d-9243-4277-9b13-d6f9639cd1bb] No waiting events found dispatching network-vif-plugged-fbf147e2-d8e0-4cb5-8ec5-79756fc53140 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:25:16 user nova-compute[85141]: WARNING nova.compute.manager [req-4716d326-6c95-44d2-b495-728cf97586cd req-78fd3b3a-266c-420d-90b6-964616caa2a2 service nova] [instance: bc76703d-9243-4277-9b13-d6f9639cd1bb] Received unexpected event network-vif-plugged-fbf147e2-d8e0-4cb5-8ec5-79756fc53140 for instance with vm_state building and task_state spawning.
Nov 16 10:25:16 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:25:16 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:25:17 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:25:18 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:25:18 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:25:18 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:25:18 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:25:18 user nova-compute[85141]: DEBUG nova.compute.manager [req-9a6e0c71-133f-4798-b5bb-4bd75a0777d7 req-63570c66-654e-49ac-8051-f677d089caa8 service nova] [instance: 2b4347a0-a9f0-4e4c-9d7a-30d984fa35a9] Received event network-vif-plugged-bec27503-c534-4783-a7e9-a3a882a7590c {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:25:18 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-9a6e0c71-133f-4798-b5bb-4bd75a0777d7 req-63570c66-654e-49ac-8051-f677d089caa8 service nova] Acquiring lock "2b4347a0-a9f0-4e4c-9d7a-30d984fa35a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:25:18 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-9a6e0c71-133f-4798-b5bb-4bd75a0777d7 req-63570c66-654e-49ac-8051-f677d089caa8 service nova] Lock "2b4347a0-a9f0-4e4c-9d7a-30d984fa35a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:25:18 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-9a6e0c71-133f-4798-b5bb-4bd75a0777d7 req-63570c66-654e-49ac-8051-f677d089caa8 service nova] Lock "2b4347a0-a9f0-4e4c-9d7a-30d984fa35a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:25:18 user nova-compute[85141]: DEBUG nova.compute.manager [req-9a6e0c71-133f-4798-b5bb-4bd75a0777d7 req-63570c66-654e-49ac-8051-f677d089caa8 service nova] [instance: 2b4347a0-a9f0-4e4c-9d7a-30d984fa35a9] No waiting events found dispatching network-vif-plugged-bec27503-c534-4783-a7e9-a3a882a7590c {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:25:18 user nova-compute[85141]: WARNING nova.compute.manager [req-9a6e0c71-133f-4798-b5bb-4bd75a0777d7 req-63570c66-654e-49ac-8051-f677d089caa8 service nova] [instance: 2b4347a0-a9f0-4e4c-9d7a-30d984fa35a9] Received unexpected event network-vif-plugged-bec27503-c534-4783-a7e9-a3a882a7590c for instance with vm_state building and task_state spawning.
Nov 16 10:25:18 user nova-compute[85141]: DEBUG nova.compute.manager [req-739d1ca7-0c6b-4bb8-965a-aa4689272926 req-1df389f6-a89b-4ddf-a194-ba4e64d03cff service nova] [instance: bc76703d-9243-4277-9b13-d6f9639cd1bb] Received event network-vif-plugged-fbf147e2-d8e0-4cb5-8ec5-79756fc53140 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:25:18 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-739d1ca7-0c6b-4bb8-965a-aa4689272926 req-1df389f6-a89b-4ddf-a194-ba4e64d03cff service nova] Acquiring lock "bc76703d-9243-4277-9b13-d6f9639cd1bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:25:18 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-739d1ca7-0c6b-4bb8-965a-aa4689272926 req-1df389f6-a89b-4ddf-a194-ba4e64d03cff service nova] Lock "bc76703d-9243-4277-9b13-d6f9639cd1bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:25:18 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-739d1ca7-0c6b-4bb8-965a-aa4689272926 req-1df389f6-a89b-4ddf-a194-ba4e64d03cff service nova] Lock "bc76703d-9243-4277-9b13-d6f9639cd1bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:25:18 user nova-compute[85141]: DEBUG nova.compute.manager [req-739d1ca7-0c6b-4bb8-965a-aa4689272926 req-1df389f6-a89b-4ddf-a194-ba4e64d03cff service nova] [instance: bc76703d-9243-4277-9b13-d6f9639cd1bb] No waiting events found dispatching network-vif-plugged-fbf147e2-d8e0-4cb5-8ec5-79756fc53140 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:25:18 user nova-compute[85141]: WARNING nova.compute.manager [req-739d1ca7-0c6b-4bb8-965a-aa4689272926 req-1df389f6-a89b-4ddf-a194-ba4e64d03cff service nova] [instance: bc76703d-9243-4277-9b13-d6f9639cd1bb] Received unexpected event network-vif-plugged-fbf147e2-d8e0-4cb5-8ec5-79756fc53140 for instance with vm_state building and task_state spawning.
Nov 16 10:25:18 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:25:18 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:25:18 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:25:18 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:25:19 user nova-compute[85141]: DEBUG nova.compute.manager [None req-9160053b-a51e-4dd2-b256-ec3f62db25f1 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] [instance: bc76703d-9243-4277-9b13-d6f9639cd1bb] Instance event wait completed in 0 seconds for  {{(pid=85141) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 10:25:19 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-9160053b-a51e-4dd2-b256-ec3f62db25f1 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] [instance: bc76703d-9243-4277-9b13-d6f9639cd1bb] Guest created on hypervisor {{(pid=85141) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 10:25:20 user nova-compute[85141]: INFO nova.virt.libvirt.driver [-] [instance: bc76703d-9243-4277-9b13-d6f9639cd1bb] Instance spawned successfully.
Nov 16 10:25:20 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-9160053b-a51e-4dd2-b256-ec3f62db25f1 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] [instance: bc76703d-9243-4277-9b13-d6f9639cd1bb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 10:25:20 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-9160053b-a51e-4dd2-b256-ec3f62db25f1 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] [instance: bc76703d-9243-4277-9b13-d6f9639cd1bb] Found default for hw_cdrom_bus of ide {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:25:20 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-9160053b-a51e-4dd2-b256-ec3f62db25f1 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] [instance: bc76703d-9243-4277-9b13-d6f9639cd1bb] Found default for hw_disk_bus of virtio {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:25:20 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-9160053b-a51e-4dd2-b256-ec3f62db25f1 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] [instance: bc76703d-9243-4277-9b13-d6f9639cd1bb] Found default for hw_input_bus of None {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:25:20 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-9160053b-a51e-4dd2-b256-ec3f62db25f1 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] [instance: bc76703d-9243-4277-9b13-d6f9639cd1bb] Found default for hw_pointer_model of None {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:25:20 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-9160053b-a51e-4dd2-b256-ec3f62db25f1 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] [instance: bc76703d-9243-4277-9b13-d6f9639cd1bb] Found default for hw_video_model of virtio {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:25:20 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-9160053b-a51e-4dd2-b256-ec3f62db25f1 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] [instance: bc76703d-9243-4277-9b13-d6f9639cd1bb] Found default for hw_vif_model of virtio {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:25:20 user nova-compute[85141]: INFO nova.compute.manager [None req-9160053b-a51e-4dd2-b256-ec3f62db25f1 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] [instance: bc76703d-9243-4277-9b13-d6f9639cd1bb] Took 6.75 seconds to spawn the instance on the hypervisor.
Nov 16 10:25:20 user nova-compute[85141]: DEBUG nova.compute.manager [None req-9160053b-a51e-4dd2-b256-ec3f62db25f1 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] [instance: bc76703d-9243-4277-9b13-d6f9639cd1bb] Checking state {{(pid=85141) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 10:25:20 user nova-compute[85141]: INFO nova.compute.manager [None req-9160053b-a51e-4dd2-b256-ec3f62db25f1 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] [instance: bc76703d-9243-4277-9b13-d6f9639cd1bb] Took 14.79 seconds to build instance.
Nov 16 10:25:20 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-9160053b-a51e-4dd2-b256-ec3f62db25f1 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Lock "bc76703d-9243-4277-9b13-d6f9639cd1bb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.969s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:25:20 user nova-compute[85141]: DEBUG nova.compute.manager [None req-eaf2c923-c735-42ce-87bf-80c05bbdb5d5 tempest-VolumesActionsTest-511249111 tempest-VolumesActionsTest-511249111-project-member] [instance: 2b4347a0-a9f0-4e4c-9d7a-30d984fa35a9] Instance event wait completed in 0 seconds for  {{(pid=85141) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 10:25:20 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-eaf2c923-c735-42ce-87bf-80c05bbdb5d5 tempest-VolumesActionsTest-511249111 tempest-VolumesActionsTest-511249111-project-member] [instance: 2b4347a0-a9f0-4e4c-9d7a-30d984fa35a9] Guest created on hypervisor {{(pid=85141) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 10:25:20 user nova-compute[85141]: INFO nova.virt.libvirt.driver [-] [instance: 2b4347a0-a9f0-4e4c-9d7a-30d984fa35a9] Instance spawned successfully.
Nov 16 10:25:20 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-eaf2c923-c735-42ce-87bf-80c05bbdb5d5 tempest-VolumesActionsTest-511249111 tempest-VolumesActionsTest-511249111-project-member] [instance: 2b4347a0-a9f0-4e4c-9d7a-30d984fa35a9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 10:25:20 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-eaf2c923-c735-42ce-87bf-80c05bbdb5d5 tempest-VolumesActionsTest-511249111 tempest-VolumesActionsTest-511249111-project-member] [instance: 2b4347a0-a9f0-4e4c-9d7a-30d984fa35a9] Found default for hw_cdrom_bus of ide {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:25:20 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-eaf2c923-c735-42ce-87bf-80c05bbdb5d5 tempest-VolumesActionsTest-511249111 tempest-VolumesActionsTest-511249111-project-member] [instance: 2b4347a0-a9f0-4e4c-9d7a-30d984fa35a9] Found default for hw_disk_bus of virtio {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:25:20 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-eaf2c923-c735-42ce-87bf-80c05bbdb5d5 tempest-VolumesActionsTest-511249111 tempest-VolumesActionsTest-511249111-project-member] [instance: 2b4347a0-a9f0-4e4c-9d7a-30d984fa35a9] Found default for hw_input_bus of None {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:25:20 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-eaf2c923-c735-42ce-87bf-80c05bbdb5d5 tempest-VolumesActionsTest-511249111 tempest-VolumesActionsTest-511249111-project-member] [instance: 2b4347a0-a9f0-4e4c-9d7a-30d984fa35a9] Found default for hw_pointer_model of None {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:25:20 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-eaf2c923-c735-42ce-87bf-80c05bbdb5d5 tempest-VolumesActionsTest-511249111 tempest-VolumesActionsTest-511249111-project-member] [instance: 2b4347a0-a9f0-4e4c-9d7a-30d984fa35a9] Found default for hw_video_model of virtio {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:25:20 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-eaf2c923-c735-42ce-87bf-80c05bbdb5d5 tempest-VolumesActionsTest-511249111 tempest-VolumesActionsTest-511249111-project-member] [instance: 2b4347a0-a9f0-4e4c-9d7a-30d984fa35a9] Found default for hw_vif_model of virtio {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:25:20 user nova-compute[85141]: DEBUG nova.compute.manager [req-43a685d7-1b06-4873-aa2f-67b252c63788 req-5c36c572-af7f-4e19-97c2-404bc608aa76 service nova] [instance: 2b4347a0-a9f0-4e4c-9d7a-30d984fa35a9] Received event network-vif-plugged-bec27503-c534-4783-a7e9-a3a882a7590c {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:25:20 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-43a685d7-1b06-4873-aa2f-67b252c63788 req-5c36c572-af7f-4e19-97c2-404bc608aa76 service nova] Acquiring lock "2b4347a0-a9f0-4e4c-9d7a-30d984fa35a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:25:20 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-43a685d7-1b06-4873-aa2f-67b252c63788 req-5c36c572-af7f-4e19-97c2-404bc608aa76 service nova] Lock "2b4347a0-a9f0-4e4c-9d7a-30d984fa35a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:25:20 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-43a685d7-1b06-4873-aa2f-67b252c63788 req-5c36c572-af7f-4e19-97c2-404bc608aa76 service nova] Lock "2b4347a0-a9f0-4e4c-9d7a-30d984fa35a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:25:20 user nova-compute[85141]: DEBUG nova.compute.manager [req-43a685d7-1b06-4873-aa2f-67b252c63788 req-5c36c572-af7f-4e19-97c2-404bc608aa76 service nova] [instance: 2b4347a0-a9f0-4e4c-9d7a-30d984fa35a9] No waiting events found dispatching network-vif-plugged-bec27503-c534-4783-a7e9-a3a882a7590c {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:25:20 user nova-compute[85141]: WARNING nova.compute.manager [req-43a685d7-1b06-4873-aa2f-67b252c63788 req-5c36c572-af7f-4e19-97c2-404bc608aa76 service nova] [instance: 2b4347a0-a9f0-4e4c-9d7a-30d984fa35a9] Received unexpected event network-vif-plugged-bec27503-c534-4783-a7e9-a3a882a7590c for instance with vm_state building and task_state spawning.
Nov 16 10:25:20 user nova-compute[85141]: INFO nova.compute.manager [None req-eaf2c923-c735-42ce-87bf-80c05bbdb5d5 tempest-VolumesActionsTest-511249111 tempest-VolumesActionsTest-511249111-project-member] [instance: 2b4347a0-a9f0-4e4c-9d7a-30d984fa35a9] Took 6.30 seconds to spawn the instance on the hypervisor.
Nov 16 10:25:20 user nova-compute[85141]: DEBUG nova.compute.manager [None req-eaf2c923-c735-42ce-87bf-80c05bbdb5d5 tempest-VolumesActionsTest-511249111 tempest-VolumesActionsTest-511249111-project-member] [instance: 2b4347a0-a9f0-4e4c-9d7a-30d984fa35a9] Checking state {{(pid=85141) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 10:25:20 user nova-compute[85141]: INFO nova.compute.manager [None req-eaf2c923-c735-42ce-87bf-80c05bbdb5d5 tempest-VolumesActionsTest-511249111 tempest-VolumesActionsTest-511249111-project-member] [instance: 2b4347a0-a9f0-4e4c-9d7a-30d984fa35a9] Took 7.32 seconds to build instance.
Nov 16 10:25:20 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-eaf2c923-c735-42ce-87bf-80c05bbdb5d5 tempest-VolumesActionsTest-511249111 tempest-VolumesActionsTest-511249111-project-member] Lock "2b4347a0-a9f0-4e4c-9d7a-30d984fa35a9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.413s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:25:21 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:25:22 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fcca7a63-8289-4bed-bd93-b073bc8e7280 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] [instance: 17480138-4b61-43f7-92a5-db065f7d1696] Calling os-brick to attach iSCSI Volume {{(pid=85141) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 10:25:22 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcca7a63-8289-4bed-bd93-b073bc8e7280 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51806b6080>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:bb96bfcd-cecc-452f-bc3b-61b7daf72599', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lftgnHOy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 10:25:22 user nova-compute[85141]: WARNING os_brick.initiator.connectors.base [None req-fcca7a63-8289-4bed-bd93-b073bc8e7280 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 10:25:22 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-fcca7a63-8289-4bed-bd93-b073bc8e7280 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 10:25:22 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-fcca7a63-8289-4bed-bd93-b073bc8e7280 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 10:25:22 user nova-compute[85141]: WARNING os_brick.initiator.connectors.base [None req-fcca7a63-8289-4bed-bd93-b073bc8e7280 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 10:25:22 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-fcca7a63-8289-4bed-bd93-b073bc8e7280 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bb96bfcd-cecc-452f-bc3b-61b7daf72599" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 10:25:22 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-fcca7a63-8289-4bed-bd93-b073bc8e7280 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bb96bfcd-cecc-452f-bc3b-61b7daf72599" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 10:25:22 user nova-compute[85141]: INFO os_brick.initiator.connectors.iscsi [None req-fcca7a63-8289-4bed-bd93-b073bc8e7280 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 10:25:22 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb96bfcd-cecc-452f-bc3b-61b7daf72599 -p 172.16.0.220:3260 {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:25:22 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb96bfcd-cecc-452f-bc3b-61b7daf72599 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:25:22 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[962b2bea-5d11-4887-b184-8f8e0e9f53a2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:25:22 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcca7a63-8289-4bed-bd93-b073bc8e7280 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 10:25:22 user nova-compute[85141]:  {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:25:22 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb96bfcd-cecc-452f-bc3b-61b7daf72599 -p 172.16.0.220:3260 --interface default --op new {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:25:22 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb96bfcd-cecc-452f-bc3b-61b7daf72599 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:25:22 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dad9d16-d735-4a85-96aa-eb0627425908]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bb96bfcd-cecc-452f-bc3b-61b7daf72599] added\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:25:22 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcca7a63-8289-4bed-bd93-b073bc8e7280 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bb96bfcd-cecc-452f-bc3b-61b7daf72599] added
Nov 16 10:25:22 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:25:22 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb96bfcd-cecc-452f-bc3b-61b7daf72599 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:25:22 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb96bfcd-cecc-452f-bc3b-61b7daf72599 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:25:22 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ec52848-9321-4b46-8f74-d88410fafe2f]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:25:22 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcca7a63-8289-4bed-bd93-b073bc8e7280 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:25:22 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb96bfcd-cecc-452f-bc3b-61b7daf72599 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:25:22 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb96bfcd-cecc-452f-bc3b-61b7daf72599 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:25:22 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[3de1d34f-7e06-45f0-95b4-d47b95ce0d38]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:25:22 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcca7a63-8289-4bed-bd93-b073bc8e7280 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:25:22 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb96bfcd-cecc-452f-bc3b-61b7daf72599 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lftgnHOy {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:25:22 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb96bfcd-cecc-452f-bc3b-61b7daf72599 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lftgnHOy" returned: 0 in 0.018s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:25:22 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[698540f9-abe5-4fe1-914e-edd85fcac3f4]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:25:22 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcca7a63-8289-4bed-bd93-b073bc8e7280 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lftgnHOy'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:25:22 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb96bfcd-cecc-452f-bc3b-61b7daf72599 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:25:22 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb96bfcd-cecc-452f-bc3b-61b7daf72599 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:25:22 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cf871c5-c81c-4ec2-afbb-f7cf707d47fa]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:25:22 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcca7a63-8289-4bed-bd93-b073bc8e7280 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:25:22 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:25:22 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:25:22 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cb221b1-aa6f-415e-9c88-f73ac86da854]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11a6a15b-38c1-4e7e-b8fa-2feb6789e775 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bc0a873-d872-4f63-9af6-b4ac71162eeb (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2006a77c-e5e8-4ec5-8de5-a0f9505c429a (non-flash)\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:25:22 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcca7a63-8289-4bed-bd93-b073bc8e7280 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)
Nov 16 10:25:22 user nova-compute[85141]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11a6a15b-38c1-4e7e-b8fa-2feb6789e775 (non-flash)
Nov 16 10:25:22 user nova-compute[85141]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bc0a873-d872-4f63-9af6-b4ac71162eeb (non-flash)
Nov 16 10:25:22 user nova-compute[85141]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2006a77c-e5e8-4ec5-8de5-a0f9505c429a (non-flash)
Nov 16 10:25:22 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:25:22 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcca7a63-8289-4bed-bd93-b073bc8e7280 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)
Nov 16 10:25:22 user nova-compute[85141]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11a6a15b-38c1-4e7e-b8fa-2feb6789e775 (non-flash)
Nov 16 10:25:22 user nova-compute[85141]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bc0a873-d872-4f63-9af6-b4ac71162eeb (non-flash)
Nov 16 10:25:22 user nova-compute[85141]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2006a77c-e5e8-4ec5-8de5-a0f9505c429a (non-flash)
Nov 16 10:25:22 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 10:25:22 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb96bfcd-cecc-452f-bc3b-61b7daf72599 -p 172.16.0.220:3260 --login {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:25:22 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb96bfcd-cecc-452f-bc3b-61b7daf72599 -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:25:22 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[c93bfcae-b9b6-4fbd-bb25-4cba5e5eb819]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bb96bfcd-cecc-452f-bc3b-61b7daf72599, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bb96bfcd-cecc-452f-bc3b-61b7daf72599, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:25:22 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcca7a63-8289-4bed-bd93-b073bc8e7280 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bb96bfcd-cecc-452f-bc3b-61b7daf72599, portal: 172.16.0.220,3260]
Nov 16 10:25:22 user nova-compute[85141]: Login to [iface: default, target: iqn.2010-10.org.openstack:bb96bfcd-cecc-452f-bc3b-61b7daf72599, portal: 172.16.0.220,3260] successful.
Nov 16 10:25:22 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:25:22 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb96bfcd-cecc-452f-bc3b-61b7daf72599 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:25:22 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb96bfcd-cecc-452f-bc3b-61b7daf72599 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:25:22 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3b3a356-0f6a-45ea-829c-beff007918d0]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:25:22 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcca7a63-8289-4bed-bd93-b073bc8e7280 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:25:22 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:25:22 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:25:22 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[030a4f3e-4cbb-461d-84d5-62b0f33485a8]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11a6a15b-38c1-4e7e-b8fa-2feb6789e775 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bc0a873-d872-4f63-9af6-b4ac71162eeb (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2006a77c-e5e8-4ec5-8de5-a0f9505c429a (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb96bfcd-cecc-452f-bc3b-61b7daf72599 (non-flash)\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:25:22 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcca7a63-8289-4bed-bd93-b073bc8e7280 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)
Nov 16 10:25:22 user nova-compute[85141]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11a6a15b-38c1-4e7e-b8fa-2feb6789e775 (non-flash)
Nov 16 10:25:22 user nova-compute[85141]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bc0a873-d872-4f63-9af6-b4ac71162eeb (non-flash)
Nov 16 10:25:22 user nova-compute[85141]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2006a77c-e5e8-4ec5-8de5-a0f9505c429a (non-flash)
Nov 16 10:25:22 user nova-compute[85141]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb96bfcd-cecc-452f-bc3b-61b7daf72599 (non-flash)
Nov 16 10:25:22 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:25:22 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcca7a63-8289-4bed-bd93-b073bc8e7280 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)
Nov 16 10:25:22 user nova-compute[85141]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11a6a15b-38c1-4e7e-b8fa-2feb6789e775 (non-flash)
Nov 16 10:25:22 user nova-compute[85141]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bc0a873-d872-4f63-9af6-b4ac71162eeb (non-flash)
Nov 16 10:25:22 user nova-compute[85141]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2006a77c-e5e8-4ec5-8de5-a0f9505c429a (non-flash)
Nov 16 10:25:22 user nova-compute[85141]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb96bfcd-cecc-452f-bc3b-61b7daf72599 (non-flash)
Nov 16 10:25:22 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 10:25:22 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-fcca7a63-8289-4bed-bd93-b073bc8e7280 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bb96bfcd-cecc-452f-bc3b-61b7daf72599" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.293s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 10:25:22 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcca7a63-8289-4bed-bd93-b073bc8e7280 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Connected to 172.16.0.220:3260 {{(pid=85141) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 10:25:22 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-fcca7a63-8289-4bed-bd93-b073bc8e7280 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] HCTL ('37', '-', '-', 0) found on session 38 with lun 0 {{(pid=85141) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 10:25:22 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-fcca7a63-8289-4bed-bd93-b073bc8e7280 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=85141) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 10:25:22 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:25:22 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.016s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:25:22 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[e89d34bb-ef6e-4c43-a3d1-a3a235704090]: (4, ('- - 0', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:25:22 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-fcca7a63-8289-4bed-bd93-b073bc8e7280 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Searching for a device in session 38 and hctl ['37', '*', '*', 0] yield: None {{(pid=85141) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 10:25:22 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:25:23 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-fcca7a63-8289-4bed-bd93-b073bc8e7280 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Searching for a device in session 38 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=85141) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 10:25:23 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcca7a63-8289-4bed-bd93-b073bc8e7280 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:bb96bfcd-cecc-452f-bc3b-61b7daf72599', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lftgnHOy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=85141) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 10:25:23 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-fcca7a63-8289-4bed-bd93-b073bc8e7280 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.323s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 10:25:23 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcca7a63-8289-4bed-bd93-b073bc8e7280 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] <== connect_volume: return (1324ms) {'type': 'block', 'scsi_wwn': '23339376231643535', 'path': '/dev/sdf'} {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 10:25:23 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fcca7a63-8289-4bed-bd93-b073bc8e7280 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] [instance: 17480138-4b61-43f7-92a5-db065f7d1696] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23339376231643535', 'path': '/dev/sdf'} {{(pid=85141) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 10:25:23 user nova-compute[85141]: DEBUG nova.objects.instance [None req-fcca7a63-8289-4bed-bd93-b073bc8e7280 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Lazy-loading 'flavor' on Instance uuid 17480138-4b61-43f7-92a5-db065f7d1696 {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:25:23 user nova-compute[85141]: DEBUG nova.virt.libvirt.guest [None req-fcca7a63-8289-4bed-bd93-b073bc8e7280 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 10:25:23 user nova-compute[85141]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 10:25:23 user nova-compute[85141]:   <source dev="/dev/sdf"/>
Nov 16 10:25:23 user nova-compute[85141]:   <target dev="vdb" bus="virtio"/>
Nov 16 10:25:23 user nova-compute[85141]:   <serial>bb96bfcd-cecc-452f-bc3b-61b7daf72599</serial>
Nov 16 10:25:23 user nova-compute[85141]: </disk>
Nov 16 10:25:23 user nova-compute[85141]:  {{(pid=85141) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 10:25:23 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-fcca7a63-8289-4bed-bd93-b073bc8e7280 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] No BDM found with device name vda, not building metadata. {{(pid=85141) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 10:25:23 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-fcca7a63-8289-4bed-bd93-b073bc8e7280 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] No BDM found with device name vdb, not building metadata. {{(pid=85141) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 10:25:23 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-fcca7a63-8289-4bed-bd93-b073bc8e7280 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] No VIF found with MAC fa:16:3e:9f:52:3b, not building metadata {{(pid=85141) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 10:25:24 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-fcca7a63-8289-4bed-bd93-b073bc8e7280 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Lock "17480138-4b61-43f7-92a5-db065f7d1696" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.694s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:25:26 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:25:26 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:25:26 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:25:26 user nova-compute[85141]: DEBUG nova.compute.manager [req-7b538e12-2a80-40ec-a677-727f2ed9044d req-38836daf-5c6e-46f1-af9a-5721044f80cf service nova] [instance: 17480138-4b61-43f7-92a5-db065f7d1696] Received event network-changed-6082a650-3a4c-4393-b6ab-8cbc97d751cb {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:25:26 user nova-compute[85141]: DEBUG nova.compute.manager [req-7b538e12-2a80-40ec-a677-727f2ed9044d req-38836daf-5c6e-46f1-af9a-5721044f80cf service nova] [instance: 17480138-4b61-43f7-92a5-db065f7d1696] Refreshing instance network info cache due to event network-changed-6082a650-3a4c-4393-b6ab-8cbc97d751cb. {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 10:25:26 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-7b538e12-2a80-40ec-a677-727f2ed9044d req-38836daf-5c6e-46f1-af9a-5721044f80cf service nova] Acquiring lock "refresh_cache-17480138-4b61-43f7-92a5-db065f7d1696" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:25:26 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-7b538e12-2a80-40ec-a677-727f2ed9044d req-38836daf-5c6e-46f1-af9a-5721044f80cf service nova] Acquired lock "refresh_cache-17480138-4b61-43f7-92a5-db065f7d1696" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:25:26 user nova-compute[85141]: DEBUG nova.network.neutron [req-7b538e12-2a80-40ec-a677-727f2ed9044d req-38836daf-5c6e-46f1-af9a-5721044f80cf service nova] [instance: 17480138-4b61-43f7-92a5-db065f7d1696] Refreshing network info cache for port 6082a650-3a4c-4393-b6ab-8cbc97d751cb {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 10:25:27 user nova-compute[85141]: DEBUG nova.network.neutron [req-7b538e12-2a80-40ec-a677-727f2ed9044d req-38836daf-5c6e-46f1-af9a-5721044f80cf service nova] [instance: 17480138-4b61-43f7-92a5-db065f7d1696] Updated VIF entry in instance network info cache for port 6082a650-3a4c-4393-b6ab-8cbc97d751cb. {{(pid=85141) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 10:25:27 user nova-compute[85141]: DEBUG nova.network.neutron [req-7b538e12-2a80-40ec-a677-727f2ed9044d req-38836daf-5c6e-46f1-af9a-5721044f80cf service nova] [instance: 17480138-4b61-43f7-92a5-db065f7d1696] Updating instance_info_cache with network_info: [{"id": "6082a650-3a4c-4393-b6ab-8cbc97d751cb", "address": "fa:16:3e:9f:52:3b", "network": {"id": "436477fd-9294-4297-bfb3-405564823fa0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1068749207-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4e4f57f79564d2fbcb8080bf8f1c5c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6082a650-3a", "ovs_interfaceid": "6082a650-3a4c-4393-b6ab-8cbc97d751cb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:25:27 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-7b538e12-2a80-40ec-a677-727f2ed9044d req-38836daf-5c6e-46f1-af9a-5721044f80cf service nova] Releasing lock "refresh_cache-17480138-4b61-43f7-92a5-db065f7d1696" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:25:27 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:25:29 user nova-compute[85141]: DEBUG nova.compute.manager [req-281a9be2-404e-43dd-ac68-807eb55d3a2d req-18934f17-e4a5-425e-873f-775bdc58ff5d service nova] [instance: 17480138-4b61-43f7-92a5-db065f7d1696] Received event network-changed-6082a650-3a4c-4393-b6ab-8cbc97d751cb {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:25:29 user nova-compute[85141]: DEBUG nova.compute.manager [req-281a9be2-404e-43dd-ac68-807eb55d3a2d req-18934f17-e4a5-425e-873f-775bdc58ff5d service nova] [instance: 17480138-4b61-43f7-92a5-db065f7d1696] Refreshing instance network info cache due to event network-changed-6082a650-3a4c-4393-b6ab-8cbc97d751cb. {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 10:25:29 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-281a9be2-404e-43dd-ac68-807eb55d3a2d req-18934f17-e4a5-425e-873f-775bdc58ff5d service nova] Acquiring lock "refresh_cache-17480138-4b61-43f7-92a5-db065f7d1696" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:25:29 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-281a9be2-404e-43dd-ac68-807eb55d3a2d req-18934f17-e4a5-425e-873f-775bdc58ff5d service nova] Acquired lock "refresh_cache-17480138-4b61-43f7-92a5-db065f7d1696" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:25:29 user nova-compute[85141]: DEBUG nova.network.neutron [req-281a9be2-404e-43dd-ac68-807eb55d3a2d req-18934f17-e4a5-425e-873f-775bdc58ff5d service nova] [instance: 17480138-4b61-43f7-92a5-db065f7d1696] Refreshing network info cache for port 6082a650-3a4c-4393-b6ab-8cbc97d751cb {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 10:25:29 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:25:29 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Starting heal instance info cache {{(pid=85141) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 10:25:29 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Acquiring lock "refresh_cache-f01dc8cf-1a69-4618-a15d-0c1075157f05" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:25:29 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Acquired lock "refresh_cache-f01dc8cf-1a69-4618-a15d-0c1075157f05" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:25:29 user nova-compute[85141]: DEBUG nova.network.neutron [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] [instance: f01dc8cf-1a69-4618-a15d-0c1075157f05] Forcefully refreshing network info cache for instance {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 10:25:29 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-f2f803c6-a0e0-4a4c-95d7-cc404bbd2eaa tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Acquiring lock "17480138-4b61-43f7-92a5-db065f7d1696" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:25:29 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-f2f803c6-a0e0-4a4c-95d7-cc404bbd2eaa tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Lock "17480138-4b61-43f7-92a5-db065f7d1696" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:25:29 user nova-compute[85141]: INFO nova.compute.manager [None req-f2f803c6-a0e0-4a4c-95d7-cc404bbd2eaa tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] [instance: 17480138-4b61-43f7-92a5-db065f7d1696] Rebooting instance
Nov 16 10:25:29 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-f2f803c6-a0e0-4a4c-95d7-cc404bbd2eaa tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Acquiring lock "refresh_cache-17480138-4b61-43f7-92a5-db065f7d1696" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:25:30 user nova-compute[85141]: DEBUG nova.network.neutron [req-281a9be2-404e-43dd-ac68-807eb55d3a2d req-18934f17-e4a5-425e-873f-775bdc58ff5d service nova] [instance: 17480138-4b61-43f7-92a5-db065f7d1696] Updated VIF entry in instance network info cache for port 6082a650-3a4c-4393-b6ab-8cbc97d751cb. {{(pid=85141) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 10:25:30 user nova-compute[85141]: DEBUG nova.network.neutron [req-281a9be2-404e-43dd-ac68-807eb55d3a2d req-18934f17-e4a5-425e-873f-775bdc58ff5d service nova] [instance: 17480138-4b61-43f7-92a5-db065f7d1696] Updating instance_info_cache with network_info: [{"id": "6082a650-3a4c-4393-b6ab-8cbc97d751cb", "address": "fa:16:3e:9f:52:3b", "network": {"id": "436477fd-9294-4297-bfb3-405564823fa0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1068749207-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4e4f57f79564d2fbcb8080bf8f1c5c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6082a650-3a", "ovs_interfaceid": "6082a650-3a4c-4393-b6ab-8cbc97d751cb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:25:30 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-281a9be2-404e-43dd-ac68-807eb55d3a2d req-18934f17-e4a5-425e-873f-775bdc58ff5d service nova] Releasing lock "refresh_cache-17480138-4b61-43f7-92a5-db065f7d1696" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:25:30 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-f2f803c6-a0e0-4a4c-95d7-cc404bbd2eaa tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Acquired lock "refresh_cache-17480138-4b61-43f7-92a5-db065f7d1696" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:25:30 user nova-compute[85141]: DEBUG nova.network.neutron [None req-f2f803c6-a0e0-4a4c-95d7-cc404bbd2eaa tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] [instance: 17480138-4b61-43f7-92a5-db065f7d1696] Building network info cache for instance {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 10:25:30 user nova-compute[85141]: DEBUG nova.network.neutron [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] [instance: f01dc8cf-1a69-4618-a15d-0c1075157f05] Updating instance_info_cache with network_info: [{"id": "52edc378-51f4-43c3-b9f3-2d0201ed125d", "address": "fa:16:3e:38:1f:8f", "network": {"id": "e40e4bd2-4277-40b1-9451-1c8365ffa488", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1333036447-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "733b504d4dbe4f028963cf2c197f0064", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52edc378-51", "ovs_interfaceid": "52edc378-51f4-43c3-b9f3-2d0201ed125d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:25:30 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Releasing lock "refresh_cache-f01dc8cf-1a69-4618-a15d-0c1075157f05" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:25:30 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] [instance: f01dc8cf-1a69-4618-a15d-0c1075157f05] Updated the network info_cache for instance {{(pid=85141) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 10:25:30 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:25:30 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=85141) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 10:25:30 user nova-compute[85141]: DEBUG nova.network.neutron [None req-f2f803c6-a0e0-4a4c-95d7-cc404bbd2eaa tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] [instance: 17480138-4b61-43f7-92a5-db065f7d1696] Updating instance_info_cache with network_info: [{"id": "6082a650-3a4c-4393-b6ab-8cbc97d751cb", "address": "fa:16:3e:9f:52:3b", "network": {"id": "436477fd-9294-4297-bfb3-405564823fa0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1068749207-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4e4f57f79564d2fbcb8080bf8f1c5c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6082a650-3a", "ovs_interfaceid": "6082a650-3a4c-4393-b6ab-8cbc97d751cb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:25:30 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-f2f803c6-a0e0-4a4c-95d7-cc404bbd2eaa tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Releasing lock "refresh_cache-17480138-4b61-43f7-92a5-db065f7d1696" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:25:30 user nova-compute[85141]: DEBUG nova.compute.manager [None req-f2f803c6-a0e0-4a4c-95d7-cc404bbd2eaa tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] [instance: 17480138-4b61-43f7-92a5-db065f7d1696] Checking state {{(pid=85141) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 10:25:31 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:25:32 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:25:32 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:25:33 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:25:33 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:25:33 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:25:33 user nova-compute[85141]: DEBUG nova.compute.manager [req-b246f275-d956-4b95-9bea-d7f2d5501e88 req-0ab37785-2b19-4d98-8b9e-f87199908e18 service nova] [instance: 17480138-4b61-43f7-92a5-db065f7d1696] Received event network-vif-unplugged-6082a650-3a4c-4393-b6ab-8cbc97d751cb {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:25:33 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-b246f275-d956-4b95-9bea-d7f2d5501e88 req-0ab37785-2b19-4d98-8b9e-f87199908e18 service nova] Acquiring lock "17480138-4b61-43f7-92a5-db065f7d1696-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:25:33 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-b246f275-d956-4b95-9bea-d7f2d5501e88 req-0ab37785-2b19-4d98-8b9e-f87199908e18 service nova] Lock "17480138-4b61-43f7-92a5-db065f7d1696-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:25:33 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-b246f275-d956-4b95-9bea-d7f2d5501e88 req-0ab37785-2b19-4d98-8b9e-f87199908e18 service nova] Lock "17480138-4b61-43f7-92a5-db065f7d1696-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:25:33 user nova-compute[85141]: DEBUG nova.compute.manager [req-b246f275-d956-4b95-9bea-d7f2d5501e88 req-0ab37785-2b19-4d98-8b9e-f87199908e18 service nova] [instance: 17480138-4b61-43f7-92a5-db065f7d1696] No waiting events found dispatching network-vif-unplugged-6082a650-3a4c-4393-b6ab-8cbc97d751cb {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:25:33 user nova-compute[85141]: WARNING nova.compute.manager [req-b246f275-d956-4b95-9bea-d7f2d5501e88 req-0ab37785-2b19-4d98-8b9e-f87199908e18 service nova] [instance: 17480138-4b61-43f7-92a5-db065f7d1696] Received unexpected event network-vif-unplugged-6082a650-3a4c-4393-b6ab-8cbc97d751cb for instance with vm_state active and task_state reboot_started.
Nov 16 10:25:33 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:25:33 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:25:33 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-f2f803c6-a0e0-4a4c-95d7-cc404bbd2eaa tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] [instance: 17480138-4b61-43f7-92a5-db065f7d1696] Instance shutdown successfully.
Nov 16 10:25:34 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:25:34 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager.update_available_resource {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:25:34 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:25:34 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:25:34 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.006s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:25:34 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Auditing locally available compute resources for user (node: user) {{(pid=85141) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 10:25:35 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:25:35 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:25:35 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:25:35 user nova-compute[85141]: DEBUG nova.compute.manager [req-97fb294e-5125-48e9-bf92-a55fcd67bb03 req-32a26b7c-5d85-4164-96ce-2dbc43720b90 service nova] [instance: 17480138-4b61-43f7-92a5-db065f7d1696] Received event network-vif-plugged-6082a650-3a4c-4393-b6ab-8cbc97d751cb {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:25:35 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-97fb294e-5125-48e9-bf92-a55fcd67bb03 req-32a26b7c-5d85-4164-96ce-2dbc43720b90 service nova] Acquiring lock "17480138-4b61-43f7-92a5-db065f7d1696-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:25:35 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-97fb294e-5125-48e9-bf92-a55fcd67bb03 req-32a26b7c-5d85-4164-96ce-2dbc43720b90 service nova] Lock "17480138-4b61-43f7-92a5-db065f7d1696-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:25:35 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-97fb294e-5125-48e9-bf92-a55fcd67bb03 req-32a26b7c-5d85-4164-96ce-2dbc43720b90 service nova] Lock "17480138-4b61-43f7-92a5-db065f7d1696-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:25:35 user nova-compute[85141]: DEBUG nova.compute.manager [req-97fb294e-5125-48e9-bf92-a55fcd67bb03 req-32a26b7c-5d85-4164-96ce-2dbc43720b90 service nova] [instance: 17480138-4b61-43f7-92a5-db065f7d1696] No waiting events found dispatching network-vif-plugged-6082a650-3a4c-4393-b6ab-8cbc97d751cb {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:25:35 user nova-compute[85141]: WARNING nova.compute.manager [req-97fb294e-5125-48e9-bf92-a55fcd67bb03 req-32a26b7c-5d85-4164-96ce-2dbc43720b90 service nova] [instance: 17480138-4b61-43f7-92a5-db065f7d1696] Received unexpected event network-vif-plugged-6082a650-3a4c-4393-b6ab-8cbc97d751cb for instance with vm_state active and task_state reboot_started.
Nov 16 10:25:35 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:25:35 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:25:35 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:25:35 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:25:35 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:25:36 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:25:36 user nova-compute[85141]: DEBUG nova.compute.manager [req-82e42255-2fc6-4d0a-8dc6-2973799f45a9 req-5a8ea4d0-b823-4ef9-8fe9-cf2630e83274 service nova] [instance: 463034ff-14ce-477a-9642-4d86aa6f9cd9] Received event network-changed-121bbc09-53cf-4586-8585-655079b4c49b {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:25:36 user nova-compute[85141]: DEBUG nova.compute.manager [req-82e42255-2fc6-4d0a-8dc6-2973799f45a9 req-5a8ea4d0-b823-4ef9-8fe9-cf2630e83274 service nova] [instance: 463034ff-14ce-477a-9642-4d86aa6f9cd9] Refreshing instance network info cache due to event network-changed-121bbc09-53cf-4586-8585-655079b4c49b. {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 10:25:36 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-82e42255-2fc6-4d0a-8dc6-2973799f45a9 req-5a8ea4d0-b823-4ef9-8fe9-cf2630e83274 service nova] Acquiring lock "refresh_cache-463034ff-14ce-477a-9642-4d86aa6f9cd9" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:25:36 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-82e42255-2fc6-4d0a-8dc6-2973799f45a9 req-5a8ea4d0-b823-4ef9-8fe9-cf2630e83274 service nova] Acquired lock "refresh_cache-463034ff-14ce-477a-9642-4d86aa6f9cd9" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:25:36 user nova-compute[85141]: DEBUG nova.network.neutron [req-82e42255-2fc6-4d0a-8dc6-2973799f45a9 req-5a8ea4d0-b823-4ef9-8fe9-cf2630e83274 service nova] [instance: 463034ff-14ce-477a-9642-4d86aa6f9cd9] Refreshing network info cache for port 121bbc09-53cf-4586-8585-655079b4c49b {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 10:25:36 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-cabe7751-c5b0-45aa-b12e-7ad94eeaec78 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Acquiring lock "463034ff-14ce-477a-9642-4d86aa6f9cd9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:25:36 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-cabe7751-c5b0-45aa-b12e-7ad94eeaec78 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Lock "463034ff-14ce-477a-9642-4d86aa6f9cd9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:25:36 user nova-compute[85141]: DEBUG nova.objects.instance [None req-cabe7751-c5b0-45aa-b12e-7ad94eeaec78 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Lazy-loading 'flavor' on Instance uuid 463034ff-14ce-477a-9642-4d86aa6f9cd9 {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:25:36 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-cabe7751-c5b0-45aa-b12e-7ad94eeaec78 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Lock "463034ff-14ce-477a-9642-4d86aa6f9cd9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:25:36 user nova-compute[85141]: DEBUG nova.network.neutron [req-82e42255-2fc6-4d0a-8dc6-2973799f45a9 req-5a8ea4d0-b823-4ef9-8fe9-cf2630e83274 service nova] [instance: 463034ff-14ce-477a-9642-4d86aa6f9cd9] Updated VIF entry in instance network info cache for port 121bbc09-53cf-4586-8585-655079b4c49b. {{(pid=85141) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 10:25:36 user nova-compute[85141]: DEBUG nova.network.neutron [req-82e42255-2fc6-4d0a-8dc6-2973799f45a9 req-5a8ea4d0-b823-4ef9-8fe9-cf2630e83274 service nova] [instance: 463034ff-14ce-477a-9642-4d86aa6f9cd9] Updating instance_info_cache with network_info: [{"id": "121bbc09-53cf-4586-8585-655079b4c49b", "address": "fa:16:3e:b0:77:d5", "network": {"id": "5b67a3fd-ef1e-4f2c-b6e0-31766ef39d30", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2137186235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09b520de67ac4290a4b779f50afeb1a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap121bbc09-53", "ovs_interfaceid": "121bbc09-53cf-4586-8585-655079b4c49b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:25:36 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-82e42255-2fc6-4d0a-8dc6-2973799f45a9 req-5a8ea4d0-b823-4ef9-8fe9-cf2630e83274 service nova] Releasing lock "refresh_cache-463034ff-14ce-477a-9642-4d86aa6f9cd9" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:25:36 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-cabe7751-c5b0-45aa-b12e-7ad94eeaec78 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Acquiring lock "463034ff-14ce-477a-9642-4d86aa6f9cd9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:25:36 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-cabe7751-c5b0-45aa-b12e-7ad94eeaec78 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Lock "463034ff-14ce-477a-9642-4d86aa6f9cd9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:25:36 user nova-compute[85141]: INFO nova.compute.manager [None req-cabe7751-c5b0-45aa-b12e-7ad94eeaec78 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] [instance: 463034ff-14ce-477a-9642-4d86aa6f9cd9] Attaching volume e1b58025-0c18-41f6-a126-fb3c925399a1 to /dev/vdb
Nov 16 10:25:37 user nova-compute[85141]: DEBUG os_brick.utils [None req-cabe7751-c5b0-45aa-b12e-7ad94eeaec78 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 10:25:37 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:25:37 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:25:37 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[308cf515-4033-4293-a880-fb8cb7290687]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c7834de5c295\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:25:37 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:25:37 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:25:37 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f9c4070-64f7-477d-8365-17e3e68179b8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:25:37 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:25:37 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:25:37 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[84b95bf9-b594-4d4c-81a6-ac4486940bc7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:25:37 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[5471721f-493a-4419-a2fa-512163565b4a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:25:37 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-cabe7751-c5b0-45aa-b12e-7ad94eeaec78 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Running cmd (subprocess): nvme version {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:25:37 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-cabe7751-c5b0-45aa-b12e-7ad94eeaec78 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] 'nvme version' failed. Not Retrying. {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 10:25:37 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cabe7751-c5b0-45aa-b12e-7ad94eeaec78 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] nvme not present on system {{(pid=85141) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 10:25:37 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:25:37 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 10:25:37 user nova-compute[85141]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 10:25:37 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[10a8d342-f72a-419e-b785-7fdd45008074]: (4, '') {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:25:37 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.lightos [None req-cabe7751-c5b0-45aa-b12e-7ad94eeaec78 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=85141) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 10:25:37 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.lightos [None req-cabe7751-c5b0-45aa-b12e-7ad94eeaec78 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=85141) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 10:25:37 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.lightos [None req-cabe7751-c5b0-45aa-b12e-7ad94eeaec78 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] LIGHTOS: no hostnqn found. {{(pid=85141) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 10:25:37 user nova-compute[85141]: DEBUG os_brick.utils [None req-cabe7751-c5b0-45aa-b12e-7ad94eeaec78 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] <== get_connector_properties: return (142ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c7834de5c295', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 10:25:37 user nova-compute[85141]: DEBUG nova.virt.block_device [None req-cabe7751-c5b0-45aa-b12e-7ad94eeaec78 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] [instance: 463034ff-14ce-477a-9642-4d86aa6f9cd9] Updating existing volume attachment record: b3ec09ad-55b6-4231-9167-7dffd015394a {{(pid=85141) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 10:25:37 user nova-compute[85141]: DEBUG nova.compute.manager [req-cfc6bcfd-41b6-48a9-81f6-16e5c0c1ac7f req-c2d75b2d-4e8b-40f6-8e47-2babd5fddba4 service nova] [instance: 17480138-4b61-43f7-92a5-db065f7d1696] Received event network-vif-plugged-6082a650-3a4c-4393-b6ab-8cbc97d751cb {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:25:37 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-cfc6bcfd-41b6-48a9-81f6-16e5c0c1ac7f req-c2d75b2d-4e8b-40f6-8e47-2babd5fddba4 service nova] Acquiring lock "17480138-4b61-43f7-92a5-db065f7d1696-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:25:37 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-cfc6bcfd-41b6-48a9-81f6-16e5c0c1ac7f req-c2d75b2d-4e8b-40f6-8e47-2babd5fddba4 service nova] Lock "17480138-4b61-43f7-92a5-db065f7d1696-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:25:37 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-cfc6bcfd-41b6-48a9-81f6-16e5c0c1ac7f req-c2d75b2d-4e8b-40f6-8e47-2babd5fddba4 service nova] Lock "17480138-4b61-43f7-92a5-db065f7d1696-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:25:37 user nova-compute[85141]: DEBUG nova.compute.manager [req-cfc6bcfd-41b6-48a9-81f6-16e5c0c1ac7f req-c2d75b2d-4e8b-40f6-8e47-2babd5fddba4 service nova] [instance: 17480138-4b61-43f7-92a5-db065f7d1696] No waiting events found dispatching network-vif-plugged-6082a650-3a4c-4393-b6ab-8cbc97d751cb {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:25:37 user nova-compute[85141]: WARNING nova.compute.manager [req-cfc6bcfd-41b6-48a9-81f6-16e5c0c1ac7f req-c2d75b2d-4e8b-40f6-8e47-2babd5fddba4 service nova] [instance: 17480138-4b61-43f7-92a5-db065f7d1696] Received unexpected event network-vif-plugged-6082a650-3a4c-4393-b6ab-8cbc97d751cb for instance with vm_state active and task_state reboot_started.
Nov 16 10:25:37 user nova-compute[85141]: DEBUG nova.compute.manager [req-cfc6bcfd-41b6-48a9-81f6-16e5c0c1ac7f req-c2d75b2d-4e8b-40f6-8e47-2babd5fddba4 service nova] [instance: 17480138-4b61-43f7-92a5-db065f7d1696] Received event network-vif-plugged-6082a650-3a4c-4393-b6ab-8cbc97d751cb {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:25:37 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-cfc6bcfd-41b6-48a9-81f6-16e5c0c1ac7f req-c2d75b2d-4e8b-40f6-8e47-2babd5fddba4 service nova] Acquiring lock "17480138-4b61-43f7-92a5-db065f7d1696-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:25:37 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-cfc6bcfd-41b6-48a9-81f6-16e5c0c1ac7f req-c2d75b2d-4e8b-40f6-8e47-2babd5fddba4 service nova] Lock "17480138-4b61-43f7-92a5-db065f7d1696-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:25:37 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-cfc6bcfd-41b6-48a9-81f6-16e5c0c1ac7f req-c2d75b2d-4e8b-40f6-8e47-2babd5fddba4 service nova] Lock "17480138-4b61-43f7-92a5-db065f7d1696-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:25:37 user nova-compute[85141]: DEBUG nova.compute.manager [req-cfc6bcfd-41b6-48a9-81f6-16e5c0c1ac7f req-c2d75b2d-4e8b-40f6-8e47-2babd5fddba4 service nova] [instance: 17480138-4b61-43f7-92a5-db065f7d1696] No waiting events found dispatching network-vif-plugged-6082a650-3a4c-4393-b6ab-8cbc97d751cb {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:25:37 user nova-compute[85141]: WARNING nova.compute.manager [req-cfc6bcfd-41b6-48a9-81f6-16e5c0c1ac7f req-c2d75b2d-4e8b-40f6-8e47-2babd5fddba4 service nova] [instance: 17480138-4b61-43f7-92a5-db065f7d1696] Received unexpected event network-vif-plugged-6082a650-3a4c-4393-b6ab-8cbc97d751cb for instance with vm_state active and task_state reboot_started.
Nov 16 10:25:37 user nova-compute[85141]: INFO nova.virt.libvirt.driver [-] [instance: 17480138-4b61-43f7-92a5-db065f7d1696] Instance running successfully.
Nov 16 10:25:37 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-f2f803c6-a0e0-4a4c-95d7-cc404bbd2eaa tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] [instance: 17480138-4b61-43f7-92a5-db065f7d1696] Instance soft rebooted successfully.
Nov 16 10:25:37 user nova-compute[85141]: DEBUG nova.compute.manager [None req-f2f803c6-a0e0-4a4c-95d7-cc404bbd2eaa tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] [instance: 17480138-4b61-43f7-92a5-db065f7d1696] Checking state {{(pid=85141) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 10:25:37 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-f2f803c6-a0e0-4a4c-95d7-cc404bbd2eaa tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Lock "17480138-4b61-43f7-92a5-db065f7d1696" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.824s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:25:37 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/463034ff-14ce-477a-9642-4d86aa6f9cd9/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:25:37 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/463034ff-14ce-477a-9642-4d86aa6f9cd9/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:25:37 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/463034ff-14ce-477a-9642-4d86aa6f9cd9/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:25:37 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:25:38 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/463034ff-14ce-477a-9642-4d86aa6f9cd9/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:25:38 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b388b98-4e65-4258-bbe2-77e699321fb7/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:25:38 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b388b98-4e65-4258-bbe2-77e699321fb7/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:25:38 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b388b98-4e65-4258-bbe2-77e699321fb7/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:25:38 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b388b98-4e65-4258-bbe2-77e699321fb7/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:25:38 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a507c85-0369-48ea-8858-3e7d346b4cb0/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:25:38 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a507c85-0369-48ea-8858-3e7d346b4cb0/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:25:38 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a507c85-0369-48ea-8858-3e7d346b4cb0/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:25:38 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a507c85-0369-48ea-8858-3e7d346b4cb0/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:25:38 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e214bbb-5bbb-4e6f-ac09-9cb1412f068b/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:25:39 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e214bbb-5bbb-4e6f-ac09-9cb1412f068b/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:25:39 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e214bbb-5bbb-4e6f-ac09-9cb1412f068b/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:25:39 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e214bbb-5bbb-4e6f-ac09-9cb1412f068b/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:25:39 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d842f90e-663b-4c95-9d7c-d092d2bac41f/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:25:39 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d842f90e-663b-4c95-9d7c-d092d2bac41f/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:25:39 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d842f90e-663b-4c95-9d7c-d092d2bac41f/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:25:39 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d842f90e-663b-4c95-9d7c-d092d2bac41f/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:25:39 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=85141) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 10:25:39 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17480138-4b61-43f7-92a5-db065f7d1696/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:25:39 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17480138-4b61-43f7-92a5-db065f7d1696/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:25:39 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17480138-4b61-43f7-92a5-db065f7d1696/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:25:40 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17480138-4b61-43f7-92a5-db065f7d1696/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:25:40 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=85141) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 10:25:40 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=85141) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 10:25:40 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=85141) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 10:25:40 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7dfe34a-f7ba-44b3-8898-634338161a23/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:25:40 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7dfe34a-f7ba-44b3-8898-634338161a23/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:25:40 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7dfe34a-f7ba-44b3-8898-634338161a23/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:25:40 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7dfe34a-f7ba-44b3-8898-634338161a23/disk --force-share --output=json" returned: 0 in 0.256s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:25:40 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b24c3954-06ff-4e15-9e43-c65d1dae7a5d/disk.rescue --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:25:40 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b24c3954-06ff-4e15-9e43-c65d1dae7a5d/disk.rescue --force-share --output=json" returned: 0 in 0.205s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:25:40 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b24c3954-06ff-4e15-9e43-c65d1dae7a5d/disk.rescue --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:25:41 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b24c3954-06ff-4e15-9e43-c65d1dae7a5d/disk.rescue --force-share --output=json" returned: 0 in 0.197s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:25:41 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b24c3954-06ff-4e15-9e43-c65d1dae7a5d/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:25:41 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b24c3954-06ff-4e15-9e43-c65d1dae7a5d/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:25:41 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b24c3954-06ff-4e15-9e43-c65d1dae7a5d/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:25:41 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:25:41 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b24c3954-06ff-4e15-9e43-c65d1dae7a5d/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:25:41 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=85141) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 10:25:41 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abe5d4b7-a0d7-40e3-b630-0de746ddb55b/disk.rescue --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:25:41 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abe5d4b7-a0d7-40e3-b630-0de746ddb55b/disk.rescue --force-share --output=json" returned: 0 in 0.198s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:25:41 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abe5d4b7-a0d7-40e3-b630-0de746ddb55b/disk.rescue --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:25:41 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/abe5d4b7-a0d7-40e3-b630-0de746ddb55b/disk.rescue --force-share --output=json" returned: 0 in 0.195s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:25:41 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/059d6974-bd0c-4f73-91fc-8202ebda4238/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:25:42 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/059d6974-bd0c-4f73-91fc-8202ebda4238/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:25:42 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/059d6974-bd0c-4f73-91fc-8202ebda4238/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:25:42 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/059d6974-bd0c-4f73-91fc-8202ebda4238/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:25:42 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b4347a0-a9f0-4e4c-9d7a-30d984fa35a9/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:25:42 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b4347a0-a9f0-4e4c-9d7a-30d984fa35a9/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:25:42 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b4347a0-a9f0-4e4c-9d7a-30d984fa35a9/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:25:42 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b4347a0-a9f0-4e4c-9d7a-30d984fa35a9/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:25:42 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11986c5b-6914-491e-8e71-983ab6b13c6e/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:25:42 user nova-compute[85141]: DEBUG nova.objects.instance [None req-1d02d19c-a2d5-4207-8a1a-b5d38f99487a tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Lazy-loading 'flavor' on Instance uuid 0b388b98-4e65-4258-bbe2-77e699321fb7 {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:25:42 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11986c5b-6914-491e-8e71-983ab6b13c6e/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:25:42 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11986c5b-6914-491e-8e71-983ab6b13c6e/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:25:42 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-1d02d19c-a2d5-4207-8a1a-b5d38f99487a tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Acquiring lock "refresh_cache-0b388b98-4e65-4258-bbe2-77e699321fb7" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:25:42 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-1d02d19c-a2d5-4207-8a1a-b5d38f99487a tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Acquired lock "refresh_cache-0b388b98-4e65-4258-bbe2-77e699321fb7" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:25:42 user nova-compute[85141]: DEBUG nova.network.neutron [None req-1d02d19c-a2d5-4207-8a1a-b5d38f99487a tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] [instance: 0b388b98-4e65-4258-bbe2-77e699321fb7] Building network info cache for instance {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 10:25:42 user nova-compute[85141]: DEBUG nova.objects.instance [None req-1d02d19c-a2d5-4207-8a1a-b5d38f99487a tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Lazy-loading 'info_cache' on Instance uuid 0b388b98-4e65-4258-bbe2-77e699321fb7 {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:25:42 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:25:42 user nova-compute[85141]: DEBUG nova.objects.base [None req-1d02d19c-a2d5-4207-8a1a-b5d38f99487a tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Object Instance<0b388b98-4e65-4258-bbe2-77e699321fb7> lazy-loaded attributes: flavor,info_cache {{(pid=85141) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 10:25:43 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11986c5b-6914-491e-8e71-983ab6b13c6e/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:25:43 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cabe7751-c5b0-45aa-b12e-7ad94eeaec78 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] [instance: 463034ff-14ce-477a-9642-4d86aa6f9cd9] Calling os-brick to attach iSCSI Volume {{(pid=85141) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 10:25:43 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-cabe7751-c5b0-45aa-b12e-7ad94eeaec78 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51806b6080>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e1b58025-0c18-41f6-a126-fb3c925399a1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SCyDABYj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 10:25:43 user nova-compute[85141]: WARNING os_brick.initiator.connectors.base [None req-cabe7751-c5b0-45aa-b12e-7ad94eeaec78 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 10:25:43 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-cabe7751-c5b0-45aa-b12e-7ad94eeaec78 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 10:25:43 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-cabe7751-c5b0-45aa-b12e-7ad94eeaec78 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 10:25:43 user nova-compute[85141]: WARNING os_brick.initiator.connectors.base [None req-cabe7751-c5b0-45aa-b12e-7ad94eeaec78 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 10:25:43 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-cabe7751-c5b0-45aa-b12e-7ad94eeaec78 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e1b58025-0c18-41f6-a126-fb3c925399a1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 10:25:43 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-cabe7751-c5b0-45aa-b12e-7ad94eeaec78 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e1b58025-0c18-41f6-a126-fb3c925399a1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 10:25:43 user nova-compute[85141]: INFO os_brick.initiator.connectors.iscsi [None req-cabe7751-c5b0-45aa-b12e-7ad94eeaec78 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 10:25:43 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1b58025-0c18-41f6-a126-fb3c925399a1 -p 172.16.0.220:3260 {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:25:43 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1b58025-0c18-41f6-a126-fb3c925399a1 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:25:43 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0ef3800-bc50-42a4-88dc-36e844a6a5bf]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:25:43 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-cabe7751-c5b0-45aa-b12e-7ad94eeaec78 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 10:25:43 user nova-compute[85141]:  {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:25:43 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1b58025-0c18-41f6-a126-fb3c925399a1 -p 172.16.0.220:3260 --interface default --op new {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:25:43 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:25:43 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:25:43 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Hypervisor/Node resource view: name=user free_ram=7111MB free_disk=24.781639099121094GB free_vcpus=-2 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=85141) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 10:25:43 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:25:43 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:25:43 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1b58025-0c18-41f6-a126-fb3c925399a1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:25:43 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[e420d731-d987-4ddb-b24e-73a8b2bcb1b5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e1b58025-0c18-41f6-a126-fb3c925399a1] added\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:25:43 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-cabe7751-c5b0-45aa-b12e-7ad94eeaec78 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e1b58025-0c18-41f6-a126-fb3c925399a1] added
Nov 16 10:25:43 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:25:43 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1b58025-0c18-41f6-a126-fb3c925399a1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:25:43 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1b58025-0c18-41f6-a126-fb3c925399a1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:25:43 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa36d5e8-44a8-456f-9827-a7be7e19f43b]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:25:43 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-cabe7751-c5b0-45aa-b12e-7ad94eeaec78 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:25:43 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1b58025-0c18-41f6-a126-fb3c925399a1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:25:43 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1b58025-0c18-41f6-a126-fb3c925399a1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.083s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:25:43 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[2efcee6e-7462-4750-8602-b4666517dcbc]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:25:43 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-cabe7751-c5b0-45aa-b12e-7ad94eeaec78 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:25:43 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1b58025-0c18-41f6-a126-fb3c925399a1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SCyDABYj {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:25:44 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1b58025-0c18-41f6-a126-fb3c925399a1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SCyDABYj" returned: 0 in 0.145s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:25:44 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[706c8f46-d693-4f3f-8c76-0f0bccecc522]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:25:44 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-cabe7751-c5b0-45aa-b12e-7ad94eeaec78 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SCyDABYj'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:25:44 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1b58025-0c18-41f6-a126-fb3c925399a1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:25:44 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1b58025-0c18-41f6-a126-fb3c925399a1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:25:44 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[f864d9f6-e20e-443b-8d0c-b58e5f729300]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:25:44 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-cabe7751-c5b0-45aa-b12e-7ad94eeaec78 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:25:44 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:25:44 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance d842f90e-663b-4c95-9d7c-d092d2bac41f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:25:44 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance f01dc8cf-1a69-4618-a15d-0c1075157f05 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:25:44 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance 059d6974-bd0c-4f73-91fc-8202ebda4238 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:25:44 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance 4e214bbb-5bbb-4e6f-ac09-9cb1412f068b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:25:44 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance b24c3954-06ff-4e15-9e43-c65d1dae7a5d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:25:44 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance 0b388b98-4e65-4258-bbe2-77e699321fb7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:25:44 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance 11986c5b-6914-491e-8e71-983ab6b13c6e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:25:44 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance abe5d4b7-a0d7-40e3-b630-0de746ddb55b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:25:44 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance 17480138-4b61-43f7-92a5-db065f7d1696 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:25:44 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance 463034ff-14ce-477a-9642-4d86aa6f9cd9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:25:44 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance 5a507c85-0369-48ea-8858-3e7d346b4cb0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:25:44 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance d7dfe34a-f7ba-44b3-8898-634338161a23 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:25:44 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance dfe84cd6-628a-484e-b266-34e2abe890f2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:25:44 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance bc76703d-9243-4277-9b13-d6f9639cd1bb actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:25:44 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance 2b4347a0-a9f0-4e4c-9d7a-30d984fa35a9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:25:44 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Total usable vcpus: 12, total allocated vcpus: 15 {{(pid=85141) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 10:25:44 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Final resource view: name=user phys_ram=16011MB used_ram=8192MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=15 pci_stats=[] {{(pid=85141) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 10:25:44 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:25:44 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e2fc18e-2cf8-4e08-9d6f-261c6d8084df]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11a6a15b-38c1-4e7e-b8fa-2feb6789e775 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bc0a873-d872-4f63-9af6-b4ac71162eeb (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2006a77c-e5e8-4ec5-8de5-a0f9505c429a (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb96bfcd-cecc-452f-bc3b-61b7daf72599 (non-flash)\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:25:44 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-cabe7751-c5b0-45aa-b12e-7ad94eeaec78 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)
Nov 16 10:25:44 user nova-compute[85141]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11a6a15b-38c1-4e7e-b8fa-2feb6789e775 (non-flash)
Nov 16 10:25:44 user nova-compute[85141]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bc0a873-d872-4f63-9af6-b4ac71162eeb (non-flash)
Nov 16 10:25:44 user nova-compute[85141]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2006a77c-e5e8-4ec5-8de5-a0f9505c429a (non-flash)
Nov 16 10:25:44 user nova-compute[85141]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb96bfcd-cecc-452f-bc3b-61b7daf72599 (non-flash)
Nov 16 10:25:44 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:25:44 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-cabe7751-c5b0-45aa-b12e-7ad94eeaec78 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)
Nov 16 10:25:44 user nova-compute[85141]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11a6a15b-38c1-4e7e-b8fa-2feb6789e775 (non-flash)
Nov 16 10:25:44 user nova-compute[85141]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bc0a873-d872-4f63-9af6-b4ac71162eeb (non-flash)
Nov 16 10:25:44 user nova-compute[85141]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2006a77c-e5e8-4ec5-8de5-a0f9505c429a (non-flash)
Nov 16 10:25:44 user nova-compute[85141]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb96bfcd-cecc-452f-bc3b-61b7daf72599 (non-flash)
Nov 16 10:25:44 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 10:25:44 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1b58025-0c18-41f6-a126-fb3c925399a1 -p 172.16.0.220:3260 --login {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:25:44 user nova-compute[85141]: DEBUG nova.network.neutron [None req-1d02d19c-a2d5-4207-8a1a-b5d38f99487a tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] [instance: 0b388b98-4e65-4258-bbe2-77e699321fb7] Updating instance_info_cache with network_info: [{"id": "3ed9d2a6-c028-4b75-9023-95b1cfa982b6", "address": "fa:16:3e:85:dd:4c", "network": {"id": "4e36c3d2-7d16-4305-a0a7-2358e1208df3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1030128743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2acc04e107d4a229c3580cf078a20f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ed9d2a6-c0", "ovs_interfaceid": "3ed9d2a6-c028-4b75-9023-95b1cfa982b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:25:44 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1b58025-0c18-41f6-a126-fb3c925399a1 -p 172.16.0.220:3260 --login" returned: 0 in 0.112s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:25:44 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7bb4c1c-a3a6-4bc3-8d9b-d3d2fb7a5b89]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e1b58025-0c18-41f6-a126-fb3c925399a1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e1b58025-0c18-41f6-a126-fb3c925399a1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:25:44 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-cabe7751-c5b0-45aa-b12e-7ad94eeaec78 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e1b58025-0c18-41f6-a126-fb3c925399a1, portal: 172.16.0.220,3260]
Nov 16 10:25:44 user nova-compute[85141]: Login to [iface: default, target: iqn.2010-10.org.openstack:e1b58025-0c18-41f6-a126-fb3c925399a1, portal: 172.16.0.220,3260] successful.
Nov 16 10:25:44 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:25:44 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1b58025-0c18-41f6-a126-fb3c925399a1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:25:44 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-1d02d19c-a2d5-4207-8a1a-b5d38f99487a tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Releasing lock "refresh_cache-0b388b98-4e65-4258-bbe2-77e699321fb7" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:25:44 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1b58025-0c18-41f6-a126-fb3c925399a1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:25:44 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c6778e0-80cc-4e7d-abbb-1f6e90912571]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:25:44 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-cabe7751-c5b0-45aa-b12e-7ad94eeaec78 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:25:44 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:25:44 user nova-compute[85141]: INFO nova.virt.libvirt.driver [-] [instance: 0b388b98-4e65-4258-bbe2-77e699321fb7] Instance destroyed successfully.
Nov 16 10:25:44 user nova-compute[85141]: DEBUG nova.objects.instance [None req-1d02d19c-a2d5-4207-8a1a-b5d38f99487a tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Lazy-loading 'resources' on Instance uuid 0b388b98-4e65-4258-bbe2-77e699321fb7 {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:25:44 user nova-compute[85141]: DEBUG nova.objects.base [None req-1d02d19c-a2d5-4207-8a1a-b5d38f99487a tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Object Instance<0b388b98-4e65-4258-bbe2-77e699321fb7> lazy-loaded attributes: flavor,info_cache,resources {{(pid=85141) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 10:25:44 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-1d02d19c-a2d5-4207-8a1a-b5d38f99487a tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T10:17:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1602512664',display_name='tempest-AttachVolumeTestJSON-server-1602512664',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1602512664',id=23,image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAR6bF9nouUYoCi9ZNGh3nZGY5ofrnXVxXtSu/7Acr1EHKWGjXKYUGtrq2XimOt/E4akdnq6ZnUvHCruk4Zy5W8xPtBZmROYAs+9Sfqoh0p8jGC4Ld4F7tm19PX/QAMtvA==',key_name='tempest-keypair-1960067559',keypairs=<?>,launch_index=0,launched_at=2023-11-16T10:17:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='c2acc04e107d4a229c3580cf078a20f7',ramdisk_id='',reservation_id='r-ji9l4e80',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1609390288',owner_user_name='tempest-AttachVolumeTestJSON-1609390288-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T10:23:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f58409e5923c42b685d0a3ad0ab42974',uuid=0b388b98-4e65-4258-bbe2-77e699321fb7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "3ed9d2a6-c028-4b75-9023-95b1cfa982b6", "address": "fa:16:3e:85:dd:4c", "network": {"id": "4e36c3d2-7d16-4305-a0a7-2358e1208df3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1030128743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2acc04e107d4a229c3580cf078a20f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ed9d2a6-c0", "ovs_interfaceid": "3ed9d2a6-c028-4b75-9023-95b1cfa982b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 10:25:44 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-1d02d19c-a2d5-4207-8a1a-b5d38f99487a tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Converting VIF {"id": "3ed9d2a6-c028-4b75-9023-95b1cfa982b6", "address": "fa:16:3e:85:dd:4c", "network": {"id": "4e36c3d2-7d16-4305-a0a7-2358e1208df3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1030128743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2acc04e107d4a229c3580cf078a20f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ed9d2a6-c0", "ovs_interfaceid": "3ed9d2a6-c028-4b75-9023-95b1cfa982b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:25:44 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-1d02d19c-a2d5-4207-8a1a-b5d38f99487a tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:85:dd:4c,bridge_name='br-int',has_traffic_filtering=True,id=3ed9d2a6-c028-4b75-9023-95b1cfa982b6,network=Network(4e36c3d2-7d16-4305-a0a7-2358e1208df3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ed9d2a6-c0') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:25:44 user nova-compute[85141]: DEBUG os_vif [None req-1d02d19c-a2d5-4207-8a1a-b5d38f99487a tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:85:dd:4c,bridge_name='br-int',has_traffic_filtering=True,id=3ed9d2a6-c028-4b75-9023-95b1cfa982b6,network=Network(4e36c3d2-7d16-4305-a0a7-2358e1208df3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ed9d2a6-c0') {{(pid=85141) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 10:25:44 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:25:44 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[61a8f0a3-2a0f-44ca-b8b2-35ca4fdd40c0]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11a6a15b-38c1-4e7e-b8fa-2feb6789e775 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bc0a873-d872-4f63-9af6-b4ac71162eeb (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2006a77c-e5e8-4ec5-8de5-a0f9505c429a (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb96bfcd-cecc-452f-bc3b-61b7daf72599 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b58025-0c18-41f6-a126-fb3c925399a1 (non-flash)\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:25:44 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-cabe7751-c5b0-45aa-b12e-7ad94eeaec78 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)
Nov 16 10:25:44 user nova-compute[85141]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11a6a15b-38c1-4e7e-b8fa-2feb6789e775 (non-flash)
Nov 16 10:25:44 user nova-compute[85141]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bc0a873-d872-4f63-9af6-b4ac71162eeb (non-flash)
Nov 16 10:25:44 user nova-compute[85141]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2006a77c-e5e8-4ec5-8de5-a0f9505c429a (non-flash)
Nov 16 10:25:44 user nova-compute[85141]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb96bfcd-cecc-452f-bc3b-61b7daf72599 (non-flash)
Nov 16 10:25:44 user nova-compute[85141]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b58025-0c18-41f6-a126-fb3c925399a1 (non-flash)
Nov 16 10:25:44 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:25:44 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-cabe7751-c5b0-45aa-b12e-7ad94eeaec78 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)
Nov 16 10:25:44 user nova-compute[85141]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11a6a15b-38c1-4e7e-b8fa-2feb6789e775 (non-flash)
Nov 16 10:25:44 user nova-compute[85141]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bc0a873-d872-4f63-9af6-b4ac71162eeb (non-flash)
Nov 16 10:25:44 user nova-compute[85141]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2006a77c-e5e8-4ec5-8de5-a0f9505c429a (non-flash)
Nov 16 10:25:44 user nova-compute[85141]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb96bfcd-cecc-452f-bc3b-61b7daf72599 (non-flash)
Nov 16 10:25:44 user nova-compute[85141]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b58025-0c18-41f6-a126-fb3c925399a1 (non-flash)
Nov 16 10:25:44 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 10:25:44 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-cabe7751-c5b0-45aa-b12e-7ad94eeaec78 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e1b58025-0c18-41f6-a126-fb3c925399a1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.214s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 10:25:44 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-cabe7751-c5b0-45aa-b12e-7ad94eeaec78 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Connected to 172.16.0.220:3260 {{(pid=85141) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 10:25:44 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-cabe7751-c5b0-45aa-b12e-7ad94eeaec78 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] HCTL ('38', '-', '-', 0) found on session 39 with lun 0 {{(pid=85141) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 10:25:44 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-cabe7751-c5b0-45aa-b12e-7ad94eeaec78 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=85141) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 10:25:44 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:25:44 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3ed9d2a6-c0, bridge=br-int, if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:25:44 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:25:44 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:25:44 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:25:44 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:25:44 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b8aef809-1a73-4f62-aa83-46032c5cfb0d) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:25:44 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:25:44 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:25:44 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.026s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:25:44 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[17f3f529-d940-4db1-8d37-926debdf7063]: (4, ('- - 0', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:25:44 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-cabe7751-c5b0-45aa-b12e-7ad94eeaec78 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Searching for a device in session 39 and hctl ['38', '*', '*', 0] yield: None {{(pid=85141) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 10:25:44 user nova-compute[85141]: INFO os_vif [None req-1d02d19c-a2d5-4207-8a1a-b5d38f99487a tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:85:dd:4c,bridge_name='br-int',has_traffic_filtering=True,id=3ed9d2a6-c028-4b75-9023-95b1cfa982b6,network=Network(4e36c3d2-7d16-4305-a0a7-2358e1208df3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ed9d2a6-c0')
Nov 16 10:25:44 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-1d02d19c-a2d5-4207-8a1a-b5d38f99487a tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] [instance: 0b388b98-4e65-4258-bbe2-77e699321fb7] Start _get_guest_xml network_info=[{"id": "3ed9d2a6-c028-4b75-9023-95b1cfa982b6", "address": "fa:16:3e:85:dd:4c", "network": {"id": "4e36c3d2-7d16-4305-a0a7-2358e1208df3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1030128743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2acc04e107d4a229c3580cf078a20f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ed9d2a6-c0", "ovs_interfaceid": "3ed9d2a6-c028-4b75-9023-95b1cfa982b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=bc4ca70f-a459-4d5c-a9e6-80f1948eb48b,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_options': None, 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'image_id': 'bc4ca70f-a459-4d5c-a9e6-80f1948eb48b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=85141) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 10:25:44 user nova-compute[85141]: DEBUG nova.objects.instance [None req-1d02d19c-a2d5-4207-8a1a-b5d38f99487a tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Lazy-loading 'numa_topology' on Instance uuid 0b388b98-4e65-4258-bbe2-77e699321fb7 {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:25:44 user nova-compute[85141]: DEBUG nova.objects.base [None req-1d02d19c-a2d5-4207-8a1a-b5d38f99487a tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Object Instance<0b388b98-4e65-4258-bbe2-77e699321fb7> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=85141) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 10:25:44 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-1d02d19c-a2d5-4207-8a1a-b5d38f99487a tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:25:44 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-1d02d19c-a2d5-4207-8a1a-b5d38f99487a tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:25:44 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-1d02d19c-a2d5-4207-8a1a-b5d38f99487a tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=85141) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 10:25:44 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-1d02d19c-a2d5-4207-8a1a-b5d38f99487a tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] CPU controller missing on host. {{(pid=85141) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 10:25:44 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-1d02d19c-a2d5-4207-8a1a-b5d38f99487a tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=85141) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 10:25:44 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-1d02d19c-a2d5-4207-8a1a-b5d38f99487a tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] CPU controller found on host. {{(pid=85141) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 10:25:44 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-1d02d19c-a2d5-4207-8a1a-b5d38f99487a tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=85141) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 10:25:44 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-1d02d19c-a2d5-4207-8a1a-b5d38f99487a tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T10:06:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=bc4ca70f-a459-4d5c-a9e6-80f1948eb48b,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 10:25:44 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-1d02d19c-a2d5-4207-8a1a-b5d38f99487a tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Flavor limits 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 10:25:44 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-1d02d19c-a2d5-4207-8a1a-b5d38f99487a tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Image limits 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 10:25:44 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-1d02d19c-a2d5-4207-8a1a-b5d38f99487a tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Flavor pref 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 10:25:44 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-1d02d19c-a2d5-4207-8a1a-b5d38f99487a tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Image pref 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 10:25:44 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-1d02d19c-a2d5-4207-8a1a-b5d38f99487a tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 10:25:44 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-1d02d19c-a2d5-4207-8a1a-b5d38f99487a tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 10:25:44 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-1d02d19c-a2d5-4207-8a1a-b5d38f99487a tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=85141) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 10:25:44 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-1d02d19c-a2d5-4207-8a1a-b5d38f99487a tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Got 1 possible topologies {{(pid=85141) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 10:25:44 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-1d02d19c-a2d5-4207-8a1a-b5d38f99487a tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 10:25:44 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-1d02d19c-a2d5-4207-8a1a-b5d38f99487a tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 10:25:44 user nova-compute[85141]: DEBUG nova.objects.instance [None req-1d02d19c-a2d5-4207-8a1a-b5d38f99487a tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Lazy-loading 'vcpu_model' on Instance uuid 0b388b98-4e65-4258-bbe2-77e699321fb7 {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:25:44 user nova-compute[85141]: DEBUG nova.objects.base [None req-1d02d19c-a2d5-4207-8a1a-b5d38f99487a tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Object Instance<0b388b98-4e65-4258-bbe2-77e699321fb7> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=85141) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 10:25:44 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-1d02d19c-a2d5-4207-8a1a-b5d38f99487a tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T10:17:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1602512664',display_name='tempest-AttachVolumeTestJSON-server-1602512664',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1602512664',id=23,image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAR6bF9nouUYoCi9ZNGh3nZGY5ofrnXVxXtSu/7Acr1EHKWGjXKYUGtrq2XimOt/E4akdnq6ZnUvHCruk4Zy5W8xPtBZmROYAs+9Sfqoh0p8jGC4Ld4F7tm19PX/QAMtvA==',key_name='tempest-keypair-1960067559',keypairs=<?>,launch_index=0,launched_at=2023-11-16T10:17:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='c2acc04e107d4a229c3580cf078a20f7',ramdisk_id='',reservation_id='r-ji9l4e80',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1609390288',owner_user_name='tempest-AttachVolumeTestJSON-1609390288-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T10:23:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f58409e5923c42b685d0a3ad0ab42974',uuid=0b388b98-4e65-4258-bbe2-77e699321fb7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "3ed9d2a6-c028-4b75-9023-95b1cfa982b6", "address": "fa:16:3e:85:dd:4c", "network": {"id": "4e36c3d2-7d16-4305-a0a7-2358e1208df3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1030128743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2acc04e107d4a229c3580cf078a20f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ed9d2a6-c0", "ovs_interfaceid": "3ed9d2a6-c028-4b75-9023-95b1cfa982b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=85141) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 10:25:44 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-1d02d19c-a2d5-4207-8a1a-b5d38f99487a tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Converting VIF {"id": "3ed9d2a6-c028-4b75-9023-95b1cfa982b6", "address": "fa:16:3e:85:dd:4c", "network": {"id": "4e36c3d2-7d16-4305-a0a7-2358e1208df3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1030128743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2acc04e107d4a229c3580cf078a20f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ed9d2a6-c0", "ovs_interfaceid": "3ed9d2a6-c028-4b75-9023-95b1cfa982b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:25:44 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-1d02d19c-a2d5-4207-8a1a-b5d38f99487a tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:85:dd:4c,bridge_name='br-int',has_traffic_filtering=True,id=3ed9d2a6-c028-4b75-9023-95b1cfa982b6,network=Network(4e36c3d2-7d16-4305-a0a7-2358e1208df3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ed9d2a6-c0') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:25:44 user nova-compute[85141]: DEBUG nova.objects.instance [None req-1d02d19c-a2d5-4207-8a1a-b5d38f99487a tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Lazy-loading 'pci_devices' on Instance uuid 0b388b98-4e65-4258-bbe2-77e699321fb7 {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:25:44 user nova-compute[85141]: DEBUG nova.objects.base [None req-1d02d19c-a2d5-4207-8a1a-b5d38f99487a tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Object Instance<0b388b98-4e65-4258-bbe2-77e699321fb7> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=85141) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 10:25:44 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-1d02d19c-a2d5-4207-8a1a-b5d38f99487a tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] [instance: 0b388b98-4e65-4258-bbe2-77e699321fb7] End _get_guest_xml xml=<domain type="kvm">
Nov 16 10:25:44 user nova-compute[85141]:   <uuid>0b388b98-4e65-4258-bbe2-77e699321fb7</uuid>
Nov 16 10:25:44 user nova-compute[85141]:   <name>instance-00000017</name>
Nov 16 10:25:44 user nova-compute[85141]:   <memory>524288</memory>
Nov 16 10:25:44 user nova-compute[85141]:   <vcpu>1</vcpu>
Nov 16 10:25:44 user nova-compute[85141]:   <metadata>
Nov 16 10:25:44 user nova-compute[85141]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 10:25:44 user nova-compute[85141]:       <nova:package version="0.0.0"/>
Nov 16 10:25:44 user nova-compute[85141]:       <nova:name>tempest-AttachVolumeTestJSON-server-1602512664</nova:name>
Nov 16 10:25:44 user nova-compute[85141]:       <nova:creationTime>2023-11-16 10:25:44</nova:creationTime>
Nov 16 10:25:44 user nova-compute[85141]:       <nova:flavor name="m1.tiny">
Nov 16 10:25:44 user nova-compute[85141]:         <nova:memory>512</nova:memory>
Nov 16 10:25:44 user nova-compute[85141]:         <nova:disk>1</nova:disk>
Nov 16 10:25:44 user nova-compute[85141]:         <nova:swap>0</nova:swap>
Nov 16 10:25:44 user nova-compute[85141]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 10:25:44 user nova-compute[85141]:         <nova:vcpus>1</nova:vcpus>
Nov 16 10:25:44 user nova-compute[85141]:       </nova:flavor>
Nov 16 10:25:44 user nova-compute[85141]:       <nova:owner>
Nov 16 10:25:44 user nova-compute[85141]:         <nova:user uuid="f58409e5923c42b685d0a3ad0ab42974">tempest-AttachVolumeTestJSON-1609390288-project-member</nova:user>
Nov 16 10:25:44 user nova-compute[85141]:         <nova:project uuid="c2acc04e107d4a229c3580cf078a20f7">tempest-AttachVolumeTestJSON-1609390288</nova:project>
Nov 16 10:25:44 user nova-compute[85141]:       </nova:owner>
Nov 16 10:25:44 user nova-compute[85141]:       <nova:root type="image" uuid="bc4ca70f-a459-4d5c-a9e6-80f1948eb48b"/>
Nov 16 10:25:44 user nova-compute[85141]:       <nova:ports>
Nov 16 10:25:44 user nova-compute[85141]:         <nova:port uuid="3ed9d2a6-c028-4b75-9023-95b1cfa982b6">
Nov 16 10:25:44 user nova-compute[85141]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 16 10:25:44 user nova-compute[85141]:         </nova:port>
Nov 16 10:25:44 user nova-compute[85141]:       </nova:ports>
Nov 16 10:25:44 user nova-compute[85141]:     </nova:instance>
Nov 16 10:25:44 user nova-compute[85141]:   </metadata>
Nov 16 10:25:44 user nova-compute[85141]:   <sysinfo type="smbios">
Nov 16 10:25:44 user nova-compute[85141]:     <system>
Nov 16 10:25:44 user nova-compute[85141]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 10:25:44 user nova-compute[85141]:       <entry name="product">OpenStack Nova</entry>
Nov 16 10:25:44 user nova-compute[85141]:       <entry name="version">0.0.0</entry>
Nov 16 10:25:44 user nova-compute[85141]:       <entry name="serial">0b388b98-4e65-4258-bbe2-77e699321fb7</entry>
Nov 16 10:25:44 user nova-compute[85141]:       <entry name="uuid">0b388b98-4e65-4258-bbe2-77e699321fb7</entry>
Nov 16 10:25:44 user nova-compute[85141]:       <entry name="family">Virtual Machine</entry>
Nov 16 10:25:44 user nova-compute[85141]:     </system>
Nov 16 10:25:44 user nova-compute[85141]:   </sysinfo>
Nov 16 10:25:44 user nova-compute[85141]:   <os>
Nov 16 10:25:44 user nova-compute[85141]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 10:25:44 user nova-compute[85141]:     <boot dev="hd"/>
Nov 16 10:25:44 user nova-compute[85141]:     <smbios mode="sysinfo"/>
Nov 16 10:25:44 user nova-compute[85141]:   </os>
Nov 16 10:25:44 user nova-compute[85141]:   <features>
Nov 16 10:25:44 user nova-compute[85141]:     <acpi/>
Nov 16 10:25:44 user nova-compute[85141]:     <apic/>
Nov 16 10:25:44 user nova-compute[85141]:     <vmcoreinfo/>
Nov 16 10:25:44 user nova-compute[85141]:   </features>
Nov 16 10:25:44 user nova-compute[85141]:   <clock offset="utc">
Nov 16 10:25:44 user nova-compute[85141]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 10:25:44 user nova-compute[85141]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 10:25:44 user nova-compute[85141]:     <timer name="hpet" present="no"/>
Nov 16 10:25:44 user nova-compute[85141]:   </clock>
Nov 16 10:25:44 user nova-compute[85141]:   <cpu mode="custom" match="exact">
Nov 16 10:25:44 user nova-compute[85141]:     <model>Nehalem</model>
Nov 16 10:25:44 user nova-compute[85141]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 10:25:44 user nova-compute[85141]:   </cpu>
Nov 16 10:25:44 user nova-compute[85141]:   <devices>
Nov 16 10:25:44 user nova-compute[85141]:     <disk type="file" device="disk">
Nov 16 10:25:44 user nova-compute[85141]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 10:25:44 user nova-compute[85141]:       <source file="/opt/stack/data/nova/instances/0b388b98-4e65-4258-bbe2-77e699321fb7/disk"/>
Nov 16 10:25:44 user nova-compute[85141]:       <target dev="vda" bus="virtio"/>
Nov 16 10:25:44 user nova-compute[85141]:     </disk>
Nov 16 10:25:44 user nova-compute[85141]:     <interface type="ethernet">
Nov 16 10:25:44 user nova-compute[85141]:       <mac address="fa:16:3e:85:dd:4c"/>
Nov 16 10:25:44 user nova-compute[85141]:       <model type="virtio"/>
Nov 16 10:25:44 user nova-compute[85141]:       <mtu size="1442"/>
Nov 16 10:25:44 user nova-compute[85141]:       <target dev="tap3ed9d2a6-c0"/>
Nov 16 10:25:44 user nova-compute[85141]:     </interface>
Nov 16 10:25:44 user nova-compute[85141]:     <serial type="pty">
Nov 16 10:25:44 user nova-compute[85141]:       <log file="/opt/stack/data/nova/instances/0b388b98-4e65-4258-bbe2-77e699321fb7/console.log" append="off"/>
Nov 16 10:25:44 user nova-compute[85141]:     </serial>
Nov 16 10:25:44 user nova-compute[85141]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 10:25:44 user nova-compute[85141]:     <video>
Nov 16 10:25:44 user nova-compute[85141]:       <model type="virtio"/>
Nov 16 10:25:44 user nova-compute[85141]:     </video>
Nov 16 10:25:44 user nova-compute[85141]:     <rng model="virtio">
Nov 16 10:25:44 user nova-compute[85141]:       <backend model="random">/dev/urandom</backend>
Nov 16 10:25:44 user nova-compute[85141]:     </rng>
Nov 16 10:25:44 user nova-compute[85141]:     <controller type="usb" index="0" model="none"/>
Nov 16 10:25:44 user nova-compute[85141]:     <memballoon model="virtio">
Nov 16 10:25:44 user nova-compute[85141]:       <stats period="10"/>
Nov 16 10:25:44 user nova-compute[85141]:     </memballoon>
Nov 16 10:25:44 user nova-compute[85141]:   </devices>
Nov 16 10:25:44 user nova-compute[85141]: </domain>
Nov 16 10:25:44 user nova-compute[85141]:  {{(pid=85141) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 10:25:44 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-1d02d19c-a2d5-4207-8a1a-b5d38f99487a tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b388b98-4e65-4258-bbe2-77e699321fb7/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:25:44 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-1d02d19c-a2d5-4207-8a1a-b5d38f99487a tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b388b98-4e65-4258-bbe2-77e699321fb7/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:25:44 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-1d02d19c-a2d5-4207-8a1a-b5d38f99487a tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b388b98-4e65-4258-bbe2-77e699321fb7/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:25:44 user nova-compute[85141]: DEBUG nova.compute.provider_tree [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Inventory has not changed in ProviderTree for provider: bf8e0fa1-16b6-408f-9203-c4cd63916272 {{(pid=85141) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 10:25:44 user nova-compute[85141]: DEBUG nova.scheduler.client.report [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Inventory has not changed for provider bf8e0fa1-16b6-408f-9203-c4cd63916272 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=85141) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 10:25:44 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Compute_service record updated for user:user {{(pid=85141) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 10:25:44 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.073s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:25:44 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-1d02d19c-a2d5-4207-8a1a-b5d38f99487a tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b388b98-4e65-4258-bbe2-77e699321fb7/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:25:44 user nova-compute[85141]: DEBUG nova.objects.instance [None req-1d02d19c-a2d5-4207-8a1a-b5d38f99487a tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Lazy-loading 'trusted_certs' on Instance uuid 0b388b98-4e65-4258-bbe2-77e699321fb7 {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:25:44 user nova-compute[85141]: DEBUG nova.objects.base [None req-1d02d19c-a2d5-4207-8a1a-b5d38f99487a tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Object Instance<0b388b98-4e65-4258-bbe2-77e699321fb7> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=85141) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 10:25:44 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-1d02d19c-a2d5-4207-8a1a-b5d38f99487a tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:25:45 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-1d02d19c-a2d5-4207-8a1a-b5d38f99487a tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json" returned: 0 in 0.178s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:25:45 user nova-compute[85141]: DEBUG nova.virt.disk.api [None req-1d02d19c-a2d5-4207-8a1a-b5d38f99487a tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0b388b98-4e65-4258-bbe2-77e699321fb7/disk. size=1073741824 {{(pid=85141) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 10:25:45 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-1d02d19c-a2d5-4207-8a1a-b5d38f99487a tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b388b98-4e65-4258-bbe2-77e699321fb7/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:25:45 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-1d02d19c-a2d5-4207-8a1a-b5d38f99487a tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b388b98-4e65-4258-bbe2-77e699321fb7/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:25:45 user nova-compute[85141]: DEBUG nova.virt.disk.api [None req-1d02d19c-a2d5-4207-8a1a-b5d38f99487a tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Cannot resize image /opt/stack/data/nova/instances/0b388b98-4e65-4258-bbe2-77e699321fb7/disk to a smaller size. {{(pid=85141) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 10:25:45 user nova-compute[85141]: DEBUG nova.objects.instance [None req-1d02d19c-a2d5-4207-8a1a-b5d38f99487a tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Lazy-loading 'migration_context' on Instance uuid 0b388b98-4e65-4258-bbe2-77e699321fb7 {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:25:45 user nova-compute[85141]: DEBUG nova.objects.base [None req-1d02d19c-a2d5-4207-8a1a-b5d38f99487a tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Object Instance<0b388b98-4e65-4258-bbe2-77e699321fb7> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=85141) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 10:25:45 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-1d02d19c-a2d5-4207-8a1a-b5d38f99487a tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T10:17:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1602512664',display_name='tempest-AttachVolumeTestJSON-server-1602512664',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1602512664',id=23,image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAR6bF9nouUYoCi9ZNGh3nZGY5ofrnXVxXtSu/7Acr1EHKWGjXKYUGtrq2XimOt/E4akdnq6ZnUvHCruk4Zy5W8xPtBZmROYAs+9Sfqoh0p8jGC4Ld4F7tm19PX/QAMtvA==',key_name='tempest-keypair-1960067559',keypairs=<?>,launch_index=0,launched_at=2023-11-16T10:17:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='c2acc04e107d4a229c3580cf078a20f7',ramdisk_id='',reservation_id='r-ji9l4e80',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1609390288',owner_user_name='tempest-AttachVolumeTestJSON-1609390288-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T10:23:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f58409e5923c42b685d0a3ad0ab42974',uuid=0b388b98-4e65-4258-bbe2-77e699321fb7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "3ed9d2a6-c028-4b75-9023-95b1cfa982b6", "address": "fa:16:3e:85:dd:4c", "network": {"id": "4e36c3d2-7d16-4305-a0a7-2358e1208df3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1030128743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2acc04e107d4a229c3580cf078a20f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ed9d2a6-c0", "ovs_interfaceid": "3ed9d2a6-c028-4b75-9023-95b1cfa982b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 10:25:45 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-1d02d19c-a2d5-4207-8a1a-b5d38f99487a tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Converting VIF {"id": "3ed9d2a6-c028-4b75-9023-95b1cfa982b6", "address": "fa:16:3e:85:dd:4c", "network": {"id": "4e36c3d2-7d16-4305-a0a7-2358e1208df3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1030128743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2acc04e107d4a229c3580cf078a20f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ed9d2a6-c0", "ovs_interfaceid": "3ed9d2a6-c028-4b75-9023-95b1cfa982b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:25:45 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-1d02d19c-a2d5-4207-8a1a-b5d38f99487a tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:85:dd:4c,bridge_name='br-int',has_traffic_filtering=True,id=3ed9d2a6-c028-4b75-9023-95b1cfa982b6,network=Network(4e36c3d2-7d16-4305-a0a7-2358e1208df3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ed9d2a6-c0') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:25:45 user nova-compute[85141]: DEBUG os_vif [None req-1d02d19c-a2d5-4207-8a1a-b5d38f99487a tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:85:dd:4c,bridge_name='br-int',has_traffic_filtering=True,id=3ed9d2a6-c028-4b75-9023-95b1cfa982b6,network=Network(4e36c3d2-7d16-4305-a0a7-2358e1208df3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ed9d2a6-c0') {{(pid=85141) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 10:25:45 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:25:45 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:25:45 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 10:25:45 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:25:45 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0d9404e5-c1b0-55b5-995e-7843afb8e8d3', '_type': 'linux-noop'}}, row=False) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:25:45 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:25:45 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:25:45 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:25:45 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3ed9d2a6-c0, may_exist=True, interface_attrs={}) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:25:45 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3ed9d2a6-c0, col_values=(('qos', UUID('0643b6fb-566c-476c-8525-75f027c006ad')),), if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:25:45 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3ed9d2a6-c0, col_values=(('external_ids', {'iface-id': '3ed9d2a6-c028-4b75-9023-95b1cfa982b6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:85:dd:4c', 'vm-uuid': '0b388b98-4e65-4258-bbe2-77e699321fb7'}),), if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:25:45 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:25:45 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:25:45 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:25:45 user nova-compute[85141]: INFO os_vif [None req-1d02d19c-a2d5-4207-8a1a-b5d38f99487a tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:85:dd:4c,bridge_name='br-int',has_traffic_filtering=True,id=3ed9d2a6-c028-4b75-9023-95b1cfa982b6,network=Network(4e36c3d2-7d16-4305-a0a7-2358e1208df3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ed9d2a6-c0')
Nov 16 10:25:45 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-cabe7751-c5b0-45aa-b12e-7ad94eeaec78 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Searching for a device in session 39 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=85141) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 10:25:45 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-cabe7751-c5b0-45aa-b12e-7ad94eeaec78 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:e1b58025-0c18-41f6-a126-fb3c925399a1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SCyDABYj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=85141) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 10:25:45 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-cabe7751-c5b0-45aa-b12e-7ad94eeaec78 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.255s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 10:25:45 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-cabe7751-c5b0-45aa-b12e-7ad94eeaec78 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] <== connect_volume: return (2257ms) {'type': 'block', 'scsi_wwn': '23563656131663833', 'path': '/dev/sdg'} {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 10:25:45 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cabe7751-c5b0-45aa-b12e-7ad94eeaec78 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] [instance: 463034ff-14ce-477a-9642-4d86aa6f9cd9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23563656131663833', 'path': '/dev/sdg'} {{(pid=85141) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 10:25:45 user nova-compute[85141]: DEBUG nova.objects.instance [None req-cabe7751-c5b0-45aa-b12e-7ad94eeaec78 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Lazy-loading 'flavor' on Instance uuid 463034ff-14ce-477a-9642-4d86aa6f9cd9 {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:25:45 user nova-compute[85141]: DEBUG nova.virt.libvirt.guest [None req-cabe7751-c5b0-45aa-b12e-7ad94eeaec78 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 10:25:45 user nova-compute[85141]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 10:25:45 user nova-compute[85141]:   <source dev="/dev/sdg"/>
Nov 16 10:25:45 user nova-compute[85141]:   <target dev="vdb" bus="virtio"/>
Nov 16 10:25:45 user nova-compute[85141]:   <serial>e1b58025-0c18-41f6-a126-fb3c925399a1</serial>
Nov 16 10:25:45 user nova-compute[85141]: </disk>
Nov 16 10:25:45 user nova-compute[85141]:  {{(pid=85141) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 10:25:46 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-cabe7751-c5b0-45aa-b12e-7ad94eeaec78 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] No BDM found with device name vda, not building metadata. {{(pid=85141) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 10:25:46 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-cabe7751-c5b0-45aa-b12e-7ad94eeaec78 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] No BDM found with device name vdb, not building metadata. {{(pid=85141) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 10:25:46 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-cabe7751-c5b0-45aa-b12e-7ad94eeaec78 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] No VIF found with MAC fa:16:3e:b0:77:d5, not building metadata {{(pid=85141) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 10:25:46 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-cabe7751-c5b0-45aa-b12e-7ad94eeaec78 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Lock "463034ff-14ce-477a-9642-4d86aa6f9cd9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.417s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:25:46 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:25:46 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:25:47 user nova-compute[85141]: INFO nova.compute.manager [None req-420f5d24-7d67-430b-bc5c-8b9bafd97386 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] [instance: 463034ff-14ce-477a-9642-4d86aa6f9cd9] Rescuing
Nov 16 10:25:47 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-420f5d24-7d67-430b-bc5c-8b9bafd97386 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Acquiring lock "refresh_cache-463034ff-14ce-477a-9642-4d86aa6f9cd9" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:25:47 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-420f5d24-7d67-430b-bc5c-8b9bafd97386 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Acquired lock "refresh_cache-463034ff-14ce-477a-9642-4d86aa6f9cd9" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:25:47 user nova-compute[85141]: DEBUG nova.network.neutron [None req-420f5d24-7d67-430b-bc5c-8b9bafd97386 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] [instance: 463034ff-14ce-477a-9642-4d86aa6f9cd9] Building network info cache for instance {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 10:25:47 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:25:47 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:25:47 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:25:47 user nova-compute[85141]: DEBUG nova.compute.manager [req-23ae228b-404c-40a0-97f9-90fbc1da3e63 req-37ba33d0-0242-4461-997b-add4e56fe710 service nova] [instance: 0b388b98-4e65-4258-bbe2-77e699321fb7] Received event network-vif-plugged-3ed9d2a6-c028-4b75-9023-95b1cfa982b6 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:25:47 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-23ae228b-404c-40a0-97f9-90fbc1da3e63 req-37ba33d0-0242-4461-997b-add4e56fe710 service nova] Acquiring lock "0b388b98-4e65-4258-bbe2-77e699321fb7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:25:47 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-23ae228b-404c-40a0-97f9-90fbc1da3e63 req-37ba33d0-0242-4461-997b-add4e56fe710 service nova] Lock "0b388b98-4e65-4258-bbe2-77e699321fb7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:25:47 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-23ae228b-404c-40a0-97f9-90fbc1da3e63 req-37ba33d0-0242-4461-997b-add4e56fe710 service nova] Lock "0b388b98-4e65-4258-bbe2-77e699321fb7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:25:47 user nova-compute[85141]: DEBUG nova.compute.manager [req-23ae228b-404c-40a0-97f9-90fbc1da3e63 req-37ba33d0-0242-4461-997b-add4e56fe710 service nova] [instance: 0b388b98-4e65-4258-bbe2-77e699321fb7] No waiting events found dispatching network-vif-plugged-3ed9d2a6-c028-4b75-9023-95b1cfa982b6 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:25:47 user nova-compute[85141]: WARNING nova.compute.manager [req-23ae228b-404c-40a0-97f9-90fbc1da3e63 req-37ba33d0-0242-4461-997b-add4e56fe710 service nova] [instance: 0b388b98-4e65-4258-bbe2-77e699321fb7] Received unexpected event network-vif-plugged-3ed9d2a6-c028-4b75-9023-95b1cfa982b6 for instance with vm_state stopped and task_state powering-on.
Nov 16 10:25:47 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:25:47 user nova-compute[85141]: DEBUG nova.network.neutron [None req-420f5d24-7d67-430b-bc5c-8b9bafd97386 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] [instance: 463034ff-14ce-477a-9642-4d86aa6f9cd9] Updating instance_info_cache with network_info: [{"id": "121bbc09-53cf-4586-8585-655079b4c49b", "address": "fa:16:3e:b0:77:d5", "network": {"id": "5b67a3fd-ef1e-4f2c-b6e0-31766ef39d30", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2137186235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09b520de67ac4290a4b779f50afeb1a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap121bbc09-53", "ovs_interfaceid": "121bbc09-53cf-4586-8585-655079b4c49b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:25:47 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:25:47 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-420f5d24-7d67-430b-bc5c-8b9bafd97386 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Releasing lock "refresh_cache-463034ff-14ce-477a-9642-4d86aa6f9cd9" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:25:47 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:25:48 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:25:48 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:25:48 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-d1f13476-70ad-48db-946e-0f9083a06c8a tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] Acquiring lock "9fcf8335-9e6f-4878-a3e2-c68aeab0978e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:25:48 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-d1f13476-70ad-48db-946e-0f9083a06c8a tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] Lock "9fcf8335-9e6f-4878-a3e2-c68aeab0978e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:25:48 user nova-compute[85141]: DEBUG nova.compute.manager [None req-d1f13476-70ad-48db-946e-0f9083a06c8a tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] [instance: 9fcf8335-9e6f-4878-a3e2-c68aeab0978e] Starting instance... {{(pid=85141) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 10:25:48 user nova-compute[85141]: DEBUG nova.compute.manager [req-d38a7b16-5125-4b60-940f-d7e9077ba2a5 req-7d30248d-f457-4a91-b463-d0ce8825b0e3 service nova] [instance: 463034ff-14ce-477a-9642-4d86aa6f9cd9] Received event network-vif-unplugged-121bbc09-53cf-4586-8585-655079b4c49b {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:25:48 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-d38a7b16-5125-4b60-940f-d7e9077ba2a5 req-7d30248d-f457-4a91-b463-d0ce8825b0e3 service nova] Acquiring lock "463034ff-14ce-477a-9642-4d86aa6f9cd9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:25:48 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-d38a7b16-5125-4b60-940f-d7e9077ba2a5 req-7d30248d-f457-4a91-b463-d0ce8825b0e3 service nova] Lock "463034ff-14ce-477a-9642-4d86aa6f9cd9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:25:48 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-d38a7b16-5125-4b60-940f-d7e9077ba2a5 req-7d30248d-f457-4a91-b463-d0ce8825b0e3 service nova] Lock "463034ff-14ce-477a-9642-4d86aa6f9cd9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:25:48 user nova-compute[85141]: DEBUG nova.compute.manager [req-d38a7b16-5125-4b60-940f-d7e9077ba2a5 req-7d30248d-f457-4a91-b463-d0ce8825b0e3 service nova] [instance: 463034ff-14ce-477a-9642-4d86aa6f9cd9] No waiting events found dispatching network-vif-unplugged-121bbc09-53cf-4586-8585-655079b4c49b {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:25:48 user nova-compute[85141]: WARNING nova.compute.manager [req-d38a7b16-5125-4b60-940f-d7e9077ba2a5 req-7d30248d-f457-4a91-b463-d0ce8825b0e3 service nova] [instance: 463034ff-14ce-477a-9642-4d86aa6f9cd9] Received unexpected event network-vif-unplugged-121bbc09-53cf-4586-8585-655079b4c49b for instance with vm_state active and task_state rescuing.
Nov 16 10:25:48 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-d1f13476-70ad-48db-946e-0f9083a06c8a tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:25:48 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-d1f13476-70ad-48db-946e-0f9083a06c8a tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:25:48 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-d1f13476-70ad-48db-946e-0f9083a06c8a tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=85141) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 10:25:48 user nova-compute[85141]: INFO nova.compute.claims [None req-d1f13476-70ad-48db-946e-0f9083a06c8a tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] [instance: 9fcf8335-9e6f-4878-a3e2-c68aeab0978e] Claim successful on node user
Nov 16 10:25:48 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:25:48 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:25:48 user nova-compute[85141]: INFO nova.virt.libvirt.driver [-] [instance: 463034ff-14ce-477a-9642-4d86aa6f9cd9] Instance destroyed successfully.
Nov 16 10:25:48 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-420f5d24-7d67-430b-bc5c-8b9bafd97386 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] [instance: 463034ff-14ce-477a-9642-4d86aa6f9cd9] Attempting rescue
Nov 16 10:25:48 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-420f5d24-7d67-430b-bc5c-8b9bafd97386 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=85141) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 16 10:25:48 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-420f5d24-7d67-430b-bc5c-8b9bafd97386 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] [instance: 463034ff-14ce-477a-9642-4d86aa6f9cd9] Instance directory exists: not creating {{(pid=85141) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 16 10:25:48 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-420f5d24-7d67-430b-bc5c-8b9bafd97386 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] [instance: 463034ff-14ce-477a-9642-4d86aa6f9cd9] Creating image(s)
Nov 16 10:25:48 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-420f5d24-7d67-430b-bc5c-8b9bafd97386 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Acquiring lock "/opt/stack/data/nova/instances/463034ff-14ce-477a-9642-4d86aa6f9cd9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:25:48 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-420f5d24-7d67-430b-bc5c-8b9bafd97386 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Lock "/opt/stack/data/nova/instances/463034ff-14ce-477a-9642-4d86aa6f9cd9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:25:48 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-420f5d24-7d67-430b-bc5c-8b9bafd97386 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Lock "/opt/stack/data/nova/instances/463034ff-14ce-477a-9642-4d86aa6f9cd9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:25:48 user nova-compute[85141]: DEBUG nova.objects.instance [None req-420f5d24-7d67-430b-bc5c-8b9bafd97386 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Lazy-loading 'trusted_certs' on Instance uuid 463034ff-14ce-477a-9642-4d86aa6f9cd9 {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:25:48 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-420f5d24-7d67-430b-bc5c-8b9bafd97386 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Acquiring lock "60a78556fb399ed4a41bc3ca4bccf77c96d8e811" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:25:48 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-420f5d24-7d67-430b-bc5c-8b9bafd97386 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Lock "60a78556fb399ed4a41bc3ca4bccf77c96d8e811" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.014s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:25:48 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-420f5d24-7d67-430b-bc5c-8b9bafd97386 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:25:49 user nova-compute[85141]: DEBUG nova.compute.provider_tree [None req-d1f13476-70ad-48db-946e-0f9083a06c8a tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] Inventory has not changed in ProviderTree for provider: bf8e0fa1-16b6-408f-9203-c4cd63916272 {{(pid=85141) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 10:25:49 user nova-compute[85141]: DEBUG nova.scheduler.client.report [None req-d1f13476-70ad-48db-946e-0f9083a06c8a tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] Inventory has not changed for provider bf8e0fa1-16b6-408f-9203-c4cd63916272 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=85141) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 10:25:49 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-d1f13476-70ad-48db-946e-0f9083a06c8a tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.709s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:25:49 user nova-compute[85141]: DEBUG nova.compute.manager [None req-d1f13476-70ad-48db-946e-0f9083a06c8a tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] [instance: 9fcf8335-9e6f-4878-a3e2-c68aeab0978e] Start building networks asynchronously for instance. {{(pid=85141) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 10:25:49 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-420f5d24-7d67-430b-bc5c-8b9bafd97386 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json" returned: 0 in 0.178s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:25:49 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-420f5d24-7d67-430b-bc5c-8b9bafd97386 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811,backing_fmt=raw /opt/stack/data/nova/instances/463034ff-14ce-477a-9642-4d86aa6f9cd9/disk.rescue {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:25:49 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-420f5d24-7d67-430b-bc5c-8b9bafd97386 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811,backing_fmt=raw /opt/stack/data/nova/instances/463034ff-14ce-477a-9642-4d86aa6f9cd9/disk.rescue" returned: 0 in 0.050s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:25:49 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-420f5d24-7d67-430b-bc5c-8b9bafd97386 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Lock "60a78556fb399ed4a41bc3ca4bccf77c96d8e811" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.232s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:25:49 user nova-compute[85141]: DEBUG nova.objects.instance [None req-420f5d24-7d67-430b-bc5c-8b9bafd97386 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Lazy-loading 'migration_context' on Instance uuid 463034ff-14ce-477a-9642-4d86aa6f9cd9 {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:25:49 user nova-compute[85141]: DEBUG nova.objects.base [None req-420f5d24-7d67-430b-bc5c-8b9bafd97386 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Object Instance<463034ff-14ce-477a-9642-4d86aa6f9cd9> lazy-loaded attributes: trusted_certs,migration_context {{(pid=85141) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 10:25:49 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-420f5d24-7d67-430b-bc5c-8b9bafd97386 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] [instance: 463034ff-14ce-477a-9642-4d86aa6f9cd9] Created local disks {{(pid=85141) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 10:25:49 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-420f5d24-7d67-430b-bc5c-8b9bafd97386 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] [instance: 463034ff-14ce-477a-9642-4d86aa6f9cd9] Start _get_guest_xml network_info=[{"id": "121bbc09-53cf-4586-8585-655079b4c49b", "address": "fa:16:3e:b0:77:d5", "network": {"id": "5b67a3fd-ef1e-4f2c-b6e0-31766ef39d30", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2137186235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-2137186235-network", "vif_mac": "fa:16:3e:b0:77:d5"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09b520de67ac4290a4b779f50afeb1a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap121bbc09-53", "ovs_interfaceid": "121bbc09-53cf-4586-8585-655079b4c49b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T10:06:42Z,direct_url=<?>,disk_format='qcow2',id=bc4ca70f-a459-4d5c-a9e6-80f1948eb48b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1044631a5fe84ce8904864a7024049fa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T10:06:44Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'bc4ca70f-a459-4d5c-a9e6-80f1948eb48b', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=85141) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 10:25:49 user nova-compute[85141]: DEBUG nova.objects.instance [None req-420f5d24-7d67-430b-bc5c-8b9bafd97386 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Lazy-loading 'resources' on Instance uuid 463034ff-14ce-477a-9642-4d86aa6f9cd9 {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:25:49 user nova-compute[85141]: DEBUG nova.compute.manager [None req-d1f13476-70ad-48db-946e-0f9083a06c8a tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] [instance: 9fcf8335-9e6f-4878-a3e2-c68aeab0978e] Allocating IP information in the background. {{(pid=85141) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 10:25:49 user nova-compute[85141]: DEBUG nova.network.neutron [None req-d1f13476-70ad-48db-946e-0f9083a06c8a tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] [instance: 9fcf8335-9e6f-4878-a3e2-c68aeab0978e] allocate_for_instance() {{(pid=85141) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 10:25:49 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-d1f13476-70ad-48db-946e-0f9083a06c8a tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] [instance: 9fcf8335-9e6f-4878-a3e2-c68aeab0978e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 10:25:49 user nova-compute[85141]: DEBUG nova.compute.manager [None req-d1f13476-70ad-48db-946e-0f9083a06c8a tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] [instance: 9fcf8335-9e6f-4878-a3e2-c68aeab0978e] Start building block device mappings for instance. {{(pid=85141) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 10:25:49 user nova-compute[85141]: DEBUG nova.objects.base [None req-420f5d24-7d67-430b-bc5c-8b9bafd97386 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Object Instance<463034ff-14ce-477a-9642-4d86aa6f9cd9> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=85141) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 10:25:49 user nova-compute[85141]: DEBUG nova.objects.instance [None req-420f5d24-7d67-430b-bc5c-8b9bafd97386 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Lazy-loading 'numa_topology' on Instance uuid 463034ff-14ce-477a-9642-4d86aa6f9cd9 {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:25:49 user nova-compute[85141]: DEBUG nova.policy [None req-d1f13476-70ad-48db-946e-0f9083a06c8a tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a7b52c2f46234602ae4925447a7d39a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79e4ebd46b4243c09f88927532b610f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85141) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 10:25:49 user nova-compute[85141]: DEBUG nova.objects.base [None req-420f5d24-7d67-430b-bc5c-8b9bafd97386 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Object Instance<463034ff-14ce-477a-9642-4d86aa6f9cd9> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=85141) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 10:25:49 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-420f5d24-7d67-430b-bc5c-8b9bafd97386 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:25:49 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-420f5d24-7d67-430b-bc5c-8b9bafd97386 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:25:49 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-420f5d24-7d67-430b-bc5c-8b9bafd97386 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=85141) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 10:25:49 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-420f5d24-7d67-430b-bc5c-8b9bafd97386 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] CPU controller missing on host. {{(pid=85141) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 10:25:49 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-420f5d24-7d67-430b-bc5c-8b9bafd97386 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=85141) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 10:25:49 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-420f5d24-7d67-430b-bc5c-8b9bafd97386 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] CPU controller found on host. {{(pid=85141) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 10:25:49 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-420f5d24-7d67-430b-bc5c-8b9bafd97386 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=85141) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 10:25:49 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-420f5d24-7d67-430b-bc5c-8b9bafd97386 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T10:06:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T10:06:42Z,direct_url=<?>,disk_format='qcow2',id=bc4ca70f-a459-4d5c-a9e6-80f1948eb48b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1044631a5fe84ce8904864a7024049fa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T10:06:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 10:25:49 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-420f5d24-7d67-430b-bc5c-8b9bafd97386 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Flavor limits 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 10:25:49 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-420f5d24-7d67-430b-bc5c-8b9bafd97386 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Image limits 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 10:25:49 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-420f5d24-7d67-430b-bc5c-8b9bafd97386 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Flavor pref 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 10:25:49 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-420f5d24-7d67-430b-bc5c-8b9bafd97386 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Image pref 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 10:25:49 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-420f5d24-7d67-430b-bc5c-8b9bafd97386 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 10:25:49 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-420f5d24-7d67-430b-bc5c-8b9bafd97386 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 10:25:49 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-420f5d24-7d67-430b-bc5c-8b9bafd97386 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=85141) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 10:25:49 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-420f5d24-7d67-430b-bc5c-8b9bafd97386 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Got 1 possible topologies {{(pid=85141) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 10:25:49 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-420f5d24-7d67-430b-bc5c-8b9bafd97386 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 10:25:49 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-420f5d24-7d67-430b-bc5c-8b9bafd97386 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 10:25:49 user nova-compute[85141]: DEBUG nova.objects.instance [None req-420f5d24-7d67-430b-bc5c-8b9bafd97386 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Lazy-loading 'vcpu_model' on Instance uuid 463034ff-14ce-477a-9642-4d86aa6f9cd9 {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:25:49 user nova-compute[85141]: DEBUG nova.objects.base [None req-420f5d24-7d67-430b-bc5c-8b9bafd97386 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Object Instance<463034ff-14ce-477a-9642-4d86aa6f9cd9> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=85141) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 10:25:49 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-420f5d24-7d67-430b-bc5c-8b9bafd97386 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T10:23:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-574895759',display_name='tempest-ServerRescueNegativeTestJSON-server-574895759',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-574895759',id=30,image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPy9eDkAgUcYCfTGhKLJIwUDyptUWD0jpoBJdtiaupfL19VFNXv7ziT8DtfeHqgz7E4YFUN6fJXfeX4wrZlUO//q/m/KCWJdqM1qmRa4ROfNjPo1wV8qmxBxFoKuN0LXfA==',key_name='tempest-keypair-392930711',keypairs=<?>,launch_index=0,launched_at=2023-11-16T10:23:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='09b520de67ac4290a4b779f50afeb1a4',ramdisk_id='',reservation_id='r-a1f5xtl2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-2068988845',owner_user_name='tempest-ServerRescueNegativeTestJSON-2068988845-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T10:23:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='76d4eaf5cef745c3bf3ae07068338b1a',uuid=463034ff-14ce-477a-9642-4d86aa6f9cd9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "121bbc09-53cf-4586-8585-655079b4c49b", "address": "fa:16:3e:b0:77:d5", "network": {"id": "5b67a3fd-ef1e-4f2c-b6e0-31766ef39d30", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2137186235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-2137186235-network", "vif_mac": "fa:16:3e:b0:77:d5"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09b520de67ac4290a4b779f50afeb1a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap121bbc09-53", "ovs_interfaceid": "121bbc09-53cf-4586-8585-655079b4c49b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=85141) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 10:25:49 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-420f5d24-7d67-430b-bc5c-8b9bafd97386 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Converting VIF {"id": "121bbc09-53cf-4586-8585-655079b4c49b", "address": "fa:16:3e:b0:77:d5", "network": {"id": "5b67a3fd-ef1e-4f2c-b6e0-31766ef39d30", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2137186235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-2137186235-network", "vif_mac": "fa:16:3e:b0:77:d5"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09b520de67ac4290a4b779f50afeb1a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap121bbc09-53", "ovs_interfaceid": "121bbc09-53cf-4586-8585-655079b4c49b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:25:49 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-420f5d24-7d67-430b-bc5c-8b9bafd97386 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b0:77:d5,bridge_name='br-int',has_traffic_filtering=True,id=121bbc09-53cf-4586-8585-655079b4c49b,network=Network(5b67a3fd-ef1e-4f2c-b6e0-31766ef39d30),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap121bbc09-53') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:25:49 user nova-compute[85141]: DEBUG nova.objects.instance [None req-420f5d24-7d67-430b-bc5c-8b9bafd97386 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Lazy-loading 'pci_devices' on Instance uuid 463034ff-14ce-477a-9642-4d86aa6f9cd9 {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:25:49 user nova-compute[85141]: DEBUG nova.compute.manager [None req-d1f13476-70ad-48db-946e-0f9083a06c8a tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] [instance: 9fcf8335-9e6f-4878-a3e2-c68aeab0978e] Start spawning the instance on the hypervisor. {{(pid=85141) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 10:25:49 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-d1f13476-70ad-48db-946e-0f9083a06c8a tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] [instance: 9fcf8335-9e6f-4878-a3e2-c68aeab0978e] Creating instance directory {{(pid=85141) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 10:25:49 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-d1f13476-70ad-48db-946e-0f9083a06c8a tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] [instance: 9fcf8335-9e6f-4878-a3e2-c68aeab0978e] Creating image(s)
Nov 16 10:25:49 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-d1f13476-70ad-48db-946e-0f9083a06c8a tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] Acquiring lock "/opt/stack/data/nova/instances/9fcf8335-9e6f-4878-a3e2-c68aeab0978e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:25:49 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-d1f13476-70ad-48db-946e-0f9083a06c8a tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] Lock "/opt/stack/data/nova/instances/9fcf8335-9e6f-4878-a3e2-c68aeab0978e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:25:49 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-d1f13476-70ad-48db-946e-0f9083a06c8a tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] Lock "/opt/stack/data/nova/instances/9fcf8335-9e6f-4878-a3e2-c68aeab0978e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:25:49 user nova-compute[85141]: DEBUG nova.objects.base [None req-420f5d24-7d67-430b-bc5c-8b9bafd97386 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Object Instance<463034ff-14ce-477a-9642-4d86aa6f9cd9> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=85141) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 10:25:49 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-420f5d24-7d67-430b-bc5c-8b9bafd97386 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] [instance: 463034ff-14ce-477a-9642-4d86aa6f9cd9] End _get_guest_xml xml=<domain type="kvm">
Nov 16 10:25:49 user nova-compute[85141]:   <uuid>463034ff-14ce-477a-9642-4d86aa6f9cd9</uuid>
Nov 16 10:25:49 user nova-compute[85141]:   <name>instance-0000001e</name>
Nov 16 10:25:49 user nova-compute[85141]:   <memory>524288</memory>
Nov 16 10:25:49 user nova-compute[85141]:   <vcpu>1</vcpu>
Nov 16 10:25:49 user nova-compute[85141]:   <metadata>
Nov 16 10:25:49 user nova-compute[85141]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 10:25:49 user nova-compute[85141]:       <nova:package version="0.0.0"/>
Nov 16 10:25:49 user nova-compute[85141]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-574895759</nova:name>
Nov 16 10:25:49 user nova-compute[85141]:       <nova:creationTime>2023-11-16 10:25:49</nova:creationTime>
Nov 16 10:25:49 user nova-compute[85141]:       <nova:flavor name="m1.tiny">
Nov 16 10:25:49 user nova-compute[85141]:         <nova:memory>512</nova:memory>
Nov 16 10:25:49 user nova-compute[85141]:         <nova:disk>1</nova:disk>
Nov 16 10:25:49 user nova-compute[85141]:         <nova:swap>0</nova:swap>
Nov 16 10:25:49 user nova-compute[85141]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 10:25:49 user nova-compute[85141]:         <nova:vcpus>1</nova:vcpus>
Nov 16 10:25:49 user nova-compute[85141]:       </nova:flavor>
Nov 16 10:25:49 user nova-compute[85141]:       <nova:owner>
Nov 16 10:25:49 user nova-compute[85141]:         <nova:user uuid="76d4eaf5cef745c3bf3ae07068338b1a">tempest-ServerRescueNegativeTestJSON-2068988845-project-member</nova:user>
Nov 16 10:25:49 user nova-compute[85141]:         <nova:project uuid="09b520de67ac4290a4b779f50afeb1a4">tempest-ServerRescueNegativeTestJSON-2068988845</nova:project>
Nov 16 10:25:49 user nova-compute[85141]:       </nova:owner>
Nov 16 10:25:49 user nova-compute[85141]:       <nova:root type="image" uuid="bc4ca70f-a459-4d5c-a9e6-80f1948eb48b"/>
Nov 16 10:25:49 user nova-compute[85141]:       <nova:ports>
Nov 16 10:25:49 user nova-compute[85141]:         <nova:port uuid="121bbc09-53cf-4586-8585-655079b4c49b">
Nov 16 10:25:49 user nova-compute[85141]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 16 10:25:49 user nova-compute[85141]:         </nova:port>
Nov 16 10:25:49 user nova-compute[85141]:       </nova:ports>
Nov 16 10:25:49 user nova-compute[85141]:     </nova:instance>
Nov 16 10:25:49 user nova-compute[85141]:   </metadata>
Nov 16 10:25:49 user nova-compute[85141]:   <sysinfo type="smbios">
Nov 16 10:25:49 user nova-compute[85141]:     <system>
Nov 16 10:25:49 user nova-compute[85141]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 10:25:49 user nova-compute[85141]:       <entry name="product">OpenStack Nova</entry>
Nov 16 10:25:49 user nova-compute[85141]:       <entry name="version">0.0.0</entry>
Nov 16 10:25:49 user nova-compute[85141]:       <entry name="serial">463034ff-14ce-477a-9642-4d86aa6f9cd9</entry>
Nov 16 10:25:49 user nova-compute[85141]:       <entry name="uuid">463034ff-14ce-477a-9642-4d86aa6f9cd9</entry>
Nov 16 10:25:49 user nova-compute[85141]:       <entry name="family">Virtual Machine</entry>
Nov 16 10:25:49 user nova-compute[85141]:     </system>
Nov 16 10:25:49 user nova-compute[85141]:   </sysinfo>
Nov 16 10:25:49 user nova-compute[85141]:   <os>
Nov 16 10:25:49 user nova-compute[85141]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 10:25:49 user nova-compute[85141]:     <smbios mode="sysinfo"/>
Nov 16 10:25:49 user nova-compute[85141]:   </os>
Nov 16 10:25:49 user nova-compute[85141]:   <features>
Nov 16 10:25:49 user nova-compute[85141]:     <acpi/>
Nov 16 10:25:49 user nova-compute[85141]:     <apic/>
Nov 16 10:25:49 user nova-compute[85141]:     <vmcoreinfo/>
Nov 16 10:25:49 user nova-compute[85141]:   </features>
Nov 16 10:25:49 user nova-compute[85141]:   <clock offset="utc">
Nov 16 10:25:49 user nova-compute[85141]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 10:25:49 user nova-compute[85141]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 10:25:49 user nova-compute[85141]:     <timer name="hpet" present="no"/>
Nov 16 10:25:49 user nova-compute[85141]:   </clock>
Nov 16 10:25:49 user nova-compute[85141]:   <cpu mode="custom" match="exact">
Nov 16 10:25:49 user nova-compute[85141]:     <model>Nehalem</model>
Nov 16 10:25:49 user nova-compute[85141]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 10:25:49 user nova-compute[85141]:   </cpu>
Nov 16 10:25:49 user nova-compute[85141]:   <devices>
Nov 16 10:25:49 user nova-compute[85141]:     <disk type="file" device="disk">
Nov 16 10:25:49 user nova-compute[85141]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 10:25:49 user nova-compute[85141]:       <source file="/opt/stack/data/nova/instances/463034ff-14ce-477a-9642-4d86aa6f9cd9/disk.rescue"/>
Nov 16 10:25:49 user nova-compute[85141]:       <target dev="vda" bus="virtio"/>
Nov 16 10:25:49 user nova-compute[85141]:     </disk>
Nov 16 10:25:49 user nova-compute[85141]:     <disk type="file" device="disk">
Nov 16 10:25:49 user nova-compute[85141]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 10:25:49 user nova-compute[85141]:       <source file="/opt/stack/data/nova/instances/463034ff-14ce-477a-9642-4d86aa6f9cd9/disk"/>
Nov 16 10:25:49 user nova-compute[85141]:       <target dev="vdb" bus="virtio"/>
Nov 16 10:25:49 user nova-compute[85141]:     </disk>
Nov 16 10:25:49 user nova-compute[85141]:     <interface type="ethernet">
Nov 16 10:25:49 user nova-compute[85141]:       <mac address="fa:16:3e:b0:77:d5"/>
Nov 16 10:25:49 user nova-compute[85141]:       <model type="virtio"/>
Nov 16 10:25:49 user nova-compute[85141]:       <mtu size="1442"/>
Nov 16 10:25:49 user nova-compute[85141]:       <target dev="tap121bbc09-53"/>
Nov 16 10:25:49 user nova-compute[85141]:     </interface>
Nov 16 10:25:49 user nova-compute[85141]:     <serial type="pty">
Nov 16 10:25:49 user nova-compute[85141]:       <log file="/opt/stack/data/nova/instances/463034ff-14ce-477a-9642-4d86aa6f9cd9/console.log" append="off"/>
Nov 16 10:25:49 user nova-compute[85141]:     </serial>
Nov 16 10:25:49 user nova-compute[85141]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 10:25:49 user nova-compute[85141]:     <video>
Nov 16 10:25:49 user nova-compute[85141]:       <model type="virtio"/>
Nov 16 10:25:49 user nova-compute[85141]:     </video>
Nov 16 10:25:49 user nova-compute[85141]:     <rng model="virtio">
Nov 16 10:25:49 user nova-compute[85141]:       <backend model="random">/dev/urandom</backend>
Nov 16 10:25:49 user nova-compute[85141]:     </rng>
Nov 16 10:25:49 user nova-compute[85141]:     <controller type="usb" index="0" model="none"/>
Nov 16 10:25:49 user nova-compute[85141]:     <memballoon model="virtio">
Nov 16 10:25:49 user nova-compute[85141]:       <stats period="10"/>
Nov 16 10:25:49 user nova-compute[85141]:     </memballoon>
Nov 16 10:25:49 user nova-compute[85141]:   </devices>
Nov 16 10:25:49 user nova-compute[85141]: </domain>
Nov 16 10:25:49 user nova-compute[85141]:  {{(pid=85141) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 10:25:49 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-d1f13476-70ad-48db-946e-0f9083a06c8a tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:25:49 user nova-compute[85141]: INFO nova.virt.libvirt.driver [-] [instance: 463034ff-14ce-477a-9642-4d86aa6f9cd9] Instance destroyed successfully.
Nov 16 10:25:49 user nova-compute[85141]: DEBUG nova.compute.manager [None req-1d02d19c-a2d5-4207-8a1a-b5d38f99487a tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] [instance: 0b388b98-4e65-4258-bbe2-77e699321fb7] Instance event wait completed in 0 seconds for  {{(pid=85141) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 10:25:49 user nova-compute[85141]: INFO nova.virt.libvirt.driver [-] [instance: 0b388b98-4e65-4258-bbe2-77e699321fb7] Instance rebooted successfully.
Nov 16 10:25:49 user nova-compute[85141]: DEBUG nova.compute.manager [None req-1d02d19c-a2d5-4207-8a1a-b5d38f99487a tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] [instance: 0b388b98-4e65-4258-bbe2-77e699321fb7] Checking state {{(pid=85141) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 10:25:49 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-420f5d24-7d67-430b-bc5c-8b9bafd97386 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] No BDM found with device name vda, not building metadata. {{(pid=85141) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 10:25:49 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-420f5d24-7d67-430b-bc5c-8b9bafd97386 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] No BDM found with device name vdb, not building metadata. {{(pid=85141) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 10:25:49 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-420f5d24-7d67-430b-bc5c-8b9bafd97386 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] No VIF found with MAC fa:16:3e:b0:77:d5, not building metadata {{(pid=85141) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 10:25:49 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-d1f13476-70ad-48db-946e-0f9083a06c8a tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json" returned: 0 in 0.190s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:25:49 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-d1f13476-70ad-48db-946e-0f9083a06c8a tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] Acquiring lock "60a78556fb399ed4a41bc3ca4bccf77c96d8e811" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:25:49 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-d1f13476-70ad-48db-946e-0f9083a06c8a tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] Lock "60a78556fb399ed4a41bc3ca4bccf77c96d8e811" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:25:49 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-d1f13476-70ad-48db-946e-0f9083a06c8a tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:25:49 user nova-compute[85141]: DEBUG nova.compute.manager [req-5c084d07-8da8-4d22-aacd-ff6117c3d8d5 req-cbb4983a-1be0-4584-aba1-267f8b2c5c7b service nova] [instance: 0b388b98-4e65-4258-bbe2-77e699321fb7] Received event network-vif-plugged-3ed9d2a6-c028-4b75-9023-95b1cfa982b6 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:25:49 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-5c084d07-8da8-4d22-aacd-ff6117c3d8d5 req-cbb4983a-1be0-4584-aba1-267f8b2c5c7b service nova] Acquiring lock "0b388b98-4e65-4258-bbe2-77e699321fb7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:25:49 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-5c084d07-8da8-4d22-aacd-ff6117c3d8d5 req-cbb4983a-1be0-4584-aba1-267f8b2c5c7b service nova] Lock "0b388b98-4e65-4258-bbe2-77e699321fb7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:25:49 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-5c084d07-8da8-4d22-aacd-ff6117c3d8d5 req-cbb4983a-1be0-4584-aba1-267f8b2c5c7b service nova] Lock "0b388b98-4e65-4258-bbe2-77e699321fb7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:25:49 user nova-compute[85141]: DEBUG nova.compute.manager [req-5c084d07-8da8-4d22-aacd-ff6117c3d8d5 req-cbb4983a-1be0-4584-aba1-267f8b2c5c7b service nova] [instance: 0b388b98-4e65-4258-bbe2-77e699321fb7] No waiting events found dispatching network-vif-plugged-3ed9d2a6-c028-4b75-9023-95b1cfa982b6 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:25:49 user nova-compute[85141]: WARNING nova.compute.manager [req-5c084d07-8da8-4d22-aacd-ff6117c3d8d5 req-cbb4983a-1be0-4584-aba1-267f8b2c5c7b service nova] [instance: 0b388b98-4e65-4258-bbe2-77e699321fb7] Received unexpected event network-vif-plugged-3ed9d2a6-c028-4b75-9023-95b1cfa982b6 for instance with vm_state active and task_state None.
Nov 16 10:25:49 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-d1f13476-70ad-48db-946e-0f9083a06c8a tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json" returned: 0 in 0.192s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:25:49 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-d1f13476-70ad-48db-946e-0f9083a06c8a tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811,backing_fmt=raw /opt/stack/data/nova/instances/9fcf8335-9e6f-4878-a3e2-c68aeab0978e/disk 1073741824 {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:25:49 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-d1f13476-70ad-48db-946e-0f9083a06c8a tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811,backing_fmt=raw /opt/stack/data/nova/instances/9fcf8335-9e6f-4878-a3e2-c68aeab0978e/disk 1073741824" returned: 0 in 0.060s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:25:49 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-d1f13476-70ad-48db-946e-0f9083a06c8a tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] Lock "60a78556fb399ed4a41bc3ca4bccf77c96d8e811" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.258s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:25:49 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-d1f13476-70ad-48db-946e-0f9083a06c8a tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:25:49 user nova-compute[85141]: DEBUG nova.network.neutron [None req-d1f13476-70ad-48db-946e-0f9083a06c8a tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] [instance: 9fcf8335-9e6f-4878-a3e2-c68aeab0978e] Successfully created port: 956ab401-d2c8-4b62-a0ba-9ccb12bf449c {{(pid=85141) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 10:25:50 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-d1f13476-70ad-48db-946e-0f9083a06c8a tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json" returned: 0 in 0.192s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:25:50 user nova-compute[85141]: DEBUG nova.virt.disk.api [None req-d1f13476-70ad-48db-946e-0f9083a06c8a tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9fcf8335-9e6f-4878-a3e2-c68aeab0978e/disk. size=1073741824 {{(pid=85141) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 10:25:50 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-d1f13476-70ad-48db-946e-0f9083a06c8a tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fcf8335-9e6f-4878-a3e2-c68aeab0978e/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:25:50 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:25:50 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-d1f13476-70ad-48db-946e-0f9083a06c8a tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fcf8335-9e6f-4878-a3e2-c68aeab0978e/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:25:50 user nova-compute[85141]: DEBUG nova.virt.disk.api [None req-d1f13476-70ad-48db-946e-0f9083a06c8a tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] Cannot resize image /opt/stack/data/nova/instances/9fcf8335-9e6f-4878-a3e2-c68aeab0978e/disk to a smaller size. {{(pid=85141) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 10:25:50 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-d1f13476-70ad-48db-946e-0f9083a06c8a tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] [instance: 9fcf8335-9e6f-4878-a3e2-c68aeab0978e] Created local disks {{(pid=85141) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 10:25:50 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-d1f13476-70ad-48db-946e-0f9083a06c8a tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] [instance: 9fcf8335-9e6f-4878-a3e2-c68aeab0978e] Ensure instance console log exists: /opt/stack/data/nova/instances/9fcf8335-9e6f-4878-a3e2-c68aeab0978e/console.log {{(pid=85141) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 10:25:50 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-d1f13476-70ad-48db-946e-0f9083a06c8a tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:25:50 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-d1f13476-70ad-48db-946e-0f9083a06c8a tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:25:50 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-d1f13476-70ad-48db-946e-0f9083a06c8a tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:25:50 user nova-compute[85141]: DEBUG nova.compute.manager [req-fed84ca2-44f2-4552-8a75-8be532f46eb8 req-8bd42b7d-e381-4698-9c82-2edbad7bbf12 service nova] [instance: 463034ff-14ce-477a-9642-4d86aa6f9cd9] Received event network-vif-plugged-121bbc09-53cf-4586-8585-655079b4c49b {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:25:50 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-fed84ca2-44f2-4552-8a75-8be532f46eb8 req-8bd42b7d-e381-4698-9c82-2edbad7bbf12 service nova] Acquiring lock "463034ff-14ce-477a-9642-4d86aa6f9cd9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:25:50 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-fed84ca2-44f2-4552-8a75-8be532f46eb8 req-8bd42b7d-e381-4698-9c82-2edbad7bbf12 service nova] Lock "463034ff-14ce-477a-9642-4d86aa6f9cd9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:25:50 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-fed84ca2-44f2-4552-8a75-8be532f46eb8 req-8bd42b7d-e381-4698-9c82-2edbad7bbf12 service nova] Lock "463034ff-14ce-477a-9642-4d86aa6f9cd9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:25:50 user nova-compute[85141]: DEBUG nova.compute.manager [req-fed84ca2-44f2-4552-8a75-8be532f46eb8 req-8bd42b7d-e381-4698-9c82-2edbad7bbf12 service nova] [instance: 463034ff-14ce-477a-9642-4d86aa6f9cd9] No waiting events found dispatching network-vif-plugged-121bbc09-53cf-4586-8585-655079b4c49b {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:25:50 user nova-compute[85141]: WARNING nova.compute.manager [req-fed84ca2-44f2-4552-8a75-8be532f46eb8 req-8bd42b7d-e381-4698-9c82-2edbad7bbf12 service nova] [instance: 463034ff-14ce-477a-9642-4d86aa6f9cd9] Received unexpected event network-vif-plugged-121bbc09-53cf-4586-8585-655079b4c49b for instance with vm_state active and task_state rescuing.
Nov 16 10:25:50 user nova-compute[85141]: DEBUG nova.network.neutron [None req-d1f13476-70ad-48db-946e-0f9083a06c8a tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] [instance: 9fcf8335-9e6f-4878-a3e2-c68aeab0978e] Successfully updated port: 956ab401-d2c8-4b62-a0ba-9ccb12bf449c {{(pid=85141) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 10:25:50 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-d1f13476-70ad-48db-946e-0f9083a06c8a tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] Acquiring lock "refresh_cache-9fcf8335-9e6f-4878-a3e2-c68aeab0978e" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:25:50 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-d1f13476-70ad-48db-946e-0f9083a06c8a tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] Acquired lock "refresh_cache-9fcf8335-9e6f-4878-a3e2-c68aeab0978e" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:25:50 user nova-compute[85141]: DEBUG nova.network.neutron [None req-d1f13476-70ad-48db-946e-0f9083a06c8a tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] [instance: 9fcf8335-9e6f-4878-a3e2-c68aeab0978e] Building network info cache for instance {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 10:25:50 user nova-compute[85141]: DEBUG nova.network.neutron [None req-d1f13476-70ad-48db-946e-0f9083a06c8a tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] [instance: 9fcf8335-9e6f-4878-a3e2-c68aeab0978e] Instance cache missing network info. {{(pid=85141) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 10:25:50 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:25:50 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:25:50 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:25:51 user nova-compute[85141]: DEBUG nova.network.neutron [None req-d1f13476-70ad-48db-946e-0f9083a06c8a tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] [instance: 9fcf8335-9e6f-4878-a3e2-c68aeab0978e] Updating instance_info_cache with network_info: [{"id": "956ab401-d2c8-4b62-a0ba-9ccb12bf449c", "address": "fa:16:3e:76:76:a8", "network": {"id": "a75d923b-3849-49c0-ba13-f8b356efda8f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1113409976-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79e4ebd46b4243c09f88927532b610f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap956ab401-d2", "ovs_interfaceid": "956ab401-d2c8-4b62-a0ba-9ccb12bf449c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:25:51 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-d1f13476-70ad-48db-946e-0f9083a06c8a tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] Releasing lock "refresh_cache-9fcf8335-9e6f-4878-a3e2-c68aeab0978e" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:25:51 user nova-compute[85141]: DEBUG nova.compute.manager [None req-d1f13476-70ad-48db-946e-0f9083a06c8a tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] [instance: 9fcf8335-9e6f-4878-a3e2-c68aeab0978e] Instance network_info: |[{"id": "956ab401-d2c8-4b62-a0ba-9ccb12bf449c", "address": "fa:16:3e:76:76:a8", "network": {"id": "a75d923b-3849-49c0-ba13-f8b356efda8f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1113409976-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79e4ebd46b4243c09f88927532b610f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap956ab401-d2", "ovs_interfaceid": "956ab401-d2c8-4b62-a0ba-9ccb12bf449c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=85141) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 10:25:51 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-d1f13476-70ad-48db-946e-0f9083a06c8a tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] [instance: 9fcf8335-9e6f-4878-a3e2-c68aeab0978e] Start _get_guest_xml network_info=[{"id": "956ab401-d2c8-4b62-a0ba-9ccb12bf449c", "address": "fa:16:3e:76:76:a8", "network": {"id": "a75d923b-3849-49c0-ba13-f8b356efda8f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1113409976-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79e4ebd46b4243c09f88927532b610f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap956ab401-d2", "ovs_interfaceid": "956ab401-d2c8-4b62-a0ba-9ccb12bf449c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T10:06:42Z,direct_url=<?>,disk_format='qcow2',id=bc4ca70f-a459-4d5c-a9e6-80f1948eb48b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1044631a5fe84ce8904864a7024049fa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T10:06:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_options': None, 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'image_id': 'bc4ca70f-a459-4d5c-a9e6-80f1948eb48b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=85141) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 10:25:51 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-d1f13476-70ad-48db-946e-0f9083a06c8a tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:25:51 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-d1f13476-70ad-48db-946e-0f9083a06c8a tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:25:51 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-d1f13476-70ad-48db-946e-0f9083a06c8a tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=85141) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 10:25:51 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-d1f13476-70ad-48db-946e-0f9083a06c8a tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] CPU controller missing on host. {{(pid=85141) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 10:25:51 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-d1f13476-70ad-48db-946e-0f9083a06c8a tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=85141) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 10:25:51 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-d1f13476-70ad-48db-946e-0f9083a06c8a tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] CPU controller found on host. {{(pid=85141) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 10:25:51 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-d1f13476-70ad-48db-946e-0f9083a06c8a tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=85141) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 10:25:51 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-d1f13476-70ad-48db-946e-0f9083a06c8a tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T10:06:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T10:06:42Z,direct_url=<?>,disk_format='qcow2',id=bc4ca70f-a459-4d5c-a9e6-80f1948eb48b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1044631a5fe84ce8904864a7024049fa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T10:06:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 10:25:51 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-d1f13476-70ad-48db-946e-0f9083a06c8a tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] Flavor limits 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 10:25:51 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-d1f13476-70ad-48db-946e-0f9083a06c8a tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] Image limits 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 10:25:51 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-d1f13476-70ad-48db-946e-0f9083a06c8a tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] Flavor pref 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 10:25:51 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-d1f13476-70ad-48db-946e-0f9083a06c8a tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] Image pref 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 10:25:51 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-d1f13476-70ad-48db-946e-0f9083a06c8a tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 10:25:51 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-d1f13476-70ad-48db-946e-0f9083a06c8a tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 10:25:51 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-d1f13476-70ad-48db-946e-0f9083a06c8a tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=85141) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 10:25:51 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-d1f13476-70ad-48db-946e-0f9083a06c8a tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] Got 1 possible topologies {{(pid=85141) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 10:25:51 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-d1f13476-70ad-48db-946e-0f9083a06c8a tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 10:25:51 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-d1f13476-70ad-48db-946e-0f9083a06c8a tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 10:25:51 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-d1f13476-70ad-48db-946e-0f9083a06c8a tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T10:25:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1384833831',display_name='tempest-ServersNegativeTestJSON-server-1384833831',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1384833831',id=36,image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='79e4ebd46b4243c09f88927532b610f0',ramdisk_id='',reservation_id='r-hla8voaz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1452286076',owner_user_name='tempest-ServersNegativeTestJSON-1452286076-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T10:25:49Z,user_data=None,user_id='a7b52c2f46234602ae4925447a7d39a0',uuid=9fcf8335-9e6f-4878-a3e2-c68aeab0978e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "956ab401-d2c8-4b62-a0ba-9ccb12bf449c", "address": "fa:16:3e:76:76:a8", "network": {"id": "a75d923b-3849-49c0-ba13-f8b356efda8f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1113409976-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79e4ebd46b4243c09f88927532b610f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap956ab401-d2", "ovs_interfaceid": "956ab401-d2c8-4b62-a0ba-9ccb12bf449c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=85141) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 10:25:51 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-d1f13476-70ad-48db-946e-0f9083a06c8a tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] Converting VIF {"id": "956ab401-d2c8-4b62-a0ba-9ccb12bf449c", "address": "fa:16:3e:76:76:a8", "network": {"id": "a75d923b-3849-49c0-ba13-f8b356efda8f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1113409976-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79e4ebd46b4243c09f88927532b610f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap956ab401-d2", "ovs_interfaceid": "956ab401-d2c8-4b62-a0ba-9ccb12bf449c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:25:51 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-d1f13476-70ad-48db-946e-0f9083a06c8a tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:76:a8,bridge_name='br-int',has_traffic_filtering=True,id=956ab401-d2c8-4b62-a0ba-9ccb12bf449c,network=Network(a75d923b-3849-49c0-ba13-f8b356efda8f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap956ab401-d2') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:25:51 user nova-compute[85141]: DEBUG nova.objects.instance [None req-d1f13476-70ad-48db-946e-0f9083a06c8a tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] Lazy-loading 'pci_devices' on Instance uuid 9fcf8335-9e6f-4878-a3e2-c68aeab0978e {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:25:51 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-d1f13476-70ad-48db-946e-0f9083a06c8a tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] [instance: 9fcf8335-9e6f-4878-a3e2-c68aeab0978e] End _get_guest_xml xml=<domain type="kvm">
Nov 16 10:25:51 user nova-compute[85141]:   <uuid>9fcf8335-9e6f-4878-a3e2-c68aeab0978e</uuid>
Nov 16 10:25:51 user nova-compute[85141]:   <name>instance-00000024</name>
Nov 16 10:25:51 user nova-compute[85141]:   <memory>524288</memory>
Nov 16 10:25:51 user nova-compute[85141]:   <vcpu>1</vcpu>
Nov 16 10:25:51 user nova-compute[85141]:   <metadata>
Nov 16 10:25:51 user nova-compute[85141]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 10:25:51 user nova-compute[85141]:       <nova:package version="0.0.0"/>
Nov 16 10:25:51 user nova-compute[85141]:       <nova:name>tempest-ServersNegativeTestJSON-server-1384833831</nova:name>
Nov 16 10:25:51 user nova-compute[85141]:       <nova:creationTime>2023-11-16 10:25:51</nova:creationTime>
Nov 16 10:25:51 user nova-compute[85141]:       <nova:flavor name="m1.tiny">
Nov 16 10:25:51 user nova-compute[85141]:         <nova:memory>512</nova:memory>
Nov 16 10:25:51 user nova-compute[85141]:         <nova:disk>1</nova:disk>
Nov 16 10:25:51 user nova-compute[85141]:         <nova:swap>0</nova:swap>
Nov 16 10:25:51 user nova-compute[85141]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 10:25:51 user nova-compute[85141]:         <nova:vcpus>1</nova:vcpus>
Nov 16 10:25:51 user nova-compute[85141]:       </nova:flavor>
Nov 16 10:25:51 user nova-compute[85141]:       <nova:owner>
Nov 16 10:25:51 user nova-compute[85141]:         <nova:user uuid="a7b52c2f46234602ae4925447a7d39a0">tempest-ServersNegativeTestJSON-1452286076-project-member</nova:user>
Nov 16 10:25:51 user nova-compute[85141]:         <nova:project uuid="79e4ebd46b4243c09f88927532b610f0">tempest-ServersNegativeTestJSON-1452286076</nova:project>
Nov 16 10:25:51 user nova-compute[85141]:       </nova:owner>
Nov 16 10:25:51 user nova-compute[85141]:       <nova:root type="image" uuid="bc4ca70f-a459-4d5c-a9e6-80f1948eb48b"/>
Nov 16 10:25:51 user nova-compute[85141]:       <nova:ports>
Nov 16 10:25:51 user nova-compute[85141]:         <nova:port uuid="956ab401-d2c8-4b62-a0ba-9ccb12bf449c">
Nov 16 10:25:51 user nova-compute[85141]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 16 10:25:51 user nova-compute[85141]:         </nova:port>
Nov 16 10:25:51 user nova-compute[85141]:       </nova:ports>
Nov 16 10:25:51 user nova-compute[85141]:     </nova:instance>
Nov 16 10:25:51 user nova-compute[85141]:   </metadata>
Nov 16 10:25:51 user nova-compute[85141]:   <sysinfo type="smbios">
Nov 16 10:25:51 user nova-compute[85141]:     <system>
Nov 16 10:25:51 user nova-compute[85141]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 10:25:51 user nova-compute[85141]:       <entry name="product">OpenStack Nova</entry>
Nov 16 10:25:51 user nova-compute[85141]:       <entry name="version">0.0.0</entry>
Nov 16 10:25:51 user nova-compute[85141]:       <entry name="serial">9fcf8335-9e6f-4878-a3e2-c68aeab0978e</entry>
Nov 16 10:25:51 user nova-compute[85141]:       <entry name="uuid">9fcf8335-9e6f-4878-a3e2-c68aeab0978e</entry>
Nov 16 10:25:51 user nova-compute[85141]:       <entry name="family">Virtual Machine</entry>
Nov 16 10:25:51 user nova-compute[85141]:     </system>
Nov 16 10:25:51 user nova-compute[85141]:   </sysinfo>
Nov 16 10:25:51 user nova-compute[85141]:   <os>
Nov 16 10:25:51 user nova-compute[85141]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 10:25:51 user nova-compute[85141]:     <boot dev="hd"/>
Nov 16 10:25:51 user nova-compute[85141]:     <smbios mode="sysinfo"/>
Nov 16 10:25:51 user nova-compute[85141]:   </os>
Nov 16 10:25:51 user nova-compute[85141]:   <features>
Nov 16 10:25:51 user nova-compute[85141]:     <acpi/>
Nov 16 10:25:51 user nova-compute[85141]:     <apic/>
Nov 16 10:25:51 user nova-compute[85141]:     <vmcoreinfo/>
Nov 16 10:25:51 user nova-compute[85141]:   </features>
Nov 16 10:25:51 user nova-compute[85141]:   <clock offset="utc">
Nov 16 10:25:51 user nova-compute[85141]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 10:25:51 user nova-compute[85141]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 10:25:51 user nova-compute[85141]:     <timer name="hpet" present="no"/>
Nov 16 10:25:51 user nova-compute[85141]:   </clock>
Nov 16 10:25:51 user nova-compute[85141]:   <cpu mode="custom" match="exact">
Nov 16 10:25:51 user nova-compute[85141]:     <model>Nehalem</model>
Nov 16 10:25:51 user nova-compute[85141]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 10:25:51 user nova-compute[85141]:   </cpu>
Nov 16 10:25:51 user nova-compute[85141]:   <devices>
Nov 16 10:25:51 user nova-compute[85141]:     <disk type="file" device="disk">
Nov 16 10:25:51 user nova-compute[85141]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 10:25:51 user nova-compute[85141]:       <source file="/opt/stack/data/nova/instances/9fcf8335-9e6f-4878-a3e2-c68aeab0978e/disk"/>
Nov 16 10:25:51 user nova-compute[85141]:       <target dev="vda" bus="virtio"/>
Nov 16 10:25:51 user nova-compute[85141]:     </disk>
Nov 16 10:25:51 user nova-compute[85141]:     <interface type="ethernet">
Nov 16 10:25:51 user nova-compute[85141]:       <mac address="fa:16:3e:76:76:a8"/>
Nov 16 10:25:51 user nova-compute[85141]:       <model type="virtio"/>
Nov 16 10:25:51 user nova-compute[85141]:       <mtu size="1442"/>
Nov 16 10:25:51 user nova-compute[85141]:       <target dev="tap956ab401-d2"/>
Nov 16 10:25:51 user nova-compute[85141]:     </interface>
Nov 16 10:25:51 user nova-compute[85141]:     <serial type="pty">
Nov 16 10:25:51 user nova-compute[85141]:       <log file="/opt/stack/data/nova/instances/9fcf8335-9e6f-4878-a3e2-c68aeab0978e/console.log" append="off"/>
Nov 16 10:25:51 user nova-compute[85141]:     </serial>
Nov 16 10:25:51 user nova-compute[85141]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 10:25:51 user nova-compute[85141]:     <video>
Nov 16 10:25:51 user nova-compute[85141]:       <model type="virtio"/>
Nov 16 10:25:51 user nova-compute[85141]:     </video>
Nov 16 10:25:51 user nova-compute[85141]:     <rng model="virtio">
Nov 16 10:25:51 user nova-compute[85141]:       <backend model="random">/dev/urandom</backend>
Nov 16 10:25:51 user nova-compute[85141]:     </rng>
Nov 16 10:25:51 user nova-compute[85141]:     <controller type="usb" index="0" model="none"/>
Nov 16 10:25:51 user nova-compute[85141]:     <memballoon model="virtio">
Nov 16 10:25:51 user nova-compute[85141]:       <stats period="10"/>
Nov 16 10:25:51 user nova-compute[85141]:     </memballoon>
Nov 16 10:25:51 user nova-compute[85141]:   </devices>
Nov 16 10:25:51 user nova-compute[85141]: </domain>
Nov 16 10:25:51 user nova-compute[85141]:  {{(pid=85141) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 10:25:51 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-d1f13476-70ad-48db-946e-0f9083a06c8a tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T10:25:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1384833831',display_name='tempest-ServersNegativeTestJSON-server-1384833831',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1384833831',id=36,image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='79e4ebd46b4243c09f88927532b610f0',ramdisk_id='',reservation_id='r-hla8voaz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1452286076',owner_user_name='tempest-ServersNegativeTestJSON-1452286076-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T10:25:49Z,user_data=None,user_id='a7b52c2f46234602ae4925447a7d39a0',uuid=9fcf8335-9e6f-4878-a3e2-c68aeab0978e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "956ab401-d2c8-4b62-a0ba-9ccb12bf449c", "address": "fa:16:3e:76:76:a8", "network": {"id": "a75d923b-3849-49c0-ba13-f8b356efda8f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1113409976-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79e4ebd46b4243c09f88927532b610f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap956ab401-d2", "ovs_interfaceid": "956ab401-d2c8-4b62-a0ba-9ccb12bf449c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 10:25:51 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-d1f13476-70ad-48db-946e-0f9083a06c8a tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] Converting VIF {"id": "956ab401-d2c8-4b62-a0ba-9ccb12bf449c", "address": "fa:16:3e:76:76:a8", "network": {"id": "a75d923b-3849-49c0-ba13-f8b356efda8f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1113409976-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79e4ebd46b4243c09f88927532b610f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap956ab401-d2", "ovs_interfaceid": "956ab401-d2c8-4b62-a0ba-9ccb12bf449c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:25:51 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-d1f13476-70ad-48db-946e-0f9083a06c8a tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:76:a8,bridge_name='br-int',has_traffic_filtering=True,id=956ab401-d2c8-4b62-a0ba-9ccb12bf449c,network=Network(a75d923b-3849-49c0-ba13-f8b356efda8f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap956ab401-d2') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:25:51 user nova-compute[85141]: DEBUG os_vif [None req-d1f13476-70ad-48db-946e-0f9083a06c8a tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:76:a8,bridge_name='br-int',has_traffic_filtering=True,id=956ab401-d2c8-4b62-a0ba-9ccb12bf449c,network=Network(a75d923b-3849-49c0-ba13-f8b356efda8f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap956ab401-d2') {{(pid=85141) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 10:25:51 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:25:51 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:25:51 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 10:25:51 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:25:51 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '10a7ace4-6b8c-5bdf-8627-d461d44009d4', '_type': 'linux-noop'}}, row=False) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:25:51 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:25:51 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:25:51 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:25:51 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap956ab401-d2, may_exist=True, interface_attrs={}) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:25:51 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap956ab401-d2, col_values=(('qos', UUID('348ea113-4db0-4699-b6c8-8b6d59bb00d9')),), if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:25:51 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap956ab401-d2, col_values=(('external_ids', {'iface-id': '956ab401-d2c8-4b62-a0ba-9ccb12bf449c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:76:76:a8', 'vm-uuid': '9fcf8335-9e6f-4878-a3e2-c68aeab0978e'}),), if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:25:51 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:25:51 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:25:51 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:25:51 user nova-compute[85141]: INFO os_vif [None req-d1f13476-70ad-48db-946e-0f9083a06c8a tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:76:a8,bridge_name='br-int',has_traffic_filtering=True,id=956ab401-d2c8-4b62-a0ba-9ccb12bf449c,network=Network(a75d923b-3849-49c0-ba13-f8b356efda8f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap956ab401-d2')
Nov 16 10:25:51 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:25:51 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:25:51 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-d1f13476-70ad-48db-946e-0f9083a06c8a tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] No BDM found with device name vda, not building metadata. {{(pid=85141) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 10:25:51 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-d1f13476-70ad-48db-946e-0f9083a06c8a tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] No VIF found with MAC fa:16:3e:76:76:a8, not building metadata {{(pid=85141) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 10:25:51 user nova-compute[85141]: DEBUG nova.compute.manager [req-f74b9324-7fa3-45be-890f-f6715ad8e8cb req-5b0c3e17-2a44-49a5-8296-6b847db85e34 service nova] [instance: 9fcf8335-9e6f-4878-a3e2-c68aeab0978e] Received event network-changed-956ab401-d2c8-4b62-a0ba-9ccb12bf449c {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:25:51 user nova-compute[85141]: DEBUG nova.compute.manager [req-f74b9324-7fa3-45be-890f-f6715ad8e8cb req-5b0c3e17-2a44-49a5-8296-6b847db85e34 service nova] [instance: 9fcf8335-9e6f-4878-a3e2-c68aeab0978e] Refreshing instance network info cache due to event network-changed-956ab401-d2c8-4b62-a0ba-9ccb12bf449c. {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 10:25:51 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-f74b9324-7fa3-45be-890f-f6715ad8e8cb req-5b0c3e17-2a44-49a5-8296-6b847db85e34 service nova] Acquiring lock "refresh_cache-9fcf8335-9e6f-4878-a3e2-c68aeab0978e" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:25:51 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-f74b9324-7fa3-45be-890f-f6715ad8e8cb req-5b0c3e17-2a44-49a5-8296-6b847db85e34 service nova] Acquired lock "refresh_cache-9fcf8335-9e6f-4878-a3e2-c68aeab0978e" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:25:51 user nova-compute[85141]: DEBUG nova.network.neutron [req-f74b9324-7fa3-45be-890f-f6715ad8e8cb req-5b0c3e17-2a44-49a5-8296-6b847db85e34 service nova] [instance: 9fcf8335-9e6f-4878-a3e2-c68aeab0978e] Refreshing network info cache for port 956ab401-d2c8-4b62-a0ba-9ccb12bf449c {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 10:25:52 user nova-compute[85141]: DEBUG nova.network.neutron [req-f74b9324-7fa3-45be-890f-f6715ad8e8cb req-5b0c3e17-2a44-49a5-8296-6b847db85e34 service nova] [instance: 9fcf8335-9e6f-4878-a3e2-c68aeab0978e] Updated VIF entry in instance network info cache for port 956ab401-d2c8-4b62-a0ba-9ccb12bf449c. {{(pid=85141) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 10:25:52 user nova-compute[85141]: DEBUG nova.network.neutron [req-f74b9324-7fa3-45be-890f-f6715ad8e8cb req-5b0c3e17-2a44-49a5-8296-6b847db85e34 service nova] [instance: 9fcf8335-9e6f-4878-a3e2-c68aeab0978e] Updating instance_info_cache with network_info: [{"id": "956ab401-d2c8-4b62-a0ba-9ccb12bf449c", "address": "fa:16:3e:76:76:a8", "network": {"id": "a75d923b-3849-49c0-ba13-f8b356efda8f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1113409976-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79e4ebd46b4243c09f88927532b610f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap956ab401-d2", "ovs_interfaceid": "956ab401-d2c8-4b62-a0ba-9ccb12bf449c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:25:52 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-f74b9324-7fa3-45be-890f-f6715ad8e8cb req-5b0c3e17-2a44-49a5-8296-6b847db85e34 service nova] Releasing lock "refresh_cache-9fcf8335-9e6f-4878-a3e2-c68aeab0978e" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:25:52 user nova-compute[85141]: DEBUG nova.compute.manager [req-ede851a4-76dd-4cc7-8c5d-34f7cba56c2f req-9eb8adba-eb93-4c14-b13f-a530e41a12ee service nova] [instance: 463034ff-14ce-477a-9642-4d86aa6f9cd9] Received event network-vif-plugged-121bbc09-53cf-4586-8585-655079b4c49b {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:25:52 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-ede851a4-76dd-4cc7-8c5d-34f7cba56c2f req-9eb8adba-eb93-4c14-b13f-a530e41a12ee service nova] Acquiring lock "463034ff-14ce-477a-9642-4d86aa6f9cd9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:25:52 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-ede851a4-76dd-4cc7-8c5d-34f7cba56c2f req-9eb8adba-eb93-4c14-b13f-a530e41a12ee service nova] Lock "463034ff-14ce-477a-9642-4d86aa6f9cd9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:25:52 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-ede851a4-76dd-4cc7-8c5d-34f7cba56c2f req-9eb8adba-eb93-4c14-b13f-a530e41a12ee service nova] Lock "463034ff-14ce-477a-9642-4d86aa6f9cd9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:25:52 user nova-compute[85141]: DEBUG nova.compute.manager [req-ede851a4-76dd-4cc7-8c5d-34f7cba56c2f req-9eb8adba-eb93-4c14-b13f-a530e41a12ee service nova] [instance: 463034ff-14ce-477a-9642-4d86aa6f9cd9] No waiting events found dispatching network-vif-plugged-121bbc09-53cf-4586-8585-655079b4c49b {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:25:52 user nova-compute[85141]: WARNING nova.compute.manager [req-ede851a4-76dd-4cc7-8c5d-34f7cba56c2f req-9eb8adba-eb93-4c14-b13f-a530e41a12ee service nova] [instance: 463034ff-14ce-477a-9642-4d86aa6f9cd9] Received unexpected event network-vif-plugged-121bbc09-53cf-4586-8585-655079b4c49b for instance with vm_state active and task_state rescuing.
Nov 16 10:25:52 user nova-compute[85141]: DEBUG nova.compute.manager [req-ede851a4-76dd-4cc7-8c5d-34f7cba56c2f req-9eb8adba-eb93-4c14-b13f-a530e41a12ee service nova] [instance: 463034ff-14ce-477a-9642-4d86aa6f9cd9] Received event network-vif-plugged-121bbc09-53cf-4586-8585-655079b4c49b {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:25:52 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-ede851a4-76dd-4cc7-8c5d-34f7cba56c2f req-9eb8adba-eb93-4c14-b13f-a530e41a12ee service nova] Acquiring lock "463034ff-14ce-477a-9642-4d86aa6f9cd9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:25:52 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-ede851a4-76dd-4cc7-8c5d-34f7cba56c2f req-9eb8adba-eb93-4c14-b13f-a530e41a12ee service nova] Lock "463034ff-14ce-477a-9642-4d86aa6f9cd9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:25:52 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-ede851a4-76dd-4cc7-8c5d-34f7cba56c2f req-9eb8adba-eb93-4c14-b13f-a530e41a12ee service nova] Lock "463034ff-14ce-477a-9642-4d86aa6f9cd9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:25:52 user nova-compute[85141]: DEBUG nova.compute.manager [req-ede851a4-76dd-4cc7-8c5d-34f7cba56c2f req-9eb8adba-eb93-4c14-b13f-a530e41a12ee service nova] [instance: 463034ff-14ce-477a-9642-4d86aa6f9cd9] No waiting events found dispatching network-vif-plugged-121bbc09-53cf-4586-8585-655079b4c49b {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:25:52 user nova-compute[85141]: WARNING nova.compute.manager [req-ede851a4-76dd-4cc7-8c5d-34f7cba56c2f req-9eb8adba-eb93-4c14-b13f-a530e41a12ee service nova] [instance: 463034ff-14ce-477a-9642-4d86aa6f9cd9] Received unexpected event network-vif-plugged-121bbc09-53cf-4586-8585-655079b4c49b for instance with vm_state active and task_state rescuing.
Nov 16 10:25:52 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:25:52 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:25:52 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:25:52 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:25:53 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:25:53 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:25:53 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:25:53 user nova-compute[85141]: DEBUG nova.compute.manager [req-3989d7ec-f840-4720-8af3-4ac5fc2840f4 req-13b84fdb-f90f-437b-b678-123b4c5194c5 service nova] [instance: 9fcf8335-9e6f-4878-a3e2-c68aeab0978e] Received event network-vif-plugged-956ab401-d2c8-4b62-a0ba-9ccb12bf449c {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:25:53 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-3989d7ec-f840-4720-8af3-4ac5fc2840f4 req-13b84fdb-f90f-437b-b678-123b4c5194c5 service nova] Acquiring lock "9fcf8335-9e6f-4878-a3e2-c68aeab0978e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:25:53 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-3989d7ec-f840-4720-8af3-4ac5fc2840f4 req-13b84fdb-f90f-437b-b678-123b4c5194c5 service nova] Lock "9fcf8335-9e6f-4878-a3e2-c68aeab0978e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:25:53 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-3989d7ec-f840-4720-8af3-4ac5fc2840f4 req-13b84fdb-f90f-437b-b678-123b4c5194c5 service nova] Lock "9fcf8335-9e6f-4878-a3e2-c68aeab0978e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:25:53 user nova-compute[85141]: DEBUG nova.compute.manager [req-3989d7ec-f840-4720-8af3-4ac5fc2840f4 req-13b84fdb-f90f-437b-b678-123b4c5194c5 service nova] [instance: 9fcf8335-9e6f-4878-a3e2-c68aeab0978e] No waiting events found dispatching network-vif-plugged-956ab401-d2c8-4b62-a0ba-9ccb12bf449c {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:25:53 user nova-compute[85141]: WARNING nova.compute.manager [req-3989d7ec-f840-4720-8af3-4ac5fc2840f4 req-13b84fdb-f90f-437b-b678-123b4c5194c5 service nova] [instance: 9fcf8335-9e6f-4878-a3e2-c68aeab0978e] Received unexpected event network-vif-plugged-956ab401-d2c8-4b62-a0ba-9ccb12bf449c for instance with vm_state building and task_state spawning.
Nov 16 10:25:53 user nova-compute[85141]: DEBUG nova.compute.manager [None req-420f5d24-7d67-430b-bc5c-8b9bafd97386 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] [instance: 463034ff-14ce-477a-9642-4d86aa6f9cd9] Checking state {{(pid=85141) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 10:25:55 user nova-compute[85141]: DEBUG nova.compute.manager [req-482da32d-a301-4419-8362-162177c4b315 req-50eab31b-12f1-4eee-ab2f-b7aade397caa service nova] [instance: 9fcf8335-9e6f-4878-a3e2-c68aeab0978e] Received event network-vif-plugged-956ab401-d2c8-4b62-a0ba-9ccb12bf449c {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:25:55 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-482da32d-a301-4419-8362-162177c4b315 req-50eab31b-12f1-4eee-ab2f-b7aade397caa service nova] Acquiring lock "9fcf8335-9e6f-4878-a3e2-c68aeab0978e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:25:55 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-482da32d-a301-4419-8362-162177c4b315 req-50eab31b-12f1-4eee-ab2f-b7aade397caa service nova] Lock "9fcf8335-9e6f-4878-a3e2-c68aeab0978e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:25:55 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-482da32d-a301-4419-8362-162177c4b315 req-50eab31b-12f1-4eee-ab2f-b7aade397caa service nova] Lock "9fcf8335-9e6f-4878-a3e2-c68aeab0978e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:25:55 user nova-compute[85141]: DEBUG nova.compute.manager [req-482da32d-a301-4419-8362-162177c4b315 req-50eab31b-12f1-4eee-ab2f-b7aade397caa service nova] [instance: 9fcf8335-9e6f-4878-a3e2-c68aeab0978e] No waiting events found dispatching network-vif-plugged-956ab401-d2c8-4b62-a0ba-9ccb12bf449c {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:25:55 user nova-compute[85141]: WARNING nova.compute.manager [req-482da32d-a301-4419-8362-162177c4b315 req-50eab31b-12f1-4eee-ab2f-b7aade397caa service nova] [instance: 9fcf8335-9e6f-4878-a3e2-c68aeab0978e] Received unexpected event network-vif-plugged-956ab401-d2c8-4b62-a0ba-9ccb12bf449c for instance with vm_state building and task_state spawning.
Nov 16 10:25:55 user nova-compute[85141]: DEBUG nova.compute.manager [None req-d1f13476-70ad-48db-946e-0f9083a06c8a tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] [instance: 9fcf8335-9e6f-4878-a3e2-c68aeab0978e] Instance event wait completed in 0 seconds for  {{(pid=85141) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 10:25:55 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-d1f13476-70ad-48db-946e-0f9083a06c8a tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] [instance: 9fcf8335-9e6f-4878-a3e2-c68aeab0978e] Guest created on hypervisor {{(pid=85141) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 10:25:55 user nova-compute[85141]: INFO nova.virt.libvirt.driver [-] [instance: 9fcf8335-9e6f-4878-a3e2-c68aeab0978e] Instance spawned successfully.
Nov 16 10:25:55 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-d1f13476-70ad-48db-946e-0f9083a06c8a tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] [instance: 9fcf8335-9e6f-4878-a3e2-c68aeab0978e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 10:25:55 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-d1f13476-70ad-48db-946e-0f9083a06c8a tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] [instance: 9fcf8335-9e6f-4878-a3e2-c68aeab0978e] Found default for hw_cdrom_bus of ide {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:25:55 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-d1f13476-70ad-48db-946e-0f9083a06c8a tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] [instance: 9fcf8335-9e6f-4878-a3e2-c68aeab0978e] Found default for hw_disk_bus of virtio {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:25:55 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-d1f13476-70ad-48db-946e-0f9083a06c8a tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] [instance: 9fcf8335-9e6f-4878-a3e2-c68aeab0978e] Found default for hw_input_bus of None {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:25:55 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-d1f13476-70ad-48db-946e-0f9083a06c8a tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] [instance: 9fcf8335-9e6f-4878-a3e2-c68aeab0978e] Found default for hw_pointer_model of None {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:25:55 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-d1f13476-70ad-48db-946e-0f9083a06c8a tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] [instance: 9fcf8335-9e6f-4878-a3e2-c68aeab0978e] Found default for hw_video_model of virtio {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:25:55 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-d1f13476-70ad-48db-946e-0f9083a06c8a tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] [instance: 9fcf8335-9e6f-4878-a3e2-c68aeab0978e] Found default for hw_vif_model of virtio {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:25:55 user nova-compute[85141]: INFO nova.compute.manager [None req-d1f13476-70ad-48db-946e-0f9083a06c8a tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] [instance: 9fcf8335-9e6f-4878-a3e2-c68aeab0978e] Took 5.98 seconds to spawn the instance on the hypervisor.
Nov 16 10:25:55 user nova-compute[85141]: DEBUG nova.compute.manager [None req-d1f13476-70ad-48db-946e-0f9083a06c8a tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] [instance: 9fcf8335-9e6f-4878-a3e2-c68aeab0978e] Checking state {{(pid=85141) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 10:25:55 user nova-compute[85141]: INFO nova.compute.manager [None req-d1f13476-70ad-48db-946e-0f9083a06c8a tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] [instance: 9fcf8335-9e6f-4878-a3e2-c68aeab0978e] Took 7.14 seconds to build instance.
Nov 16 10:25:55 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-d1f13476-70ad-48db-946e-0f9083a06c8a tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] Lock "9fcf8335-9e6f-4878-a3e2-c68aeab0978e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.260s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:25:56 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:25:58 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:26:01 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:26:03 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:26:03 user nova-compute[85141]: DEBUG nova.compute.manager [req-10dcced6-dc23-4f07-92e5-0e04cc4c9eef req-1fb4e9dc-2b2b-4739-a9f8-b517c45bc316 service nova] [instance: d7dfe34a-f7ba-44b3-8898-634338161a23] Received event network-changed-401df940-fd58-48b0-89f4-5083130952d5 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:26:03 user nova-compute[85141]: DEBUG nova.compute.manager [req-10dcced6-dc23-4f07-92e5-0e04cc4c9eef req-1fb4e9dc-2b2b-4739-a9f8-b517c45bc316 service nova] [instance: d7dfe34a-f7ba-44b3-8898-634338161a23] Refreshing instance network info cache due to event network-changed-401df940-fd58-48b0-89f4-5083130952d5. {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 10:26:03 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-10dcced6-dc23-4f07-92e5-0e04cc4c9eef req-1fb4e9dc-2b2b-4739-a9f8-b517c45bc316 service nova] Acquiring lock "refresh_cache-d7dfe34a-f7ba-44b3-8898-634338161a23" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:26:03 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-10dcced6-dc23-4f07-92e5-0e04cc4c9eef req-1fb4e9dc-2b2b-4739-a9f8-b517c45bc316 service nova] Acquired lock "refresh_cache-d7dfe34a-f7ba-44b3-8898-634338161a23" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:26:03 user nova-compute[85141]: DEBUG nova.network.neutron [req-10dcced6-dc23-4f07-92e5-0e04cc4c9eef req-1fb4e9dc-2b2b-4739-a9f8-b517c45bc316 service nova] [instance: d7dfe34a-f7ba-44b3-8898-634338161a23] Refreshing network info cache for port 401df940-fd58-48b0-89f4-5083130952d5 {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 10:26:04 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5e4a634e-5df0-4282-ba53-d651287077a4 tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Acquiring lock "d7dfe34a-f7ba-44b3-8898-634338161a23" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:26:04 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5e4a634e-5df0-4282-ba53-d651287077a4 tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Lock "d7dfe34a-f7ba-44b3-8898-634338161a23" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:26:04 user nova-compute[85141]: DEBUG nova.objects.instance [None req-5e4a634e-5df0-4282-ba53-d651287077a4 tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Lazy-loading 'flavor' on Instance uuid d7dfe34a-f7ba-44b3-8898-634338161a23 {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:26:04 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-5e4a634e-5df0-4282-ba53-d651287077a4 tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] [instance: d7dfe34a-f7ba-44b3-8898-634338161a23] Ignoring supplied device name: /dev/vdb
Nov 16 10:26:04 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5e4a634e-5df0-4282-ba53-d651287077a4 tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Lock "d7dfe34a-f7ba-44b3-8898-634338161a23" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:26:04 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5e4a634e-5df0-4282-ba53-d651287077a4 tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Acquiring lock "d7dfe34a-f7ba-44b3-8898-634338161a23" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:26:04 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5e4a634e-5df0-4282-ba53-d651287077a4 tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Lock "d7dfe34a-f7ba-44b3-8898-634338161a23" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:26:04 user nova-compute[85141]: INFO nova.compute.manager [None req-5e4a634e-5df0-4282-ba53-d651287077a4 tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] [instance: d7dfe34a-f7ba-44b3-8898-634338161a23] Attaching volume b1957d79-bfb4-4f74-bc74-1d241b5254bc to /dev/vdb
Nov 16 10:26:04 user nova-compute[85141]: DEBUG nova.network.neutron [req-10dcced6-dc23-4f07-92e5-0e04cc4c9eef req-1fb4e9dc-2b2b-4739-a9f8-b517c45bc316 service nova] [instance: d7dfe34a-f7ba-44b3-8898-634338161a23] Updated VIF entry in instance network info cache for port 401df940-fd58-48b0-89f4-5083130952d5. {{(pid=85141) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 10:26:04 user nova-compute[85141]: DEBUG nova.network.neutron [req-10dcced6-dc23-4f07-92e5-0e04cc4c9eef req-1fb4e9dc-2b2b-4739-a9f8-b517c45bc316 service nova] [instance: d7dfe34a-f7ba-44b3-8898-634338161a23] Updating instance_info_cache with network_info: [{"id": "401df940-fd58-48b0-89f4-5083130952d5", "address": "fa:16:3e:1e:59:2e", "network": {"id": "d791d4f1-ec4b-4db3-ae9a-471f071206eb", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-369109742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a0984b7ef0346768c3231b9ab00fb57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap401df940-fd", "ovs_interfaceid": "401df940-fd58-48b0-89f4-5083130952d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:26:04 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-10dcced6-dc23-4f07-92e5-0e04cc4c9eef req-1fb4e9dc-2b2b-4739-a9f8-b517c45bc316 service nova] Releasing lock "refresh_cache-d7dfe34a-f7ba-44b3-8898-634338161a23" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:26:04 user nova-compute[85141]: DEBUG os_brick.utils [None req-5e4a634e-5df0-4282-ba53-d651287077a4 tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 10:26:04 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:26:04 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:26:04 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5b4f426-47de-498d-b699-469d16afa614]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c7834de5c295\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:26:04 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:26:04 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:26:04 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[495c26b3-397a-4f7f-892d-9959c85f05c4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:26:04 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:26:04 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:26:04 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[888db175-13ac-4f60-b1b2-954ffdfff7d7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:26:04 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[554ba9f1-9278-4af0-82b8-eabccab48085]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:26:04 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5e4a634e-5df0-4282-ba53-d651287077a4 tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Running cmd (subprocess): nvme version {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:26:04 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5e4a634e-5df0-4282-ba53-d651287077a4 tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] 'nvme version' failed. Not Retrying. {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 10:26:04 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5e4a634e-5df0-4282-ba53-d651287077a4 tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] nvme not present on system {{(pid=85141) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 10:26:04 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:26:04 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 10:26:04 user nova-compute[85141]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 10:26:04 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bbb165d-3c7e-4172-aaa7-2e4d01a767df]: (4, '') {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:26:04 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.lightos [None req-5e4a634e-5df0-4282-ba53-d651287077a4 tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=85141) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 10:26:04 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.lightos [None req-5e4a634e-5df0-4282-ba53-d651287077a4 tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=85141) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 10:26:04 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.lightos [None req-5e4a634e-5df0-4282-ba53-d651287077a4 tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] LIGHTOS: no hostnqn found. {{(pid=85141) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 10:26:04 user nova-compute[85141]: DEBUG os_brick.utils [None req-5e4a634e-5df0-4282-ba53-d651287077a4 tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c7834de5c295', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 10:26:04 user nova-compute[85141]: DEBUG nova.virt.block_device [None req-5e4a634e-5df0-4282-ba53-d651287077a4 tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] [instance: d7dfe34a-f7ba-44b3-8898-634338161a23] Updating existing volume attachment record: c3feaceb-42da-42c0-bb5b-6ae1c112590d {{(pid=85141) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 10:26:06 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:26:08 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:26:10 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5e4a634e-5df0-4282-ba53-d651287077a4 tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] [instance: d7dfe34a-f7ba-44b3-8898-634338161a23] Calling os-brick to attach iSCSI Volume {{(pid=85141) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 10:26:10 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e4a634e-5df0-4282-ba53-d651287077a4 tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51806b6080>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b1957d79-bfb4-4f74-bc74-1d241b5254bc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QYsfbKkd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 10:26:10 user nova-compute[85141]: WARNING os_brick.initiator.connectors.base [None req-5e4a634e-5df0-4282-ba53-d651287077a4 tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 10:26:10 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-5e4a634e-5df0-4282-ba53-d651287077a4 tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 10:26:10 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-5e4a634e-5df0-4282-ba53-d651287077a4 tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 10:26:10 user nova-compute[85141]: WARNING os_brick.initiator.connectors.base [None req-5e4a634e-5df0-4282-ba53-d651287077a4 tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 10:26:10 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-5e4a634e-5df0-4282-ba53-d651287077a4 tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b1957d79-bfb4-4f74-bc74-1d241b5254bc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 10:26:10 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-5e4a634e-5df0-4282-ba53-d651287077a4 tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b1957d79-bfb4-4f74-bc74-1d241b5254bc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 10:26:10 user nova-compute[85141]: INFO os_brick.initiator.connectors.iscsi [None req-5e4a634e-5df0-4282-ba53-d651287077a4 tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 10:26:10 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1957d79-bfb4-4f74-bc74-1d241b5254bc -p 172.16.0.220:3260 {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:26:10 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1957d79-bfb4-4f74-bc74-1d241b5254bc -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:26:10 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[903177eb-3fa1-499f-af5a-6bd38ab05e02]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:26:10 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e4a634e-5df0-4282-ba53-d651287077a4 tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 10:26:10 user nova-compute[85141]:  {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:26:10 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1957d79-bfb4-4f74-bc74-1d241b5254bc -p 172.16.0.220:3260 --interface default --op new {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:26:10 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1957d79-bfb4-4f74-bc74-1d241b5254bc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:26:10 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[11fbe3e8-0a17-4d59-aecd-b50a6b67d5d3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b1957d79-bfb4-4f74-bc74-1d241b5254bc] added\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:26:10 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e4a634e-5df0-4282-ba53-d651287077a4 tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b1957d79-bfb4-4f74-bc74-1d241b5254bc] added
Nov 16 10:26:10 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:26:10 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1957d79-bfb4-4f74-bc74-1d241b5254bc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:26:10 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1957d79-bfb4-4f74-bc74-1d241b5254bc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:26:10 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc7435d8-cb43-42af-969b-d6bcc3c8a742]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:26:10 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e4a634e-5df0-4282-ba53-d651287077a4 tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:26:10 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1957d79-bfb4-4f74-bc74-1d241b5254bc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:26:10 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1957d79-bfb4-4f74-bc74-1d241b5254bc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:26:10 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7a0c00c-0882-42b9-a225-4cacc8bffd58]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:26:10 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e4a634e-5df0-4282-ba53-d651287077a4 tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:26:10 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1957d79-bfb4-4f74-bc74-1d241b5254bc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QYsfbKkd {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:26:10 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1957d79-bfb4-4f74-bc74-1d241b5254bc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QYsfbKkd" returned: 0 in 0.018s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:26:10 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ab5c130-30d2-4aa4-9e02-2a312a7d5f8d]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:26:10 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e4a634e-5df0-4282-ba53-d651287077a4 tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QYsfbKkd'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:26:10 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1957d79-bfb4-4f74-bc74-1d241b5254bc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:26:10 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1957d79-bfb4-4f74-bc74-1d241b5254bc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:26:10 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[128046c1-9ab1-4199-b40a-aeb6a8332eb8]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:26:10 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e4a634e-5df0-4282-ba53-d651287077a4 tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:26:10 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:26:10 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:26:10 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[722b4890-9b11-47e7-881c-c1a980349da7]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11a6a15b-38c1-4e7e-b8fa-2feb6789e775 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bc0a873-d872-4f63-9af6-b4ac71162eeb (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2006a77c-e5e8-4ec5-8de5-a0f9505c429a (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb96bfcd-cecc-452f-bc3b-61b7daf72599 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b58025-0c18-41f6-a126-fb3c925399a1 (non-flash)\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:26:10 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e4a634e-5df0-4282-ba53-d651287077a4 tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)
Nov 16 10:26:10 user nova-compute[85141]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11a6a15b-38c1-4e7e-b8fa-2feb6789e775 (non-flash)
Nov 16 10:26:10 user nova-compute[85141]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bc0a873-d872-4f63-9af6-b4ac71162eeb (non-flash)
Nov 16 10:26:10 user nova-compute[85141]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2006a77c-e5e8-4ec5-8de5-a0f9505c429a (non-flash)
Nov 16 10:26:10 user nova-compute[85141]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb96bfcd-cecc-452f-bc3b-61b7daf72599 (non-flash)
Nov 16 10:26:10 user nova-compute[85141]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b58025-0c18-41f6-a126-fb3c925399a1 (non-flash)
Nov 16 10:26:10 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:26:10 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e4a634e-5df0-4282-ba53-d651287077a4 tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)
Nov 16 10:26:10 user nova-compute[85141]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11a6a15b-38c1-4e7e-b8fa-2feb6789e775 (non-flash)
Nov 16 10:26:10 user nova-compute[85141]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bc0a873-d872-4f63-9af6-b4ac71162eeb (non-flash)
Nov 16 10:26:10 user nova-compute[85141]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2006a77c-e5e8-4ec5-8de5-a0f9505c429a (non-flash)
Nov 16 10:26:10 user nova-compute[85141]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb96bfcd-cecc-452f-bc3b-61b7daf72599 (non-flash)
Nov 16 10:26:10 user nova-compute[85141]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b58025-0c18-41f6-a126-fb3c925399a1 (non-flash)
Nov 16 10:26:10 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 10:26:10 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1957d79-bfb4-4f74-bc74-1d241b5254bc -p 172.16.0.220:3260 --login {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:26:10 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1957d79-bfb4-4f74-bc74-1d241b5254bc -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:26:10 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[f38b8bd9-c01b-46d8-aef3-461c412af132]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b1957d79-bfb4-4f74-bc74-1d241b5254bc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b1957d79-bfb4-4f74-bc74-1d241b5254bc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:26:10 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e4a634e-5df0-4282-ba53-d651287077a4 tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b1957d79-bfb4-4f74-bc74-1d241b5254bc, portal: 172.16.0.220,3260]
Nov 16 10:26:10 user nova-compute[85141]: Login to [iface: default, target: iqn.2010-10.org.openstack:b1957d79-bfb4-4f74-bc74-1d241b5254bc, portal: 172.16.0.220,3260] successful.
Nov 16 10:26:10 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:26:10 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1957d79-bfb4-4f74-bc74-1d241b5254bc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:26:10 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1957d79-bfb4-4f74-bc74-1d241b5254bc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:26:10 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b898db1-65c9-4f0a-95e1-59ef22766c04]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:26:10 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e4a634e-5df0-4282-ba53-d651287077a4 tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:26:10 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:26:10 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:26:10 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[582c0687-ceec-4283-8e33-071bd7a7d814]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11a6a15b-38c1-4e7e-b8fa-2feb6789e775 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bc0a873-d872-4f63-9af6-b4ac71162eeb (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2006a77c-e5e8-4ec5-8de5-a0f9505c429a (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb96bfcd-cecc-452f-bc3b-61b7daf72599 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b58025-0c18-41f6-a126-fb3c925399a1 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1957d79-bfb4-4f74-bc74-1d241b5254bc (non-flash)\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:26:10 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e4a634e-5df0-4282-ba53-d651287077a4 tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)
Nov 16 10:26:10 user nova-compute[85141]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11a6a15b-38c1-4e7e-b8fa-2feb6789e775 (non-flash)
Nov 16 10:26:10 user nova-compute[85141]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bc0a873-d872-4f63-9af6-b4ac71162eeb (non-flash)
Nov 16 10:26:10 user nova-compute[85141]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2006a77c-e5e8-4ec5-8de5-a0f9505c429a (non-flash)
Nov 16 10:26:10 user nova-compute[85141]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb96bfcd-cecc-452f-bc3b-61b7daf72599 (non-flash)
Nov 16 10:26:10 user nova-compute[85141]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b58025-0c18-41f6-a126-fb3c925399a1 (non-flash)
Nov 16 10:26:10 user nova-compute[85141]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1957d79-bfb4-4f74-bc74-1d241b5254bc (non-flash)
Nov 16 10:26:10 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:26:10 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e4a634e-5df0-4282-ba53-d651287077a4 tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)
Nov 16 10:26:10 user nova-compute[85141]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11a6a15b-38c1-4e7e-b8fa-2feb6789e775 (non-flash)
Nov 16 10:26:10 user nova-compute[85141]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bc0a873-d872-4f63-9af6-b4ac71162eeb (non-flash)
Nov 16 10:26:10 user nova-compute[85141]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2006a77c-e5e8-4ec5-8de5-a0f9505c429a (non-flash)
Nov 16 10:26:10 user nova-compute[85141]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb96bfcd-cecc-452f-bc3b-61b7daf72599 (non-flash)
Nov 16 10:26:10 user nova-compute[85141]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b58025-0c18-41f6-a126-fb3c925399a1 (non-flash)
Nov 16 10:26:10 user nova-compute[85141]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1957d79-bfb4-4f74-bc74-1d241b5254bc (non-flash)
Nov 16 10:26:10 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 10:26:10 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-5e4a634e-5df0-4282-ba53-d651287077a4 tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b1957d79-bfb4-4f74-bc74-1d241b5254bc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.310s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 10:26:10 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e4a634e-5df0-4282-ba53-d651287077a4 tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Connected to 172.16.0.220:3260 {{(pid=85141) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 10:26:10 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-5e4a634e-5df0-4282-ba53-d651287077a4 tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] HCTL ('39', '-', '-', 0) found on session 40 with lun 0 {{(pid=85141) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 10:26:10 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-5e4a634e-5df0-4282-ba53-d651287077a4 tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=85141) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 10:26:10 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:26:10 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.016s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:26:10 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdfea1e4-7eaa-4a74-bd42-20132d61cb0c]: (4, ('- - 0', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:26:10 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-5e4a634e-5df0-4282-ba53-d651287077a4 tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Searching for a device in session 40 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=85141) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 10:26:10 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e4a634e-5df0-4282-ba53-d651287077a4 tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:b1957d79-bfb4-4f74-bc74-1d241b5254bc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QYsfbKkd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=85141) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 10:26:11 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:26:11 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-5e4a634e-5df0-4282-ba53-d651287077a4 tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.345s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 10:26:11 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e4a634e-5df0-4282-ba53-d651287077a4 tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] <== connect_volume: return (1347ms) {'type': 'block', 'scsi_wwn': '23566313064396664', 'path': '/dev/sdh'} {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 10:26:11 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5e4a634e-5df0-4282-ba53-d651287077a4 tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] [instance: d7dfe34a-f7ba-44b3-8898-634338161a23] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23566313064396664', 'path': '/dev/sdh'} {{(pid=85141) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 10:26:11 user nova-compute[85141]: DEBUG nova.objects.instance [None req-5e4a634e-5df0-4282-ba53-d651287077a4 tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Lazy-loading 'flavor' on Instance uuid d7dfe34a-f7ba-44b3-8898-634338161a23 {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:26:11 user nova-compute[85141]: DEBUG nova.virt.libvirt.guest [None req-5e4a634e-5df0-4282-ba53-d651287077a4 tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 10:26:11 user nova-compute[85141]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 10:26:11 user nova-compute[85141]:   <source dev="/dev/sdh"/>
Nov 16 10:26:11 user nova-compute[85141]:   <target dev="vdb" bus="virtio"/>
Nov 16 10:26:11 user nova-compute[85141]:   <serial>b1957d79-bfb4-4f74-bc74-1d241b5254bc</serial>
Nov 16 10:26:11 user nova-compute[85141]: </disk>
Nov 16 10:26:11 user nova-compute[85141]:  {{(pid=85141) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 10:26:11 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-5e4a634e-5df0-4282-ba53-d651287077a4 tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] No BDM found with device name vda, not building metadata. {{(pid=85141) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 10:26:11 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-5e4a634e-5df0-4282-ba53-d651287077a4 tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] No BDM found with device name vdb, not building metadata. {{(pid=85141) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 10:26:11 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-5e4a634e-5df0-4282-ba53-d651287077a4 tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] No VIF found with MAC fa:16:3e:1e:59:2e, not building metadata {{(pid=85141) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 10:26:12 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5e4a634e-5df0-4282-ba53-d651287077a4 tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Lock "d7dfe34a-f7ba-44b3-8898-634338161a23" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.566s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:26:13 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:26:16 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:26:18 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:26:21 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:26:23 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:26:24 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-7fea7c54-7e23-4ae4-8f40-9c63e7a438a7 tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Acquiring lock "d7dfe34a-f7ba-44b3-8898-634338161a23" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:26:24 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-7fea7c54-7e23-4ae4-8f40-9c63e7a438a7 tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Lock "d7dfe34a-f7ba-44b3-8898-634338161a23" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:26:24 user nova-compute[85141]: INFO nova.compute.manager [None req-7fea7c54-7e23-4ae4-8f40-9c63e7a438a7 tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] [instance: d7dfe34a-f7ba-44b3-8898-634338161a23] Detaching volume b1957d79-bfb4-4f74-bc74-1d241b5254bc
Nov 16 10:26:24 user nova-compute[85141]: INFO nova.virt.block_device [None req-7fea7c54-7e23-4ae4-8f40-9c63e7a438a7 tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] [instance: d7dfe34a-f7ba-44b3-8898-634338161a23] Attempting to driver detach volume b1957d79-bfb4-4f74-bc74-1d241b5254bc from mountpoint /dev/vdb
Nov 16 10:26:24 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-7fea7c54-7e23-4ae4-8f40-9c63e7a438a7 tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Attempting to detach device vdb from instance d7dfe34a-f7ba-44b3-8898-634338161a23 from the persistent domain config. {{(pid=85141) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 10:26:24 user nova-compute[85141]: DEBUG nova.virt.libvirt.guest [None req-7fea7c54-7e23-4ae4-8f40-9c63e7a438a7 tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 10:26:24 user nova-compute[85141]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 10:26:24 user nova-compute[85141]:   <source dev="/dev/sdh"/>
Nov 16 10:26:24 user nova-compute[85141]:   <target dev="vdb" bus="virtio"/>
Nov 16 10:26:24 user nova-compute[85141]:   <serial>b1957d79-bfb4-4f74-bc74-1d241b5254bc</serial>
Nov 16 10:26:24 user nova-compute[85141]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 10:26:24 user nova-compute[85141]: </disk>
Nov 16 10:26:24 user nova-compute[85141]:  {{(pid=85141) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 10:26:24 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-7fea7c54-7e23-4ae4-8f40-9c63e7a438a7 tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Successfully detached device vdb from instance d7dfe34a-f7ba-44b3-8898-634338161a23 from the persistent domain config.
Nov 16 10:26:24 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-7fea7c54-7e23-4ae4-8f40-9c63e7a438a7 tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d7dfe34a-f7ba-44b3-8898-634338161a23 from the live domain config. {{(pid=85141) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 10:26:24 user nova-compute[85141]: DEBUG nova.virt.libvirt.guest [None req-7fea7c54-7e23-4ae4-8f40-9c63e7a438a7 tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 10:26:24 user nova-compute[85141]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 10:26:24 user nova-compute[85141]:   <source dev="/dev/sdh"/>
Nov 16 10:26:24 user nova-compute[85141]:   <target dev="vdb" bus="virtio"/>
Nov 16 10:26:24 user nova-compute[85141]:   <serial>b1957d79-bfb4-4f74-bc74-1d241b5254bc</serial>
Nov 16 10:26:24 user nova-compute[85141]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 10:26:24 user nova-compute[85141]: </disk>
Nov 16 10:26:24 user nova-compute[85141]:  {{(pid=85141) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 10:26:24 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-9b69e743-af3c-42c0-bf95-e038fda377ce tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Acquiring lock "d7dfe34a-f7ba-44b3-8898-634338161a23" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:26:24 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-7fea7c54-7e23-4ae4-8f40-9c63e7a438a7 tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d7dfe34a-f7ba-44b3-8898-634338161a23 {{(pid=85141) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 10:26:26 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:26:28 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:26:28 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:26:29 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:26:30 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:26:30 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Cleaning up deleted instances with incomplete migration  {{(pid=85141) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 16 10:26:31 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:26:31 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:26:31 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Starting heal instance info cache {{(pid=85141) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 10:26:31 user nova-compute[85141]: INFO nova.compute.manager [None req-b4954a22-413a-41aa-8284-d435d267d5cc tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] [instance: abe5d4b7-a0d7-40e3-b630-0de746ddb55b] Unrescuing
Nov 16 10:26:31 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-b4954a22-413a-41aa-8284-d435d267d5cc tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Acquiring lock "refresh_cache-abe5d4b7-a0d7-40e3-b630-0de746ddb55b" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:26:31 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-b4954a22-413a-41aa-8284-d435d267d5cc tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Acquired lock "refresh_cache-abe5d4b7-a0d7-40e3-b630-0de746ddb55b" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:26:31 user nova-compute[85141]: DEBUG nova.network.neutron [None req-b4954a22-413a-41aa-8284-d435d267d5cc tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] [instance: abe5d4b7-a0d7-40e3-b630-0de746ddb55b] Building network info cache for instance {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 10:26:31 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-15f22e04-7381-4a43-a609-03a14e744788 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Acquiring lock "dfe84cd6-628a-484e-b266-34e2abe890f2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:26:31 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-15f22e04-7381-4a43-a609-03a14e744788 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Lock "dfe84cd6-628a-484e-b266-34e2abe890f2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:26:31 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-15f22e04-7381-4a43-a609-03a14e744788 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Acquiring lock "dfe84cd6-628a-484e-b266-34e2abe890f2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:26:31 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-15f22e04-7381-4a43-a609-03a14e744788 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Lock "dfe84cd6-628a-484e-b266-34e2abe890f2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:26:31 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-15f22e04-7381-4a43-a609-03a14e744788 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Lock "dfe84cd6-628a-484e-b266-34e2abe890f2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:26:31 user nova-compute[85141]: INFO nova.compute.manager [None req-15f22e04-7381-4a43-a609-03a14e744788 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: dfe84cd6-628a-484e-b266-34e2abe890f2] Terminating instance
Nov 16 10:26:31 user nova-compute[85141]: DEBUG nova.compute.manager [None req-15f22e04-7381-4a43-a609-03a14e744788 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: dfe84cd6-628a-484e-b266-34e2abe890f2] Start destroying the instance on the hypervisor. {{(pid=85141) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 10:26:31 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Acquiring lock "refresh_cache-059d6974-bd0c-4f73-91fc-8202ebda4238" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:26:31 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Acquired lock "refresh_cache-059d6974-bd0c-4f73-91fc-8202ebda4238" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:26:31 user nova-compute[85141]: DEBUG nova.network.neutron [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] [instance: 059d6974-bd0c-4f73-91fc-8202ebda4238] Forcefully refreshing network info cache for instance {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 10:26:31 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:26:31 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:26:31 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:26:31 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:26:32 user nova-compute[85141]: INFO nova.virt.libvirt.driver [-] [instance: dfe84cd6-628a-484e-b266-34e2abe890f2] Instance destroyed successfully.
Nov 16 10:26:32 user nova-compute[85141]: DEBUG nova.objects.instance [None req-15f22e04-7381-4a43-a609-03a14e744788 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Lazy-loading 'resources' on Instance uuid dfe84cd6-628a-484e-b266-34e2abe890f2 {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:26:32 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-15f22e04-7381-4a43-a609-03a14e744788 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T10:24:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-821229199',display_name='tempest-TestVolumeBootPattern-server-821229199',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-821229199',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-16T10:24:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='aec3bb9fe5e6446590900b5adf65df0f',ramdisk_id='',reservation_id='r-ls7raevm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1979039357',owner_user_name='tempest-TestVolumeBootPattern-1979039357-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T10:24:55Z,user_data=None,user_id='7261b57c36904fcda87a9ea32d4b5b31',uuid=dfe84cd6-628a-484e-b266-34e2abe890f2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e3463cf8-10c0-4465-95d8-28248f06c3c1", "address": "fa:16:3e:66:21:97", "network": {"id": "b8ada47f-9721-4358-ac4f-0305f06dbbb8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1663922860-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aec3bb9fe5e6446590900b5adf65df0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3463cf8-10", "ovs_interfaceid": "e3463cf8-10c0-4465-95d8-28248f06c3c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 10:26:32 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-15f22e04-7381-4a43-a609-03a14e744788 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Converting VIF {"id": "e3463cf8-10c0-4465-95d8-28248f06c3c1", "address": "fa:16:3e:66:21:97", "network": {"id": "b8ada47f-9721-4358-ac4f-0305f06dbbb8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1663922860-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aec3bb9fe5e6446590900b5adf65df0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3463cf8-10", "ovs_interfaceid": "e3463cf8-10c0-4465-95d8-28248f06c3c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:26:32 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-15f22e04-7381-4a43-a609-03a14e744788 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:66:21:97,bridge_name='br-int',has_traffic_filtering=True,id=e3463cf8-10c0-4465-95d8-28248f06c3c1,network=Network(b8ada47f-9721-4358-ac4f-0305f06dbbb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3463cf8-10') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:26:32 user nova-compute[85141]: DEBUG os_vif [None req-15f22e04-7381-4a43-a609-03a14e744788 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:21:97,bridge_name='br-int',has_traffic_filtering=True,id=e3463cf8-10c0-4465-95d8-28248f06c3c1,network=Network(b8ada47f-9721-4358-ac4f-0305f06dbbb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3463cf8-10') {{(pid=85141) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 10:26:32 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:26:32 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape3463cf8-10, bridge=br-int, if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:26:32 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:26:32 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:26:32 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:26:32 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=847d8c3e-55c7-4874-9601-4e8aa3a81efb) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:26:32 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:26:32 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:26:32 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:26:32 user nova-compute[85141]: INFO os_vif [None req-15f22e04-7381-4a43-a609-03a14e744788 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:21:97,bridge_name='br-int',has_traffic_filtering=True,id=e3463cf8-10c0-4465-95d8-28248f06c3c1,network=Network(b8ada47f-9721-4358-ac4f-0305f06dbbb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3463cf8-10')
Nov 16 10:26:32 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-15f22e04-7381-4a43-a609-03a14e744788 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: dfe84cd6-628a-484e-b266-34e2abe890f2] calling os-brick to detach iSCSI Volume {{(pid=85141) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 10:26:32 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-15f22e04-7381-4a43-a609-03a14e744788 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51806b6080>, {'target_iqn': 'iqn.2010-10.org.openstack:9bc0a873-d872-4f63-9af6-b4ac71162eeb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jxsmXgGt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 10:26:32 user nova-compute[85141]: WARNING os_brick.initiator.connectors.base [None req-15f22e04-7381-4a43-a609-03a14e744788 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 10:26:32 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-15f22e04-7381-4a43-a609-03a14e744788 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 10:26:32 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-15f22e04-7381-4a43-a609-03a14e744788 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 10:26:32 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:26:32 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:26:32 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b67e3d6-3320-45e4-b1e5-1f8c924dd15c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:bb96bfcd-cecc-452f-bc3b-61b7daf72599\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b1957d79-bfb4-4f74-bc74-1d241b5254bc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:11a6a15b-38c1-4e7e-b8fa-2feb6789e775\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9bc0a873-d872-4f63-9af6-b4ac71162eeb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e1b58025-0c18-41f6-a126-fb3c925399a1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2006a77c-e5e8-4ec5-8de5-a0f9505c429a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:26:32 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-15f22e04-7381-4a43-a609-03a14e744788 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 10:26:32 user nova-compute[85141]: No targets found.
Nov 16 10:26:32 user nova-compute[85141]: iSNS:
Nov 16 10:26:32 user nova-compute[85141]: No targets found.
Nov 16 10:26:32 user nova-compute[85141]: STATIC:
Nov 16 10:26:32 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:bb96bfcd-cecc-452f-bc3b-61b7daf72599
Nov 16 10:26:32 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:26:32 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:26:32 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:b1957d79-bfb4-4f74-bc74-1d241b5254bc
Nov 16 10:26:32 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:26:32 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:26:32 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee
Nov 16 10:26:32 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:26:32 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:26:32 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:11a6a15b-38c1-4e7e-b8fa-2feb6789e775
Nov 16 10:26:32 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:26:32 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:26:32 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:9bc0a873-d872-4f63-9af6-b4ac71162eeb
Nov 16 10:26:32 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:26:32 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:26:32 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:e1b58025-0c18-41f6-a126-fb3c925399a1
Nov 16 10:26:32 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:26:32 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:26:32 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:2006a77c-e5e8-4ec5-8de5-a0f9505c429a
Nov 16 10:26:32 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:26:32 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:26:32 user nova-compute[85141]: FIRMWARE:
Nov 16 10:26:32 user nova-compute[85141]: No targets found.
Nov 16 10:26:32 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:26:32 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-15f22e04-7381-4a43-a609-03a14e744788 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 10:26:32 user nova-compute[85141]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 10:26:32 user nova-compute[85141]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=85141) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 10:26:32 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-15f22e04-7381-4a43-a609-03a14e744788 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9bc0a873-d872-4f63-9af6-b4ac71162eeb', 0)] {{(pid=85141) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 10:26:32 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:26:32 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:26:32 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[eca06339-d2fb-46ec-bdc5-025707883f10]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:11a6a15b-38c1-4e7e-b8fa-2feb6789e775\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2006a77c-e5e8-4ec5-8de5-a0f9505c429a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9bc0a873-d872-4f63-9af6-b4ac71162eeb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b1957d79-bfb4-4f74-bc74-1d241b5254bc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bb96bfcd-cecc-452f-bc3b-61b7daf72599\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e1b58025-0c18-41f6-a126-fb3c925399a1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:26:32 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:26:32 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.041s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:26:32 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[fde21504-60ad-4a4b-a9aa-09dc17e230d3]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11a6a15b-38c1-4e7e-b8fa-2feb6789e775 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bc0a873-d872-4f63-9af6-b4ac71162eeb (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2006a77c-e5e8-4ec5-8de5-a0f9505c429a (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb96bfcd-cecc-452f-bc3b-61b7daf72599 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b58025-0c18-41f6-a126-fb3c925399a1 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1957d79-bfb4-4f74-bc74-1d241b5254bc (non-flash)\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:26:32 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-15f22e04-7381-4a43-a609-03a14e744788 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)
Nov 16 10:26:32 user nova-compute[85141]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11a6a15b-38c1-4e7e-b8fa-2feb6789e775 (non-flash)
Nov 16 10:26:32 user nova-compute[85141]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bc0a873-d872-4f63-9af6-b4ac71162eeb (non-flash)
Nov 16 10:26:32 user nova-compute[85141]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2006a77c-e5e8-4ec5-8de5-a0f9505c429a (non-flash)
Nov 16 10:26:32 user nova-compute[85141]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb96bfcd-cecc-452f-bc3b-61b7daf72599 (non-flash)
Nov 16 10:26:32 user nova-compute[85141]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b58025-0c18-41f6-a126-fb3c925399a1 (non-flash)
Nov 16 10:26:32 user nova-compute[85141]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1957d79-bfb4-4f74-bc74-1d241b5254bc (non-flash)
Nov 16 10:26:32 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:26:32 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-15f22e04-7381-4a43-a609-03a14e744788 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)
Nov 16 10:26:32 user nova-compute[85141]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11a6a15b-38c1-4e7e-b8fa-2feb6789e775 (non-flash)
Nov 16 10:26:32 user nova-compute[85141]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bc0a873-d872-4f63-9af6-b4ac71162eeb (non-flash)
Nov 16 10:26:32 user nova-compute[85141]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2006a77c-e5e8-4ec5-8de5-a0f9505c429a (non-flash)
Nov 16 10:26:32 user nova-compute[85141]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb96bfcd-cecc-452f-bc3b-61b7daf72599 (non-flash)
Nov 16 10:26:32 user nova-compute[85141]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b58025-0c18-41f6-a126-fb3c925399a1 (non-flash)
Nov 16 10:26:32 user nova-compute[85141]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1957d79-bfb4-4f74-bc74-1d241b5254bc (non-flash)
Nov 16 10:26:32 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 10:26:32 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-15f22e04-7381-4a43-a609-03a14e744788 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5160665510>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9bc0a873-d872-4f63-9af6-b4ac71162eeb'): ({'sdb'}, set())}) {{(pid=85141) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 10:26:32 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-15f22e04-7381-4a43-a609-03a14e744788 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Removing single pathed devices sdb {{(pid=85141) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 10:26:32 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:26:32 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:26:32 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b6f542c-4537-42e2-9c83-033873d573d3]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:26:32 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:26:32 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.024s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:26:32 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[51fc64f1-a188-4573-815e-082f7d632e74]: (4, ('ok\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:26:32 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-15f22e04-7381-4a43-a609-03a14e744788 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Flushing IO for device /dev/sdb {{(pid=85141) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 10:26:32 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:26:32 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:26:32 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[c93a3e69-89c7-4a0c-a04e-857b096ded8a]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:26:32 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-15f22e04-7381-4a43-a609-03a14e744788 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=85141) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 10:26:32 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:26:32 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.067s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:26:32 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[31f4b7bf-0448-4c18-bad0-981244904496]: (4, ('1', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:26:32 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-15f22e04-7381-4a43-a609-03a14e744788 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=85141) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 10:26:32 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-15f22e04-7381-4a43-a609-03a14e744788 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] SCSI volumes sdb have been removed. {{(pid=85141) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 10:26:32 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-15f22e04-7381-4a43-a609-03a14e744788 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9bc0a873-d872-4f63-9af6-b4ac71162eeb')] {{(pid=85141) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 10:26:32 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9bc0a873-d872-4f63-9af6-b4ac71162eeb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:26:32 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9bc0a873-d872-4f63-9af6-b4ac71162eeb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:26:32 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c50d1f0-9229-4f53-9530-b6eb02d8dcda]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:26:32 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-15f22e04-7381-4a43-a609-03a14e744788 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:26:32 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9bc0a873-d872-4f63-9af6-b4ac71162eeb -p 172.16.0.220:3260 --logout {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:26:32 user nova-compute[85141]: DEBUG nova.compute.manager [req-a23ac278-6ee4-4a51-b05d-7101c664a6f7 req-9159225a-1b30-44f0-8d14-60fdc7de7980 service nova] [instance: dfe84cd6-628a-484e-b266-34e2abe890f2] Received event network-vif-unplugged-e3463cf8-10c0-4465-95d8-28248f06c3c1 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:26:32 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-a23ac278-6ee4-4a51-b05d-7101c664a6f7 req-9159225a-1b30-44f0-8d14-60fdc7de7980 service nova] Acquiring lock "dfe84cd6-628a-484e-b266-34e2abe890f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:26:32 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-a23ac278-6ee4-4a51-b05d-7101c664a6f7 req-9159225a-1b30-44f0-8d14-60fdc7de7980 service nova] Lock "dfe84cd6-628a-484e-b266-34e2abe890f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:26:32 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-a23ac278-6ee4-4a51-b05d-7101c664a6f7 req-9159225a-1b30-44f0-8d14-60fdc7de7980 service nova] Lock "dfe84cd6-628a-484e-b266-34e2abe890f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:26:32 user nova-compute[85141]: DEBUG nova.compute.manager [req-a23ac278-6ee4-4a51-b05d-7101c664a6f7 req-9159225a-1b30-44f0-8d14-60fdc7de7980 service nova] [instance: dfe84cd6-628a-484e-b266-34e2abe890f2] No waiting events found dispatching network-vif-unplugged-e3463cf8-10c0-4465-95d8-28248f06c3c1 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:26:32 user nova-compute[85141]: DEBUG nova.compute.manager [req-a23ac278-6ee4-4a51-b05d-7101c664a6f7 req-9159225a-1b30-44f0-8d14-60fdc7de7980 service nova] [instance: dfe84cd6-628a-484e-b266-34e2abe890f2] Received event network-vif-unplugged-e3463cf8-10c0-4465-95d8-28248f06c3c1 for instance with task_state deleting. {{(pid=85141) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 10:26:32 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9bc0a873-d872-4f63-9af6-b4ac71162eeb -p 172.16.0.220:3260 --logout" returned: 0 in 0.085s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:26:32 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd30f19d-80ca-43e7-882b-6b484e9837bc]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:9bc0a873-d872-4f63-9af6-b4ac71162eeb, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:9bc0a873-d872-4f63-9af6-b4ac71162eeb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:26:32 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-15f22e04-7381-4a43-a609-03a14e744788 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:9bc0a873-d872-4f63-9af6-b4ac71162eeb, portal: 172.16.0.220,3260]
Nov 16 10:26:32 user nova-compute[85141]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:9bc0a873-d872-4f63-9af6-b4ac71162eeb, portal: 172.16.0.220,3260] successful.
Nov 16 10:26:32 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:26:32 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9bc0a873-d872-4f63-9af6-b4ac71162eeb -p 172.16.0.220:3260 --op delete {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:26:32 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9bc0a873-d872-4f63-9af6-b4ac71162eeb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.044s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:26:32 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[0af6200a-9e27-4a86-a874-a76d62fd0df6]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:26:32 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-15f22e04-7381-4a43-a609-03a14e744788 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:26:32 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-15f22e04-7381-4a43-a609-03a14e744788 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.462s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 10:26:32 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-15f22e04-7381-4a43-a609-03a14e744788 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] <== disconnect_volume: return (464ms) None {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 10:26:32 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-15f22e04-7381-4a43-a609-03a14e744788 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: dfe84cd6-628a-484e-b266-34e2abe890f2] Disconnected iSCSI Volume {{(pid=85141) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 10:26:32 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-15f22e04-7381-4a43-a609-03a14e744788 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: dfe84cd6-628a-484e-b266-34e2abe890f2] Deleting instance files /opt/stack/data/nova/instances/dfe84cd6-628a-484e-b266-34e2abe890f2_del
Nov 16 10:26:32 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-15f22e04-7381-4a43-a609-03a14e744788 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: dfe84cd6-628a-484e-b266-34e2abe890f2] Deletion of /opt/stack/data/nova/instances/dfe84cd6-628a-484e-b266-34e2abe890f2_del complete
Nov 16 10:26:32 user nova-compute[85141]: INFO nova.compute.manager [None req-15f22e04-7381-4a43-a609-03a14e744788 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: dfe84cd6-628a-484e-b266-34e2abe890f2] Took 1.37 seconds to destroy the instance on the hypervisor.
Nov 16 10:26:32 user nova-compute[85141]: DEBUG oslo.service.loopingcall [None req-15f22e04-7381-4a43-a609-03a14e744788 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=85141) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 10:26:32 user nova-compute[85141]: DEBUG nova.compute.manager [-] [instance: dfe84cd6-628a-484e-b266-34e2abe890f2] Deallocating network for instance {{(pid=85141) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 10:26:32 user nova-compute[85141]: DEBUG nova.network.neutron [-] [instance: dfe84cd6-628a-484e-b266-34e2abe890f2] deallocate_for_instance() {{(pid=85141) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 10:26:32 user nova-compute[85141]: DEBUG nova.network.neutron [None req-b4954a22-413a-41aa-8284-d435d267d5cc tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] [instance: abe5d4b7-a0d7-40e3-b630-0de746ddb55b] Updating instance_info_cache with network_info: [{"id": "e583d579-7583-4f41-b0f1-b3241b6af956", "address": "fa:16:3e:4d:24:64", "network": {"id": "e40e4bd2-4277-40b1-9451-1c8365ffa488", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1333036447-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "733b504d4dbe4f028963cf2c197f0064", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape583d579-75", "ovs_interfaceid": "e583d579-7583-4f41-b0f1-b3241b6af956", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:26:32 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-b4954a22-413a-41aa-8284-d435d267d5cc tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Releasing lock "refresh_cache-abe5d4b7-a0d7-40e3-b630-0de746ddb55b" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:26:32 user nova-compute[85141]: DEBUG nova.objects.instance [None req-b4954a22-413a-41aa-8284-d435d267d5cc tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Lazy-loading 'flavor' on Instance uuid abe5d4b7-a0d7-40e3-b630-0de746ddb55b {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:26:32 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:26:32 user nova-compute[85141]: DEBUG nova.network.neutron [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] [instance: 059d6974-bd0c-4f73-91fc-8202ebda4238] Updating instance_info_cache with network_info: [{"id": "89bf502f-593d-4c6e-aa83-a041e0ad7b28", "address": "fa:16:3e:40:09:f4", "network": {"id": "859d1f09-56c4-4c2b-b2c3-02b1938e8dbf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1562516834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "879fa3f4dfc34726b20149b8a7db22dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89bf502f-59", "ovs_interfaceid": "89bf502f-593d-4c6e-aa83-a041e0ad7b28", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:26:32 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:26:32 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Releasing lock "refresh_cache-059d6974-bd0c-4f73-91fc-8202ebda4238" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:26:32 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] [instance: 059d6974-bd0c-4f73-91fc-8202ebda4238] Updated the network info_cache for instance {{(pid=85141) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 10:26:32 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:26:32 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=85141) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 10:26:33 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:26:33 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:26:33 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:26:33 user nova-compute[85141]: DEBUG nova.network.neutron [-] [instance: dfe84cd6-628a-484e-b266-34e2abe890f2] Updating instance_info_cache with network_info: [] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:26:33 user nova-compute[85141]: INFO nova.compute.manager [-] [instance: dfe84cd6-628a-484e-b266-34e2abe890f2] Took 0.70 seconds to deallocate network for instance.
Nov 16 10:26:33 user nova-compute[85141]: DEBUG nova.compute.manager [req-ff96fd8f-1ae7-471b-b5ed-485881fa45f9 req-515a04f4-e447-46c0-b41a-aeca4ca9578d service nova] [instance: dfe84cd6-628a-484e-b266-34e2abe890f2] Received event network-vif-deleted-e3463cf8-10c0-4465-95d8-28248f06c3c1 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:26:33 user nova-compute[85141]: INFO nova.virt.libvirt.driver [-] [instance: abe5d4b7-a0d7-40e3-b630-0de746ddb55b] Instance destroyed successfully.
Nov 16 10:26:34 user nova-compute[85141]: INFO nova.compute.manager [None req-15f22e04-7381-4a43-a609-03a14e744788 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: dfe84cd6-628a-484e-b266-34e2abe890f2] Took 0.76 seconds to detach 1 volumes for instance.
Nov 16 10:26:34 user nova-compute[85141]: DEBUG nova.compute.manager [None req-15f22e04-7381-4a43-a609-03a14e744788 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: dfe84cd6-628a-484e-b266-34e2abe890f2] Deleting volume: 9bc0a873-d872-4f63-9af6-b4ac71162eeb {{(pid=85141) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 16 10:26:34 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:26:34 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:26:34 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager.update_available_resource {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:26:34 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-15f22e04-7381-4a43-a609-03a14e744788 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:26:34 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-15f22e04-7381-4a43-a609-03a14e744788 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:26:34 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:26:34 user nova-compute[85141]: DEBUG nova.compute.manager [req-05148fe9-269b-4e5f-904f-be1a441d3ddd req-f5060e79-9bba-4b05-9ccb-00c34fd63bf2 service nova] [instance: dfe84cd6-628a-484e-b266-34e2abe890f2] Received event network-vif-plugged-e3463cf8-10c0-4465-95d8-28248f06c3c1 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:26:34 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-05148fe9-269b-4e5f-904f-be1a441d3ddd req-f5060e79-9bba-4b05-9ccb-00c34fd63bf2 service nova] Acquiring lock "dfe84cd6-628a-484e-b266-34e2abe890f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:26:34 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-05148fe9-269b-4e5f-904f-be1a441d3ddd req-f5060e79-9bba-4b05-9ccb-00c34fd63bf2 service nova] Lock "dfe84cd6-628a-484e-b266-34e2abe890f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:26:34 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-05148fe9-269b-4e5f-904f-be1a441d3ddd req-f5060e79-9bba-4b05-9ccb-00c34fd63bf2 service nova] Lock "dfe84cd6-628a-484e-b266-34e2abe890f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:26:34 user nova-compute[85141]: DEBUG nova.compute.manager [req-05148fe9-269b-4e5f-904f-be1a441d3ddd req-f5060e79-9bba-4b05-9ccb-00c34fd63bf2 service nova] [instance: dfe84cd6-628a-484e-b266-34e2abe890f2] No waiting events found dispatching network-vif-plugged-e3463cf8-10c0-4465-95d8-28248f06c3c1 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:26:34 user nova-compute[85141]: WARNING nova.compute.manager [req-05148fe9-269b-4e5f-904f-be1a441d3ddd req-f5060e79-9bba-4b05-9ccb-00c34fd63bf2 service nova] [instance: dfe84cd6-628a-484e-b266-34e2abe890f2] Received unexpected event network-vif-plugged-e3463cf8-10c0-4465-95d8-28248f06c3c1 for instance with vm_state deleted and task_state None.
Nov 16 10:26:34 user nova-compute[85141]: DEBUG nova.compute.manager [req-05148fe9-269b-4e5f-904f-be1a441d3ddd req-f5060e79-9bba-4b05-9ccb-00c34fd63bf2 service nova] [instance: abe5d4b7-a0d7-40e3-b630-0de746ddb55b] Received event network-vif-unplugged-e583d579-7583-4f41-b0f1-b3241b6af956 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:26:34 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-05148fe9-269b-4e5f-904f-be1a441d3ddd req-f5060e79-9bba-4b05-9ccb-00c34fd63bf2 service nova] Acquiring lock "abe5d4b7-a0d7-40e3-b630-0de746ddb55b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:26:34 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-05148fe9-269b-4e5f-904f-be1a441d3ddd req-f5060e79-9bba-4b05-9ccb-00c34fd63bf2 service nova] Lock "abe5d4b7-a0d7-40e3-b630-0de746ddb55b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:26:34 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-05148fe9-269b-4e5f-904f-be1a441d3ddd req-f5060e79-9bba-4b05-9ccb-00c34fd63bf2 service nova] Lock "abe5d4b7-a0d7-40e3-b630-0de746ddb55b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:26:34 user nova-compute[85141]: DEBUG nova.compute.manager [req-05148fe9-269b-4e5f-904f-be1a441d3ddd req-f5060e79-9bba-4b05-9ccb-00c34fd63bf2 service nova] [instance: abe5d4b7-a0d7-40e3-b630-0de746ddb55b] No waiting events found dispatching network-vif-unplugged-e583d579-7583-4f41-b0f1-b3241b6af956 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:26:34 user nova-compute[85141]: WARNING nova.compute.manager [req-05148fe9-269b-4e5f-904f-be1a441d3ddd req-f5060e79-9bba-4b05-9ccb-00c34fd63bf2 service nova] [instance: abe5d4b7-a0d7-40e3-b630-0de746ddb55b] Received unexpected event network-vif-unplugged-e583d579-7583-4f41-b0f1-b3241b6af956 for instance with vm_state rescued and task_state unrescuing.
Nov 16 10:26:34 user nova-compute[85141]: DEBUG nova.compute.manager [req-05148fe9-269b-4e5f-904f-be1a441d3ddd req-f5060e79-9bba-4b05-9ccb-00c34fd63bf2 service nova] [instance: abe5d4b7-a0d7-40e3-b630-0de746ddb55b] Received event network-vif-plugged-e583d579-7583-4f41-b0f1-b3241b6af956 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:26:34 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-05148fe9-269b-4e5f-904f-be1a441d3ddd req-f5060e79-9bba-4b05-9ccb-00c34fd63bf2 service nova] Acquiring lock "abe5d4b7-a0d7-40e3-b630-0de746ddb55b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:26:34 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-05148fe9-269b-4e5f-904f-be1a441d3ddd req-f5060e79-9bba-4b05-9ccb-00c34fd63bf2 service nova] Lock "abe5d4b7-a0d7-40e3-b630-0de746ddb55b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:26:34 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-05148fe9-269b-4e5f-904f-be1a441d3ddd req-f5060e79-9bba-4b05-9ccb-00c34fd63bf2 service nova] Lock "abe5d4b7-a0d7-40e3-b630-0de746ddb55b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:26:34 user nova-compute[85141]: DEBUG nova.compute.manager [req-05148fe9-269b-4e5f-904f-be1a441d3ddd req-f5060e79-9bba-4b05-9ccb-00c34fd63bf2 service nova] [instance: abe5d4b7-a0d7-40e3-b630-0de746ddb55b] No waiting events found dispatching network-vif-plugged-e583d579-7583-4f41-b0f1-b3241b6af956 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:26:34 user nova-compute[85141]: WARNING nova.compute.manager [req-05148fe9-269b-4e5f-904f-be1a441d3ddd req-f5060e79-9bba-4b05-9ccb-00c34fd63bf2 service nova] [instance: abe5d4b7-a0d7-40e3-b630-0de746ddb55b] Received unexpected event network-vif-plugged-e583d579-7583-4f41-b0f1-b3241b6af956 for instance with vm_state rescued and task_state unrescuing.
Nov 16 10:26:34 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:26:34 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:26:34 user nova-compute[85141]: DEBUG nova.compute.provider_tree [None req-15f22e04-7381-4a43-a609-03a14e744788 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Inventory has not changed in ProviderTree for provider: bf8e0fa1-16b6-408f-9203-c4cd63916272 {{(pid=85141) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 10:26:34 user nova-compute[85141]: DEBUG nova.scheduler.client.report [None req-15f22e04-7381-4a43-a609-03a14e744788 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Inventory has not changed for provider bf8e0fa1-16b6-408f-9203-c4cd63916272 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=85141) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 10:26:34 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:26:34 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:26:34 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:26:34 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-15f22e04-7381-4a43-a609-03a14e744788 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.656s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:26:35 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.647s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:26:35 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:26:35 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Auditing locally available compute resources for user (node: user) {{(pid=85141) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 10:26:35 user nova-compute[85141]: INFO nova.scheduler.client.report [None req-15f22e04-7381-4a43-a609-03a14e744788 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Deleted allocations for instance dfe84cd6-628a-484e-b266-34e2abe890f2
Nov 16 10:26:35 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-15f22e04-7381-4a43-a609-03a14e744788 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Lock "dfe84cd6-628a-484e-b266-34e2abe890f2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.746s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:26:35 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:26:35 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:26:35 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:26:36 user nova-compute[85141]: DEBUG nova.compute.manager [req-97415b5e-c047-405c-9adf-45e0e8c7ae73 req-c00a3010-bfa9-4624-8e3c-fc572b27fb3b service nova] [instance: abe5d4b7-a0d7-40e3-b630-0de746ddb55b] Received event network-vif-plugged-e583d579-7583-4f41-b0f1-b3241b6af956 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:26:36 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-97415b5e-c047-405c-9adf-45e0e8c7ae73 req-c00a3010-bfa9-4624-8e3c-fc572b27fb3b service nova] Acquiring lock "abe5d4b7-a0d7-40e3-b630-0de746ddb55b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:26:36 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-97415b5e-c047-405c-9adf-45e0e8c7ae73 req-c00a3010-bfa9-4624-8e3c-fc572b27fb3b service nova] Lock "abe5d4b7-a0d7-40e3-b630-0de746ddb55b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:26:36 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-97415b5e-c047-405c-9adf-45e0e8c7ae73 req-c00a3010-bfa9-4624-8e3c-fc572b27fb3b service nova] Lock "abe5d4b7-a0d7-40e3-b630-0de746ddb55b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:26:36 user nova-compute[85141]: DEBUG nova.compute.manager [req-97415b5e-c047-405c-9adf-45e0e8c7ae73 req-c00a3010-bfa9-4624-8e3c-fc572b27fb3b service nova] [instance: abe5d4b7-a0d7-40e3-b630-0de746ddb55b] No waiting events found dispatching network-vif-plugged-e583d579-7583-4f41-b0f1-b3241b6af956 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:26:36 user nova-compute[85141]: WARNING nova.compute.manager [req-97415b5e-c047-405c-9adf-45e0e8c7ae73 req-c00a3010-bfa9-4624-8e3c-fc572b27fb3b service nova] [instance: abe5d4b7-a0d7-40e3-b630-0de746ddb55b] Received unexpected event network-vif-plugged-e583d579-7583-4f41-b0f1-b3241b6af956 for instance with vm_state rescued and task_state unrescuing.
Nov 16 10:26:36 user nova-compute[85141]: DEBUG nova.compute.manager [req-97415b5e-c047-405c-9adf-45e0e8c7ae73 req-c00a3010-bfa9-4624-8e3c-fc572b27fb3b service nova] [instance: abe5d4b7-a0d7-40e3-b630-0de746ddb55b] Received event network-vif-plugged-e583d579-7583-4f41-b0f1-b3241b6af956 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:26:36 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-97415b5e-c047-405c-9adf-45e0e8c7ae73 req-c00a3010-bfa9-4624-8e3c-fc572b27fb3b service nova] Acquiring lock "abe5d4b7-a0d7-40e3-b630-0de746ddb55b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:26:36 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-97415b5e-c047-405c-9adf-45e0e8c7ae73 req-c00a3010-bfa9-4624-8e3c-fc572b27fb3b service nova] Lock "abe5d4b7-a0d7-40e3-b630-0de746ddb55b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:26:36 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-97415b5e-c047-405c-9adf-45e0e8c7ae73 req-c00a3010-bfa9-4624-8e3c-fc572b27fb3b service nova] Lock "abe5d4b7-a0d7-40e3-b630-0de746ddb55b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:26:36 user nova-compute[85141]: DEBUG nova.compute.manager [req-97415b5e-c047-405c-9adf-45e0e8c7ae73 req-c00a3010-bfa9-4624-8e3c-fc572b27fb3b service nova] [instance: abe5d4b7-a0d7-40e3-b630-0de746ddb55b] No waiting events found dispatching network-vif-plugged-e583d579-7583-4f41-b0f1-b3241b6af956 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:26:36 user nova-compute[85141]: WARNING nova.compute.manager [req-97415b5e-c047-405c-9adf-45e0e8c7ae73 req-c00a3010-bfa9-4624-8e3c-fc572b27fb3b service nova] [instance: abe5d4b7-a0d7-40e3-b630-0de746ddb55b] Received unexpected event network-vif-plugged-e583d579-7583-4f41-b0f1-b3241b6af956 for instance with vm_state rescued and task_state unrescuing.
Nov 16 10:26:37 user nova-compute[85141]: DEBUG nova.compute.manager [None req-b4954a22-413a-41aa-8284-d435d267d5cc tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] [instance: abe5d4b7-a0d7-40e3-b630-0de746ddb55b] Checking state {{(pid=85141) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 10:26:37 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:26:37 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/463034ff-14ce-477a-9642-4d86aa6f9cd9/disk.rescue --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:26:37 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/463034ff-14ce-477a-9642-4d86aa6f9cd9/disk.rescue --force-share --output=json" returned: 0 in 0.202s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:26:37 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/463034ff-14ce-477a-9642-4d86aa6f9cd9/disk.rescue --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:26:37 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/463034ff-14ce-477a-9642-4d86aa6f9cd9/disk.rescue --force-share --output=json" returned: 0 in 0.189s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:26:37 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] skipping disk /opt/stack/data/nova/instances/463034ff-14ce-477a-9642-4d86aa6f9cd9/disk (vdb) as it is a volume {{(pid=85141) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 10:26:37 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b388b98-4e65-4258-bbe2-77e699321fb7/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:26:37 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b388b98-4e65-4258-bbe2-77e699321fb7/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:26:37 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b388b98-4e65-4258-bbe2-77e699321fb7/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:26:38 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b388b98-4e65-4258-bbe2-77e699321fb7/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:26:38 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a507c85-0369-48ea-8858-3e7d346b4cb0/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:26:38 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:26:38 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a507c85-0369-48ea-8858-3e7d346b4cb0/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:26:38 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a507c85-0369-48ea-8858-3e7d346b4cb0/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:26:38 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a507c85-0369-48ea-8858-3e7d346b4cb0/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:26:38 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e214bbb-5bbb-4e6f-ac09-9cb1412f068b/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:26:38 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e214bbb-5bbb-4e6f-ac09-9cb1412f068b/disk --force-share --output=json" returned: 0 in 0.299s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:26:38 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e214bbb-5bbb-4e6f-ac09-9cb1412f068b/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:26:38 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e214bbb-5bbb-4e6f-ac09-9cb1412f068b/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:26:38 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d842f90e-663b-4c95-9d7c-d092d2bac41f/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:26:39 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d842f90e-663b-4c95-9d7c-d092d2bac41f/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:26:39 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d842f90e-663b-4c95-9d7c-d092d2bac41f/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:26:39 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d842f90e-663b-4c95-9d7c-d092d2bac41f/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:26:39 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=85141) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 10:26:39 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17480138-4b61-43f7-92a5-db065f7d1696/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:26:39 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17480138-4b61-43f7-92a5-db065f7d1696/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:26:39 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17480138-4b61-43f7-92a5-db065f7d1696/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:26:39 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17480138-4b61-43f7-92a5-db065f7d1696/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:26:39 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=85141) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 10:26:39 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=85141) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 10:26:39 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7dfe34a-f7ba-44b3-8898-634338161a23/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:26:39 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7dfe34a-f7ba-44b3-8898-634338161a23/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:26:39 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7dfe34a-f7ba-44b3-8898-634338161a23/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:26:40 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7dfe34a-f7ba-44b3-8898-634338161a23/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:26:40 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b24c3954-06ff-4e15-9e43-c65d1dae7a5d/disk.rescue --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:26:40 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b24c3954-06ff-4e15-9e43-c65d1dae7a5d/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:26:40 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b24c3954-06ff-4e15-9e43-c65d1dae7a5d/disk.rescue --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:26:40 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b24c3954-06ff-4e15-9e43-c65d1dae7a5d/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:26:40 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b24c3954-06ff-4e15-9e43-c65d1dae7a5d/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:26:40 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b24c3954-06ff-4e15-9e43-c65d1dae7a5d/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:26:40 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b24c3954-06ff-4e15-9e43-c65d1dae7a5d/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:26:40 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b24c3954-06ff-4e15-9e43-c65d1dae7a5d/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:26:40 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=85141) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 10:26:40 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/059d6974-bd0c-4f73-91fc-8202ebda4238/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:26:40 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/059d6974-bd0c-4f73-91fc-8202ebda4238/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:26:40 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/059d6974-bd0c-4f73-91fc-8202ebda4238/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:26:41 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/059d6974-bd0c-4f73-91fc-8202ebda4238/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:26:41 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fcf8335-9e6f-4878-a3e2-c68aeab0978e/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:26:41 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fcf8335-9e6f-4878-a3e2-c68aeab0978e/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:26:41 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fcf8335-9e6f-4878-a3e2-c68aeab0978e/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:26:41 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fcf8335-9e6f-4878-a3e2-c68aeab0978e/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:26:41 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b4347a0-a9f0-4e4c-9d7a-30d984fa35a9/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:26:41 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b4347a0-a9f0-4e4c-9d7a-30d984fa35a9/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:26:41 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b4347a0-a9f0-4e4c-9d7a-30d984fa35a9/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:26:41 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b4347a0-a9f0-4e4c-9d7a-30d984fa35a9/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:26:41 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11986c5b-6914-491e-8e71-983ab6b13c6e/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:26:42 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11986c5b-6914-491e-8e71-983ab6b13c6e/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:26:42 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11986c5b-6914-491e-8e71-983ab6b13c6e/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:26:42 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:26:42 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11986c5b-6914-491e-8e71-983ab6b13c6e/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:26:42 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:26:42 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:26:42 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Hypervisor/Node resource view: name=user free_ram=6870MB free_disk=24.720394134521484GB free_vcpus=-3 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=85141) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 10:26:42 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:26:42 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:26:42 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance d842f90e-663b-4c95-9d7c-d092d2bac41f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:26:42 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance f01dc8cf-1a69-4618-a15d-0c1075157f05 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:26:42 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance 059d6974-bd0c-4f73-91fc-8202ebda4238 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:26:42 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance 4e214bbb-5bbb-4e6f-ac09-9cb1412f068b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:26:42 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance b24c3954-06ff-4e15-9e43-c65d1dae7a5d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:26:42 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance 0b388b98-4e65-4258-bbe2-77e699321fb7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:26:42 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance 11986c5b-6914-491e-8e71-983ab6b13c6e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:26:42 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance abe5d4b7-a0d7-40e3-b630-0de746ddb55b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:26:42 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance 17480138-4b61-43f7-92a5-db065f7d1696 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:26:42 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance 463034ff-14ce-477a-9642-4d86aa6f9cd9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:26:42 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance 5a507c85-0369-48ea-8858-3e7d346b4cb0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:26:42 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance d7dfe34a-f7ba-44b3-8898-634338161a23 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:26:42 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance bc76703d-9243-4277-9b13-d6f9639cd1bb actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:26:42 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance 2b4347a0-a9f0-4e4c-9d7a-30d984fa35a9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:26:42 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance 9fcf8335-9e6f-4878-a3e2-c68aeab0978e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:26:42 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Total usable vcpus: 12, total allocated vcpus: 15 {{(pid=85141) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 10:26:42 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Final resource view: name=user phys_ram=16011MB used_ram=8192MB phys_disk=40GB used_disk=12GB total_vcpus=12 used_vcpus=15 pci_stats=[] {{(pid=85141) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 10:26:42 user nova-compute[85141]: DEBUG nova.scheduler.client.report [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Refreshing inventories for resource provider bf8e0fa1-16b6-408f-9203-c4cd63916272 {{(pid=85141) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 16 10:26:42 user nova-compute[85141]: DEBUG nova.scheduler.client.report [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Updating ProviderTree inventory for provider bf8e0fa1-16b6-408f-9203-c4cd63916272 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=85141) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 16 10:26:42 user nova-compute[85141]: DEBUG nova.compute.provider_tree [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Updating inventory in ProviderTree for provider bf8e0fa1-16b6-408f-9203-c4cd63916272 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=85141) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 16 10:26:43 user nova-compute[85141]: DEBUG nova.scheduler.client.report [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Refreshing aggregate associations for resource provider bf8e0fa1-16b6-408f-9203-c4cd63916272, aggregates: None {{(pid=85141) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 16 10:26:43 user nova-compute[85141]: DEBUG nova.scheduler.client.report [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Refreshing trait associations for resource provider bf8e0fa1-16b6-408f-9203-c4cd63916272, traits: COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE41,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_ACCELERATORS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_USB,COMPUTE_TRUSTED_CERTS,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_RESCUE_BFV,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VOLUME_ATTACH_WITH_TAG {{(pid=85141) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 16 10:26:43 user nova-compute[85141]: DEBUG nova.compute.provider_tree [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Inventory has not changed in ProviderTree for provider: bf8e0fa1-16b6-408f-9203-c4cd63916272 {{(pid=85141) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 10:26:43 user nova-compute[85141]: DEBUG nova.scheduler.client.report [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Inventory has not changed for provider bf8e0fa1-16b6-408f-9203-c4cd63916272 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=85141) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 10:26:43 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Compute_service record updated for user:user {{(pid=85141) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 10:26:43 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.779s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:26:43 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:26:43 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Cleaning up deleted instances {{(pid=85141) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 16 10:26:43 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] There are 0 instances to clean {{(pid=85141) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 16 10:26:43 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:26:44 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-7fea7c54-7e23-4ae4-8f40-9c63e7a438a7 tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance d7dfe34a-f7ba-44b3-8898-634338161a23 is timed out.
Nov 16 10:26:44 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-7fea7c54-7e23-4ae4-8f40-9c63e7a438a7 tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Successfully detached device vdb from instance d7dfe34a-f7ba-44b3-8898-634338161a23 from the live domain config.
Nov 16 10:26:44 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7fea7c54-7e23-4ae4-8f40-9c63e7a438a7 tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] [instance: d7dfe34a-f7ba-44b3-8898-634338161a23] calling os-brick to detach iSCSI Volume {{(pid=85141) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 10:26:44 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fea7c54-7e23-4ae4-8f40-9c63e7a438a7 tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51806b6080>, {'target_iqn': 'iqn.2010-10.org.openstack:b1957d79-bfb4-4f74-bc74-1d241b5254bc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QYsfbKkd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 10:26:44 user nova-compute[85141]: WARNING os_brick.initiator.connectors.base [None req-7fea7c54-7e23-4ae4-8f40-9c63e7a438a7 tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 10:26:44 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-7fea7c54-7e23-4ae4-8f40-9c63e7a438a7 tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 10:26:44 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-7fea7c54-7e23-4ae4-8f40-9c63e7a438a7 tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 10:26:44 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:26:44 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:26:44 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[11fd97a9-0141-4e75-b7f5-e1738fa03536]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:bb96bfcd-cecc-452f-bc3b-61b7daf72599\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b1957d79-bfb4-4f74-bc74-1d241b5254bc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:11a6a15b-38c1-4e7e-b8fa-2feb6789e775\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e1b58025-0c18-41f6-a126-fb3c925399a1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2006a77c-e5e8-4ec5-8de5-a0f9505c429a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:26:44 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fea7c54-7e23-4ae4-8f40-9c63e7a438a7 tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 10:26:44 user nova-compute[85141]: No targets found.
Nov 16 10:26:44 user nova-compute[85141]: iSNS:
Nov 16 10:26:44 user nova-compute[85141]: No targets found.
Nov 16 10:26:44 user nova-compute[85141]: STATIC:
Nov 16 10:26:44 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:bb96bfcd-cecc-452f-bc3b-61b7daf72599
Nov 16 10:26:44 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:26:44 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:26:44 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:b1957d79-bfb4-4f74-bc74-1d241b5254bc
Nov 16 10:26:44 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:26:44 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:26:44 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee
Nov 16 10:26:44 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:26:44 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:26:44 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:11a6a15b-38c1-4e7e-b8fa-2feb6789e775
Nov 16 10:26:44 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:26:44 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:26:44 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:e1b58025-0c18-41f6-a126-fb3c925399a1
Nov 16 10:26:44 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:26:44 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:26:44 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:2006a77c-e5e8-4ec5-8de5-a0f9505c429a
Nov 16 10:26:44 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:26:44 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:26:44 user nova-compute[85141]: FIRMWARE:
Nov 16 10:26:44 user nova-compute[85141]: No targets found.
Nov 16 10:26:44 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:26:44 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fea7c54-7e23-4ae4-8f40-9c63e7a438a7 tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 10:26:44 user nova-compute[85141]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 10:26:44 user nova-compute[85141]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=85141) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 10:26:44 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fea7c54-7e23-4ae4-8f40-9c63e7a438a7 tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b1957d79-bfb4-4f74-bc74-1d241b5254bc', 0)] {{(pid=85141) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 10:26:44 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:26:44 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:26:44 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7d9ab93-5c1b-45bc-b32d-564ee1588979]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:11a6a15b-38c1-4e7e-b8fa-2feb6789e775\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2006a77c-e5e8-4ec5-8de5-a0f9505c429a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b1957d79-bfb4-4f74-bc74-1d241b5254bc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bb96bfcd-cecc-452f-bc3b-61b7daf72599\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e1b58025-0c18-41f6-a126-fb3c925399a1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:26:44 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:26:44 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:26:44 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cd01e94-38c4-4545-98fe-e90118bdea3a]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11a6a15b-38c1-4e7e-b8fa-2feb6789e775 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2006a77c-e5e8-4ec5-8de5-a0f9505c429a (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb96bfcd-cecc-452f-bc3b-61b7daf72599 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b58025-0c18-41f6-a126-fb3c925399a1 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1957d79-bfb4-4f74-bc74-1d241b5254bc (non-flash)\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:26:44 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fea7c54-7e23-4ae4-8f40-9c63e7a438a7 tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)
Nov 16 10:26:44 user nova-compute[85141]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11a6a15b-38c1-4e7e-b8fa-2feb6789e775 (non-flash)
Nov 16 10:26:44 user nova-compute[85141]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2006a77c-e5e8-4ec5-8de5-a0f9505c429a (non-flash)
Nov 16 10:26:44 user nova-compute[85141]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb96bfcd-cecc-452f-bc3b-61b7daf72599 (non-flash)
Nov 16 10:26:44 user nova-compute[85141]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b58025-0c18-41f6-a126-fb3c925399a1 (non-flash)
Nov 16 10:26:44 user nova-compute[85141]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1957d79-bfb4-4f74-bc74-1d241b5254bc (non-flash)
Nov 16 10:26:44 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:26:44 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fea7c54-7e23-4ae4-8f40-9c63e7a438a7 tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)
Nov 16 10:26:44 user nova-compute[85141]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11a6a15b-38c1-4e7e-b8fa-2feb6789e775 (non-flash)
Nov 16 10:26:44 user nova-compute[85141]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2006a77c-e5e8-4ec5-8de5-a0f9505c429a (non-flash)
Nov 16 10:26:44 user nova-compute[85141]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb96bfcd-cecc-452f-bc3b-61b7daf72599 (non-flash)
Nov 16 10:26:44 user nova-compute[85141]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b58025-0c18-41f6-a126-fb3c925399a1 (non-flash)
Nov 16 10:26:44 user nova-compute[85141]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1957d79-bfb4-4f74-bc74-1d241b5254bc (non-flash)
Nov 16 10:26:44 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 10:26:44 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fea7c54-7e23-4ae4-8f40-9c63e7a438a7 tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f518054d240>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b1957d79-bfb4-4f74-bc74-1d241b5254bc'): ({'sdh'}, set())}) {{(pid=85141) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 10:26:44 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-7fea7c54-7e23-4ae4-8f40-9c63e7a438a7 tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Removing single pathed devices sdh {{(pid=85141) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 10:26:44 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:26:44 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:26:44 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f43130c-dc98-44a0-bc6e-44efae12499d]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:26:44 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:26:44 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.017s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:26:44 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[76b00a21-9099-4352-9f0f-6fae498ae51a]: (4, ('ok\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:26:44 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-7fea7c54-7e23-4ae4-8f40-9c63e7a438a7 tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Flushing IO for device /dev/sdh {{(pid=85141) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 10:26:44 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:26:44 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.017s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:26:44 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[69b4af39-58ba-482e-9c0f-a738dbf15348]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:26:44 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-7fea7c54-7e23-4ae4-8f40-9c63e7a438a7 tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=85141) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 10:26:44 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:26:44 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.049s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:26:44 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f9d2988-3a37-4dd9-92f1-dc6e57e74b53]: (4, ('1', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:26:44 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-7fea7c54-7e23-4ae4-8f40-9c63e7a438a7 tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=85141) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 10:26:44 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-7fea7c54-7e23-4ae4-8f40-9c63e7a438a7 tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] SCSI volumes sdh have been removed. {{(pid=85141) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 10:26:44 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fea7c54-7e23-4ae4-8f40-9c63e7a438a7 tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b1957d79-bfb4-4f74-bc74-1d241b5254bc')] {{(pid=85141) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 10:26:44 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1957d79-bfb4-4f74-bc74-1d241b5254bc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:26:44 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1957d79-bfb4-4f74-bc74-1d241b5254bc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:26:44 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5cd902f-9c77-453c-86a5-651ce8bf7e71]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:26:44 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fea7c54-7e23-4ae4-8f40-9c63e7a438a7 tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:26:44 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1957d79-bfb4-4f74-bc74-1d241b5254bc -p 172.16.0.220:3260 --logout {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:26:45 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1957d79-bfb4-4f74-bc74-1d241b5254bc -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:26:45 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[de68b6ad-b81e-4fa7-9a08-d7b29128db2c]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:b1957d79-bfb4-4f74-bc74-1d241b5254bc, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:b1957d79-bfb4-4f74-bc74-1d241b5254bc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:26:45 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fea7c54-7e23-4ae4-8f40-9c63e7a438a7 tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:b1957d79-bfb4-4f74-bc74-1d241b5254bc, portal: 172.16.0.220,3260]
Nov 16 10:26:45 user nova-compute[85141]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:b1957d79-bfb4-4f74-bc74-1d241b5254bc, portal: 172.16.0.220,3260] successful.
Nov 16 10:26:45 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:26:45 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1957d79-bfb4-4f74-bc74-1d241b5254bc -p 172.16.0.220:3260 --op delete {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:26:45 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1957d79-bfb4-4f74-bc74-1d241b5254bc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:26:45 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[61adc0d7-21f6-4d78-8738-e8915fd13031]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:26:45 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fea7c54-7e23-4ae4-8f40-9c63e7a438a7 tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:26:45 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-7fea7c54-7e23-4ae4-8f40-9c63e7a438a7 tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.332s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 10:26:45 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fea7c54-7e23-4ae4-8f40-9c63e7a438a7 tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] <== disconnect_volume: return (334ms) None {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 10:26:45 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7fea7c54-7e23-4ae4-8f40-9c63e7a438a7 tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] [instance: d7dfe34a-f7ba-44b3-8898-634338161a23] Disconnected iSCSI Volume {{(pid=85141) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 10:26:45 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:26:45 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:26:45 user nova-compute[85141]: DEBUG nova.objects.instance [None req-7fea7c54-7e23-4ae4-8f40-9c63e7a438a7 tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Lazy-loading 'flavor' on Instance uuid d7dfe34a-f7ba-44b3-8898-634338161a23 {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:26:46 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-7fea7c54-7e23-4ae4-8f40-9c63e7a438a7 tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Lock "d7dfe34a-f7ba-44b3-8898-634338161a23" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.841s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:26:46 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-9b69e743-af3c-42c0-bf95-e038fda377ce tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Lock "d7dfe34a-f7ba-44b3-8898-634338161a23" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.728s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:26:46 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-9b69e743-af3c-42c0-bf95-e038fda377ce tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Acquiring lock "d7dfe34a-f7ba-44b3-8898-634338161a23-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:26:46 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-9b69e743-af3c-42c0-bf95-e038fda377ce tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Lock "d7dfe34a-f7ba-44b3-8898-634338161a23-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:26:46 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-9b69e743-af3c-42c0-bf95-e038fda377ce tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Lock "d7dfe34a-f7ba-44b3-8898-634338161a23-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:26:46 user nova-compute[85141]: INFO nova.compute.manager [None req-9b69e743-af3c-42c0-bf95-e038fda377ce tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] [instance: d7dfe34a-f7ba-44b3-8898-634338161a23] Terminating instance
Nov 16 10:26:46 user nova-compute[85141]: DEBUG nova.compute.manager [None req-9b69e743-af3c-42c0-bf95-e038fda377ce tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] [instance: d7dfe34a-f7ba-44b3-8898-634338161a23] Start destroying the instance on the hypervisor. {{(pid=85141) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 10:26:46 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:26:46 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:26:46 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:26:46 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:26:46 user nova-compute[85141]: DEBUG nova.compute.manager [req-19b5dd26-abeb-49fe-9de0-cbae1f2cae3c req-7e0d9433-c469-48ea-a3e0-4d48905c2a27 service nova] [instance: d7dfe34a-f7ba-44b3-8898-634338161a23] Received event network-vif-unplugged-401df940-fd58-48b0-89f4-5083130952d5 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:26:46 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-19b5dd26-abeb-49fe-9de0-cbae1f2cae3c req-7e0d9433-c469-48ea-a3e0-4d48905c2a27 service nova] Acquiring lock "d7dfe34a-f7ba-44b3-8898-634338161a23-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:26:46 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-19b5dd26-abeb-49fe-9de0-cbae1f2cae3c req-7e0d9433-c469-48ea-a3e0-4d48905c2a27 service nova] Lock "d7dfe34a-f7ba-44b3-8898-634338161a23-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:26:46 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-19b5dd26-abeb-49fe-9de0-cbae1f2cae3c req-7e0d9433-c469-48ea-a3e0-4d48905c2a27 service nova] Lock "d7dfe34a-f7ba-44b3-8898-634338161a23-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:26:46 user nova-compute[85141]: DEBUG nova.compute.manager [req-19b5dd26-abeb-49fe-9de0-cbae1f2cae3c req-7e0d9433-c469-48ea-a3e0-4d48905c2a27 service nova] [instance: d7dfe34a-f7ba-44b3-8898-634338161a23] No waiting events found dispatching network-vif-unplugged-401df940-fd58-48b0-89f4-5083130952d5 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:26:46 user nova-compute[85141]: DEBUG nova.compute.manager [req-19b5dd26-abeb-49fe-9de0-cbae1f2cae3c req-7e0d9433-c469-48ea-a3e0-4d48905c2a27 service nova] [instance: d7dfe34a-f7ba-44b3-8898-634338161a23] Received event network-vif-unplugged-401df940-fd58-48b0-89f4-5083130952d5 for instance with task_state deleting. {{(pid=85141) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 10:26:46 user nova-compute[85141]: INFO nova.virt.libvirt.driver [-] [instance: d7dfe34a-f7ba-44b3-8898-634338161a23] Instance destroyed successfully.
Nov 16 10:26:46 user nova-compute[85141]: DEBUG nova.objects.instance [None req-9b69e743-af3c-42c0-bf95-e038fda377ce tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Lazy-loading 'resources' on Instance uuid d7dfe34a-f7ba-44b3-8898-634338161a23 {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:26:46 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-9b69e743-af3c-42c0-bf95-e038fda377ce tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T10:24:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-454057559',display_name='tempest-VolumesSnapshotTestJSON-instance-454057559',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-454057559',id=32,image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFvceMg7UP8xvNyrSavrKskF+lFeWK8f4QMgCeiS7/XawkQcsVT/zpfrUPenlNfCnn9QfeCu6Id4NfS6DcdUpYgQ4mMn7IU9vasremdvX6QkF0SCshLi30D3X/getVQb8Q==',key_name='tempest-keypair-36388301',keypairs=<?>,launch_index=0,launched_at=2023-11-16T10:24:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6a0984b7ef0346768c3231b9ab00fb57',ramdisk_id='',reservation_id='r-3z9vidhl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-790088929',owner_user_name='tempest-VolumesSnapshotTestJSON-790088929-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T10:24:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eb874e8c071f4305a1de443f23f5df95',uuid=d7dfe34a-f7ba-44b3-8898-634338161a23,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "401df940-fd58-48b0-89f4-5083130952d5", "address": "fa:16:3e:1e:59:2e", "network": {"id": "d791d4f1-ec4b-4db3-ae9a-471f071206eb", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-369109742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a0984b7ef0346768c3231b9ab00fb57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap401df940-fd", "ovs_interfaceid": "401df940-fd58-48b0-89f4-5083130952d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 10:26:46 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-9b69e743-af3c-42c0-bf95-e038fda377ce tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Converting VIF {"id": "401df940-fd58-48b0-89f4-5083130952d5", "address": "fa:16:3e:1e:59:2e", "network": {"id": "d791d4f1-ec4b-4db3-ae9a-471f071206eb", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-369109742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a0984b7ef0346768c3231b9ab00fb57", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap401df940-fd", "ovs_interfaceid": "401df940-fd58-48b0-89f4-5083130952d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:26:46 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-9b69e743-af3c-42c0-bf95-e038fda377ce tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1e:59:2e,bridge_name='br-int',has_traffic_filtering=True,id=401df940-fd58-48b0-89f4-5083130952d5,network=Network(d791d4f1-ec4b-4db3-ae9a-471f071206eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap401df940-fd') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:26:46 user nova-compute[85141]: DEBUG os_vif [None req-9b69e743-af3c-42c0-bf95-e038fda377ce tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1e:59:2e,bridge_name='br-int',has_traffic_filtering=True,id=401df940-fd58-48b0-89f4-5083130952d5,network=Network(d791d4f1-ec4b-4db3-ae9a-471f071206eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap401df940-fd') {{(pid=85141) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 10:26:46 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:26:46 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap401df940-fd, bridge=br-int, if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:26:46 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:26:46 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:26:46 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:26:46 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=091e84f0-9af6-4bf8-a8fb-c8c4dae72f6f) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:26:46 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:26:46 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:26:46 user nova-compute[85141]: INFO os_vif [None req-9b69e743-af3c-42c0-bf95-e038fda377ce tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1e:59:2e,bridge_name='br-int',has_traffic_filtering=True,id=401df940-fd58-48b0-89f4-5083130952d5,network=Network(d791d4f1-ec4b-4db3-ae9a-471f071206eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap401df940-fd')
Nov 16 10:26:46 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9b69e743-af3c-42c0-bf95-e038fda377ce tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] [instance: d7dfe34a-f7ba-44b3-8898-634338161a23] calling os-brick to detach iSCSI Volume {{(pid=85141) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 10:26:46 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b69e743-af3c-42c0-bf95-e038fda377ce tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51806b6080>, {'target_iqn': 'iqn.2010-10.org.openstack:b1957d79-bfb4-4f74-bc74-1d241b5254bc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QYsfbKkd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': True}}" {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 10:26:46 user nova-compute[85141]: WARNING os_brick.initiator.connectors.base [None req-9b69e743-af3c-42c0-bf95-e038fda377ce tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 10:26:46 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-9b69e743-af3c-42c0-bf95-e038fda377ce tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 10:26:46 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-9b69e743-af3c-42c0-bf95-e038fda377ce tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 10:26:46 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:26:46 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.028s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:26:46 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[571c81a3-6fa7-4f81-8adb-346245742633]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:bb96bfcd-cecc-452f-bc3b-61b7daf72599\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:11a6a15b-38c1-4e7e-b8fa-2feb6789e775\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e1b58025-0c18-41f6-a126-fb3c925399a1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2006a77c-e5e8-4ec5-8de5-a0f9505c429a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:26:46 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b69e743-af3c-42c0-bf95-e038fda377ce tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 10:26:46 user nova-compute[85141]: No targets found.
Nov 16 10:26:46 user nova-compute[85141]: iSNS:
Nov 16 10:26:46 user nova-compute[85141]: No targets found.
Nov 16 10:26:46 user nova-compute[85141]: STATIC:
Nov 16 10:26:46 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:bb96bfcd-cecc-452f-bc3b-61b7daf72599
Nov 16 10:26:46 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:26:46 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:26:46 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee
Nov 16 10:26:46 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:26:46 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:26:46 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:11a6a15b-38c1-4e7e-b8fa-2feb6789e775
Nov 16 10:26:46 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:26:46 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:26:46 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:e1b58025-0c18-41f6-a126-fb3c925399a1
Nov 16 10:26:46 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:26:46 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:26:46 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:2006a77c-e5e8-4ec5-8de5-a0f9505c429a
Nov 16 10:26:46 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:26:46 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:26:46 user nova-compute[85141]: FIRMWARE:
Nov 16 10:26:46 user nova-compute[85141]: No targets found.
Nov 16 10:26:46 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:26:46 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b69e743-af3c-42c0-bf95-e038fda377ce tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 10:26:46 user nova-compute[85141]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 10:26:46 user nova-compute[85141]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=85141) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 10:26:46 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b69e743-af3c-42c0-bf95-e038fda377ce tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b1957d79-bfb4-4f74-bc74-1d241b5254bc', 0)] {{(pid=85141) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 10:26:46 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:26:47 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:26:47 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[db7ecfea-d509-4088-a3cc-841c2a6b003d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:11a6a15b-38c1-4e7e-b8fa-2feb6789e775\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2006a77c-e5e8-4ec5-8de5-a0f9505c429a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bb96bfcd-cecc-452f-bc3b-61b7daf72599\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e1b58025-0c18-41f6-a126-fb3c925399a1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:26:47 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:26:47 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:26:47 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[0447f45d-d488-4d72-a4c7-8a445a9d2cc7]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11a6a15b-38c1-4e7e-b8fa-2feb6789e775 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2006a77c-e5e8-4ec5-8de5-a0f9505c429a (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb96bfcd-cecc-452f-bc3b-61b7daf72599 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b58025-0c18-41f6-a126-fb3c925399a1 (non-flash)\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:26:47 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b69e743-af3c-42c0-bf95-e038fda377ce tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)
Nov 16 10:26:47 user nova-compute[85141]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11a6a15b-38c1-4e7e-b8fa-2feb6789e775 (non-flash)
Nov 16 10:26:47 user nova-compute[85141]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2006a77c-e5e8-4ec5-8de5-a0f9505c429a (non-flash)
Nov 16 10:26:47 user nova-compute[85141]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb96bfcd-cecc-452f-bc3b-61b7daf72599 (non-flash)
Nov 16 10:26:47 user nova-compute[85141]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b58025-0c18-41f6-a126-fb3c925399a1 (non-flash)
Nov 16 10:26:47 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:26:47 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b69e743-af3c-42c0-bf95-e038fda377ce tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)
Nov 16 10:26:47 user nova-compute[85141]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11a6a15b-38c1-4e7e-b8fa-2feb6789e775 (non-flash)
Nov 16 10:26:47 user nova-compute[85141]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2006a77c-e5e8-4ec5-8de5-a0f9505c429a (non-flash)
Nov 16 10:26:47 user nova-compute[85141]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb96bfcd-cecc-452f-bc3b-61b7daf72599 (non-flash)
Nov 16 10:26:47 user nova-compute[85141]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b58025-0c18-41f6-a126-fb3c925399a1 (non-flash)
Nov 16 10:26:47 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 10:26:47 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b69e743-af3c-42c0-bf95-e038fda377ce tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5160664670>, {}) {{(pid=85141) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 10:26:47 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b69e743-af3c-42c0-bf95-e038fda377ce tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Disconnecting from: [] {{(pid=85141) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 10:26:47 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-9b69e743-af3c-42c0-bf95-e038fda377ce tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.084s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 10:26:47 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b69e743-af3c-42c0-bf95-e038fda377ce tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] <== disconnect_volume: return (84ms) None {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 10:26:47 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9b69e743-af3c-42c0-bf95-e038fda377ce tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] [instance: d7dfe34a-f7ba-44b3-8898-634338161a23] Disconnected iSCSI Volume {{(pid=85141) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 10:26:47 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-9b69e743-af3c-42c0-bf95-e038fda377ce tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] [instance: d7dfe34a-f7ba-44b3-8898-634338161a23] Deleting instance files /opt/stack/data/nova/instances/d7dfe34a-f7ba-44b3-8898-634338161a23_del
Nov 16 10:26:47 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-9b69e743-af3c-42c0-bf95-e038fda377ce tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] [instance: d7dfe34a-f7ba-44b3-8898-634338161a23] Deletion of /opt/stack/data/nova/instances/d7dfe34a-f7ba-44b3-8898-634338161a23_del complete
Nov 16 10:26:47 user nova-compute[85141]: INFO nova.compute.manager [None req-9b69e743-af3c-42c0-bf95-e038fda377ce tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] [instance: d7dfe34a-f7ba-44b3-8898-634338161a23] Took 1.06 seconds to destroy the instance on the hypervisor.
Nov 16 10:26:47 user nova-compute[85141]: DEBUG oslo.service.loopingcall [None req-9b69e743-af3c-42c0-bf95-e038fda377ce tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=85141) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 10:26:47 user nova-compute[85141]: DEBUG nova.compute.manager [-] [instance: d7dfe34a-f7ba-44b3-8898-634338161a23] Deallocating network for instance {{(pid=85141) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 10:26:47 user nova-compute[85141]: DEBUG nova.network.neutron [-] [instance: d7dfe34a-f7ba-44b3-8898-634338161a23] deallocate_for_instance() {{(pid=85141) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 10:26:48 user nova-compute[85141]: DEBUG nova.network.neutron [-] [instance: d7dfe34a-f7ba-44b3-8898-634338161a23] Updating instance_info_cache with network_info: [] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:26:48 user nova-compute[85141]: DEBUG nova.compute.manager [req-82893967-d439-4241-928b-7b571f23a16d req-308cc254-ef49-463d-83b9-575e5e56bb84 service nova] [instance: d7dfe34a-f7ba-44b3-8898-634338161a23] Received event network-vif-deleted-401df940-fd58-48b0-89f4-5083130952d5 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:26:48 user nova-compute[85141]: INFO nova.compute.manager [req-82893967-d439-4241-928b-7b571f23a16d req-308cc254-ef49-463d-83b9-575e5e56bb84 service nova] [instance: d7dfe34a-f7ba-44b3-8898-634338161a23] Neutron deleted interface 401df940-fd58-48b0-89f4-5083130952d5; detaching it from the instance and deleting it from the info cache
Nov 16 10:26:48 user nova-compute[85141]: DEBUG nova.network.neutron [req-82893967-d439-4241-928b-7b571f23a16d req-308cc254-ef49-463d-83b9-575e5e56bb84 service nova] [instance: d7dfe34a-f7ba-44b3-8898-634338161a23] Updating instance_info_cache with network_info: [] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:26:48 user nova-compute[85141]: INFO nova.compute.manager [-] [instance: d7dfe34a-f7ba-44b3-8898-634338161a23] Took 1.06 seconds to deallocate network for instance.
Nov 16 10:26:48 user nova-compute[85141]: DEBUG nova.compute.manager [req-82893967-d439-4241-928b-7b571f23a16d req-308cc254-ef49-463d-83b9-575e5e56bb84 service nova] [instance: d7dfe34a-f7ba-44b3-8898-634338161a23] Detach interface failed, port_id=401df940-fd58-48b0-89f4-5083130952d5, reason: Instance d7dfe34a-f7ba-44b3-8898-634338161a23 could not be found. {{(pid=85141) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 16 10:26:48 user nova-compute[85141]: WARNING nova.volume.cinder [None req-9b69e743-af3c-42c0-bf95-e038fda377ce tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Attachment c3feaceb-42da-42c0-bb5b-6ae1c112590d does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = c3feaceb-42da-42c0-bb5b-6ae1c112590d. (HTTP 404) (Request-ID: req-17e1ce38-e762-4b32-9793-d02a99791259)
Nov 16 10:26:48 user nova-compute[85141]: INFO nova.compute.manager [None req-9b69e743-af3c-42c0-bf95-e038fda377ce tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] [instance: d7dfe34a-f7ba-44b3-8898-634338161a23] Took 0.40 seconds to detach 1 volumes for instance.
Nov 16 10:26:48 user nova-compute[85141]: DEBUG nova.compute.manager [req-ebaded25-fe99-42d7-97df-5a8162438872 req-40e10d7b-b8c1-423b-b78b-af91859e7e0f service nova] [instance: d7dfe34a-f7ba-44b3-8898-634338161a23] Received event network-vif-plugged-401df940-fd58-48b0-89f4-5083130952d5 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:26:48 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-ebaded25-fe99-42d7-97df-5a8162438872 req-40e10d7b-b8c1-423b-b78b-af91859e7e0f service nova] Acquiring lock "d7dfe34a-f7ba-44b3-8898-634338161a23-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:26:48 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-ebaded25-fe99-42d7-97df-5a8162438872 req-40e10d7b-b8c1-423b-b78b-af91859e7e0f service nova] Lock "d7dfe34a-f7ba-44b3-8898-634338161a23-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:26:48 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-ebaded25-fe99-42d7-97df-5a8162438872 req-40e10d7b-b8c1-423b-b78b-af91859e7e0f service nova] Lock "d7dfe34a-f7ba-44b3-8898-634338161a23-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:26:48 user nova-compute[85141]: DEBUG nova.compute.manager [req-ebaded25-fe99-42d7-97df-5a8162438872 req-40e10d7b-b8c1-423b-b78b-af91859e7e0f service nova] [instance: d7dfe34a-f7ba-44b3-8898-634338161a23] No waiting events found dispatching network-vif-plugged-401df940-fd58-48b0-89f4-5083130952d5 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:26:48 user nova-compute[85141]: WARNING nova.compute.manager [req-ebaded25-fe99-42d7-97df-5a8162438872 req-40e10d7b-b8c1-423b-b78b-af91859e7e0f service nova] [instance: d7dfe34a-f7ba-44b3-8898-634338161a23] Received unexpected event network-vif-plugged-401df940-fd58-48b0-89f4-5083130952d5 for instance with vm_state active and task_state deleting.
Nov 16 10:26:48 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-9b69e743-af3c-42c0-bf95-e038fda377ce tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:26:48 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-9b69e743-af3c-42c0-bf95-e038fda377ce tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:26:48 user nova-compute[85141]: DEBUG nova.compute.provider_tree [None req-9b69e743-af3c-42c0-bf95-e038fda377ce tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Inventory has not changed in ProviderTree for provider: bf8e0fa1-16b6-408f-9203-c4cd63916272 {{(pid=85141) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 10:26:48 user nova-compute[85141]: DEBUG nova.scheduler.client.report [None req-9b69e743-af3c-42c0-bf95-e038fda377ce tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Inventory has not changed for provider bf8e0fa1-16b6-408f-9203-c4cd63916272 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=85141) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 10:26:49 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-9b69e743-af3c-42c0-bf95-e038fda377ce tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.400s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:26:49 user nova-compute[85141]: INFO nova.scheduler.client.report [None req-9b69e743-af3c-42c0-bf95-e038fda377ce tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Deleted allocations for instance d7dfe34a-f7ba-44b3-8898-634338161a23
Nov 16 10:26:49 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-9b69e743-af3c-42c0-bf95-e038fda377ce tempest-VolumesSnapshotTestJSON-790088929 tempest-VolumesSnapshotTestJSON-790088929-project-member] Lock "d7dfe34a-f7ba-44b3-8898-634338161a23" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.120s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:26:51 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:26:53 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:26:56 user nova-compute[85141]: DEBUG nova.compute.manager [req-f7df78c1-9359-4b76-9a36-35e06dbf79eb req-4ef8b612-3919-4437-abdd-bc24a4587dc8 service nova] [instance: 059d6974-bd0c-4f73-91fc-8202ebda4238] Received event network-changed-89bf502f-593d-4c6e-aa83-a041e0ad7b28 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:26:56 user nova-compute[85141]: DEBUG nova.compute.manager [req-f7df78c1-9359-4b76-9a36-35e06dbf79eb req-4ef8b612-3919-4437-abdd-bc24a4587dc8 service nova] [instance: 059d6974-bd0c-4f73-91fc-8202ebda4238] Refreshing instance network info cache due to event network-changed-89bf502f-593d-4c6e-aa83-a041e0ad7b28. {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 10:26:56 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-f7df78c1-9359-4b76-9a36-35e06dbf79eb req-4ef8b612-3919-4437-abdd-bc24a4587dc8 service nova] Acquiring lock "refresh_cache-059d6974-bd0c-4f73-91fc-8202ebda4238" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:26:56 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-f7df78c1-9359-4b76-9a36-35e06dbf79eb req-4ef8b612-3919-4437-abdd-bc24a4587dc8 service nova] Acquired lock "refresh_cache-059d6974-bd0c-4f73-91fc-8202ebda4238" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:26:56 user nova-compute[85141]: DEBUG nova.network.neutron [req-f7df78c1-9359-4b76-9a36-35e06dbf79eb req-4ef8b612-3919-4437-abdd-bc24a4587dc8 service nova] [instance: 059d6974-bd0c-4f73-91fc-8202ebda4238] Refreshing network info cache for port 89bf502f-593d-4c6e-aa83-a041e0ad7b28 {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 10:26:56 user nova-compute[85141]: DEBUG nova.network.neutron [req-f7df78c1-9359-4b76-9a36-35e06dbf79eb req-4ef8b612-3919-4437-abdd-bc24a4587dc8 service nova] [instance: 059d6974-bd0c-4f73-91fc-8202ebda4238] Updated VIF entry in instance network info cache for port 89bf502f-593d-4c6e-aa83-a041e0ad7b28. {{(pid=85141) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 10:26:56 user nova-compute[85141]: DEBUG nova.network.neutron [req-f7df78c1-9359-4b76-9a36-35e06dbf79eb req-4ef8b612-3919-4437-abdd-bc24a4587dc8 service nova] [instance: 059d6974-bd0c-4f73-91fc-8202ebda4238] Updating instance_info_cache with network_info: [{"id": "89bf502f-593d-4c6e-aa83-a041e0ad7b28", "address": "fa:16:3e:40:09:f4", "network": {"id": "859d1f09-56c4-4c2b-b2c3-02b1938e8dbf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1562516834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "879fa3f4dfc34726b20149b8a7db22dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89bf502f-59", "ovs_interfaceid": "89bf502f-593d-4c6e-aa83-a041e0ad7b28", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:26:56 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-f7df78c1-9359-4b76-9a36-35e06dbf79eb req-4ef8b612-3919-4437-abdd-bc24a4587dc8 service nova] Releasing lock "refresh_cache-059d6974-bd0c-4f73-91fc-8202ebda4238" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:26:56 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:26:57 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._sync_power_states {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:26:57 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Triggering sync for uuid d842f90e-663b-4c95-9d7c-d092d2bac41f {{(pid=85141) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 16 10:26:57 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Triggering sync for uuid f01dc8cf-1a69-4618-a15d-0c1075157f05 {{(pid=85141) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 16 10:26:57 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Triggering sync for uuid 059d6974-bd0c-4f73-91fc-8202ebda4238 {{(pid=85141) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 16 10:26:57 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Triggering sync for uuid 4e214bbb-5bbb-4e6f-ac09-9cb1412f068b {{(pid=85141) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 16 10:26:57 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Triggering sync for uuid b24c3954-06ff-4e15-9e43-c65d1dae7a5d {{(pid=85141) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 16 10:26:57 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Triggering sync for uuid 0b388b98-4e65-4258-bbe2-77e699321fb7 {{(pid=85141) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 16 10:26:57 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Triggering sync for uuid 11986c5b-6914-491e-8e71-983ab6b13c6e {{(pid=85141) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 16 10:26:57 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Triggering sync for uuid abe5d4b7-a0d7-40e3-b630-0de746ddb55b {{(pid=85141) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 16 10:26:57 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Triggering sync for uuid 17480138-4b61-43f7-92a5-db065f7d1696 {{(pid=85141) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 16 10:26:57 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Triggering sync for uuid 463034ff-14ce-477a-9642-4d86aa6f9cd9 {{(pid=85141) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 16 10:26:57 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Triggering sync for uuid 5a507c85-0369-48ea-8858-3e7d346b4cb0 {{(pid=85141) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 16 10:26:57 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Triggering sync for uuid bc76703d-9243-4277-9b13-d6f9639cd1bb {{(pid=85141) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 16 10:26:57 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Triggering sync for uuid 2b4347a0-a9f0-4e4c-9d7a-30d984fa35a9 {{(pid=85141) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 16 10:26:57 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Triggering sync for uuid 9fcf8335-9e6f-4878-a3e2-c68aeab0978e {{(pid=85141) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 16 10:26:57 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Acquiring lock "d842f90e-663b-4c95-9d7c-d092d2bac41f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:26:57 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "d842f90e-663b-4c95-9d7c-d092d2bac41f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:26:57 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Acquiring lock "f01dc8cf-1a69-4618-a15d-0c1075157f05" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:26:57 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "f01dc8cf-1a69-4618-a15d-0c1075157f05" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:26:57 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Acquiring lock "059d6974-bd0c-4f73-91fc-8202ebda4238" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:26:57 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "059d6974-bd0c-4f73-91fc-8202ebda4238" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:26:57 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Acquiring lock "4e214bbb-5bbb-4e6f-ac09-9cb1412f068b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:26:57 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "4e214bbb-5bbb-4e6f-ac09-9cb1412f068b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:26:57 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Acquiring lock "b24c3954-06ff-4e15-9e43-c65d1dae7a5d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:26:57 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "b24c3954-06ff-4e15-9e43-c65d1dae7a5d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:26:57 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Acquiring lock "0b388b98-4e65-4258-bbe2-77e699321fb7" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:26:57 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "0b388b98-4e65-4258-bbe2-77e699321fb7" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:26:57 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Acquiring lock "11986c5b-6914-491e-8e71-983ab6b13c6e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:26:57 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "11986c5b-6914-491e-8e71-983ab6b13c6e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:26:57 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Acquiring lock "abe5d4b7-a0d7-40e3-b630-0de746ddb55b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:26:57 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "abe5d4b7-a0d7-40e3-b630-0de746ddb55b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:26:57 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Acquiring lock "17480138-4b61-43f7-92a5-db065f7d1696" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:26:57 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "17480138-4b61-43f7-92a5-db065f7d1696" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:26:57 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Acquiring lock "463034ff-14ce-477a-9642-4d86aa6f9cd9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:26:57 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "463034ff-14ce-477a-9642-4d86aa6f9cd9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:26:57 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Acquiring lock "5a507c85-0369-48ea-8858-3e7d346b4cb0" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:26:57 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "5a507c85-0369-48ea-8858-3e7d346b4cb0" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:26:57 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Acquiring lock "bc76703d-9243-4277-9b13-d6f9639cd1bb" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:26:57 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "bc76703d-9243-4277-9b13-d6f9639cd1bb" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:26:57 user nova-compute[85141]: INFO nova.compute.manager [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] [instance: bc76703d-9243-4277-9b13-d6f9639cd1bb] During sync_power_state the instance has a pending task (resize_prep). Skip.
Nov 16 10:26:57 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "bc76703d-9243-4277-9b13-d6f9639cd1bb" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:26:57 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Acquiring lock "2b4347a0-a9f0-4e4c-9d7a-30d984fa35a9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:26:57 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "2b4347a0-a9f0-4e4c-9d7a-30d984fa35a9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:26:57 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Acquiring lock "9fcf8335-9e6f-4878-a3e2-c68aeab0978e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:26:57 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "9fcf8335-9e6f-4878-a3e2-c68aeab0978e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:26:57 user nova-compute[85141]: DEBUG nova.compute.manager [None req-1464c2f2-0e5e-482c-acda-4792fe518c72 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] [instance: bc76703d-9243-4277-9b13-d6f9639cd1bb] Stashing vm_state: active {{(pid=85141) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Nov 16 10:26:57 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "d842f90e-663b-4c95-9d7c-d092d2bac41f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.061s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:26:57 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "f01dc8cf-1a69-4618-a15d-0c1075157f05" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.064s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:26:57 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "059d6974-bd0c-4f73-91fc-8202ebda4238" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.078s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:26:57 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "4e214bbb-5bbb-4e6f-ac09-9cb1412f068b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.087s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:26:57 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "0b388b98-4e65-4258-bbe2-77e699321fb7" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.090s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:26:57 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "11986c5b-6914-491e-8e71-983ab6b13c6e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.094s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:26:57 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "b24c3954-06ff-4e15-9e43-c65d1dae7a5d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.108s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:26:57 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "abe5d4b7-a0d7-40e3-b630-0de746ddb55b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.111s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:26:57 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "17480138-4b61-43f7-92a5-db065f7d1696" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.112s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:26:57 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "463034ff-14ce-477a-9642-4d86aa6f9cd9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.118s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:26:57 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "2b4347a0-a9f0-4e4c-9d7a-30d984fa35a9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.122s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:26:57 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "9fcf8335-9e6f-4878-a3e2-c68aeab0978e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.126s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:26:57 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "5a507c85-0369-48ea-8858-3e7d346b4cb0" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.130s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:26:57 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-1464c2f2-0e5e-482c-acda-4792fe518c72 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:26:57 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-1464c2f2-0e5e-482c-acda-4792fe518c72 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:26:57 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-1464c2f2-0e5e-482c-acda-4792fe518c72 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=85141) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 10:26:57 user nova-compute[85141]: INFO nova.compute.claims [None req-1464c2f2-0e5e-482c-acda-4792fe518c72 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] [instance: bc76703d-9243-4277-9b13-d6f9639cd1bb] Claim successful on node user
Nov 16 10:26:57 user nova-compute[85141]: INFO nova.compute.resource_tracker [None req-1464c2f2-0e5e-482c-acda-4792fe518c72 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] [instance: bc76703d-9243-4277-9b13-d6f9639cd1bb] Updating resource usage from migration 72c5d793-592e-4c2f-a692-665458d8517a
Nov 16 10:26:58 user nova-compute[85141]: DEBUG nova.compute.provider_tree [None req-1464c2f2-0e5e-482c-acda-4792fe518c72 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Inventory has not changed in ProviderTree for provider: bf8e0fa1-16b6-408f-9203-c4cd63916272 {{(pid=85141) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 10:26:58 user nova-compute[85141]: DEBUG nova.scheduler.client.report [None req-1464c2f2-0e5e-482c-acda-4792fe518c72 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Inventory has not changed for provider bf8e0fa1-16b6-408f-9203-c4cd63916272 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=85141) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 10:26:58 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-1464c2f2-0e5e-482c-acda-4792fe518c72 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.483s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:26:58 user nova-compute[85141]: INFO nova.compute.manager [None req-1464c2f2-0e5e-482c-acda-4792fe518c72 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] [instance: bc76703d-9243-4277-9b13-d6f9639cd1bb] Migrating
Nov 16 10:26:58 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:26:58 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-1464c2f2-0e5e-482c-acda-4792fe518c72 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Acquiring lock "refresh_cache-bc76703d-9243-4277-9b13-d6f9639cd1bb" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:26:58 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-1464c2f2-0e5e-482c-acda-4792fe518c72 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Acquired lock "refresh_cache-bc76703d-9243-4277-9b13-d6f9639cd1bb" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:26:58 user nova-compute[85141]: DEBUG nova.network.neutron [None req-1464c2f2-0e5e-482c-acda-4792fe518c72 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] [instance: bc76703d-9243-4277-9b13-d6f9639cd1bb] Building network info cache for instance {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 10:26:58 user nova-compute[85141]: DEBUG nova.compute.manager [req-cd3c41d9-6694-4e26-b6ad-dac458ce0267 req-117d5333-e71c-4ead-87c3-c13e9c71d0c1 service nova] [instance: bc76703d-9243-4277-9b13-d6f9639cd1bb] Received event network-changed-fbf147e2-d8e0-4cb5-8ec5-79756fc53140 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:26:58 user nova-compute[85141]: DEBUG nova.compute.manager [req-cd3c41d9-6694-4e26-b6ad-dac458ce0267 req-117d5333-e71c-4ead-87c3-c13e9c71d0c1 service nova] [instance: bc76703d-9243-4277-9b13-d6f9639cd1bb] Refreshing instance network info cache due to event network-changed-fbf147e2-d8e0-4cb5-8ec5-79756fc53140. {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 10:26:58 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-cd3c41d9-6694-4e26-b6ad-dac458ce0267 req-117d5333-e71c-4ead-87c3-c13e9c71d0c1 service nova] Acquiring lock "refresh_cache-bc76703d-9243-4277-9b13-d6f9639cd1bb" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:26:58 user nova-compute[85141]: DEBUG nova.network.neutron [None req-1464c2f2-0e5e-482c-acda-4792fe518c72 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] [instance: bc76703d-9243-4277-9b13-d6f9639cd1bb] Updating instance_info_cache with network_info: [{"id": "fbf147e2-d8e0-4cb5-8ec5-79756fc53140", "address": "fa:16:3e:a1:42:09", "network": {"id": "859d1f09-56c4-4c2b-b2c3-02b1938e8dbf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1562516834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "879fa3f4dfc34726b20149b8a7db22dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbf147e2-d8", "ovs_interfaceid": "fbf147e2-d8e0-4cb5-8ec5-79756fc53140", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:26:58 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-1464c2f2-0e5e-482c-acda-4792fe518c72 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Releasing lock "refresh_cache-bc76703d-9243-4277-9b13-d6f9639cd1bb" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:26:58 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-cd3c41d9-6694-4e26-b6ad-dac458ce0267 req-117d5333-e71c-4ead-87c3-c13e9c71d0c1 service nova] Acquired lock "refresh_cache-bc76703d-9243-4277-9b13-d6f9639cd1bb" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:26:58 user nova-compute[85141]: DEBUG nova.network.neutron [req-cd3c41d9-6694-4e26-b6ad-dac458ce0267 req-117d5333-e71c-4ead-87c3-c13e9c71d0c1 service nova] [instance: bc76703d-9243-4277-9b13-d6f9639cd1bb] Refreshing network info cache for port fbf147e2-d8e0-4cb5-8ec5-79756fc53140 {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 10:26:58 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-1464c2f2-0e5e-482c-acda-4792fe518c72 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] [instance: bc76703d-9243-4277-9b13-d6f9639cd1bb] Starting migrate_disk_and_power_off {{(pid=85141) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Nov 16 10:26:58 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:26:58 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:26:59 user nova-compute[85141]: DEBUG nova.network.neutron [req-cd3c41d9-6694-4e26-b6ad-dac458ce0267 req-117d5333-e71c-4ead-87c3-c13e9c71d0c1 service nova] [instance: bc76703d-9243-4277-9b13-d6f9639cd1bb] Updated VIF entry in instance network info cache for port fbf147e2-d8e0-4cb5-8ec5-79756fc53140. {{(pid=85141) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 10:26:59 user nova-compute[85141]: DEBUG nova.network.neutron [req-cd3c41d9-6694-4e26-b6ad-dac458ce0267 req-117d5333-e71c-4ead-87c3-c13e9c71d0c1 service nova] [instance: bc76703d-9243-4277-9b13-d6f9639cd1bb] Updating instance_info_cache with network_info: [{"id": "fbf147e2-d8e0-4cb5-8ec5-79756fc53140", "address": "fa:16:3e:a1:42:09", "network": {"id": "859d1f09-56c4-4c2b-b2c3-02b1938e8dbf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1562516834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "879fa3f4dfc34726b20149b8a7db22dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbf147e2-d8", "ovs_interfaceid": "fbf147e2-d8e0-4cb5-8ec5-79756fc53140", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:26:59 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-cd3c41d9-6694-4e26-b6ad-dac458ce0267 req-117d5333-e71c-4ead-87c3-c13e9c71d0c1 service nova] Releasing lock "refresh_cache-bc76703d-9243-4277-9b13-d6f9639cd1bb" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:26:59 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:26:59 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:26:59 user nova-compute[85141]: DEBUG nova.compute.manager [req-1d1644aa-5d9a-4f04-b684-d2d77755be81 req-85aa15d1-9914-4c56-9b63-97186f398dd7 service nova] [instance: bc76703d-9243-4277-9b13-d6f9639cd1bb] Received event network-vif-unplugged-fbf147e2-d8e0-4cb5-8ec5-79756fc53140 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:26:59 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-1d1644aa-5d9a-4f04-b684-d2d77755be81 req-85aa15d1-9914-4c56-9b63-97186f398dd7 service nova] Acquiring lock "bc76703d-9243-4277-9b13-d6f9639cd1bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:26:59 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-1d1644aa-5d9a-4f04-b684-d2d77755be81 req-85aa15d1-9914-4c56-9b63-97186f398dd7 service nova] Lock "bc76703d-9243-4277-9b13-d6f9639cd1bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:26:59 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-1d1644aa-5d9a-4f04-b684-d2d77755be81 req-85aa15d1-9914-4c56-9b63-97186f398dd7 service nova] Lock "bc76703d-9243-4277-9b13-d6f9639cd1bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:26:59 user nova-compute[85141]: DEBUG nova.compute.manager [req-1d1644aa-5d9a-4f04-b684-d2d77755be81 req-85aa15d1-9914-4c56-9b63-97186f398dd7 service nova] [instance: bc76703d-9243-4277-9b13-d6f9639cd1bb] No waiting events found dispatching network-vif-unplugged-fbf147e2-d8e0-4cb5-8ec5-79756fc53140 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:26:59 user nova-compute[85141]: WARNING nova.compute.manager [req-1d1644aa-5d9a-4f04-b684-d2d77755be81 req-85aa15d1-9914-4c56-9b63-97186f398dd7 service nova] [instance: bc76703d-9243-4277-9b13-d6f9639cd1bb] Received unexpected event network-vif-unplugged-fbf147e2-d8e0-4cb5-8ec5-79756fc53140 for instance with vm_state active and task_state resize_migrating.
Nov 16 10:26:59 user nova-compute[85141]: INFO nova.virt.libvirt.driver [-] [instance: bc76703d-9243-4277-9b13-d6f9639cd1bb] Instance destroyed successfully.
Nov 16 10:26:59 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-1464c2f2-0e5e-482c-acda-4792fe518c72 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T10:25:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-331499197',display_name='tempest-ServerActionsTestOtherA-server-331499197',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-331499197',id=34,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFB91nOE4JIg0PQZ9Fq9iMRTb/Qm6bpwHSXAkC8g5YxG6awy4b4nS0XAfWSm4O4f40Blu3eMfyuYdZY8eI6KFpQYslLrgvG2jeJNbK6AHNNiLWxDV8sQbQZDDAy7NeOUMQ==',key_name='tempest-keypair-799272913',keypairs=<?>,launch_index=0,launched_at=2023-11-16T10:25:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='879fa3f4dfc34726b20149b8a7db22dc',ramdisk_id='',reservation_id='r-01yoy1pt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1137992555',owner_user_name='tempest-ServerActionsTestOtherA-1137992555-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T10:26:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e95802a919de4345add493a8d7873e48',uuid=bc76703d-9243-4277-9b13-d6f9639cd1bb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fbf147e2-d8e0-4cb5-8ec5-79756fc53140", "address": "fa:16:3e:a1:42:09", "network": {"id": "859d1f09-56c4-4c2b-b2c3-02b1938e8dbf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1562516834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1562516834-network", "vif_mac": "fa:16:3e:a1:42:09"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "879fa3f4dfc34726b20149b8a7db22dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbf147e2-d8", "ovs_interfaceid": "fbf147e2-d8e0-4cb5-8ec5-79756fc53140", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 10:26:59 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-1464c2f2-0e5e-482c-acda-4792fe518c72 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Converting VIF {"id": "fbf147e2-d8e0-4cb5-8ec5-79756fc53140", "address": "fa:16:3e:a1:42:09", "network": {"id": "859d1f09-56c4-4c2b-b2c3-02b1938e8dbf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1562516834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1562516834-network", "vif_mac": "fa:16:3e:a1:42:09"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "879fa3f4dfc34726b20149b8a7db22dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbf147e2-d8", "ovs_interfaceid": "fbf147e2-d8e0-4cb5-8ec5-79756fc53140", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:26:59 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-1464c2f2-0e5e-482c-acda-4792fe518c72 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a1:42:09,bridge_name='br-int',has_traffic_filtering=True,id=fbf147e2-d8e0-4cb5-8ec5-79756fc53140,network=Network(859d1f09-56c4-4c2b-b2c3-02b1938e8dbf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfbf147e2-d8') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:26:59 user nova-compute[85141]: DEBUG os_vif [None req-1464c2f2-0e5e-482c-acda-4792fe518c72 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a1:42:09,bridge_name='br-int',has_traffic_filtering=True,id=fbf147e2-d8e0-4cb5-8ec5-79756fc53140,network=Network(859d1f09-56c4-4c2b-b2c3-02b1938e8dbf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfbf147e2-d8') {{(pid=85141) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 10:26:59 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:26:59 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfbf147e2-d8, bridge=br-int, if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:26:59 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:26:59 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:26:59 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:26:59 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:26:59 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6f187b70-cd36-4bb9-a335-ff4b4e3298a0) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:26:59 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:26:59 user nova-compute[85141]: INFO os_vif [None req-1464c2f2-0e5e-482c-acda-4792fe518c72 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a1:42:09,bridge_name='br-int',has_traffic_filtering=True,id=fbf147e2-d8e0-4cb5-8ec5-79756fc53140,network=Network(859d1f09-56c4-4c2b-b2c3-02b1938e8dbf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfbf147e2-d8')
Nov 16 10:26:59 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1464c2f2-0e5e-482c-acda-4792fe518c72 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] [instance: bc76703d-9243-4277-9b13-d6f9639cd1bb] calling os-brick to detach iSCSI Volume {{(pid=85141) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 10:26:59 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-1464c2f2-0e5e-482c-acda-4792fe518c72 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51806b6080>, {'target_iqn': 'iqn.2010-10.org.openstack:2006a77c-e5e8-4ec5-8de5-a0f9505c429a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vdtqwVjE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 10:26:59 user nova-compute[85141]: WARNING os_brick.initiator.connectors.base [None req-1464c2f2-0e5e-482c-acda-4792fe518c72 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 10:26:59 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-1464c2f2-0e5e-482c-acda-4792fe518c72 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 10:26:59 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-1464c2f2-0e5e-482c-acda-4792fe518c72 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 10:26:59 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:26:59 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:26:59 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a93a7c3-ac28-411c-aa44-c7a6679bd29a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:bb96bfcd-cecc-452f-bc3b-61b7daf72599\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:11a6a15b-38c1-4e7e-b8fa-2feb6789e775\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e1b58025-0c18-41f6-a126-fb3c925399a1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2006a77c-e5e8-4ec5-8de5-a0f9505c429a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:26:59 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-1464c2f2-0e5e-482c-acda-4792fe518c72 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 10:26:59 user nova-compute[85141]: No targets found.
Nov 16 10:26:59 user nova-compute[85141]: iSNS:
Nov 16 10:26:59 user nova-compute[85141]: No targets found.
Nov 16 10:26:59 user nova-compute[85141]: STATIC:
Nov 16 10:26:59 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:bb96bfcd-cecc-452f-bc3b-61b7daf72599
Nov 16 10:26:59 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:26:59 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:26:59 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee
Nov 16 10:26:59 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:26:59 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:26:59 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:11a6a15b-38c1-4e7e-b8fa-2feb6789e775
Nov 16 10:26:59 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:26:59 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:26:59 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:e1b58025-0c18-41f6-a126-fb3c925399a1
Nov 16 10:26:59 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:26:59 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:26:59 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:2006a77c-e5e8-4ec5-8de5-a0f9505c429a
Nov 16 10:26:59 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:26:59 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:26:59 user nova-compute[85141]: FIRMWARE:
Nov 16 10:26:59 user nova-compute[85141]: No targets found.
Nov 16 10:26:59 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:26:59 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-1464c2f2-0e5e-482c-acda-4792fe518c72 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 10:26:59 user nova-compute[85141]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 10:26:59 user nova-compute[85141]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=85141) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 10:26:59 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-1464c2f2-0e5e-482c-acda-4792fe518c72 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2006a77c-e5e8-4ec5-8de5-a0f9505c429a', 0)] {{(pid=85141) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 10:26:59 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:26:59 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:26:59 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[268a96cb-5ca4-4dff-bead-6d5a203889b2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:11a6a15b-38c1-4e7e-b8fa-2feb6789e775\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2006a77c-e5e8-4ec5-8de5-a0f9505c429a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bb96bfcd-cecc-452f-bc3b-61b7daf72599\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e1b58025-0c18-41f6-a126-fb3c925399a1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:26:59 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:26:59 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:26:59 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[616006d6-374f-4dde-9be5-98334783c542]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11a6a15b-38c1-4e7e-b8fa-2feb6789e775 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2006a77c-e5e8-4ec5-8de5-a0f9505c429a (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb96bfcd-cecc-452f-bc3b-61b7daf72599 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b58025-0c18-41f6-a126-fb3c925399a1 (non-flash)\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:26:59 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-1464c2f2-0e5e-482c-acda-4792fe518c72 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)
Nov 16 10:26:59 user nova-compute[85141]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11a6a15b-38c1-4e7e-b8fa-2feb6789e775 (non-flash)
Nov 16 10:26:59 user nova-compute[85141]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2006a77c-e5e8-4ec5-8de5-a0f9505c429a (non-flash)
Nov 16 10:26:59 user nova-compute[85141]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb96bfcd-cecc-452f-bc3b-61b7daf72599 (non-flash)
Nov 16 10:26:59 user nova-compute[85141]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b58025-0c18-41f6-a126-fb3c925399a1 (non-flash)
Nov 16 10:26:59 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:26:59 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-1464c2f2-0e5e-482c-acda-4792fe518c72 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)
Nov 16 10:26:59 user nova-compute[85141]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11a6a15b-38c1-4e7e-b8fa-2feb6789e775 (non-flash)
Nov 16 10:26:59 user nova-compute[85141]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2006a77c-e5e8-4ec5-8de5-a0f9505c429a (non-flash)
Nov 16 10:26:59 user nova-compute[85141]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb96bfcd-cecc-452f-bc3b-61b7daf72599 (non-flash)
Nov 16 10:26:59 user nova-compute[85141]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b58025-0c18-41f6-a126-fb3c925399a1 (non-flash)
Nov 16 10:26:59 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 10:26:59 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-1464c2f2-0e5e-482c-acda-4792fe518c72 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f51a09b6a70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2006a77c-e5e8-4ec5-8de5-a0f9505c429a'): ({'sde'}, set())}) {{(pid=85141) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 10:26:59 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-1464c2f2-0e5e-482c-acda-4792fe518c72 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Removing single pathed devices sde {{(pid=85141) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 10:26:59 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:26:59 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:26:59 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[46dc9149-40f5-416b-b48c-54f2d7c08ffc]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:26:59 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:26:59 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.017s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:26:59 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[650b134c-2e92-45ac-968b-4d629b57f55d]: (4, ('ok\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:26:59 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-1464c2f2-0e5e-482c-acda-4792fe518c72 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Flushing IO for device /dev/sde {{(pid=85141) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 10:26:59 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:26:59 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:26:59 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c1f4eb8-37ee-4284-813b-7f10bfa54693]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:26:59 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-1464c2f2-0e5e-482c-acda-4792fe518c72 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=85141) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 10:26:59 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:26:59 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.058s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:26:59 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[65df7293-ce53-4351-8906-a09047cf9ad3]: (4, ('1', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:26:59 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-1464c2f2-0e5e-482c-acda-4792fe518c72 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=85141) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 10:26:59 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-1464c2f2-0e5e-482c-acda-4792fe518c72 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] SCSI volumes sde have been removed. {{(pid=85141) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 10:26:59 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-1464c2f2-0e5e-482c-acda-4792fe518c72 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2006a77c-e5e8-4ec5-8de5-a0f9505c429a')] {{(pid=85141) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 10:26:59 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2006a77c-e5e8-4ec5-8de5-a0f9505c429a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:26:59 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2006a77c-e5e8-4ec5-8de5-a0f9505c429a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:26:59 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[d14b011a-41be-49c8-95fa-646d68de3ba9]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:26:59 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-1464c2f2-0e5e-482c-acda-4792fe518c72 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:26:59 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2006a77c-e5e8-4ec5-8de5-a0f9505c429a -p 172.16.0.220:3260 --logout {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:26:59 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2006a77c-e5e8-4ec5-8de5-a0f9505c429a -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:26:59 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4ad416c-1ca8-49d6-99f2-495095d94af4]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:2006a77c-e5e8-4ec5-8de5-a0f9505c429a, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:2006a77c-e5e8-4ec5-8de5-a0f9505c429a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:26:59 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-1464c2f2-0e5e-482c-acda-4792fe518c72 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:2006a77c-e5e8-4ec5-8de5-a0f9505c429a, portal: 172.16.0.220,3260]
Nov 16 10:26:59 user nova-compute[85141]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:2006a77c-e5e8-4ec5-8de5-a0f9505c429a, portal: 172.16.0.220,3260] successful.
Nov 16 10:26:59 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:26:59 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2006a77c-e5e8-4ec5-8de5-a0f9505c429a -p 172.16.0.220:3260 --op delete {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:26:59 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2006a77c-e5e8-4ec5-8de5-a0f9505c429a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:26:59 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6e44209-7b52-40a4-bdc2-a0f8a804b784]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:26:59 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-1464c2f2-0e5e-482c-acda-4792fe518c72 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:26:59 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-1464c2f2-0e5e-482c-acda-4792fe518c72 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.318s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 10:26:59 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-1464c2f2-0e5e-482c-acda-4792fe518c72 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] <== disconnect_volume: return (319ms) None {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 10:26:59 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1464c2f2-0e5e-482c-acda-4792fe518c72 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] [instance: bc76703d-9243-4277-9b13-d6f9639cd1bb] Disconnected iSCSI Volume {{(pid=85141) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 10:26:59 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-1464c2f2-0e5e-482c-acda-4792fe518c72 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] skipping disk /dev/sde (vda) as it is a volume {{(pid=85141) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 10:27:00 user nova-compute[85141]: DEBUG nova.network.neutron [None req-1464c2f2-0e5e-482c-acda-4792fe518c72 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] [instance: bc76703d-9243-4277-9b13-d6f9639cd1bb] Port fbf147e2-d8e0-4cb5-8ec5-79756fc53140 binding to destination host user is already ACTIVE {{(pid=85141) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 16 10:27:00 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-1464c2f2-0e5e-482c-acda-4792fe518c72 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Acquiring lock "bc76703d-9243-4277-9b13-d6f9639cd1bb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:27:00 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-1464c2f2-0e5e-482c-acda-4792fe518c72 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Lock "bc76703d-9243-4277-9b13-d6f9639cd1bb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:27:00 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-1464c2f2-0e5e-482c-acda-4792fe518c72 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Lock "bc76703d-9243-4277-9b13-d6f9639cd1bb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:27:01 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-1464c2f2-0e5e-482c-acda-4792fe518c72 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Acquiring lock "refresh_cache-bc76703d-9243-4277-9b13-d6f9639cd1bb" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:27:01 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-1464c2f2-0e5e-482c-acda-4792fe518c72 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Acquired lock "refresh_cache-bc76703d-9243-4277-9b13-d6f9639cd1bb" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:27:01 user nova-compute[85141]: DEBUG nova.network.neutron [None req-1464c2f2-0e5e-482c-acda-4792fe518c72 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] [instance: bc76703d-9243-4277-9b13-d6f9639cd1bb] Building network info cache for instance {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 10:27:01 user nova-compute[85141]: DEBUG nova.compute.manager [req-b405c8c3-29dc-4d51-83b3-34f449bbb090 req-18698278-ac03-4467-bfef-fef2d49e41a8 service nova] [instance: bc76703d-9243-4277-9b13-d6f9639cd1bb] Received event network-vif-plugged-fbf147e2-d8e0-4cb5-8ec5-79756fc53140 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:27:01 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-b405c8c3-29dc-4d51-83b3-34f449bbb090 req-18698278-ac03-4467-bfef-fef2d49e41a8 service nova] Acquiring lock "bc76703d-9243-4277-9b13-d6f9639cd1bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:27:01 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-b405c8c3-29dc-4d51-83b3-34f449bbb090 req-18698278-ac03-4467-bfef-fef2d49e41a8 service nova] Lock "bc76703d-9243-4277-9b13-d6f9639cd1bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:27:01 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-b405c8c3-29dc-4d51-83b3-34f449bbb090 req-18698278-ac03-4467-bfef-fef2d49e41a8 service nova] Lock "bc76703d-9243-4277-9b13-d6f9639cd1bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:27:01 user nova-compute[85141]: DEBUG nova.compute.manager [req-b405c8c3-29dc-4d51-83b3-34f449bbb090 req-18698278-ac03-4467-bfef-fef2d49e41a8 service nova] [instance: bc76703d-9243-4277-9b13-d6f9639cd1bb] No waiting events found dispatching network-vif-plugged-fbf147e2-d8e0-4cb5-8ec5-79756fc53140 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:27:01 user nova-compute[85141]: WARNING nova.compute.manager [req-b405c8c3-29dc-4d51-83b3-34f449bbb090 req-18698278-ac03-4467-bfef-fef2d49e41a8 service nova] [instance: bc76703d-9243-4277-9b13-d6f9639cd1bb] Received unexpected event network-vif-plugged-fbf147e2-d8e0-4cb5-8ec5-79756fc53140 for instance with vm_state active and task_state resize_migrated.
Nov 16 10:27:01 user nova-compute[85141]: DEBUG nova.network.neutron [None req-1464c2f2-0e5e-482c-acda-4792fe518c72 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] [instance: bc76703d-9243-4277-9b13-d6f9639cd1bb] Updating instance_info_cache with network_info: [{"id": "fbf147e2-d8e0-4cb5-8ec5-79756fc53140", "address": "fa:16:3e:a1:42:09", "network": {"id": "859d1f09-56c4-4c2b-b2c3-02b1938e8dbf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1562516834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "879fa3f4dfc34726b20149b8a7db22dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbf147e2-d8", "ovs_interfaceid": "fbf147e2-d8e0-4cb5-8ec5-79756fc53140", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:27:01 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-1464c2f2-0e5e-482c-acda-4792fe518c72 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Releasing lock "refresh_cache-bc76703d-9243-4277-9b13-d6f9639cd1bb" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:27:01 user nova-compute[85141]: DEBUG os_brick.utils [None req-1464c2f2-0e5e-482c-acda-4792fe518c72 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 10:27:01 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:27:01 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:27:01 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[affc973e-a2a6-4fde-8c97-8fc0c4055d88]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c7834de5c295\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:27:01 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:27:01 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:27:01 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[d705affa-61f9-44f3-88be-f33fcac07d40]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:27:01 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:27:01 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:27:01 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a31dc34-6869-4192-a5df-a0c64a103492]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:27:01 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[147226ad-17b0-4e47-83cf-f448e4184f37]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:27:01 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-1464c2f2-0e5e-482c-acda-4792fe518c72 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Running cmd (subprocess): nvme version {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:27:01 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-1464c2f2-0e5e-482c-acda-4792fe518c72 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] 'nvme version' failed. Not Retrying. {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 10:27:01 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1464c2f2-0e5e-482c-acda-4792fe518c72 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] nvme not present on system {{(pid=85141) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 10:27:01 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:27:01 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 10:27:01 user nova-compute[85141]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 10:27:01 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[32c29332-731e-4666-b54c-10539f1550e9]: (4, '') {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:27:01 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.lightos [None req-1464c2f2-0e5e-482c-acda-4792fe518c72 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=85141) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 10:27:01 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.lightos [None req-1464c2f2-0e5e-482c-acda-4792fe518c72 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=85141) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 10:27:01 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.lightos [None req-1464c2f2-0e5e-482c-acda-4792fe518c72 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] LIGHTOS: no hostnqn found. {{(pid=85141) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 10:27:01 user nova-compute[85141]: DEBUG os_brick.utils [None req-1464c2f2-0e5e-482c-acda-4792fe518c72 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c7834de5c295', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 10:27:03 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:27:04 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:27:06 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-1464c2f2-0e5e-482c-acda-4792fe518c72 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] [instance: bc76703d-9243-4277-9b13-d6f9639cd1bb] Starting finish_migration {{(pid=85141) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Nov 16 10:27:06 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-1464c2f2-0e5e-482c-acda-4792fe518c72 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] [instance: bc76703d-9243-4277-9b13-d6f9639cd1bb] Instance directory exists: not creating {{(pid=85141) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 16 10:27:06 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-1464c2f2-0e5e-482c-acda-4792fe518c72 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] [instance: bc76703d-9243-4277-9b13-d6f9639cd1bb] Creating image(s)
Nov 16 10:27:06 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-1464c2f2-0e5e-482c-acda-4792fe518c72 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] [instance: bc76703d-9243-4277-9b13-d6f9639cd1bb] Did not create local disks {{(pid=85141) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 16 10:27:06 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-1464c2f2-0e5e-482c-acda-4792fe518c72 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] [instance: bc76703d-9243-4277-9b13-d6f9639cd1bb] Ensure instance console log exists: /opt/stack/data/nova/instances/bc76703d-9243-4277-9b13-d6f9639cd1bb/console.log {{(pid=85141) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 10:27:06 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-1464c2f2-0e5e-482c-acda-4792fe518c72 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:27:06 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-1464c2f2-0e5e-482c-acda-4792fe518c72 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:27:06 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-1464c2f2-0e5e-482c-acda-4792fe518c72 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:27:06 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-1464c2f2-0e5e-482c-acda-4792fe518c72 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] [instance: bc76703d-9243-4277-9b13-d6f9639cd1bb] Start _get_guest_xml network_info=[{"id": "fbf147e2-d8e0-4cb5-8ec5-79756fc53140", "address": "fa:16:3e:a1:42:09", "network": {"id": "859d1f09-56c4-4c2b-b2c3-02b1938e8dbf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1562516834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1562516834-network", "vif_mac": "fa:16:3e:a1:42:09"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "879fa3f4dfc34726b20149b8a7db22dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbf147e2-d8", "ovs_interfaceid": "fbf147e2-d8e0-4cb5-8ec5-79756fc53140", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2006a77c-e5e8-4ec5-8de5-a0f9505c429a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vdtqwVjE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'bc76703d-9243-4277-9b13-d6f9639cd1bb', 'attached_at': '2023-11-16T10:27:07.000000', 'detached_at': '', 'volume_id': '2006a77c-e5e8-4ec5-8de5-a0f9505c429a', 'serial': '2006a77c-e5e8-4ec5-8de5-a0f9505c429a'}, 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'attachment_id': '15231e7a-8dd1-4c26-88c3-cee4f2a206e9', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=85141) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 10:27:06 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-1464c2f2-0e5e-482c-acda-4792fe518c72 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:27:06 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-1464c2f2-0e5e-482c-acda-4792fe518c72 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:27:06 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-1464c2f2-0e5e-482c-acda-4792fe518c72 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=85141) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 10:27:06 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-1464c2f2-0e5e-482c-acda-4792fe518c72 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] CPU controller missing on host. {{(pid=85141) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 10:27:06 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-1464c2f2-0e5e-482c-acda-4792fe518c72 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=85141) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 10:27:06 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-1464c2f2-0e5e-482c-acda-4792fe518c72 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] CPU controller found on host. {{(pid=85141) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 10:27:06 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-1464c2f2-0e5e-482c-acda-4792fe518c72 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=85141) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 10:27:07 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-1464c2f2-0e5e-482c-acda-4792fe518c72 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T10:06:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 10:27:07 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-1464c2f2-0e5e-482c-acda-4792fe518c72 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Flavor limits 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 10:27:07 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-1464c2f2-0e5e-482c-acda-4792fe518c72 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Image limits 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 10:27:07 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-1464c2f2-0e5e-482c-acda-4792fe518c72 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Flavor pref 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 10:27:07 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-1464c2f2-0e5e-482c-acda-4792fe518c72 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Image pref 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 10:27:07 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-1464c2f2-0e5e-482c-acda-4792fe518c72 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 10:27:07 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-1464c2f2-0e5e-482c-acda-4792fe518c72 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 10:27:07 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-1464c2f2-0e5e-482c-acda-4792fe518c72 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=85141) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 10:27:07 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-1464c2f2-0e5e-482c-acda-4792fe518c72 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Got 1 possible topologies {{(pid=85141) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 10:27:07 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-1464c2f2-0e5e-482c-acda-4792fe518c72 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 10:27:07 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-1464c2f2-0e5e-482c-acda-4792fe518c72 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 10:27:07 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1464c2f2-0e5e-482c-acda-4792fe518c72 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] [instance: bc76703d-9243-4277-9b13-d6f9639cd1bb] Calling os-brick to attach iSCSI Volume {{(pid=85141) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 10:27:07 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-1464c2f2-0e5e-482c-acda-4792fe518c72 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51806b6080>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2006a77c-e5e8-4ec5-8de5-a0f9505c429a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vdtqwVjE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 10:27:07 user nova-compute[85141]: WARNING os_brick.initiator.connectors.base [None req-1464c2f2-0e5e-482c-acda-4792fe518c72 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 10:27:07 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-1464c2f2-0e5e-482c-acda-4792fe518c72 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 10:27:07 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-1464c2f2-0e5e-482c-acda-4792fe518c72 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 10:27:07 user nova-compute[85141]: WARNING os_brick.initiator.connectors.base [None req-1464c2f2-0e5e-482c-acda-4792fe518c72 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 10:27:07 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-1464c2f2-0e5e-482c-acda-4792fe518c72 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2006a77c-e5e8-4ec5-8de5-a0f9505c429a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 10:27:07 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-1464c2f2-0e5e-482c-acda-4792fe518c72 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2006a77c-e5e8-4ec5-8de5-a0f9505c429a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 10:27:07 user nova-compute[85141]: INFO os_brick.initiator.connectors.iscsi [None req-1464c2f2-0e5e-482c-acda-4792fe518c72 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 10:27:07 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2006a77c-e5e8-4ec5-8de5-a0f9505c429a -p 172.16.0.220:3260 {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:27:07 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2006a77c-e5e8-4ec5-8de5-a0f9505c429a -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:27:07 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[e51d337e-0481-404b-80b3-e57bf6cf2db9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:27:07 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-1464c2f2-0e5e-482c-acda-4792fe518c72 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 10:27:07 user nova-compute[85141]:  {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:27:07 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2006a77c-e5e8-4ec5-8de5-a0f9505c429a -p 172.16.0.220:3260 --interface default --op new {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:27:07 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2006a77c-e5e8-4ec5-8de5-a0f9505c429a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:27:07 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[5de2a5ea-dae3-46b0-9e35-bf8d9e171f46]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2006a77c-e5e8-4ec5-8de5-a0f9505c429a] added\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:27:07 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-1464c2f2-0e5e-482c-acda-4792fe518c72 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2006a77c-e5e8-4ec5-8de5-a0f9505c429a] added
Nov 16 10:27:07 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:27:07 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2006a77c-e5e8-4ec5-8de5-a0f9505c429a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:27:07 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2006a77c-e5e8-4ec5-8de5-a0f9505c429a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:27:07 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a0d923e-c255-4a3e-b67c-c7ab22110916]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:27:07 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-1464c2f2-0e5e-482c-acda-4792fe518c72 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:27:07 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2006a77c-e5e8-4ec5-8de5-a0f9505c429a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:27:07 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2006a77c-e5e8-4ec5-8de5-a0f9505c429a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.030s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:27:07 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc237221-a55d-4302-8e4b-b7e8102f3e2d]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:27:07 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-1464c2f2-0e5e-482c-acda-4792fe518c72 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:27:07 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2006a77c-e5e8-4ec5-8de5-a0f9505c429a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vdtqwVjE {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:27:07 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2006a77c-e5e8-4ec5-8de5-a0f9505c429a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vdtqwVjE" returned: 0 in 0.020s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:27:07 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[891dc2cd-7218-42a5-8c63-fbd4cec737f6]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:27:07 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-1464c2f2-0e5e-482c-acda-4792fe518c72 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vdtqwVjE'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:27:07 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2006a77c-e5e8-4ec5-8de5-a0f9505c429a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:27:07 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2006a77c-e5e8-4ec5-8de5-a0f9505c429a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.033s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:27:07 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3d42bc9-b754-4bc1-9a82-499a40f56110]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:27:07 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-1464c2f2-0e5e-482c-acda-4792fe518c72 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:27:07 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:27:07 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:27:07 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc1f0bc8-45c5-4ce0-9a88-08d6710079e8]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11a6a15b-38c1-4e7e-b8fa-2feb6789e775 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb96bfcd-cecc-452f-bc3b-61b7daf72599 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b58025-0c18-41f6-a126-fb3c925399a1 (non-flash)\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:27:07 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-1464c2f2-0e5e-482c-acda-4792fe518c72 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)
Nov 16 10:27:07 user nova-compute[85141]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11a6a15b-38c1-4e7e-b8fa-2feb6789e775 (non-flash)
Nov 16 10:27:07 user nova-compute[85141]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb96bfcd-cecc-452f-bc3b-61b7daf72599 (non-flash)
Nov 16 10:27:07 user nova-compute[85141]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b58025-0c18-41f6-a126-fb3c925399a1 (non-flash)
Nov 16 10:27:07 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:27:07 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-1464c2f2-0e5e-482c-acda-4792fe518c72 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)
Nov 16 10:27:07 user nova-compute[85141]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11a6a15b-38c1-4e7e-b8fa-2feb6789e775 (non-flash)
Nov 16 10:27:07 user nova-compute[85141]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb96bfcd-cecc-452f-bc3b-61b7daf72599 (non-flash)
Nov 16 10:27:07 user nova-compute[85141]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b58025-0c18-41f6-a126-fb3c925399a1 (non-flash)
Nov 16 10:27:07 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 10:27:07 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2006a77c-e5e8-4ec5-8de5-a0f9505c429a -p 172.16.0.220:3260 --login {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:27:07 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2006a77c-e5e8-4ec5-8de5-a0f9505c429a -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:27:07 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b75fa10-6bff-4fc4-95aa-d063bef9e63f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2006a77c-e5e8-4ec5-8de5-a0f9505c429a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2006a77c-e5e8-4ec5-8de5-a0f9505c429a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:27:07 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-1464c2f2-0e5e-482c-acda-4792fe518c72 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2006a77c-e5e8-4ec5-8de5-a0f9505c429a, portal: 172.16.0.220,3260]
Nov 16 10:27:07 user nova-compute[85141]: Login to [iface: default, target: iqn.2010-10.org.openstack:2006a77c-e5e8-4ec5-8de5-a0f9505c429a, portal: 172.16.0.220,3260] successful.
Nov 16 10:27:07 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:27:07 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2006a77c-e5e8-4ec5-8de5-a0f9505c429a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:27:07 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2006a77c-e5e8-4ec5-8de5-a0f9505c429a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:27:07 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cdbe2ca-ad94-42d4-8259-d3d01948a0f1]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:27:07 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-1464c2f2-0e5e-482c-acda-4792fe518c72 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:27:07 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:27:07 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:27:07 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e620e15-397f-4e0c-92e6-46d8abcc1392]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11a6a15b-38c1-4e7e-b8fa-2feb6789e775 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb96bfcd-cecc-452f-bc3b-61b7daf72599 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b58025-0c18-41f6-a126-fb3c925399a1 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2006a77c-e5e8-4ec5-8de5-a0f9505c429a (non-flash)\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:27:07 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-1464c2f2-0e5e-482c-acda-4792fe518c72 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)
Nov 16 10:27:07 user nova-compute[85141]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11a6a15b-38c1-4e7e-b8fa-2feb6789e775 (non-flash)
Nov 16 10:27:07 user nova-compute[85141]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb96bfcd-cecc-452f-bc3b-61b7daf72599 (non-flash)
Nov 16 10:27:07 user nova-compute[85141]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b58025-0c18-41f6-a126-fb3c925399a1 (non-flash)
Nov 16 10:27:07 user nova-compute[85141]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2006a77c-e5e8-4ec5-8de5-a0f9505c429a (non-flash)
Nov 16 10:27:07 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:27:07 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-1464c2f2-0e5e-482c-acda-4792fe518c72 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)
Nov 16 10:27:07 user nova-compute[85141]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11a6a15b-38c1-4e7e-b8fa-2feb6789e775 (non-flash)
Nov 16 10:27:07 user nova-compute[85141]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb96bfcd-cecc-452f-bc3b-61b7daf72599 (non-flash)
Nov 16 10:27:07 user nova-compute[85141]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b58025-0c18-41f6-a126-fb3c925399a1 (non-flash)
Nov 16 10:27:07 user nova-compute[85141]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2006a77c-e5e8-4ec5-8de5-a0f9505c429a (non-flash)
Nov 16 10:27:07 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 10:27:07 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-1464c2f2-0e5e-482c-acda-4792fe518c72 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2006a77c-e5e8-4ec5-8de5-a0f9505c429a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.312s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 10:27:07 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-1464c2f2-0e5e-482c-acda-4792fe518c72 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Connected to 172.16.0.220:3260 {{(pid=85141) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 10:27:07 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-1464c2f2-0e5e-482c-acda-4792fe518c72 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] HCTL ('33', '-', '-', 0) found on session 41 with lun 0 {{(pid=85141) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 10:27:07 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-1464c2f2-0e5e-482c-acda-4792fe518c72 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=85141) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 10:27:07 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:27:07 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:27:07 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a483677-cd65-42b6-906e-9cffbd8bc160]: (4, ('- - 0', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:27:07 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-1464c2f2-0e5e-482c-acda-4792fe518c72 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Searching for a device in session 41 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=85141) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 10:27:07 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-1464c2f2-0e5e-482c-acda-4792fe518c72 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:2006a77c-e5e8-4ec5-8de5-a0f9505c429a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vdtqwVjE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=85141) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 10:27:08 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:27:08 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-1464c2f2-0e5e-482c-acda-4792fe518c72 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.344s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 10:27:08 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-1464c2f2-0e5e-482c-acda-4792fe518c72 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] <== connect_volume: return (1346ms) {'type': 'block', 'scsi_wwn': '23838366537646236', 'path': '/dev/sdb'} {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 10:27:08 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1464c2f2-0e5e-482c-acda-4792fe518c72 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] [instance: bc76703d-9243-4277-9b13-d6f9639cd1bb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23838366537646236', 'path': '/dev/sdb'} {{(pid=85141) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 10:27:08 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-1464c2f2-0e5e-482c-acda-4792fe518c72 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T10:25:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-331499197',display_name='tempest-ServerActionsTestOtherA-server-331499197',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-331499197',id=34,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFB91nOE4JIg0PQZ9Fq9iMRTb/Qm6bpwHSXAkC8g5YxG6awy4b4nS0XAfWSm4O4f40Blu3eMfyuYdZY8eI6KFpQYslLrgvG2jeJNbK6AHNNiLWxDV8sQbQZDDAy7NeOUMQ==',key_name='tempest-keypair-799272913',keypairs=<?>,launch_index=0,launched_at=2023-11-16T10:25:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='879fa3f4dfc34726b20149b8a7db22dc',ramdisk_id='',reservation_id='r-01yoy1pt',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1137992555',owner_user_name='tempest-ServerActionsTestOtherA-1137992555-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T10:27:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e95802a919de4345add493a8d7873e48',uuid=bc76703d-9243-4277-9b13-d6f9639cd1bb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fbf147e2-d8e0-4cb5-8ec5-79756fc53140", "address": "fa:16:3e:a1:42:09", "network": {"id": "859d1f09-56c4-4c2b-b2c3-02b1938e8dbf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1562516834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1562516834-network", "vif_mac": "fa:16:3e:a1:42:09"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "879fa3f4dfc34726b20149b8a7db22dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbf147e2-d8", "ovs_interfaceid": "fbf147e2-d8e0-4cb5-8ec5-79756fc53140", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=85141) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 10:27:08 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-1464c2f2-0e5e-482c-acda-4792fe518c72 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Converting VIF {"id": "fbf147e2-d8e0-4cb5-8ec5-79756fc53140", "address": "fa:16:3e:a1:42:09", "network": {"id": "859d1f09-56c4-4c2b-b2c3-02b1938e8dbf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1562516834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1562516834-network", "vif_mac": "fa:16:3e:a1:42:09"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "879fa3f4dfc34726b20149b8a7db22dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbf147e2-d8", "ovs_interfaceid": "fbf147e2-d8e0-4cb5-8ec5-79756fc53140", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:27:08 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-1464c2f2-0e5e-482c-acda-4792fe518c72 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a1:42:09,bridge_name='br-int',has_traffic_filtering=True,id=fbf147e2-d8e0-4cb5-8ec5-79756fc53140,network=Network(859d1f09-56c4-4c2b-b2c3-02b1938e8dbf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfbf147e2-d8') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:27:08 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-1464c2f2-0e5e-482c-acda-4792fe518c72 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] [instance: bc76703d-9243-4277-9b13-d6f9639cd1bb] End _get_guest_xml xml=<domain type="kvm">
Nov 16 10:27:08 user nova-compute[85141]:   <uuid>bc76703d-9243-4277-9b13-d6f9639cd1bb</uuid>
Nov 16 10:27:08 user nova-compute[85141]:   <name>instance-00000022</name>
Nov 16 10:27:08 user nova-compute[85141]:   <memory>2097152</memory>
Nov 16 10:27:08 user nova-compute[85141]:   <vcpu>1</vcpu>
Nov 16 10:27:08 user nova-compute[85141]:   <metadata>
Nov 16 10:27:08 user nova-compute[85141]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 10:27:08 user nova-compute[85141]:       <nova:package version="0.0.0"/>
Nov 16 10:27:08 user nova-compute[85141]:       <nova:name>tempest-ServerActionsTestOtherA-server-331499197</nova:name>
Nov 16 10:27:08 user nova-compute[85141]:       <nova:creationTime>2023-11-16 10:27:06</nova:creationTime>
Nov 16 10:27:08 user nova-compute[85141]:       <nova:flavor name="m1.small">
Nov 16 10:27:08 user nova-compute[85141]:         <nova:memory>2048</nova:memory>
Nov 16 10:27:08 user nova-compute[85141]:         <nova:disk>20</nova:disk>
Nov 16 10:27:08 user nova-compute[85141]:         <nova:swap>0</nova:swap>
Nov 16 10:27:08 user nova-compute[85141]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 10:27:08 user nova-compute[85141]:         <nova:vcpus>1</nova:vcpus>
Nov 16 10:27:08 user nova-compute[85141]:       </nova:flavor>
Nov 16 10:27:08 user nova-compute[85141]:       <nova:owner>
Nov 16 10:27:08 user nova-compute[85141]:         <nova:user uuid="e95802a919de4345add493a8d7873e48">tempest-ServerActionsTestOtherA-1137992555-project-member</nova:user>
Nov 16 10:27:08 user nova-compute[85141]:         <nova:project uuid="879fa3f4dfc34726b20149b8a7db22dc">tempest-ServerActionsTestOtherA-1137992555</nova:project>
Nov 16 10:27:08 user nova-compute[85141]:       </nova:owner>
Nov 16 10:27:08 user nova-compute[85141]:       <nova:ports>
Nov 16 10:27:08 user nova-compute[85141]:         <nova:port uuid="fbf147e2-d8e0-4cb5-8ec5-79756fc53140">
Nov 16 10:27:08 user nova-compute[85141]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 16 10:27:08 user nova-compute[85141]:         </nova:port>
Nov 16 10:27:08 user nova-compute[85141]:       </nova:ports>
Nov 16 10:27:08 user nova-compute[85141]:     </nova:instance>
Nov 16 10:27:08 user nova-compute[85141]:   </metadata>
Nov 16 10:27:08 user nova-compute[85141]:   <sysinfo type="smbios">
Nov 16 10:27:08 user nova-compute[85141]:     <system>
Nov 16 10:27:08 user nova-compute[85141]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 10:27:08 user nova-compute[85141]:       <entry name="product">OpenStack Nova</entry>
Nov 16 10:27:08 user nova-compute[85141]:       <entry name="version">0.0.0</entry>
Nov 16 10:27:08 user nova-compute[85141]:       <entry name="serial">bc76703d-9243-4277-9b13-d6f9639cd1bb</entry>
Nov 16 10:27:08 user nova-compute[85141]:       <entry name="uuid">bc76703d-9243-4277-9b13-d6f9639cd1bb</entry>
Nov 16 10:27:08 user nova-compute[85141]:       <entry name="family">Virtual Machine</entry>
Nov 16 10:27:08 user nova-compute[85141]:     </system>
Nov 16 10:27:08 user nova-compute[85141]:   </sysinfo>
Nov 16 10:27:08 user nova-compute[85141]:   <os>
Nov 16 10:27:08 user nova-compute[85141]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 10:27:08 user nova-compute[85141]:     <boot dev="hd"/>
Nov 16 10:27:08 user nova-compute[85141]:     <smbios mode="sysinfo"/>
Nov 16 10:27:08 user nova-compute[85141]:   </os>
Nov 16 10:27:08 user nova-compute[85141]:   <features>
Nov 16 10:27:08 user nova-compute[85141]:     <acpi/>
Nov 16 10:27:08 user nova-compute[85141]:     <apic/>
Nov 16 10:27:08 user nova-compute[85141]:     <vmcoreinfo/>
Nov 16 10:27:08 user nova-compute[85141]:   </features>
Nov 16 10:27:08 user nova-compute[85141]:   <clock offset="utc">
Nov 16 10:27:08 user nova-compute[85141]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 10:27:08 user nova-compute[85141]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 10:27:08 user nova-compute[85141]:     <timer name="hpet" present="no"/>
Nov 16 10:27:08 user nova-compute[85141]:   </clock>
Nov 16 10:27:08 user nova-compute[85141]:   <cpu mode="custom" match="exact">
Nov 16 10:27:08 user nova-compute[85141]:     <model>Nehalem</model>
Nov 16 10:27:08 user nova-compute[85141]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 10:27:08 user nova-compute[85141]:   </cpu>
Nov 16 10:27:08 user nova-compute[85141]:   <devices>
Nov 16 10:27:08 user nova-compute[85141]:     <disk type="block" device="disk">
Nov 16 10:27:08 user nova-compute[85141]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 10:27:08 user nova-compute[85141]:       <source dev="/dev/sdb"/>
Nov 16 10:27:08 user nova-compute[85141]:       <target dev="vda" bus="virtio"/>
Nov 16 10:27:08 user nova-compute[85141]:       <serial>2006a77c-e5e8-4ec5-8de5-a0f9505c429a</serial>
Nov 16 10:27:08 user nova-compute[85141]:     </disk>
Nov 16 10:27:08 user nova-compute[85141]:     <interface type="ethernet">
Nov 16 10:27:08 user nova-compute[85141]:       <mac address="fa:16:3e:a1:42:09"/>
Nov 16 10:27:08 user nova-compute[85141]:       <model type="virtio"/>
Nov 16 10:27:08 user nova-compute[85141]:       <mtu size="1442"/>
Nov 16 10:27:08 user nova-compute[85141]:       <target dev="tapfbf147e2-d8"/>
Nov 16 10:27:08 user nova-compute[85141]:     </interface>
Nov 16 10:27:08 user nova-compute[85141]:     <serial type="pty">
Nov 16 10:27:08 user nova-compute[85141]:       <log file="/opt/stack/data/nova/instances/bc76703d-9243-4277-9b13-d6f9639cd1bb/console.log" append="off"/>
Nov 16 10:27:08 user nova-compute[85141]:     </serial>
Nov 16 10:27:08 user nova-compute[85141]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 10:27:08 user nova-compute[85141]:     <video>
Nov 16 10:27:08 user nova-compute[85141]:       <model type="virtio"/>
Nov 16 10:27:08 user nova-compute[85141]:     </video>
Nov 16 10:27:08 user nova-compute[85141]:     <rng model="virtio">
Nov 16 10:27:08 user nova-compute[85141]:       <backend model="random">/dev/urandom</backend>
Nov 16 10:27:08 user nova-compute[85141]:     </rng>
Nov 16 10:27:08 user nova-compute[85141]:     <controller type="usb" index="0" model="none"/>
Nov 16 10:27:08 user nova-compute[85141]:     <memballoon model="virtio">
Nov 16 10:27:08 user nova-compute[85141]:       <stats period="10"/>
Nov 16 10:27:08 user nova-compute[85141]:     </memballoon>
Nov 16 10:27:08 user nova-compute[85141]:   </devices>
Nov 16 10:27:08 user nova-compute[85141]: </domain>
Nov 16 10:27:08 user nova-compute[85141]:  {{(pid=85141) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 10:27:08 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-1464c2f2-0e5e-482c-acda-4792fe518c72 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T10:25:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-331499197',display_name='tempest-ServerActionsTestOtherA-server-331499197',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-331499197',id=34,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFB91nOE4JIg0PQZ9Fq9iMRTb/Qm6bpwHSXAkC8g5YxG6awy4b4nS0XAfWSm4O4f40Blu3eMfyuYdZY8eI6KFpQYslLrgvG2jeJNbK6AHNNiLWxDV8sQbQZDDAy7NeOUMQ==',key_name='tempest-keypair-799272913',keypairs=<?>,launch_index=0,launched_at=2023-11-16T10:25:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='879fa3f4dfc34726b20149b8a7db22dc',ramdisk_id='',reservation_id='r-01yoy1pt',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1137992555',owner_user_name='tempest-ServerActionsTestOtherA-1137992555-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T10:27:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e95802a919de4345add493a8d7873e48',uuid=bc76703d-9243-4277-9b13-d6f9639cd1bb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fbf147e2-d8e0-4cb5-8ec5-79756fc53140", "address": "fa:16:3e:a1:42:09", "network": {"id": "859d1f09-56c4-4c2b-b2c3-02b1938e8dbf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1562516834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1562516834-network", "vif_mac": "fa:16:3e:a1:42:09"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "879fa3f4dfc34726b20149b8a7db22dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbf147e2-d8", "ovs_interfaceid": "fbf147e2-d8e0-4cb5-8ec5-79756fc53140", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 10:27:08 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-1464c2f2-0e5e-482c-acda-4792fe518c72 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Converting VIF {"id": "fbf147e2-d8e0-4cb5-8ec5-79756fc53140", "address": "fa:16:3e:a1:42:09", "network": {"id": "859d1f09-56c4-4c2b-b2c3-02b1938e8dbf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1562516834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1562516834-network", "vif_mac": "fa:16:3e:a1:42:09"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "879fa3f4dfc34726b20149b8a7db22dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbf147e2-d8", "ovs_interfaceid": "fbf147e2-d8e0-4cb5-8ec5-79756fc53140", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:27:08 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-1464c2f2-0e5e-482c-acda-4792fe518c72 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a1:42:09,bridge_name='br-int',has_traffic_filtering=True,id=fbf147e2-d8e0-4cb5-8ec5-79756fc53140,network=Network(859d1f09-56c4-4c2b-b2c3-02b1938e8dbf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfbf147e2-d8') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:27:08 user nova-compute[85141]: DEBUG os_vif [None req-1464c2f2-0e5e-482c-acda-4792fe518c72 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a1:42:09,bridge_name='br-int',has_traffic_filtering=True,id=fbf147e2-d8e0-4cb5-8ec5-79756fc53140,network=Network(859d1f09-56c4-4c2b-b2c3-02b1938e8dbf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfbf147e2-d8') {{(pid=85141) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 10:27:08 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:27:08 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:27:08 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 10:27:08 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:27:08 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '65de3341-fe7b-5fad-a360-1f0e869a3463', '_type': 'linux-noop'}}, row=False) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:27:08 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:27:08 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:27:08 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:27:08 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfbf147e2-d8, may_exist=True, interface_attrs={}) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:27:08 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfbf147e2-d8, col_values=(('qos', UUID('4cb47623-7248-4fd8-8692-2e245b239624')),), if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:27:08 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfbf147e2-d8, col_values=(('external_ids', {'iface-id': 'fbf147e2-d8e0-4cb5-8ec5-79756fc53140', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a1:42:09', 'vm-uuid': 'bc76703d-9243-4277-9b13-d6f9639cd1bb'}),), if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:27:08 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:27:08 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:27:08 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:27:08 user nova-compute[85141]: INFO os_vif [None req-1464c2f2-0e5e-482c-acda-4792fe518c72 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a1:42:09,bridge_name='br-int',has_traffic_filtering=True,id=fbf147e2-d8e0-4cb5-8ec5-79756fc53140,network=Network(859d1f09-56c4-4c2b-b2c3-02b1938e8dbf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfbf147e2-d8')
Nov 16 10:27:08 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-1464c2f2-0e5e-482c-acda-4792fe518c72 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] No BDM found with device name vda, not building metadata. {{(pid=85141) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 10:27:08 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-1464c2f2-0e5e-482c-acda-4792fe518c72 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] No VIF found with MAC fa:16:3e:a1:42:09, not building metadata {{(pid=85141) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 10:27:09 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-4f7baf65-793a-4439-98f3-85263b5a7e5b tempest-VolumesActionsTest-511249111 tempest-VolumesActionsTest-511249111-project-member] Acquiring lock "2b4347a0-a9f0-4e4c-9d7a-30d984fa35a9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:27:09 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-4f7baf65-793a-4439-98f3-85263b5a7e5b tempest-VolumesActionsTest-511249111 tempest-VolumesActionsTest-511249111-project-member] Lock "2b4347a0-a9f0-4e4c-9d7a-30d984fa35a9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:27:09 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-4f7baf65-793a-4439-98f3-85263b5a7e5b tempest-VolumesActionsTest-511249111 tempest-VolumesActionsTest-511249111-project-member] Acquiring lock "2b4347a0-a9f0-4e4c-9d7a-30d984fa35a9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:27:09 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-4f7baf65-793a-4439-98f3-85263b5a7e5b tempest-VolumesActionsTest-511249111 tempest-VolumesActionsTest-511249111-project-member] Lock "2b4347a0-a9f0-4e4c-9d7a-30d984fa35a9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:27:09 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-4f7baf65-793a-4439-98f3-85263b5a7e5b tempest-VolumesActionsTest-511249111 tempest-VolumesActionsTest-511249111-project-member] Lock "2b4347a0-a9f0-4e4c-9d7a-30d984fa35a9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:27:09 user nova-compute[85141]: INFO nova.compute.manager [None req-4f7baf65-793a-4439-98f3-85263b5a7e5b tempest-VolumesActionsTest-511249111 tempest-VolumesActionsTest-511249111-project-member] [instance: 2b4347a0-a9f0-4e4c-9d7a-30d984fa35a9] Terminating instance
Nov 16 10:27:09 user nova-compute[85141]: DEBUG nova.compute.manager [None req-4f7baf65-793a-4439-98f3-85263b5a7e5b tempest-VolumesActionsTest-511249111 tempest-VolumesActionsTest-511249111-project-member] [instance: 2b4347a0-a9f0-4e4c-9d7a-30d984fa35a9] Start destroying the instance on the hypervisor. {{(pid=85141) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 10:27:09 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:27:09 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:27:09 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:27:09 user nova-compute[85141]: DEBUG nova.compute.manager [req-e339d7b6-bb3e-44d9-88c0-c35d345d7abb req-9d67a582-bb59-4d6d-bc0e-2d290ff577cc service nova] [instance: 2b4347a0-a9f0-4e4c-9d7a-30d984fa35a9] Received event network-vif-unplugged-bec27503-c534-4783-a7e9-a3a882a7590c {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:27:09 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-e339d7b6-bb3e-44d9-88c0-c35d345d7abb req-9d67a582-bb59-4d6d-bc0e-2d290ff577cc service nova] Acquiring lock "2b4347a0-a9f0-4e4c-9d7a-30d984fa35a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:27:09 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-e339d7b6-bb3e-44d9-88c0-c35d345d7abb req-9d67a582-bb59-4d6d-bc0e-2d290ff577cc service nova] Lock "2b4347a0-a9f0-4e4c-9d7a-30d984fa35a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:27:09 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-e339d7b6-bb3e-44d9-88c0-c35d345d7abb req-9d67a582-bb59-4d6d-bc0e-2d290ff577cc service nova] Lock "2b4347a0-a9f0-4e4c-9d7a-30d984fa35a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:27:09 user nova-compute[85141]: DEBUG nova.compute.manager [req-e339d7b6-bb3e-44d9-88c0-c35d345d7abb req-9d67a582-bb59-4d6d-bc0e-2d290ff577cc service nova] [instance: 2b4347a0-a9f0-4e4c-9d7a-30d984fa35a9] No waiting events found dispatching network-vif-unplugged-bec27503-c534-4783-a7e9-a3a882a7590c {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:27:09 user nova-compute[85141]: DEBUG nova.compute.manager [req-e339d7b6-bb3e-44d9-88c0-c35d345d7abb req-9d67a582-bb59-4d6d-bc0e-2d290ff577cc service nova] [instance: 2b4347a0-a9f0-4e4c-9d7a-30d984fa35a9] Received event network-vif-unplugged-bec27503-c534-4783-a7e9-a3a882a7590c for instance with task_state deleting. {{(pid=85141) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 10:27:10 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:27:10 user nova-compute[85141]: INFO nova.virt.libvirt.driver [-] [instance: 2b4347a0-a9f0-4e4c-9d7a-30d984fa35a9] Instance destroyed successfully.
Nov 16 10:27:10 user nova-compute[85141]: DEBUG nova.objects.instance [None req-4f7baf65-793a-4439-98f3-85263b5a7e5b tempest-VolumesActionsTest-511249111 tempest-VolumesActionsTest-511249111-project-member] Lazy-loading 'resources' on Instance uuid 2b4347a0-a9f0-4e4c-9d7a-30d984fa35a9 {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:27:10 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-4f7baf65-793a-4439-98f3-85263b5a7e5b tempest-VolumesActionsTest-511249111 tempest-VolumesActionsTest-511249111-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T10:25:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1306621481',display_name='tempest-VolumesActionsTest-instance-1306621481',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1306621481',id=35,image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-16T10:25:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0d645d18547849f8ad9e1035b7e7f71a',ramdisk_id='',reservation_id='r-0dbebm31',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-511249111',owner_user_name='tempest-VolumesActionsTest-511249111-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T10:25:21Z,user_data=None,user_id='e7bfe97b6b494d969ab1d6fe766563e8',uuid=2b4347a0-a9f0-4e4c-9d7a-30d984fa35a9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bec27503-c534-4783-a7e9-a3a882a7590c", "address": "fa:16:3e:79:9d:06", "network": {"id": "5bb45ec6-2255-4d0a-b503-097a9d8ad0df", "bridge": "br-int", "label": "tempest-VolumesActionsTest-115729215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d645d18547849f8ad9e1035b7e7f71a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbec27503-c5", "ovs_interfaceid": "bec27503-c534-4783-a7e9-a3a882a7590c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 10:27:10 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-4f7baf65-793a-4439-98f3-85263b5a7e5b tempest-VolumesActionsTest-511249111 tempest-VolumesActionsTest-511249111-project-member] Converting VIF {"id": "bec27503-c534-4783-a7e9-a3a882a7590c", "address": "fa:16:3e:79:9d:06", "network": {"id": "5bb45ec6-2255-4d0a-b503-097a9d8ad0df", "bridge": "br-int", "label": "tempest-VolumesActionsTest-115729215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d645d18547849f8ad9e1035b7e7f71a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbec27503-c5", "ovs_interfaceid": "bec27503-c534-4783-a7e9-a3a882a7590c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:27:10 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-4f7baf65-793a-4439-98f3-85263b5a7e5b tempest-VolumesActionsTest-511249111 tempest-VolumesActionsTest-511249111-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:9d:06,bridge_name='br-int',has_traffic_filtering=True,id=bec27503-c534-4783-a7e9-a3a882a7590c,network=Network(5bb45ec6-2255-4d0a-b503-097a9d8ad0df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbec27503-c5') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:27:10 user nova-compute[85141]: DEBUG os_vif [None req-4f7baf65-793a-4439-98f3-85263b5a7e5b tempest-VolumesActionsTest-511249111 tempest-VolumesActionsTest-511249111-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:9d:06,bridge_name='br-int',has_traffic_filtering=True,id=bec27503-c534-4783-a7e9-a3a882a7590c,network=Network(5bb45ec6-2255-4d0a-b503-097a9d8ad0df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbec27503-c5') {{(pid=85141) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 10:27:10 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:27:10 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbec27503-c5, bridge=br-int, if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:27:10 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:27:10 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:27:10 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:27:10 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:27:10 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0f56cd7b-79ef-478f-b60d-dd750a52efde) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:27:10 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:27:10 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:27:10 user nova-compute[85141]: INFO os_vif [None req-4f7baf65-793a-4439-98f3-85263b5a7e5b tempest-VolumesActionsTest-511249111 tempest-VolumesActionsTest-511249111-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:9d:06,bridge_name='br-int',has_traffic_filtering=True,id=bec27503-c534-4783-a7e9-a3a882a7590c,network=Network(5bb45ec6-2255-4d0a-b503-097a9d8ad0df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbec27503-c5')
Nov 16 10:27:10 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-4f7baf65-793a-4439-98f3-85263b5a7e5b tempest-VolumesActionsTest-511249111 tempest-VolumesActionsTest-511249111-project-member] [instance: 2b4347a0-a9f0-4e4c-9d7a-30d984fa35a9] Deleting instance files /opt/stack/data/nova/instances/2b4347a0-a9f0-4e4c-9d7a-30d984fa35a9_del
Nov 16 10:27:10 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-4f7baf65-793a-4439-98f3-85263b5a7e5b tempest-VolumesActionsTest-511249111 tempest-VolumesActionsTest-511249111-project-member] [instance: 2b4347a0-a9f0-4e4c-9d7a-30d984fa35a9] Deletion of /opt/stack/data/nova/instances/2b4347a0-a9f0-4e4c-9d7a-30d984fa35a9_del complete
Nov 16 10:27:10 user nova-compute[85141]: INFO nova.compute.manager [None req-4f7baf65-793a-4439-98f3-85263b5a7e5b tempest-VolumesActionsTest-511249111 tempest-VolumesActionsTest-511249111-project-member] [instance: 2b4347a0-a9f0-4e4c-9d7a-30d984fa35a9] Took 1.09 seconds to destroy the instance on the hypervisor.
Nov 16 10:27:10 user nova-compute[85141]: DEBUG oslo.service.loopingcall [None req-4f7baf65-793a-4439-98f3-85263b5a7e5b tempest-VolumesActionsTest-511249111 tempest-VolumesActionsTest-511249111-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=85141) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 10:27:10 user nova-compute[85141]: DEBUG nova.compute.manager [-] [instance: 2b4347a0-a9f0-4e4c-9d7a-30d984fa35a9] Deallocating network for instance {{(pid=85141) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 10:27:10 user nova-compute[85141]: DEBUG nova.network.neutron [-] [instance: 2b4347a0-a9f0-4e4c-9d7a-30d984fa35a9] deallocate_for_instance() {{(pid=85141) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 10:27:10 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:27:10 user nova-compute[85141]: DEBUG nova.compute.manager [req-39ca92bb-0d60-40a3-ab74-5972e4208e4b req-58bb6487-27a3-46b6-93eb-17842a9816bf service nova] [instance: bc76703d-9243-4277-9b13-d6f9639cd1bb] Received event network-vif-plugged-fbf147e2-d8e0-4cb5-8ec5-79756fc53140 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:27:10 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-39ca92bb-0d60-40a3-ab74-5972e4208e4b req-58bb6487-27a3-46b6-93eb-17842a9816bf service nova] Acquiring lock "bc76703d-9243-4277-9b13-d6f9639cd1bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:27:10 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-39ca92bb-0d60-40a3-ab74-5972e4208e4b req-58bb6487-27a3-46b6-93eb-17842a9816bf service nova] Lock "bc76703d-9243-4277-9b13-d6f9639cd1bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:27:10 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-39ca92bb-0d60-40a3-ab74-5972e4208e4b req-58bb6487-27a3-46b6-93eb-17842a9816bf service nova] Lock "bc76703d-9243-4277-9b13-d6f9639cd1bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:27:10 user nova-compute[85141]: DEBUG nova.compute.manager [req-39ca92bb-0d60-40a3-ab74-5972e4208e4b req-58bb6487-27a3-46b6-93eb-17842a9816bf service nova] [instance: bc76703d-9243-4277-9b13-d6f9639cd1bb] No waiting events found dispatching network-vif-plugged-fbf147e2-d8e0-4cb5-8ec5-79756fc53140 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:27:10 user nova-compute[85141]: WARNING nova.compute.manager [req-39ca92bb-0d60-40a3-ab74-5972e4208e4b req-58bb6487-27a3-46b6-93eb-17842a9816bf service nova] [instance: bc76703d-9243-4277-9b13-d6f9639cd1bb] Received unexpected event network-vif-plugged-fbf147e2-d8e0-4cb5-8ec5-79756fc53140 for instance with vm_state active and task_state resize_finish.
Nov 16 10:27:10 user nova-compute[85141]: DEBUG nova.network.neutron [-] [instance: 2b4347a0-a9f0-4e4c-9d7a-30d984fa35a9] Updating instance_info_cache with network_info: [] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:27:10 user nova-compute[85141]: DEBUG nova.compute.manager [req-9f27aa2d-1770-497a-8ddd-dfc9ba80b46f req-8a212644-fc95-4280-b4ce-7cbbc8b2f4b1 service nova] [instance: 2b4347a0-a9f0-4e4c-9d7a-30d984fa35a9] Received event network-vif-deleted-bec27503-c534-4783-a7e9-a3a882a7590c {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:27:10 user nova-compute[85141]: INFO nova.compute.manager [req-9f27aa2d-1770-497a-8ddd-dfc9ba80b46f req-8a212644-fc95-4280-b4ce-7cbbc8b2f4b1 service nova] [instance: 2b4347a0-a9f0-4e4c-9d7a-30d984fa35a9] Neutron deleted interface bec27503-c534-4783-a7e9-a3a882a7590c; detaching it from the instance and deleting it from the info cache
Nov 16 10:27:10 user nova-compute[85141]: DEBUG nova.network.neutron [req-9f27aa2d-1770-497a-8ddd-dfc9ba80b46f req-8a212644-fc95-4280-b4ce-7cbbc8b2f4b1 service nova] [instance: 2b4347a0-a9f0-4e4c-9d7a-30d984fa35a9] Updating instance_info_cache with network_info: [] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:27:10 user nova-compute[85141]: INFO nova.compute.manager [-] [instance: 2b4347a0-a9f0-4e4c-9d7a-30d984fa35a9] Took 0.47 seconds to deallocate network for instance.
Nov 16 10:27:10 user nova-compute[85141]: DEBUG nova.compute.manager [req-9f27aa2d-1770-497a-8ddd-dfc9ba80b46f req-8a212644-fc95-4280-b4ce-7cbbc8b2f4b1 service nova] [instance: 2b4347a0-a9f0-4e4c-9d7a-30d984fa35a9] Detach interface failed, port_id=bec27503-c534-4783-a7e9-a3a882a7590c, reason: Instance 2b4347a0-a9f0-4e4c-9d7a-30d984fa35a9 could not be found. {{(pid=85141) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 16 10:27:10 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-4f7baf65-793a-4439-98f3-85263b5a7e5b tempest-VolumesActionsTest-511249111 tempest-VolumesActionsTest-511249111-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:27:10 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-4f7baf65-793a-4439-98f3-85263b5a7e5b tempest-VolumesActionsTest-511249111 tempest-VolumesActionsTest-511249111-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:27:11 user nova-compute[85141]: DEBUG nova.compute.provider_tree [None req-4f7baf65-793a-4439-98f3-85263b5a7e5b tempest-VolumesActionsTest-511249111 tempest-VolumesActionsTest-511249111-project-member] Inventory has not changed in ProviderTree for provider: bf8e0fa1-16b6-408f-9203-c4cd63916272 {{(pid=85141) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 10:27:11 user nova-compute[85141]: DEBUG nova.scheduler.client.report [None req-4f7baf65-793a-4439-98f3-85263b5a7e5b tempest-VolumesActionsTest-511249111 tempest-VolumesActionsTest-511249111-project-member] Inventory has not changed for provider bf8e0fa1-16b6-408f-9203-c4cd63916272 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=85141) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 10:27:11 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-4f7baf65-793a-4439-98f3-85263b5a7e5b tempest-VolumesActionsTest-511249111 tempest-VolumesActionsTest-511249111-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.478s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:27:11 user nova-compute[85141]: INFO nova.scheduler.client.report [None req-4f7baf65-793a-4439-98f3-85263b5a7e5b tempest-VolumesActionsTest-511249111 tempest-VolumesActionsTest-511249111-project-member] Deleted allocations for instance 2b4347a0-a9f0-4e4c-9d7a-30d984fa35a9
Nov 16 10:27:11 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-4f7baf65-793a-4439-98f3-85263b5a7e5b tempest-VolumesActionsTest-511249111 tempest-VolumesActionsTest-511249111-project-member] Lock "2b4347a0-a9f0-4e4c-9d7a-30d984fa35a9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.213s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:27:11 user nova-compute[85141]: DEBUG nova.compute.manager [req-e9e36cd3-72e1-4a50-8015-e3dcb2550ece req-2c56637b-60b8-4b44-afe4-075668d145cc service nova] [instance: 2b4347a0-a9f0-4e4c-9d7a-30d984fa35a9] Received event network-vif-plugged-bec27503-c534-4783-a7e9-a3a882a7590c {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:27:11 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-e9e36cd3-72e1-4a50-8015-e3dcb2550ece req-2c56637b-60b8-4b44-afe4-075668d145cc service nova] Acquiring lock "2b4347a0-a9f0-4e4c-9d7a-30d984fa35a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:27:11 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-e9e36cd3-72e1-4a50-8015-e3dcb2550ece req-2c56637b-60b8-4b44-afe4-075668d145cc service nova] Lock "2b4347a0-a9f0-4e4c-9d7a-30d984fa35a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:27:11 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-e9e36cd3-72e1-4a50-8015-e3dcb2550ece req-2c56637b-60b8-4b44-afe4-075668d145cc service nova] Lock "2b4347a0-a9f0-4e4c-9d7a-30d984fa35a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:27:11 user nova-compute[85141]: DEBUG nova.compute.manager [req-e9e36cd3-72e1-4a50-8015-e3dcb2550ece req-2c56637b-60b8-4b44-afe4-075668d145cc service nova] [instance: 2b4347a0-a9f0-4e4c-9d7a-30d984fa35a9] No waiting events found dispatching network-vif-plugged-bec27503-c534-4783-a7e9-a3a882a7590c {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:27:11 user nova-compute[85141]: WARNING nova.compute.manager [req-e9e36cd3-72e1-4a50-8015-e3dcb2550ece req-2c56637b-60b8-4b44-afe4-075668d145cc service nova] [instance: 2b4347a0-a9f0-4e4c-9d7a-30d984fa35a9] Received unexpected event network-vif-plugged-bec27503-c534-4783-a7e9-a3a882a7590c for instance with vm_state deleted and task_state None.
Nov 16 10:27:12 user nova-compute[85141]: DEBUG nova.compute.manager [None req-1464c2f2-0e5e-482c-acda-4792fe518c72 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] [instance: bc76703d-9243-4277-9b13-d6f9639cd1bb] Instance event wait completed in 0 seconds for  {{(pid=85141) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 10:27:12 user nova-compute[85141]: INFO nova.virt.libvirt.driver [-] [instance: bc76703d-9243-4277-9b13-d6f9639cd1bb] Instance running successfully.
Nov 16 10:27:12 user nova-compute[85141]: DEBUG nova.virt.libvirt.guest [None req-1464c2f2-0e5e-482c-acda-4792fe518c72 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] [instance: bc76703d-9243-4277-9b13-d6f9639cd1bb] Failed to set time: agent not configured {{(pid=85141) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Nov 16 10:27:12 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-1464c2f2-0e5e-482c-acda-4792fe518c72 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] [instance: bc76703d-9243-4277-9b13-d6f9639cd1bb] finish_migration finished successfully. {{(pid=85141) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Nov 16 10:27:12 user nova-compute[85141]: DEBUG nova.compute.manager [req-b303971f-c31a-4c4a-8f4f-1f4c8bcb4413 req-a8fe6998-21f1-43ce-97b3-7c31459e8288 service nova] [instance: bc76703d-9243-4277-9b13-d6f9639cd1bb] Received event network-vif-plugged-fbf147e2-d8e0-4cb5-8ec5-79756fc53140 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:27:12 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-b303971f-c31a-4c4a-8f4f-1f4c8bcb4413 req-a8fe6998-21f1-43ce-97b3-7c31459e8288 service nova] Acquiring lock "bc76703d-9243-4277-9b13-d6f9639cd1bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:27:12 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-b303971f-c31a-4c4a-8f4f-1f4c8bcb4413 req-a8fe6998-21f1-43ce-97b3-7c31459e8288 service nova] Lock "bc76703d-9243-4277-9b13-d6f9639cd1bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:27:12 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-b303971f-c31a-4c4a-8f4f-1f4c8bcb4413 req-a8fe6998-21f1-43ce-97b3-7c31459e8288 service nova] Lock "bc76703d-9243-4277-9b13-d6f9639cd1bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:27:12 user nova-compute[85141]: DEBUG nova.compute.manager [req-b303971f-c31a-4c4a-8f4f-1f4c8bcb4413 req-a8fe6998-21f1-43ce-97b3-7c31459e8288 service nova] [instance: bc76703d-9243-4277-9b13-d6f9639cd1bb] No waiting events found dispatching network-vif-plugged-fbf147e2-d8e0-4cb5-8ec5-79756fc53140 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:27:12 user nova-compute[85141]: WARNING nova.compute.manager [req-b303971f-c31a-4c4a-8f4f-1f4c8bcb4413 req-a8fe6998-21f1-43ce-97b3-7c31459e8288 service nova] [instance: bc76703d-9243-4277-9b13-d6f9639cd1bb] Received unexpected event network-vif-plugged-fbf147e2-d8e0-4cb5-8ec5-79756fc53140 for instance with vm_state active and task_state resize_finish.
Nov 16 10:27:13 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:27:15 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:27:20 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:27:21 user nova-compute[85141]: DEBUG nova.compute.manager [req-0cf0945a-d08b-4119-9e43-47d9f7537cb2 req-04b56df8-d022-4c75-bf50-ba48e5d82f44 service nova] [instance: 17480138-4b61-43f7-92a5-db065f7d1696] Received event network-changed-6082a650-3a4c-4393-b6ab-8cbc97d751cb {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:27:21 user nova-compute[85141]: DEBUG nova.compute.manager [req-0cf0945a-d08b-4119-9e43-47d9f7537cb2 req-04b56df8-d022-4c75-bf50-ba48e5d82f44 service nova] [instance: 17480138-4b61-43f7-92a5-db065f7d1696] Refreshing instance network info cache due to event network-changed-6082a650-3a4c-4393-b6ab-8cbc97d751cb. {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 10:27:21 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-0cf0945a-d08b-4119-9e43-47d9f7537cb2 req-04b56df8-d022-4c75-bf50-ba48e5d82f44 service nova] Acquiring lock "refresh_cache-17480138-4b61-43f7-92a5-db065f7d1696" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:27:21 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-0cf0945a-d08b-4119-9e43-47d9f7537cb2 req-04b56df8-d022-4c75-bf50-ba48e5d82f44 service nova] Acquired lock "refresh_cache-17480138-4b61-43f7-92a5-db065f7d1696" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:27:21 user nova-compute[85141]: DEBUG nova.network.neutron [req-0cf0945a-d08b-4119-9e43-47d9f7537cb2 req-04b56df8-d022-4c75-bf50-ba48e5d82f44 service nova] [instance: 17480138-4b61-43f7-92a5-db065f7d1696] Refreshing network info cache for port 6082a650-3a4c-4393-b6ab-8cbc97d751cb {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 10:27:22 user nova-compute[85141]: DEBUG nova.network.neutron [req-0cf0945a-d08b-4119-9e43-47d9f7537cb2 req-04b56df8-d022-4c75-bf50-ba48e5d82f44 service nova] [instance: 17480138-4b61-43f7-92a5-db065f7d1696] Updated VIF entry in instance network info cache for port 6082a650-3a4c-4393-b6ab-8cbc97d751cb. {{(pid=85141) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 10:27:22 user nova-compute[85141]: DEBUG nova.network.neutron [req-0cf0945a-d08b-4119-9e43-47d9f7537cb2 req-04b56df8-d022-4c75-bf50-ba48e5d82f44 service nova] [instance: 17480138-4b61-43f7-92a5-db065f7d1696] Updating instance_info_cache with network_info: [{"id": "6082a650-3a4c-4393-b6ab-8cbc97d751cb", "address": "fa:16:3e:9f:52:3b", "network": {"id": "436477fd-9294-4297-bfb3-405564823fa0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1068749207-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4e4f57f79564d2fbcb8080bf8f1c5c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6082a650-3a", "ovs_interfaceid": "6082a650-3a4c-4393-b6ab-8cbc97d751cb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:27:22 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-0cf0945a-d08b-4119-9e43-47d9f7537cb2 req-04b56df8-d022-4c75-bf50-ba48e5d82f44 service nova] Releasing lock "refresh_cache-17480138-4b61-43f7-92a5-db065f7d1696" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:27:22 user nova-compute[85141]: DEBUG nova.compute.manager [req-69843312-cf3b-412e-a60b-22c7cdbc3426 req-12083363-2b81-461c-a11c-d1b464d1a45b service nova] [instance: 17480138-4b61-43f7-92a5-db065f7d1696] Received event network-changed-6082a650-3a4c-4393-b6ab-8cbc97d751cb {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:27:22 user nova-compute[85141]: DEBUG nova.compute.manager [req-69843312-cf3b-412e-a60b-22c7cdbc3426 req-12083363-2b81-461c-a11c-d1b464d1a45b service nova] [instance: 17480138-4b61-43f7-92a5-db065f7d1696] Refreshing instance network info cache due to event network-changed-6082a650-3a4c-4393-b6ab-8cbc97d751cb. {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 10:27:22 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-69843312-cf3b-412e-a60b-22c7cdbc3426 req-12083363-2b81-461c-a11c-d1b464d1a45b service nova] Acquiring lock "refresh_cache-17480138-4b61-43f7-92a5-db065f7d1696" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:27:22 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-69843312-cf3b-412e-a60b-22c7cdbc3426 req-12083363-2b81-461c-a11c-d1b464d1a45b service nova] Acquired lock "refresh_cache-17480138-4b61-43f7-92a5-db065f7d1696" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:27:22 user nova-compute[85141]: DEBUG nova.network.neutron [req-69843312-cf3b-412e-a60b-22c7cdbc3426 req-12083363-2b81-461c-a11c-d1b464d1a45b service nova] [instance: 17480138-4b61-43f7-92a5-db065f7d1696] Refreshing network info cache for port 6082a650-3a4c-4393-b6ab-8cbc97d751cb {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 10:27:23 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:27:23 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-100846e9-59eb-4a1c-94ad-1d5bf04cf791 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Acquiring lock "17480138-4b61-43f7-92a5-db065f7d1696" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:27:23 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-100846e9-59eb-4a1c-94ad-1d5bf04cf791 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Lock "17480138-4b61-43f7-92a5-db065f7d1696" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:27:23 user nova-compute[85141]: INFO nova.compute.manager [None req-100846e9-59eb-4a1c-94ad-1d5bf04cf791 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] [instance: 17480138-4b61-43f7-92a5-db065f7d1696] Detaching volume bb96bfcd-cecc-452f-bc3b-61b7daf72599
Nov 16 10:27:23 user nova-compute[85141]: INFO nova.virt.block_device [None req-100846e9-59eb-4a1c-94ad-1d5bf04cf791 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] [instance: 17480138-4b61-43f7-92a5-db065f7d1696] Attempting to driver detach volume bb96bfcd-cecc-452f-bc3b-61b7daf72599 from mountpoint /dev/vdb
Nov 16 10:27:23 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-100846e9-59eb-4a1c-94ad-1d5bf04cf791 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Attempting to detach device vdb from instance 17480138-4b61-43f7-92a5-db065f7d1696 from the persistent domain config. {{(pid=85141) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 10:27:23 user nova-compute[85141]: DEBUG nova.virt.libvirt.guest [None req-100846e9-59eb-4a1c-94ad-1d5bf04cf791 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 10:27:23 user nova-compute[85141]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 10:27:23 user nova-compute[85141]:   <source dev="/dev/sdf"/>
Nov 16 10:27:23 user nova-compute[85141]:   <target dev="vdb" bus="virtio"/>
Nov 16 10:27:23 user nova-compute[85141]:   <serial>bb96bfcd-cecc-452f-bc3b-61b7daf72599</serial>
Nov 16 10:27:23 user nova-compute[85141]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 10:27:23 user nova-compute[85141]: </disk>
Nov 16 10:27:23 user nova-compute[85141]:  {{(pid=85141) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 10:27:23 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-100846e9-59eb-4a1c-94ad-1d5bf04cf791 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Successfully detached device vdb from instance 17480138-4b61-43f7-92a5-db065f7d1696 from the persistent domain config.
Nov 16 10:27:23 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-100846e9-59eb-4a1c-94ad-1d5bf04cf791 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 17480138-4b61-43f7-92a5-db065f7d1696 from the live domain config. {{(pid=85141) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 10:27:23 user nova-compute[85141]: DEBUG nova.virt.libvirt.guest [None req-100846e9-59eb-4a1c-94ad-1d5bf04cf791 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 10:27:23 user nova-compute[85141]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 10:27:23 user nova-compute[85141]:   <source dev="/dev/sdf"/>
Nov 16 10:27:23 user nova-compute[85141]:   <target dev="vdb" bus="virtio"/>
Nov 16 10:27:23 user nova-compute[85141]:   <serial>bb96bfcd-cecc-452f-bc3b-61b7daf72599</serial>
Nov 16 10:27:23 user nova-compute[85141]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 10:27:23 user nova-compute[85141]: </disk>
Nov 16 10:27:23 user nova-compute[85141]:  {{(pid=85141) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 10:27:23 user nova-compute[85141]: DEBUG nova.network.neutron [req-69843312-cf3b-412e-a60b-22c7cdbc3426 req-12083363-2b81-461c-a11c-d1b464d1a45b service nova] [instance: 17480138-4b61-43f7-92a5-db065f7d1696] Updated VIF entry in instance network info cache for port 6082a650-3a4c-4393-b6ab-8cbc97d751cb. {{(pid=85141) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 10:27:23 user nova-compute[85141]: DEBUG nova.network.neutron [req-69843312-cf3b-412e-a60b-22c7cdbc3426 req-12083363-2b81-461c-a11c-d1b464d1a45b service nova] [instance: 17480138-4b61-43f7-92a5-db065f7d1696] Updating instance_info_cache with network_info: [{"id": "6082a650-3a4c-4393-b6ab-8cbc97d751cb", "address": "fa:16:3e:9f:52:3b", "network": {"id": "436477fd-9294-4297-bfb3-405564823fa0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1068749207-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4e4f57f79564d2fbcb8080bf8f1c5c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6082a650-3a", "ovs_interfaceid": "6082a650-3a4c-4393-b6ab-8cbc97d751cb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:27:23 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-69843312-cf3b-412e-a60b-22c7cdbc3426 req-12083363-2b81-461c-a11c-d1b464d1a45b service nova] Releasing lock "refresh_cache-17480138-4b61-43f7-92a5-db065f7d1696" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:27:23 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-100846e9-59eb-4a1c-94ad-1d5bf04cf791 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 17480138-4b61-43f7-92a5-db065f7d1696 {{(pid=85141) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 10:27:25 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:27:28 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:27:28 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:27:30 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:27:32 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-300086b7-4045-4e2a-863e-c8b1afffa323 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Acquiring lock "e1253324-3ca1-4610-b9d6-3db7c6c76828" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:27:32 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-300086b7-4045-4e2a-863e-c8b1afffa323 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Lock "e1253324-3ca1-4610-b9d6-3db7c6c76828" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:27:33 user nova-compute[85141]: DEBUG nova.compute.manager [None req-300086b7-4045-4e2a-863e-c8b1afffa323 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: e1253324-3ca1-4610-b9d6-3db7c6c76828] Starting instance... {{(pid=85141) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 10:27:33 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:27:33 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-300086b7-4045-4e2a-863e-c8b1afffa323 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:27:33 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-300086b7-4045-4e2a-863e-c8b1afffa323 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:27:33 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-300086b7-4045-4e2a-863e-c8b1afffa323 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=85141) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 10:27:33 user nova-compute[85141]: INFO nova.compute.claims [None req-300086b7-4045-4e2a-863e-c8b1afffa323 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: e1253324-3ca1-4610-b9d6-3db7c6c76828] Claim successful on node user
Nov 16 10:27:33 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:27:33 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Starting heal instance info cache {{(pid=85141) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 10:27:33 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Acquiring lock "refresh_cache-4e214bbb-5bbb-4e6f-ac09-9cb1412f068b" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:27:33 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Acquired lock "refresh_cache-4e214bbb-5bbb-4e6f-ac09-9cb1412f068b" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:27:33 user nova-compute[85141]: DEBUG nova.network.neutron [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] [instance: 4e214bbb-5bbb-4e6f-ac09-9cb1412f068b] Forcefully refreshing network info cache for instance {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 10:27:33 user nova-compute[85141]: DEBUG nova.compute.provider_tree [None req-300086b7-4045-4e2a-863e-c8b1afffa323 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Inventory has not changed in ProviderTree for provider: bf8e0fa1-16b6-408f-9203-c4cd63916272 {{(pid=85141) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 10:27:33 user nova-compute[85141]: DEBUG nova.scheduler.client.report [None req-300086b7-4045-4e2a-863e-c8b1afffa323 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Inventory has not changed for provider bf8e0fa1-16b6-408f-9203-c4cd63916272 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=85141) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 10:27:33 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-300086b7-4045-4e2a-863e-c8b1afffa323 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.673s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:27:33 user nova-compute[85141]: DEBUG nova.compute.manager [None req-300086b7-4045-4e2a-863e-c8b1afffa323 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: e1253324-3ca1-4610-b9d6-3db7c6c76828] Start building networks asynchronously for instance. {{(pid=85141) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 10:27:33 user nova-compute[85141]: DEBUG nova.compute.manager [None req-300086b7-4045-4e2a-863e-c8b1afffa323 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: e1253324-3ca1-4610-b9d6-3db7c6c76828] Allocating IP information in the background. {{(pid=85141) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 10:27:33 user nova-compute[85141]: DEBUG nova.network.neutron [None req-300086b7-4045-4e2a-863e-c8b1afffa323 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: e1253324-3ca1-4610-b9d6-3db7c6c76828] allocate_for_instance() {{(pid=85141) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 10:27:33 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-300086b7-4045-4e2a-863e-c8b1afffa323 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: e1253324-3ca1-4610-b9d6-3db7c6c76828] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 10:27:33 user nova-compute[85141]: DEBUG nova.network.neutron [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] [instance: 4e214bbb-5bbb-4e6f-ac09-9cb1412f068b] Updating instance_info_cache with network_info: [{"id": "b0a1b07c-bdba-4ef8-893e-fb5dcdbac88c", "address": "fa:16:3e:b9:03:60", "network": {"id": "5b67a3fd-ef1e-4f2c-b6e0-31766ef39d30", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2137186235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09b520de67ac4290a4b779f50afeb1a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0a1b07c-bd", "ovs_interfaceid": "b0a1b07c-bdba-4ef8-893e-fb5dcdbac88c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:27:33 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Releasing lock "refresh_cache-4e214bbb-5bbb-4e6f-ac09-9cb1412f068b" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:27:33 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] [instance: 4e214bbb-5bbb-4e6f-ac09-9cb1412f068b] Updated the network info_cache for instance {{(pid=85141) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 10:27:33 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:27:33 user nova-compute[85141]: DEBUG nova.compute.manager [None req-300086b7-4045-4e2a-863e-c8b1afffa323 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: e1253324-3ca1-4610-b9d6-3db7c6c76828] Start building block device mappings for instance. {{(pid=85141) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 10:27:33 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:27:33 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=85141) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 10:27:34 user nova-compute[85141]: INFO nova.virt.block_device [None req-300086b7-4045-4e2a-863e-c8b1afffa323 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: e1253324-3ca1-4610-b9d6-3db7c6c76828] Booting with volume e0c5c19d-363b-4f5d-a04f-fb7de64423f2 at /dev/vda
Nov 16 10:27:34 user nova-compute[85141]: DEBUG nova.policy [None req-300086b7-4045-4e2a-863e-c8b1afffa323 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7261b57c36904fcda87a9ea32d4b5b31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aec3bb9fe5e6446590900b5adf65df0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85141) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 10:27:34 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-ac9751de-05f1-48a6-9322-f2cf32e87a6b tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Acquiring lock "0b388b98-4e65-4258-bbe2-77e699321fb7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:27:34 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-ac9751de-05f1-48a6-9322-f2cf32e87a6b tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Lock "0b388b98-4e65-4258-bbe2-77e699321fb7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:27:34 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-ac9751de-05f1-48a6-9322-f2cf32e87a6b tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Acquiring lock "0b388b98-4e65-4258-bbe2-77e699321fb7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:27:34 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-ac9751de-05f1-48a6-9322-f2cf32e87a6b tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Lock "0b388b98-4e65-4258-bbe2-77e699321fb7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:27:34 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-ac9751de-05f1-48a6-9322-f2cf32e87a6b tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Lock "0b388b98-4e65-4258-bbe2-77e699321fb7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:27:34 user nova-compute[85141]: INFO nova.compute.manager [None req-ac9751de-05f1-48a6-9322-f2cf32e87a6b tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] [instance: 0b388b98-4e65-4258-bbe2-77e699321fb7] Terminating instance
Nov 16 10:27:34 user nova-compute[85141]: DEBUG nova.compute.manager [None req-ac9751de-05f1-48a6-9322-f2cf32e87a6b tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] [instance: 0b388b98-4e65-4258-bbe2-77e699321fb7] Start destroying the instance on the hypervisor. {{(pid=85141) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 10:27:34 user nova-compute[85141]: DEBUG os_brick.utils [None req-300086b7-4045-4e2a-863e-c8b1afffa323 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 10:27:34 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:27:34 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:27:34 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfe85770-3284-4d33-831c-dc6c70f25515]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c7834de5c295\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:27:34 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:27:34 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:27:34 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.023s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:27:34 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[aee07b01-4947-4e2e-8700-24ca1b372988]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:27:34 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:27:34 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:27:34 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:27:34 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.029s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:27:34 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[5653e56e-6850-46f1-9f83-cf83f22b3540]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:27:34 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7ed0ba0-c7d3-4ea6-b185-dfa5ec93821f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:27:34 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-300086b7-4045-4e2a-863e-c8b1afffa323 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Running cmd (subprocess): nvme version {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:27:34 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-300086b7-4045-4e2a-863e-c8b1afffa323 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] 'nvme version' failed. Not Retrying. {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 10:27:34 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:27:34 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.nvmeof [None req-300086b7-4045-4e2a-863e-c8b1afffa323 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] nvme not present on system {{(pid=85141) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 10:27:34 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:27:34 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 10:27:34 user nova-compute[85141]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 10:27:34 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c7a0c4c-85a8-4a74-bc88-dc56bccb4cb9]: (4, '') {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:27:34 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager.update_available_resource {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:27:34 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.lightos [None req-300086b7-4045-4e2a-863e-c8b1afffa323 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=85141) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 10:27:34 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.lightos [None req-300086b7-4045-4e2a-863e-c8b1afffa323 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=85141) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 10:27:34 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.lightos [None req-300086b7-4045-4e2a-863e-c8b1afffa323 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] LIGHTOS: no hostnqn found. {{(pid=85141) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 10:27:34 user nova-compute[85141]: DEBUG os_brick.utils [None req-300086b7-4045-4e2a-863e-c8b1afffa323 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] <== get_connector_properties: return (180ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c7834de5c295', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 10:27:34 user nova-compute[85141]: DEBUG nova.virt.block_device [None req-300086b7-4045-4e2a-863e-c8b1afffa323 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: e1253324-3ca1-4610-b9d6-3db7c6c76828] Updating existing volume attachment record: 2420b566-e033-489c-bc6c-c96ce257417b {{(pid=85141) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 10:27:34 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:27:34 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:27:34 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:27:34 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Auditing locally available compute resources for user (node: user) {{(pid=85141) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 10:27:34 user nova-compute[85141]: DEBUG nova.compute.manager [req-4ae03c8f-7a30-4907-a7e4-1962cf2e46e2 req-086777bf-5eab-4975-b9c3-c368d66c09f7 service nova] [instance: 0b388b98-4e65-4258-bbe2-77e699321fb7] Received event network-vif-unplugged-3ed9d2a6-c028-4b75-9023-95b1cfa982b6 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:27:34 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-4ae03c8f-7a30-4907-a7e4-1962cf2e46e2 req-086777bf-5eab-4975-b9c3-c368d66c09f7 service nova] Acquiring lock "0b388b98-4e65-4258-bbe2-77e699321fb7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:27:34 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-4ae03c8f-7a30-4907-a7e4-1962cf2e46e2 req-086777bf-5eab-4975-b9c3-c368d66c09f7 service nova] Lock "0b388b98-4e65-4258-bbe2-77e699321fb7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:27:34 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-4ae03c8f-7a30-4907-a7e4-1962cf2e46e2 req-086777bf-5eab-4975-b9c3-c368d66c09f7 service nova] Lock "0b388b98-4e65-4258-bbe2-77e699321fb7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:27:34 user nova-compute[85141]: DEBUG nova.compute.manager [req-4ae03c8f-7a30-4907-a7e4-1962cf2e46e2 req-086777bf-5eab-4975-b9c3-c368d66c09f7 service nova] [instance: 0b388b98-4e65-4258-bbe2-77e699321fb7] No waiting events found dispatching network-vif-unplugged-3ed9d2a6-c028-4b75-9023-95b1cfa982b6 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:27:34 user nova-compute[85141]: DEBUG nova.compute.manager [req-4ae03c8f-7a30-4907-a7e4-1962cf2e46e2 req-086777bf-5eab-4975-b9c3-c368d66c09f7 service nova] [instance: 0b388b98-4e65-4258-bbe2-77e699321fb7] Received event network-vif-unplugged-3ed9d2a6-c028-4b75-9023-95b1cfa982b6 for instance with task_state deleting. {{(pid=85141) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 10:27:34 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:27:34 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:27:34 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:27:34 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:27:34 user nova-compute[85141]: INFO nova.virt.libvirt.driver [-] [instance: 0b388b98-4e65-4258-bbe2-77e699321fb7] Instance destroyed successfully.
Nov 16 10:27:34 user nova-compute[85141]: DEBUG nova.objects.instance [None req-ac9751de-05f1-48a6-9322-f2cf32e87a6b tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Lazy-loading 'resources' on Instance uuid 0b388b98-4e65-4258-bbe2-77e699321fb7 {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:27:34 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-ac9751de-05f1-48a6-9322-f2cf32e87a6b tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T10:17:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1602512664',display_name='tempest-AttachVolumeTestJSON-server-1602512664',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1602512664',id=23,image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAR6bF9nouUYoCi9ZNGh3nZGY5ofrnXVxXtSu/7Acr1EHKWGjXKYUGtrq2XimOt/E4akdnq6ZnUvHCruk4Zy5W8xPtBZmROYAs+9Sfqoh0p8jGC4Ld4F7tm19PX/QAMtvA==',key_name='tempest-keypair-1960067559',keypairs=<?>,launch_index=0,launched_at=2023-11-16T10:17:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c2acc04e107d4a229c3580cf078a20f7',ramdisk_id='',reservation_id='r-ji9l4e80',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1609390288',owner_user_name='tempest-AttachVolumeTestJSON-1609390288-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T10:25:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f58409e5923c42b685d0a3ad0ab42974',uuid=0b388b98-4e65-4258-bbe2-77e699321fb7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3ed9d2a6-c028-4b75-9023-95b1cfa982b6", "address": "fa:16:3e:85:dd:4c", "network": {"id": "4e36c3d2-7d16-4305-a0a7-2358e1208df3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1030128743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2acc04e107d4a229c3580cf078a20f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ed9d2a6-c0", "ovs_interfaceid": "3ed9d2a6-c028-4b75-9023-95b1cfa982b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 10:27:34 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-ac9751de-05f1-48a6-9322-f2cf32e87a6b tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Converting VIF {"id": "3ed9d2a6-c028-4b75-9023-95b1cfa982b6", "address": "fa:16:3e:85:dd:4c", "network": {"id": "4e36c3d2-7d16-4305-a0a7-2358e1208df3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1030128743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2acc04e107d4a229c3580cf078a20f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ed9d2a6-c0", "ovs_interfaceid": "3ed9d2a6-c028-4b75-9023-95b1cfa982b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:27:34 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-ac9751de-05f1-48a6-9322-f2cf32e87a6b tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:85:dd:4c,bridge_name='br-int',has_traffic_filtering=True,id=3ed9d2a6-c028-4b75-9023-95b1cfa982b6,network=Network(4e36c3d2-7d16-4305-a0a7-2358e1208df3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ed9d2a6-c0') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:27:34 user nova-compute[85141]: DEBUG os_vif [None req-ac9751de-05f1-48a6-9322-f2cf32e87a6b tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:85:dd:4c,bridge_name='br-int',has_traffic_filtering=True,id=3ed9d2a6-c028-4b75-9023-95b1cfa982b6,network=Network(4e36c3d2-7d16-4305-a0a7-2358e1208df3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ed9d2a6-c0') {{(pid=85141) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 10:27:34 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:27:34 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3ed9d2a6-c0, bridge=br-int, if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:27:34 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:27:34 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:27:34 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:27:35 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:27:35 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0643b6fb-566c-476c-8525-75f027c006ad) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:27:35 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:27:35 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:27:35 user nova-compute[85141]: INFO os_vif [None req-ac9751de-05f1-48a6-9322-f2cf32e87a6b tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:85:dd:4c,bridge_name='br-int',has_traffic_filtering=True,id=3ed9d2a6-c028-4b75-9023-95b1cfa982b6,network=Network(4e36c3d2-7d16-4305-a0a7-2358e1208df3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ed9d2a6-c0')
Nov 16 10:27:35 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-ac9751de-05f1-48a6-9322-f2cf32e87a6b tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] [instance: 0b388b98-4e65-4258-bbe2-77e699321fb7] Deleting instance files /opt/stack/data/nova/instances/0b388b98-4e65-4258-bbe2-77e699321fb7_del
Nov 16 10:27:35 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-ac9751de-05f1-48a6-9322-f2cf32e87a6b tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] [instance: 0b388b98-4e65-4258-bbe2-77e699321fb7] Deletion of /opt/stack/data/nova/instances/0b388b98-4e65-4258-bbe2-77e699321fb7_del complete
Nov 16 10:27:35 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:27:35 user nova-compute[85141]: INFO nova.compute.manager [None req-ac9751de-05f1-48a6-9322-f2cf32e87a6b tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] [instance: 0b388b98-4e65-4258-bbe2-77e699321fb7] Took 1.14 seconds to destroy the instance on the hypervisor.
Nov 16 10:27:35 user nova-compute[85141]: DEBUG oslo.service.loopingcall [None req-ac9751de-05f1-48a6-9322-f2cf32e87a6b tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=85141) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 10:27:35 user nova-compute[85141]: DEBUG nova.compute.manager [-] [instance: 0b388b98-4e65-4258-bbe2-77e699321fb7] Deallocating network for instance {{(pid=85141) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 10:27:35 user nova-compute[85141]: DEBUG nova.network.neutron [-] [instance: 0b388b98-4e65-4258-bbe2-77e699321fb7] deallocate_for_instance() {{(pid=85141) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 10:27:35 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/463034ff-14ce-477a-9642-4d86aa6f9cd9/disk.rescue --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:27:35 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:27:35 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/463034ff-14ce-477a-9642-4d86aa6f9cd9/disk.rescue --force-share --output=json" returned: 0 in 0.221s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:27:35 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/463034ff-14ce-477a-9642-4d86aa6f9cd9/disk.rescue --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:27:35 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:27:35 user nova-compute[85141]: DEBUG nova.network.neutron [None req-300086b7-4045-4e2a-863e-c8b1afffa323 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: e1253324-3ca1-4610-b9d6-3db7c6c76828] Successfully created port: 29a94474-9722-43fb-b61a-d8eca4d6d728 {{(pid=85141) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 10:27:35 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:27:35 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:27:35 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:27:35 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/463034ff-14ce-477a-9642-4d86aa6f9cd9/disk.rescue --force-share --output=json" returned: 0 in 0.215s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:27:35 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] skipping disk /opt/stack/data/nova/instances/463034ff-14ce-477a-9642-4d86aa6f9cd9/disk (vdb) as it is a volume {{(pid=85141) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 10:27:35 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Error from libvirt while getting description of instance-00000017: [Error Code 42] Domain not found: no domain with matching uuid '0b388b98-4e65-4258-bbe2-77e699321fb7' (instance-00000017): libvirt.libvirtError: Domain not found: no domain with matching uuid '0b388b98-4e65-4258-bbe2-77e699321fb7' (instance-00000017)
Nov 16 10:27:35 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a507c85-0369-48ea-8858-3e7d346b4cb0/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:27:36 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a507c85-0369-48ea-8858-3e7d346b4cb0/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:27:36 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a507c85-0369-48ea-8858-3e7d346b4cb0/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:27:36 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a507c85-0369-48ea-8858-3e7d346b4cb0/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:27:36 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e214bbb-5bbb-4e6f-ac09-9cb1412f068b/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:27:36 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e214bbb-5bbb-4e6f-ac09-9cb1412f068b/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:27:36 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e214bbb-5bbb-4e6f-ac09-9cb1412f068b/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:27:36 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e214bbb-5bbb-4e6f-ac09-9cb1412f068b/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:27:36 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d842f90e-663b-4c95-9d7c-d092d2bac41f/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:27:36 user nova-compute[85141]: DEBUG nova.network.neutron [-] [instance: 0b388b98-4e65-4258-bbe2-77e699321fb7] Updating instance_info_cache with network_info: [] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:27:36 user nova-compute[85141]: DEBUG nova.compute.manager [req-b18a6484-3726-4509-b71c-5d5a9cbfaef2 req-9edf1ec6-08d4-4861-a72b-74140ffca999 service nova] [instance: 0b388b98-4e65-4258-bbe2-77e699321fb7] Received event network-vif-plugged-3ed9d2a6-c028-4b75-9023-95b1cfa982b6 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:27:36 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-b18a6484-3726-4509-b71c-5d5a9cbfaef2 req-9edf1ec6-08d4-4861-a72b-74140ffca999 service nova] Acquiring lock "0b388b98-4e65-4258-bbe2-77e699321fb7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:27:36 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-b18a6484-3726-4509-b71c-5d5a9cbfaef2 req-9edf1ec6-08d4-4861-a72b-74140ffca999 service nova] Lock "0b388b98-4e65-4258-bbe2-77e699321fb7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:27:36 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-b18a6484-3726-4509-b71c-5d5a9cbfaef2 req-9edf1ec6-08d4-4861-a72b-74140ffca999 service nova] Lock "0b388b98-4e65-4258-bbe2-77e699321fb7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:27:36 user nova-compute[85141]: DEBUG nova.compute.manager [req-b18a6484-3726-4509-b71c-5d5a9cbfaef2 req-9edf1ec6-08d4-4861-a72b-74140ffca999 service nova] [instance: 0b388b98-4e65-4258-bbe2-77e699321fb7] No waiting events found dispatching network-vif-plugged-3ed9d2a6-c028-4b75-9023-95b1cfa982b6 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:27:36 user nova-compute[85141]: WARNING nova.compute.manager [req-b18a6484-3726-4509-b71c-5d5a9cbfaef2 req-9edf1ec6-08d4-4861-a72b-74140ffca999 service nova] [instance: 0b388b98-4e65-4258-bbe2-77e699321fb7] Received unexpected event network-vif-plugged-3ed9d2a6-c028-4b75-9023-95b1cfa982b6 for instance with vm_state active and task_state deleting.
Nov 16 10:27:36 user nova-compute[85141]: DEBUG nova.compute.manager [req-b18a6484-3726-4509-b71c-5d5a9cbfaef2 req-9edf1ec6-08d4-4861-a72b-74140ffca999 service nova] [instance: 0b388b98-4e65-4258-bbe2-77e699321fb7] Received event network-vif-plugged-3ed9d2a6-c028-4b75-9023-95b1cfa982b6 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:27:36 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-b18a6484-3726-4509-b71c-5d5a9cbfaef2 req-9edf1ec6-08d4-4861-a72b-74140ffca999 service nova] Acquiring lock "0b388b98-4e65-4258-bbe2-77e699321fb7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:27:36 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-b18a6484-3726-4509-b71c-5d5a9cbfaef2 req-9edf1ec6-08d4-4861-a72b-74140ffca999 service nova] Lock "0b388b98-4e65-4258-bbe2-77e699321fb7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:27:36 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-b18a6484-3726-4509-b71c-5d5a9cbfaef2 req-9edf1ec6-08d4-4861-a72b-74140ffca999 service nova] Lock "0b388b98-4e65-4258-bbe2-77e699321fb7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:27:36 user nova-compute[85141]: DEBUG nova.compute.manager [req-b18a6484-3726-4509-b71c-5d5a9cbfaef2 req-9edf1ec6-08d4-4861-a72b-74140ffca999 service nova] [instance: 0b388b98-4e65-4258-bbe2-77e699321fb7] No waiting events found dispatching network-vif-plugged-3ed9d2a6-c028-4b75-9023-95b1cfa982b6 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:27:36 user nova-compute[85141]: WARNING nova.compute.manager [req-b18a6484-3726-4509-b71c-5d5a9cbfaef2 req-9edf1ec6-08d4-4861-a72b-74140ffca999 service nova] [instance: 0b388b98-4e65-4258-bbe2-77e699321fb7] Received unexpected event network-vif-plugged-3ed9d2a6-c028-4b75-9023-95b1cfa982b6 for instance with vm_state active and task_state deleting.
Nov 16 10:27:36 user nova-compute[85141]: DEBUG nova.compute.manager [req-b18a6484-3726-4509-b71c-5d5a9cbfaef2 req-9edf1ec6-08d4-4861-a72b-74140ffca999 service nova] [instance: 0b388b98-4e65-4258-bbe2-77e699321fb7] Received event network-vif-plugged-3ed9d2a6-c028-4b75-9023-95b1cfa982b6 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:27:36 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-b18a6484-3726-4509-b71c-5d5a9cbfaef2 req-9edf1ec6-08d4-4861-a72b-74140ffca999 service nova] Acquiring lock "0b388b98-4e65-4258-bbe2-77e699321fb7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:27:36 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-b18a6484-3726-4509-b71c-5d5a9cbfaef2 req-9edf1ec6-08d4-4861-a72b-74140ffca999 service nova] Lock "0b388b98-4e65-4258-bbe2-77e699321fb7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:27:36 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-b18a6484-3726-4509-b71c-5d5a9cbfaef2 req-9edf1ec6-08d4-4861-a72b-74140ffca999 service nova] Lock "0b388b98-4e65-4258-bbe2-77e699321fb7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:27:36 user nova-compute[85141]: DEBUG nova.compute.manager [req-b18a6484-3726-4509-b71c-5d5a9cbfaef2 req-9edf1ec6-08d4-4861-a72b-74140ffca999 service nova] [instance: 0b388b98-4e65-4258-bbe2-77e699321fb7] No waiting events found dispatching network-vif-plugged-3ed9d2a6-c028-4b75-9023-95b1cfa982b6 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:27:36 user nova-compute[85141]: WARNING nova.compute.manager [req-b18a6484-3726-4509-b71c-5d5a9cbfaef2 req-9edf1ec6-08d4-4861-a72b-74140ffca999 service nova] [instance: 0b388b98-4e65-4258-bbe2-77e699321fb7] Received unexpected event network-vif-plugged-3ed9d2a6-c028-4b75-9023-95b1cfa982b6 for instance with vm_state active and task_state deleting.
Nov 16 10:27:36 user nova-compute[85141]: DEBUG nova.compute.manager [req-b18a6484-3726-4509-b71c-5d5a9cbfaef2 req-9edf1ec6-08d4-4861-a72b-74140ffca999 service nova] [instance: 0b388b98-4e65-4258-bbe2-77e699321fb7] Received event network-vif-unplugged-3ed9d2a6-c028-4b75-9023-95b1cfa982b6 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:27:36 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-b18a6484-3726-4509-b71c-5d5a9cbfaef2 req-9edf1ec6-08d4-4861-a72b-74140ffca999 service nova] Acquiring lock "0b388b98-4e65-4258-bbe2-77e699321fb7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:27:36 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-b18a6484-3726-4509-b71c-5d5a9cbfaef2 req-9edf1ec6-08d4-4861-a72b-74140ffca999 service nova] Lock "0b388b98-4e65-4258-bbe2-77e699321fb7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:27:36 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-b18a6484-3726-4509-b71c-5d5a9cbfaef2 req-9edf1ec6-08d4-4861-a72b-74140ffca999 service nova] Lock "0b388b98-4e65-4258-bbe2-77e699321fb7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:27:36 user nova-compute[85141]: DEBUG nova.compute.manager [req-b18a6484-3726-4509-b71c-5d5a9cbfaef2 req-9edf1ec6-08d4-4861-a72b-74140ffca999 service nova] [instance: 0b388b98-4e65-4258-bbe2-77e699321fb7] No waiting events found dispatching network-vif-unplugged-3ed9d2a6-c028-4b75-9023-95b1cfa982b6 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:27:36 user nova-compute[85141]: DEBUG nova.compute.manager [req-b18a6484-3726-4509-b71c-5d5a9cbfaef2 req-9edf1ec6-08d4-4861-a72b-74140ffca999 service nova] [instance: 0b388b98-4e65-4258-bbe2-77e699321fb7] Received event network-vif-unplugged-3ed9d2a6-c028-4b75-9023-95b1cfa982b6 for instance with task_state deleting. {{(pid=85141) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 10:27:36 user nova-compute[85141]: INFO nova.compute.manager [-] [instance: 0b388b98-4e65-4258-bbe2-77e699321fb7] Took 1.54 seconds to deallocate network for instance.
Nov 16 10:27:36 user nova-compute[85141]: DEBUG nova.compute.manager [req-5eab8c33-28c3-4e8c-b82e-ce5626844737 req-4ffd3401-6274-406f-9012-4595025a69d7 service nova] [instance: 0b388b98-4e65-4258-bbe2-77e699321fb7] Received event network-vif-deleted-3ed9d2a6-c028-4b75-9023-95b1cfa982b6 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:27:36 user nova-compute[85141]: INFO nova.compute.manager [req-5eab8c33-28c3-4e8c-b82e-ce5626844737 req-4ffd3401-6274-406f-9012-4595025a69d7 service nova] [instance: 0b388b98-4e65-4258-bbe2-77e699321fb7] Neutron deleted interface 3ed9d2a6-c028-4b75-9023-95b1cfa982b6; detaching it from the instance and deleting it from the info cache
Nov 16 10:27:36 user nova-compute[85141]: DEBUG nova.network.neutron [req-5eab8c33-28c3-4e8c-b82e-ce5626844737 req-4ffd3401-6274-406f-9012-4595025a69d7 service nova] [instance: 0b388b98-4e65-4258-bbe2-77e699321fb7] Updating instance_info_cache with network_info: [] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:27:36 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d842f90e-663b-4c95-9d7c-d092d2bac41f/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:27:36 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d842f90e-663b-4c95-9d7c-d092d2bac41f/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:27:36 user nova-compute[85141]: DEBUG nova.compute.manager [req-5eab8c33-28c3-4e8c-b82e-ce5626844737 req-4ffd3401-6274-406f-9012-4595025a69d7 service nova] [instance: 0b388b98-4e65-4258-bbe2-77e699321fb7] Detach interface failed, port_id=3ed9d2a6-c028-4b75-9023-95b1cfa982b6, reason: Instance 0b388b98-4e65-4258-bbe2-77e699321fb7 could not be found. {{(pid=85141) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 16 10:27:36 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-ac9751de-05f1-48a6-9322-f2cf32e87a6b tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:27:36 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-ac9751de-05f1-48a6-9322-f2cf32e87a6b tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:27:37 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d842f90e-663b-4c95-9d7c-d092d2bac41f/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:27:37 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=85141) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 10:27:37 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17480138-4b61-43f7-92a5-db065f7d1696/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:27:37 user nova-compute[85141]: DEBUG nova.network.neutron [None req-300086b7-4045-4e2a-863e-c8b1afffa323 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: e1253324-3ca1-4610-b9d6-3db7c6c76828] Successfully updated port: 29a94474-9722-43fb-b61a-d8eca4d6d728 {{(pid=85141) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 10:27:37 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-300086b7-4045-4e2a-863e-c8b1afffa323 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Acquiring lock "refresh_cache-e1253324-3ca1-4610-b9d6-3db7c6c76828" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:27:37 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-300086b7-4045-4e2a-863e-c8b1afffa323 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Acquired lock "refresh_cache-e1253324-3ca1-4610-b9d6-3db7c6c76828" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:27:37 user nova-compute[85141]: DEBUG nova.network.neutron [None req-300086b7-4045-4e2a-863e-c8b1afffa323 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: e1253324-3ca1-4610-b9d6-3db7c6c76828] Building network info cache for instance {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 10:27:37 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17480138-4b61-43f7-92a5-db065f7d1696/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:27:37 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17480138-4b61-43f7-92a5-db065f7d1696/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:27:37 user nova-compute[85141]: DEBUG nova.network.neutron [None req-300086b7-4045-4e2a-863e-c8b1afffa323 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: e1253324-3ca1-4610-b9d6-3db7c6c76828] Instance cache missing network info. {{(pid=85141) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 10:27:37 user nova-compute[85141]: DEBUG nova.compute.provider_tree [None req-ac9751de-05f1-48a6-9322-f2cf32e87a6b tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Inventory has not changed in ProviderTree for provider: bf8e0fa1-16b6-408f-9203-c4cd63916272 {{(pid=85141) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 10:27:37 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17480138-4b61-43f7-92a5-db065f7d1696/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:27:37 user nova-compute[85141]: DEBUG nova.scheduler.client.report [None req-ac9751de-05f1-48a6-9322-f2cf32e87a6b tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Inventory has not changed for provider bf8e0fa1-16b6-408f-9203-c4cd63916272 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=85141) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 10:27:37 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=85141) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 10:27:37 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b24c3954-06ff-4e15-9e43-c65d1dae7a5d/disk.rescue --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:27:37 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-ac9751de-05f1-48a6-9322-f2cf32e87a6b tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.652s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:27:37 user nova-compute[85141]: INFO nova.scheduler.client.report [None req-ac9751de-05f1-48a6-9322-f2cf32e87a6b tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Deleted allocations for instance 0b388b98-4e65-4258-bbe2-77e699321fb7
Nov 16 10:27:37 user nova-compute[85141]: DEBUG nova.network.neutron [None req-300086b7-4045-4e2a-863e-c8b1afffa323 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: e1253324-3ca1-4610-b9d6-3db7c6c76828] Updating instance_info_cache with network_info: [{"id": "29a94474-9722-43fb-b61a-d8eca4d6d728", "address": "fa:16:3e:ea:fd:01", "network": {"id": "b8ada47f-9721-4358-ac4f-0305f06dbbb8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1663922860-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aec3bb9fe5e6446590900b5adf65df0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29a94474-97", "ovs_interfaceid": "29a94474-9722-43fb-b61a-d8eca4d6d728", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:27:37 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-300086b7-4045-4e2a-863e-c8b1afffa323 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Releasing lock "refresh_cache-e1253324-3ca1-4610-b9d6-3db7c6c76828" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:27:37 user nova-compute[85141]: DEBUG nova.compute.manager [None req-300086b7-4045-4e2a-863e-c8b1afffa323 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: e1253324-3ca1-4610-b9d6-3db7c6c76828] Instance network_info: |[{"id": "29a94474-9722-43fb-b61a-d8eca4d6d728", "address": "fa:16:3e:ea:fd:01", "network": {"id": "b8ada47f-9721-4358-ac4f-0305f06dbbb8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1663922860-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aec3bb9fe5e6446590900b5adf65df0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29a94474-97", "ovs_interfaceid": "29a94474-9722-43fb-b61a-d8eca4d6d728", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=85141) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 10:27:37 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-ac9751de-05f1-48a6-9322-f2cf32e87a6b tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Lock "0b388b98-4e65-4258-bbe2-77e699321fb7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.550s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:27:37 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b24c3954-06ff-4e15-9e43-c65d1dae7a5d/disk.rescue --force-share --output=json" returned: 0 in 0.189s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:27:37 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b24c3954-06ff-4e15-9e43-c65d1dae7a5d/disk.rescue --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:27:37 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b24c3954-06ff-4e15-9e43-c65d1dae7a5d/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:27:37 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b24c3954-06ff-4e15-9e43-c65d1dae7a5d/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:27:38 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b24c3954-06ff-4e15-9e43-c65d1dae7a5d/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:27:38 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b24c3954-06ff-4e15-9e43-c65d1dae7a5d/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:27:38 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:27:38 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b24c3954-06ff-4e15-9e43-c65d1dae7a5d/disk --force-share --output=json" returned: 0 in 0.281s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:27:38 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=85141) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 10:27:38 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/059d6974-bd0c-4f73-91fc-8202ebda4238/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:27:38 user nova-compute[85141]: INFO nova.compute.manager [None req-53863f76-8227-4f00-904a-15856ca3751e tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] [instance: 463034ff-14ce-477a-9642-4d86aa6f9cd9] Unrescuing
Nov 16 10:27:38 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-53863f76-8227-4f00-904a-15856ca3751e tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Acquiring lock "refresh_cache-463034ff-14ce-477a-9642-4d86aa6f9cd9" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:27:38 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-53863f76-8227-4f00-904a-15856ca3751e tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Acquired lock "refresh_cache-463034ff-14ce-477a-9642-4d86aa6f9cd9" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:27:38 user nova-compute[85141]: DEBUG nova.network.neutron [None req-53863f76-8227-4f00-904a-15856ca3751e tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] [instance: 463034ff-14ce-477a-9642-4d86aa6f9cd9] Building network info cache for instance {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 10:27:38 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-f9213b8a-a427-4294-9707-890224ab9544 tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] Acquiring lock "9fcf8335-9e6f-4878-a3e2-c68aeab0978e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:27:38 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-f9213b8a-a427-4294-9707-890224ab9544 tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] Lock "9fcf8335-9e6f-4878-a3e2-c68aeab0978e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:27:38 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-f9213b8a-a427-4294-9707-890224ab9544 tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] Acquiring lock "9fcf8335-9e6f-4878-a3e2-c68aeab0978e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:27:38 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-f9213b8a-a427-4294-9707-890224ab9544 tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] Lock "9fcf8335-9e6f-4878-a3e2-c68aeab0978e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:27:38 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-f9213b8a-a427-4294-9707-890224ab9544 tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] Lock "9fcf8335-9e6f-4878-a3e2-c68aeab0978e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:27:38 user nova-compute[85141]: INFO nova.compute.manager [None req-f9213b8a-a427-4294-9707-890224ab9544 tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] [instance: 9fcf8335-9e6f-4878-a3e2-c68aeab0978e] Terminating instance
Nov 16 10:27:38 user nova-compute[85141]: DEBUG nova.compute.manager [None req-f9213b8a-a427-4294-9707-890224ab9544 tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] [instance: 9fcf8335-9e6f-4878-a3e2-c68aeab0978e] Start destroying the instance on the hypervisor. {{(pid=85141) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 10:27:38 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/059d6974-bd0c-4f73-91fc-8202ebda4238/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:27:38 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/059d6974-bd0c-4f73-91fc-8202ebda4238/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:27:38 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:27:38 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:27:38 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/059d6974-bd0c-4f73-91fc-8202ebda4238/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:27:38 user nova-compute[85141]: DEBUG nova.compute.manager [req-ece2191b-0a06-4ec2-b2c3-201be227dc99 req-2333b5e3-0029-440b-a652-e025f90b2cdd service nova] [instance: 9fcf8335-9e6f-4878-a3e2-c68aeab0978e] Received event network-vif-unplugged-956ab401-d2c8-4b62-a0ba-9ccb12bf449c {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:27:38 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-ece2191b-0a06-4ec2-b2c3-201be227dc99 req-2333b5e3-0029-440b-a652-e025f90b2cdd service nova] Acquiring lock "9fcf8335-9e6f-4878-a3e2-c68aeab0978e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:27:38 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-ece2191b-0a06-4ec2-b2c3-201be227dc99 req-2333b5e3-0029-440b-a652-e025f90b2cdd service nova] Lock "9fcf8335-9e6f-4878-a3e2-c68aeab0978e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:27:38 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-ece2191b-0a06-4ec2-b2c3-201be227dc99 req-2333b5e3-0029-440b-a652-e025f90b2cdd service nova] Lock "9fcf8335-9e6f-4878-a3e2-c68aeab0978e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:27:38 user nova-compute[85141]: DEBUG nova.compute.manager [req-ece2191b-0a06-4ec2-b2c3-201be227dc99 req-2333b5e3-0029-440b-a652-e025f90b2cdd service nova] [instance: 9fcf8335-9e6f-4878-a3e2-c68aeab0978e] No waiting events found dispatching network-vif-unplugged-956ab401-d2c8-4b62-a0ba-9ccb12bf449c {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:27:38 user nova-compute[85141]: DEBUG nova.compute.manager [req-ece2191b-0a06-4ec2-b2c3-201be227dc99 req-2333b5e3-0029-440b-a652-e025f90b2cdd service nova] [instance: 9fcf8335-9e6f-4878-a3e2-c68aeab0978e] Received event network-vif-unplugged-956ab401-d2c8-4b62-a0ba-9ccb12bf449c for instance with task_state deleting. {{(pid=85141) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 10:27:38 user nova-compute[85141]: DEBUG nova.compute.manager [req-71e6a947-f5aa-4ccc-aa3b-7da50a4c5ddf req-5fa593a3-b07e-49c6-ace5-d5ac666cc5a2 service nova] [instance: 0b388b98-4e65-4258-bbe2-77e699321fb7] Received event network-vif-plugged-3ed9d2a6-c028-4b75-9023-95b1cfa982b6 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:27:38 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-71e6a947-f5aa-4ccc-aa3b-7da50a4c5ddf req-5fa593a3-b07e-49c6-ace5-d5ac666cc5a2 service nova] Acquiring lock "0b388b98-4e65-4258-bbe2-77e699321fb7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:27:38 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-71e6a947-f5aa-4ccc-aa3b-7da50a4c5ddf req-5fa593a3-b07e-49c6-ace5-d5ac666cc5a2 service nova] Lock "0b388b98-4e65-4258-bbe2-77e699321fb7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:27:38 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-71e6a947-f5aa-4ccc-aa3b-7da50a4c5ddf req-5fa593a3-b07e-49c6-ace5-d5ac666cc5a2 service nova] Lock "0b388b98-4e65-4258-bbe2-77e699321fb7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:27:38 user nova-compute[85141]: DEBUG nova.compute.manager [req-71e6a947-f5aa-4ccc-aa3b-7da50a4c5ddf req-5fa593a3-b07e-49c6-ace5-d5ac666cc5a2 service nova] [instance: 0b388b98-4e65-4258-bbe2-77e699321fb7] No waiting events found dispatching network-vif-plugged-3ed9d2a6-c028-4b75-9023-95b1cfa982b6 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:27:38 user nova-compute[85141]: WARNING nova.compute.manager [req-71e6a947-f5aa-4ccc-aa3b-7da50a4c5ddf req-5fa593a3-b07e-49c6-ace5-d5ac666cc5a2 service nova] [instance: 0b388b98-4e65-4258-bbe2-77e699321fb7] Received unexpected event network-vif-plugged-3ed9d2a6-c028-4b75-9023-95b1cfa982b6 for instance with vm_state deleted and task_state None.
Nov 16 10:27:38 user nova-compute[85141]: DEBUG nova.compute.manager [req-71e6a947-f5aa-4ccc-aa3b-7da50a4c5ddf req-5fa593a3-b07e-49c6-ace5-d5ac666cc5a2 service nova] [instance: e1253324-3ca1-4610-b9d6-3db7c6c76828] Received event network-changed-29a94474-9722-43fb-b61a-d8eca4d6d728 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:27:38 user nova-compute[85141]: DEBUG nova.compute.manager [req-71e6a947-f5aa-4ccc-aa3b-7da50a4c5ddf req-5fa593a3-b07e-49c6-ace5-d5ac666cc5a2 service nova] [instance: e1253324-3ca1-4610-b9d6-3db7c6c76828] Refreshing instance network info cache due to event network-changed-29a94474-9722-43fb-b61a-d8eca4d6d728. {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 10:27:38 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-71e6a947-f5aa-4ccc-aa3b-7da50a4c5ddf req-5fa593a3-b07e-49c6-ace5-d5ac666cc5a2 service nova] Acquiring lock "refresh_cache-e1253324-3ca1-4610-b9d6-3db7c6c76828" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:27:38 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-71e6a947-f5aa-4ccc-aa3b-7da50a4c5ddf req-5fa593a3-b07e-49c6-ace5-d5ac666cc5a2 service nova] Acquired lock "refresh_cache-e1253324-3ca1-4610-b9d6-3db7c6c76828" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:27:38 user nova-compute[85141]: DEBUG nova.network.neutron [req-71e6a947-f5aa-4ccc-aa3b-7da50a4c5ddf req-5fa593a3-b07e-49c6-ace5-d5ac666cc5a2 service nova] [instance: e1253324-3ca1-4610-b9d6-3db7c6c76828] Refreshing network info cache for port 29a94474-9722-43fb-b61a-d8eca4d6d728 {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 10:27:38 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:27:38 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:27:38 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fcf8335-9e6f-4878-a3e2-c68aeab0978e/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:27:39 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fcf8335-9e6f-4878-a3e2-c68aeab0978e/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:27:39 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fcf8335-9e6f-4878-a3e2-c68aeab0978e/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:27:39 user nova-compute[85141]: DEBUG nova.network.neutron [None req-53863f76-8227-4f00-904a-15856ca3751e tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] [instance: 463034ff-14ce-477a-9642-4d86aa6f9cd9] Updating instance_info_cache with network_info: [{"id": "121bbc09-53cf-4586-8585-655079b4c49b", "address": "fa:16:3e:b0:77:d5", "network": {"id": "5b67a3fd-ef1e-4f2c-b6e0-31766ef39d30", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2137186235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09b520de67ac4290a4b779f50afeb1a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap121bbc09-53", "ovs_interfaceid": "121bbc09-53cf-4586-8585-655079b4c49b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:27:39 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-53863f76-8227-4f00-904a-15856ca3751e tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Releasing lock "refresh_cache-463034ff-14ce-477a-9642-4d86aa6f9cd9" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:27:39 user nova-compute[85141]: DEBUG nova.objects.instance [None req-53863f76-8227-4f00-904a-15856ca3751e tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Lazy-loading 'flavor' on Instance uuid 463034ff-14ce-477a-9642-4d86aa6f9cd9 {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:27:39 user nova-compute[85141]: INFO nova.virt.libvirt.driver [-] [instance: 9fcf8335-9e6f-4878-a3e2-c68aeab0978e] Instance destroyed successfully.
Nov 16 10:27:39 user nova-compute[85141]: DEBUG nova.objects.instance [None req-f9213b8a-a427-4294-9707-890224ab9544 tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] Lazy-loading 'resources' on Instance uuid 9fcf8335-9e6f-4878-a3e2-c68aeab0978e {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:27:39 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-f9213b8a-a427-4294-9707-890224ab9544 tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T10:25:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1384833831',display_name='tempest-ServersNegativeTestJSON-server-1384833831',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1384833831',id=36,image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-16T10:25:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='79e4ebd46b4243c09f88927532b610f0',ramdisk_id='',reservation_id='r-hla8voaz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1452286076',owner_user_name='tempest-ServersNegativeTestJSON-1452286076-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T10:25:55Z,user_data=None,user_id='a7b52c2f46234602ae4925447a7d39a0',uuid=9fcf8335-9e6f-4878-a3e2-c68aeab0978e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "956ab401-d2c8-4b62-a0ba-9ccb12bf449c", "address": "fa:16:3e:76:76:a8", "network": {"id": "a75d923b-3849-49c0-ba13-f8b356efda8f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1113409976-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79e4ebd46b4243c09f88927532b610f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap956ab401-d2", "ovs_interfaceid": "956ab401-d2c8-4b62-a0ba-9ccb12bf449c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 10:27:39 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-f9213b8a-a427-4294-9707-890224ab9544 tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] Converting VIF {"id": "956ab401-d2c8-4b62-a0ba-9ccb12bf449c", "address": "fa:16:3e:76:76:a8", "network": {"id": "a75d923b-3849-49c0-ba13-f8b356efda8f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1113409976-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79e4ebd46b4243c09f88927532b610f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap956ab401-d2", "ovs_interfaceid": "956ab401-d2c8-4b62-a0ba-9ccb12bf449c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:27:39 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-f9213b8a-a427-4294-9707-890224ab9544 tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:76:a8,bridge_name='br-int',has_traffic_filtering=True,id=956ab401-d2c8-4b62-a0ba-9ccb12bf449c,network=Network(a75d923b-3849-49c0-ba13-f8b356efda8f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap956ab401-d2') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:27:39 user nova-compute[85141]: DEBUG os_vif [None req-f9213b8a-a427-4294-9707-890224ab9544 tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:76:a8,bridge_name='br-int',has_traffic_filtering=True,id=956ab401-d2c8-4b62-a0ba-9ccb12bf449c,network=Network(a75d923b-3849-49c0-ba13-f8b356efda8f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap956ab401-d2') {{(pid=85141) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 10:27:39 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:27:39 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap956ab401-d2, bridge=br-int, if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:27:39 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:27:39 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:27:39 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:27:39 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=348ea113-4db0-4699-b6c8-8b6d59bb00d9) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:27:39 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:27:39 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fcf8335-9e6f-4878-a3e2-c68aeab0978e/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:27:39 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:27:39 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11986c5b-6914-491e-8e71-983ab6b13c6e/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:27:39 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:27:39 user nova-compute[85141]: INFO os_vif [None req-f9213b8a-a427-4294-9707-890224ab9544 tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:76:a8,bridge_name='br-int',has_traffic_filtering=True,id=956ab401-d2c8-4b62-a0ba-9ccb12bf449c,network=Network(a75d923b-3849-49c0-ba13-f8b356efda8f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap956ab401-d2')
Nov 16 10:27:39 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-f9213b8a-a427-4294-9707-890224ab9544 tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] [instance: 9fcf8335-9e6f-4878-a3e2-c68aeab0978e] Deleting instance files /opt/stack/data/nova/instances/9fcf8335-9e6f-4878-a3e2-c68aeab0978e_del
Nov 16 10:27:39 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-f9213b8a-a427-4294-9707-890224ab9544 tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] [instance: 9fcf8335-9e6f-4878-a3e2-c68aeab0978e] Deletion of /opt/stack/data/nova/instances/9fcf8335-9e6f-4878-a3e2-c68aeab0978e_del complete
Nov 16 10:27:39 user nova-compute[85141]: INFO nova.compute.manager [None req-f9213b8a-a427-4294-9707-890224ab9544 tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] [instance: 9fcf8335-9e6f-4878-a3e2-c68aeab0978e] Took 1.05 seconds to destroy the instance on the hypervisor.
Nov 16 10:27:39 user nova-compute[85141]: DEBUG oslo.service.loopingcall [None req-f9213b8a-a427-4294-9707-890224ab9544 tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=85141) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 10:27:39 user nova-compute[85141]: DEBUG nova.compute.manager [-] [instance: 9fcf8335-9e6f-4878-a3e2-c68aeab0978e] Deallocating network for instance {{(pid=85141) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 10:27:39 user nova-compute[85141]: DEBUG nova.network.neutron [-] [instance: 9fcf8335-9e6f-4878-a3e2-c68aeab0978e] deallocate_for_instance() {{(pid=85141) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 10:27:39 user nova-compute[85141]: DEBUG nova.compute.manager [req-dec0119b-5835-491b-a423-32327abc2222 req-cfbc15ed-7487-449a-a069-294f64b179c9 service nova] [instance: 463034ff-14ce-477a-9642-4d86aa6f9cd9] Received event network-vif-unplugged-121bbc09-53cf-4586-8585-655079b4c49b {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:27:39 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-dec0119b-5835-491b-a423-32327abc2222 req-cfbc15ed-7487-449a-a069-294f64b179c9 service nova] Acquiring lock "463034ff-14ce-477a-9642-4d86aa6f9cd9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:27:39 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-dec0119b-5835-491b-a423-32327abc2222 req-cfbc15ed-7487-449a-a069-294f64b179c9 service nova] Lock "463034ff-14ce-477a-9642-4d86aa6f9cd9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:27:39 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-dec0119b-5835-491b-a423-32327abc2222 req-cfbc15ed-7487-449a-a069-294f64b179c9 service nova] Lock "463034ff-14ce-477a-9642-4d86aa6f9cd9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:27:39 user nova-compute[85141]: DEBUG nova.compute.manager [req-dec0119b-5835-491b-a423-32327abc2222 req-cfbc15ed-7487-449a-a069-294f64b179c9 service nova] [instance: 463034ff-14ce-477a-9642-4d86aa6f9cd9] No waiting events found dispatching network-vif-unplugged-121bbc09-53cf-4586-8585-655079b4c49b {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:27:39 user nova-compute[85141]: WARNING nova.compute.manager [req-dec0119b-5835-491b-a423-32327abc2222 req-cfbc15ed-7487-449a-a069-294f64b179c9 service nova] [instance: 463034ff-14ce-477a-9642-4d86aa6f9cd9] Received unexpected event network-vif-unplugged-121bbc09-53cf-4586-8585-655079b4c49b for instance with vm_state rescued and task_state unrescuing.
Nov 16 10:27:39 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11986c5b-6914-491e-8e71-983ab6b13c6e/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:27:39 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11986c5b-6914-491e-8e71-983ab6b13c6e/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:27:39 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:27:39 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:27:39 user nova-compute[85141]: DEBUG nova.network.neutron [req-71e6a947-f5aa-4ccc-aa3b-7da50a4c5ddf req-5fa593a3-b07e-49c6-ace5-d5ac666cc5a2 service nova] [instance: e1253324-3ca1-4610-b9d6-3db7c6c76828] Updated VIF entry in instance network info cache for port 29a94474-9722-43fb-b61a-d8eca4d6d728. {{(pid=85141) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 10:27:39 user nova-compute[85141]: DEBUG nova.network.neutron [req-71e6a947-f5aa-4ccc-aa3b-7da50a4c5ddf req-5fa593a3-b07e-49c6-ace5-d5ac666cc5a2 service nova] [instance: e1253324-3ca1-4610-b9d6-3db7c6c76828] Updating instance_info_cache with network_info: [{"id": "29a94474-9722-43fb-b61a-d8eca4d6d728", "address": "fa:16:3e:ea:fd:01", "network": {"id": "b8ada47f-9721-4358-ac4f-0305f06dbbb8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1663922860-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aec3bb9fe5e6446590900b5adf65df0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29a94474-97", "ovs_interfaceid": "29a94474-9722-43fb-b61a-d8eca4d6d728", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:27:39 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-71e6a947-f5aa-4ccc-aa3b-7da50a4c5ddf req-5fa593a3-b07e-49c6-ace5-d5ac666cc5a2 service nova] Releasing lock "refresh_cache-e1253324-3ca1-4610-b9d6-3db7c6c76828" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:27:39 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11986c5b-6914-491e-8e71-983ab6b13c6e/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:27:39 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:27:40 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:27:40 user nova-compute[85141]: DEBUG nova.network.neutron [-] [instance: 9fcf8335-9e6f-4878-a3e2-c68aeab0978e] Updating instance_info_cache with network_info: [] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:27:40 user nova-compute[85141]: INFO nova.virt.libvirt.driver [-] [instance: 463034ff-14ce-477a-9642-4d86aa6f9cd9] Instance destroyed successfully.
Nov 16 10:27:40 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:27:40 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:27:40 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Hypervisor/Node resource view: name=user free_ram=7273MB free_disk=24.76534652709961GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=85141) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 10:27:40 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:27:40 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:27:40 user nova-compute[85141]: INFO nova.compute.manager [-] [instance: 9fcf8335-9e6f-4878-a3e2-c68aeab0978e] Took 0.84 seconds to deallocate network for instance.
Nov 16 10:27:40 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:27:40 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:27:40 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-f9213b8a-a427-4294-9707-890224ab9544 tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:27:40 user nova-compute[85141]: DEBUG nova.compute.manager [None req-300086b7-4045-4e2a-863e-c8b1afffa323 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: e1253324-3ca1-4610-b9d6-3db7c6c76828] Start spawning the instance on the hypervisor. {{(pid=85141) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 10:27:40 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-300086b7-4045-4e2a-863e-c8b1afffa323 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: e1253324-3ca1-4610-b9d6-3db7c6c76828] Creating instance directory {{(pid=85141) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 10:27:40 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-300086b7-4045-4e2a-863e-c8b1afffa323 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: e1253324-3ca1-4610-b9d6-3db7c6c76828] Creating image(s)
Nov 16 10:27:40 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-300086b7-4045-4e2a-863e-c8b1afffa323 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: e1253324-3ca1-4610-b9d6-3db7c6c76828] Did not create local disks {{(pid=85141) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 16 10:27:40 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-300086b7-4045-4e2a-863e-c8b1afffa323 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: e1253324-3ca1-4610-b9d6-3db7c6c76828] Ensure instance console log exists: /opt/stack/data/nova/instances/e1253324-3ca1-4610-b9d6-3db7c6c76828/console.log {{(pid=85141) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 10:27:40 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-300086b7-4045-4e2a-863e-c8b1afffa323 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:27:40 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-300086b7-4045-4e2a-863e-c8b1afffa323 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:27:40 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-300086b7-4045-4e2a-863e-c8b1afffa323 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:27:40 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-300086b7-4045-4e2a-863e-c8b1afffa323 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: e1253324-3ca1-4610-b9d6-3db7c6c76828] Start _get_guest_xml network_info=[{"id": "29a94474-9722-43fb-b61a-d8eca4d6d728", "address": "fa:16:3e:ea:fd:01", "network": {"id": "b8ada47f-9721-4358-ac4f-0305f06dbbb8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1663922860-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aec3bb9fe5e6446590900b5adf65df0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29a94474-97", "ovs_interfaceid": "29a94474-9722-43fb-b61a-d8eca4d6d728", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e0c5c19d-363b-4f5d-a04f-fb7de64423f2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cfmRCWNK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e1253324-3ca1-4610-b9d6-3db7c6c76828', 'attached_at': '', 'detached_at': '', 'volume_id': 'e0c5c19d-363b-4f5d-a04f-fb7de64423f2', 'serial': 'e0c5c19d-363b-4f5d-a04f-fb7de64423f2'}, 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'attachment_id': '2420b566-e033-489c-bc6c-c96ce257417b', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=85141) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 10:27:40 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Applying migration context for instance bc76703d-9243-4277-9b13-d6f9639cd1bb as it has an incoming, in-progress migration 72c5d793-592e-4c2f-a692-665458d8517a. Migration status is finished {{(pid=85141) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 16 10:27:40 user nova-compute[85141]: INFO nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] [instance: bc76703d-9243-4277-9b13-d6f9639cd1bb] Updating resource usage from migration 72c5d793-592e-4c2f-a692-665458d8517a
Nov 16 10:27:40 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-300086b7-4045-4e2a-863e-c8b1afffa323 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:27:40 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-300086b7-4045-4e2a-863e-c8b1afffa323 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:27:40 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-300086b7-4045-4e2a-863e-c8b1afffa323 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=85141) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 10:27:40 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-300086b7-4045-4e2a-863e-c8b1afffa323 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] CPU controller missing on host. {{(pid=85141) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 10:27:40 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-300086b7-4045-4e2a-863e-c8b1afffa323 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=85141) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 10:27:40 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-300086b7-4045-4e2a-863e-c8b1afffa323 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] CPU controller found on host. {{(pid=85141) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 10:27:40 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-300086b7-4045-4e2a-863e-c8b1afffa323 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=85141) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 10:27:40 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-300086b7-4045-4e2a-863e-c8b1afffa323 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T10:06:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 10:27:40 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-300086b7-4045-4e2a-863e-c8b1afffa323 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Flavor limits 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 10:27:40 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-300086b7-4045-4e2a-863e-c8b1afffa323 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Image limits 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 10:27:40 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-300086b7-4045-4e2a-863e-c8b1afffa323 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Flavor pref 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 10:27:40 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-300086b7-4045-4e2a-863e-c8b1afffa323 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Image pref 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 10:27:40 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-300086b7-4045-4e2a-863e-c8b1afffa323 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 10:27:40 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-300086b7-4045-4e2a-863e-c8b1afffa323 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 10:27:40 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-300086b7-4045-4e2a-863e-c8b1afffa323 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=85141) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 10:27:40 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-300086b7-4045-4e2a-863e-c8b1afffa323 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Got 1 possible topologies {{(pid=85141) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 10:27:40 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-300086b7-4045-4e2a-863e-c8b1afffa323 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 10:27:40 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-300086b7-4045-4e2a-863e-c8b1afffa323 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 10:27:40 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-300086b7-4045-4e2a-863e-c8b1afffa323 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: e1253324-3ca1-4610-b9d6-3db7c6c76828] Calling os-brick to attach iSCSI Volume {{(pid=85141) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 10:27:40 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-300086b7-4045-4e2a-863e-c8b1afffa323 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51806b6080>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e0c5c19d-363b-4f5d-a04f-fb7de64423f2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cfmRCWNK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 10:27:40 user nova-compute[85141]: WARNING os_brick.initiator.connectors.base [None req-300086b7-4045-4e2a-863e-c8b1afffa323 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 10:27:40 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-300086b7-4045-4e2a-863e-c8b1afffa323 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 10:27:40 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-300086b7-4045-4e2a-863e-c8b1afffa323 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 10:27:40 user nova-compute[85141]: WARNING os_brick.initiator.connectors.base [None req-300086b7-4045-4e2a-863e-c8b1afffa323 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 10:27:40 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-300086b7-4045-4e2a-863e-c8b1afffa323 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e0c5c19d-363b-4f5d-a04f-fb7de64423f2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 10:27:40 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-300086b7-4045-4e2a-863e-c8b1afffa323 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e0c5c19d-363b-4f5d-a04f-fb7de64423f2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 10:27:40 user nova-compute[85141]: INFO os_brick.initiator.connectors.iscsi [None req-300086b7-4045-4e2a-863e-c8b1afffa323 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 10:27:40 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance d842f90e-663b-4c95-9d7c-d092d2bac41f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:27:40 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance f01dc8cf-1a69-4618-a15d-0c1075157f05 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:27:40 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance 059d6974-bd0c-4f73-91fc-8202ebda4238 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:27:40 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance 4e214bbb-5bbb-4e6f-ac09-9cb1412f068b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:27:40 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance b24c3954-06ff-4e15-9e43-c65d1dae7a5d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:27:40 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance 11986c5b-6914-491e-8e71-983ab6b13c6e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:27:40 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance abe5d4b7-a0d7-40e3-b630-0de746ddb55b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:27:40 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance 17480138-4b61-43f7-92a5-db065f7d1696 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:27:40 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance 463034ff-14ce-477a-9642-4d86aa6f9cd9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:27:40 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance 5a507c85-0369-48ea-8858-3e7d346b4cb0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:27:40 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance 9fcf8335-9e6f-4878-a3e2-c68aeab0978e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:27:40 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Migration 72c5d793-592e-4c2f-a692-665458d8517a is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 16 10:27:40 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance bc76703d-9243-4277-9b13-d6f9639cd1bb actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:27:40 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance e1253324-3ca1-4610-b9d6-3db7c6c76828 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:27:40 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Total usable vcpus: 12, total allocated vcpus: 14 {{(pid=85141) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 10:27:40 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Final resource view: name=user phys_ram=16011MB used_ram=9216MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=14 pci_stats=[] {{(pid=85141) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 10:27:40 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0c5c19d-363b-4f5d-a04f-fb7de64423f2 -p 172.16.0.220:3260 {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:27:40 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0c5c19d-363b-4f5d-a04f-fb7de64423f2 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:27:40 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6942a3f-c7c5-4ae4-8966-33c7e7613d09]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:27:40 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-300086b7-4045-4e2a-863e-c8b1afffa323 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 10:27:40 user nova-compute[85141]:  {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:27:40 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0c5c19d-363b-4f5d-a04f-fb7de64423f2 -p 172.16.0.220:3260 --interface default --op new {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:27:40 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0c5c19d-363b-4f5d-a04f-fb7de64423f2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:27:40 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[34be049d-2b3b-4700-a5a9-a882cbfc4d3a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e0c5c19d-363b-4f5d-a04f-fb7de64423f2] added\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:27:40 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-300086b7-4045-4e2a-863e-c8b1afffa323 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e0c5c19d-363b-4f5d-a04f-fb7de64423f2] added
Nov 16 10:27:40 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:27:40 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0c5c19d-363b-4f5d-a04f-fb7de64423f2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:27:40 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0c5c19d-363b-4f5d-a04f-fb7de64423f2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:27:40 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[1151a627-ea00-44e1-a654-c133e913330f]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:27:40 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-300086b7-4045-4e2a-863e-c8b1afffa323 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:27:40 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0c5c19d-363b-4f5d-a04f-fb7de64423f2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:27:40 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0c5c19d-363b-4f5d-a04f-fb7de64423f2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:27:40 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb7c161c-9339-4629-bee0-730c79028b95]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:27:40 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-300086b7-4045-4e2a-863e-c8b1afffa323 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:27:40 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0c5c19d-363b-4f5d-a04f-fb7de64423f2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cfmRCWNK {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:27:40 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0c5c19d-363b-4f5d-a04f-fb7de64423f2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cfmRCWNK" returned: 0 in 0.018s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:27:40 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bc3a715-e40f-4a91-a5e0-1452020eeae1]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:27:40 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-300086b7-4045-4e2a-863e-c8b1afffa323 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cfmRCWNK'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:27:40 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0c5c19d-363b-4f5d-a04f-fb7de64423f2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:27:40 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0c5c19d-363b-4f5d-a04f-fb7de64423f2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:27:40 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[98d7f17c-159e-48c9-a271-7ea9113764a2]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:27:40 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-300086b7-4045-4e2a-863e-c8b1afffa323 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:27:40 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:27:40 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:27:40 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4247dae-c3d4-40b1-beea-6eb1b5dbdbeb]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11a6a15b-38c1-4e7e-b8fa-2feb6789e775 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb96bfcd-cecc-452f-bc3b-61b7daf72599 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b58025-0c18-41f6-a126-fb3c925399a1 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2006a77c-e5e8-4ec5-8de5-a0f9505c429a (non-flash)\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:27:40 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-300086b7-4045-4e2a-863e-c8b1afffa323 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)
Nov 16 10:27:40 user nova-compute[85141]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11a6a15b-38c1-4e7e-b8fa-2feb6789e775 (non-flash)
Nov 16 10:27:40 user nova-compute[85141]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb96bfcd-cecc-452f-bc3b-61b7daf72599 (non-flash)
Nov 16 10:27:40 user nova-compute[85141]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b58025-0c18-41f6-a126-fb3c925399a1 (non-flash)
Nov 16 10:27:40 user nova-compute[85141]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2006a77c-e5e8-4ec5-8de5-a0f9505c429a (non-flash)
Nov 16 10:27:40 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:27:40 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-300086b7-4045-4e2a-863e-c8b1afffa323 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)
Nov 16 10:27:40 user nova-compute[85141]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11a6a15b-38c1-4e7e-b8fa-2feb6789e775 (non-flash)
Nov 16 10:27:40 user nova-compute[85141]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb96bfcd-cecc-452f-bc3b-61b7daf72599 (non-flash)
Nov 16 10:27:40 user nova-compute[85141]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b58025-0c18-41f6-a126-fb3c925399a1 (non-flash)
Nov 16 10:27:40 user nova-compute[85141]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2006a77c-e5e8-4ec5-8de5-a0f9505c429a (non-flash)
Nov 16 10:27:40 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 10:27:40 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0c5c19d-363b-4f5d-a04f-fb7de64423f2 -p 172.16.0.220:3260 --login {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:27:40 user nova-compute[85141]: DEBUG nova.compute.manager [req-4e1b6fa8-ed3a-48f9-9184-3a149d96e6fb req-63cbe5e2-5c61-4b6e-abed-9d16391ef9a2 service nova] [instance: 9fcf8335-9e6f-4878-a3e2-c68aeab0978e] Received event network-vif-plugged-956ab401-d2c8-4b62-a0ba-9ccb12bf449c {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:27:40 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-4e1b6fa8-ed3a-48f9-9184-3a149d96e6fb req-63cbe5e2-5c61-4b6e-abed-9d16391ef9a2 service nova] Acquiring lock "9fcf8335-9e6f-4878-a3e2-c68aeab0978e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:27:40 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-4e1b6fa8-ed3a-48f9-9184-3a149d96e6fb req-63cbe5e2-5c61-4b6e-abed-9d16391ef9a2 service nova] Lock "9fcf8335-9e6f-4878-a3e2-c68aeab0978e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:27:40 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-4e1b6fa8-ed3a-48f9-9184-3a149d96e6fb req-63cbe5e2-5c61-4b6e-abed-9d16391ef9a2 service nova] Lock "9fcf8335-9e6f-4878-a3e2-c68aeab0978e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:27:40 user nova-compute[85141]: DEBUG nova.compute.manager [req-4e1b6fa8-ed3a-48f9-9184-3a149d96e6fb req-63cbe5e2-5c61-4b6e-abed-9d16391ef9a2 service nova] [instance: 9fcf8335-9e6f-4878-a3e2-c68aeab0978e] No waiting events found dispatching network-vif-plugged-956ab401-d2c8-4b62-a0ba-9ccb12bf449c {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:27:40 user nova-compute[85141]: WARNING nova.compute.manager [req-4e1b6fa8-ed3a-48f9-9184-3a149d96e6fb req-63cbe5e2-5c61-4b6e-abed-9d16391ef9a2 service nova] [instance: 9fcf8335-9e6f-4878-a3e2-c68aeab0978e] Received unexpected event network-vif-plugged-956ab401-d2c8-4b62-a0ba-9ccb12bf449c for instance with vm_state deleted and task_state None.
Nov 16 10:27:40 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0c5c19d-363b-4f5d-a04f-fb7de64423f2 -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:27:40 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe4749bd-d115-45da-8183-d1eafd3e85b6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e0c5c19d-363b-4f5d-a04f-fb7de64423f2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e0c5c19d-363b-4f5d-a04f-fb7de64423f2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:27:40 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-300086b7-4045-4e2a-863e-c8b1afffa323 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e0c5c19d-363b-4f5d-a04f-fb7de64423f2, portal: 172.16.0.220,3260]
Nov 16 10:27:40 user nova-compute[85141]: Login to [iface: default, target: iqn.2010-10.org.openstack:e0c5c19d-363b-4f5d-a04f-fb7de64423f2, portal: 172.16.0.220,3260] successful.
Nov 16 10:27:40 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:27:40 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0c5c19d-363b-4f5d-a04f-fb7de64423f2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:27:40 user nova-compute[85141]: DEBUG nova.compute.manager [req-d72ac554-a5f9-4f55-b027-7d77b78b6597 req-16e87e2f-f543-453e-beb9-ba34b6851c81 service nova] [instance: 9fcf8335-9e6f-4878-a3e2-c68aeab0978e] Received event network-vif-deleted-956ab401-d2c8-4b62-a0ba-9ccb12bf449c {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:27:40 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0c5c19d-363b-4f5d-a04f-fb7de64423f2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:27:40 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[51cc22e5-4462-4a7c-a4d6-77a31466a454]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:27:40 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-300086b7-4045-4e2a-863e-c8b1afffa323 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:27:40 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:27:41 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:27:41 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee1dfa24-7d86-4e1d-b87d-711feb038113]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11a6a15b-38c1-4e7e-b8fa-2feb6789e775 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb96bfcd-cecc-452f-bc3b-61b7daf72599 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b58025-0c18-41f6-a126-fb3c925399a1 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2006a77c-e5e8-4ec5-8de5-a0f9505c429a (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0c5c19d-363b-4f5d-a04f-fb7de64423f2 (non-flash)\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:27:41 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-300086b7-4045-4e2a-863e-c8b1afffa323 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)
Nov 16 10:27:41 user nova-compute[85141]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11a6a15b-38c1-4e7e-b8fa-2feb6789e775 (non-flash)
Nov 16 10:27:41 user nova-compute[85141]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb96bfcd-cecc-452f-bc3b-61b7daf72599 (non-flash)
Nov 16 10:27:41 user nova-compute[85141]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b58025-0c18-41f6-a126-fb3c925399a1 (non-flash)
Nov 16 10:27:41 user nova-compute[85141]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2006a77c-e5e8-4ec5-8de5-a0f9505c429a (non-flash)
Nov 16 10:27:41 user nova-compute[85141]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0c5c19d-363b-4f5d-a04f-fb7de64423f2 (non-flash)
Nov 16 10:27:41 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:27:41 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-300086b7-4045-4e2a-863e-c8b1afffa323 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)
Nov 16 10:27:41 user nova-compute[85141]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11a6a15b-38c1-4e7e-b8fa-2feb6789e775 (non-flash)
Nov 16 10:27:41 user nova-compute[85141]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb96bfcd-cecc-452f-bc3b-61b7daf72599 (non-flash)
Nov 16 10:27:41 user nova-compute[85141]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b58025-0c18-41f6-a126-fb3c925399a1 (non-flash)
Nov 16 10:27:41 user nova-compute[85141]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2006a77c-e5e8-4ec5-8de5-a0f9505c429a (non-flash)
Nov 16 10:27:41 user nova-compute[85141]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0c5c19d-363b-4f5d-a04f-fb7de64423f2 (non-flash)
Nov 16 10:27:41 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 10:27:41 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-300086b7-4045-4e2a-863e-c8b1afffa323 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e0c5c19d-363b-4f5d-a04f-fb7de64423f2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.321s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 10:27:41 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-300086b7-4045-4e2a-863e-c8b1afffa323 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Connected to 172.16.0.220:3260 {{(pid=85141) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 10:27:41 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-300086b7-4045-4e2a-863e-c8b1afffa323 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] HCTL ('36', '-', '-', 0) found on session 42 with lun 0 {{(pid=85141) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 10:27:41 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-300086b7-4045-4e2a-863e-c8b1afffa323 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=85141) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 10:27:41 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:27:41 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.020s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:27:41 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b9d893d-f6df-41d4-9213-b65aa48ebe1c]: (4, ('- - 0', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:27:41 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-300086b7-4045-4e2a-863e-c8b1afffa323 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Searching for a device in session 42 and hctl ['36', '*', '*', 0] yield: sde {{(pid=85141) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 10:27:41 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-300086b7-4045-4e2a-863e-c8b1afffa323 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:e0c5c19d-363b-4f5d-a04f-fb7de64423f2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cfmRCWNK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=85141) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 10:27:41 user nova-compute[85141]: DEBUG nova.compute.provider_tree [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Inventory has not changed in ProviderTree for provider: bf8e0fa1-16b6-408f-9203-c4cd63916272 {{(pid=85141) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 10:27:41 user nova-compute[85141]: DEBUG nova.scheduler.client.report [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Inventory has not changed for provider bf8e0fa1-16b6-408f-9203-c4cd63916272 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=85141) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 10:27:41 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Compute_service record updated for user:user {{(pid=85141) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 10:27:41 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.727s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:27:41 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-f9213b8a-a427-4294-9707-890224ab9544 tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.655s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:27:41 user nova-compute[85141]: DEBUG nova.compute.provider_tree [None req-f9213b8a-a427-4294-9707-890224ab9544 tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] Inventory has not changed in ProviderTree for provider: bf8e0fa1-16b6-408f-9203-c4cd63916272 {{(pid=85141) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 10:27:41 user nova-compute[85141]: DEBUG nova.scheduler.client.report [None req-f9213b8a-a427-4294-9707-890224ab9544 tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] Inventory has not changed for provider bf8e0fa1-16b6-408f-9203-c4cd63916272 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=85141) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 10:27:41 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-f9213b8a-a427-4294-9707-890224ab9544 tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.450s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:27:41 user nova-compute[85141]: INFO nova.scheduler.client.report [None req-f9213b8a-a427-4294-9707-890224ab9544 tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] Deleted allocations for instance 9fcf8335-9e6f-4878-a3e2-c68aeab0978e
Nov 16 10:27:41 user nova-compute[85141]: DEBUG nova.compute.manager [req-3db27d40-e96f-47ce-9aae-1d8e6d771240 req-1c29e832-da86-478a-b7d8-c86df7217944 service nova] [instance: 463034ff-14ce-477a-9642-4d86aa6f9cd9] Received event network-vif-plugged-121bbc09-53cf-4586-8585-655079b4c49b {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:27:41 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-3db27d40-e96f-47ce-9aae-1d8e6d771240 req-1c29e832-da86-478a-b7d8-c86df7217944 service nova] Acquiring lock "463034ff-14ce-477a-9642-4d86aa6f9cd9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:27:41 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-3db27d40-e96f-47ce-9aae-1d8e6d771240 req-1c29e832-da86-478a-b7d8-c86df7217944 service nova] Lock "463034ff-14ce-477a-9642-4d86aa6f9cd9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:27:41 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-3db27d40-e96f-47ce-9aae-1d8e6d771240 req-1c29e832-da86-478a-b7d8-c86df7217944 service nova] Lock "463034ff-14ce-477a-9642-4d86aa6f9cd9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:27:41 user nova-compute[85141]: DEBUG nova.compute.manager [req-3db27d40-e96f-47ce-9aae-1d8e6d771240 req-1c29e832-da86-478a-b7d8-c86df7217944 service nova] [instance: 463034ff-14ce-477a-9642-4d86aa6f9cd9] No waiting events found dispatching network-vif-plugged-121bbc09-53cf-4586-8585-655079b4c49b {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:27:41 user nova-compute[85141]: WARNING nova.compute.manager [req-3db27d40-e96f-47ce-9aae-1d8e6d771240 req-1c29e832-da86-478a-b7d8-c86df7217944 service nova] [instance: 463034ff-14ce-477a-9642-4d86aa6f9cd9] Received unexpected event network-vif-plugged-121bbc09-53cf-4586-8585-655079b4c49b for instance with vm_state rescued and task_state unrescuing.
Nov 16 10:27:41 user nova-compute[85141]: DEBUG nova.compute.manager [req-3db27d40-e96f-47ce-9aae-1d8e6d771240 req-1c29e832-da86-478a-b7d8-c86df7217944 service nova] [instance: 463034ff-14ce-477a-9642-4d86aa6f9cd9] Received event network-vif-plugged-121bbc09-53cf-4586-8585-655079b4c49b {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:27:41 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-3db27d40-e96f-47ce-9aae-1d8e6d771240 req-1c29e832-da86-478a-b7d8-c86df7217944 service nova] Acquiring lock "463034ff-14ce-477a-9642-4d86aa6f9cd9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:27:41 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-3db27d40-e96f-47ce-9aae-1d8e6d771240 req-1c29e832-da86-478a-b7d8-c86df7217944 service nova] Lock "463034ff-14ce-477a-9642-4d86aa6f9cd9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:27:41 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-3db27d40-e96f-47ce-9aae-1d8e6d771240 req-1c29e832-da86-478a-b7d8-c86df7217944 service nova] Lock "463034ff-14ce-477a-9642-4d86aa6f9cd9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:27:41 user nova-compute[85141]: DEBUG nova.compute.manager [req-3db27d40-e96f-47ce-9aae-1d8e6d771240 req-1c29e832-da86-478a-b7d8-c86df7217944 service nova] [instance: 463034ff-14ce-477a-9642-4d86aa6f9cd9] No waiting events found dispatching network-vif-plugged-121bbc09-53cf-4586-8585-655079b4c49b {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:27:41 user nova-compute[85141]: WARNING nova.compute.manager [req-3db27d40-e96f-47ce-9aae-1d8e6d771240 req-1c29e832-da86-478a-b7d8-c86df7217944 service nova] [instance: 463034ff-14ce-477a-9642-4d86aa6f9cd9] Received unexpected event network-vif-plugged-121bbc09-53cf-4586-8585-655079b4c49b for instance with vm_state rescued and task_state unrescuing.
Nov 16 10:27:41 user nova-compute[85141]: DEBUG nova.compute.manager [req-3db27d40-e96f-47ce-9aae-1d8e6d771240 req-1c29e832-da86-478a-b7d8-c86df7217944 service nova] [instance: 463034ff-14ce-477a-9642-4d86aa6f9cd9] Received event network-vif-plugged-121bbc09-53cf-4586-8585-655079b4c49b {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:27:41 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-3db27d40-e96f-47ce-9aae-1d8e6d771240 req-1c29e832-da86-478a-b7d8-c86df7217944 service nova] Acquiring lock "463034ff-14ce-477a-9642-4d86aa6f9cd9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:27:41 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-3db27d40-e96f-47ce-9aae-1d8e6d771240 req-1c29e832-da86-478a-b7d8-c86df7217944 service nova] Lock "463034ff-14ce-477a-9642-4d86aa6f9cd9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:27:41 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-3db27d40-e96f-47ce-9aae-1d8e6d771240 req-1c29e832-da86-478a-b7d8-c86df7217944 service nova] Lock "463034ff-14ce-477a-9642-4d86aa6f9cd9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:27:41 user nova-compute[85141]: DEBUG nova.compute.manager [req-3db27d40-e96f-47ce-9aae-1d8e6d771240 req-1c29e832-da86-478a-b7d8-c86df7217944 service nova] [instance: 463034ff-14ce-477a-9642-4d86aa6f9cd9] No waiting events found dispatching network-vif-plugged-121bbc09-53cf-4586-8585-655079b4c49b {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:27:41 user nova-compute[85141]: WARNING nova.compute.manager [req-3db27d40-e96f-47ce-9aae-1d8e6d771240 req-1c29e832-da86-478a-b7d8-c86df7217944 service nova] [instance: 463034ff-14ce-477a-9642-4d86aa6f9cd9] Received unexpected event network-vif-plugged-121bbc09-53cf-4586-8585-655079b4c49b for instance with vm_state rescued and task_state unrescuing.
Nov 16 10:27:41 user nova-compute[85141]: DEBUG nova.compute.manager [req-3db27d40-e96f-47ce-9aae-1d8e6d771240 req-1c29e832-da86-478a-b7d8-c86df7217944 service nova] [instance: 463034ff-14ce-477a-9642-4d86aa6f9cd9] Received event network-vif-unplugged-121bbc09-53cf-4586-8585-655079b4c49b {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:27:41 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-3db27d40-e96f-47ce-9aae-1d8e6d771240 req-1c29e832-da86-478a-b7d8-c86df7217944 service nova] Acquiring lock "463034ff-14ce-477a-9642-4d86aa6f9cd9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:27:41 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-3db27d40-e96f-47ce-9aae-1d8e6d771240 req-1c29e832-da86-478a-b7d8-c86df7217944 service nova] Lock "463034ff-14ce-477a-9642-4d86aa6f9cd9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:27:41 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-3db27d40-e96f-47ce-9aae-1d8e6d771240 req-1c29e832-da86-478a-b7d8-c86df7217944 service nova] Lock "463034ff-14ce-477a-9642-4d86aa6f9cd9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:27:41 user nova-compute[85141]: DEBUG nova.compute.manager [req-3db27d40-e96f-47ce-9aae-1d8e6d771240 req-1c29e832-da86-478a-b7d8-c86df7217944 service nova] [instance: 463034ff-14ce-477a-9642-4d86aa6f9cd9] No waiting events found dispatching network-vif-unplugged-121bbc09-53cf-4586-8585-655079b4c49b {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:27:41 user nova-compute[85141]: WARNING nova.compute.manager [req-3db27d40-e96f-47ce-9aae-1d8e6d771240 req-1c29e832-da86-478a-b7d8-c86df7217944 service nova] [instance: 463034ff-14ce-477a-9642-4d86aa6f9cd9] Received unexpected event network-vif-unplugged-121bbc09-53cf-4586-8585-655079b4c49b for instance with vm_state rescued and task_state unrescuing.
Nov 16 10:27:41 user nova-compute[85141]: DEBUG nova.compute.manager [req-3db27d40-e96f-47ce-9aae-1d8e6d771240 req-1c29e832-da86-478a-b7d8-c86df7217944 service nova] [instance: 463034ff-14ce-477a-9642-4d86aa6f9cd9] Received event network-vif-plugged-121bbc09-53cf-4586-8585-655079b4c49b {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:27:41 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-3db27d40-e96f-47ce-9aae-1d8e6d771240 req-1c29e832-da86-478a-b7d8-c86df7217944 service nova] Acquiring lock "463034ff-14ce-477a-9642-4d86aa6f9cd9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:27:41 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-3db27d40-e96f-47ce-9aae-1d8e6d771240 req-1c29e832-da86-478a-b7d8-c86df7217944 service nova] Lock "463034ff-14ce-477a-9642-4d86aa6f9cd9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:27:41 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-3db27d40-e96f-47ce-9aae-1d8e6d771240 req-1c29e832-da86-478a-b7d8-c86df7217944 service nova] Lock "463034ff-14ce-477a-9642-4d86aa6f9cd9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:27:41 user nova-compute[85141]: DEBUG nova.compute.manager [req-3db27d40-e96f-47ce-9aae-1d8e6d771240 req-1c29e832-da86-478a-b7d8-c86df7217944 service nova] [instance: 463034ff-14ce-477a-9642-4d86aa6f9cd9] No waiting events found dispatching network-vif-plugged-121bbc09-53cf-4586-8585-655079b4c49b {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:27:41 user nova-compute[85141]: WARNING nova.compute.manager [req-3db27d40-e96f-47ce-9aae-1d8e6d771240 req-1c29e832-da86-478a-b7d8-c86df7217944 service nova] [instance: 463034ff-14ce-477a-9642-4d86aa6f9cd9] Received unexpected event network-vif-plugged-121bbc09-53cf-4586-8585-655079b4c49b for instance with vm_state rescued and task_state unrescuing.
Nov 16 10:27:41 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-f9213b8a-a427-4294-9707-890224ab9544 tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] Lock "9fcf8335-9e6f-4878-a3e2-c68aeab0978e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.219s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:27:41 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:27:41 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:27:41 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:27:41 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:27:41 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:27:42 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:27:42 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:27:42 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-300086b7-4045-4e2a-863e-c8b1afffa323 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.358s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 10:27:42 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-300086b7-4045-4e2a-863e-c8b1afffa323 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] <== connect_volume: return (1359ms) {'type': 'block', 'scsi_wwn': '23563613235646439', 'path': '/dev/sde'} {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 10:27:42 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-300086b7-4045-4e2a-863e-c8b1afffa323 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: e1253324-3ca1-4610-b9d6-3db7c6c76828] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23563613235646439', 'path': '/dev/sde'} {{(pid=85141) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 10:27:42 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-300086b7-4045-4e2a-863e-c8b1afffa323 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T10:27:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-615588371',display_name='tempest-TestVolumeBootPattern-volume-backed-server-615588371',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-615588371',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBYzzhkEK2/NjOq8Yn3s1/OzQQHvxzuiO6kqIBTDqgvHr65BPFUOAx5vszFFpF5ymvq8g8TtsBgjzBe0oF5cn8NT7CRg7igJehFG7Svi1to6c2aDBQ6RO7b9xkwKib4IUQ==',key_name='tempest-keypair-1027464512',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aec3bb9fe5e6446590900b5adf65df0f',ramdisk_id='',reservation_id='r-ekv5wv10',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1979039357',owner_user_name='tempest-TestVolumeBootPattern-1979039357-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T10:27:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7261b57c36904fcda87a9ea32d4b5b31',uuid=e1253324-3ca1-4610-b9d6-3db7c6c76828,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "29a94474-9722-43fb-b61a-d8eca4d6d728", "address": "fa:16:3e:ea:fd:01", "network": {"id": "b8ada47f-9721-4358-ac4f-0305f06dbbb8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1663922860-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aec3bb9fe5e6446590900b5adf65df0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29a94474-97", "ovs_interfaceid": "29a94474-9722-43fb-b61a-d8eca4d6d728", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=85141) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 10:27:42 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-300086b7-4045-4e2a-863e-c8b1afffa323 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Converting VIF {"id": "29a94474-9722-43fb-b61a-d8eca4d6d728", "address": "fa:16:3e:ea:fd:01", "network": {"id": "b8ada47f-9721-4358-ac4f-0305f06dbbb8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1663922860-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aec3bb9fe5e6446590900b5adf65df0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29a94474-97", "ovs_interfaceid": "29a94474-9722-43fb-b61a-d8eca4d6d728", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:27:42 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-300086b7-4045-4e2a-863e-c8b1afffa323 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:fd:01,bridge_name='br-int',has_traffic_filtering=True,id=29a94474-9722-43fb-b61a-d8eca4d6d728,network=Network(b8ada47f-9721-4358-ac4f-0305f06dbbb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29a94474-97') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:27:42 user nova-compute[85141]: DEBUG nova.objects.instance [None req-300086b7-4045-4e2a-863e-c8b1afffa323 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Lazy-loading 'pci_devices' on Instance uuid e1253324-3ca1-4610-b9d6-3db7c6c76828 {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:27:42 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-300086b7-4045-4e2a-863e-c8b1afffa323 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: e1253324-3ca1-4610-b9d6-3db7c6c76828] End _get_guest_xml xml=<domain type="kvm">
Nov 16 10:27:42 user nova-compute[85141]:   <uuid>e1253324-3ca1-4610-b9d6-3db7c6c76828</uuid>
Nov 16 10:27:42 user nova-compute[85141]:   <name>instance-00000025</name>
Nov 16 10:27:42 user nova-compute[85141]:   <memory>524288</memory>
Nov 16 10:27:42 user nova-compute[85141]:   <vcpu>1</vcpu>
Nov 16 10:27:42 user nova-compute[85141]:   <metadata>
Nov 16 10:27:42 user nova-compute[85141]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 10:27:42 user nova-compute[85141]:       <nova:package version="0.0.0"/>
Nov 16 10:27:42 user nova-compute[85141]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-615588371</nova:name>
Nov 16 10:27:42 user nova-compute[85141]:       <nova:creationTime>2023-11-16 10:27:40</nova:creationTime>
Nov 16 10:27:42 user nova-compute[85141]:       <nova:flavor name="m1.tiny">
Nov 16 10:27:42 user nova-compute[85141]:         <nova:memory>512</nova:memory>
Nov 16 10:27:42 user nova-compute[85141]:         <nova:disk>1</nova:disk>
Nov 16 10:27:42 user nova-compute[85141]:         <nova:swap>0</nova:swap>
Nov 16 10:27:42 user nova-compute[85141]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 10:27:42 user nova-compute[85141]:         <nova:vcpus>1</nova:vcpus>
Nov 16 10:27:42 user nova-compute[85141]:       </nova:flavor>
Nov 16 10:27:42 user nova-compute[85141]:       <nova:owner>
Nov 16 10:27:42 user nova-compute[85141]:         <nova:user uuid="7261b57c36904fcda87a9ea32d4b5b31">tempest-TestVolumeBootPattern-1979039357-project-member</nova:user>
Nov 16 10:27:42 user nova-compute[85141]:         <nova:project uuid="aec3bb9fe5e6446590900b5adf65df0f">tempest-TestVolumeBootPattern-1979039357</nova:project>
Nov 16 10:27:42 user nova-compute[85141]:       </nova:owner>
Nov 16 10:27:42 user nova-compute[85141]:       <nova:ports>
Nov 16 10:27:42 user nova-compute[85141]:         <nova:port uuid="29a94474-9722-43fb-b61a-d8eca4d6d728">
Nov 16 10:27:42 user nova-compute[85141]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 16 10:27:42 user nova-compute[85141]:         </nova:port>
Nov 16 10:27:42 user nova-compute[85141]:       </nova:ports>
Nov 16 10:27:42 user nova-compute[85141]:     </nova:instance>
Nov 16 10:27:42 user nova-compute[85141]:   </metadata>
Nov 16 10:27:42 user nova-compute[85141]:   <sysinfo type="smbios">
Nov 16 10:27:42 user nova-compute[85141]:     <system>
Nov 16 10:27:42 user nova-compute[85141]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 10:27:42 user nova-compute[85141]:       <entry name="product">OpenStack Nova</entry>
Nov 16 10:27:42 user nova-compute[85141]:       <entry name="version">0.0.0</entry>
Nov 16 10:27:42 user nova-compute[85141]:       <entry name="serial">e1253324-3ca1-4610-b9d6-3db7c6c76828</entry>
Nov 16 10:27:42 user nova-compute[85141]:       <entry name="uuid">e1253324-3ca1-4610-b9d6-3db7c6c76828</entry>
Nov 16 10:27:42 user nova-compute[85141]:       <entry name="family">Virtual Machine</entry>
Nov 16 10:27:42 user nova-compute[85141]:     </system>
Nov 16 10:27:42 user nova-compute[85141]:   </sysinfo>
Nov 16 10:27:42 user nova-compute[85141]:   <os>
Nov 16 10:27:42 user nova-compute[85141]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 10:27:42 user nova-compute[85141]:     <boot dev="hd"/>
Nov 16 10:27:42 user nova-compute[85141]:     <smbios mode="sysinfo"/>
Nov 16 10:27:42 user nova-compute[85141]:   </os>
Nov 16 10:27:42 user nova-compute[85141]:   <features>
Nov 16 10:27:42 user nova-compute[85141]:     <acpi/>
Nov 16 10:27:42 user nova-compute[85141]:     <apic/>
Nov 16 10:27:42 user nova-compute[85141]:     <vmcoreinfo/>
Nov 16 10:27:42 user nova-compute[85141]:   </features>
Nov 16 10:27:42 user nova-compute[85141]:   <clock offset="utc">
Nov 16 10:27:42 user nova-compute[85141]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 10:27:42 user nova-compute[85141]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 10:27:42 user nova-compute[85141]:     <timer name="hpet" present="no"/>
Nov 16 10:27:42 user nova-compute[85141]:   </clock>
Nov 16 10:27:42 user nova-compute[85141]:   <cpu mode="custom" match="exact">
Nov 16 10:27:42 user nova-compute[85141]:     <model>Nehalem</model>
Nov 16 10:27:42 user nova-compute[85141]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 10:27:42 user nova-compute[85141]:   </cpu>
Nov 16 10:27:42 user nova-compute[85141]:   <devices>
Nov 16 10:27:42 user nova-compute[85141]:     <disk type="block" device="disk">
Nov 16 10:27:42 user nova-compute[85141]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 10:27:42 user nova-compute[85141]:       <source dev="/dev/sde"/>
Nov 16 10:27:42 user nova-compute[85141]:       <target dev="vda" bus="virtio"/>
Nov 16 10:27:42 user nova-compute[85141]:       <serial>e0c5c19d-363b-4f5d-a04f-fb7de64423f2</serial>
Nov 16 10:27:42 user nova-compute[85141]:     </disk>
Nov 16 10:27:42 user nova-compute[85141]:     <interface type="ethernet">
Nov 16 10:27:42 user nova-compute[85141]:       <mac address="fa:16:3e:ea:fd:01"/>
Nov 16 10:27:42 user nova-compute[85141]:       <model type="virtio"/>
Nov 16 10:27:42 user nova-compute[85141]:       <mtu size="1442"/>
Nov 16 10:27:42 user nova-compute[85141]:       <target dev="tap29a94474-97"/>
Nov 16 10:27:42 user nova-compute[85141]:     </interface>
Nov 16 10:27:42 user nova-compute[85141]:     <serial type="pty">
Nov 16 10:27:42 user nova-compute[85141]:       <log file="/opt/stack/data/nova/instances/e1253324-3ca1-4610-b9d6-3db7c6c76828/console.log" append="off"/>
Nov 16 10:27:42 user nova-compute[85141]:     </serial>
Nov 16 10:27:42 user nova-compute[85141]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 10:27:42 user nova-compute[85141]:     <video>
Nov 16 10:27:42 user nova-compute[85141]:       <model type="virtio"/>
Nov 16 10:27:42 user nova-compute[85141]:     </video>
Nov 16 10:27:42 user nova-compute[85141]:     <rng model="virtio">
Nov 16 10:27:42 user nova-compute[85141]:       <backend model="random">/dev/urandom</backend>
Nov 16 10:27:42 user nova-compute[85141]:     </rng>
Nov 16 10:27:42 user nova-compute[85141]:     <controller type="usb" index="0" model="none"/>
Nov 16 10:27:42 user nova-compute[85141]:     <memballoon model="virtio">
Nov 16 10:27:42 user nova-compute[85141]:       <stats period="10"/>
Nov 16 10:27:42 user nova-compute[85141]:     </memballoon>
Nov 16 10:27:42 user nova-compute[85141]:   </devices>
Nov 16 10:27:42 user nova-compute[85141]: </domain>
Nov 16 10:27:42 user nova-compute[85141]:  {{(pid=85141) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 10:27:42 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-300086b7-4045-4e2a-863e-c8b1afffa323 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T10:27:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-615588371',display_name='tempest-TestVolumeBootPattern-volume-backed-server-615588371',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-615588371',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBYzzhkEK2/NjOq8Yn3s1/OzQQHvxzuiO6kqIBTDqgvHr65BPFUOAx5vszFFpF5ymvq8g8TtsBgjzBe0oF5cn8NT7CRg7igJehFG7Svi1to6c2aDBQ6RO7b9xkwKib4IUQ==',key_name='tempest-keypair-1027464512',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aec3bb9fe5e6446590900b5adf65df0f',ramdisk_id='',reservation_id='r-ekv5wv10',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1979039357',owner_user_name='tempest-TestVolumeBootPattern-1979039357-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T10:27:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7261b57c36904fcda87a9ea32d4b5b31',uuid=e1253324-3ca1-4610-b9d6-3db7c6c76828,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "29a94474-9722-43fb-b61a-d8eca4d6d728", "address": "fa:16:3e:ea:fd:01", "network": {"id": "b8ada47f-9721-4358-ac4f-0305f06dbbb8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1663922860-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aec3bb9fe5e6446590900b5adf65df0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29a94474-97", "ovs_interfaceid": "29a94474-9722-43fb-b61a-d8eca4d6d728", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 10:27:42 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-300086b7-4045-4e2a-863e-c8b1afffa323 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Converting VIF {"id": "29a94474-9722-43fb-b61a-d8eca4d6d728", "address": "fa:16:3e:ea:fd:01", "network": {"id": "b8ada47f-9721-4358-ac4f-0305f06dbbb8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1663922860-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aec3bb9fe5e6446590900b5adf65df0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29a94474-97", "ovs_interfaceid": "29a94474-9722-43fb-b61a-d8eca4d6d728", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:27:42 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-300086b7-4045-4e2a-863e-c8b1afffa323 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:fd:01,bridge_name='br-int',has_traffic_filtering=True,id=29a94474-9722-43fb-b61a-d8eca4d6d728,network=Network(b8ada47f-9721-4358-ac4f-0305f06dbbb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29a94474-97') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:27:42 user nova-compute[85141]: DEBUG os_vif [None req-300086b7-4045-4e2a-863e-c8b1afffa323 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:fd:01,bridge_name='br-int',has_traffic_filtering=True,id=29a94474-9722-43fb-b61a-d8eca4d6d728,network=Network(b8ada47f-9721-4358-ac4f-0305f06dbbb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29a94474-97') {{(pid=85141) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 10:27:42 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:27:42 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:27:42 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 10:27:42 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:27:42 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '91b13f90-5e72-59ff-bb5e-98ae22ee9d8c', '_type': 'linux-noop'}}, row=False) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:27:42 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:27:42 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:27:42 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:27:42 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap29a94474-97, may_exist=True, interface_attrs={}) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:27:42 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap29a94474-97, col_values=(('qos', UUID('47c866f4-2e4b-4cbc-8c69-270550ab144a')),), if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:27:42 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap29a94474-97, col_values=(('external_ids', {'iface-id': '29a94474-9722-43fb-b61a-d8eca4d6d728', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ea:fd:01', 'vm-uuid': 'e1253324-3ca1-4610-b9d6-3db7c6c76828'}),), if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:27:42 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:27:42 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:27:42 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:27:42 user nova-compute[85141]: INFO os_vif [None req-300086b7-4045-4e2a-863e-c8b1afffa323 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:fd:01,bridge_name='br-int',has_traffic_filtering=True,id=29a94474-9722-43fb-b61a-d8eca4d6d728,network=Network(b8ada47f-9721-4358-ac4f-0305f06dbbb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29a94474-97')
Nov 16 10:27:42 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:27:42 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:27:42 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:27:42 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:27:42 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-300086b7-4045-4e2a-863e-c8b1afffa323 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] No BDM found with device name vda, not building metadata. {{(pid=85141) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 10:27:42 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-300086b7-4045-4e2a-863e-c8b1afffa323 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] No VIF found with MAC fa:16:3e:ea:fd:01, not building metadata {{(pid=85141) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 10:27:43 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:27:43 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:27:43 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:27:43 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:27:43 user nova-compute[85141]: DEBUG nova.compute.manager [req-18d36ce9-8b91-4d77-baa2-e757c3f24d4e req-467540dd-f376-40b0-9468-c10fa9bb09fa service nova] [instance: e1253324-3ca1-4610-b9d6-3db7c6c76828] Received event network-vif-plugged-29a94474-9722-43fb-b61a-d8eca4d6d728 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:27:43 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-18d36ce9-8b91-4d77-baa2-e757c3f24d4e req-467540dd-f376-40b0-9468-c10fa9bb09fa service nova] Acquiring lock "e1253324-3ca1-4610-b9d6-3db7c6c76828-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:27:43 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-18d36ce9-8b91-4d77-baa2-e757c3f24d4e req-467540dd-f376-40b0-9468-c10fa9bb09fa service nova] Lock "e1253324-3ca1-4610-b9d6-3db7c6c76828-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:27:43 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-18d36ce9-8b91-4d77-baa2-e757c3f24d4e req-467540dd-f376-40b0-9468-c10fa9bb09fa service nova] Lock "e1253324-3ca1-4610-b9d6-3db7c6c76828-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:27:43 user nova-compute[85141]: DEBUG nova.compute.manager [req-18d36ce9-8b91-4d77-baa2-e757c3f24d4e req-467540dd-f376-40b0-9468-c10fa9bb09fa service nova] [instance: e1253324-3ca1-4610-b9d6-3db7c6c76828] No waiting events found dispatching network-vif-plugged-29a94474-9722-43fb-b61a-d8eca4d6d728 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:27:43 user nova-compute[85141]: WARNING nova.compute.manager [req-18d36ce9-8b91-4d77-baa2-e757c3f24d4e req-467540dd-f376-40b0-9468-c10fa9bb09fa service nova] [instance: e1253324-3ca1-4610-b9d6-3db7c6c76828] Received unexpected event network-vif-plugged-29a94474-9722-43fb-b61a-d8eca4d6d728 for instance with vm_state building and task_state spawning.
Nov 16 10:27:43 user nova-compute[85141]: DEBUG nova.compute.manager [req-58350f06-b640-4709-b13a-f79a41c74c56 req-ff2efac3-7423-421a-a23e-cdc257c9f292 service nova] [instance: 463034ff-14ce-477a-9642-4d86aa6f9cd9] Received event network-vif-plugged-121bbc09-53cf-4586-8585-655079b4c49b {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:27:43 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-58350f06-b640-4709-b13a-f79a41c74c56 req-ff2efac3-7423-421a-a23e-cdc257c9f292 service nova] Acquiring lock "463034ff-14ce-477a-9642-4d86aa6f9cd9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:27:43 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-58350f06-b640-4709-b13a-f79a41c74c56 req-ff2efac3-7423-421a-a23e-cdc257c9f292 service nova] Lock "463034ff-14ce-477a-9642-4d86aa6f9cd9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:27:43 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-58350f06-b640-4709-b13a-f79a41c74c56 req-ff2efac3-7423-421a-a23e-cdc257c9f292 service nova] Lock "463034ff-14ce-477a-9642-4d86aa6f9cd9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:27:43 user nova-compute[85141]: DEBUG nova.compute.manager [req-58350f06-b640-4709-b13a-f79a41c74c56 req-ff2efac3-7423-421a-a23e-cdc257c9f292 service nova] [instance: 463034ff-14ce-477a-9642-4d86aa6f9cd9] No waiting events found dispatching network-vif-plugged-121bbc09-53cf-4586-8585-655079b4c49b {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:27:43 user nova-compute[85141]: WARNING nova.compute.manager [req-58350f06-b640-4709-b13a-f79a41c74c56 req-ff2efac3-7423-421a-a23e-cdc257c9f292 service nova] [instance: 463034ff-14ce-477a-9642-4d86aa6f9cd9] Received unexpected event network-vif-plugged-121bbc09-53cf-4586-8585-655079b4c49b for instance with vm_state rescued and task_state unrescuing.
Nov 16 10:27:43 user nova-compute[85141]: DEBUG nova.compute.manager [req-58350f06-b640-4709-b13a-f79a41c74c56 req-ff2efac3-7423-421a-a23e-cdc257c9f292 service nova] [instance: 463034ff-14ce-477a-9642-4d86aa6f9cd9] Received event network-vif-plugged-121bbc09-53cf-4586-8585-655079b4c49b {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:27:43 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-58350f06-b640-4709-b13a-f79a41c74c56 req-ff2efac3-7423-421a-a23e-cdc257c9f292 service nova] Acquiring lock "463034ff-14ce-477a-9642-4d86aa6f9cd9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:27:43 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-58350f06-b640-4709-b13a-f79a41c74c56 req-ff2efac3-7423-421a-a23e-cdc257c9f292 service nova] Lock "463034ff-14ce-477a-9642-4d86aa6f9cd9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:27:43 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-58350f06-b640-4709-b13a-f79a41c74c56 req-ff2efac3-7423-421a-a23e-cdc257c9f292 service nova] Lock "463034ff-14ce-477a-9642-4d86aa6f9cd9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:27:43 user nova-compute[85141]: DEBUG nova.compute.manager [req-58350f06-b640-4709-b13a-f79a41c74c56 req-ff2efac3-7423-421a-a23e-cdc257c9f292 service nova] [instance: 463034ff-14ce-477a-9642-4d86aa6f9cd9] No waiting events found dispatching network-vif-plugged-121bbc09-53cf-4586-8585-655079b4c49b {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:27:43 user nova-compute[85141]: WARNING nova.compute.manager [req-58350f06-b640-4709-b13a-f79a41c74c56 req-ff2efac3-7423-421a-a23e-cdc257c9f292 service nova] [instance: 463034ff-14ce-477a-9642-4d86aa6f9cd9] Received unexpected event network-vif-plugged-121bbc09-53cf-4586-8585-655079b4c49b for instance with vm_state rescued and task_state unrescuing.
Nov 16 10:27:43 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-100846e9-59eb-4a1c-94ad-1d5bf04cf791 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 17480138-4b61-43f7-92a5-db065f7d1696 is timed out.
Nov 16 10:27:43 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-100846e9-59eb-4a1c-94ad-1d5bf04cf791 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Successfully detached device vdb from instance 17480138-4b61-43f7-92a5-db065f7d1696 from the live domain config.
Nov 16 10:27:43 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-100846e9-59eb-4a1c-94ad-1d5bf04cf791 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] [instance: 17480138-4b61-43f7-92a5-db065f7d1696] calling os-brick to detach iSCSI Volume {{(pid=85141) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 10:27:43 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-100846e9-59eb-4a1c-94ad-1d5bf04cf791 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51806b6080>, {'target_iqn': 'iqn.2010-10.org.openstack:bb96bfcd-cecc-452f-bc3b-61b7daf72599', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lftgnHOy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 10:27:43 user nova-compute[85141]: WARNING os_brick.initiator.connectors.base [None req-100846e9-59eb-4a1c-94ad-1d5bf04cf791 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 10:27:43 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-100846e9-59eb-4a1c-94ad-1d5bf04cf791 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 10:27:43 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-100846e9-59eb-4a1c-94ad-1d5bf04cf791 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 10:27:43 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:27:43 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:27:43 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e5b4197-c967-4552-b936-e61ec76f553f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e0c5c19d-363b-4f5d-a04f-fb7de64423f2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bb96bfcd-cecc-452f-bc3b-61b7daf72599\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:11a6a15b-38c1-4e7e-b8fa-2feb6789e775\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e1b58025-0c18-41f6-a126-fb3c925399a1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2006a77c-e5e8-4ec5-8de5-a0f9505c429a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:27:43 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-100846e9-59eb-4a1c-94ad-1d5bf04cf791 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 10:27:43 user nova-compute[85141]: No targets found.
Nov 16 10:27:43 user nova-compute[85141]: iSNS:
Nov 16 10:27:43 user nova-compute[85141]: No targets found.
Nov 16 10:27:43 user nova-compute[85141]: STATIC:
Nov 16 10:27:43 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:e0c5c19d-363b-4f5d-a04f-fb7de64423f2
Nov 16 10:27:43 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:27:43 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:27:43 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:bb96bfcd-cecc-452f-bc3b-61b7daf72599
Nov 16 10:27:43 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:27:43 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:27:43 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee
Nov 16 10:27:43 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:27:43 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:27:43 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:11a6a15b-38c1-4e7e-b8fa-2feb6789e775
Nov 16 10:27:43 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:27:43 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:27:43 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:e1b58025-0c18-41f6-a126-fb3c925399a1
Nov 16 10:27:43 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:27:43 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:27:43 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:2006a77c-e5e8-4ec5-8de5-a0f9505c429a
Nov 16 10:27:43 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:27:43 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:27:43 user nova-compute[85141]: FIRMWARE:
Nov 16 10:27:43 user nova-compute[85141]: No targets found.
Nov 16 10:27:43 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:27:43 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-100846e9-59eb-4a1c-94ad-1d5bf04cf791 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 10:27:43 user nova-compute[85141]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 10:27:43 user nova-compute[85141]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=85141) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 10:27:43 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-100846e9-59eb-4a1c-94ad-1d5bf04cf791 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bb96bfcd-cecc-452f-bc3b-61b7daf72599', 0)] {{(pid=85141) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 10:27:43 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:27:43 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:27:43 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5d380d1-b23f-49c7-8db6-9d55244f3ff0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:11a6a15b-38c1-4e7e-b8fa-2feb6789e775\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2006a77c-e5e8-4ec5-8de5-a0f9505c429a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bb96bfcd-cecc-452f-bc3b-61b7daf72599\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e0c5c19d-363b-4f5d-a04f-fb7de64423f2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e1b58025-0c18-41f6-a126-fb3c925399a1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:27:43 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:27:43 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.050s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:27:43 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[9da38e6a-66a1-4653-8843-a4cd1001d34b]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11a6a15b-38c1-4e7e-b8fa-2feb6789e775 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb96bfcd-cecc-452f-bc3b-61b7daf72599 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b58025-0c18-41f6-a126-fb3c925399a1 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2006a77c-e5e8-4ec5-8de5-a0f9505c429a (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0c5c19d-363b-4f5d-a04f-fb7de64423f2 (non-flash)\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:27:43 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-100846e9-59eb-4a1c-94ad-1d5bf04cf791 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)
Nov 16 10:27:43 user nova-compute[85141]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11a6a15b-38c1-4e7e-b8fa-2feb6789e775 (non-flash)
Nov 16 10:27:43 user nova-compute[85141]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb96bfcd-cecc-452f-bc3b-61b7daf72599 (non-flash)
Nov 16 10:27:43 user nova-compute[85141]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b58025-0c18-41f6-a126-fb3c925399a1 (non-flash)
Nov 16 10:27:43 user nova-compute[85141]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2006a77c-e5e8-4ec5-8de5-a0f9505c429a (non-flash)
Nov 16 10:27:43 user nova-compute[85141]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0c5c19d-363b-4f5d-a04f-fb7de64423f2 (non-flash)
Nov 16 10:27:43 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:27:43 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-100846e9-59eb-4a1c-94ad-1d5bf04cf791 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)
Nov 16 10:27:43 user nova-compute[85141]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11a6a15b-38c1-4e7e-b8fa-2feb6789e775 (non-flash)
Nov 16 10:27:43 user nova-compute[85141]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb96bfcd-cecc-452f-bc3b-61b7daf72599 (non-flash)
Nov 16 10:27:43 user nova-compute[85141]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b58025-0c18-41f6-a126-fb3c925399a1 (non-flash)
Nov 16 10:27:43 user nova-compute[85141]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2006a77c-e5e8-4ec5-8de5-a0f9505c429a (non-flash)
Nov 16 10:27:43 user nova-compute[85141]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0c5c19d-363b-4f5d-a04f-fb7de64423f2 (non-flash)
Nov 16 10:27:43 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 10:27:43 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-100846e9-59eb-4a1c-94ad-1d5bf04cf791 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f51a09b4dc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bb96bfcd-cecc-452f-bc3b-61b7daf72599'): ({'sdf'}, set())}) {{(pid=85141) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 10:27:43 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-100846e9-59eb-4a1c-94ad-1d5bf04cf791 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Removing single pathed devices sdf {{(pid=85141) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 10:27:43 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:27:44 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:27:44 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[574251ed-ce56-4332-ba13-4b5d2a96bef4]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:27:44 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:27:44 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.022s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:27:44 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[b48482cc-470d-4aa1-83a3-70ca11e56dc8]: (4, ('ok\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:27:44 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-100846e9-59eb-4a1c-94ad-1d5bf04cf791 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Flushing IO for device /dev/sdf {{(pid=85141) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 10:27:44 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:27:44 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.018s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:27:44 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[a963d4e9-7a66-40d4-8c56-373b483ee7c2]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:27:44 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-100846e9-59eb-4a1c-94ad-1d5bf04cf791 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=85141) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 10:27:44 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:27:44 user nova-compute[85141]: DEBUG nova.compute.manager [None req-53863f76-8227-4f00-904a-15856ca3751e tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] [instance: 463034ff-14ce-477a-9642-4d86aa6f9cd9] Checking state {{(pid=85141) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 10:27:44 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.062s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:27:44 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bd8a6f1-3b0b-4104-8a9f-133f104964ca]: (4, ('1', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:27:44 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-100846e9-59eb-4a1c-94ad-1d5bf04cf791 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=85141) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 10:27:44 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-100846e9-59eb-4a1c-94ad-1d5bf04cf791 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] SCSI volumes sdf have been removed. {{(pid=85141) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 10:27:44 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-100846e9-59eb-4a1c-94ad-1d5bf04cf791 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bb96bfcd-cecc-452f-bc3b-61b7daf72599')] {{(pid=85141) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 10:27:44 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb96bfcd-cecc-452f-bc3b-61b7daf72599 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:27:44 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb96bfcd-cecc-452f-bc3b-61b7daf72599 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:27:44 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[8659d34a-0eb1-478a-a96e-0c29a713ba40]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:27:44 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-100846e9-59eb-4a1c-94ad-1d5bf04cf791 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:27:44 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb96bfcd-cecc-452f-bc3b-61b7daf72599 -p 172.16.0.220:3260 --logout {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:27:44 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:27:44 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:27:44 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb96bfcd-cecc-452f-bc3b-61b7daf72599 -p 172.16.0.220:3260 --logout" returned: 0 in 0.077s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:27:44 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3415a30-b689-4546-9ec8-2d5d31bc5b97]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:bb96bfcd-cecc-452f-bc3b-61b7daf72599, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:bb96bfcd-cecc-452f-bc3b-61b7daf72599, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:27:44 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-100846e9-59eb-4a1c-94ad-1d5bf04cf791 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:bb96bfcd-cecc-452f-bc3b-61b7daf72599, portal: 172.16.0.220,3260]
Nov 16 10:27:44 user nova-compute[85141]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:bb96bfcd-cecc-452f-bc3b-61b7daf72599, portal: 172.16.0.220,3260] successful.
Nov 16 10:27:44 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:27:44 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb96bfcd-cecc-452f-bc3b-61b7daf72599 -p 172.16.0.220:3260 --op delete {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:27:44 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb96bfcd-cecc-452f-bc3b-61b7daf72599 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:27:44 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[b28a7886-a12e-4e08-b7d4-df12b6faa860]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:27:44 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-100846e9-59eb-4a1c-94ad-1d5bf04cf791 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:27:44 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-100846e9-59eb-4a1c-94ad-1d5bf04cf791 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.404s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 10:27:44 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-100846e9-59eb-4a1c-94ad-1d5bf04cf791 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] <== disconnect_volume: return (406ms) None {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 10:27:44 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-100846e9-59eb-4a1c-94ad-1d5bf04cf791 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] [instance: 17480138-4b61-43f7-92a5-db065f7d1696] Disconnected iSCSI Volume {{(pid=85141) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 10:27:45 user nova-compute[85141]: DEBUG nova.objects.instance [None req-100846e9-59eb-4a1c-94ad-1d5bf04cf791 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Lazy-loading 'flavor' on Instance uuid 17480138-4b61-43f7-92a5-db065f7d1696 {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:27:45 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-100846e9-59eb-4a1c-94ad-1d5bf04cf791 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Lock "17480138-4b61-43f7-92a5-db065f7d1696" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.102s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:27:45 user nova-compute[85141]: DEBUG nova.compute.manager [req-e2497e7f-b5f5-4e7f-b3e4-03f0abb855de req-02118e27-c942-4de7-9176-e9b237c3eb02 service nova] [instance: e1253324-3ca1-4610-b9d6-3db7c6c76828] Received event network-vif-plugged-29a94474-9722-43fb-b61a-d8eca4d6d728 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:27:45 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-e2497e7f-b5f5-4e7f-b3e4-03f0abb855de req-02118e27-c942-4de7-9176-e9b237c3eb02 service nova] Acquiring lock "e1253324-3ca1-4610-b9d6-3db7c6c76828-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:27:45 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-e2497e7f-b5f5-4e7f-b3e4-03f0abb855de req-02118e27-c942-4de7-9176-e9b237c3eb02 service nova] Lock "e1253324-3ca1-4610-b9d6-3db7c6c76828-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:27:45 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-e2497e7f-b5f5-4e7f-b3e4-03f0abb855de req-02118e27-c942-4de7-9176-e9b237c3eb02 service nova] Lock "e1253324-3ca1-4610-b9d6-3db7c6c76828-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:27:45 user nova-compute[85141]: DEBUG nova.compute.manager [req-e2497e7f-b5f5-4e7f-b3e4-03f0abb855de req-02118e27-c942-4de7-9176-e9b237c3eb02 service nova] [instance: e1253324-3ca1-4610-b9d6-3db7c6c76828] No waiting events found dispatching network-vif-plugged-29a94474-9722-43fb-b61a-d8eca4d6d728 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:27:45 user nova-compute[85141]: WARNING nova.compute.manager [req-e2497e7f-b5f5-4e7f-b3e4-03f0abb855de req-02118e27-c942-4de7-9176-e9b237c3eb02 service nova] [instance: e1253324-3ca1-4610-b9d6-3db7c6c76828] Received unexpected event network-vif-plugged-29a94474-9722-43fb-b61a-d8eca4d6d728 for instance with vm_state building and task_state spawning.
Nov 16 10:27:45 user nova-compute[85141]: DEBUG nova.compute.manager [None req-300086b7-4045-4e2a-863e-c8b1afffa323 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: e1253324-3ca1-4610-b9d6-3db7c6c76828] Instance event wait completed in 0 seconds for  {{(pid=85141) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 10:27:45 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-300086b7-4045-4e2a-863e-c8b1afffa323 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: e1253324-3ca1-4610-b9d6-3db7c6c76828] Guest created on hypervisor {{(pid=85141) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 10:27:45 user nova-compute[85141]: INFO nova.virt.libvirt.driver [-] [instance: e1253324-3ca1-4610-b9d6-3db7c6c76828] Instance spawned successfully.
Nov 16 10:27:45 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-300086b7-4045-4e2a-863e-c8b1afffa323 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: e1253324-3ca1-4610-b9d6-3db7c6c76828] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 10:27:45 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-300086b7-4045-4e2a-863e-c8b1afffa323 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: e1253324-3ca1-4610-b9d6-3db7c6c76828] Found default for hw_cdrom_bus of ide {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:27:45 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-300086b7-4045-4e2a-863e-c8b1afffa323 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: e1253324-3ca1-4610-b9d6-3db7c6c76828] Found default for hw_disk_bus of virtio {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:27:45 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-300086b7-4045-4e2a-863e-c8b1afffa323 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: e1253324-3ca1-4610-b9d6-3db7c6c76828] Found default for hw_input_bus of None {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:27:45 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-300086b7-4045-4e2a-863e-c8b1afffa323 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: e1253324-3ca1-4610-b9d6-3db7c6c76828] Found default for hw_pointer_model of None {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:27:45 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-300086b7-4045-4e2a-863e-c8b1afffa323 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: e1253324-3ca1-4610-b9d6-3db7c6c76828] Found default for hw_video_model of virtio {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:27:45 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-300086b7-4045-4e2a-863e-c8b1afffa323 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: e1253324-3ca1-4610-b9d6-3db7c6c76828] Found default for hw_vif_model of virtio {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:27:45 user nova-compute[85141]: INFO nova.compute.manager [None req-300086b7-4045-4e2a-863e-c8b1afffa323 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: e1253324-3ca1-4610-b9d6-3db7c6c76828] Took 5.39 seconds to spawn the instance on the hypervisor.
Nov 16 10:27:45 user nova-compute[85141]: DEBUG nova.compute.manager [None req-300086b7-4045-4e2a-863e-c8b1afffa323 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: e1253324-3ca1-4610-b9d6-3db7c6c76828] Checking state {{(pid=85141) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 10:27:46 user nova-compute[85141]: INFO nova.compute.manager [None req-300086b7-4045-4e2a-863e-c8b1afffa323 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: e1253324-3ca1-4610-b9d6-3db7c6c76828] Took 12.98 seconds to build instance.
Nov 16 10:27:46 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-300086b7-4045-4e2a-863e-c8b1afffa323 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Lock "e1253324-3ca1-4610-b9d6-3db7c6c76828" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.115s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:27:47 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:27:47 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:27:48 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:27:52 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:27:57 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:28:02 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:28:03 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:28:04 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:28:07 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:28:07 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:28:08 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:28:12 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:28:12 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:28:13 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:28:13 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:28:14 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:28:16 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-be208941-3f32-4f5b-a323-1b62350200a6 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Acquiring lock "17480138-4b61-43f7-92a5-db065f7d1696" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:28:16 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-be208941-3f32-4f5b-a323-1b62350200a6 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Lock "17480138-4b61-43f7-92a5-db065f7d1696" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:28:16 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-be208941-3f32-4f5b-a323-1b62350200a6 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Acquiring lock "17480138-4b61-43f7-92a5-db065f7d1696-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:28:16 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-be208941-3f32-4f5b-a323-1b62350200a6 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Lock "17480138-4b61-43f7-92a5-db065f7d1696-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:28:16 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-be208941-3f32-4f5b-a323-1b62350200a6 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Lock "17480138-4b61-43f7-92a5-db065f7d1696-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:28:16 user nova-compute[85141]: INFO nova.compute.manager [None req-be208941-3f32-4f5b-a323-1b62350200a6 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] [instance: 17480138-4b61-43f7-92a5-db065f7d1696] Terminating instance
Nov 16 10:28:16 user nova-compute[85141]: DEBUG nova.compute.manager [None req-be208941-3f32-4f5b-a323-1b62350200a6 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] [instance: 17480138-4b61-43f7-92a5-db065f7d1696] Start destroying the instance on the hypervisor. {{(pid=85141) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 10:28:16 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:28:16 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:28:16 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:28:16 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:28:17 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:28:17 user nova-compute[85141]: DEBUG nova.compute.manager [req-96513d25-1b67-4f16-a5c4-99d523dad315 req-0b16b6da-a1c5-4770-a946-0097841175cf service nova] [instance: 17480138-4b61-43f7-92a5-db065f7d1696] Received event network-vif-unplugged-6082a650-3a4c-4393-b6ab-8cbc97d751cb {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:28:17 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-96513d25-1b67-4f16-a5c4-99d523dad315 req-0b16b6da-a1c5-4770-a946-0097841175cf service nova] Acquiring lock "17480138-4b61-43f7-92a5-db065f7d1696-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:28:17 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-96513d25-1b67-4f16-a5c4-99d523dad315 req-0b16b6da-a1c5-4770-a946-0097841175cf service nova] Lock "17480138-4b61-43f7-92a5-db065f7d1696-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:28:17 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-96513d25-1b67-4f16-a5c4-99d523dad315 req-0b16b6da-a1c5-4770-a946-0097841175cf service nova] Lock "17480138-4b61-43f7-92a5-db065f7d1696-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:28:17 user nova-compute[85141]: DEBUG nova.compute.manager [req-96513d25-1b67-4f16-a5c4-99d523dad315 req-0b16b6da-a1c5-4770-a946-0097841175cf service nova] [instance: 17480138-4b61-43f7-92a5-db065f7d1696] No waiting events found dispatching network-vif-unplugged-6082a650-3a4c-4393-b6ab-8cbc97d751cb {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:28:17 user nova-compute[85141]: DEBUG nova.compute.manager [req-96513d25-1b67-4f16-a5c4-99d523dad315 req-0b16b6da-a1c5-4770-a946-0097841175cf service nova] [instance: 17480138-4b61-43f7-92a5-db065f7d1696] Received event network-vif-unplugged-6082a650-3a4c-4393-b6ab-8cbc97d751cb for instance with task_state deleting. {{(pid=85141) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 10:28:17 user nova-compute[85141]: INFO nova.virt.libvirt.driver [-] [instance: 17480138-4b61-43f7-92a5-db065f7d1696] Instance destroyed successfully.
Nov 16 10:28:17 user nova-compute[85141]: DEBUG nova.objects.instance [None req-be208941-3f32-4f5b-a323-1b62350200a6 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Lazy-loading 'resources' on Instance uuid 17480138-4b61-43f7-92a5-db065f7d1696 {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:28:17 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-be208941-3f32-4f5b-a323-1b62350200a6 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T10:23:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1016408900',display_name='tempest-TestMinimumBasicScenario-server-1016408900',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1016408900',id=29,image_ref='02a606ba-ede1-407d-a705-3096965845d4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM5QAu9tmIiG19cYFLnKY14lKb1asapUwyzieFSgmsXZ5HIBmKcOtLkuG9D0Q+roR/DuIPKPcyBbi0aHUfveomJ+iiD6VjcU+CQiQpu6xXsDlRfjOeGe+hceqhGiZhbY2A==',key_name='tempest-TestMinimumBasicScenario-1095224120',keypairs=<?>,launch_index=0,launched_at=2023-11-16T10:23:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b4e4f57f79564d2fbcb8080bf8f1c5c0',ramdisk_id='',reservation_id='r-bermcl2h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='02a606ba-ede1-407d-a705-3096965845d4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-766472507',owner_user_name='tempest-TestMinimumBasicScenario-766472507-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T10:25:38Z,user_data=None,user_id='f8792b5cbd0845299dc396f922399980',uuid=17480138-4b61-43f7-92a5-db065f7d1696,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6082a650-3a4c-4393-b6ab-8cbc97d751cb", "address": "fa:16:3e:9f:52:3b", "network": {"id": "436477fd-9294-4297-bfb3-405564823fa0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1068749207-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4e4f57f79564d2fbcb8080bf8f1c5c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6082a650-3a", "ovs_interfaceid": "6082a650-3a4c-4393-b6ab-8cbc97d751cb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 10:28:17 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-be208941-3f32-4f5b-a323-1b62350200a6 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Converting VIF {"id": "6082a650-3a4c-4393-b6ab-8cbc97d751cb", "address": "fa:16:3e:9f:52:3b", "network": {"id": "436477fd-9294-4297-bfb3-405564823fa0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1068749207-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4e4f57f79564d2fbcb8080bf8f1c5c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6082a650-3a", "ovs_interfaceid": "6082a650-3a4c-4393-b6ab-8cbc97d751cb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:28:17 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-be208941-3f32-4f5b-a323-1b62350200a6 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9f:52:3b,bridge_name='br-int',has_traffic_filtering=True,id=6082a650-3a4c-4393-b6ab-8cbc97d751cb,network=Network(436477fd-9294-4297-bfb3-405564823fa0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6082a650-3a') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:28:17 user nova-compute[85141]: DEBUG os_vif [None req-be208941-3f32-4f5b-a323-1b62350200a6 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9f:52:3b,bridge_name='br-int',has_traffic_filtering=True,id=6082a650-3a4c-4393-b6ab-8cbc97d751cb,network=Network(436477fd-9294-4297-bfb3-405564823fa0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6082a650-3a') {{(pid=85141) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 10:28:17 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:28:17 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6082a650-3a, bridge=br-int, if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:28:17 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:28:17 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:28:17 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:28:17 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b3d4f04e-550a-4a64-8c28-7317b6961892) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:28:17 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:28:17 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:28:17 user nova-compute[85141]: INFO os_vif [None req-be208941-3f32-4f5b-a323-1b62350200a6 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9f:52:3b,bridge_name='br-int',has_traffic_filtering=True,id=6082a650-3a4c-4393-b6ab-8cbc97d751cb,network=Network(436477fd-9294-4297-bfb3-405564823fa0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6082a650-3a')
Nov 16 10:28:17 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-be208941-3f32-4f5b-a323-1b62350200a6 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] [instance: 17480138-4b61-43f7-92a5-db065f7d1696] Deleting instance files /opt/stack/data/nova/instances/17480138-4b61-43f7-92a5-db065f7d1696_del
Nov 16 10:28:17 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-be208941-3f32-4f5b-a323-1b62350200a6 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] [instance: 17480138-4b61-43f7-92a5-db065f7d1696] Deletion of /opt/stack/data/nova/instances/17480138-4b61-43f7-92a5-db065f7d1696_del complete
Nov 16 10:28:17 user nova-compute[85141]: INFO nova.compute.manager [None req-be208941-3f32-4f5b-a323-1b62350200a6 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] [instance: 17480138-4b61-43f7-92a5-db065f7d1696] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 16 10:28:17 user nova-compute[85141]: DEBUG oslo.service.loopingcall [None req-be208941-3f32-4f5b-a323-1b62350200a6 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=85141) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 10:28:17 user nova-compute[85141]: DEBUG nova.compute.manager [-] [instance: 17480138-4b61-43f7-92a5-db065f7d1696] Deallocating network for instance {{(pid=85141) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 10:28:17 user nova-compute[85141]: DEBUG nova.network.neutron [-] [instance: 17480138-4b61-43f7-92a5-db065f7d1696] deallocate_for_instance() {{(pid=85141) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 10:28:17 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-b7d8f534-8000-405a-8e23-ec08618974e6 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Acquiring lock "da42de06-4518-4c8a-8c63-9b5a2759a1bf" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:28:17 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-b7d8f534-8000-405a-8e23-ec08618974e6 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Lock "da42de06-4518-4c8a-8c63-9b5a2759a1bf" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:28:17 user nova-compute[85141]: DEBUG nova.compute.manager [None req-b7d8f534-8000-405a-8e23-ec08618974e6 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] [instance: da42de06-4518-4c8a-8c63-9b5a2759a1bf] Starting instance... {{(pid=85141) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 10:28:17 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-b7d8f534-8000-405a-8e23-ec08618974e6 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:28:17 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-b7d8f534-8000-405a-8e23-ec08618974e6 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:28:17 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-b7d8f534-8000-405a-8e23-ec08618974e6 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=85141) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 10:28:17 user nova-compute[85141]: INFO nova.compute.claims [None req-b7d8f534-8000-405a-8e23-ec08618974e6 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] [instance: da42de06-4518-4c8a-8c63-9b5a2759a1bf] Claim successful on node user
Nov 16 10:28:18 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:28:18 user nova-compute[85141]: DEBUG nova.network.neutron [-] [instance: 17480138-4b61-43f7-92a5-db065f7d1696] Updating instance_info_cache with network_info: [] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:28:18 user nova-compute[85141]: INFO nova.compute.manager [-] [instance: 17480138-4b61-43f7-92a5-db065f7d1696] Took 0.64 seconds to deallocate network for instance.
Nov 16 10:28:18 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-be208941-3f32-4f5b-a323-1b62350200a6 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:28:18 user nova-compute[85141]: DEBUG nova.compute.provider_tree [None req-b7d8f534-8000-405a-8e23-ec08618974e6 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Inventory has not changed in ProviderTree for provider: bf8e0fa1-16b6-408f-9203-c4cd63916272 {{(pid=85141) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 10:28:18 user nova-compute[85141]: DEBUG nova.scheduler.client.report [None req-b7d8f534-8000-405a-8e23-ec08618974e6 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Inventory has not changed for provider bf8e0fa1-16b6-408f-9203-c4cd63916272 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=85141) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 10:28:18 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-b7d8f534-8000-405a-8e23-ec08618974e6 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.704s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:28:18 user nova-compute[85141]: DEBUG nova.compute.manager [None req-b7d8f534-8000-405a-8e23-ec08618974e6 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] [instance: da42de06-4518-4c8a-8c63-9b5a2759a1bf] Start building networks asynchronously for instance. {{(pid=85141) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 10:28:18 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-be208941-3f32-4f5b-a323-1b62350200a6 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.226s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:28:18 user nova-compute[85141]: DEBUG nova.compute.manager [None req-b7d8f534-8000-405a-8e23-ec08618974e6 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] [instance: da42de06-4518-4c8a-8c63-9b5a2759a1bf] Allocating IP information in the background. {{(pid=85141) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 10:28:18 user nova-compute[85141]: DEBUG nova.network.neutron [None req-b7d8f534-8000-405a-8e23-ec08618974e6 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] [instance: da42de06-4518-4c8a-8c63-9b5a2759a1bf] allocate_for_instance() {{(pid=85141) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 10:28:18 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-b7d8f534-8000-405a-8e23-ec08618974e6 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] [instance: da42de06-4518-4c8a-8c63-9b5a2759a1bf] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 10:28:18 user nova-compute[85141]: DEBUG nova.compute.manager [None req-b7d8f534-8000-405a-8e23-ec08618974e6 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] [instance: da42de06-4518-4c8a-8c63-9b5a2759a1bf] Start building block device mappings for instance. {{(pid=85141) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 10:28:19 user nova-compute[85141]: DEBUG nova.compute.manager [None req-b7d8f534-8000-405a-8e23-ec08618974e6 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] [instance: da42de06-4518-4c8a-8c63-9b5a2759a1bf] Start spawning the instance on the hypervisor. {{(pid=85141) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 10:28:19 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-b7d8f534-8000-405a-8e23-ec08618974e6 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] [instance: da42de06-4518-4c8a-8c63-9b5a2759a1bf] Creating instance directory {{(pid=85141) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 10:28:19 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-b7d8f534-8000-405a-8e23-ec08618974e6 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] [instance: da42de06-4518-4c8a-8c63-9b5a2759a1bf] Creating image(s)
Nov 16 10:28:19 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-b7d8f534-8000-405a-8e23-ec08618974e6 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Acquiring lock "/opt/stack/data/nova/instances/da42de06-4518-4c8a-8c63-9b5a2759a1bf/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:28:19 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-b7d8f534-8000-405a-8e23-ec08618974e6 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Lock "/opt/stack/data/nova/instances/da42de06-4518-4c8a-8c63-9b5a2759a1bf/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:28:19 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-b7d8f534-8000-405a-8e23-ec08618974e6 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Lock "/opt/stack/data/nova/instances/da42de06-4518-4c8a-8c63-9b5a2759a1bf/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:28:19 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-b7d8f534-8000-405a-8e23-ec08618974e6 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:28:19 user nova-compute[85141]: DEBUG nova.policy [None req-b7d8f534-8000-405a-8e23-ec08618974e6 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ef2996a7b2b54ae38380743cf424dc18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fb187d45ec54e74a0721973235f98b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85141) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 10:28:19 user nova-compute[85141]: DEBUG nova.compute.provider_tree [None req-be208941-3f32-4f5b-a323-1b62350200a6 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Inventory has not changed in ProviderTree for provider: bf8e0fa1-16b6-408f-9203-c4cd63916272 {{(pid=85141) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 10:28:19 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-b7d8f534-8000-405a-8e23-ec08618974e6 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json" returned: 0 in 0.194s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:28:19 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-b7d8f534-8000-405a-8e23-ec08618974e6 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Acquiring lock "60a78556fb399ed4a41bc3ca4bccf77c96d8e811" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:28:19 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-b7d8f534-8000-405a-8e23-ec08618974e6 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Lock "60a78556fb399ed4a41bc3ca4bccf77c96d8e811" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:28:19 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-b7d8f534-8000-405a-8e23-ec08618974e6 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:28:19 user nova-compute[85141]: DEBUG nova.compute.manager [req-01fc0017-a461-469e-8785-f6b3cd4c59dd req-a74a996b-4929-4349-a6f0-87f44de7beb1 service nova] [instance: 17480138-4b61-43f7-92a5-db065f7d1696] Received event network-vif-plugged-6082a650-3a4c-4393-b6ab-8cbc97d751cb {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:28:19 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-01fc0017-a461-469e-8785-f6b3cd4c59dd req-a74a996b-4929-4349-a6f0-87f44de7beb1 service nova] Acquiring lock "17480138-4b61-43f7-92a5-db065f7d1696-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:28:19 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-01fc0017-a461-469e-8785-f6b3cd4c59dd req-a74a996b-4929-4349-a6f0-87f44de7beb1 service nova] Lock "17480138-4b61-43f7-92a5-db065f7d1696-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:28:19 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-01fc0017-a461-469e-8785-f6b3cd4c59dd req-a74a996b-4929-4349-a6f0-87f44de7beb1 service nova] Lock "17480138-4b61-43f7-92a5-db065f7d1696-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:28:19 user nova-compute[85141]: DEBUG nova.compute.manager [req-01fc0017-a461-469e-8785-f6b3cd4c59dd req-a74a996b-4929-4349-a6f0-87f44de7beb1 service nova] [instance: 17480138-4b61-43f7-92a5-db065f7d1696] No waiting events found dispatching network-vif-plugged-6082a650-3a4c-4393-b6ab-8cbc97d751cb {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:28:19 user nova-compute[85141]: WARNING nova.compute.manager [req-01fc0017-a461-469e-8785-f6b3cd4c59dd req-a74a996b-4929-4349-a6f0-87f44de7beb1 service nova] [instance: 17480138-4b61-43f7-92a5-db065f7d1696] Received unexpected event network-vif-plugged-6082a650-3a4c-4393-b6ab-8cbc97d751cb for instance with vm_state deleted and task_state None.
Nov 16 10:28:19 user nova-compute[85141]: DEBUG nova.compute.manager [req-01fc0017-a461-469e-8785-f6b3cd4c59dd req-a74a996b-4929-4349-a6f0-87f44de7beb1 service nova] [instance: 17480138-4b61-43f7-92a5-db065f7d1696] Received event network-vif-deleted-6082a650-3a4c-4393-b6ab-8cbc97d751cb {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:28:19 user nova-compute[85141]: DEBUG nova.scheduler.client.report [None req-be208941-3f32-4f5b-a323-1b62350200a6 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Inventory has not changed for provider bf8e0fa1-16b6-408f-9203-c4cd63916272 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=85141) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 10:28:19 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-be208941-3f32-4f5b-a323-1b62350200a6 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.716s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:28:19 user nova-compute[85141]: INFO nova.scheduler.client.report [None req-be208941-3f32-4f5b-a323-1b62350200a6 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Deleted allocations for instance 17480138-4b61-43f7-92a5-db065f7d1696
Nov 16 10:28:19 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-b7d8f534-8000-405a-8e23-ec08618974e6 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json" returned: 0 in 0.178s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:28:19 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-b7d8f534-8000-405a-8e23-ec08618974e6 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811,backing_fmt=raw /opt/stack/data/nova/instances/da42de06-4518-4c8a-8c63-9b5a2759a1bf/disk 1073741824 {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:28:19 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-b7d8f534-8000-405a-8e23-ec08618974e6 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811,backing_fmt=raw /opt/stack/data/nova/instances/da42de06-4518-4c8a-8c63-9b5a2759a1bf/disk 1073741824" returned: 0 in 0.059s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:28:19 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-b7d8f534-8000-405a-8e23-ec08618974e6 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Lock "60a78556fb399ed4a41bc3ca4bccf77c96d8e811" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.241s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:28:19 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-b7d8f534-8000-405a-8e23-ec08618974e6 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:28:19 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-be208941-3f32-4f5b-a323-1b62350200a6 tempest-TestMinimumBasicScenario-766472507 tempest-TestMinimumBasicScenario-766472507-project-member] Lock "17480138-4b61-43f7-92a5-db065f7d1696" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.732s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:28:19 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-b7d8f534-8000-405a-8e23-ec08618974e6 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json" returned: 0 in 0.176s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:28:19 user nova-compute[85141]: DEBUG nova.virt.disk.api [None req-b7d8f534-8000-405a-8e23-ec08618974e6 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Checking if we can resize image /opt/stack/data/nova/instances/da42de06-4518-4c8a-8c63-9b5a2759a1bf/disk. size=1073741824 {{(pid=85141) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 10:28:19 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-b7d8f534-8000-405a-8e23-ec08618974e6 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da42de06-4518-4c8a-8c63-9b5a2759a1bf/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:28:19 user nova-compute[85141]: DEBUG nova.network.neutron [None req-b7d8f534-8000-405a-8e23-ec08618974e6 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] [instance: da42de06-4518-4c8a-8c63-9b5a2759a1bf] Successfully created port: 82a8c393-e062-47b9-a531-a6823f7d00a6 {{(pid=85141) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 10:28:19 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-b7d8f534-8000-405a-8e23-ec08618974e6 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da42de06-4518-4c8a-8c63-9b5a2759a1bf/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:28:19 user nova-compute[85141]: DEBUG nova.virt.disk.api [None req-b7d8f534-8000-405a-8e23-ec08618974e6 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Cannot resize image /opt/stack/data/nova/instances/da42de06-4518-4c8a-8c63-9b5a2759a1bf/disk to a smaller size. {{(pid=85141) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 10:28:19 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-b7d8f534-8000-405a-8e23-ec08618974e6 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] [instance: da42de06-4518-4c8a-8c63-9b5a2759a1bf] Created local disks {{(pid=85141) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 10:28:19 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-b7d8f534-8000-405a-8e23-ec08618974e6 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] [instance: da42de06-4518-4c8a-8c63-9b5a2759a1bf] Ensure instance console log exists: /opt/stack/data/nova/instances/da42de06-4518-4c8a-8c63-9b5a2759a1bf/console.log {{(pid=85141) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 10:28:19 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-b7d8f534-8000-405a-8e23-ec08618974e6 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:28:19 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-b7d8f534-8000-405a-8e23-ec08618974e6 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:28:19 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-b7d8f534-8000-405a-8e23-ec08618974e6 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:28:20 user nova-compute[85141]: DEBUG nova.network.neutron [None req-b7d8f534-8000-405a-8e23-ec08618974e6 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] [instance: da42de06-4518-4c8a-8c63-9b5a2759a1bf] Successfully updated port: 82a8c393-e062-47b9-a531-a6823f7d00a6 {{(pid=85141) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 10:28:20 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-b7d8f534-8000-405a-8e23-ec08618974e6 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Acquiring lock "refresh_cache-da42de06-4518-4c8a-8c63-9b5a2759a1bf" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:28:20 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-b7d8f534-8000-405a-8e23-ec08618974e6 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Acquired lock "refresh_cache-da42de06-4518-4c8a-8c63-9b5a2759a1bf" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:28:20 user nova-compute[85141]: DEBUG nova.network.neutron [None req-b7d8f534-8000-405a-8e23-ec08618974e6 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] [instance: da42de06-4518-4c8a-8c63-9b5a2759a1bf] Building network info cache for instance {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 10:28:20 user nova-compute[85141]: DEBUG nova.network.neutron [None req-b7d8f534-8000-405a-8e23-ec08618974e6 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] [instance: da42de06-4518-4c8a-8c63-9b5a2759a1bf] Instance cache missing network info. {{(pid=85141) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 10:28:20 user nova-compute[85141]: DEBUG nova.network.neutron [None req-b7d8f534-8000-405a-8e23-ec08618974e6 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] [instance: da42de06-4518-4c8a-8c63-9b5a2759a1bf] Updating instance_info_cache with network_info: [{"id": "82a8c393-e062-47b9-a531-a6823f7d00a6", "address": "fa:16:3e:e4:f2:a7", "network": {"id": "a8f7d218-f758-44d8-adb3-120a5f724f70", "bridge": "br-int", "label": "tempest-TestStampPattern-1966889964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fb187d45ec54e74a0721973235f98b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82a8c393-e0", "ovs_interfaceid": "82a8c393-e062-47b9-a531-a6823f7d00a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:28:20 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-b7d8f534-8000-405a-8e23-ec08618974e6 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Releasing lock "refresh_cache-da42de06-4518-4c8a-8c63-9b5a2759a1bf" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:28:20 user nova-compute[85141]: DEBUG nova.compute.manager [None req-b7d8f534-8000-405a-8e23-ec08618974e6 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] [instance: da42de06-4518-4c8a-8c63-9b5a2759a1bf] Instance network_info: |[{"id": "82a8c393-e062-47b9-a531-a6823f7d00a6", "address": "fa:16:3e:e4:f2:a7", "network": {"id": "a8f7d218-f758-44d8-adb3-120a5f724f70", "bridge": "br-int", "label": "tempest-TestStampPattern-1966889964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fb187d45ec54e74a0721973235f98b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82a8c393-e0", "ovs_interfaceid": "82a8c393-e062-47b9-a531-a6823f7d00a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=85141) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 10:28:20 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-b7d8f534-8000-405a-8e23-ec08618974e6 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] [instance: da42de06-4518-4c8a-8c63-9b5a2759a1bf] Start _get_guest_xml network_info=[{"id": "82a8c393-e062-47b9-a531-a6823f7d00a6", "address": "fa:16:3e:e4:f2:a7", "network": {"id": "a8f7d218-f758-44d8-adb3-120a5f724f70", "bridge": "br-int", "label": "tempest-TestStampPattern-1966889964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fb187d45ec54e74a0721973235f98b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82a8c393-e0", "ovs_interfaceid": "82a8c393-e062-47b9-a531-a6823f7d00a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T10:06:42Z,direct_url=<?>,disk_format='qcow2',id=bc4ca70f-a459-4d5c-a9e6-80f1948eb48b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1044631a5fe84ce8904864a7024049fa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T10:06:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_options': None, 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'image_id': 'bc4ca70f-a459-4d5c-a9e6-80f1948eb48b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=85141) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 10:28:20 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-b7d8f534-8000-405a-8e23-ec08618974e6 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:28:20 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-b7d8f534-8000-405a-8e23-ec08618974e6 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:28:20 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-b7d8f534-8000-405a-8e23-ec08618974e6 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=85141) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 10:28:20 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-b7d8f534-8000-405a-8e23-ec08618974e6 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] CPU controller missing on host. {{(pid=85141) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 10:28:20 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-b7d8f534-8000-405a-8e23-ec08618974e6 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=85141) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 10:28:20 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-b7d8f534-8000-405a-8e23-ec08618974e6 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] CPU controller found on host. {{(pid=85141) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 10:28:20 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-b7d8f534-8000-405a-8e23-ec08618974e6 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=85141) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 10:28:20 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-b7d8f534-8000-405a-8e23-ec08618974e6 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T10:06:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T10:06:42Z,direct_url=<?>,disk_format='qcow2',id=bc4ca70f-a459-4d5c-a9e6-80f1948eb48b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1044631a5fe84ce8904864a7024049fa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T10:06:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 10:28:20 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-b7d8f534-8000-405a-8e23-ec08618974e6 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Flavor limits 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 10:28:20 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-b7d8f534-8000-405a-8e23-ec08618974e6 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Image limits 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 10:28:20 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-b7d8f534-8000-405a-8e23-ec08618974e6 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Flavor pref 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 10:28:20 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-b7d8f534-8000-405a-8e23-ec08618974e6 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Image pref 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 10:28:20 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-b7d8f534-8000-405a-8e23-ec08618974e6 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 10:28:20 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-b7d8f534-8000-405a-8e23-ec08618974e6 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 10:28:20 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-b7d8f534-8000-405a-8e23-ec08618974e6 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=85141) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 10:28:20 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-b7d8f534-8000-405a-8e23-ec08618974e6 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Got 1 possible topologies {{(pid=85141) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 10:28:20 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-b7d8f534-8000-405a-8e23-ec08618974e6 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 10:28:20 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-b7d8f534-8000-405a-8e23-ec08618974e6 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 10:28:20 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-b7d8f534-8000-405a-8e23-ec08618974e6 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T10:28:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-603665308',display_name='tempest-TestStampPattern-server-603665308',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-603665308',id=38,image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHF1TofF/AHeRXw7sOS6/Y4wIEeeHYvjmPtqSMUQwk4rvI03M+9FGX8I4Wssar9zDuv0PRZIDidniJXR8tQIzSEDKx9zL7EpsVLQYl+cVUTa2/jPhGRM8ZPjKll4UR2MBA==',key_name='tempest-TestStampPattern-1189059507',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5fb187d45ec54e74a0721973235f98b0',ramdisk_id='',reservation_id='r-21zebp1m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-2139210362',owner_user_name='tempest-TestStampPattern-2139210362-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T10:28:19Z,user_data=None,user_id='ef2996a7b2b54ae38380743cf424dc18',uuid=da42de06-4518-4c8a-8c63-9b5a2759a1bf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "82a8c393-e062-47b9-a531-a6823f7d00a6", "address": "fa:16:3e:e4:f2:a7", "network": {"id": "a8f7d218-f758-44d8-adb3-120a5f724f70", "bridge": "br-int", "label": "tempest-TestStampPattern-1966889964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fb187d45ec54e74a0721973235f98b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82a8c393-e0", "ovs_interfaceid": "82a8c393-e062-47b9-a531-a6823f7d00a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=85141) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 10:28:20 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-b7d8f534-8000-405a-8e23-ec08618974e6 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Converting VIF {"id": "82a8c393-e062-47b9-a531-a6823f7d00a6", "address": "fa:16:3e:e4:f2:a7", "network": {"id": "a8f7d218-f758-44d8-adb3-120a5f724f70", "bridge": "br-int", "label": "tempest-TestStampPattern-1966889964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fb187d45ec54e74a0721973235f98b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82a8c393-e0", "ovs_interfaceid": "82a8c393-e062-47b9-a531-a6823f7d00a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:28:20 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-b7d8f534-8000-405a-8e23-ec08618974e6 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:f2:a7,bridge_name='br-int',has_traffic_filtering=True,id=82a8c393-e062-47b9-a531-a6823f7d00a6,network=Network(a8f7d218-f758-44d8-adb3-120a5f724f70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82a8c393-e0') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:28:20 user nova-compute[85141]: DEBUG nova.objects.instance [None req-b7d8f534-8000-405a-8e23-ec08618974e6 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Lazy-loading 'pci_devices' on Instance uuid da42de06-4518-4c8a-8c63-9b5a2759a1bf {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:28:20 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-b7d8f534-8000-405a-8e23-ec08618974e6 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] [instance: da42de06-4518-4c8a-8c63-9b5a2759a1bf] End _get_guest_xml xml=<domain type="kvm">
Nov 16 10:28:20 user nova-compute[85141]:   <uuid>da42de06-4518-4c8a-8c63-9b5a2759a1bf</uuid>
Nov 16 10:28:20 user nova-compute[85141]:   <name>instance-00000026</name>
Nov 16 10:28:20 user nova-compute[85141]:   <memory>524288</memory>
Nov 16 10:28:20 user nova-compute[85141]:   <vcpu>1</vcpu>
Nov 16 10:28:20 user nova-compute[85141]:   <metadata>
Nov 16 10:28:20 user nova-compute[85141]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 10:28:20 user nova-compute[85141]:       <nova:package version="0.0.0"/>
Nov 16 10:28:20 user nova-compute[85141]:       <nova:name>tempest-TestStampPattern-server-603665308</nova:name>
Nov 16 10:28:20 user nova-compute[85141]:       <nova:creationTime>2023-11-16 10:28:20</nova:creationTime>
Nov 16 10:28:20 user nova-compute[85141]:       <nova:flavor name="m1.tiny">
Nov 16 10:28:20 user nova-compute[85141]:         <nova:memory>512</nova:memory>
Nov 16 10:28:20 user nova-compute[85141]:         <nova:disk>1</nova:disk>
Nov 16 10:28:20 user nova-compute[85141]:         <nova:swap>0</nova:swap>
Nov 16 10:28:20 user nova-compute[85141]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 10:28:20 user nova-compute[85141]:         <nova:vcpus>1</nova:vcpus>
Nov 16 10:28:20 user nova-compute[85141]:       </nova:flavor>
Nov 16 10:28:20 user nova-compute[85141]:       <nova:owner>
Nov 16 10:28:20 user nova-compute[85141]:         <nova:user uuid="ef2996a7b2b54ae38380743cf424dc18">tempest-TestStampPattern-2139210362-project-member</nova:user>
Nov 16 10:28:20 user nova-compute[85141]:         <nova:project uuid="5fb187d45ec54e74a0721973235f98b0">tempest-TestStampPattern-2139210362</nova:project>
Nov 16 10:28:20 user nova-compute[85141]:       </nova:owner>
Nov 16 10:28:20 user nova-compute[85141]:       <nova:root type="image" uuid="bc4ca70f-a459-4d5c-a9e6-80f1948eb48b"/>
Nov 16 10:28:20 user nova-compute[85141]:       <nova:ports>
Nov 16 10:28:20 user nova-compute[85141]:         <nova:port uuid="82a8c393-e062-47b9-a531-a6823f7d00a6">
Nov 16 10:28:20 user nova-compute[85141]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 16 10:28:20 user nova-compute[85141]:         </nova:port>
Nov 16 10:28:20 user nova-compute[85141]:       </nova:ports>
Nov 16 10:28:20 user nova-compute[85141]:     </nova:instance>
Nov 16 10:28:20 user nova-compute[85141]:   </metadata>
Nov 16 10:28:20 user nova-compute[85141]:   <sysinfo type="smbios">
Nov 16 10:28:20 user nova-compute[85141]:     <system>
Nov 16 10:28:20 user nova-compute[85141]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 10:28:20 user nova-compute[85141]:       <entry name="product">OpenStack Nova</entry>
Nov 16 10:28:20 user nova-compute[85141]:       <entry name="version">0.0.0</entry>
Nov 16 10:28:20 user nova-compute[85141]:       <entry name="serial">da42de06-4518-4c8a-8c63-9b5a2759a1bf</entry>
Nov 16 10:28:20 user nova-compute[85141]:       <entry name="uuid">da42de06-4518-4c8a-8c63-9b5a2759a1bf</entry>
Nov 16 10:28:20 user nova-compute[85141]:       <entry name="family">Virtual Machine</entry>
Nov 16 10:28:20 user nova-compute[85141]:     </system>
Nov 16 10:28:20 user nova-compute[85141]:   </sysinfo>
Nov 16 10:28:20 user nova-compute[85141]:   <os>
Nov 16 10:28:20 user nova-compute[85141]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 10:28:20 user nova-compute[85141]:     <boot dev="hd"/>
Nov 16 10:28:20 user nova-compute[85141]:     <smbios mode="sysinfo"/>
Nov 16 10:28:20 user nova-compute[85141]:   </os>
Nov 16 10:28:20 user nova-compute[85141]:   <features>
Nov 16 10:28:20 user nova-compute[85141]:     <acpi/>
Nov 16 10:28:20 user nova-compute[85141]:     <apic/>
Nov 16 10:28:20 user nova-compute[85141]:     <vmcoreinfo/>
Nov 16 10:28:20 user nova-compute[85141]:   </features>
Nov 16 10:28:20 user nova-compute[85141]:   <clock offset="utc">
Nov 16 10:28:20 user nova-compute[85141]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 10:28:20 user nova-compute[85141]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 10:28:20 user nova-compute[85141]:     <timer name="hpet" present="no"/>
Nov 16 10:28:20 user nova-compute[85141]:   </clock>
Nov 16 10:28:20 user nova-compute[85141]:   <cpu mode="custom" match="exact">
Nov 16 10:28:20 user nova-compute[85141]:     <model>Nehalem</model>
Nov 16 10:28:20 user nova-compute[85141]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 10:28:20 user nova-compute[85141]:   </cpu>
Nov 16 10:28:20 user nova-compute[85141]:   <devices>
Nov 16 10:28:20 user nova-compute[85141]:     <disk type="file" device="disk">
Nov 16 10:28:20 user nova-compute[85141]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 10:28:20 user nova-compute[85141]:       <source file="/opt/stack/data/nova/instances/da42de06-4518-4c8a-8c63-9b5a2759a1bf/disk"/>
Nov 16 10:28:20 user nova-compute[85141]:       <target dev="vda" bus="virtio"/>
Nov 16 10:28:20 user nova-compute[85141]:     </disk>
Nov 16 10:28:20 user nova-compute[85141]:     <interface type="ethernet">
Nov 16 10:28:20 user nova-compute[85141]:       <mac address="fa:16:3e:e4:f2:a7"/>
Nov 16 10:28:20 user nova-compute[85141]:       <model type="virtio"/>
Nov 16 10:28:20 user nova-compute[85141]:       <mtu size="1442"/>
Nov 16 10:28:20 user nova-compute[85141]:       <target dev="tap82a8c393-e0"/>
Nov 16 10:28:20 user nova-compute[85141]:     </interface>
Nov 16 10:28:20 user nova-compute[85141]:     <serial type="pty">
Nov 16 10:28:20 user nova-compute[85141]:       <log file="/opt/stack/data/nova/instances/da42de06-4518-4c8a-8c63-9b5a2759a1bf/console.log" append="off"/>
Nov 16 10:28:20 user nova-compute[85141]:     </serial>
Nov 16 10:28:20 user nova-compute[85141]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 10:28:20 user nova-compute[85141]:     <video>
Nov 16 10:28:20 user nova-compute[85141]:       <model type="virtio"/>
Nov 16 10:28:20 user nova-compute[85141]:     </video>
Nov 16 10:28:20 user nova-compute[85141]:     <rng model="virtio">
Nov 16 10:28:20 user nova-compute[85141]:       <backend model="random">/dev/urandom</backend>
Nov 16 10:28:20 user nova-compute[85141]:     </rng>
Nov 16 10:28:20 user nova-compute[85141]:     <controller type="usb" index="0" model="none"/>
Nov 16 10:28:20 user nova-compute[85141]:     <memballoon model="virtio">
Nov 16 10:28:20 user nova-compute[85141]:       <stats period="10"/>
Nov 16 10:28:20 user nova-compute[85141]:     </memballoon>
Nov 16 10:28:20 user nova-compute[85141]:   </devices>
Nov 16 10:28:20 user nova-compute[85141]: </domain>
Nov 16 10:28:20 user nova-compute[85141]:  {{(pid=85141) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 10:28:20 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-b7d8f534-8000-405a-8e23-ec08618974e6 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T10:28:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-603665308',display_name='tempest-TestStampPattern-server-603665308',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-603665308',id=38,image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHF1TofF/AHeRXw7sOS6/Y4wIEeeHYvjmPtqSMUQwk4rvI03M+9FGX8I4Wssar9zDuv0PRZIDidniJXR8tQIzSEDKx9zL7EpsVLQYl+cVUTa2/jPhGRM8ZPjKll4UR2MBA==',key_name='tempest-TestStampPattern-1189059507',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5fb187d45ec54e74a0721973235f98b0',ramdisk_id='',reservation_id='r-21zebp1m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-2139210362',owner_user_name='tempest-TestStampPattern-2139210362-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T10:28:19Z,user_data=None,user_id='ef2996a7b2b54ae38380743cf424dc18',uuid=da42de06-4518-4c8a-8c63-9b5a2759a1bf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "82a8c393-e062-47b9-a531-a6823f7d00a6", "address": "fa:16:3e:e4:f2:a7", "network": {"id": "a8f7d218-f758-44d8-adb3-120a5f724f70", "bridge": "br-int", "label": "tempest-TestStampPattern-1966889964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fb187d45ec54e74a0721973235f98b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82a8c393-e0", "ovs_interfaceid": "82a8c393-e062-47b9-a531-a6823f7d00a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 10:28:20 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-b7d8f534-8000-405a-8e23-ec08618974e6 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Converting VIF {"id": "82a8c393-e062-47b9-a531-a6823f7d00a6", "address": "fa:16:3e:e4:f2:a7", "network": {"id": "a8f7d218-f758-44d8-adb3-120a5f724f70", "bridge": "br-int", "label": "tempest-TestStampPattern-1966889964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fb187d45ec54e74a0721973235f98b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82a8c393-e0", "ovs_interfaceid": "82a8c393-e062-47b9-a531-a6823f7d00a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:28:20 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-b7d8f534-8000-405a-8e23-ec08618974e6 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:f2:a7,bridge_name='br-int',has_traffic_filtering=True,id=82a8c393-e062-47b9-a531-a6823f7d00a6,network=Network(a8f7d218-f758-44d8-adb3-120a5f724f70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82a8c393-e0') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:28:20 user nova-compute[85141]: DEBUG os_vif [None req-b7d8f534-8000-405a-8e23-ec08618974e6 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:f2:a7,bridge_name='br-int',has_traffic_filtering=True,id=82a8c393-e062-47b9-a531-a6823f7d00a6,network=Network(a8f7d218-f758-44d8-adb3-120a5f724f70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82a8c393-e0') {{(pid=85141) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 10:28:20 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:28:20 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:28:20 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 10:28:20 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:28:20 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'db7d4c9e-aabe-5951-8c3f-762e286dd885', '_type': 'linux-noop'}}, row=False) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:28:20 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:28:20 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:28:20 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:28:20 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap82a8c393-e0, may_exist=True, interface_attrs={}) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:28:20 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap82a8c393-e0, col_values=(('qos', UUID('934a9041-4590-45b4-b08d-476f2e9febc6')),), if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:28:20 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap82a8c393-e0, col_values=(('external_ids', {'iface-id': '82a8c393-e062-47b9-a531-a6823f7d00a6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e4:f2:a7', 'vm-uuid': 'da42de06-4518-4c8a-8c63-9b5a2759a1bf'}),), if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:28:20 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:28:20 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:28:20 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:28:20 user nova-compute[85141]: INFO os_vif [None req-b7d8f534-8000-405a-8e23-ec08618974e6 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:f2:a7,bridge_name='br-int',has_traffic_filtering=True,id=82a8c393-e062-47b9-a531-a6823f7d00a6,network=Network(a8f7d218-f758-44d8-adb3-120a5f724f70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82a8c393-e0')
Nov 16 10:28:20 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-b7d8f534-8000-405a-8e23-ec08618974e6 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] No BDM found with device name vda, not building metadata. {{(pid=85141) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 10:28:21 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-b7d8f534-8000-405a-8e23-ec08618974e6 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] No VIF found with MAC fa:16:3e:e4:f2:a7, not building metadata {{(pid=85141) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 10:28:21 user nova-compute[85141]: DEBUG nova.compute.manager [req-84435ca4-434d-4369-a547-92f23cfa7f02 req-c0646a30-5228-46e8-83df-c59e68e6ed57 service nova] [instance: da42de06-4518-4c8a-8c63-9b5a2759a1bf] Received event network-changed-82a8c393-e062-47b9-a531-a6823f7d00a6 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:28:21 user nova-compute[85141]: DEBUG nova.compute.manager [req-84435ca4-434d-4369-a547-92f23cfa7f02 req-c0646a30-5228-46e8-83df-c59e68e6ed57 service nova] [instance: da42de06-4518-4c8a-8c63-9b5a2759a1bf] Refreshing instance network info cache due to event network-changed-82a8c393-e062-47b9-a531-a6823f7d00a6. {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 10:28:21 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-84435ca4-434d-4369-a547-92f23cfa7f02 req-c0646a30-5228-46e8-83df-c59e68e6ed57 service nova] Acquiring lock "refresh_cache-da42de06-4518-4c8a-8c63-9b5a2759a1bf" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:28:21 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-84435ca4-434d-4369-a547-92f23cfa7f02 req-c0646a30-5228-46e8-83df-c59e68e6ed57 service nova] Acquired lock "refresh_cache-da42de06-4518-4c8a-8c63-9b5a2759a1bf" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:28:21 user nova-compute[85141]: DEBUG nova.network.neutron [req-84435ca4-434d-4369-a547-92f23cfa7f02 req-c0646a30-5228-46e8-83df-c59e68e6ed57 service nova] [instance: da42de06-4518-4c8a-8c63-9b5a2759a1bf] Refreshing network info cache for port 82a8c393-e062-47b9-a531-a6823f7d00a6 {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 10:28:21 user nova-compute[85141]: DEBUG nova.network.neutron [req-84435ca4-434d-4369-a547-92f23cfa7f02 req-c0646a30-5228-46e8-83df-c59e68e6ed57 service nova] [instance: da42de06-4518-4c8a-8c63-9b5a2759a1bf] Updated VIF entry in instance network info cache for port 82a8c393-e062-47b9-a531-a6823f7d00a6. {{(pid=85141) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 10:28:21 user nova-compute[85141]: DEBUG nova.network.neutron [req-84435ca4-434d-4369-a547-92f23cfa7f02 req-c0646a30-5228-46e8-83df-c59e68e6ed57 service nova] [instance: da42de06-4518-4c8a-8c63-9b5a2759a1bf] Updating instance_info_cache with network_info: [{"id": "82a8c393-e062-47b9-a531-a6823f7d00a6", "address": "fa:16:3e:e4:f2:a7", "network": {"id": "a8f7d218-f758-44d8-adb3-120a5f724f70", "bridge": "br-int", "label": "tempest-TestStampPattern-1966889964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fb187d45ec54e74a0721973235f98b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82a8c393-e0", "ovs_interfaceid": "82a8c393-e062-47b9-a531-a6823f7d00a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:28:21 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-84435ca4-434d-4369-a547-92f23cfa7f02 req-c0646a30-5228-46e8-83df-c59e68e6ed57 service nova] Releasing lock "refresh_cache-da42de06-4518-4c8a-8c63-9b5a2759a1bf" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:28:22 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:28:22 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:28:22 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:28:22 user nova-compute[85141]: DEBUG nova.compute.manager [req-16ab7946-61d3-4f3a-a271-7588bf70e46f req-2923cdd1-f6b7-432d-80a1-d0fded1cfed2 service nova] [instance: da42de06-4518-4c8a-8c63-9b5a2759a1bf] Received event network-vif-plugged-82a8c393-e062-47b9-a531-a6823f7d00a6 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:28:22 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-16ab7946-61d3-4f3a-a271-7588bf70e46f req-2923cdd1-f6b7-432d-80a1-d0fded1cfed2 service nova] Acquiring lock "da42de06-4518-4c8a-8c63-9b5a2759a1bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:28:22 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-16ab7946-61d3-4f3a-a271-7588bf70e46f req-2923cdd1-f6b7-432d-80a1-d0fded1cfed2 service nova] Lock "da42de06-4518-4c8a-8c63-9b5a2759a1bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:28:22 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-16ab7946-61d3-4f3a-a271-7588bf70e46f req-2923cdd1-f6b7-432d-80a1-d0fded1cfed2 service nova] Lock "da42de06-4518-4c8a-8c63-9b5a2759a1bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:28:22 user nova-compute[85141]: DEBUG nova.compute.manager [req-16ab7946-61d3-4f3a-a271-7588bf70e46f req-2923cdd1-f6b7-432d-80a1-d0fded1cfed2 service nova] [instance: da42de06-4518-4c8a-8c63-9b5a2759a1bf] No waiting events found dispatching network-vif-plugged-82a8c393-e062-47b9-a531-a6823f7d00a6 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:28:22 user nova-compute[85141]: WARNING nova.compute.manager [req-16ab7946-61d3-4f3a-a271-7588bf70e46f req-2923cdd1-f6b7-432d-80a1-d0fded1cfed2 service nova] [instance: da42de06-4518-4c8a-8c63-9b5a2759a1bf] Received unexpected event network-vif-plugged-82a8c393-e062-47b9-a531-a6823f7d00a6 for instance with vm_state building and task_state spawning.
Nov 16 10:28:22 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-3dc478df-5421-4b4a-89b9-49787efd3ce2 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Acquiring lock "abe5d4b7-a0d7-40e3-b630-0de746ddb55b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:28:22 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-3dc478df-5421-4b4a-89b9-49787efd3ce2 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Lock "abe5d4b7-a0d7-40e3-b630-0de746ddb55b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:28:22 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-3dc478df-5421-4b4a-89b9-49787efd3ce2 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Acquiring lock "abe5d4b7-a0d7-40e3-b630-0de746ddb55b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:28:22 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-3dc478df-5421-4b4a-89b9-49787efd3ce2 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Lock "abe5d4b7-a0d7-40e3-b630-0de746ddb55b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:28:22 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-3dc478df-5421-4b4a-89b9-49787efd3ce2 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Lock "abe5d4b7-a0d7-40e3-b630-0de746ddb55b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:28:22 user nova-compute[85141]: INFO nova.compute.manager [None req-3dc478df-5421-4b4a-89b9-49787efd3ce2 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] [instance: abe5d4b7-a0d7-40e3-b630-0de746ddb55b] Terminating instance
Nov 16 10:28:22 user nova-compute[85141]: DEBUG nova.compute.manager [None req-3dc478df-5421-4b4a-89b9-49787efd3ce2 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] [instance: abe5d4b7-a0d7-40e3-b630-0de746ddb55b] Start destroying the instance on the hypervisor. {{(pid=85141) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 10:28:22 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:28:22 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:28:22 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:28:22 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:28:22 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:28:23 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:28:23 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:28:23 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:28:23 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:28:23 user nova-compute[85141]: DEBUG nova.compute.manager [req-0a65598a-ddfa-4124-bab4-7e7b805e6876 req-a19e95f5-1c2d-4d11-8e60-cffc9989d47b service nova] [instance: abe5d4b7-a0d7-40e3-b630-0de746ddb55b] Received event network-vif-unplugged-e583d579-7583-4f41-b0f1-b3241b6af956 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:28:23 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-0a65598a-ddfa-4124-bab4-7e7b805e6876 req-a19e95f5-1c2d-4d11-8e60-cffc9989d47b service nova] Acquiring lock "abe5d4b7-a0d7-40e3-b630-0de746ddb55b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:28:23 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-0a65598a-ddfa-4124-bab4-7e7b805e6876 req-a19e95f5-1c2d-4d11-8e60-cffc9989d47b service nova] Lock "abe5d4b7-a0d7-40e3-b630-0de746ddb55b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:28:23 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-0a65598a-ddfa-4124-bab4-7e7b805e6876 req-a19e95f5-1c2d-4d11-8e60-cffc9989d47b service nova] Lock "abe5d4b7-a0d7-40e3-b630-0de746ddb55b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:28:23 user nova-compute[85141]: DEBUG nova.compute.manager [req-0a65598a-ddfa-4124-bab4-7e7b805e6876 req-a19e95f5-1c2d-4d11-8e60-cffc9989d47b service nova] [instance: abe5d4b7-a0d7-40e3-b630-0de746ddb55b] No waiting events found dispatching network-vif-unplugged-e583d579-7583-4f41-b0f1-b3241b6af956 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:28:23 user nova-compute[85141]: DEBUG nova.compute.manager [req-0a65598a-ddfa-4124-bab4-7e7b805e6876 req-a19e95f5-1c2d-4d11-8e60-cffc9989d47b service nova] [instance: abe5d4b7-a0d7-40e3-b630-0de746ddb55b] Received event network-vif-unplugged-e583d579-7583-4f41-b0f1-b3241b6af956 for instance with task_state deleting. {{(pid=85141) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 10:28:23 user nova-compute[85141]: DEBUG nova.compute.manager [req-0a65598a-ddfa-4124-bab4-7e7b805e6876 req-a19e95f5-1c2d-4d11-8e60-cffc9989d47b service nova] [instance: abe5d4b7-a0d7-40e3-b630-0de746ddb55b] Received event network-vif-plugged-e583d579-7583-4f41-b0f1-b3241b6af956 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:28:23 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-0a65598a-ddfa-4124-bab4-7e7b805e6876 req-a19e95f5-1c2d-4d11-8e60-cffc9989d47b service nova] Acquiring lock "abe5d4b7-a0d7-40e3-b630-0de746ddb55b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:28:23 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-0a65598a-ddfa-4124-bab4-7e7b805e6876 req-a19e95f5-1c2d-4d11-8e60-cffc9989d47b service nova] Lock "abe5d4b7-a0d7-40e3-b630-0de746ddb55b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:28:23 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-0a65598a-ddfa-4124-bab4-7e7b805e6876 req-a19e95f5-1c2d-4d11-8e60-cffc9989d47b service nova] Lock "abe5d4b7-a0d7-40e3-b630-0de746ddb55b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:28:23 user nova-compute[85141]: DEBUG nova.compute.manager [req-0a65598a-ddfa-4124-bab4-7e7b805e6876 req-a19e95f5-1c2d-4d11-8e60-cffc9989d47b service nova] [instance: abe5d4b7-a0d7-40e3-b630-0de746ddb55b] No waiting events found dispatching network-vif-plugged-e583d579-7583-4f41-b0f1-b3241b6af956 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:28:23 user nova-compute[85141]: WARNING nova.compute.manager [req-0a65598a-ddfa-4124-bab4-7e7b805e6876 req-a19e95f5-1c2d-4d11-8e60-cffc9989d47b service nova] [instance: abe5d4b7-a0d7-40e3-b630-0de746ddb55b] Received unexpected event network-vif-plugged-e583d579-7583-4f41-b0f1-b3241b6af956 for instance with vm_state active and task_state deleting.
Nov 16 10:28:23 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:28:23 user nova-compute[85141]: INFO nova.virt.libvirt.driver [-] [instance: abe5d4b7-a0d7-40e3-b630-0de746ddb55b] Instance destroyed successfully.
Nov 16 10:28:23 user nova-compute[85141]: DEBUG nova.objects.instance [None req-3dc478df-5421-4b4a-89b9-49787efd3ce2 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Lazy-loading 'resources' on Instance uuid abe5d4b7-a0d7-40e3-b630-0de746ddb55b {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:28:23 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-3dc478df-5421-4b4a-89b9-49787efd3ce2 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T10:22:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-845278396',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-845278396',id=28,image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-16T10:24:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='733b504d4dbe4f028963cf2c197f0064',ramdisk_id='',reservation_id='r-qwti326h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-742384119',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T10:26:37Z,user_data=None,user_id='ffe6ceff3cc346b59b4fbf294b9fc1a3',uuid=abe5d4b7-a0d7-40e3-b630-0de746ddb55b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e583d579-7583-4f41-b0f1-b3241b6af956", "address": "fa:16:3e:4d:24:64", "network": {"id": "e40e4bd2-4277-40b1-9451-1c8365ffa488", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1333036447-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "733b504d4dbe4f028963cf2c197f0064", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape583d579-75", "ovs_interfaceid": "e583d579-7583-4f41-b0f1-b3241b6af956", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 10:28:23 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-3dc478df-5421-4b4a-89b9-49787efd3ce2 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Converting VIF {"id": "e583d579-7583-4f41-b0f1-b3241b6af956", "address": "fa:16:3e:4d:24:64", "network": {"id": "e40e4bd2-4277-40b1-9451-1c8365ffa488", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1333036447-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "733b504d4dbe4f028963cf2c197f0064", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape583d579-75", "ovs_interfaceid": "e583d579-7583-4f41-b0f1-b3241b6af956", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:28:23 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-3dc478df-5421-4b4a-89b9-49787efd3ce2 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4d:24:64,bridge_name='br-int',has_traffic_filtering=True,id=e583d579-7583-4f41-b0f1-b3241b6af956,network=Network(e40e4bd2-4277-40b1-9451-1c8365ffa488),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape583d579-75') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:28:23 user nova-compute[85141]: DEBUG os_vif [None req-3dc478df-5421-4b4a-89b9-49787efd3ce2 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4d:24:64,bridge_name='br-int',has_traffic_filtering=True,id=e583d579-7583-4f41-b0f1-b3241b6af956,network=Network(e40e4bd2-4277-40b1-9451-1c8365ffa488),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape583d579-75') {{(pid=85141) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 10:28:23 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:28:23 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape583d579-75, bridge=br-int, if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:28:23 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:28:23 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:28:23 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:28:23 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f71ea205-5141-460a-8b98-7d482838c250) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:28:23 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:28:23 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:28:23 user nova-compute[85141]: INFO os_vif [None req-3dc478df-5421-4b4a-89b9-49787efd3ce2 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4d:24:64,bridge_name='br-int',has_traffic_filtering=True,id=e583d579-7583-4f41-b0f1-b3241b6af956,network=Network(e40e4bd2-4277-40b1-9451-1c8365ffa488),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape583d579-75')
Nov 16 10:28:23 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3dc478df-5421-4b4a-89b9-49787efd3ce2 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] [instance: abe5d4b7-a0d7-40e3-b630-0de746ddb55b] calling os-brick to detach iSCSI Volume {{(pid=85141) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 10:28:23 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dc478df-5421-4b4a-89b9-49787efd3ce2 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51806b6080>, {'target_iqn': 'iqn.2010-10.org.openstack:11a6a15b-38c1-4e7e-b8fa-2feb6789e775', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WtUCwYzB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 10:28:23 user nova-compute[85141]: WARNING os_brick.initiator.connectors.base [None req-3dc478df-5421-4b4a-89b9-49787efd3ce2 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 10:28:23 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-3dc478df-5421-4b4a-89b9-49787efd3ce2 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 10:28:23 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-3dc478df-5421-4b4a-89b9-49787efd3ce2 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 10:28:23 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:28:23 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:28:23 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f31c47a-ba96-4654-8791-5cafe0dd5257]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e0c5c19d-363b-4f5d-a04f-fb7de64423f2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:11a6a15b-38c1-4e7e-b8fa-2feb6789e775\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e1b58025-0c18-41f6-a126-fb3c925399a1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2006a77c-e5e8-4ec5-8de5-a0f9505c429a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:28:23 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dc478df-5421-4b4a-89b9-49787efd3ce2 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 10:28:23 user nova-compute[85141]: No targets found.
Nov 16 10:28:23 user nova-compute[85141]: iSNS:
Nov 16 10:28:23 user nova-compute[85141]: No targets found.
Nov 16 10:28:23 user nova-compute[85141]: STATIC:
Nov 16 10:28:23 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:e0c5c19d-363b-4f5d-a04f-fb7de64423f2
Nov 16 10:28:23 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:28:23 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:28:23 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee
Nov 16 10:28:23 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:28:23 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:28:23 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:11a6a15b-38c1-4e7e-b8fa-2feb6789e775
Nov 16 10:28:23 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:28:23 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:28:23 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:e1b58025-0c18-41f6-a126-fb3c925399a1
Nov 16 10:28:23 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:28:23 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:28:23 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:2006a77c-e5e8-4ec5-8de5-a0f9505c429a
Nov 16 10:28:23 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:28:23 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:28:23 user nova-compute[85141]: FIRMWARE:
Nov 16 10:28:23 user nova-compute[85141]: No targets found.
Nov 16 10:28:23 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:28:23 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dc478df-5421-4b4a-89b9-49787efd3ce2 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 10:28:23 user nova-compute[85141]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 10:28:23 user nova-compute[85141]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=85141) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 10:28:23 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dc478df-5421-4b4a-89b9-49787efd3ce2 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:11a6a15b-38c1-4e7e-b8fa-2feb6789e775', 0)] {{(pid=85141) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 10:28:23 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:28:23 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:28:23 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d061494-0ec9-49f1-a311-e61d0a7ec625]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:11a6a15b-38c1-4e7e-b8fa-2feb6789e775\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2006a77c-e5e8-4ec5-8de5-a0f9505c429a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e0c5c19d-363b-4f5d-a04f-fb7de64423f2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e1b58025-0c18-41f6-a126-fb3c925399a1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:28:23 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:28:23 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:28:23 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[1db91377-501f-4c1d-a690-3b68b0bcd149]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11a6a15b-38c1-4e7e-b8fa-2feb6789e775 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b58025-0c18-41f6-a126-fb3c925399a1 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2006a77c-e5e8-4ec5-8de5-a0f9505c429a (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0c5c19d-363b-4f5d-a04f-fb7de64423f2 (non-flash)\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:28:23 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dc478df-5421-4b4a-89b9-49787efd3ce2 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)
Nov 16 10:28:23 user nova-compute[85141]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11a6a15b-38c1-4e7e-b8fa-2feb6789e775 (non-flash)
Nov 16 10:28:23 user nova-compute[85141]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b58025-0c18-41f6-a126-fb3c925399a1 (non-flash)
Nov 16 10:28:23 user nova-compute[85141]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2006a77c-e5e8-4ec5-8de5-a0f9505c429a (non-flash)
Nov 16 10:28:23 user nova-compute[85141]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0c5c19d-363b-4f5d-a04f-fb7de64423f2 (non-flash)
Nov 16 10:28:23 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:28:23 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dc478df-5421-4b4a-89b9-49787efd3ce2 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)
Nov 16 10:28:23 user nova-compute[85141]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11a6a15b-38c1-4e7e-b8fa-2feb6789e775 (non-flash)
Nov 16 10:28:23 user nova-compute[85141]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b58025-0c18-41f6-a126-fb3c925399a1 (non-flash)
Nov 16 10:28:23 user nova-compute[85141]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2006a77c-e5e8-4ec5-8de5-a0f9505c429a (non-flash)
Nov 16 10:28:23 user nova-compute[85141]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0c5c19d-363b-4f5d-a04f-fb7de64423f2 (non-flash)
Nov 16 10:28:23 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 10:28:23 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dc478df-5421-4b4a-89b9-49787efd3ce2 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f51606e5c60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:11a6a15b-38c1-4e7e-b8fa-2feb6789e775'): ({'sdd'}, set())}) {{(pid=85141) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 10:28:23 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-3dc478df-5421-4b4a-89b9-49787efd3ce2 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Removing single pathed devices sdd {{(pid=85141) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 10:28:23 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:28:23 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:28:23 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[44cb7143-c368-479f-997c-f298c3c19143]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:28:23 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:28:23 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.022s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:28:23 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1b8e1b0-458b-4bf6-b7c9-03edb51f7045]: (4, ('ok\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:28:23 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-3dc478df-5421-4b4a-89b9-49787efd3ce2 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Flushing IO for device /dev/sdd {{(pid=85141) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 10:28:23 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:28:23 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:28:23 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[06d4084d-c57b-4d58-b951-1efe780de769]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:28:23 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-3dc478df-5421-4b4a-89b9-49787efd3ce2 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=85141) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 10:28:23 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:28:23 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.035s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:28:23 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ec47985-da77-465a-98a9-cca1ad85a665]: (4, ('1', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:28:23 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-3dc478df-5421-4b4a-89b9-49787efd3ce2 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=85141) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 10:28:23 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-3dc478df-5421-4b4a-89b9-49787efd3ce2 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] SCSI volumes sdd have been removed. {{(pid=85141) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 10:28:23 user nova-compute[85141]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_48e09450', '/dev/disk/by-id/scsi-26637656466636334', '/dev/disk/by-id/scsi-1SCST_BIO48e09450-f7edfcc44c409fcb') {{(pid=95342) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 16 10:28:23 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[22f810c1-c4a8-4a8b-b9f2-ea1059ada813]: (4, None) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:28:23 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dc478df-5421-4b4a-89b9-49787efd3ce2 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:11a6a15b-38c1-4e7e-b8fa-2feb6789e775')] {{(pid=85141) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 10:28:23 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11a6a15b-38c1-4e7e-b8fa-2feb6789e775 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:28:23 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11a6a15b-38c1-4e7e-b8fa-2feb6789e775 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:28:23 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[c50765f5-6c91-4024-a912-b4cc3697b36d]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:28:23 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dc478df-5421-4b4a-89b9-49787efd3ce2 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:28:23 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11a6a15b-38c1-4e7e-b8fa-2feb6789e775 -p 172.16.0.220:3260 --logout {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:28:23 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11a6a15b-38c1-4e7e-b8fa-2feb6789e775 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:28:23 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[28320f07-f3e2-401c-b9f9-4712077b9a01]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:11a6a15b-38c1-4e7e-b8fa-2feb6789e775, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:11a6a15b-38c1-4e7e-b8fa-2feb6789e775, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:28:23 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dc478df-5421-4b4a-89b9-49787efd3ce2 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:11a6a15b-38c1-4e7e-b8fa-2feb6789e775, portal: 172.16.0.220,3260]
Nov 16 10:28:23 user nova-compute[85141]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:11a6a15b-38c1-4e7e-b8fa-2feb6789e775, portal: 172.16.0.220,3260] successful.
Nov 16 10:28:23 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:28:23 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11a6a15b-38c1-4e7e-b8fa-2feb6789e775 -p 172.16.0.220:3260 --op delete {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:28:23 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11a6a15b-38c1-4e7e-b8fa-2feb6789e775 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:28:23 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[9096f6ec-b847-4251-be2f-7e2f86de7450]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:28:23 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dc478df-5421-4b4a-89b9-49787efd3ce2 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:28:23 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-3dc478df-5421-4b4a-89b9-49787efd3ce2 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.332s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 10:28:23 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dc478df-5421-4b4a-89b9-49787efd3ce2 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] <== disconnect_volume: return (333ms) None {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 10:28:23 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3dc478df-5421-4b4a-89b9-49787efd3ce2 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] [instance: abe5d4b7-a0d7-40e3-b630-0de746ddb55b] Disconnected iSCSI Volume {{(pid=85141) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 10:28:23 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-3dc478df-5421-4b4a-89b9-49787efd3ce2 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] [instance: abe5d4b7-a0d7-40e3-b630-0de746ddb55b] Deleting instance files /opt/stack/data/nova/instances/abe5d4b7-a0d7-40e3-b630-0de746ddb55b_del
Nov 16 10:28:23 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-3dc478df-5421-4b4a-89b9-49787efd3ce2 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] [instance: abe5d4b7-a0d7-40e3-b630-0de746ddb55b] Deletion of /opt/stack/data/nova/instances/abe5d4b7-a0d7-40e3-b630-0de746ddb55b_del complete
Nov 16 10:28:23 user nova-compute[85141]: INFO nova.compute.manager [None req-3dc478df-5421-4b4a-89b9-49787efd3ce2 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] [instance: abe5d4b7-a0d7-40e3-b630-0de746ddb55b] Took 1.26 seconds to destroy the instance on the hypervisor.
Nov 16 10:28:23 user nova-compute[85141]: DEBUG oslo.service.loopingcall [None req-3dc478df-5421-4b4a-89b9-49787efd3ce2 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=85141) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 10:28:23 user nova-compute[85141]: DEBUG nova.compute.manager [-] [instance: abe5d4b7-a0d7-40e3-b630-0de746ddb55b] Deallocating network for instance {{(pid=85141) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 10:28:23 user nova-compute[85141]: DEBUG nova.network.neutron [-] [instance: abe5d4b7-a0d7-40e3-b630-0de746ddb55b] deallocate_for_instance() {{(pid=85141) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 10:28:24 user nova-compute[85141]: DEBUG nova.network.neutron [-] [instance: abe5d4b7-a0d7-40e3-b630-0de746ddb55b] Updating instance_info_cache with network_info: [] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:28:24 user nova-compute[85141]: INFO nova.compute.manager [-] [instance: abe5d4b7-a0d7-40e3-b630-0de746ddb55b] Took 0.41 seconds to deallocate network for instance.
Nov 16 10:28:24 user nova-compute[85141]: DEBUG nova.compute.manager [req-e3cd8ef2-c2e2-4f95-8de3-e975b0bf236a req-c6526b20-fad6-4145-90ae-576cd14cf56a service nova] [instance: da42de06-4518-4c8a-8c63-9b5a2759a1bf] Received event network-vif-plugged-82a8c393-e062-47b9-a531-a6823f7d00a6 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:28:24 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-e3cd8ef2-c2e2-4f95-8de3-e975b0bf236a req-c6526b20-fad6-4145-90ae-576cd14cf56a service nova] Acquiring lock "da42de06-4518-4c8a-8c63-9b5a2759a1bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:28:24 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-e3cd8ef2-c2e2-4f95-8de3-e975b0bf236a req-c6526b20-fad6-4145-90ae-576cd14cf56a service nova] Lock "da42de06-4518-4c8a-8c63-9b5a2759a1bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:28:24 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-e3cd8ef2-c2e2-4f95-8de3-e975b0bf236a req-c6526b20-fad6-4145-90ae-576cd14cf56a service nova] Lock "da42de06-4518-4c8a-8c63-9b5a2759a1bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:28:24 user nova-compute[85141]: DEBUG nova.compute.manager [req-e3cd8ef2-c2e2-4f95-8de3-e975b0bf236a req-c6526b20-fad6-4145-90ae-576cd14cf56a service nova] [instance: da42de06-4518-4c8a-8c63-9b5a2759a1bf] No waiting events found dispatching network-vif-plugged-82a8c393-e062-47b9-a531-a6823f7d00a6 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:28:24 user nova-compute[85141]: WARNING nova.compute.manager [req-e3cd8ef2-c2e2-4f95-8de3-e975b0bf236a req-c6526b20-fad6-4145-90ae-576cd14cf56a service nova] [instance: da42de06-4518-4c8a-8c63-9b5a2759a1bf] Received unexpected event network-vif-plugged-82a8c393-e062-47b9-a531-a6823f7d00a6 for instance with vm_state building and task_state spawning.
Nov 16 10:28:24 user nova-compute[85141]: DEBUG nova.compute.manager [None req-b7d8f534-8000-405a-8e23-ec08618974e6 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] [instance: da42de06-4518-4c8a-8c63-9b5a2759a1bf] Instance event wait completed in 0 seconds for  {{(pid=85141) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 10:28:24 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-b7d8f534-8000-405a-8e23-ec08618974e6 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] [instance: da42de06-4518-4c8a-8c63-9b5a2759a1bf] Guest created on hypervisor {{(pid=85141) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 10:28:24 user nova-compute[85141]: INFO nova.virt.libvirt.driver [-] [instance: da42de06-4518-4c8a-8c63-9b5a2759a1bf] Instance spawned successfully.
Nov 16 10:28:24 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-b7d8f534-8000-405a-8e23-ec08618974e6 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] [instance: da42de06-4518-4c8a-8c63-9b5a2759a1bf] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 10:28:24 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-b7d8f534-8000-405a-8e23-ec08618974e6 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] [instance: da42de06-4518-4c8a-8c63-9b5a2759a1bf] Found default for hw_cdrom_bus of ide {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:28:24 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-b7d8f534-8000-405a-8e23-ec08618974e6 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] [instance: da42de06-4518-4c8a-8c63-9b5a2759a1bf] Found default for hw_disk_bus of virtio {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:28:24 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-b7d8f534-8000-405a-8e23-ec08618974e6 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] [instance: da42de06-4518-4c8a-8c63-9b5a2759a1bf] Found default for hw_input_bus of None {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:28:24 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-b7d8f534-8000-405a-8e23-ec08618974e6 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] [instance: da42de06-4518-4c8a-8c63-9b5a2759a1bf] Found default for hw_pointer_model of None {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:28:24 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-b7d8f534-8000-405a-8e23-ec08618974e6 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] [instance: da42de06-4518-4c8a-8c63-9b5a2759a1bf] Found default for hw_video_model of virtio {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:28:24 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-b7d8f534-8000-405a-8e23-ec08618974e6 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] [instance: da42de06-4518-4c8a-8c63-9b5a2759a1bf] Found default for hw_vif_model of virtio {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:28:24 user nova-compute[85141]: INFO nova.compute.manager [None req-b7d8f534-8000-405a-8e23-ec08618974e6 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] [instance: da42de06-4518-4c8a-8c63-9b5a2759a1bf] Took 5.71 seconds to spawn the instance on the hypervisor.
Nov 16 10:28:24 user nova-compute[85141]: DEBUG nova.compute.manager [None req-b7d8f534-8000-405a-8e23-ec08618974e6 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] [instance: da42de06-4518-4c8a-8c63-9b5a2759a1bf] Checking state {{(pid=85141) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 10:28:24 user nova-compute[85141]: INFO nova.compute.manager [None req-b7d8f534-8000-405a-8e23-ec08618974e6 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] [instance: da42de06-4518-4c8a-8c63-9b5a2759a1bf] Took 6.94 seconds to build instance.
Nov 16 10:28:24 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-b7d8f534-8000-405a-8e23-ec08618974e6 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Lock "da42de06-4518-4c8a-8c63-9b5a2759a1bf" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.039s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:28:25 user nova-compute[85141]: INFO nova.compute.manager [None req-3dc478df-5421-4b4a-89b9-49787efd3ce2 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] [instance: abe5d4b7-a0d7-40e3-b630-0de746ddb55b] Took 0.96 seconds to detach 1 volumes for instance.
Nov 16 10:28:25 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-3dc478df-5421-4b4a-89b9-49787efd3ce2 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:28:25 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-3dc478df-5421-4b4a-89b9-49787efd3ce2 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:28:25 user nova-compute[85141]: DEBUG nova.compute.manager [req-c82bdfce-caf5-4be0-86b0-be0780549bbd req-bf510a4a-d21a-4977-998e-125ccd9b3afb service nova] [instance: abe5d4b7-a0d7-40e3-b630-0de746ddb55b] Received event network-vif-deleted-e583d579-7583-4f41-b0f1-b3241b6af956 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:28:25 user nova-compute[85141]: DEBUG nova.compute.provider_tree [None req-3dc478df-5421-4b4a-89b9-49787efd3ce2 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Inventory has not changed in ProviderTree for provider: bf8e0fa1-16b6-408f-9203-c4cd63916272 {{(pid=85141) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 10:28:25 user nova-compute[85141]: DEBUG nova.scheduler.client.report [None req-3dc478df-5421-4b4a-89b9-49787efd3ce2 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Inventory has not changed for provider bf8e0fa1-16b6-408f-9203-c4cd63916272 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=85141) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 10:28:25 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-3dc478df-5421-4b4a-89b9-49787efd3ce2 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.461s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:28:25 user nova-compute[85141]: INFO nova.scheduler.client.report [None req-3dc478df-5421-4b4a-89b9-49787efd3ce2 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Deleted allocations for instance abe5d4b7-a0d7-40e3-b630-0de746ddb55b
Nov 16 10:28:26 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-3dc478df-5421-4b4a-89b9-49787efd3ce2 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Lock "abe5d4b7-a0d7-40e3-b630-0de746ddb55b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.330s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:28:28 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:28:28 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:28:28 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:28:29 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-410f71cd-f392-46d4-9817-151837d39dc0 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Acquiring lock "89e358d7-0844-4742-853b-ff88800415d2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:28:29 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-410f71cd-f392-46d4-9817-151837d39dc0 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Lock "89e358d7-0844-4742-853b-ff88800415d2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:28:29 user nova-compute[85141]: DEBUG nova.compute.manager [None req-410f71cd-f392-46d4-9817-151837d39dc0 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] [instance: 89e358d7-0844-4742-853b-ff88800415d2] Starting instance... {{(pid=85141) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 10:28:29 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:28:29 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-410f71cd-f392-46d4-9817-151837d39dc0 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:28:29 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-410f71cd-f392-46d4-9817-151837d39dc0 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:28:29 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-410f71cd-f392-46d4-9817-151837d39dc0 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=85141) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 10:28:29 user nova-compute[85141]: INFO nova.compute.claims [None req-410f71cd-f392-46d4-9817-151837d39dc0 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] [instance: 89e358d7-0844-4742-853b-ff88800415d2] Claim successful on node user
Nov 16 10:28:29 user nova-compute[85141]: DEBUG nova.compute.provider_tree [None req-410f71cd-f392-46d4-9817-151837d39dc0 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Inventory has not changed in ProviderTree for provider: bf8e0fa1-16b6-408f-9203-c4cd63916272 {{(pid=85141) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 10:28:29 user nova-compute[85141]: DEBUG nova.scheduler.client.report [None req-410f71cd-f392-46d4-9817-151837d39dc0 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Inventory has not changed for provider bf8e0fa1-16b6-408f-9203-c4cd63916272 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=85141) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 10:28:29 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-410f71cd-f392-46d4-9817-151837d39dc0 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.477s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:28:29 user nova-compute[85141]: DEBUG nova.compute.manager [None req-410f71cd-f392-46d4-9817-151837d39dc0 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] [instance: 89e358d7-0844-4742-853b-ff88800415d2] Start building networks asynchronously for instance. {{(pid=85141) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 10:28:29 user nova-compute[85141]: DEBUG nova.compute.manager [None req-410f71cd-f392-46d4-9817-151837d39dc0 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] [instance: 89e358d7-0844-4742-853b-ff88800415d2] Allocating IP information in the background. {{(pid=85141) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 10:28:29 user nova-compute[85141]: DEBUG nova.network.neutron [None req-410f71cd-f392-46d4-9817-151837d39dc0 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] [instance: 89e358d7-0844-4742-853b-ff88800415d2] allocate_for_instance() {{(pid=85141) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 10:28:29 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-410f71cd-f392-46d4-9817-151837d39dc0 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] [instance: 89e358d7-0844-4742-853b-ff88800415d2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 10:28:29 user nova-compute[85141]: DEBUG nova.compute.manager [None req-410f71cd-f392-46d4-9817-151837d39dc0 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] [instance: 89e358d7-0844-4742-853b-ff88800415d2] Start building block device mappings for instance. {{(pid=85141) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 10:28:30 user nova-compute[85141]: DEBUG nova.policy [None req-410f71cd-f392-46d4-9817-151837d39dc0 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f58409e5923c42b685d0a3ad0ab42974', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2acc04e107d4a229c3580cf078a20f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85141) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 10:28:30 user nova-compute[85141]: DEBUG nova.compute.manager [None req-410f71cd-f392-46d4-9817-151837d39dc0 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] [instance: 89e358d7-0844-4742-853b-ff88800415d2] Start spawning the instance on the hypervisor. {{(pid=85141) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 10:28:30 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-410f71cd-f392-46d4-9817-151837d39dc0 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] [instance: 89e358d7-0844-4742-853b-ff88800415d2] Creating instance directory {{(pid=85141) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 10:28:30 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-410f71cd-f392-46d4-9817-151837d39dc0 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] [instance: 89e358d7-0844-4742-853b-ff88800415d2] Creating image(s)
Nov 16 10:28:30 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-410f71cd-f392-46d4-9817-151837d39dc0 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Acquiring lock "/opt/stack/data/nova/instances/89e358d7-0844-4742-853b-ff88800415d2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:28:30 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-410f71cd-f392-46d4-9817-151837d39dc0 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Lock "/opt/stack/data/nova/instances/89e358d7-0844-4742-853b-ff88800415d2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:28:30 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-410f71cd-f392-46d4-9817-151837d39dc0 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Lock "/opt/stack/data/nova/instances/89e358d7-0844-4742-853b-ff88800415d2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:28:30 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-410f71cd-f392-46d4-9817-151837d39dc0 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:28:30 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-410f71cd-f392-46d4-9817-151837d39dc0 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json" returned: 0 in 0.287s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:28:30 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-410f71cd-f392-46d4-9817-151837d39dc0 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Acquiring lock "60a78556fb399ed4a41bc3ca4bccf77c96d8e811" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:28:30 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-410f71cd-f392-46d4-9817-151837d39dc0 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Lock "60a78556fb399ed4a41bc3ca4bccf77c96d8e811" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:28:30 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-410f71cd-f392-46d4-9817-151837d39dc0 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:28:30 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-410f71cd-f392-46d4-9817-151837d39dc0 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json" returned: 0 in 0.174s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:28:30 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-410f71cd-f392-46d4-9817-151837d39dc0 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811,backing_fmt=raw /opt/stack/data/nova/instances/89e358d7-0844-4742-853b-ff88800415d2/disk 1073741824 {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:28:30 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-410f71cd-f392-46d4-9817-151837d39dc0 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811,backing_fmt=raw /opt/stack/data/nova/instances/89e358d7-0844-4742-853b-ff88800415d2/disk 1073741824" returned: 0 in 0.058s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:28:30 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-410f71cd-f392-46d4-9817-151837d39dc0 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Lock "60a78556fb399ed4a41bc3ca4bccf77c96d8e811" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.240s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:28:30 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-410f71cd-f392-46d4-9817-151837d39dc0 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:28:30 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-410f71cd-f392-46d4-9817-151837d39dc0 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json" returned: 0 in 0.183s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:28:30 user nova-compute[85141]: DEBUG nova.virt.disk.api [None req-410f71cd-f392-46d4-9817-151837d39dc0 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Checking if we can resize image /opt/stack/data/nova/instances/89e358d7-0844-4742-853b-ff88800415d2/disk. size=1073741824 {{(pid=85141) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 10:28:30 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-410f71cd-f392-46d4-9817-151837d39dc0 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89e358d7-0844-4742-853b-ff88800415d2/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:28:30 user nova-compute[85141]: DEBUG nova.network.neutron [None req-410f71cd-f392-46d4-9817-151837d39dc0 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] [instance: 89e358d7-0844-4742-853b-ff88800415d2] Successfully created port: b60a8a3c-4aac-4af1-ba04-d8a61ab96324 {{(pid=85141) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 10:28:31 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-410f71cd-f392-46d4-9817-151837d39dc0 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89e358d7-0844-4742-853b-ff88800415d2/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:28:31 user nova-compute[85141]: DEBUG nova.virt.disk.api [None req-410f71cd-f392-46d4-9817-151837d39dc0 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Cannot resize image /opt/stack/data/nova/instances/89e358d7-0844-4742-853b-ff88800415d2/disk to a smaller size. {{(pid=85141) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 10:28:31 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-410f71cd-f392-46d4-9817-151837d39dc0 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] [instance: 89e358d7-0844-4742-853b-ff88800415d2] Created local disks {{(pid=85141) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 10:28:31 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-410f71cd-f392-46d4-9817-151837d39dc0 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] [instance: 89e358d7-0844-4742-853b-ff88800415d2] Ensure instance console log exists: /opt/stack/data/nova/instances/89e358d7-0844-4742-853b-ff88800415d2/console.log {{(pid=85141) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 10:28:31 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-410f71cd-f392-46d4-9817-151837d39dc0 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:28:31 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-410f71cd-f392-46d4-9817-151837d39dc0 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:28:31 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-410f71cd-f392-46d4-9817-151837d39dc0 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:28:31 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:28:32 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:28:32 user nova-compute[85141]: DEBUG nova.network.neutron [None req-410f71cd-f392-46d4-9817-151837d39dc0 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] [instance: 89e358d7-0844-4742-853b-ff88800415d2] Successfully updated port: b60a8a3c-4aac-4af1-ba04-d8a61ab96324 {{(pid=85141) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 10:28:32 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-410f71cd-f392-46d4-9817-151837d39dc0 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Acquiring lock "refresh_cache-89e358d7-0844-4742-853b-ff88800415d2" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:28:32 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-410f71cd-f392-46d4-9817-151837d39dc0 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Acquired lock "refresh_cache-89e358d7-0844-4742-853b-ff88800415d2" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:28:32 user nova-compute[85141]: DEBUG nova.network.neutron [None req-410f71cd-f392-46d4-9817-151837d39dc0 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] [instance: 89e358d7-0844-4742-853b-ff88800415d2] Building network info cache for instance {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 10:28:32 user nova-compute[85141]: DEBUG nova.compute.manager [req-de6a04b9-addf-4b74-bd2f-98038dff586c req-f1cbc9b4-2a27-4cec-8f45-1690ab87fbdd service nova] [instance: 89e358d7-0844-4742-853b-ff88800415d2] Received event network-changed-b60a8a3c-4aac-4af1-ba04-d8a61ab96324 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:28:32 user nova-compute[85141]: DEBUG nova.compute.manager [req-de6a04b9-addf-4b74-bd2f-98038dff586c req-f1cbc9b4-2a27-4cec-8f45-1690ab87fbdd service nova] [instance: 89e358d7-0844-4742-853b-ff88800415d2] Refreshing instance network info cache due to event network-changed-b60a8a3c-4aac-4af1-ba04-d8a61ab96324. {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 10:28:32 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-de6a04b9-addf-4b74-bd2f-98038dff586c req-f1cbc9b4-2a27-4cec-8f45-1690ab87fbdd service nova] Acquiring lock "refresh_cache-89e358d7-0844-4742-853b-ff88800415d2" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:28:32 user nova-compute[85141]: DEBUG nova.network.neutron [None req-410f71cd-f392-46d4-9817-151837d39dc0 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] [instance: 89e358d7-0844-4742-853b-ff88800415d2] Instance cache missing network info. {{(pid=85141) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 10:28:33 user nova-compute[85141]: DEBUG nova.network.neutron [None req-410f71cd-f392-46d4-9817-151837d39dc0 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] [instance: 89e358d7-0844-4742-853b-ff88800415d2] Updating instance_info_cache with network_info: [{"id": "b60a8a3c-4aac-4af1-ba04-d8a61ab96324", "address": "fa:16:3e:56:2d:dd", "network": {"id": "4e36c3d2-7d16-4305-a0a7-2358e1208df3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1030128743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2acc04e107d4a229c3580cf078a20f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb60a8a3c-4a", "ovs_interfaceid": "b60a8a3c-4aac-4af1-ba04-d8a61ab96324", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:28:33 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-410f71cd-f392-46d4-9817-151837d39dc0 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Releasing lock "refresh_cache-89e358d7-0844-4742-853b-ff88800415d2" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:28:33 user nova-compute[85141]: DEBUG nova.compute.manager [None req-410f71cd-f392-46d4-9817-151837d39dc0 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] [instance: 89e358d7-0844-4742-853b-ff88800415d2] Instance network_info: |[{"id": "b60a8a3c-4aac-4af1-ba04-d8a61ab96324", "address": "fa:16:3e:56:2d:dd", "network": {"id": "4e36c3d2-7d16-4305-a0a7-2358e1208df3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1030128743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2acc04e107d4a229c3580cf078a20f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb60a8a3c-4a", "ovs_interfaceid": "b60a8a3c-4aac-4af1-ba04-d8a61ab96324", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=85141) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 10:28:33 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-de6a04b9-addf-4b74-bd2f-98038dff586c req-f1cbc9b4-2a27-4cec-8f45-1690ab87fbdd service nova] Acquired lock "refresh_cache-89e358d7-0844-4742-853b-ff88800415d2" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:28:33 user nova-compute[85141]: DEBUG nova.network.neutron [req-de6a04b9-addf-4b74-bd2f-98038dff586c req-f1cbc9b4-2a27-4cec-8f45-1690ab87fbdd service nova] [instance: 89e358d7-0844-4742-853b-ff88800415d2] Refreshing network info cache for port b60a8a3c-4aac-4af1-ba04-d8a61ab96324 {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 10:28:33 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-410f71cd-f392-46d4-9817-151837d39dc0 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] [instance: 89e358d7-0844-4742-853b-ff88800415d2] Start _get_guest_xml network_info=[{"id": "b60a8a3c-4aac-4af1-ba04-d8a61ab96324", "address": "fa:16:3e:56:2d:dd", "network": {"id": "4e36c3d2-7d16-4305-a0a7-2358e1208df3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1030128743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2acc04e107d4a229c3580cf078a20f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb60a8a3c-4a", "ovs_interfaceid": "b60a8a3c-4aac-4af1-ba04-d8a61ab96324", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T10:06:42Z,direct_url=<?>,disk_format='qcow2',id=bc4ca70f-a459-4d5c-a9e6-80f1948eb48b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1044631a5fe84ce8904864a7024049fa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T10:06:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_options': None, 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'image_id': 'bc4ca70f-a459-4d5c-a9e6-80f1948eb48b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=85141) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 10:28:33 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-410f71cd-f392-46d4-9817-151837d39dc0 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:28:33 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-410f71cd-f392-46d4-9817-151837d39dc0 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:28:33 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-410f71cd-f392-46d4-9817-151837d39dc0 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=85141) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 10:28:33 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-410f71cd-f392-46d4-9817-151837d39dc0 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] CPU controller missing on host. {{(pid=85141) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 10:28:33 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-410f71cd-f392-46d4-9817-151837d39dc0 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=85141) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 10:28:33 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-410f71cd-f392-46d4-9817-151837d39dc0 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] CPU controller found on host. {{(pid=85141) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 10:28:33 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-410f71cd-f392-46d4-9817-151837d39dc0 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=85141) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 10:28:33 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-410f71cd-f392-46d4-9817-151837d39dc0 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T10:06:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T10:06:42Z,direct_url=<?>,disk_format='qcow2',id=bc4ca70f-a459-4d5c-a9e6-80f1948eb48b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1044631a5fe84ce8904864a7024049fa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T10:06:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 10:28:33 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-410f71cd-f392-46d4-9817-151837d39dc0 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Flavor limits 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 10:28:33 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-410f71cd-f392-46d4-9817-151837d39dc0 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Image limits 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 10:28:33 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-410f71cd-f392-46d4-9817-151837d39dc0 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Flavor pref 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 10:28:33 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-410f71cd-f392-46d4-9817-151837d39dc0 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Image pref 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 10:28:33 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-410f71cd-f392-46d4-9817-151837d39dc0 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 10:28:33 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-410f71cd-f392-46d4-9817-151837d39dc0 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 10:28:33 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-410f71cd-f392-46d4-9817-151837d39dc0 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=85141) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 10:28:33 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-410f71cd-f392-46d4-9817-151837d39dc0 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Got 1 possible topologies {{(pid=85141) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 10:28:33 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-410f71cd-f392-46d4-9817-151837d39dc0 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 10:28:33 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-410f71cd-f392-46d4-9817-151837d39dc0 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 10:28:33 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-410f71cd-f392-46d4-9817-151837d39dc0 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T10:28:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1978887411',display_name='tempest-AttachVolumeTestJSON-server-1978887411',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1978887411',id=39,image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEtnGhEBueND8l7UfodG/3yX2PPWW+imcz+d5bVZlVPU/rWym+1QHZXKKfsccjLcvHnRnkF2UVQL++p1nntGQssXfyBeaUcIJXUn7Qmdy2roin1IEfhDyVzv5ajgVbp4vA==',key_name='tempest-keypair-2091170545',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c2acc04e107d4a229c3580cf078a20f7',ramdisk_id='',reservation_id='r-ffqa41ep',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1609390288',owner_user_name='tempest-AttachVolumeTestJSON-1609390288-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T10:28:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f58409e5923c42b685d0a3ad0ab42974',uuid=89e358d7-0844-4742-853b-ff88800415d2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b60a8a3c-4aac-4af1-ba04-d8a61ab96324", "address": "fa:16:3e:56:2d:dd", "network": {"id": "4e36c3d2-7d16-4305-a0a7-2358e1208df3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1030128743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2acc04e107d4a229c3580cf078a20f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb60a8a3c-4a", "ovs_interfaceid": "b60a8a3c-4aac-4af1-ba04-d8a61ab96324", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=85141) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 10:28:33 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-410f71cd-f392-46d4-9817-151837d39dc0 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Converting VIF {"id": "b60a8a3c-4aac-4af1-ba04-d8a61ab96324", "address": "fa:16:3e:56:2d:dd", "network": {"id": "4e36c3d2-7d16-4305-a0a7-2358e1208df3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1030128743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2acc04e107d4a229c3580cf078a20f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb60a8a3c-4a", "ovs_interfaceid": "b60a8a3c-4aac-4af1-ba04-d8a61ab96324", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:28:33 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-410f71cd-f392-46d4-9817-151837d39dc0 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:2d:dd,bridge_name='br-int',has_traffic_filtering=True,id=b60a8a3c-4aac-4af1-ba04-d8a61ab96324,network=Network(4e36c3d2-7d16-4305-a0a7-2358e1208df3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb60a8a3c-4a') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:28:33 user nova-compute[85141]: DEBUG nova.objects.instance [None req-410f71cd-f392-46d4-9817-151837d39dc0 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Lazy-loading 'pci_devices' on Instance uuid 89e358d7-0844-4742-853b-ff88800415d2 {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:28:33 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-410f71cd-f392-46d4-9817-151837d39dc0 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] [instance: 89e358d7-0844-4742-853b-ff88800415d2] End _get_guest_xml xml=<domain type="kvm">
Nov 16 10:28:33 user nova-compute[85141]:   <uuid>89e358d7-0844-4742-853b-ff88800415d2</uuid>
Nov 16 10:28:33 user nova-compute[85141]:   <name>instance-00000027</name>
Nov 16 10:28:33 user nova-compute[85141]:   <memory>524288</memory>
Nov 16 10:28:33 user nova-compute[85141]:   <vcpu>1</vcpu>
Nov 16 10:28:33 user nova-compute[85141]:   <metadata>
Nov 16 10:28:33 user nova-compute[85141]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 10:28:33 user nova-compute[85141]:       <nova:package version="0.0.0"/>
Nov 16 10:28:33 user nova-compute[85141]:       <nova:name>tempest-AttachVolumeTestJSON-server-1978887411</nova:name>
Nov 16 10:28:33 user nova-compute[85141]:       <nova:creationTime>2023-11-16 10:28:33</nova:creationTime>
Nov 16 10:28:33 user nova-compute[85141]:       <nova:flavor name="m1.tiny">
Nov 16 10:28:33 user nova-compute[85141]:         <nova:memory>512</nova:memory>
Nov 16 10:28:33 user nova-compute[85141]:         <nova:disk>1</nova:disk>
Nov 16 10:28:33 user nova-compute[85141]:         <nova:swap>0</nova:swap>
Nov 16 10:28:33 user nova-compute[85141]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 10:28:33 user nova-compute[85141]:         <nova:vcpus>1</nova:vcpus>
Nov 16 10:28:33 user nova-compute[85141]:       </nova:flavor>
Nov 16 10:28:33 user nova-compute[85141]:       <nova:owner>
Nov 16 10:28:33 user nova-compute[85141]:         <nova:user uuid="f58409e5923c42b685d0a3ad0ab42974">tempest-AttachVolumeTestJSON-1609390288-project-member</nova:user>
Nov 16 10:28:33 user nova-compute[85141]:         <nova:project uuid="c2acc04e107d4a229c3580cf078a20f7">tempest-AttachVolumeTestJSON-1609390288</nova:project>
Nov 16 10:28:33 user nova-compute[85141]:       </nova:owner>
Nov 16 10:28:33 user nova-compute[85141]:       <nova:root type="image" uuid="bc4ca70f-a459-4d5c-a9e6-80f1948eb48b"/>
Nov 16 10:28:33 user nova-compute[85141]:       <nova:ports>
Nov 16 10:28:33 user nova-compute[85141]:         <nova:port uuid="b60a8a3c-4aac-4af1-ba04-d8a61ab96324">
Nov 16 10:28:33 user nova-compute[85141]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 16 10:28:33 user nova-compute[85141]:         </nova:port>
Nov 16 10:28:33 user nova-compute[85141]:       </nova:ports>
Nov 16 10:28:33 user nova-compute[85141]:     </nova:instance>
Nov 16 10:28:33 user nova-compute[85141]:   </metadata>
Nov 16 10:28:33 user nova-compute[85141]:   <sysinfo type="smbios">
Nov 16 10:28:33 user nova-compute[85141]:     <system>
Nov 16 10:28:33 user nova-compute[85141]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 10:28:33 user nova-compute[85141]:       <entry name="product">OpenStack Nova</entry>
Nov 16 10:28:33 user nova-compute[85141]:       <entry name="version">0.0.0</entry>
Nov 16 10:28:33 user nova-compute[85141]:       <entry name="serial">89e358d7-0844-4742-853b-ff88800415d2</entry>
Nov 16 10:28:33 user nova-compute[85141]:       <entry name="uuid">89e358d7-0844-4742-853b-ff88800415d2</entry>
Nov 16 10:28:33 user nova-compute[85141]:       <entry name="family">Virtual Machine</entry>
Nov 16 10:28:33 user nova-compute[85141]:     </system>
Nov 16 10:28:33 user nova-compute[85141]:   </sysinfo>
Nov 16 10:28:33 user nova-compute[85141]:   <os>
Nov 16 10:28:33 user nova-compute[85141]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 10:28:33 user nova-compute[85141]:     <boot dev="hd"/>
Nov 16 10:28:33 user nova-compute[85141]:     <smbios mode="sysinfo"/>
Nov 16 10:28:33 user nova-compute[85141]:   </os>
Nov 16 10:28:33 user nova-compute[85141]:   <features>
Nov 16 10:28:33 user nova-compute[85141]:     <acpi/>
Nov 16 10:28:33 user nova-compute[85141]:     <apic/>
Nov 16 10:28:33 user nova-compute[85141]:     <vmcoreinfo/>
Nov 16 10:28:33 user nova-compute[85141]:   </features>
Nov 16 10:28:33 user nova-compute[85141]:   <clock offset="utc">
Nov 16 10:28:33 user nova-compute[85141]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 10:28:33 user nova-compute[85141]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 10:28:33 user nova-compute[85141]:     <timer name="hpet" present="no"/>
Nov 16 10:28:33 user nova-compute[85141]:   </clock>
Nov 16 10:28:33 user nova-compute[85141]:   <cpu mode="custom" match="exact">
Nov 16 10:28:33 user nova-compute[85141]:     <model>Nehalem</model>
Nov 16 10:28:33 user nova-compute[85141]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 10:28:33 user nova-compute[85141]:   </cpu>
Nov 16 10:28:33 user nova-compute[85141]:   <devices>
Nov 16 10:28:33 user nova-compute[85141]:     <disk type="file" device="disk">
Nov 16 10:28:33 user nova-compute[85141]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 10:28:33 user nova-compute[85141]:       <source file="/opt/stack/data/nova/instances/89e358d7-0844-4742-853b-ff88800415d2/disk"/>
Nov 16 10:28:33 user nova-compute[85141]:       <target dev="vda" bus="virtio"/>
Nov 16 10:28:33 user nova-compute[85141]:     </disk>
Nov 16 10:28:33 user nova-compute[85141]:     <interface type="ethernet">
Nov 16 10:28:33 user nova-compute[85141]:       <mac address="fa:16:3e:56:2d:dd"/>
Nov 16 10:28:33 user nova-compute[85141]:       <model type="virtio"/>
Nov 16 10:28:33 user nova-compute[85141]:       <mtu size="1442"/>
Nov 16 10:28:33 user nova-compute[85141]:       <target dev="tapb60a8a3c-4a"/>
Nov 16 10:28:33 user nova-compute[85141]:     </interface>
Nov 16 10:28:33 user nova-compute[85141]:     <serial type="pty">
Nov 16 10:28:33 user nova-compute[85141]:       <log file="/opt/stack/data/nova/instances/89e358d7-0844-4742-853b-ff88800415d2/console.log" append="off"/>
Nov 16 10:28:33 user nova-compute[85141]:     </serial>
Nov 16 10:28:33 user nova-compute[85141]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 10:28:33 user nova-compute[85141]:     <video>
Nov 16 10:28:33 user nova-compute[85141]:       <model type="virtio"/>
Nov 16 10:28:33 user nova-compute[85141]:     </video>
Nov 16 10:28:33 user nova-compute[85141]:     <rng model="virtio">
Nov 16 10:28:33 user nova-compute[85141]:       <backend model="random">/dev/urandom</backend>
Nov 16 10:28:33 user nova-compute[85141]:     </rng>
Nov 16 10:28:33 user nova-compute[85141]:     <controller type="usb" index="0" model="none"/>
Nov 16 10:28:33 user nova-compute[85141]:     <memballoon model="virtio">
Nov 16 10:28:33 user nova-compute[85141]:       <stats period="10"/>
Nov 16 10:28:33 user nova-compute[85141]:     </memballoon>
Nov 16 10:28:33 user nova-compute[85141]:   </devices>
Nov 16 10:28:33 user nova-compute[85141]: </domain>
Nov 16 10:28:33 user nova-compute[85141]:  {{(pid=85141) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 10:28:33 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-410f71cd-f392-46d4-9817-151837d39dc0 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T10:28:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1978887411',display_name='tempest-AttachVolumeTestJSON-server-1978887411',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1978887411',id=39,image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEtnGhEBueND8l7UfodG/3yX2PPWW+imcz+d5bVZlVPU/rWym+1QHZXKKfsccjLcvHnRnkF2UVQL++p1nntGQssXfyBeaUcIJXUn7Qmdy2roin1IEfhDyVzv5ajgVbp4vA==',key_name='tempest-keypair-2091170545',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c2acc04e107d4a229c3580cf078a20f7',ramdisk_id='',reservation_id='r-ffqa41ep',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1609390288',owner_user_name='tempest-AttachVolumeTestJSON-1609390288-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T10:28:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f58409e5923c42b685d0a3ad0ab42974',uuid=89e358d7-0844-4742-853b-ff88800415d2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b60a8a3c-4aac-4af1-ba04-d8a61ab96324", "address": "fa:16:3e:56:2d:dd", "network": {"id": "4e36c3d2-7d16-4305-a0a7-2358e1208df3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1030128743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2acc04e107d4a229c3580cf078a20f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb60a8a3c-4a", "ovs_interfaceid": "b60a8a3c-4aac-4af1-ba04-d8a61ab96324", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 10:28:33 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-410f71cd-f392-46d4-9817-151837d39dc0 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Converting VIF {"id": "b60a8a3c-4aac-4af1-ba04-d8a61ab96324", "address": "fa:16:3e:56:2d:dd", "network": {"id": "4e36c3d2-7d16-4305-a0a7-2358e1208df3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1030128743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2acc04e107d4a229c3580cf078a20f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb60a8a3c-4a", "ovs_interfaceid": "b60a8a3c-4aac-4af1-ba04-d8a61ab96324", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:28:33 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-410f71cd-f392-46d4-9817-151837d39dc0 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:2d:dd,bridge_name='br-int',has_traffic_filtering=True,id=b60a8a3c-4aac-4af1-ba04-d8a61ab96324,network=Network(4e36c3d2-7d16-4305-a0a7-2358e1208df3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb60a8a3c-4a') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:28:33 user nova-compute[85141]: DEBUG os_vif [None req-410f71cd-f392-46d4-9817-151837d39dc0 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:2d:dd,bridge_name='br-int',has_traffic_filtering=True,id=b60a8a3c-4aac-4af1-ba04-d8a61ab96324,network=Network(4e36c3d2-7d16-4305-a0a7-2358e1208df3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb60a8a3c-4a') {{(pid=85141) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 10:28:33 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:28:33 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:28:33 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 10:28:33 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:28:33 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '023c28c9-c39a-569b-a92d-288d85687f8c', '_type': 'linux-noop'}}, row=False) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:28:33 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:28:33 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:28:33 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:28:33 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb60a8a3c-4a, may_exist=True, interface_attrs={}) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:28:33 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb60a8a3c-4a, col_values=(('qos', UUID('cee54ef7-ae69-470a-a552-540fee9bb1a9')),), if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:28:33 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb60a8a3c-4a, col_values=(('external_ids', {'iface-id': 'b60a8a3c-4aac-4af1-ba04-d8a61ab96324', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:56:2d:dd', 'vm-uuid': '89e358d7-0844-4742-853b-ff88800415d2'}),), if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:28:33 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:28:33 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:28:33 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:28:33 user nova-compute[85141]: INFO os_vif [None req-410f71cd-f392-46d4-9817-151837d39dc0 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:2d:dd,bridge_name='br-int',has_traffic_filtering=True,id=b60a8a3c-4aac-4af1-ba04-d8a61ab96324,network=Network(4e36c3d2-7d16-4305-a0a7-2358e1208df3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb60a8a3c-4a')
Nov 16 10:28:33 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:28:33 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Starting heal instance info cache {{(pid=85141) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 10:28:33 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-410f71cd-f392-46d4-9817-151837d39dc0 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] No BDM found with device name vda, not building metadata. {{(pid=85141) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 10:28:33 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-410f71cd-f392-46d4-9817-151837d39dc0 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] No VIF found with MAC fa:16:3e:56:2d:dd, not building metadata {{(pid=85141) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 10:28:33 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Acquiring lock "refresh_cache-b24c3954-06ff-4e15-9e43-c65d1dae7a5d" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:28:33 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Acquired lock "refresh_cache-b24c3954-06ff-4e15-9e43-c65d1dae7a5d" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:28:33 user nova-compute[85141]: DEBUG nova.network.neutron [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] [instance: b24c3954-06ff-4e15-9e43-c65d1dae7a5d] Forcefully refreshing network info cache for instance {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 10:28:33 user nova-compute[85141]: DEBUG nova.network.neutron [req-de6a04b9-addf-4b74-bd2f-98038dff586c req-f1cbc9b4-2a27-4cec-8f45-1690ab87fbdd service nova] [instance: 89e358d7-0844-4742-853b-ff88800415d2] Updated VIF entry in instance network info cache for port b60a8a3c-4aac-4af1-ba04-d8a61ab96324. {{(pid=85141) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 10:28:33 user nova-compute[85141]: DEBUG nova.network.neutron [req-de6a04b9-addf-4b74-bd2f-98038dff586c req-f1cbc9b4-2a27-4cec-8f45-1690ab87fbdd service nova] [instance: 89e358d7-0844-4742-853b-ff88800415d2] Updating instance_info_cache with network_info: [{"id": "b60a8a3c-4aac-4af1-ba04-d8a61ab96324", "address": "fa:16:3e:56:2d:dd", "network": {"id": "4e36c3d2-7d16-4305-a0a7-2358e1208df3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1030128743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2acc04e107d4a229c3580cf078a20f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb60a8a3c-4a", "ovs_interfaceid": "b60a8a3c-4aac-4af1-ba04-d8a61ab96324", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:28:33 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-de6a04b9-addf-4b74-bd2f-98038dff586c req-f1cbc9b4-2a27-4cec-8f45-1690ab87fbdd service nova] Releasing lock "refresh_cache-89e358d7-0844-4742-853b-ff88800415d2" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:28:34 user nova-compute[85141]: DEBUG nova.network.neutron [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] [instance: b24c3954-06ff-4e15-9e43-c65d1dae7a5d] Updating instance_info_cache with network_info: [{"id": "6becb779-bd08-4a40-bb56-3b8f03d1f844", "address": "fa:16:3e:ca:42:7f", "network": {"id": "5b67a3fd-ef1e-4f2c-b6e0-31766ef39d30", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2137186235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09b520de67ac4290a4b779f50afeb1a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6becb779-bd", "ovs_interfaceid": "6becb779-bd08-4a40-bb56-3b8f03d1f844", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:28:34 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Releasing lock "refresh_cache-b24c3954-06ff-4e15-9e43-c65d1dae7a5d" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:28:34 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] [instance: b24c3954-06ff-4e15-9e43-c65d1dae7a5d] Updated the network info_cache for instance {{(pid=85141) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 10:28:34 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:28:34 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=85141) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 10:28:34 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:28:34 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:28:34 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:28:35 user nova-compute[85141]: DEBUG nova.compute.manager [req-d1c1b2dd-112b-4cf4-90b7-dbf925e877cc req-90b21a22-ce0a-4871-8358-5fad2ba14bf1 service nova] [instance: 89e358d7-0844-4742-853b-ff88800415d2] Received event network-vif-plugged-b60a8a3c-4aac-4af1-ba04-d8a61ab96324 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:28:35 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-d1c1b2dd-112b-4cf4-90b7-dbf925e877cc req-90b21a22-ce0a-4871-8358-5fad2ba14bf1 service nova] Acquiring lock "89e358d7-0844-4742-853b-ff88800415d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:28:35 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-d1c1b2dd-112b-4cf4-90b7-dbf925e877cc req-90b21a22-ce0a-4871-8358-5fad2ba14bf1 service nova] Lock "89e358d7-0844-4742-853b-ff88800415d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:28:35 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-d1c1b2dd-112b-4cf4-90b7-dbf925e877cc req-90b21a22-ce0a-4871-8358-5fad2ba14bf1 service nova] Lock "89e358d7-0844-4742-853b-ff88800415d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:28:35 user nova-compute[85141]: DEBUG nova.compute.manager [req-d1c1b2dd-112b-4cf4-90b7-dbf925e877cc req-90b21a22-ce0a-4871-8358-5fad2ba14bf1 service nova] [instance: 89e358d7-0844-4742-853b-ff88800415d2] No waiting events found dispatching network-vif-plugged-b60a8a3c-4aac-4af1-ba04-d8a61ab96324 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:28:35 user nova-compute[85141]: WARNING nova.compute.manager [req-d1c1b2dd-112b-4cf4-90b7-dbf925e877cc req-90b21a22-ce0a-4871-8358-5fad2ba14bf1 service nova] [instance: 89e358d7-0844-4742-853b-ff88800415d2] Received unexpected event network-vif-plugged-b60a8a3c-4aac-4af1-ba04-d8a61ab96324 for instance with vm_state building and task_state spawning.
Nov 16 10:28:35 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:28:35 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:28:35 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:28:35 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:28:35 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:28:36 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager.update_available_resource {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:28:36 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:28:36 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:28:36 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:28:36 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Auditing locally available compute resources for user (node: user) {{(pid=85141) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 10:28:36 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/463034ff-14ce-477a-9642-4d86aa6f9cd9/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:28:36 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/463034ff-14ce-477a-9642-4d86aa6f9cd9/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:28:36 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/463034ff-14ce-477a-9642-4d86aa6f9cd9/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:28:37 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/463034ff-14ce-477a-9642-4d86aa6f9cd9/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:28:37 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=85141) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 10:28:37 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a507c85-0369-48ea-8858-3e7d346b4cb0/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:28:37 user nova-compute[85141]: DEBUG nova.compute.manager [req-552223a7-847b-436f-ac63-e005031ad05d req-018cfd14-2637-4afc-9e11-066bb54bd52e service nova] [instance: 89e358d7-0844-4742-853b-ff88800415d2] Received event network-vif-plugged-b60a8a3c-4aac-4af1-ba04-d8a61ab96324 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:28:37 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-552223a7-847b-436f-ac63-e005031ad05d req-018cfd14-2637-4afc-9e11-066bb54bd52e service nova] Acquiring lock "89e358d7-0844-4742-853b-ff88800415d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:28:37 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-552223a7-847b-436f-ac63-e005031ad05d req-018cfd14-2637-4afc-9e11-066bb54bd52e service nova] Lock "89e358d7-0844-4742-853b-ff88800415d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:28:37 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-552223a7-847b-436f-ac63-e005031ad05d req-018cfd14-2637-4afc-9e11-066bb54bd52e service nova] Lock "89e358d7-0844-4742-853b-ff88800415d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:28:37 user nova-compute[85141]: DEBUG nova.compute.manager [req-552223a7-847b-436f-ac63-e005031ad05d req-018cfd14-2637-4afc-9e11-066bb54bd52e service nova] [instance: 89e358d7-0844-4742-853b-ff88800415d2] No waiting events found dispatching network-vif-plugged-b60a8a3c-4aac-4af1-ba04-d8a61ab96324 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:28:37 user nova-compute[85141]: WARNING nova.compute.manager [req-552223a7-847b-436f-ac63-e005031ad05d req-018cfd14-2637-4afc-9e11-066bb54bd52e service nova] [instance: 89e358d7-0844-4742-853b-ff88800415d2] Received unexpected event network-vif-plugged-b60a8a3c-4aac-4af1-ba04-d8a61ab96324 for instance with vm_state building and task_state spawning.
Nov 16 10:28:37 user nova-compute[85141]: DEBUG nova.compute.manager [None req-410f71cd-f392-46d4-9817-151837d39dc0 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] [instance: 89e358d7-0844-4742-853b-ff88800415d2] Instance event wait completed in 0 seconds for  {{(pid=85141) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 10:28:37 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-410f71cd-f392-46d4-9817-151837d39dc0 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] [instance: 89e358d7-0844-4742-853b-ff88800415d2] Guest created on hypervisor {{(pid=85141) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 10:28:37 user nova-compute[85141]: INFO nova.virt.libvirt.driver [-] [instance: 89e358d7-0844-4742-853b-ff88800415d2] Instance spawned successfully.
Nov 16 10:28:37 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-410f71cd-f392-46d4-9817-151837d39dc0 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] [instance: 89e358d7-0844-4742-853b-ff88800415d2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 10:28:37 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-410f71cd-f392-46d4-9817-151837d39dc0 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] [instance: 89e358d7-0844-4742-853b-ff88800415d2] Found default for hw_cdrom_bus of ide {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:28:37 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-410f71cd-f392-46d4-9817-151837d39dc0 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] [instance: 89e358d7-0844-4742-853b-ff88800415d2] Found default for hw_disk_bus of virtio {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:28:37 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-410f71cd-f392-46d4-9817-151837d39dc0 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] [instance: 89e358d7-0844-4742-853b-ff88800415d2] Found default for hw_input_bus of None {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:28:37 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-410f71cd-f392-46d4-9817-151837d39dc0 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] [instance: 89e358d7-0844-4742-853b-ff88800415d2] Found default for hw_pointer_model of None {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:28:37 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-410f71cd-f392-46d4-9817-151837d39dc0 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] [instance: 89e358d7-0844-4742-853b-ff88800415d2] Found default for hw_video_model of virtio {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:28:37 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-410f71cd-f392-46d4-9817-151837d39dc0 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] [instance: 89e358d7-0844-4742-853b-ff88800415d2] Found default for hw_vif_model of virtio {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:28:37 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a507c85-0369-48ea-8858-3e7d346b4cb0/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:28:37 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a507c85-0369-48ea-8858-3e7d346b4cb0/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:28:37 user nova-compute[85141]: INFO nova.compute.manager [None req-410f71cd-f392-46d4-9817-151837d39dc0 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] [instance: 89e358d7-0844-4742-853b-ff88800415d2] Took 7.21 seconds to spawn the instance on the hypervisor.
Nov 16 10:28:37 user nova-compute[85141]: DEBUG nova.compute.manager [None req-410f71cd-f392-46d4-9817-151837d39dc0 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] [instance: 89e358d7-0844-4742-853b-ff88800415d2] Checking state {{(pid=85141) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 10:28:37 user nova-compute[85141]: INFO nova.compute.manager [None req-410f71cd-f392-46d4-9817-151837d39dc0 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] [instance: 89e358d7-0844-4742-853b-ff88800415d2] Took 8.06 seconds to build instance.
Nov 16 10:28:37 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-410f71cd-f392-46d4-9817-151837d39dc0 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Lock "89e358d7-0844-4742-853b-ff88800415d2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.242s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:28:37 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a507c85-0369-48ea-8858-3e7d346b4cb0/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:28:37 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e214bbb-5bbb-4e6f-ac09-9cb1412f068b/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:28:37 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e214bbb-5bbb-4e6f-ac09-9cb1412f068b/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:28:37 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e214bbb-5bbb-4e6f-ac09-9cb1412f068b/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:28:37 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e214bbb-5bbb-4e6f-ac09-9cb1412f068b/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:28:37 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d842f90e-663b-4c95-9d7c-d092d2bac41f/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:28:37 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d842f90e-663b-4c95-9d7c-d092d2bac41f/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:28:37 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d842f90e-663b-4c95-9d7c-d092d2bac41f/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:28:38 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:28:38 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d842f90e-663b-4c95-9d7c-d092d2bac41f/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:28:38 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=85141) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 10:28:38 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89e358d7-0844-4742-853b-ff88800415d2/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:28:38 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:28:38 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89e358d7-0844-4742-853b-ff88800415d2/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:28:38 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89e358d7-0844-4742-853b-ff88800415d2/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:28:38 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89e358d7-0844-4742-853b-ff88800415d2/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:28:38 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=85141) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 10:28:38 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b24c3954-06ff-4e15-9e43-c65d1dae7a5d/disk.rescue --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:28:38 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b24c3954-06ff-4e15-9e43-c65d1dae7a5d/disk.rescue --force-share --output=json" returned: 0 in 0.184s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:28:38 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b24c3954-06ff-4e15-9e43-c65d1dae7a5d/disk.rescue --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:28:38 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-fd3c4d49-784c-42b9-9f3c-8ba27e57f9f2 tempest-VolumesNegativeTest-355403086 tempest-VolumesNegativeTest-355403086-project-member] Acquiring lock "7628b43b-5b22-440b-a27b-bf2e28b93cf6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:28:38 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-fd3c4d49-784c-42b9-9f3c-8ba27e57f9f2 tempest-VolumesNegativeTest-355403086 tempest-VolumesNegativeTest-355403086-project-member] Lock "7628b43b-5b22-440b-a27b-bf2e28b93cf6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:28:38 user nova-compute[85141]: DEBUG nova.compute.manager [None req-fd3c4d49-784c-42b9-9f3c-8ba27e57f9f2 tempest-VolumesNegativeTest-355403086 tempest-VolumesNegativeTest-355403086-project-member] [instance: 7628b43b-5b22-440b-a27b-bf2e28b93cf6] Starting instance... {{(pid=85141) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 10:28:38 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b24c3954-06ff-4e15-9e43-c65d1dae7a5d/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:28:38 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b24c3954-06ff-4e15-9e43-c65d1dae7a5d/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:28:38 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-fd3c4d49-784c-42b9-9f3c-8ba27e57f9f2 tempest-VolumesNegativeTest-355403086 tempest-VolumesNegativeTest-355403086-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:28:38 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-fd3c4d49-784c-42b9-9f3c-8ba27e57f9f2 tempest-VolumesNegativeTest-355403086 tempest-VolumesNegativeTest-355403086-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:28:39 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-fd3c4d49-784c-42b9-9f3c-8ba27e57f9f2 tempest-VolumesNegativeTest-355403086 tempest-VolumesNegativeTest-355403086-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=85141) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 10:28:39 user nova-compute[85141]: INFO nova.compute.claims [None req-fd3c4d49-784c-42b9-9f3c-8ba27e57f9f2 tempest-VolumesNegativeTest-355403086 tempest-VolumesNegativeTest-355403086-project-member] [instance: 7628b43b-5b22-440b-a27b-bf2e28b93cf6] Claim successful on node user
Nov 16 10:28:39 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b24c3954-06ff-4e15-9e43-c65d1dae7a5d/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:28:39 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b24c3954-06ff-4e15-9e43-c65d1dae7a5d/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:28:39 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b24c3954-06ff-4e15-9e43-c65d1dae7a5d/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:28:39 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/059d6974-bd0c-4f73-91fc-8202ebda4238/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:28:39 user nova-compute[85141]: DEBUG nova.compute.provider_tree [None req-fd3c4d49-784c-42b9-9f3c-8ba27e57f9f2 tempest-VolumesNegativeTest-355403086 tempest-VolumesNegativeTest-355403086-project-member] Inventory has not changed in ProviderTree for provider: bf8e0fa1-16b6-408f-9203-c4cd63916272 {{(pid=85141) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 10:28:39 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/059d6974-bd0c-4f73-91fc-8202ebda4238/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:28:39 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/059d6974-bd0c-4f73-91fc-8202ebda4238/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:28:39 user nova-compute[85141]: DEBUG nova.scheduler.client.report [None req-fd3c4d49-784c-42b9-9f3c-8ba27e57f9f2 tempest-VolumesNegativeTest-355403086 tempest-VolumesNegativeTest-355403086-project-member] Inventory has not changed for provider bf8e0fa1-16b6-408f-9203-c4cd63916272 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=85141) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 10:28:39 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-fd3c4d49-784c-42b9-9f3c-8ba27e57f9f2 tempest-VolumesNegativeTest-355403086 tempest-VolumesNegativeTest-355403086-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.618s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:28:39 user nova-compute[85141]: DEBUG nova.compute.manager [None req-fd3c4d49-784c-42b9-9f3c-8ba27e57f9f2 tempest-VolumesNegativeTest-355403086 tempest-VolumesNegativeTest-355403086-project-member] [instance: 7628b43b-5b22-440b-a27b-bf2e28b93cf6] Start building networks asynchronously for instance. {{(pid=85141) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 10:28:39 user nova-compute[85141]: DEBUG nova.compute.manager [None req-fd3c4d49-784c-42b9-9f3c-8ba27e57f9f2 tempest-VolumesNegativeTest-355403086 tempest-VolumesNegativeTest-355403086-project-member] [instance: 7628b43b-5b22-440b-a27b-bf2e28b93cf6] Allocating IP information in the background. {{(pid=85141) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 10:28:39 user nova-compute[85141]: DEBUG nova.network.neutron [None req-fd3c4d49-784c-42b9-9f3c-8ba27e57f9f2 tempest-VolumesNegativeTest-355403086 tempest-VolumesNegativeTest-355403086-project-member] [instance: 7628b43b-5b22-440b-a27b-bf2e28b93cf6] allocate_for_instance() {{(pid=85141) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 10:28:39 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-fd3c4d49-784c-42b9-9f3c-8ba27e57f9f2 tempest-VolumesNegativeTest-355403086 tempest-VolumesNegativeTest-355403086-project-member] [instance: 7628b43b-5b22-440b-a27b-bf2e28b93cf6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 10:28:39 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/059d6974-bd0c-4f73-91fc-8202ebda4238/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:28:39 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=85141) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 10:28:39 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da42de06-4518-4c8a-8c63-9b5a2759a1bf/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:28:39 user nova-compute[85141]: DEBUG nova.compute.manager [None req-fd3c4d49-784c-42b9-9f3c-8ba27e57f9f2 tempest-VolumesNegativeTest-355403086 tempest-VolumesNegativeTest-355403086-project-member] [instance: 7628b43b-5b22-440b-a27b-bf2e28b93cf6] Start building block device mappings for instance. {{(pid=85141) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 10:28:39 user nova-compute[85141]: DEBUG nova.compute.manager [None req-fd3c4d49-784c-42b9-9f3c-8ba27e57f9f2 tempest-VolumesNegativeTest-355403086 tempest-VolumesNegativeTest-355403086-project-member] [instance: 7628b43b-5b22-440b-a27b-bf2e28b93cf6] Start spawning the instance on the hypervisor. {{(pid=85141) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 10:28:39 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-fd3c4d49-784c-42b9-9f3c-8ba27e57f9f2 tempest-VolumesNegativeTest-355403086 tempest-VolumesNegativeTest-355403086-project-member] [instance: 7628b43b-5b22-440b-a27b-bf2e28b93cf6] Creating instance directory {{(pid=85141) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 10:28:39 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-fd3c4d49-784c-42b9-9f3c-8ba27e57f9f2 tempest-VolumesNegativeTest-355403086 tempest-VolumesNegativeTest-355403086-project-member] [instance: 7628b43b-5b22-440b-a27b-bf2e28b93cf6] Creating image(s)
Nov 16 10:28:39 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-fd3c4d49-784c-42b9-9f3c-8ba27e57f9f2 tempest-VolumesNegativeTest-355403086 tempest-VolumesNegativeTest-355403086-project-member] Acquiring lock "/opt/stack/data/nova/instances/7628b43b-5b22-440b-a27b-bf2e28b93cf6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:28:39 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-fd3c4d49-784c-42b9-9f3c-8ba27e57f9f2 tempest-VolumesNegativeTest-355403086 tempest-VolumesNegativeTest-355403086-project-member] Lock "/opt/stack/data/nova/instances/7628b43b-5b22-440b-a27b-bf2e28b93cf6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:28:39 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-fd3c4d49-784c-42b9-9f3c-8ba27e57f9f2 tempest-VolumesNegativeTest-355403086 tempest-VolumesNegativeTest-355403086-project-member] Lock "/opt/stack/data/nova/instances/7628b43b-5b22-440b-a27b-bf2e28b93cf6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:28:39 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-fd3c4d49-784c-42b9-9f3c-8ba27e57f9f2 tempest-VolumesNegativeTest-355403086 tempest-VolumesNegativeTest-355403086-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:28:39 user nova-compute[85141]: DEBUG nova.policy [None req-fd3c4d49-784c-42b9-9f3c-8ba27e57f9f2 tempest-VolumesNegativeTest-355403086 tempest-VolumesNegativeTest-355403086-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b8592a9c3715469b961e4bec8011c6f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83a6d2c2eba5496dad2b9cba236f319d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85141) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 10:28:39 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da42de06-4518-4c8a-8c63-9b5a2759a1bf/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:28:39 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da42de06-4518-4c8a-8c63-9b5a2759a1bf/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:28:40 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-fd3c4d49-784c-42b9-9f3c-8ba27e57f9f2 tempest-VolumesNegativeTest-355403086 tempest-VolumesNegativeTest-355403086-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json" returned: 0 in 0.184s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:28:40 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-fd3c4d49-784c-42b9-9f3c-8ba27e57f9f2 tempest-VolumesNegativeTest-355403086 tempest-VolumesNegativeTest-355403086-project-member] Acquiring lock "60a78556fb399ed4a41bc3ca4bccf77c96d8e811" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:28:40 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-fd3c4d49-784c-42b9-9f3c-8ba27e57f9f2 tempest-VolumesNegativeTest-355403086 tempest-VolumesNegativeTest-355403086-project-member] Lock "60a78556fb399ed4a41bc3ca4bccf77c96d8e811" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:28:40 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-fd3c4d49-784c-42b9-9f3c-8ba27e57f9f2 tempest-VolumesNegativeTest-355403086 tempest-VolumesNegativeTest-355403086-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:28:40 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da42de06-4518-4c8a-8c63-9b5a2759a1bf/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:28:40 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11986c5b-6914-491e-8e71-983ab6b13c6e/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:28:40 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-fd3c4d49-784c-42b9-9f3c-8ba27e57f9f2 tempest-VolumesNegativeTest-355403086 tempest-VolumesNegativeTest-355403086-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json" returned: 0 in 0.193s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:28:40 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-fd3c4d49-784c-42b9-9f3c-8ba27e57f9f2 tempest-VolumesNegativeTest-355403086 tempest-VolumesNegativeTest-355403086-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811,backing_fmt=raw /opt/stack/data/nova/instances/7628b43b-5b22-440b-a27b-bf2e28b93cf6/disk 1073741824 {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:28:40 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11986c5b-6914-491e-8e71-983ab6b13c6e/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:28:40 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11986c5b-6914-491e-8e71-983ab6b13c6e/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:28:40 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-fd3c4d49-784c-42b9-9f3c-8ba27e57f9f2 tempest-VolumesNegativeTest-355403086 tempest-VolumesNegativeTest-355403086-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811,backing_fmt=raw /opt/stack/data/nova/instances/7628b43b-5b22-440b-a27b-bf2e28b93cf6/disk 1073741824" returned: 0 in 0.076s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:28:40 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-fd3c4d49-784c-42b9-9f3c-8ba27e57f9f2 tempest-VolumesNegativeTest-355403086 tempest-VolumesNegativeTest-355403086-project-member] Lock "60a78556fb399ed4a41bc3ca4bccf77c96d8e811" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.278s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:28:40 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-fd3c4d49-784c-42b9-9f3c-8ba27e57f9f2 tempest-VolumesNegativeTest-355403086 tempest-VolumesNegativeTest-355403086-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:28:40 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11986c5b-6914-491e-8e71-983ab6b13c6e/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:28:40 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-fd3c4d49-784c-42b9-9f3c-8ba27e57f9f2 tempest-VolumesNegativeTest-355403086 tempest-VolumesNegativeTest-355403086-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json" returned: 0 in 0.175s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:28:40 user nova-compute[85141]: DEBUG nova.virt.disk.api [None req-fd3c4d49-784c-42b9-9f3c-8ba27e57f9f2 tempest-VolumesNegativeTest-355403086 tempest-VolumesNegativeTest-355403086-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7628b43b-5b22-440b-a27b-bf2e28b93cf6/disk. size=1073741824 {{(pid=85141) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 10:28:40 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-fd3c4d49-784c-42b9-9f3c-8ba27e57f9f2 tempest-VolumesNegativeTest-355403086 tempest-VolumesNegativeTest-355403086-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7628b43b-5b22-440b-a27b-bf2e28b93cf6/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:28:41 user nova-compute[85141]: DEBUG nova.network.neutron [None req-fd3c4d49-784c-42b9-9f3c-8ba27e57f9f2 tempest-VolumesNegativeTest-355403086 tempest-VolumesNegativeTest-355403086-project-member] [instance: 7628b43b-5b22-440b-a27b-bf2e28b93cf6] Successfully created port: 9ac05886-79dc-4a75-a676-7db0abb46f99 {{(pid=85141) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 10:28:41 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-fd3c4d49-784c-42b9-9f3c-8ba27e57f9f2 tempest-VolumesNegativeTest-355403086 tempest-VolumesNegativeTest-355403086-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7628b43b-5b22-440b-a27b-bf2e28b93cf6/disk --force-share --output=json" returned: 0 in 0.528s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:28:41 user nova-compute[85141]: DEBUG nova.virt.disk.api [None req-fd3c4d49-784c-42b9-9f3c-8ba27e57f9f2 tempest-VolumesNegativeTest-355403086 tempest-VolumesNegativeTest-355403086-project-member] Cannot resize image /opt/stack/data/nova/instances/7628b43b-5b22-440b-a27b-bf2e28b93cf6/disk to a smaller size. {{(pid=85141) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 10:28:41 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-fd3c4d49-784c-42b9-9f3c-8ba27e57f9f2 tempest-VolumesNegativeTest-355403086 tempest-VolumesNegativeTest-355403086-project-member] [instance: 7628b43b-5b22-440b-a27b-bf2e28b93cf6] Created local disks {{(pid=85141) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 10:28:41 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-fd3c4d49-784c-42b9-9f3c-8ba27e57f9f2 tempest-VolumesNegativeTest-355403086 tempest-VolumesNegativeTest-355403086-project-member] [instance: 7628b43b-5b22-440b-a27b-bf2e28b93cf6] Ensure instance console log exists: /opt/stack/data/nova/instances/7628b43b-5b22-440b-a27b-bf2e28b93cf6/console.log {{(pid=85141) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 10:28:41 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-fd3c4d49-784c-42b9-9f3c-8ba27e57f9f2 tempest-VolumesNegativeTest-355403086 tempest-VolumesNegativeTest-355403086-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:28:41 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-fd3c4d49-784c-42b9-9f3c-8ba27e57f9f2 tempest-VolumesNegativeTest-355403086 tempest-VolumesNegativeTest-355403086-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:28:41 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-fd3c4d49-784c-42b9-9f3c-8ba27e57f9f2 tempest-VolumesNegativeTest-355403086 tempest-VolumesNegativeTest-355403086-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:28:41 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:28:41 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:28:41 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Hypervisor/Node resource view: name=user free_ram=7399MB free_disk=24.81732940673828GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=85141) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 10:28:41 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:28:41 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:28:41 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Applying migration context for instance bc76703d-9243-4277-9b13-d6f9639cd1bb as it has an incoming, in-progress migration 72c5d793-592e-4c2f-a692-665458d8517a. Migration status is finished {{(pid=85141) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 16 10:28:41 user nova-compute[85141]: INFO nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] [instance: bc76703d-9243-4277-9b13-d6f9639cd1bb] Updating resource usage from migration 72c5d793-592e-4c2f-a692-665458d8517a
Nov 16 10:28:41 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance d842f90e-663b-4c95-9d7c-d092d2bac41f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:28:41 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance f01dc8cf-1a69-4618-a15d-0c1075157f05 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:28:41 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance 059d6974-bd0c-4f73-91fc-8202ebda4238 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:28:41 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance 4e214bbb-5bbb-4e6f-ac09-9cb1412f068b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:28:41 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance b24c3954-06ff-4e15-9e43-c65d1dae7a5d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:28:41 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance 11986c5b-6914-491e-8e71-983ab6b13c6e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:28:41 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance 463034ff-14ce-477a-9642-4d86aa6f9cd9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:28:41 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance 5a507c85-0369-48ea-8858-3e7d346b4cb0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:28:41 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Migration 72c5d793-592e-4c2f-a692-665458d8517a is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 16 10:28:41 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance bc76703d-9243-4277-9b13-d6f9639cd1bb actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:28:41 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance e1253324-3ca1-4610-b9d6-3db7c6c76828 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:28:41 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance da42de06-4518-4c8a-8c63-9b5a2759a1bf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:28:41 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance 89e358d7-0844-4742-853b-ff88800415d2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:28:41 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance 7628b43b-5b22-440b-a27b-bf2e28b93cf6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:28:41 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Total usable vcpus: 12, total allocated vcpus: 14 {{(pid=85141) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 10:28:41 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Final resource view: name=user phys_ram=16011MB used_ram=9216MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=14 pci_stats=[] {{(pid=85141) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 10:28:41 user nova-compute[85141]: DEBUG nova.compute.provider_tree [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Inventory has not changed in ProviderTree for provider: bf8e0fa1-16b6-408f-9203-c4cd63916272 {{(pid=85141) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 10:28:41 user nova-compute[85141]: DEBUG nova.network.neutron [None req-fd3c4d49-784c-42b9-9f3c-8ba27e57f9f2 tempest-VolumesNegativeTest-355403086 tempest-VolumesNegativeTest-355403086-project-member] [instance: 7628b43b-5b22-440b-a27b-bf2e28b93cf6] Successfully updated port: 9ac05886-79dc-4a75-a676-7db0abb46f99 {{(pid=85141) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 10:28:41 user nova-compute[85141]: DEBUG nova.scheduler.client.report [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Inventory has not changed for provider bf8e0fa1-16b6-408f-9203-c4cd63916272 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=85141) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 10:28:41 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-fd3c4d49-784c-42b9-9f3c-8ba27e57f9f2 tempest-VolumesNegativeTest-355403086 tempest-VolumesNegativeTest-355403086-project-member] Acquiring lock "refresh_cache-7628b43b-5b22-440b-a27b-bf2e28b93cf6" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:28:41 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-fd3c4d49-784c-42b9-9f3c-8ba27e57f9f2 tempest-VolumesNegativeTest-355403086 tempest-VolumesNegativeTest-355403086-project-member] Acquired lock "refresh_cache-7628b43b-5b22-440b-a27b-bf2e28b93cf6" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:28:41 user nova-compute[85141]: DEBUG nova.network.neutron [None req-fd3c4d49-784c-42b9-9f3c-8ba27e57f9f2 tempest-VolumesNegativeTest-355403086 tempest-VolumesNegativeTest-355403086-project-member] [instance: 7628b43b-5b22-440b-a27b-bf2e28b93cf6] Building network info cache for instance {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 10:28:41 user nova-compute[85141]: DEBUG nova.compute.manager [req-c7d1b7c3-467a-4f78-8e67-995a4ef26527 req-2610808a-622e-4322-8ede-a44eb8c156a2 service nova] [instance: 7628b43b-5b22-440b-a27b-bf2e28b93cf6] Received event network-changed-9ac05886-79dc-4a75-a676-7db0abb46f99 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:28:41 user nova-compute[85141]: DEBUG nova.compute.manager [req-c7d1b7c3-467a-4f78-8e67-995a4ef26527 req-2610808a-622e-4322-8ede-a44eb8c156a2 service nova] [instance: 7628b43b-5b22-440b-a27b-bf2e28b93cf6] Refreshing instance network info cache due to event network-changed-9ac05886-79dc-4a75-a676-7db0abb46f99. {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 10:28:41 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-c7d1b7c3-467a-4f78-8e67-995a4ef26527 req-2610808a-622e-4322-8ede-a44eb8c156a2 service nova] Acquiring lock "refresh_cache-7628b43b-5b22-440b-a27b-bf2e28b93cf6" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:28:41 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Compute_service record updated for user:user {{(pid=85141) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 10:28:41 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.648s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:28:41 user nova-compute[85141]: DEBUG nova.network.neutron [None req-fd3c4d49-784c-42b9-9f3c-8ba27e57f9f2 tempest-VolumesNegativeTest-355403086 tempest-VolumesNegativeTest-355403086-project-member] [instance: 7628b43b-5b22-440b-a27b-bf2e28b93cf6] Instance cache missing network info. {{(pid=85141) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 10:28:42 user nova-compute[85141]: DEBUG nova.network.neutron [None req-fd3c4d49-784c-42b9-9f3c-8ba27e57f9f2 tempest-VolumesNegativeTest-355403086 tempest-VolumesNegativeTest-355403086-project-member] [instance: 7628b43b-5b22-440b-a27b-bf2e28b93cf6] Updating instance_info_cache with network_info: [{"id": "9ac05886-79dc-4a75-a676-7db0abb46f99", "address": "fa:16:3e:30:7f:49", "network": {"id": "cbda3d0f-0184-4ad3-b71f-97be51b488d9", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "1044631a5fe84ce8904864a7024049fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ac05886-79", "ovs_interfaceid": "9ac05886-79dc-4a75-a676-7db0abb46f99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:28:42 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-fd3c4d49-784c-42b9-9f3c-8ba27e57f9f2 tempest-VolumesNegativeTest-355403086 tempest-VolumesNegativeTest-355403086-project-member] Releasing lock "refresh_cache-7628b43b-5b22-440b-a27b-bf2e28b93cf6" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:28:42 user nova-compute[85141]: DEBUG nova.compute.manager [None req-fd3c4d49-784c-42b9-9f3c-8ba27e57f9f2 tempest-VolumesNegativeTest-355403086 tempest-VolumesNegativeTest-355403086-project-member] [instance: 7628b43b-5b22-440b-a27b-bf2e28b93cf6] Instance network_info: |[{"id": "9ac05886-79dc-4a75-a676-7db0abb46f99", "address": "fa:16:3e:30:7f:49", "network": {"id": "cbda3d0f-0184-4ad3-b71f-97be51b488d9", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "1044631a5fe84ce8904864a7024049fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ac05886-79", "ovs_interfaceid": "9ac05886-79dc-4a75-a676-7db0abb46f99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=85141) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 10:28:42 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-c7d1b7c3-467a-4f78-8e67-995a4ef26527 req-2610808a-622e-4322-8ede-a44eb8c156a2 service nova] Acquired lock "refresh_cache-7628b43b-5b22-440b-a27b-bf2e28b93cf6" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:28:42 user nova-compute[85141]: DEBUG nova.network.neutron [req-c7d1b7c3-467a-4f78-8e67-995a4ef26527 req-2610808a-622e-4322-8ede-a44eb8c156a2 service nova] [instance: 7628b43b-5b22-440b-a27b-bf2e28b93cf6] Refreshing network info cache for port 9ac05886-79dc-4a75-a676-7db0abb46f99 {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 10:28:42 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-fd3c4d49-784c-42b9-9f3c-8ba27e57f9f2 tempest-VolumesNegativeTest-355403086 tempest-VolumesNegativeTest-355403086-project-member] [instance: 7628b43b-5b22-440b-a27b-bf2e28b93cf6] Start _get_guest_xml network_info=[{"id": "9ac05886-79dc-4a75-a676-7db0abb46f99", "address": "fa:16:3e:30:7f:49", "network": {"id": "cbda3d0f-0184-4ad3-b71f-97be51b488d9", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "1044631a5fe84ce8904864a7024049fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ac05886-79", "ovs_interfaceid": "9ac05886-79dc-4a75-a676-7db0abb46f99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T10:06:42Z,direct_url=<?>,disk_format='qcow2',id=bc4ca70f-a459-4d5c-a9e6-80f1948eb48b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1044631a5fe84ce8904864a7024049fa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T10:06:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_options': None, 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'image_id': 'bc4ca70f-a459-4d5c-a9e6-80f1948eb48b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=85141) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 10:28:42 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-fd3c4d49-784c-42b9-9f3c-8ba27e57f9f2 tempest-VolumesNegativeTest-355403086 tempest-VolumesNegativeTest-355403086-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:28:42 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-fd3c4d49-784c-42b9-9f3c-8ba27e57f9f2 tempest-VolumesNegativeTest-355403086 tempest-VolumesNegativeTest-355403086-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:28:42 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-fd3c4d49-784c-42b9-9f3c-8ba27e57f9f2 tempest-VolumesNegativeTest-355403086 tempest-VolumesNegativeTest-355403086-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=85141) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 10:28:42 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-fd3c4d49-784c-42b9-9f3c-8ba27e57f9f2 tempest-VolumesNegativeTest-355403086 tempest-VolumesNegativeTest-355403086-project-member] CPU controller missing on host. {{(pid=85141) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 10:28:42 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-fd3c4d49-784c-42b9-9f3c-8ba27e57f9f2 tempest-VolumesNegativeTest-355403086 tempest-VolumesNegativeTest-355403086-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=85141) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 10:28:42 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-fd3c4d49-784c-42b9-9f3c-8ba27e57f9f2 tempest-VolumesNegativeTest-355403086 tempest-VolumesNegativeTest-355403086-project-member] CPU controller found on host. {{(pid=85141) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 10:28:42 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-fd3c4d49-784c-42b9-9f3c-8ba27e57f9f2 tempest-VolumesNegativeTest-355403086 tempest-VolumesNegativeTest-355403086-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=85141) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 10:28:42 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-fd3c4d49-784c-42b9-9f3c-8ba27e57f9f2 tempest-VolumesNegativeTest-355403086 tempest-VolumesNegativeTest-355403086-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T10:06:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T10:06:42Z,direct_url=<?>,disk_format='qcow2',id=bc4ca70f-a459-4d5c-a9e6-80f1948eb48b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1044631a5fe84ce8904864a7024049fa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T10:06:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 10:28:42 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-fd3c4d49-784c-42b9-9f3c-8ba27e57f9f2 tempest-VolumesNegativeTest-355403086 tempest-VolumesNegativeTest-355403086-project-member] Flavor limits 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 10:28:42 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-fd3c4d49-784c-42b9-9f3c-8ba27e57f9f2 tempest-VolumesNegativeTest-355403086 tempest-VolumesNegativeTest-355403086-project-member] Image limits 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 10:28:42 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-fd3c4d49-784c-42b9-9f3c-8ba27e57f9f2 tempest-VolumesNegativeTest-355403086 tempest-VolumesNegativeTest-355403086-project-member] Flavor pref 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 10:28:42 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-fd3c4d49-784c-42b9-9f3c-8ba27e57f9f2 tempest-VolumesNegativeTest-355403086 tempest-VolumesNegativeTest-355403086-project-member] Image pref 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 10:28:42 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-fd3c4d49-784c-42b9-9f3c-8ba27e57f9f2 tempest-VolumesNegativeTest-355403086 tempest-VolumesNegativeTest-355403086-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 10:28:42 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-fd3c4d49-784c-42b9-9f3c-8ba27e57f9f2 tempest-VolumesNegativeTest-355403086 tempest-VolumesNegativeTest-355403086-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 10:28:42 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-fd3c4d49-784c-42b9-9f3c-8ba27e57f9f2 tempest-VolumesNegativeTest-355403086 tempest-VolumesNegativeTest-355403086-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=85141) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 10:28:42 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-fd3c4d49-784c-42b9-9f3c-8ba27e57f9f2 tempest-VolumesNegativeTest-355403086 tempest-VolumesNegativeTest-355403086-project-member] Got 1 possible topologies {{(pid=85141) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 10:28:42 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-fd3c4d49-784c-42b9-9f3c-8ba27e57f9f2 tempest-VolumesNegativeTest-355403086 tempest-VolumesNegativeTest-355403086-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 10:28:42 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-fd3c4d49-784c-42b9-9f3c-8ba27e57f9f2 tempest-VolumesNegativeTest-355403086 tempest-VolumesNegativeTest-355403086-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 10:28:42 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-fd3c4d49-784c-42b9-9f3c-8ba27e57f9f2 tempest-VolumesNegativeTest-355403086 tempest-VolumesNegativeTest-355403086-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T10:28:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-690147246',display_name='tempest-VolumesNegativeTest-instance-690147246',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-690147246',id=40,image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='83a6d2c2eba5496dad2b9cba236f319d',ramdisk_id='',reservation_id='r-m1epctf0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-355403086',owner_user_name='tempest-VolumesNegativeTest-355403086-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T10:28:40Z,user_data=None,user_id='b8592a9c3715469b961e4bec8011c6f8',uuid=7628b43b-5b22-440b-a27b-bf2e28b93cf6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9ac05886-79dc-4a75-a676-7db0abb46f99", "address": "fa:16:3e:30:7f:49", "network": {"id": "cbda3d0f-0184-4ad3-b71f-97be51b488d9", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "1044631a5fe84ce8904864a7024049fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ac05886-79", "ovs_interfaceid": "9ac05886-79dc-4a75-a676-7db0abb46f99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=85141) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 10:28:42 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-fd3c4d49-784c-42b9-9f3c-8ba27e57f9f2 tempest-VolumesNegativeTest-355403086 tempest-VolumesNegativeTest-355403086-project-member] Converting VIF {"id": "9ac05886-79dc-4a75-a676-7db0abb46f99", "address": "fa:16:3e:30:7f:49", "network": {"id": "cbda3d0f-0184-4ad3-b71f-97be51b488d9", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "1044631a5fe84ce8904864a7024049fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ac05886-79", "ovs_interfaceid": "9ac05886-79dc-4a75-a676-7db0abb46f99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:28:42 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-fd3c4d49-784c-42b9-9f3c-8ba27e57f9f2 tempest-VolumesNegativeTest-355403086 tempest-VolumesNegativeTest-355403086-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:30:7f:49,bridge_name='br-int',has_traffic_filtering=True,id=9ac05886-79dc-4a75-a676-7db0abb46f99,network=Network(cbda3d0f-0184-4ad3-b71f-97be51b488d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ac05886-79') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:28:42 user nova-compute[85141]: DEBUG nova.objects.instance [None req-fd3c4d49-784c-42b9-9f3c-8ba27e57f9f2 tempest-VolumesNegativeTest-355403086 tempest-VolumesNegativeTest-355403086-project-member] Lazy-loading 'pci_devices' on Instance uuid 7628b43b-5b22-440b-a27b-bf2e28b93cf6 {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:28:42 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-fd3c4d49-784c-42b9-9f3c-8ba27e57f9f2 tempest-VolumesNegativeTest-355403086 tempest-VolumesNegativeTest-355403086-project-member] [instance: 7628b43b-5b22-440b-a27b-bf2e28b93cf6] End _get_guest_xml xml=<domain type="kvm">
Nov 16 10:28:42 user nova-compute[85141]:   <uuid>7628b43b-5b22-440b-a27b-bf2e28b93cf6</uuid>
Nov 16 10:28:42 user nova-compute[85141]:   <name>instance-00000028</name>
Nov 16 10:28:42 user nova-compute[85141]:   <memory>524288</memory>
Nov 16 10:28:42 user nova-compute[85141]:   <vcpu>1</vcpu>
Nov 16 10:28:42 user nova-compute[85141]:   <metadata>
Nov 16 10:28:42 user nova-compute[85141]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 10:28:42 user nova-compute[85141]:       <nova:package version="0.0.0"/>
Nov 16 10:28:42 user nova-compute[85141]:       <nova:name>tempest-VolumesNegativeTest-instance-690147246</nova:name>
Nov 16 10:28:42 user nova-compute[85141]:       <nova:creationTime>2023-11-16 10:28:42</nova:creationTime>
Nov 16 10:28:42 user nova-compute[85141]:       <nova:flavor name="m1.tiny">
Nov 16 10:28:42 user nova-compute[85141]:         <nova:memory>512</nova:memory>
Nov 16 10:28:42 user nova-compute[85141]:         <nova:disk>1</nova:disk>
Nov 16 10:28:42 user nova-compute[85141]:         <nova:swap>0</nova:swap>
Nov 16 10:28:42 user nova-compute[85141]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 10:28:42 user nova-compute[85141]:         <nova:vcpus>1</nova:vcpus>
Nov 16 10:28:42 user nova-compute[85141]:       </nova:flavor>
Nov 16 10:28:42 user nova-compute[85141]:       <nova:owner>
Nov 16 10:28:42 user nova-compute[85141]:         <nova:user uuid="b8592a9c3715469b961e4bec8011c6f8">tempest-VolumesNegativeTest-355403086-project-member</nova:user>
Nov 16 10:28:42 user nova-compute[85141]:         <nova:project uuid="83a6d2c2eba5496dad2b9cba236f319d">tempest-VolumesNegativeTest-355403086</nova:project>
Nov 16 10:28:42 user nova-compute[85141]:       </nova:owner>
Nov 16 10:28:42 user nova-compute[85141]:       <nova:root type="image" uuid="bc4ca70f-a459-4d5c-a9e6-80f1948eb48b"/>
Nov 16 10:28:42 user nova-compute[85141]:       <nova:ports>
Nov 16 10:28:42 user nova-compute[85141]:         <nova:port uuid="9ac05886-79dc-4a75-a676-7db0abb46f99">
Nov 16 10:28:42 user nova-compute[85141]:           <nova:ip type="fixed" address="192.168.233.208" ipVersion="4"/>
Nov 16 10:28:42 user nova-compute[85141]:         </nova:port>
Nov 16 10:28:42 user nova-compute[85141]:       </nova:ports>
Nov 16 10:28:42 user nova-compute[85141]:     </nova:instance>
Nov 16 10:28:42 user nova-compute[85141]:   </metadata>
Nov 16 10:28:42 user nova-compute[85141]:   <sysinfo type="smbios">
Nov 16 10:28:42 user nova-compute[85141]:     <system>
Nov 16 10:28:42 user nova-compute[85141]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 10:28:42 user nova-compute[85141]:       <entry name="product">OpenStack Nova</entry>
Nov 16 10:28:42 user nova-compute[85141]:       <entry name="version">0.0.0</entry>
Nov 16 10:28:42 user nova-compute[85141]:       <entry name="serial">7628b43b-5b22-440b-a27b-bf2e28b93cf6</entry>
Nov 16 10:28:42 user nova-compute[85141]:       <entry name="uuid">7628b43b-5b22-440b-a27b-bf2e28b93cf6</entry>
Nov 16 10:28:42 user nova-compute[85141]:       <entry name="family">Virtual Machine</entry>
Nov 16 10:28:42 user nova-compute[85141]:     </system>
Nov 16 10:28:42 user nova-compute[85141]:   </sysinfo>
Nov 16 10:28:42 user nova-compute[85141]:   <os>
Nov 16 10:28:42 user nova-compute[85141]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 10:28:42 user nova-compute[85141]:     <boot dev="hd"/>
Nov 16 10:28:42 user nova-compute[85141]:     <smbios mode="sysinfo"/>
Nov 16 10:28:42 user nova-compute[85141]:   </os>
Nov 16 10:28:42 user nova-compute[85141]:   <features>
Nov 16 10:28:42 user nova-compute[85141]:     <acpi/>
Nov 16 10:28:42 user nova-compute[85141]:     <apic/>
Nov 16 10:28:42 user nova-compute[85141]:     <vmcoreinfo/>
Nov 16 10:28:42 user nova-compute[85141]:   </features>
Nov 16 10:28:42 user nova-compute[85141]:   <clock offset="utc">
Nov 16 10:28:42 user nova-compute[85141]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 10:28:42 user nova-compute[85141]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 10:28:42 user nova-compute[85141]:     <timer name="hpet" present="no"/>
Nov 16 10:28:42 user nova-compute[85141]:   </clock>
Nov 16 10:28:42 user nova-compute[85141]:   <cpu mode="custom" match="exact">
Nov 16 10:28:42 user nova-compute[85141]:     <model>Nehalem</model>
Nov 16 10:28:42 user nova-compute[85141]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 10:28:42 user nova-compute[85141]:   </cpu>
Nov 16 10:28:42 user nova-compute[85141]:   <devices>
Nov 16 10:28:42 user nova-compute[85141]:     <disk type="file" device="disk">
Nov 16 10:28:42 user nova-compute[85141]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 10:28:42 user nova-compute[85141]:       <source file="/opt/stack/data/nova/instances/7628b43b-5b22-440b-a27b-bf2e28b93cf6/disk"/>
Nov 16 10:28:42 user nova-compute[85141]:       <target dev="vda" bus="virtio"/>
Nov 16 10:28:42 user nova-compute[85141]:     </disk>
Nov 16 10:28:42 user nova-compute[85141]:     <interface type="ethernet">
Nov 16 10:28:42 user nova-compute[85141]:       <mac address="fa:16:3e:30:7f:49"/>
Nov 16 10:28:42 user nova-compute[85141]:       <model type="virtio"/>
Nov 16 10:28:42 user nova-compute[85141]:       <mtu size="1442"/>
Nov 16 10:28:42 user nova-compute[85141]:       <target dev="tap9ac05886-79"/>
Nov 16 10:28:42 user nova-compute[85141]:     </interface>
Nov 16 10:28:42 user nova-compute[85141]:     <serial type="pty">
Nov 16 10:28:42 user nova-compute[85141]:       <log file="/opt/stack/data/nova/instances/7628b43b-5b22-440b-a27b-bf2e28b93cf6/console.log" append="off"/>
Nov 16 10:28:42 user nova-compute[85141]:     </serial>
Nov 16 10:28:42 user nova-compute[85141]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 10:28:42 user nova-compute[85141]:     <video>
Nov 16 10:28:42 user nova-compute[85141]:       <model type="virtio"/>
Nov 16 10:28:42 user nova-compute[85141]:     </video>
Nov 16 10:28:42 user nova-compute[85141]:     <rng model="virtio">
Nov 16 10:28:42 user nova-compute[85141]:       <backend model="random">/dev/urandom</backend>
Nov 16 10:28:42 user nova-compute[85141]:     </rng>
Nov 16 10:28:42 user nova-compute[85141]:     <controller type="usb" index="0" model="none"/>
Nov 16 10:28:42 user nova-compute[85141]:     <memballoon model="virtio">
Nov 16 10:28:42 user nova-compute[85141]:       <stats period="10"/>
Nov 16 10:28:42 user nova-compute[85141]:     </memballoon>
Nov 16 10:28:42 user nova-compute[85141]:   </devices>
Nov 16 10:28:42 user nova-compute[85141]: </domain>
Nov 16 10:28:42 user nova-compute[85141]:  {{(pid=85141) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 10:28:42 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-fd3c4d49-784c-42b9-9f3c-8ba27e57f9f2 tempest-VolumesNegativeTest-355403086 tempest-VolumesNegativeTest-355403086-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T10:28:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-690147246',display_name='tempest-VolumesNegativeTest-instance-690147246',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-690147246',id=40,image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='83a6d2c2eba5496dad2b9cba236f319d',ramdisk_id='',reservation_id='r-m1epctf0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-355403086',owner_user_name='tempest-VolumesNegativeTest-355403086-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T10:28:40Z,user_data=None,user_id='b8592a9c3715469b961e4bec8011c6f8',uuid=7628b43b-5b22-440b-a27b-bf2e28b93cf6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9ac05886-79dc-4a75-a676-7db0abb46f99", "address": "fa:16:3e:30:7f:49", "network": {"id": "cbda3d0f-0184-4ad3-b71f-97be51b488d9", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "1044631a5fe84ce8904864a7024049fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ac05886-79", "ovs_interfaceid": "9ac05886-79dc-4a75-a676-7db0abb46f99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 10:28:42 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-fd3c4d49-784c-42b9-9f3c-8ba27e57f9f2 tempest-VolumesNegativeTest-355403086 tempest-VolumesNegativeTest-355403086-project-member] Converting VIF {"id": "9ac05886-79dc-4a75-a676-7db0abb46f99", "address": "fa:16:3e:30:7f:49", "network": {"id": "cbda3d0f-0184-4ad3-b71f-97be51b488d9", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "1044631a5fe84ce8904864a7024049fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ac05886-79", "ovs_interfaceid": "9ac05886-79dc-4a75-a676-7db0abb46f99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:28:42 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-fd3c4d49-784c-42b9-9f3c-8ba27e57f9f2 tempest-VolumesNegativeTest-355403086 tempest-VolumesNegativeTest-355403086-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:30:7f:49,bridge_name='br-int',has_traffic_filtering=True,id=9ac05886-79dc-4a75-a676-7db0abb46f99,network=Network(cbda3d0f-0184-4ad3-b71f-97be51b488d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ac05886-79') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:28:42 user nova-compute[85141]: DEBUG os_vif [None req-fd3c4d49-784c-42b9-9f3c-8ba27e57f9f2 tempest-VolumesNegativeTest-355403086 tempest-VolumesNegativeTest-355403086-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:7f:49,bridge_name='br-int',has_traffic_filtering=True,id=9ac05886-79dc-4a75-a676-7db0abb46f99,network=Network(cbda3d0f-0184-4ad3-b71f-97be51b488d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ac05886-79') {{(pid=85141) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 10:28:42 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:28:42 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:28:42 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 10:28:42 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:28:42 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '64ca22b8-1749-56c3-95e7-88a4902ed027', '_type': 'linux-noop'}}, row=False) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:28:42 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:28:42 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:28:42 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:28:42 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9ac05886-79, may_exist=True, interface_attrs={}) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:28:42 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9ac05886-79, col_values=(('qos', UUID('0436001a-d7f7-4928-a402-eff1e184aec6')),), if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:28:42 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9ac05886-79, col_values=(('external_ids', {'iface-id': '9ac05886-79dc-4a75-a676-7db0abb46f99', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:30:7f:49', 'vm-uuid': '7628b43b-5b22-440b-a27b-bf2e28b93cf6'}),), if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:28:42 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:28:42 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:28:42 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:28:42 user nova-compute[85141]: INFO os_vif [None req-fd3c4d49-784c-42b9-9f3c-8ba27e57f9f2 tempest-VolumesNegativeTest-355403086 tempest-VolumesNegativeTest-355403086-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:7f:49,bridge_name='br-int',has_traffic_filtering=True,id=9ac05886-79dc-4a75-a676-7db0abb46f99,network=Network(cbda3d0f-0184-4ad3-b71f-97be51b488d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ac05886-79')
Nov 16 10:28:42 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-fd3c4d49-784c-42b9-9f3c-8ba27e57f9f2 tempest-VolumesNegativeTest-355403086 tempest-VolumesNegativeTest-355403086-project-member] No BDM found with device name vda, not building metadata. {{(pid=85141) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 10:28:42 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-fd3c4d49-784c-42b9-9f3c-8ba27e57f9f2 tempest-VolumesNegativeTest-355403086 tempest-VolumesNegativeTest-355403086-project-member] No VIF found with MAC fa:16:3e:30:7f:49, not building metadata {{(pid=85141) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 10:28:42 user nova-compute[85141]: DEBUG nova.network.neutron [req-c7d1b7c3-467a-4f78-8e67-995a4ef26527 req-2610808a-622e-4322-8ede-a44eb8c156a2 service nova] [instance: 7628b43b-5b22-440b-a27b-bf2e28b93cf6] Updated VIF entry in instance network info cache for port 9ac05886-79dc-4a75-a676-7db0abb46f99. {{(pid=85141) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 10:28:42 user nova-compute[85141]: DEBUG nova.network.neutron [req-c7d1b7c3-467a-4f78-8e67-995a4ef26527 req-2610808a-622e-4322-8ede-a44eb8c156a2 service nova] [instance: 7628b43b-5b22-440b-a27b-bf2e28b93cf6] Updating instance_info_cache with network_info: [{"id": "9ac05886-79dc-4a75-a676-7db0abb46f99", "address": "fa:16:3e:30:7f:49", "network": {"id": "cbda3d0f-0184-4ad3-b71f-97be51b488d9", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "1044631a5fe84ce8904864a7024049fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ac05886-79", "ovs_interfaceid": "9ac05886-79dc-4a75-a676-7db0abb46f99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:28:42 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-c7d1b7c3-467a-4f78-8e67-995a4ef26527 req-2610808a-622e-4322-8ede-a44eb8c156a2 service nova] Releasing lock "refresh_cache-7628b43b-5b22-440b-a27b-bf2e28b93cf6" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:28:42 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:28:42 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:28:42 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:28:43 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:28:43 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:28:43 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:28:43 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:28:43 user nova-compute[85141]: DEBUG nova.compute.manager [req-2d48fb80-127f-4464-96d3-3e5d95606696 req-04a7fa21-b284-4669-ae4d-5cf2ca15b5b8 service nova] [instance: 7628b43b-5b22-440b-a27b-bf2e28b93cf6] Received event network-vif-plugged-9ac05886-79dc-4a75-a676-7db0abb46f99 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:28:43 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-2d48fb80-127f-4464-96d3-3e5d95606696 req-04a7fa21-b284-4669-ae4d-5cf2ca15b5b8 service nova] Acquiring lock "7628b43b-5b22-440b-a27b-bf2e28b93cf6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:28:43 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-2d48fb80-127f-4464-96d3-3e5d95606696 req-04a7fa21-b284-4669-ae4d-5cf2ca15b5b8 service nova] Lock "7628b43b-5b22-440b-a27b-bf2e28b93cf6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:28:43 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-2d48fb80-127f-4464-96d3-3e5d95606696 req-04a7fa21-b284-4669-ae4d-5cf2ca15b5b8 service nova] Lock "7628b43b-5b22-440b-a27b-bf2e28b93cf6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:28:43 user nova-compute[85141]: DEBUG nova.compute.manager [req-2d48fb80-127f-4464-96d3-3e5d95606696 req-04a7fa21-b284-4669-ae4d-5cf2ca15b5b8 service nova] [instance: 7628b43b-5b22-440b-a27b-bf2e28b93cf6] No waiting events found dispatching network-vif-plugged-9ac05886-79dc-4a75-a676-7db0abb46f99 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:28:43 user nova-compute[85141]: WARNING nova.compute.manager [req-2d48fb80-127f-4464-96d3-3e5d95606696 req-04a7fa21-b284-4669-ae4d-5cf2ca15b5b8 service nova] [instance: 7628b43b-5b22-440b-a27b-bf2e28b93cf6] Received unexpected event network-vif-plugged-9ac05886-79dc-4a75-a676-7db0abb46f99 for instance with vm_state building and task_state spawning.
Nov 16 10:28:44 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:28:44 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:28:44 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:28:45 user nova-compute[85141]: DEBUG nova.compute.manager [None req-fd3c4d49-784c-42b9-9f3c-8ba27e57f9f2 tempest-VolumesNegativeTest-355403086 tempest-VolumesNegativeTest-355403086-project-member] [instance: 7628b43b-5b22-440b-a27b-bf2e28b93cf6] Instance event wait completed in 0 seconds for  {{(pid=85141) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 10:28:45 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-fd3c4d49-784c-42b9-9f3c-8ba27e57f9f2 tempest-VolumesNegativeTest-355403086 tempest-VolumesNegativeTest-355403086-project-member] [instance: 7628b43b-5b22-440b-a27b-bf2e28b93cf6] Guest created on hypervisor {{(pid=85141) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 10:28:45 user nova-compute[85141]: INFO nova.virt.libvirt.driver [-] [instance: 7628b43b-5b22-440b-a27b-bf2e28b93cf6] Instance spawned successfully.
Nov 16 10:28:45 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-fd3c4d49-784c-42b9-9f3c-8ba27e57f9f2 tempest-VolumesNegativeTest-355403086 tempest-VolumesNegativeTest-355403086-project-member] [instance: 7628b43b-5b22-440b-a27b-bf2e28b93cf6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 10:28:45 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-fd3c4d49-784c-42b9-9f3c-8ba27e57f9f2 tempest-VolumesNegativeTest-355403086 tempest-VolumesNegativeTest-355403086-project-member] [instance: 7628b43b-5b22-440b-a27b-bf2e28b93cf6] Found default for hw_cdrom_bus of ide {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:28:45 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-fd3c4d49-784c-42b9-9f3c-8ba27e57f9f2 tempest-VolumesNegativeTest-355403086 tempest-VolumesNegativeTest-355403086-project-member] [instance: 7628b43b-5b22-440b-a27b-bf2e28b93cf6] Found default for hw_disk_bus of virtio {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:28:45 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-fd3c4d49-784c-42b9-9f3c-8ba27e57f9f2 tempest-VolumesNegativeTest-355403086 tempest-VolumesNegativeTest-355403086-project-member] [instance: 7628b43b-5b22-440b-a27b-bf2e28b93cf6] Found default for hw_input_bus of None {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:28:45 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-fd3c4d49-784c-42b9-9f3c-8ba27e57f9f2 tempest-VolumesNegativeTest-355403086 tempest-VolumesNegativeTest-355403086-project-member] [instance: 7628b43b-5b22-440b-a27b-bf2e28b93cf6] Found default for hw_pointer_model of None {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:28:45 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-fd3c4d49-784c-42b9-9f3c-8ba27e57f9f2 tempest-VolumesNegativeTest-355403086 tempest-VolumesNegativeTest-355403086-project-member] [instance: 7628b43b-5b22-440b-a27b-bf2e28b93cf6] Found default for hw_video_model of virtio {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:28:45 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-fd3c4d49-784c-42b9-9f3c-8ba27e57f9f2 tempest-VolumesNegativeTest-355403086 tempest-VolumesNegativeTest-355403086-project-member] [instance: 7628b43b-5b22-440b-a27b-bf2e28b93cf6] Found default for hw_vif_model of virtio {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:28:45 user nova-compute[85141]: INFO nova.compute.manager [None req-fd3c4d49-784c-42b9-9f3c-8ba27e57f9f2 tempest-VolumesNegativeTest-355403086 tempest-VolumesNegativeTest-355403086-project-member] [instance: 7628b43b-5b22-440b-a27b-bf2e28b93cf6] Took 5.92 seconds to spawn the instance on the hypervisor.
Nov 16 10:28:45 user nova-compute[85141]: DEBUG nova.compute.manager [None req-fd3c4d49-784c-42b9-9f3c-8ba27e57f9f2 tempest-VolumesNegativeTest-355403086 tempest-VolumesNegativeTest-355403086-project-member] [instance: 7628b43b-5b22-440b-a27b-bf2e28b93cf6] Checking state {{(pid=85141) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 10:28:45 user nova-compute[85141]: DEBUG nova.compute.manager [req-5f065141-4fa9-44e7-8a3e-b1495bd0b9da req-3e06133b-5e18-437e-ba52-8619c21aa014 service nova] [instance: 7628b43b-5b22-440b-a27b-bf2e28b93cf6] Received event network-vif-plugged-9ac05886-79dc-4a75-a676-7db0abb46f99 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:28:45 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-5f065141-4fa9-44e7-8a3e-b1495bd0b9da req-3e06133b-5e18-437e-ba52-8619c21aa014 service nova] Acquiring lock "7628b43b-5b22-440b-a27b-bf2e28b93cf6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:28:45 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-5f065141-4fa9-44e7-8a3e-b1495bd0b9da req-3e06133b-5e18-437e-ba52-8619c21aa014 service nova] Lock "7628b43b-5b22-440b-a27b-bf2e28b93cf6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:28:45 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-5f065141-4fa9-44e7-8a3e-b1495bd0b9da req-3e06133b-5e18-437e-ba52-8619c21aa014 service nova] Lock "7628b43b-5b22-440b-a27b-bf2e28b93cf6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:28:45 user nova-compute[85141]: DEBUG nova.compute.manager [req-5f065141-4fa9-44e7-8a3e-b1495bd0b9da req-3e06133b-5e18-437e-ba52-8619c21aa014 service nova] [instance: 7628b43b-5b22-440b-a27b-bf2e28b93cf6] No waiting events found dispatching network-vif-plugged-9ac05886-79dc-4a75-a676-7db0abb46f99 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:28:45 user nova-compute[85141]: WARNING nova.compute.manager [req-5f065141-4fa9-44e7-8a3e-b1495bd0b9da req-3e06133b-5e18-437e-ba52-8619c21aa014 service nova] [instance: 7628b43b-5b22-440b-a27b-bf2e28b93cf6] Received unexpected event network-vif-plugged-9ac05886-79dc-4a75-a676-7db0abb46f99 for instance with vm_state building and task_state spawning.
Nov 16 10:28:45 user nova-compute[85141]: INFO nova.compute.manager [None req-fd3c4d49-784c-42b9-9f3c-8ba27e57f9f2 tempest-VolumesNegativeTest-355403086 tempest-VolumesNegativeTest-355403086-project-member] [instance: 7628b43b-5b22-440b-a27b-bf2e28b93cf6] Took 6.96 seconds to build instance.
Nov 16 10:28:45 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-fd3c4d49-784c-42b9-9f3c-8ba27e57f9f2 tempest-VolumesNegativeTest-355403086 tempest-VolumesNegativeTest-355403086-project-member] Lock "7628b43b-5b22-440b-a27b-bf2e28b93cf6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.073s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:28:47 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:28:47 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-7542fcba-e491-4301-b12d-f1b35194a820 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Acquiring lock "bc76703d-9243-4277-9b13-d6f9639cd1bb" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:28:47 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-7542fcba-e491-4301-b12d-f1b35194a820 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Lock "bc76703d-9243-4277-9b13-d6f9639cd1bb" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:28:47 user nova-compute[85141]: DEBUG nova.compute.manager [None req-7542fcba-e491-4301-b12d-f1b35194a820 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] [instance: bc76703d-9243-4277-9b13-d6f9639cd1bb] Going to confirm migration 2 {{(pid=85141) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4774}}
Nov 16 10:28:47 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-7542fcba-e491-4301-b12d-f1b35194a820 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Acquiring lock "refresh_cache-bc76703d-9243-4277-9b13-d6f9639cd1bb" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:28:47 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-7542fcba-e491-4301-b12d-f1b35194a820 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Acquired lock "refresh_cache-bc76703d-9243-4277-9b13-d6f9639cd1bb" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:28:47 user nova-compute[85141]: DEBUG nova.network.neutron [None req-7542fcba-e491-4301-b12d-f1b35194a820 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] [instance: bc76703d-9243-4277-9b13-d6f9639cd1bb] Building network info cache for instance {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 10:28:47 user nova-compute[85141]: DEBUG nova.objects.instance [None req-7542fcba-e491-4301-b12d-f1b35194a820 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Lazy-loading 'info_cache' on Instance uuid bc76703d-9243-4277-9b13-d6f9639cd1bb {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:28:47 user nova-compute[85141]: DEBUG nova.network.neutron [None req-7542fcba-e491-4301-b12d-f1b35194a820 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] [instance: bc76703d-9243-4277-9b13-d6f9639cd1bb] Updating instance_info_cache with network_info: [{"id": "fbf147e2-d8e0-4cb5-8ec5-79756fc53140", "address": "fa:16:3e:a1:42:09", "network": {"id": "859d1f09-56c4-4c2b-b2c3-02b1938e8dbf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1562516834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "879fa3f4dfc34726b20149b8a7db22dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbf147e2-d8", "ovs_interfaceid": "fbf147e2-d8e0-4cb5-8ec5-79756fc53140", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:28:48 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-7542fcba-e491-4301-b12d-f1b35194a820 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Releasing lock "refresh_cache-bc76703d-9243-4277-9b13-d6f9639cd1bb" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:28:48 user nova-compute[85141]: DEBUG nova.objects.instance [None req-7542fcba-e491-4301-b12d-f1b35194a820 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Lazy-loading 'migration_context' on Instance uuid bc76703d-9243-4277-9b13-d6f9639cd1bb {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:28:48 user nova-compute[85141]: DEBUG nova.objects.base [None req-7542fcba-e491-4301-b12d-f1b35194a820 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Object Instance<bc76703d-9243-4277-9b13-d6f9639cd1bb> lazy-loaded attributes: info_cache,migration_context {{(pid=85141) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 10:28:48 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-7542fcba-e491-4301-b12d-f1b35194a820 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:28:48 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-7542fcba-e491-4301-b12d-f1b35194a820 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:28:48 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:28:48 user nova-compute[85141]: DEBUG nova.compute.provider_tree [None req-7542fcba-e491-4301-b12d-f1b35194a820 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Inventory has not changed in ProviderTree for provider: bf8e0fa1-16b6-408f-9203-c4cd63916272 {{(pid=85141) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 10:28:48 user nova-compute[85141]: DEBUG nova.scheduler.client.report [None req-7542fcba-e491-4301-b12d-f1b35194a820 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Inventory has not changed for provider bf8e0fa1-16b6-408f-9203-c4cd63916272 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=85141) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 10:28:48 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-7542fcba-e491-4301-b12d-f1b35194a820 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.551s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:28:48 user nova-compute[85141]: INFO nova.scheduler.client.report [None req-7542fcba-e491-4301-b12d-f1b35194a820 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Deleted allocation for migration 72c5d793-592e-4c2f-a692-665458d8517a
Nov 16 10:28:48 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-7542fcba-e491-4301-b12d-f1b35194a820 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Lock "bc76703d-9243-4277-9b13-d6f9639cd1bb" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.539s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:28:52 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:28:53 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:28:57 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:28:58 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:29:02 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:29:03 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:29:07 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:29:08 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:29:08 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:29:10 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:29:12 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:29:12 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:29:13 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:29:13 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-fb90ea3d-3eeb-426b-bae1-dec347c76252 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Acquiring lock "11986c5b-6914-491e-8e71-983ab6b13c6e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:29:13 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-fb90ea3d-3eeb-426b-bae1-dec347c76252 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Lock "11986c5b-6914-491e-8e71-983ab6b13c6e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:29:13 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-fb90ea3d-3eeb-426b-bae1-dec347c76252 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Acquiring lock "11986c5b-6914-491e-8e71-983ab6b13c6e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:29:13 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-fb90ea3d-3eeb-426b-bae1-dec347c76252 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Lock "11986c5b-6914-491e-8e71-983ab6b13c6e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:29:13 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-fb90ea3d-3eeb-426b-bae1-dec347c76252 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Lock "11986c5b-6914-491e-8e71-983ab6b13c6e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:29:13 user nova-compute[85141]: INFO nova.compute.manager [None req-fb90ea3d-3eeb-426b-bae1-dec347c76252 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] [instance: 11986c5b-6914-491e-8e71-983ab6b13c6e] Terminating instance
Nov 16 10:29:13 user nova-compute[85141]: DEBUG nova.compute.manager [None req-fb90ea3d-3eeb-426b-bae1-dec347c76252 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] [instance: 11986c5b-6914-491e-8e71-983ab6b13c6e] Start destroying the instance on the hypervisor. {{(pid=85141) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 10:29:13 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:29:13 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:29:13 user nova-compute[85141]: DEBUG nova.compute.manager [req-9652004d-2b87-427f-9c58-823ee047661b req-5d35c13d-e477-4d38-97c5-7c1628bbd923 service nova] [instance: 11986c5b-6914-491e-8e71-983ab6b13c6e] Received event network-vif-unplugged-5fc0fede-224a-4cb0-a586-8be6617c5138 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:29:13 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-9652004d-2b87-427f-9c58-823ee047661b req-5d35c13d-e477-4d38-97c5-7c1628bbd923 service nova] Acquiring lock "11986c5b-6914-491e-8e71-983ab6b13c6e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:29:13 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-9652004d-2b87-427f-9c58-823ee047661b req-5d35c13d-e477-4d38-97c5-7c1628bbd923 service nova] Lock "11986c5b-6914-491e-8e71-983ab6b13c6e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:29:13 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-9652004d-2b87-427f-9c58-823ee047661b req-5d35c13d-e477-4d38-97c5-7c1628bbd923 service nova] Lock "11986c5b-6914-491e-8e71-983ab6b13c6e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:29:13 user nova-compute[85141]: DEBUG nova.compute.manager [req-9652004d-2b87-427f-9c58-823ee047661b req-5d35c13d-e477-4d38-97c5-7c1628bbd923 service nova] [instance: 11986c5b-6914-491e-8e71-983ab6b13c6e] No waiting events found dispatching network-vif-unplugged-5fc0fede-224a-4cb0-a586-8be6617c5138 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:29:13 user nova-compute[85141]: DEBUG nova.compute.manager [req-9652004d-2b87-427f-9c58-823ee047661b req-5d35c13d-e477-4d38-97c5-7c1628bbd923 service nova] [instance: 11986c5b-6914-491e-8e71-983ab6b13c6e] Received event network-vif-unplugged-5fc0fede-224a-4cb0-a586-8be6617c5138 for instance with task_state deleting. {{(pid=85141) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 10:29:13 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:29:13 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:29:14 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:29:14 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:29:14 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:29:14 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:29:14 user nova-compute[85141]: INFO nova.virt.libvirt.driver [-] [instance: 11986c5b-6914-491e-8e71-983ab6b13c6e] Instance destroyed successfully.
Nov 16 10:29:14 user nova-compute[85141]: DEBUG nova.objects.instance [None req-fb90ea3d-3eeb-426b-bae1-dec347c76252 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Lazy-loading 'resources' on Instance uuid 11986c5b-6914-491e-8e71-983ab6b13c6e {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:29:14 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-fb90ea3d-3eeb-426b-bae1-dec347c76252 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T10:19:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1385112868',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1385112868',id=26,image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-16T10:19:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='733b504d4dbe4f028963cf2c197f0064',ramdisk_id='',reservation_id='r-t0i0h8s4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-742384119',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T10:20:58Z,user_data=None,user_id='ffe6ceff3cc346b59b4fbf294b9fc1a3',uuid=11986c5b-6914-491e-8e71-983ab6b13c6e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5fc0fede-224a-4cb0-a586-8be6617c5138", "address": "fa:16:3e:1c:46:5c", "network": {"id": "e40e4bd2-4277-40b1-9451-1c8365ffa488", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1333036447-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "733b504d4dbe4f028963cf2c197f0064", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fc0fede-22", "ovs_interfaceid": "5fc0fede-224a-4cb0-a586-8be6617c5138", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 10:29:14 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-fb90ea3d-3eeb-426b-bae1-dec347c76252 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Converting VIF {"id": "5fc0fede-224a-4cb0-a586-8be6617c5138", "address": "fa:16:3e:1c:46:5c", "network": {"id": "e40e4bd2-4277-40b1-9451-1c8365ffa488", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1333036447-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "733b504d4dbe4f028963cf2c197f0064", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fc0fede-22", "ovs_interfaceid": "5fc0fede-224a-4cb0-a586-8be6617c5138", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:29:14 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-fb90ea3d-3eeb-426b-bae1-dec347c76252 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1c:46:5c,bridge_name='br-int',has_traffic_filtering=True,id=5fc0fede-224a-4cb0-a586-8be6617c5138,network=Network(e40e4bd2-4277-40b1-9451-1c8365ffa488),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5fc0fede-22') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:29:14 user nova-compute[85141]: DEBUG os_vif [None req-fb90ea3d-3eeb-426b-bae1-dec347c76252 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:46:5c,bridge_name='br-int',has_traffic_filtering=True,id=5fc0fede-224a-4cb0-a586-8be6617c5138,network=Network(e40e4bd2-4277-40b1-9451-1c8365ffa488),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5fc0fede-22') {{(pid=85141) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 10:29:14 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:29:14 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5fc0fede-22, bridge=br-int, if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:29:14 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:29:14 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:29:14 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:29:14 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c9f1764b-428a-4004-857e-68a291ffbe94) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:29:14 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:29:14 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:29:14 user nova-compute[85141]: INFO os_vif [None req-fb90ea3d-3eeb-426b-bae1-dec347c76252 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:46:5c,bridge_name='br-int',has_traffic_filtering=True,id=5fc0fede-224a-4cb0-a586-8be6617c5138,network=Network(e40e4bd2-4277-40b1-9451-1c8365ffa488),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5fc0fede-22')
Nov 16 10:29:14 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-fb90ea3d-3eeb-426b-bae1-dec347c76252 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] [instance: 11986c5b-6914-491e-8e71-983ab6b13c6e] Deleting instance files /opt/stack/data/nova/instances/11986c5b-6914-491e-8e71-983ab6b13c6e_del
Nov 16 10:29:14 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-fb90ea3d-3eeb-426b-bae1-dec347c76252 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] [instance: 11986c5b-6914-491e-8e71-983ab6b13c6e] Deletion of /opt/stack/data/nova/instances/11986c5b-6914-491e-8e71-983ab6b13c6e_del complete
Nov 16 10:29:14 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:29:14 user nova-compute[85141]: INFO nova.compute.manager [None req-fb90ea3d-3eeb-426b-bae1-dec347c76252 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] [instance: 11986c5b-6914-491e-8e71-983ab6b13c6e] Took 0.78 seconds to destroy the instance on the hypervisor.
Nov 16 10:29:14 user nova-compute[85141]: DEBUG oslo.service.loopingcall [None req-fb90ea3d-3eeb-426b-bae1-dec347c76252 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=85141) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 10:29:14 user nova-compute[85141]: DEBUG nova.compute.manager [-] [instance: 11986c5b-6914-491e-8e71-983ab6b13c6e] Deallocating network for instance {{(pid=85141) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 10:29:14 user nova-compute[85141]: DEBUG nova.network.neutron [-] [instance: 11986c5b-6914-491e-8e71-983ab6b13c6e] deallocate_for_instance() {{(pid=85141) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 10:29:14 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:29:14 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:29:15 user nova-compute[85141]: DEBUG nova.network.neutron [-] [instance: 11986c5b-6914-491e-8e71-983ab6b13c6e] Updating instance_info_cache with network_info: [] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:29:15 user nova-compute[85141]: INFO nova.compute.manager [-] [instance: 11986c5b-6914-491e-8e71-983ab6b13c6e] Took 0.95 seconds to deallocate network for instance.
Nov 16 10:29:15 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-fb90ea3d-3eeb-426b-bae1-dec347c76252 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:29:15 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-fb90ea3d-3eeb-426b-bae1-dec347c76252 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:29:15 user nova-compute[85141]: DEBUG nova.compute.provider_tree [None req-fb90ea3d-3eeb-426b-bae1-dec347c76252 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Inventory has not changed in ProviderTree for provider: bf8e0fa1-16b6-408f-9203-c4cd63916272 {{(pid=85141) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 10:29:15 user nova-compute[85141]: DEBUG nova.scheduler.client.report [None req-fb90ea3d-3eeb-426b-bae1-dec347c76252 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Inventory has not changed for provider bf8e0fa1-16b6-408f-9203-c4cd63916272 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=85141) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 10:29:15 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-fb90ea3d-3eeb-426b-bae1-dec347c76252 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.385s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:29:15 user nova-compute[85141]: INFO nova.scheduler.client.report [None req-fb90ea3d-3eeb-426b-bae1-dec347c76252 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Deleted allocations for instance 11986c5b-6914-491e-8e71-983ab6b13c6e
Nov 16 10:29:15 user nova-compute[85141]: DEBUG nova.compute.manager [req-bbc125bd-5c6f-4e6c-92c6-108bd4af9858 req-b97cf30a-6765-4671-971c-7d9fb834f1f2 service nova] [instance: 11986c5b-6914-491e-8e71-983ab6b13c6e] Received event network-vif-plugged-5fc0fede-224a-4cb0-a586-8be6617c5138 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:29:15 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-bbc125bd-5c6f-4e6c-92c6-108bd4af9858 req-b97cf30a-6765-4671-971c-7d9fb834f1f2 service nova] Acquiring lock "11986c5b-6914-491e-8e71-983ab6b13c6e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:29:15 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-bbc125bd-5c6f-4e6c-92c6-108bd4af9858 req-b97cf30a-6765-4671-971c-7d9fb834f1f2 service nova] Lock "11986c5b-6914-491e-8e71-983ab6b13c6e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:29:15 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-bbc125bd-5c6f-4e6c-92c6-108bd4af9858 req-b97cf30a-6765-4671-971c-7d9fb834f1f2 service nova] Lock "11986c5b-6914-491e-8e71-983ab6b13c6e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:29:15 user nova-compute[85141]: DEBUG nova.compute.manager [req-bbc125bd-5c6f-4e6c-92c6-108bd4af9858 req-b97cf30a-6765-4671-971c-7d9fb834f1f2 service nova] [instance: 11986c5b-6914-491e-8e71-983ab6b13c6e] No waiting events found dispatching network-vif-plugged-5fc0fede-224a-4cb0-a586-8be6617c5138 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:29:15 user nova-compute[85141]: WARNING nova.compute.manager [req-bbc125bd-5c6f-4e6c-92c6-108bd4af9858 req-b97cf30a-6765-4671-971c-7d9fb834f1f2 service nova] [instance: 11986c5b-6914-491e-8e71-983ab6b13c6e] Received unexpected event network-vif-plugged-5fc0fede-224a-4cb0-a586-8be6617c5138 for instance with vm_state deleted and task_state None.
Nov 16 10:29:15 user nova-compute[85141]: DEBUG nova.compute.manager [req-bbc125bd-5c6f-4e6c-92c6-108bd4af9858 req-b97cf30a-6765-4671-971c-7d9fb834f1f2 service nova] [instance: 11986c5b-6914-491e-8e71-983ab6b13c6e] Received event network-vif-plugged-5fc0fede-224a-4cb0-a586-8be6617c5138 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:29:15 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-bbc125bd-5c6f-4e6c-92c6-108bd4af9858 req-b97cf30a-6765-4671-971c-7d9fb834f1f2 service nova] Acquiring lock "11986c5b-6914-491e-8e71-983ab6b13c6e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:29:15 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-bbc125bd-5c6f-4e6c-92c6-108bd4af9858 req-b97cf30a-6765-4671-971c-7d9fb834f1f2 service nova] Lock "11986c5b-6914-491e-8e71-983ab6b13c6e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:29:15 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-bbc125bd-5c6f-4e6c-92c6-108bd4af9858 req-b97cf30a-6765-4671-971c-7d9fb834f1f2 service nova] Lock "11986c5b-6914-491e-8e71-983ab6b13c6e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:29:15 user nova-compute[85141]: DEBUG nova.compute.manager [req-bbc125bd-5c6f-4e6c-92c6-108bd4af9858 req-b97cf30a-6765-4671-971c-7d9fb834f1f2 service nova] [instance: 11986c5b-6914-491e-8e71-983ab6b13c6e] No waiting events found dispatching network-vif-plugged-5fc0fede-224a-4cb0-a586-8be6617c5138 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:29:15 user nova-compute[85141]: WARNING nova.compute.manager [req-bbc125bd-5c6f-4e6c-92c6-108bd4af9858 req-b97cf30a-6765-4671-971c-7d9fb834f1f2 service nova] [instance: 11986c5b-6914-491e-8e71-983ab6b13c6e] Received unexpected event network-vif-plugged-5fc0fede-224a-4cb0-a586-8be6617c5138 for instance with vm_state deleted and task_state None.
Nov 16 10:29:15 user nova-compute[85141]: DEBUG nova.compute.manager [req-bbc125bd-5c6f-4e6c-92c6-108bd4af9858 req-b97cf30a-6765-4671-971c-7d9fb834f1f2 service nova] [instance: 11986c5b-6914-491e-8e71-983ab6b13c6e] Received event network-vif-plugged-5fc0fede-224a-4cb0-a586-8be6617c5138 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:29:15 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-bbc125bd-5c6f-4e6c-92c6-108bd4af9858 req-b97cf30a-6765-4671-971c-7d9fb834f1f2 service nova] Acquiring lock "11986c5b-6914-491e-8e71-983ab6b13c6e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:29:15 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-bbc125bd-5c6f-4e6c-92c6-108bd4af9858 req-b97cf30a-6765-4671-971c-7d9fb834f1f2 service nova] Lock "11986c5b-6914-491e-8e71-983ab6b13c6e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:29:15 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-bbc125bd-5c6f-4e6c-92c6-108bd4af9858 req-b97cf30a-6765-4671-971c-7d9fb834f1f2 service nova] Lock "11986c5b-6914-491e-8e71-983ab6b13c6e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:29:15 user nova-compute[85141]: DEBUG nova.compute.manager [req-bbc125bd-5c6f-4e6c-92c6-108bd4af9858 req-b97cf30a-6765-4671-971c-7d9fb834f1f2 service nova] [instance: 11986c5b-6914-491e-8e71-983ab6b13c6e] No waiting events found dispatching network-vif-plugged-5fc0fede-224a-4cb0-a586-8be6617c5138 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:29:15 user nova-compute[85141]: WARNING nova.compute.manager [req-bbc125bd-5c6f-4e6c-92c6-108bd4af9858 req-b97cf30a-6765-4671-971c-7d9fb834f1f2 service nova] [instance: 11986c5b-6914-491e-8e71-983ab6b13c6e] Received unexpected event network-vif-plugged-5fc0fede-224a-4cb0-a586-8be6617c5138 for instance with vm_state deleted and task_state None.
Nov 16 10:29:15 user nova-compute[85141]: DEBUG nova.compute.manager [req-bbc125bd-5c6f-4e6c-92c6-108bd4af9858 req-b97cf30a-6765-4671-971c-7d9fb834f1f2 service nova] [instance: 11986c5b-6914-491e-8e71-983ab6b13c6e] Received event network-vif-plugged-5fc0fede-224a-4cb0-a586-8be6617c5138 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:29:15 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-bbc125bd-5c6f-4e6c-92c6-108bd4af9858 req-b97cf30a-6765-4671-971c-7d9fb834f1f2 service nova] Acquiring lock "11986c5b-6914-491e-8e71-983ab6b13c6e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:29:15 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-bbc125bd-5c6f-4e6c-92c6-108bd4af9858 req-b97cf30a-6765-4671-971c-7d9fb834f1f2 service nova] Lock "11986c5b-6914-491e-8e71-983ab6b13c6e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:29:15 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-bbc125bd-5c6f-4e6c-92c6-108bd4af9858 req-b97cf30a-6765-4671-971c-7d9fb834f1f2 service nova] Lock "11986c5b-6914-491e-8e71-983ab6b13c6e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:29:15 user nova-compute[85141]: DEBUG nova.compute.manager [req-bbc125bd-5c6f-4e6c-92c6-108bd4af9858 req-b97cf30a-6765-4671-971c-7d9fb834f1f2 service nova] [instance: 11986c5b-6914-491e-8e71-983ab6b13c6e] No waiting events found dispatching network-vif-plugged-5fc0fede-224a-4cb0-a586-8be6617c5138 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:29:15 user nova-compute[85141]: WARNING nova.compute.manager [req-bbc125bd-5c6f-4e6c-92c6-108bd4af9858 req-b97cf30a-6765-4671-971c-7d9fb834f1f2 service nova] [instance: 11986c5b-6914-491e-8e71-983ab6b13c6e] Received unexpected event network-vif-plugged-5fc0fede-224a-4cb0-a586-8be6617c5138 for instance with vm_state deleted and task_state None.
Nov 16 10:29:15 user nova-compute[85141]: DEBUG nova.compute.manager [req-bbc125bd-5c6f-4e6c-92c6-108bd4af9858 req-b97cf30a-6765-4671-971c-7d9fb834f1f2 service nova] [instance: 11986c5b-6914-491e-8e71-983ab6b13c6e] Received event network-vif-deleted-5fc0fede-224a-4cb0-a586-8be6617c5138 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:29:15 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-fb90ea3d-3eeb-426b-bae1-dec347c76252 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Lock "11986c5b-6914-491e-8e71-983ab6b13c6e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.307s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:29:18 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:29:18 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:29:19 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:29:20 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:29:23 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:29:23 user nova-compute[85141]: DEBUG nova.compute.manager [req-89c54c88-f103-4571-8297-a4c3f80185af req-14db1be1-4f25-4bbd-b3cc-e6a6d66db5b8 service nova] [instance: e1253324-3ca1-4610-b9d6-3db7c6c76828] Received event network-changed-29a94474-9722-43fb-b61a-d8eca4d6d728 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:29:23 user nova-compute[85141]: DEBUG nova.compute.manager [req-89c54c88-f103-4571-8297-a4c3f80185af req-14db1be1-4f25-4bbd-b3cc-e6a6d66db5b8 service nova] [instance: e1253324-3ca1-4610-b9d6-3db7c6c76828] Refreshing instance network info cache due to event network-changed-29a94474-9722-43fb-b61a-d8eca4d6d728. {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 10:29:23 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-89c54c88-f103-4571-8297-a4c3f80185af req-14db1be1-4f25-4bbd-b3cc-e6a6d66db5b8 service nova] Acquiring lock "refresh_cache-e1253324-3ca1-4610-b9d6-3db7c6c76828" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:29:23 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-89c54c88-f103-4571-8297-a4c3f80185af req-14db1be1-4f25-4bbd-b3cc-e6a6d66db5b8 service nova] Acquired lock "refresh_cache-e1253324-3ca1-4610-b9d6-3db7c6c76828" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:29:23 user nova-compute[85141]: DEBUG nova.network.neutron [req-89c54c88-f103-4571-8297-a4c3f80185af req-14db1be1-4f25-4bbd-b3cc-e6a6d66db5b8 service nova] [instance: e1253324-3ca1-4610-b9d6-3db7c6c76828] Refreshing network info cache for port 29a94474-9722-43fb-b61a-d8eca4d6d728 {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 10:29:24 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:29:24 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:29:24 user nova-compute[85141]: DEBUG nova.network.neutron [req-89c54c88-f103-4571-8297-a4c3f80185af req-14db1be1-4f25-4bbd-b3cc-e6a6d66db5b8 service nova] [instance: e1253324-3ca1-4610-b9d6-3db7c6c76828] Updated VIF entry in instance network info cache for port 29a94474-9722-43fb-b61a-d8eca4d6d728. {{(pid=85141) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 10:29:24 user nova-compute[85141]: DEBUG nova.network.neutron [req-89c54c88-f103-4571-8297-a4c3f80185af req-14db1be1-4f25-4bbd-b3cc-e6a6d66db5b8 service nova] [instance: e1253324-3ca1-4610-b9d6-3db7c6c76828] Updating instance_info_cache with network_info: [{"id": "29a94474-9722-43fb-b61a-d8eca4d6d728", "address": "fa:16:3e:ea:fd:01", "network": {"id": "b8ada47f-9721-4358-ac4f-0305f06dbbb8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1663922860-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aec3bb9fe5e6446590900b5adf65df0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29a94474-97", "ovs_interfaceid": "29a94474-9722-43fb-b61a-d8eca4d6d728", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:29:24 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-89c54c88-f103-4571-8297-a4c3f80185af req-14db1be1-4f25-4bbd-b3cc-e6a6d66db5b8 service nova] Releasing lock "refresh_cache-e1253324-3ca1-4610-b9d6-3db7c6c76828" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:29:26 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:29:28 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:29:29 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:29:30 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-1105ced2-56ea-4297-ae9e-dae52f36d2f7 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Acquiring lock "97cbb145-d47e-4eb1-8c01-06361efa8720" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:29:30 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-1105ced2-56ea-4297-ae9e-dae52f36d2f7 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Lock "97cbb145-d47e-4eb1-8c01-06361efa8720" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:29:30 user nova-compute[85141]: DEBUG nova.compute.manager [None req-1105ced2-56ea-4297-ae9e-dae52f36d2f7 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: 97cbb145-d47e-4eb1-8c01-06361efa8720] Starting instance... {{(pid=85141) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 10:29:30 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-1105ced2-56ea-4297-ae9e-dae52f36d2f7 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:29:30 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-1105ced2-56ea-4297-ae9e-dae52f36d2f7 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:29:30 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-1105ced2-56ea-4297-ae9e-dae52f36d2f7 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=85141) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 10:29:30 user nova-compute[85141]: INFO nova.compute.claims [None req-1105ced2-56ea-4297-ae9e-dae52f36d2f7 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: 97cbb145-d47e-4eb1-8c01-06361efa8720] Claim successful on node user
Nov 16 10:29:30 user nova-compute[85141]: DEBUG nova.compute.manager [req-a9cd802f-f21b-46a5-847b-b5bb58572b90 req-57041bf0-3374-4a3d-9c08-4fe3156e4a97 service nova] [instance: 463034ff-14ce-477a-9642-4d86aa6f9cd9] Received event network-changed-121bbc09-53cf-4586-8585-655079b4c49b {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:29:30 user nova-compute[85141]: DEBUG nova.compute.manager [req-a9cd802f-f21b-46a5-847b-b5bb58572b90 req-57041bf0-3374-4a3d-9c08-4fe3156e4a97 service nova] [instance: 463034ff-14ce-477a-9642-4d86aa6f9cd9] Refreshing instance network info cache due to event network-changed-121bbc09-53cf-4586-8585-655079b4c49b. {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 10:29:30 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-a9cd802f-f21b-46a5-847b-b5bb58572b90 req-57041bf0-3374-4a3d-9c08-4fe3156e4a97 service nova] Acquiring lock "refresh_cache-463034ff-14ce-477a-9642-4d86aa6f9cd9" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:29:30 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-a9cd802f-f21b-46a5-847b-b5bb58572b90 req-57041bf0-3374-4a3d-9c08-4fe3156e4a97 service nova] Acquired lock "refresh_cache-463034ff-14ce-477a-9642-4d86aa6f9cd9" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:29:30 user nova-compute[85141]: DEBUG nova.network.neutron [req-a9cd802f-f21b-46a5-847b-b5bb58572b90 req-57041bf0-3374-4a3d-9c08-4fe3156e4a97 service nova] [instance: 463034ff-14ce-477a-9642-4d86aa6f9cd9] Refreshing network info cache for port 121bbc09-53cf-4586-8585-655079b4c49b {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 10:29:30 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5bb3f7e7-6b15-492e-a4bb-9b7ff0c2e088 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] Acquiring lock "7437a3a3-9b7f-489b-b20b-f1b877ebb253" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:29:30 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5bb3f7e7-6b15-492e-a4bb-9b7ff0c2e088 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] Lock "7437a3a3-9b7f-489b-b20b-f1b877ebb253" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:29:30 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5bb3f7e7-6b15-492e-a4bb-9b7ff0c2e088 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] [instance: 7437a3a3-9b7f-489b-b20b-f1b877ebb253] Starting instance... {{(pid=85141) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 10:29:30 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5bb3f7e7-6b15-492e-a4bb-9b7ff0c2e088 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:29:30 user nova-compute[85141]: DEBUG nova.compute.provider_tree [None req-1105ced2-56ea-4297-ae9e-dae52f36d2f7 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Inventory has not changed in ProviderTree for provider: bf8e0fa1-16b6-408f-9203-c4cd63916272 {{(pid=85141) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 10:29:30 user nova-compute[85141]: DEBUG nova.scheduler.client.report [None req-1105ced2-56ea-4297-ae9e-dae52f36d2f7 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Inventory has not changed for provider bf8e0fa1-16b6-408f-9203-c4cd63916272 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=85141) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 10:29:30 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-1105ced2-56ea-4297-ae9e-dae52f36d2f7 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.582s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:29:30 user nova-compute[85141]: DEBUG nova.compute.manager [None req-1105ced2-56ea-4297-ae9e-dae52f36d2f7 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: 97cbb145-d47e-4eb1-8c01-06361efa8720] Start building networks asynchronously for instance. {{(pid=85141) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 10:29:30 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5bb3f7e7-6b15-492e-a4bb-9b7ff0c2e088 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.092s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:29:30 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-5bb3f7e7-6b15-492e-a4bb-9b7ff0c2e088 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=85141) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 10:29:30 user nova-compute[85141]: INFO nova.compute.claims [None req-5bb3f7e7-6b15-492e-a4bb-9b7ff0c2e088 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] [instance: 7437a3a3-9b7f-489b-b20b-f1b877ebb253] Claim successful on node user
Nov 16 10:29:30 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-4daaa957-30da-4ccb-b0e8-c6c88f0c6d2c tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Acquiring lock "463034ff-14ce-477a-9642-4d86aa6f9cd9" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:29:30 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-4daaa957-30da-4ccb-b0e8-c6c88f0c6d2c tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Lock "463034ff-14ce-477a-9642-4d86aa6f9cd9" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:29:30 user nova-compute[85141]: DEBUG nova.network.neutron [req-a9cd802f-f21b-46a5-847b-b5bb58572b90 req-57041bf0-3374-4a3d-9c08-4fe3156e4a97 service nova] [instance: 463034ff-14ce-477a-9642-4d86aa6f9cd9] Updated VIF entry in instance network info cache for port 121bbc09-53cf-4586-8585-655079b4c49b. {{(pid=85141) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 10:29:30 user nova-compute[85141]: DEBUG nova.network.neutron [req-a9cd802f-f21b-46a5-847b-b5bb58572b90 req-57041bf0-3374-4a3d-9c08-4fe3156e4a97 service nova] [instance: 463034ff-14ce-477a-9642-4d86aa6f9cd9] Updating instance_info_cache with network_info: [{"id": "121bbc09-53cf-4586-8585-655079b4c49b", "address": "fa:16:3e:b0:77:d5", "network": {"id": "5b67a3fd-ef1e-4f2c-b6e0-31766ef39d30", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2137186235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09b520de67ac4290a4b779f50afeb1a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap121bbc09-53", "ovs_interfaceid": "121bbc09-53cf-4586-8585-655079b4c49b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:29:30 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-1105ced2-56ea-4297-ae9e-dae52f36d2f7 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: 97cbb145-d47e-4eb1-8c01-06361efa8720] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 10:29:30 user nova-compute[85141]: DEBUG nova.compute.manager [None req-1105ced2-56ea-4297-ae9e-dae52f36d2f7 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: 97cbb145-d47e-4eb1-8c01-06361efa8720] Allocating IP information in the background. {{(pid=85141) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 10:29:30 user nova-compute[85141]: DEBUG nova.network.neutron [None req-1105ced2-56ea-4297-ae9e-dae52f36d2f7 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: 97cbb145-d47e-4eb1-8c01-06361efa8720] allocate_for_instance() {{(pid=85141) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 10:29:30 user nova-compute[85141]: INFO nova.compute.manager [None req-4daaa957-30da-4ccb-b0e8-c6c88f0c6d2c tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] [instance: 463034ff-14ce-477a-9642-4d86aa6f9cd9] Detaching volume e1b58025-0c18-41f6-a126-fb3c925399a1
Nov 16 10:29:30 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-a9cd802f-f21b-46a5-847b-b5bb58572b90 req-57041bf0-3374-4a3d-9c08-4fe3156e4a97 service nova] Releasing lock "refresh_cache-463034ff-14ce-477a-9642-4d86aa6f9cd9" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:29:30 user nova-compute[85141]: DEBUG nova.compute.manager [None req-1105ced2-56ea-4297-ae9e-dae52f36d2f7 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: 97cbb145-d47e-4eb1-8c01-06361efa8720] Start building block device mappings for instance. {{(pid=85141) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 10:29:30 user nova-compute[85141]: INFO nova.virt.block_device [None req-4daaa957-30da-4ccb-b0e8-c6c88f0c6d2c tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] [instance: 463034ff-14ce-477a-9642-4d86aa6f9cd9] Attempting to driver detach volume e1b58025-0c18-41f6-a126-fb3c925399a1 from mountpoint /dev/vdb
Nov 16 10:29:30 user nova-compute[85141]: DEBUG nova.policy [None req-1105ced2-56ea-4297-ae9e-dae52f36d2f7 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7261b57c36904fcda87a9ea32d4b5b31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aec3bb9fe5e6446590900b5adf65df0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85141) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 10:29:30 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-4daaa957-30da-4ccb-b0e8-c6c88f0c6d2c tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Attempting to detach device vdb from instance 463034ff-14ce-477a-9642-4d86aa6f9cd9 from the persistent domain config. {{(pid=85141) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 10:29:30 user nova-compute[85141]: DEBUG nova.virt.libvirt.guest [None req-4daaa957-30da-4ccb-b0e8-c6c88f0c6d2c tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 10:29:30 user nova-compute[85141]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 10:29:30 user nova-compute[85141]:   <source dev="/dev/sdg"/>
Nov 16 10:29:30 user nova-compute[85141]:   <target dev="vdb" bus="virtio"/>
Nov 16 10:29:30 user nova-compute[85141]:   <serial>e1b58025-0c18-41f6-a126-fb3c925399a1</serial>
Nov 16 10:29:30 user nova-compute[85141]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 10:29:30 user nova-compute[85141]: </disk>
Nov 16 10:29:30 user nova-compute[85141]:  {{(pid=85141) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 10:29:30 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-4daaa957-30da-4ccb-b0e8-c6c88f0c6d2c tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Successfully detached device vdb from instance 463034ff-14ce-477a-9642-4d86aa6f9cd9 from the persistent domain config.
Nov 16 10:29:30 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-4daaa957-30da-4ccb-b0e8-c6c88f0c6d2c tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 463034ff-14ce-477a-9642-4d86aa6f9cd9 from the live domain config. {{(pid=85141) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 10:29:30 user nova-compute[85141]: DEBUG nova.virt.libvirt.guest [None req-4daaa957-30da-4ccb-b0e8-c6c88f0c6d2c tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 10:29:30 user nova-compute[85141]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 10:29:30 user nova-compute[85141]:   <source dev="/dev/sdg"/>
Nov 16 10:29:30 user nova-compute[85141]:   <target dev="vdb" bus="virtio"/>
Nov 16 10:29:30 user nova-compute[85141]:   <serial>e1b58025-0c18-41f6-a126-fb3c925399a1</serial>
Nov 16 10:29:30 user nova-compute[85141]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 10:29:30 user nova-compute[85141]: </disk>
Nov 16 10:29:30 user nova-compute[85141]:  {{(pid=85141) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 10:29:30 user nova-compute[85141]: INFO nova.virt.block_device [None req-1105ced2-56ea-4297-ae9e-dae52f36d2f7 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: 97cbb145-d47e-4eb1-8c01-06361efa8720] Booting with volume snapshot 632b580b-29ff-4487-bdbf-4c2dd038d7ea at /dev/vda
Nov 16 10:29:31 user nova-compute[85141]: DEBUG nova.compute.provider_tree [None req-5bb3f7e7-6b15-492e-a4bb-9b7ff0c2e088 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] Inventory has not changed in ProviderTree for provider: bf8e0fa1-16b6-408f-9203-c4cd63916272 {{(pid=85141) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 10:29:31 user nova-compute[85141]: DEBUG nova.scheduler.client.report [None req-5bb3f7e7-6b15-492e-a4bb-9b7ff0c2e088 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] Inventory has not changed for provider bf8e0fa1-16b6-408f-9203-c4cd63916272 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=85141) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 10:29:31 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5bb3f7e7-6b15-492e-a4bb-9b7ff0c2e088 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.568s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:29:31 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5bb3f7e7-6b15-492e-a4bb-9b7ff0c2e088 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] [instance: 7437a3a3-9b7f-489b-b20b-f1b877ebb253] Start building networks asynchronously for instance. {{(pid=85141) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 10:29:31 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:29:31 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-4daaa957-30da-4ccb-b0e8-c6c88f0c6d2c tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 463034ff-14ce-477a-9642-4d86aa6f9cd9 {{(pid=85141) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 10:29:31 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5bb3f7e7-6b15-492e-a4bb-9b7ff0c2e088 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] [instance: 7437a3a3-9b7f-489b-b20b-f1b877ebb253] Allocating IP information in the background. {{(pid=85141) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 10:29:31 user nova-compute[85141]: DEBUG nova.network.neutron [None req-5bb3f7e7-6b15-492e-a4bb-9b7ff0c2e088 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] [instance: 7437a3a3-9b7f-489b-b20b-f1b877ebb253] allocate_for_instance() {{(pid=85141) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 10:29:31 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-5bb3f7e7-6b15-492e-a4bb-9b7ff0c2e088 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] [instance: 7437a3a3-9b7f-489b-b20b-f1b877ebb253] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 10:29:31 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5bb3f7e7-6b15-492e-a4bb-9b7ff0c2e088 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] [instance: 7437a3a3-9b7f-489b-b20b-f1b877ebb253] Start building block device mappings for instance. {{(pid=85141) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 10:29:31 user nova-compute[85141]: DEBUG nova.policy [None req-5bb3f7e7-6b15-492e-a4bb-9b7ff0c2e088 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7127276ead2d4cae9d562bec932c5512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f8eed15973c44ceb150fe51b6e55382', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85141) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 10:29:31 user nova-compute[85141]: DEBUG nova.network.neutron [None req-1105ced2-56ea-4297-ae9e-dae52f36d2f7 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: 97cbb145-d47e-4eb1-8c01-06361efa8720] Successfully created port: 440f9d6b-639a-4615-8b0c-e85b108f9734 {{(pid=85141) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 10:29:31 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5bb3f7e7-6b15-492e-a4bb-9b7ff0c2e088 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] [instance: 7437a3a3-9b7f-489b-b20b-f1b877ebb253] Start spawning the instance on the hypervisor. {{(pid=85141) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 10:29:31 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-5bb3f7e7-6b15-492e-a4bb-9b7ff0c2e088 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] [instance: 7437a3a3-9b7f-489b-b20b-f1b877ebb253] Creating instance directory {{(pid=85141) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 10:29:31 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-5bb3f7e7-6b15-492e-a4bb-9b7ff0c2e088 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] [instance: 7437a3a3-9b7f-489b-b20b-f1b877ebb253] Creating image(s)
Nov 16 10:29:31 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5bb3f7e7-6b15-492e-a4bb-9b7ff0c2e088 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] Acquiring lock "/opt/stack/data/nova/instances/7437a3a3-9b7f-489b-b20b-f1b877ebb253/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:29:31 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5bb3f7e7-6b15-492e-a4bb-9b7ff0c2e088 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] Lock "/opt/stack/data/nova/instances/7437a3a3-9b7f-489b-b20b-f1b877ebb253/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:29:31 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5bb3f7e7-6b15-492e-a4bb-9b7ff0c2e088 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] Lock "/opt/stack/data/nova/instances/7437a3a3-9b7f-489b-b20b-f1b877ebb253/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:29:31 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5bb3f7e7-6b15-492e-a4bb-9b7ff0c2e088 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:29:31 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5bb3f7e7-6b15-492e-a4bb-9b7ff0c2e088 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json" returned: 0 in 0.190s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:29:31 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5bb3f7e7-6b15-492e-a4bb-9b7ff0c2e088 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] Acquiring lock "60a78556fb399ed4a41bc3ca4bccf77c96d8e811" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:29:31 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5bb3f7e7-6b15-492e-a4bb-9b7ff0c2e088 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] Lock "60a78556fb399ed4a41bc3ca4bccf77c96d8e811" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:29:31 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5bb3f7e7-6b15-492e-a4bb-9b7ff0c2e088 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:29:31 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5bb3f7e7-6b15-492e-a4bb-9b7ff0c2e088 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json" returned: 0 in 0.191s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:29:31 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5bb3f7e7-6b15-492e-a4bb-9b7ff0c2e088 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811,backing_fmt=raw /opt/stack/data/nova/instances/7437a3a3-9b7f-489b-b20b-f1b877ebb253/disk 1073741824 {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:29:31 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5bb3f7e7-6b15-492e-a4bb-9b7ff0c2e088 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811,backing_fmt=raw /opt/stack/data/nova/instances/7437a3a3-9b7f-489b-b20b-f1b877ebb253/disk 1073741824" returned: 0 in 0.052s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:29:31 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5bb3f7e7-6b15-492e-a4bb-9b7ff0c2e088 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] Lock "60a78556fb399ed4a41bc3ca4bccf77c96d8e811" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.251s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:29:31 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5bb3f7e7-6b15-492e-a4bb-9b7ff0c2e088 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:29:32 user nova-compute[85141]: DEBUG nova.network.neutron [None req-5bb3f7e7-6b15-492e-a4bb-9b7ff0c2e088 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] [instance: 7437a3a3-9b7f-489b-b20b-f1b877ebb253] Successfully created port: 7ba5e576-d9a3-44c7-a741-a9d1e510d7bf {{(pid=85141) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 10:29:32 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5bb3f7e7-6b15-492e-a4bb-9b7ff0c2e088 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json" returned: 0 in 0.200s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:29:32 user nova-compute[85141]: DEBUG nova.virt.disk.api [None req-5bb3f7e7-6b15-492e-a4bb-9b7ff0c2e088 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7437a3a3-9b7f-489b-b20b-f1b877ebb253/disk. size=1073741824 {{(pid=85141) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 10:29:32 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5bb3f7e7-6b15-492e-a4bb-9b7ff0c2e088 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7437a3a3-9b7f-489b-b20b-f1b877ebb253/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:29:32 user nova-compute[85141]: DEBUG nova.compute.manager [req-039f1ac0-4406-477c-8958-1f4e75c3be0e req-e3bef6a6-d7ec-40a2-b3db-52cfbb2413e7 service nova] [instance: 463034ff-14ce-477a-9642-4d86aa6f9cd9] Received event network-changed-121bbc09-53cf-4586-8585-655079b4c49b {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:29:32 user nova-compute[85141]: DEBUG nova.compute.manager [req-039f1ac0-4406-477c-8958-1f4e75c3be0e req-e3bef6a6-d7ec-40a2-b3db-52cfbb2413e7 service nova] [instance: 463034ff-14ce-477a-9642-4d86aa6f9cd9] Refreshing instance network info cache due to event network-changed-121bbc09-53cf-4586-8585-655079b4c49b. {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 10:29:32 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-039f1ac0-4406-477c-8958-1f4e75c3be0e req-e3bef6a6-d7ec-40a2-b3db-52cfbb2413e7 service nova] Acquiring lock "refresh_cache-463034ff-14ce-477a-9642-4d86aa6f9cd9" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:29:32 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-039f1ac0-4406-477c-8958-1f4e75c3be0e req-e3bef6a6-d7ec-40a2-b3db-52cfbb2413e7 service nova] Acquired lock "refresh_cache-463034ff-14ce-477a-9642-4d86aa6f9cd9" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:29:32 user nova-compute[85141]: DEBUG nova.network.neutron [req-039f1ac0-4406-477c-8958-1f4e75c3be0e req-e3bef6a6-d7ec-40a2-b3db-52cfbb2413e7 service nova] [instance: 463034ff-14ce-477a-9642-4d86aa6f9cd9] Refreshing network info cache for port 121bbc09-53cf-4586-8585-655079b4c49b {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 10:29:32 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5bb3f7e7-6b15-492e-a4bb-9b7ff0c2e088 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7437a3a3-9b7f-489b-b20b-f1b877ebb253/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:29:32 user nova-compute[85141]: DEBUG nova.virt.disk.api [None req-5bb3f7e7-6b15-492e-a4bb-9b7ff0c2e088 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] Cannot resize image /opt/stack/data/nova/instances/7437a3a3-9b7f-489b-b20b-f1b877ebb253/disk to a smaller size. {{(pid=85141) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 10:29:32 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-5bb3f7e7-6b15-492e-a4bb-9b7ff0c2e088 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] [instance: 7437a3a3-9b7f-489b-b20b-f1b877ebb253] Created local disks {{(pid=85141) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 10:29:32 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-5bb3f7e7-6b15-492e-a4bb-9b7ff0c2e088 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] [instance: 7437a3a3-9b7f-489b-b20b-f1b877ebb253] Ensure instance console log exists: /opt/stack/data/nova/instances/7437a3a3-9b7f-489b-b20b-f1b877ebb253/console.log {{(pid=85141) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 10:29:32 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5bb3f7e7-6b15-492e-a4bb-9b7ff0c2e088 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:29:32 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5bb3f7e7-6b15-492e-a4bb-9b7ff0c2e088 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:29:32 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5bb3f7e7-6b15-492e-a4bb-9b7ff0c2e088 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:29:32 user nova-compute[85141]: DEBUG nova.network.neutron [None req-1105ced2-56ea-4297-ae9e-dae52f36d2f7 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: 97cbb145-d47e-4eb1-8c01-06361efa8720] Successfully updated port: 440f9d6b-639a-4615-8b0c-e85b108f9734 {{(pid=85141) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 10:29:32 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-1105ced2-56ea-4297-ae9e-dae52f36d2f7 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Acquiring lock "refresh_cache-97cbb145-d47e-4eb1-8c01-06361efa8720" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:29:32 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-1105ced2-56ea-4297-ae9e-dae52f36d2f7 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Acquired lock "refresh_cache-97cbb145-d47e-4eb1-8c01-06361efa8720" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:29:32 user nova-compute[85141]: DEBUG nova.network.neutron [None req-1105ced2-56ea-4297-ae9e-dae52f36d2f7 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: 97cbb145-d47e-4eb1-8c01-06361efa8720] Building network info cache for instance {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 10:29:32 user nova-compute[85141]: DEBUG nova.compute.manager [req-e0f439b3-ffce-4174-8bdf-fb8edd791cb1 req-18417784-b569-4446-ba43-cb8c9448d55b service nova] [instance: 97cbb145-d47e-4eb1-8c01-06361efa8720] Received event network-changed-440f9d6b-639a-4615-8b0c-e85b108f9734 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:29:32 user nova-compute[85141]: DEBUG nova.compute.manager [req-e0f439b3-ffce-4174-8bdf-fb8edd791cb1 req-18417784-b569-4446-ba43-cb8c9448d55b service nova] [instance: 97cbb145-d47e-4eb1-8c01-06361efa8720] Refreshing instance network info cache due to event network-changed-440f9d6b-639a-4615-8b0c-e85b108f9734. {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 10:29:32 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-e0f439b3-ffce-4174-8bdf-fb8edd791cb1 req-18417784-b569-4446-ba43-cb8c9448d55b service nova] Acquiring lock "refresh_cache-97cbb145-d47e-4eb1-8c01-06361efa8720" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:29:32 user nova-compute[85141]: DEBUG nova.network.neutron [None req-1105ced2-56ea-4297-ae9e-dae52f36d2f7 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: 97cbb145-d47e-4eb1-8c01-06361efa8720] Instance cache missing network info. {{(pid=85141) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 10:29:32 user nova-compute[85141]: DEBUG nova.network.neutron [None req-1105ced2-56ea-4297-ae9e-dae52f36d2f7 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: 97cbb145-d47e-4eb1-8c01-06361efa8720] Updating instance_info_cache with network_info: [{"id": "440f9d6b-639a-4615-8b0c-e85b108f9734", "address": "fa:16:3e:dd:8c:7c", "network": {"id": "b8ada47f-9721-4358-ac4f-0305f06dbbb8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1663922860-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aec3bb9fe5e6446590900b5adf65df0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap440f9d6b-63", "ovs_interfaceid": "440f9d6b-639a-4615-8b0c-e85b108f9734", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:29:32 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-1105ced2-56ea-4297-ae9e-dae52f36d2f7 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Releasing lock "refresh_cache-97cbb145-d47e-4eb1-8c01-06361efa8720" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:29:32 user nova-compute[85141]: DEBUG nova.compute.manager [None req-1105ced2-56ea-4297-ae9e-dae52f36d2f7 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: 97cbb145-d47e-4eb1-8c01-06361efa8720] Instance network_info: |[{"id": "440f9d6b-639a-4615-8b0c-e85b108f9734", "address": "fa:16:3e:dd:8c:7c", "network": {"id": "b8ada47f-9721-4358-ac4f-0305f06dbbb8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1663922860-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aec3bb9fe5e6446590900b5adf65df0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap440f9d6b-63", "ovs_interfaceid": "440f9d6b-639a-4615-8b0c-e85b108f9734", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=85141) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 10:29:32 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-e0f439b3-ffce-4174-8bdf-fb8edd791cb1 req-18417784-b569-4446-ba43-cb8c9448d55b service nova] Acquired lock "refresh_cache-97cbb145-d47e-4eb1-8c01-06361efa8720" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:29:32 user nova-compute[85141]: DEBUG nova.network.neutron [req-e0f439b3-ffce-4174-8bdf-fb8edd791cb1 req-18417784-b569-4446-ba43-cb8c9448d55b service nova] [instance: 97cbb145-d47e-4eb1-8c01-06361efa8720] Refreshing network info cache for port 440f9d6b-639a-4615-8b0c-e85b108f9734 {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 10:29:33 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:29:33 user nova-compute[85141]: DEBUG nova.network.neutron [req-039f1ac0-4406-477c-8958-1f4e75c3be0e req-e3bef6a6-d7ec-40a2-b3db-52cfbb2413e7 service nova] [instance: 463034ff-14ce-477a-9642-4d86aa6f9cd9] Updated VIF entry in instance network info cache for port 121bbc09-53cf-4586-8585-655079b4c49b. {{(pid=85141) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 10:29:33 user nova-compute[85141]: DEBUG nova.network.neutron [req-039f1ac0-4406-477c-8958-1f4e75c3be0e req-e3bef6a6-d7ec-40a2-b3db-52cfbb2413e7 service nova] [instance: 463034ff-14ce-477a-9642-4d86aa6f9cd9] Updating instance_info_cache with network_info: [{"id": "121bbc09-53cf-4586-8585-655079b4c49b", "address": "fa:16:3e:b0:77:d5", "network": {"id": "5b67a3fd-ef1e-4f2c-b6e0-31766ef39d30", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2137186235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09b520de67ac4290a4b779f50afeb1a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap121bbc09-53", "ovs_interfaceid": "121bbc09-53cf-4586-8585-655079b4c49b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:29:33 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-039f1ac0-4406-477c-8958-1f4e75c3be0e req-e3bef6a6-d7ec-40a2-b3db-52cfbb2413e7 service nova] Releasing lock "refresh_cache-463034ff-14ce-477a-9642-4d86aa6f9cd9" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:29:33 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:29:33 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Starting heal instance info cache {{(pid=85141) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 10:29:33 user nova-compute[85141]: DEBUG nova.network.neutron [None req-5bb3f7e7-6b15-492e-a4bb-9b7ff0c2e088 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] [instance: 7437a3a3-9b7f-489b-b20b-f1b877ebb253] Successfully updated port: 7ba5e576-d9a3-44c7-a741-a9d1e510d7bf {{(pid=85141) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 10:29:33 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5bb3f7e7-6b15-492e-a4bb-9b7ff0c2e088 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] Acquiring lock "refresh_cache-7437a3a3-9b7f-489b-b20b-f1b877ebb253" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:29:33 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5bb3f7e7-6b15-492e-a4bb-9b7ff0c2e088 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] Acquired lock "refresh_cache-7437a3a3-9b7f-489b-b20b-f1b877ebb253" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:29:33 user nova-compute[85141]: DEBUG nova.network.neutron [None req-5bb3f7e7-6b15-492e-a4bb-9b7ff0c2e088 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] [instance: 7437a3a3-9b7f-489b-b20b-f1b877ebb253] Building network info cache for instance {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 10:29:33 user nova-compute[85141]: DEBUG nova.compute.manager [req-e7738e9f-d102-440e-bea3-2d0f561c2370 req-8b581956-6999-430e-970b-180af1673cfc service nova] [instance: 7437a3a3-9b7f-489b-b20b-f1b877ebb253] Received event network-changed-7ba5e576-d9a3-44c7-a741-a9d1e510d7bf {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:29:33 user nova-compute[85141]: DEBUG nova.compute.manager [req-e7738e9f-d102-440e-bea3-2d0f561c2370 req-8b581956-6999-430e-970b-180af1673cfc service nova] [instance: 7437a3a3-9b7f-489b-b20b-f1b877ebb253] Refreshing instance network info cache due to event network-changed-7ba5e576-d9a3-44c7-a741-a9d1e510d7bf. {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 10:29:33 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-e7738e9f-d102-440e-bea3-2d0f561c2370 req-8b581956-6999-430e-970b-180af1673cfc service nova] Acquiring lock "refresh_cache-7437a3a3-9b7f-489b-b20b-f1b877ebb253" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:29:33 user nova-compute[85141]: DEBUG nova.network.neutron [req-e0f439b3-ffce-4174-8bdf-fb8edd791cb1 req-18417784-b569-4446-ba43-cb8c9448d55b service nova] [instance: 97cbb145-d47e-4eb1-8c01-06361efa8720] Updated VIF entry in instance network info cache for port 440f9d6b-639a-4615-8b0c-e85b108f9734. {{(pid=85141) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 10:29:33 user nova-compute[85141]: DEBUG nova.network.neutron [req-e0f439b3-ffce-4174-8bdf-fb8edd791cb1 req-18417784-b569-4446-ba43-cb8c9448d55b service nova] [instance: 97cbb145-d47e-4eb1-8c01-06361efa8720] Updating instance_info_cache with network_info: [{"id": "440f9d6b-639a-4615-8b0c-e85b108f9734", "address": "fa:16:3e:dd:8c:7c", "network": {"id": "b8ada47f-9721-4358-ac4f-0305f06dbbb8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1663922860-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aec3bb9fe5e6446590900b5adf65df0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap440f9d6b-63", "ovs_interfaceid": "440f9d6b-639a-4615-8b0c-e85b108f9734", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:29:33 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-e0f439b3-ffce-4174-8bdf-fb8edd791cb1 req-18417784-b569-4446-ba43-cb8c9448d55b service nova] Releasing lock "refresh_cache-97cbb145-d47e-4eb1-8c01-06361efa8720" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:29:33 user nova-compute[85141]: DEBUG nova.network.neutron [None req-5bb3f7e7-6b15-492e-a4bb-9b7ff0c2e088 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] [instance: 7437a3a3-9b7f-489b-b20b-f1b877ebb253] Instance cache missing network info. {{(pid=85141) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 10:29:33 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Acquiring lock "refresh_cache-463034ff-14ce-477a-9642-4d86aa6f9cd9" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:29:33 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Acquired lock "refresh_cache-463034ff-14ce-477a-9642-4d86aa6f9cd9" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:29:33 user nova-compute[85141]: DEBUG nova.network.neutron [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] [instance: 463034ff-14ce-477a-9642-4d86aa6f9cd9] Forcefully refreshing network info cache for instance {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 10:29:33 user nova-compute[85141]: DEBUG nova.network.neutron [None req-5bb3f7e7-6b15-492e-a4bb-9b7ff0c2e088 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] [instance: 7437a3a3-9b7f-489b-b20b-f1b877ebb253] Updating instance_info_cache with network_info: [{"id": "7ba5e576-d9a3-44c7-a741-a9d1e510d7bf", "address": "fa:16:3e:7e:27:4c", "network": {"id": "c0ffc241-9899-4b62-b6bd-91034f92f286", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1997979107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f8eed15973c44ceb150fe51b6e55382", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ba5e576-d9", "ovs_interfaceid": "7ba5e576-d9a3-44c7-a741-a9d1e510d7bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:29:33 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5bb3f7e7-6b15-492e-a4bb-9b7ff0c2e088 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] Releasing lock "refresh_cache-7437a3a3-9b7f-489b-b20b-f1b877ebb253" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:29:33 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5bb3f7e7-6b15-492e-a4bb-9b7ff0c2e088 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] [instance: 7437a3a3-9b7f-489b-b20b-f1b877ebb253] Instance network_info: |[{"id": "7ba5e576-d9a3-44c7-a741-a9d1e510d7bf", "address": "fa:16:3e:7e:27:4c", "network": {"id": "c0ffc241-9899-4b62-b6bd-91034f92f286", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1997979107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f8eed15973c44ceb150fe51b6e55382", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ba5e576-d9", "ovs_interfaceid": "7ba5e576-d9a3-44c7-a741-a9d1e510d7bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=85141) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 10:29:33 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-e7738e9f-d102-440e-bea3-2d0f561c2370 req-8b581956-6999-430e-970b-180af1673cfc service nova] Acquired lock "refresh_cache-7437a3a3-9b7f-489b-b20b-f1b877ebb253" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:29:33 user nova-compute[85141]: DEBUG nova.network.neutron [req-e7738e9f-d102-440e-bea3-2d0f561c2370 req-8b581956-6999-430e-970b-180af1673cfc service nova] [instance: 7437a3a3-9b7f-489b-b20b-f1b877ebb253] Refreshing network info cache for port 7ba5e576-d9a3-44c7-a741-a9d1e510d7bf {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 10:29:33 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-5bb3f7e7-6b15-492e-a4bb-9b7ff0c2e088 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] [instance: 7437a3a3-9b7f-489b-b20b-f1b877ebb253] Start _get_guest_xml network_info=[{"id": "7ba5e576-d9a3-44c7-a741-a9d1e510d7bf", "address": "fa:16:3e:7e:27:4c", "network": {"id": "c0ffc241-9899-4b62-b6bd-91034f92f286", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1997979107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f8eed15973c44ceb150fe51b6e55382", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ba5e576-d9", "ovs_interfaceid": "7ba5e576-d9a3-44c7-a741-a9d1e510d7bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T10:06:42Z,direct_url=<?>,disk_format='qcow2',id=bc4ca70f-a459-4d5c-a9e6-80f1948eb48b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1044631a5fe84ce8904864a7024049fa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T10:06:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_options': None, 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'image_id': 'bc4ca70f-a459-4d5c-a9e6-80f1948eb48b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=85141) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 10:29:33 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-5bb3f7e7-6b15-492e-a4bb-9b7ff0c2e088 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:29:33 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-5bb3f7e7-6b15-492e-a4bb-9b7ff0c2e088 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:29:33 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-5bb3f7e7-6b15-492e-a4bb-9b7ff0c2e088 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=85141) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 10:29:33 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-5bb3f7e7-6b15-492e-a4bb-9b7ff0c2e088 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] CPU controller missing on host. {{(pid=85141) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 10:29:33 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-5bb3f7e7-6b15-492e-a4bb-9b7ff0c2e088 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=85141) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 10:29:33 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-5bb3f7e7-6b15-492e-a4bb-9b7ff0c2e088 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] CPU controller found on host. {{(pid=85141) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 10:29:33 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-5bb3f7e7-6b15-492e-a4bb-9b7ff0c2e088 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=85141) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 10:29:33 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-5bb3f7e7-6b15-492e-a4bb-9b7ff0c2e088 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T10:06:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T10:06:42Z,direct_url=<?>,disk_format='qcow2',id=bc4ca70f-a459-4d5c-a9e6-80f1948eb48b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1044631a5fe84ce8904864a7024049fa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T10:06:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 10:29:33 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-5bb3f7e7-6b15-492e-a4bb-9b7ff0c2e088 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] Flavor limits 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 10:29:33 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-5bb3f7e7-6b15-492e-a4bb-9b7ff0c2e088 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] Image limits 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 10:29:33 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-5bb3f7e7-6b15-492e-a4bb-9b7ff0c2e088 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] Flavor pref 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 10:29:33 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-5bb3f7e7-6b15-492e-a4bb-9b7ff0c2e088 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] Image pref 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 10:29:33 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-5bb3f7e7-6b15-492e-a4bb-9b7ff0c2e088 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 10:29:33 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-5bb3f7e7-6b15-492e-a4bb-9b7ff0c2e088 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 10:29:33 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-5bb3f7e7-6b15-492e-a4bb-9b7ff0c2e088 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=85141) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 10:29:33 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-5bb3f7e7-6b15-492e-a4bb-9b7ff0c2e088 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] Got 1 possible topologies {{(pid=85141) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 10:29:33 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-5bb3f7e7-6b15-492e-a4bb-9b7ff0c2e088 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 10:29:33 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-5bb3f7e7-6b15-492e-a4bb-9b7ff0c2e088 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 10:29:33 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-5bb3f7e7-6b15-492e-a4bb-9b7ff0c2e088 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T10:29:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-344901009',display_name='tempest-TestServerVolumeAttachmentScenario-server-344901009',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-344901009',id=42,image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMPvNrJSbRFMMDGjY7pKVtR6fsIphJmAIkVfmPnNBpGgwuYrzeznF0GPJnZpOJW4HMhScDqKhb10B+EJdjQGkSKKZhgNAGBFRTq8D4waukkY4mEvjEABbIM0+P6o1SOizQ==',key_name='tempest-keypair-461665202',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0f8eed15973c44ceb150fe51b6e55382',ramdisk_id='',reservation_id='r-zkqkb6dl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-808328756',owner_user_name='tempest-TestServerVolumeAttachmentScenario-808328756-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T10:29:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7127276ead2d4cae9d562bec932c5512',uuid=7437a3a3-9b7f-489b-b20b-f1b877ebb253,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7ba5e576-d9a3-44c7-a741-a9d1e510d7bf", "address": "fa:16:3e:7e:27:4c", "network": {"id": "c0ffc241-9899-4b62-b6bd-91034f92f286", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1997979107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f8eed15973c44ceb150fe51b6e55382", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ba5e576-d9", "ovs_interfaceid": "7ba5e576-d9a3-44c7-a741-a9d1e510d7bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=85141) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 10:29:33 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-5bb3f7e7-6b15-492e-a4bb-9b7ff0c2e088 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] Converting VIF {"id": "7ba5e576-d9a3-44c7-a741-a9d1e510d7bf", "address": "fa:16:3e:7e:27:4c", "network": {"id": "c0ffc241-9899-4b62-b6bd-91034f92f286", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1997979107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f8eed15973c44ceb150fe51b6e55382", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ba5e576-d9", "ovs_interfaceid": "7ba5e576-d9a3-44c7-a741-a9d1e510d7bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:29:33 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-5bb3f7e7-6b15-492e-a4bb-9b7ff0c2e088 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:27:4c,bridge_name='br-int',has_traffic_filtering=True,id=7ba5e576-d9a3-44c7-a741-a9d1e510d7bf,network=Network(c0ffc241-9899-4b62-b6bd-91034f92f286),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ba5e576-d9') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:29:33 user nova-compute[85141]: DEBUG nova.objects.instance [None req-5bb3f7e7-6b15-492e-a4bb-9b7ff0c2e088 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] Lazy-loading 'pci_devices' on Instance uuid 7437a3a3-9b7f-489b-b20b-f1b877ebb253 {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:29:33 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-5bb3f7e7-6b15-492e-a4bb-9b7ff0c2e088 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] [instance: 7437a3a3-9b7f-489b-b20b-f1b877ebb253] End _get_guest_xml xml=<domain type="kvm">
Nov 16 10:29:33 user nova-compute[85141]:   <uuid>7437a3a3-9b7f-489b-b20b-f1b877ebb253</uuid>
Nov 16 10:29:33 user nova-compute[85141]:   <name>instance-0000002a</name>
Nov 16 10:29:33 user nova-compute[85141]:   <memory>524288</memory>
Nov 16 10:29:33 user nova-compute[85141]:   <vcpu>1</vcpu>
Nov 16 10:29:33 user nova-compute[85141]:   <metadata>
Nov 16 10:29:33 user nova-compute[85141]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 10:29:33 user nova-compute[85141]:       <nova:package version="0.0.0"/>
Nov 16 10:29:33 user nova-compute[85141]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-344901009</nova:name>
Nov 16 10:29:33 user nova-compute[85141]:       <nova:creationTime>2023-11-16 10:29:33</nova:creationTime>
Nov 16 10:29:33 user nova-compute[85141]:       <nova:flavor name="m1.tiny">
Nov 16 10:29:33 user nova-compute[85141]:         <nova:memory>512</nova:memory>
Nov 16 10:29:33 user nova-compute[85141]:         <nova:disk>1</nova:disk>
Nov 16 10:29:33 user nova-compute[85141]:         <nova:swap>0</nova:swap>
Nov 16 10:29:33 user nova-compute[85141]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 10:29:33 user nova-compute[85141]:         <nova:vcpus>1</nova:vcpus>
Nov 16 10:29:33 user nova-compute[85141]:       </nova:flavor>
Nov 16 10:29:33 user nova-compute[85141]:       <nova:owner>
Nov 16 10:29:33 user nova-compute[85141]:         <nova:user uuid="7127276ead2d4cae9d562bec932c5512">tempest-TestServerVolumeAttachmentScenario-808328756-project-member</nova:user>
Nov 16 10:29:33 user nova-compute[85141]:         <nova:project uuid="0f8eed15973c44ceb150fe51b6e55382">tempest-TestServerVolumeAttachmentScenario-808328756</nova:project>
Nov 16 10:29:33 user nova-compute[85141]:       </nova:owner>
Nov 16 10:29:33 user nova-compute[85141]:       <nova:root type="image" uuid="bc4ca70f-a459-4d5c-a9e6-80f1948eb48b"/>
Nov 16 10:29:33 user nova-compute[85141]:       <nova:ports>
Nov 16 10:29:33 user nova-compute[85141]:         <nova:port uuid="7ba5e576-d9a3-44c7-a741-a9d1e510d7bf">
Nov 16 10:29:33 user nova-compute[85141]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 16 10:29:33 user nova-compute[85141]:         </nova:port>
Nov 16 10:29:33 user nova-compute[85141]:       </nova:ports>
Nov 16 10:29:33 user nova-compute[85141]:     </nova:instance>
Nov 16 10:29:33 user nova-compute[85141]:   </metadata>
Nov 16 10:29:33 user nova-compute[85141]:   <sysinfo type="smbios">
Nov 16 10:29:33 user nova-compute[85141]:     <system>
Nov 16 10:29:33 user nova-compute[85141]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 10:29:33 user nova-compute[85141]:       <entry name="product">OpenStack Nova</entry>
Nov 16 10:29:33 user nova-compute[85141]:       <entry name="version">0.0.0</entry>
Nov 16 10:29:33 user nova-compute[85141]:       <entry name="serial">7437a3a3-9b7f-489b-b20b-f1b877ebb253</entry>
Nov 16 10:29:33 user nova-compute[85141]:       <entry name="uuid">7437a3a3-9b7f-489b-b20b-f1b877ebb253</entry>
Nov 16 10:29:33 user nova-compute[85141]:       <entry name="family">Virtual Machine</entry>
Nov 16 10:29:33 user nova-compute[85141]:     </system>
Nov 16 10:29:33 user nova-compute[85141]:   </sysinfo>
Nov 16 10:29:33 user nova-compute[85141]:   <os>
Nov 16 10:29:33 user nova-compute[85141]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 10:29:33 user nova-compute[85141]:     <boot dev="hd"/>
Nov 16 10:29:33 user nova-compute[85141]:     <smbios mode="sysinfo"/>
Nov 16 10:29:33 user nova-compute[85141]:   </os>
Nov 16 10:29:33 user nova-compute[85141]:   <features>
Nov 16 10:29:33 user nova-compute[85141]:     <acpi/>
Nov 16 10:29:33 user nova-compute[85141]:     <apic/>
Nov 16 10:29:33 user nova-compute[85141]:     <vmcoreinfo/>
Nov 16 10:29:33 user nova-compute[85141]:   </features>
Nov 16 10:29:33 user nova-compute[85141]:   <clock offset="utc">
Nov 16 10:29:33 user nova-compute[85141]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 10:29:33 user nova-compute[85141]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 10:29:33 user nova-compute[85141]:     <timer name="hpet" present="no"/>
Nov 16 10:29:33 user nova-compute[85141]:   </clock>
Nov 16 10:29:33 user nova-compute[85141]:   <cpu mode="custom" match="exact">
Nov 16 10:29:33 user nova-compute[85141]:     <model>Nehalem</model>
Nov 16 10:29:33 user nova-compute[85141]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 10:29:33 user nova-compute[85141]:   </cpu>
Nov 16 10:29:33 user nova-compute[85141]:   <devices>
Nov 16 10:29:33 user nova-compute[85141]:     <disk type="file" device="disk">
Nov 16 10:29:33 user nova-compute[85141]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 10:29:33 user nova-compute[85141]:       <source file="/opt/stack/data/nova/instances/7437a3a3-9b7f-489b-b20b-f1b877ebb253/disk"/>
Nov 16 10:29:33 user nova-compute[85141]:       <target dev="vda" bus="virtio"/>
Nov 16 10:29:33 user nova-compute[85141]:     </disk>
Nov 16 10:29:33 user nova-compute[85141]:     <interface type="ethernet">
Nov 16 10:29:33 user nova-compute[85141]:       <mac address="fa:16:3e:7e:27:4c"/>
Nov 16 10:29:33 user nova-compute[85141]:       <model type="virtio"/>
Nov 16 10:29:33 user nova-compute[85141]:       <mtu size="1442"/>
Nov 16 10:29:33 user nova-compute[85141]:       <target dev="tap7ba5e576-d9"/>
Nov 16 10:29:33 user nova-compute[85141]:     </interface>
Nov 16 10:29:33 user nova-compute[85141]:     <serial type="pty">
Nov 16 10:29:33 user nova-compute[85141]:       <log file="/opt/stack/data/nova/instances/7437a3a3-9b7f-489b-b20b-f1b877ebb253/console.log" append="off"/>
Nov 16 10:29:33 user nova-compute[85141]:     </serial>
Nov 16 10:29:33 user nova-compute[85141]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 10:29:33 user nova-compute[85141]:     <video>
Nov 16 10:29:33 user nova-compute[85141]:       <model type="virtio"/>
Nov 16 10:29:33 user nova-compute[85141]:     </video>
Nov 16 10:29:33 user nova-compute[85141]:     <rng model="virtio">
Nov 16 10:29:33 user nova-compute[85141]:       <backend model="random">/dev/urandom</backend>
Nov 16 10:29:33 user nova-compute[85141]:     </rng>
Nov 16 10:29:33 user nova-compute[85141]:     <controller type="usb" index="0" model="none"/>
Nov 16 10:29:33 user nova-compute[85141]:     <memballoon model="virtio">
Nov 16 10:29:33 user nova-compute[85141]:       <stats period="10"/>
Nov 16 10:29:33 user nova-compute[85141]:     </memballoon>
Nov 16 10:29:33 user nova-compute[85141]:   </devices>
Nov 16 10:29:33 user nova-compute[85141]: </domain>
Nov 16 10:29:33 user nova-compute[85141]:  {{(pid=85141) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 10:29:33 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-5bb3f7e7-6b15-492e-a4bb-9b7ff0c2e088 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T10:29:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-344901009',display_name='tempest-TestServerVolumeAttachmentScenario-server-344901009',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-344901009',id=42,image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMPvNrJSbRFMMDGjY7pKVtR6fsIphJmAIkVfmPnNBpGgwuYrzeznF0GPJnZpOJW4HMhScDqKhb10B+EJdjQGkSKKZhgNAGBFRTq8D4waukkY4mEvjEABbIM0+P6o1SOizQ==',key_name='tempest-keypair-461665202',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0f8eed15973c44ceb150fe51b6e55382',ramdisk_id='',reservation_id='r-zkqkb6dl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-808328756',owner_user_name='tempest-TestServerVolumeAttachmentScenario-808328756-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T10:29:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7127276ead2d4cae9d562bec932c5512',uuid=7437a3a3-9b7f-489b-b20b-f1b877ebb253,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7ba5e576-d9a3-44c7-a741-a9d1e510d7bf", "address": "fa:16:3e:7e:27:4c", "network": {"id": "c0ffc241-9899-4b62-b6bd-91034f92f286", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1997979107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f8eed15973c44ceb150fe51b6e55382", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ba5e576-d9", "ovs_interfaceid": "7ba5e576-d9a3-44c7-a741-a9d1e510d7bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 10:29:33 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-5bb3f7e7-6b15-492e-a4bb-9b7ff0c2e088 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] Converting VIF {"id": "7ba5e576-d9a3-44c7-a741-a9d1e510d7bf", "address": "fa:16:3e:7e:27:4c", "network": {"id": "c0ffc241-9899-4b62-b6bd-91034f92f286", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1997979107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f8eed15973c44ceb150fe51b6e55382", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ba5e576-d9", "ovs_interfaceid": "7ba5e576-d9a3-44c7-a741-a9d1e510d7bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:29:33 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-5bb3f7e7-6b15-492e-a4bb-9b7ff0c2e088 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:27:4c,bridge_name='br-int',has_traffic_filtering=True,id=7ba5e576-d9a3-44c7-a741-a9d1e510d7bf,network=Network(c0ffc241-9899-4b62-b6bd-91034f92f286),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ba5e576-d9') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:29:33 user nova-compute[85141]: DEBUG os_vif [None req-5bb3f7e7-6b15-492e-a4bb-9b7ff0c2e088 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:27:4c,bridge_name='br-int',has_traffic_filtering=True,id=7ba5e576-d9a3-44c7-a741-a9d1e510d7bf,network=Network(c0ffc241-9899-4b62-b6bd-91034f92f286),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ba5e576-d9') {{(pid=85141) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 10:29:33 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:29:33 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:29:33 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 10:29:33 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:29:33 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '720b1d66-cf27-5a25-a0ef-9b32663517c3', '_type': 'linux-noop'}}, row=False) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:29:33 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:29:33 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:29:33 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:29:33 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7ba5e576-d9, may_exist=True, interface_attrs={}) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:29:33 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7ba5e576-d9, col_values=(('qos', UUID('b8a7ced1-9c7e-4267-b56e-aa58d894cbea')),), if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:29:33 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7ba5e576-d9, col_values=(('external_ids', {'iface-id': '7ba5e576-d9a3-44c7-a741-a9d1e510d7bf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7e:27:4c', 'vm-uuid': '7437a3a3-9b7f-489b-b20b-f1b877ebb253'}),), if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:29:33 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:29:33 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:29:33 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:29:33 user nova-compute[85141]: INFO os_vif [None req-5bb3f7e7-6b15-492e-a4bb-9b7ff0c2e088 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:27:4c,bridge_name='br-int',has_traffic_filtering=True,id=7ba5e576-d9a3-44c7-a741-a9d1e510d7bf,network=Network(c0ffc241-9899-4b62-b6bd-91034f92f286),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ba5e576-d9')
Nov 16 10:29:33 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-5bb3f7e7-6b15-492e-a4bb-9b7ff0c2e088 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] No BDM found with device name vda, not building metadata. {{(pid=85141) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 10:29:33 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-5bb3f7e7-6b15-492e-a4bb-9b7ff0c2e088 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] No VIF found with MAC fa:16:3e:7e:27:4c, not building metadata {{(pid=85141) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 10:29:33 user nova-compute[85141]: DEBUG nova.network.neutron [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] [instance: 463034ff-14ce-477a-9642-4d86aa6f9cd9] Updating instance_info_cache with network_info: [{"id": "121bbc09-53cf-4586-8585-655079b4c49b", "address": "fa:16:3e:b0:77:d5", "network": {"id": "5b67a3fd-ef1e-4f2c-b6e0-31766ef39d30", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2137186235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09b520de67ac4290a4b779f50afeb1a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap121bbc09-53", "ovs_interfaceid": "121bbc09-53cf-4586-8585-655079b4c49b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:29:33 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Releasing lock "refresh_cache-463034ff-14ce-477a-9642-4d86aa6f9cd9" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:29:33 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] [instance: 463034ff-14ce-477a-9642-4d86aa6f9cd9] Updated the network info_cache for instance {{(pid=85141) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 10:29:34 user nova-compute[85141]: DEBUG nova.network.neutron [req-e7738e9f-d102-440e-bea3-2d0f561c2370 req-8b581956-6999-430e-970b-180af1673cfc service nova] [instance: 7437a3a3-9b7f-489b-b20b-f1b877ebb253] Updated VIF entry in instance network info cache for port 7ba5e576-d9a3-44c7-a741-a9d1e510d7bf. {{(pid=85141) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 10:29:34 user nova-compute[85141]: DEBUG nova.network.neutron [req-e7738e9f-d102-440e-bea3-2d0f561c2370 req-8b581956-6999-430e-970b-180af1673cfc service nova] [instance: 7437a3a3-9b7f-489b-b20b-f1b877ebb253] Updating instance_info_cache with network_info: [{"id": "7ba5e576-d9a3-44c7-a741-a9d1e510d7bf", "address": "fa:16:3e:7e:27:4c", "network": {"id": "c0ffc241-9899-4b62-b6bd-91034f92f286", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1997979107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f8eed15973c44ceb150fe51b6e55382", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ba5e576-d9", "ovs_interfaceid": "7ba5e576-d9a3-44c7-a741-a9d1e510d7bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:29:34 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-e7738e9f-d102-440e-bea3-2d0f561c2370 req-8b581956-6999-430e-970b-180af1673cfc service nova] Releasing lock "refresh_cache-7437a3a3-9b7f-489b-b20b-f1b877ebb253" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:29:35 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:29:35 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:29:35 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:29:35 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:29:35 user nova-compute[85141]: DEBUG nova.compute.manager [req-3f0de774-41d8-4b56-be2f-0507857bfb55 req-b393a93b-c60a-46f8-b391-02e9c875e9ba service nova] [instance: 7437a3a3-9b7f-489b-b20b-f1b877ebb253] Received event network-vif-plugged-7ba5e576-d9a3-44c7-a741-a9d1e510d7bf {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:29:35 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-3f0de774-41d8-4b56-be2f-0507857bfb55 req-b393a93b-c60a-46f8-b391-02e9c875e9ba service nova] Acquiring lock "7437a3a3-9b7f-489b-b20b-f1b877ebb253-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:29:35 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-3f0de774-41d8-4b56-be2f-0507857bfb55 req-b393a93b-c60a-46f8-b391-02e9c875e9ba service nova] Lock "7437a3a3-9b7f-489b-b20b-f1b877ebb253-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:29:35 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-3f0de774-41d8-4b56-be2f-0507857bfb55 req-b393a93b-c60a-46f8-b391-02e9c875e9ba service nova] Lock "7437a3a3-9b7f-489b-b20b-f1b877ebb253-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:29:35 user nova-compute[85141]: DEBUG nova.compute.manager [req-3f0de774-41d8-4b56-be2f-0507857bfb55 req-b393a93b-c60a-46f8-b391-02e9c875e9ba service nova] [instance: 7437a3a3-9b7f-489b-b20b-f1b877ebb253] No waiting events found dispatching network-vif-plugged-7ba5e576-d9a3-44c7-a741-a9d1e510d7bf {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:29:35 user nova-compute[85141]: WARNING nova.compute.manager [req-3f0de774-41d8-4b56-be2f-0507857bfb55 req-b393a93b-c60a-46f8-b391-02e9c875e9ba service nova] [instance: 7437a3a3-9b7f-489b-b20b-f1b877ebb253] Received unexpected event network-vif-plugged-7ba5e576-d9a3-44c7-a741-a9d1e510d7bf for instance with vm_state building and task_state spawning.
Nov 16 10:29:35 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:29:35 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:29:35 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:29:36 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:29:36 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=85141) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 10:29:36 user nova-compute[85141]: DEBUG os_brick.utils [None req-1105ced2-56ea-4297-ae9e-dae52f36d2f7 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 10:29:36 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:29:36 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:29:36 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd014416-0b91-455c-99b4-b84b82decf44]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c7834de5c295\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:29:36 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:29:36 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:29:36 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cce6ae9-343e-4122-94d4-fc67f4a3ec06]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:29:36 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:29:36 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:29:36 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ec58d41-56b2-48ed-b2d3-45d9d8ac44b1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:29:36 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab6ec08b-b546-4b83-8312-949c2d8eedd6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:29:36 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-1105ced2-56ea-4297-ae9e-dae52f36d2f7 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Running cmd (subprocess): nvme version {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:29:36 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-1105ced2-56ea-4297-ae9e-dae52f36d2f7 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] 'nvme version' failed. Not Retrying. {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 10:29:36 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1105ced2-56ea-4297-ae9e-dae52f36d2f7 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] nvme not present on system {{(pid=85141) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 10:29:36 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:29:36 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 10:29:36 user nova-compute[85141]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 10:29:36 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[4faadfa6-e932-402d-aae8-2634ce4bc9fb]: (4, '') {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:29:36 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.lightos [None req-1105ced2-56ea-4297-ae9e-dae52f36d2f7 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=85141) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 10:29:36 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.lightos [None req-1105ced2-56ea-4297-ae9e-dae52f36d2f7 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=85141) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 10:29:36 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.lightos [None req-1105ced2-56ea-4297-ae9e-dae52f36d2f7 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] LIGHTOS: no hostnqn found. {{(pid=85141) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 10:29:36 user nova-compute[85141]: DEBUG os_brick.utils [None req-1105ced2-56ea-4297-ae9e-dae52f36d2f7 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c7834de5c295', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 10:29:36 user nova-compute[85141]: DEBUG nova.virt.block_device [None req-1105ced2-56ea-4297-ae9e-dae52f36d2f7 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: 97cbb145-d47e-4eb1-8c01-06361efa8720] Updating existing volume attachment record: 8cabbe8a-d0c2-4fdb-b555-923955d5aca5 {{(pid=85141) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 10:29:37 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5bb3f7e7-6b15-492e-a4bb-9b7ff0c2e088 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] [instance: 7437a3a3-9b7f-489b-b20b-f1b877ebb253] Instance event wait completed in 0 seconds for  {{(pid=85141) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 10:29:37 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-5bb3f7e7-6b15-492e-a4bb-9b7ff0c2e088 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] [instance: 7437a3a3-9b7f-489b-b20b-f1b877ebb253] Guest created on hypervisor {{(pid=85141) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 10:29:37 user nova-compute[85141]: INFO nova.virt.libvirt.driver [-] [instance: 7437a3a3-9b7f-489b-b20b-f1b877ebb253] Instance spawned successfully.
Nov 16 10:29:37 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-5bb3f7e7-6b15-492e-a4bb-9b7ff0c2e088 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] [instance: 7437a3a3-9b7f-489b-b20b-f1b877ebb253] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 10:29:37 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-5bb3f7e7-6b15-492e-a4bb-9b7ff0c2e088 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] [instance: 7437a3a3-9b7f-489b-b20b-f1b877ebb253] Found default for hw_cdrom_bus of ide {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:29:37 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-5bb3f7e7-6b15-492e-a4bb-9b7ff0c2e088 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] [instance: 7437a3a3-9b7f-489b-b20b-f1b877ebb253] Found default for hw_disk_bus of virtio {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:29:37 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-5bb3f7e7-6b15-492e-a4bb-9b7ff0c2e088 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] [instance: 7437a3a3-9b7f-489b-b20b-f1b877ebb253] Found default for hw_input_bus of None {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:29:37 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-5bb3f7e7-6b15-492e-a4bb-9b7ff0c2e088 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] [instance: 7437a3a3-9b7f-489b-b20b-f1b877ebb253] Found default for hw_pointer_model of None {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:29:37 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-5bb3f7e7-6b15-492e-a4bb-9b7ff0c2e088 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] [instance: 7437a3a3-9b7f-489b-b20b-f1b877ebb253] Found default for hw_video_model of virtio {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:29:37 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-5bb3f7e7-6b15-492e-a4bb-9b7ff0c2e088 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] [instance: 7437a3a3-9b7f-489b-b20b-f1b877ebb253] Found default for hw_vif_model of virtio {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:29:37 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:29:37 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:29:37 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager.update_available_resource {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:29:37 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:29:37 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:29:37 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:29:37 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Auditing locally available compute resources for user (node: user) {{(pid=85141) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 10:29:37 user nova-compute[85141]: INFO nova.compute.manager [None req-5bb3f7e7-6b15-492e-a4bb-9b7ff0c2e088 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] [instance: 7437a3a3-9b7f-489b-b20b-f1b877ebb253] Took 5.83 seconds to spawn the instance on the hypervisor.
Nov 16 10:29:37 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5bb3f7e7-6b15-492e-a4bb-9b7ff0c2e088 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] [instance: 7437a3a3-9b7f-489b-b20b-f1b877ebb253] Checking state {{(pid=85141) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 10:29:37 user nova-compute[85141]: DEBUG nova.compute.manager [req-e5c33e11-915d-46fc-93bb-5f1e78940519 req-fd157d7b-3b65-46be-beaf-192832efdcad service nova] [instance: 7437a3a3-9b7f-489b-b20b-f1b877ebb253] Received event network-vif-plugged-7ba5e576-d9a3-44c7-a741-a9d1e510d7bf {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:29:37 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-e5c33e11-915d-46fc-93bb-5f1e78940519 req-fd157d7b-3b65-46be-beaf-192832efdcad service nova] Acquiring lock "7437a3a3-9b7f-489b-b20b-f1b877ebb253-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:29:37 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-e5c33e11-915d-46fc-93bb-5f1e78940519 req-fd157d7b-3b65-46be-beaf-192832efdcad service nova] Lock "7437a3a3-9b7f-489b-b20b-f1b877ebb253-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:29:37 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-e5c33e11-915d-46fc-93bb-5f1e78940519 req-fd157d7b-3b65-46be-beaf-192832efdcad service nova] Lock "7437a3a3-9b7f-489b-b20b-f1b877ebb253-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:29:37 user nova-compute[85141]: DEBUG nova.compute.manager [req-e5c33e11-915d-46fc-93bb-5f1e78940519 req-fd157d7b-3b65-46be-beaf-192832efdcad service nova] [instance: 7437a3a3-9b7f-489b-b20b-f1b877ebb253] No waiting events found dispatching network-vif-plugged-7ba5e576-d9a3-44c7-a741-a9d1e510d7bf {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:29:37 user nova-compute[85141]: WARNING nova.compute.manager [req-e5c33e11-915d-46fc-93bb-5f1e78940519 req-fd157d7b-3b65-46be-beaf-192832efdcad service nova] [instance: 7437a3a3-9b7f-489b-b20b-f1b877ebb253] Received unexpected event network-vif-plugged-7ba5e576-d9a3-44c7-a741-a9d1e510d7bf for instance with vm_state building and task_state spawning.
Nov 16 10:29:37 user nova-compute[85141]: INFO nova.compute.manager [None req-5bb3f7e7-6b15-492e-a4bb-9b7ff0c2e088 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] [instance: 7437a3a3-9b7f-489b-b20b-f1b877ebb253] Took 6.83 seconds to build instance.
Nov 16 10:29:37 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5bb3f7e7-6b15-492e-a4bb-9b7ff0c2e088 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] Lock "7437a3a3-9b7f-489b-b20b-f1b877ebb253" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.936s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:29:37 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/463034ff-14ce-477a-9642-4d86aa6f9cd9/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:29:37 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/463034ff-14ce-477a-9642-4d86aa6f9cd9/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:29:37 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/463034ff-14ce-477a-9642-4d86aa6f9cd9/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:29:37 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/463034ff-14ce-477a-9642-4d86aa6f9cd9/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:29:37 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a507c85-0369-48ea-8858-3e7d346b4cb0/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:29:38 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a507c85-0369-48ea-8858-3e7d346b4cb0/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:29:38 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a507c85-0369-48ea-8858-3e7d346b4cb0/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:29:38 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:29:38 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a507c85-0369-48ea-8858-3e7d346b4cb0/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:29:38 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e214bbb-5bbb-4e6f-ac09-9cb1412f068b/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:29:38 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e214bbb-5bbb-4e6f-ac09-9cb1412f068b/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:29:38 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e214bbb-5bbb-4e6f-ac09-9cb1412f068b/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:29:38 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e214bbb-5bbb-4e6f-ac09-9cb1412f068b/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:29:38 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d842f90e-663b-4c95-9d7c-d092d2bac41f/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:29:38 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:29:38 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d842f90e-663b-4c95-9d7c-d092d2bac41f/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:29:38 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d842f90e-663b-4c95-9d7c-d092d2bac41f/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:29:39 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d842f90e-663b-4c95-9d7c-d092d2bac41f/disk --force-share --output=json" returned: 0 in 0.261s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:29:39 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=85141) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 10:29:39 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89e358d7-0844-4742-853b-ff88800415d2/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:29:39 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89e358d7-0844-4742-853b-ff88800415d2/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:29:39 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89e358d7-0844-4742-853b-ff88800415d2/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:29:39 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89e358d7-0844-4742-853b-ff88800415d2/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:29:39 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=85141) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 10:29:39 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7437a3a3-9b7f-489b-b20b-f1b877ebb253/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:29:39 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7437a3a3-9b7f-489b-b20b-f1b877ebb253/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:29:39 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7437a3a3-9b7f-489b-b20b-f1b877ebb253/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:29:40 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7437a3a3-9b7f-489b-b20b-f1b877ebb253/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:29:40 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b24c3954-06ff-4e15-9e43-c65d1dae7a5d/disk.rescue --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:29:40 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b24c3954-06ff-4e15-9e43-c65d1dae7a5d/disk.rescue --force-share --output=json" returned: 0 in 0.247s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:29:40 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b24c3954-06ff-4e15-9e43-c65d1dae7a5d/disk.rescue --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:29:40 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b24c3954-06ff-4e15-9e43-c65d1dae7a5d/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:29:40 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b24c3954-06ff-4e15-9e43-c65d1dae7a5d/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:29:40 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b24c3954-06ff-4e15-9e43-c65d1dae7a5d/disk --force-share --output=json" returned: 0 in 0.275s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:29:40 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b24c3954-06ff-4e15-9e43-c65d1dae7a5d/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:29:40 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b24c3954-06ff-4e15-9e43-c65d1dae7a5d/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:29:40 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/059d6974-bd0c-4f73-91fc-8202ebda4238/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:29:41 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/059d6974-bd0c-4f73-91fc-8202ebda4238/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:29:41 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/059d6974-bd0c-4f73-91fc-8202ebda4238/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:29:41 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/059d6974-bd0c-4f73-91fc-8202ebda4238/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:29:41 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=85141) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 10:29:41 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da42de06-4518-4c8a-8c63-9b5a2759a1bf/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:29:41 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da42de06-4518-4c8a-8c63-9b5a2759a1bf/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:29:41 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da42de06-4518-4c8a-8c63-9b5a2759a1bf/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:29:41 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da42de06-4518-4c8a-8c63-9b5a2759a1bf/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:29:41 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7628b43b-5b22-440b-a27b-bf2e28b93cf6/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:29:41 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7628b43b-5b22-440b-a27b-bf2e28b93cf6/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:29:41 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7628b43b-5b22-440b-a27b-bf2e28b93cf6/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:29:42 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7628b43b-5b22-440b-a27b-bf2e28b93cf6/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:29:42 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:29:42 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:29:42 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Hypervisor/Node resource view: name=user free_ram=7201MB free_disk=24.885578155517578GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=85141) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 10:29:42 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:29:42 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:29:42 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance d842f90e-663b-4c95-9d7c-d092d2bac41f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:29:42 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance f01dc8cf-1a69-4618-a15d-0c1075157f05 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:29:42 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance 059d6974-bd0c-4f73-91fc-8202ebda4238 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:29:42 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance 4e214bbb-5bbb-4e6f-ac09-9cb1412f068b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:29:42 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance b24c3954-06ff-4e15-9e43-c65d1dae7a5d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:29:42 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance 463034ff-14ce-477a-9642-4d86aa6f9cd9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:29:42 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance 5a507c85-0369-48ea-8858-3e7d346b4cb0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:29:42 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance bc76703d-9243-4277-9b13-d6f9639cd1bb actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:29:42 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance e1253324-3ca1-4610-b9d6-3db7c6c76828 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:29:42 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance da42de06-4518-4c8a-8c63-9b5a2759a1bf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:29:42 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance 89e358d7-0844-4742-853b-ff88800415d2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:29:42 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance 7628b43b-5b22-440b-a27b-bf2e28b93cf6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:29:42 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance 97cbb145-d47e-4eb1-8c01-06361efa8720 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:29:42 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance 7437a3a3-9b7f-489b-b20b-f1b877ebb253 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:29:42 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Total usable vcpus: 12, total allocated vcpus: 14 {{(pid=85141) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 10:29:42 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Final resource view: name=user phys_ram=16011MB used_ram=9216MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=14 pci_stats=[] {{(pid=85141) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 10:29:42 user nova-compute[85141]: DEBUG nova.compute.manager [None req-1105ced2-56ea-4297-ae9e-dae52f36d2f7 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: 97cbb145-d47e-4eb1-8c01-06361efa8720] Start spawning the instance on the hypervisor. {{(pid=85141) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 10:29:42 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-1105ced2-56ea-4297-ae9e-dae52f36d2f7 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: 97cbb145-d47e-4eb1-8c01-06361efa8720] Creating instance directory {{(pid=85141) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 10:29:42 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-1105ced2-56ea-4297-ae9e-dae52f36d2f7 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: 97cbb145-d47e-4eb1-8c01-06361efa8720] Creating image(s)
Nov 16 10:29:42 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-1105ced2-56ea-4297-ae9e-dae52f36d2f7 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: 97cbb145-d47e-4eb1-8c01-06361efa8720] Did not create local disks {{(pid=85141) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 16 10:29:42 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-1105ced2-56ea-4297-ae9e-dae52f36d2f7 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: 97cbb145-d47e-4eb1-8c01-06361efa8720] Ensure instance console log exists: /opt/stack/data/nova/instances/97cbb145-d47e-4eb1-8c01-06361efa8720/console.log {{(pid=85141) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 10:29:42 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-1105ced2-56ea-4297-ae9e-dae52f36d2f7 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:29:42 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-1105ced2-56ea-4297-ae9e-dae52f36d2f7 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:29:42 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-1105ced2-56ea-4297-ae9e-dae52f36d2f7 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:29:42 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-1105ced2-56ea-4297-ae9e-dae52f36d2f7 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: 97cbb145-d47e-4eb1-8c01-06361efa8720] Start _get_guest_xml network_info=[{"id": "440f9d6b-639a-4615-8b0c-e85b108f9734", "address": "fa:16:3e:dd:8c:7c", "network": {"id": "b8ada47f-9721-4358-ac4f-0305f06dbbb8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1663922860-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aec3bb9fe5e6446590900b5adf65df0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap440f9d6b-63", "ovs_interfaceid": "440f9d6b-639a-4615-8b0c-e85b108f9734", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-16T10:29:25Z,direct_url=<?>,disk_format='qcow2',id=05b3847f-6c57-4cd1-866c-4094a2603dcb,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-764666510',owner='aec3bb9fe5e6446590900b5adf65df0f',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-16T10:29:27Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:925fd9db-7153-4861-bbc3-9cbb8822e196', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GCObvuko', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '97cbb145-d47e-4eb1-8c01-06361efa8720', 'attached_at': '', 'detached_at': '', 'volume_id': '925fd9db-7153-4861-bbc3-9cbb8822e196', 'serial': '925fd9db-7153-4861-bbc3-9cbb8822e196'}, 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'attachment_id': '8cabbe8a-d0c2-4fdb-b555-923955d5aca5', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=85141) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 10:29:42 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-1105ced2-56ea-4297-ae9e-dae52f36d2f7 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:29:42 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-1105ced2-56ea-4297-ae9e-dae52f36d2f7 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:29:42 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-1105ced2-56ea-4297-ae9e-dae52f36d2f7 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=85141) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 10:29:42 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-1105ced2-56ea-4297-ae9e-dae52f36d2f7 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] CPU controller missing on host. {{(pid=85141) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 10:29:42 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-1105ced2-56ea-4297-ae9e-dae52f36d2f7 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=85141) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 10:29:42 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-1105ced2-56ea-4297-ae9e-dae52f36d2f7 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] CPU controller found on host. {{(pid=85141) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 10:29:42 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-1105ced2-56ea-4297-ae9e-dae52f36d2f7 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=85141) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 10:29:42 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-1105ced2-56ea-4297-ae9e-dae52f36d2f7 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T10:06:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-16T10:29:25Z,direct_url=<?>,disk_format='qcow2',id=05b3847f-6c57-4cd1-866c-4094a2603dcb,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-764666510',owner='aec3bb9fe5e6446590900b5adf65df0f',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-16T10:29:27Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 10:29:42 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-1105ced2-56ea-4297-ae9e-dae52f36d2f7 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Flavor limits 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 10:29:42 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-1105ced2-56ea-4297-ae9e-dae52f36d2f7 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Image limits 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 10:29:42 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-1105ced2-56ea-4297-ae9e-dae52f36d2f7 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Flavor pref 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 10:29:42 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-1105ced2-56ea-4297-ae9e-dae52f36d2f7 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Image pref 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 10:29:42 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-1105ced2-56ea-4297-ae9e-dae52f36d2f7 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 10:29:42 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-1105ced2-56ea-4297-ae9e-dae52f36d2f7 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 10:29:42 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-1105ced2-56ea-4297-ae9e-dae52f36d2f7 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=85141) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 10:29:42 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-1105ced2-56ea-4297-ae9e-dae52f36d2f7 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Got 1 possible topologies {{(pid=85141) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 10:29:42 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-1105ced2-56ea-4297-ae9e-dae52f36d2f7 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 10:29:42 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-1105ced2-56ea-4297-ae9e-dae52f36d2f7 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 10:29:42 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1105ced2-56ea-4297-ae9e-dae52f36d2f7 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: 97cbb145-d47e-4eb1-8c01-06361efa8720] Calling os-brick to attach iSCSI Volume {{(pid=85141) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 10:29:42 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-1105ced2-56ea-4297-ae9e-dae52f36d2f7 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51806b6080>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:925fd9db-7153-4861-bbc3-9cbb8822e196', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GCObvuko', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 10:29:42 user nova-compute[85141]: WARNING os_brick.initiator.connectors.base [None req-1105ced2-56ea-4297-ae9e-dae52f36d2f7 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 10:29:42 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-1105ced2-56ea-4297-ae9e-dae52f36d2f7 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 10:29:42 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-1105ced2-56ea-4297-ae9e-dae52f36d2f7 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 10:29:42 user nova-compute[85141]: WARNING os_brick.initiator.connectors.base [None req-1105ced2-56ea-4297-ae9e-dae52f36d2f7 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 10:29:42 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-1105ced2-56ea-4297-ae9e-dae52f36d2f7 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:925fd9db-7153-4861-bbc3-9cbb8822e196" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 10:29:42 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-1105ced2-56ea-4297-ae9e-dae52f36d2f7 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:925fd9db-7153-4861-bbc3-9cbb8822e196" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 10:29:42 user nova-compute[85141]: INFO os_brick.initiator.connectors.iscsi [None req-1105ced2-56ea-4297-ae9e-dae52f36d2f7 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 10:29:42 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:925fd9db-7153-4861-bbc3-9cbb8822e196 -p 172.16.0.220:3260 {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:29:42 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:925fd9db-7153-4861-bbc3-9cbb8822e196 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:29:42 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f604cd1-846e-42b7-8cba-d9c5c0f1591b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:29:42 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-1105ced2-56ea-4297-ae9e-dae52f36d2f7 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 10:29:42 user nova-compute[85141]:  {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:29:42 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:925fd9db-7153-4861-bbc3-9cbb8822e196 -p 172.16.0.220:3260 --interface default --op new {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:29:42 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:925fd9db-7153-4861-bbc3-9cbb8822e196 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:29:42 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfc42436-d7eb-42f4-a91e-964cbb76d3e4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:925fd9db-7153-4861-bbc3-9cbb8822e196] added\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:29:42 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-1105ced2-56ea-4297-ae9e-dae52f36d2f7 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:925fd9db-7153-4861-bbc3-9cbb8822e196] added
Nov 16 10:29:42 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:29:42 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:925fd9db-7153-4861-bbc3-9cbb8822e196 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:29:43 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:925fd9db-7153-4861-bbc3-9cbb8822e196 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:29:43 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b996eba-b180-48b5-a5e3-bcea6b8c1dc3]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:29:43 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-1105ced2-56ea-4297-ae9e-dae52f36d2f7 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:29:43 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:925fd9db-7153-4861-bbc3-9cbb8822e196 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:29:43 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:925fd9db-7153-4861-bbc3-9cbb8822e196 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.037s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:29:43 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[dae9a3c0-ca12-4e2a-9745-ea80c695dd80]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:29:43 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-1105ced2-56ea-4297-ae9e-dae52f36d2f7 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:29:43 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:925fd9db-7153-4861-bbc3-9cbb8822e196 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GCObvuko {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:29:43 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:925fd9db-7153-4861-bbc3-9cbb8822e196 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GCObvuko" returned: 0 in 0.023s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:29:43 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[16451d44-33cb-4fcf-8813-f899ad4fb895]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:29:43 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-1105ced2-56ea-4297-ae9e-dae52f36d2f7 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GCObvuko'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:29:43 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:925fd9db-7153-4861-bbc3-9cbb8822e196 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:29:43 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:925fd9db-7153-4861-bbc3-9cbb8822e196 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:29:43 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3b7329e-6901-4b29-9256-3e9e80905ebf]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:29:43 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-1105ced2-56ea-4297-ae9e-dae52f36d2f7 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:29:43 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:29:43 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:29:43 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[9694e305-1e45-444d-a650-048b4162ef8b]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b58025-0c18-41f6-a126-fb3c925399a1 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2006a77c-e5e8-4ec5-8de5-a0f9505c429a (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0c5c19d-363b-4f5d-a04f-fb7de64423f2 (non-flash)\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:29:43 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-1105ced2-56ea-4297-ae9e-dae52f36d2f7 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)
Nov 16 10:29:43 user nova-compute[85141]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b58025-0c18-41f6-a126-fb3c925399a1 (non-flash)
Nov 16 10:29:43 user nova-compute[85141]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2006a77c-e5e8-4ec5-8de5-a0f9505c429a (non-flash)
Nov 16 10:29:43 user nova-compute[85141]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0c5c19d-363b-4f5d-a04f-fb7de64423f2 (non-flash)
Nov 16 10:29:43 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:29:43 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-1105ced2-56ea-4297-ae9e-dae52f36d2f7 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)
Nov 16 10:29:43 user nova-compute[85141]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b58025-0c18-41f6-a126-fb3c925399a1 (non-flash)
Nov 16 10:29:43 user nova-compute[85141]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2006a77c-e5e8-4ec5-8de5-a0f9505c429a (non-flash)
Nov 16 10:29:43 user nova-compute[85141]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0c5c19d-363b-4f5d-a04f-fb7de64423f2 (non-flash)
Nov 16 10:29:43 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 10:29:43 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:925fd9db-7153-4861-bbc3-9cbb8822e196 -p 172.16.0.220:3260 --login {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:29:43 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:925fd9db-7153-4861-bbc3-9cbb8822e196 -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:29:43 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[774b9b60-9b46-4f07-96cd-f13ce48cbdad]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:925fd9db-7153-4861-bbc3-9cbb8822e196, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:925fd9db-7153-4861-bbc3-9cbb8822e196, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:29:43 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-1105ced2-56ea-4297-ae9e-dae52f36d2f7 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:925fd9db-7153-4861-bbc3-9cbb8822e196, portal: 172.16.0.220,3260]
Nov 16 10:29:43 user nova-compute[85141]: Login to [iface: default, target: iqn.2010-10.org.openstack:925fd9db-7153-4861-bbc3-9cbb8822e196, portal: 172.16.0.220,3260] successful.
Nov 16 10:29:43 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:29:43 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:925fd9db-7153-4861-bbc3-9cbb8822e196 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:29:43 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:925fd9db-7153-4861-bbc3-9cbb8822e196 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:29:43 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[28931f54-f23c-447a-8e25-a59f3d459ae8]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:29:43 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-1105ced2-56ea-4297-ae9e-dae52f36d2f7 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:29:43 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:29:43 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:29:43 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:29:43 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ed0ca86-5aef-405a-8b01-6f0ccf09ffb6]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b58025-0c18-41f6-a126-fb3c925399a1 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2006a77c-e5e8-4ec5-8de5-a0f9505c429a (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0c5c19d-363b-4f5d-a04f-fb7de64423f2 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:925fd9db-7153-4861-bbc3-9cbb8822e196 (non-flash)\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:29:43 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-1105ced2-56ea-4297-ae9e-dae52f36d2f7 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)
Nov 16 10:29:43 user nova-compute[85141]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b58025-0c18-41f6-a126-fb3c925399a1 (non-flash)
Nov 16 10:29:43 user nova-compute[85141]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2006a77c-e5e8-4ec5-8de5-a0f9505c429a (non-flash)
Nov 16 10:29:43 user nova-compute[85141]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0c5c19d-363b-4f5d-a04f-fb7de64423f2 (non-flash)
Nov 16 10:29:43 user nova-compute[85141]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:925fd9db-7153-4861-bbc3-9cbb8822e196 (non-flash)
Nov 16 10:29:43 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:29:43 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-1105ced2-56ea-4297-ae9e-dae52f36d2f7 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)
Nov 16 10:29:43 user nova-compute[85141]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b58025-0c18-41f6-a126-fb3c925399a1 (non-flash)
Nov 16 10:29:43 user nova-compute[85141]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2006a77c-e5e8-4ec5-8de5-a0f9505c429a (non-flash)
Nov 16 10:29:43 user nova-compute[85141]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0c5c19d-363b-4f5d-a04f-fb7de64423f2 (non-flash)
Nov 16 10:29:43 user nova-compute[85141]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:925fd9db-7153-4861-bbc3-9cbb8822e196 (non-flash)
Nov 16 10:29:43 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 10:29:43 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-1105ced2-56ea-4297-ae9e-dae52f36d2f7 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:925fd9db-7153-4861-bbc3-9cbb8822e196" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.323s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 10:29:43 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-1105ced2-56ea-4297-ae9e-dae52f36d2f7 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Connected to 172.16.0.220:3260 {{(pid=85141) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 10:29:43 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-1105ced2-56ea-4297-ae9e-dae52f36d2f7 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] HCTL ('35', '-', '-', 0) found on session 43 with lun 0 {{(pid=85141) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 10:29:43 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-1105ced2-56ea-4297-ae9e-dae52f36d2f7 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=85141) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 10:29:43 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:29:43 user nova-compute[85141]: DEBUG nova.compute.provider_tree [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Inventory has not changed in ProviderTree for provider: bf8e0fa1-16b6-408f-9203-c4cd63916272 {{(pid=85141) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 10:29:43 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.015s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:29:43 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[11d0335b-8f43-4cbb-a6f9-6e152196dc80]: (4, ('- - 0', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:29:43 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-1105ced2-56ea-4297-ae9e-dae52f36d2f7 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Searching for a device in session 43 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=85141) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 10:29:43 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-1105ced2-56ea-4297-ae9e-dae52f36d2f7 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:925fd9db-7153-4861-bbc3-9cbb8822e196', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GCObvuko', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=85141) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 10:29:43 user nova-compute[85141]: DEBUG nova.scheduler.client.report [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Inventory has not changed for provider bf8e0fa1-16b6-408f-9203-c4cd63916272 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=85141) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 10:29:43 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Compute_service record updated for user:user {{(pid=85141) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 10:29:43 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.675s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:29:43 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:29:44 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-1105ced2-56ea-4297-ae9e-dae52f36d2f7 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.354s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 10:29:44 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-1105ced2-56ea-4297-ae9e-dae52f36d2f7 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] <== connect_volume: return (1357ms) {'type': 'block', 'scsi_wwn': '23936386336656263', 'path': '/dev/sdd'} {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 10:29:44 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1105ced2-56ea-4297-ae9e-dae52f36d2f7 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: 97cbb145-d47e-4eb1-8c01-06361efa8720] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23936386336656263', 'path': '/dev/sdd'} {{(pid=85141) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 10:29:44 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-1105ced2-56ea-4297-ae9e-dae52f36d2f7 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T10:29:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-140608141',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-140608141',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-140608141',id=41,image_ref='05b3847f-6c57-4cd1-866c-4094a2603dcb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLWYpzou5qteDfpKjtLLBgnYXRlKBsUNYhK1xOldWyafK/a5K6wabtXFqbCOnvqPrKAwfaDJluhdqceCb7ORjv86e/EObTiPvk0xd6whyFbPAOlW8r2Nx+e3cy0isLTL2w==',key_name='tempest-keypair-1096079584',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aec3bb9fe5e6446590900b5adf65df0f',ramdisk_id='',reservation_id='r-a5nypv1s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1979039357',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1979039357-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1979039357',owner_user_name='tempest-TestVolumeBootPattern-1979039357-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T10:29:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7261b57c36904fcda87a9ea32d4b5b31',uuid=97cbb145-d47e-4eb1-8c01-06361efa8720,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "440f9d6b-639a-4615-8b0c-e85b108f9734", "address": "fa:16:3e:dd:8c:7c", "network": {"id": "b8ada47f-9721-4358-ac4f-0305f06dbbb8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1663922860-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aec3bb9fe5e6446590900b5adf65df0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap440f9d6b-63", "ovs_interfaceid": "440f9d6b-639a-4615-8b0c-e85b108f9734", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=85141) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 10:29:44 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-1105ced2-56ea-4297-ae9e-dae52f36d2f7 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Converting VIF {"id": "440f9d6b-639a-4615-8b0c-e85b108f9734", "address": "fa:16:3e:dd:8c:7c", "network": {"id": "b8ada47f-9721-4358-ac4f-0305f06dbbb8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1663922860-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aec3bb9fe5e6446590900b5adf65df0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap440f9d6b-63", "ovs_interfaceid": "440f9d6b-639a-4615-8b0c-e85b108f9734", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:29:44 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-1105ced2-56ea-4297-ae9e-dae52f36d2f7 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:8c:7c,bridge_name='br-int',has_traffic_filtering=True,id=440f9d6b-639a-4615-8b0c-e85b108f9734,network=Network(b8ada47f-9721-4358-ac4f-0305f06dbbb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap440f9d6b-63') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:29:44 user nova-compute[85141]: DEBUG nova.objects.instance [None req-1105ced2-56ea-4297-ae9e-dae52f36d2f7 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Lazy-loading 'pci_devices' on Instance uuid 97cbb145-d47e-4eb1-8c01-06361efa8720 {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:29:44 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:29:44 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:29:44 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:29:44 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-1105ced2-56ea-4297-ae9e-dae52f36d2f7 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: 97cbb145-d47e-4eb1-8c01-06361efa8720] End _get_guest_xml xml=<domain type="kvm">
Nov 16 10:29:44 user nova-compute[85141]:   <uuid>97cbb145-d47e-4eb1-8c01-06361efa8720</uuid>
Nov 16 10:29:44 user nova-compute[85141]:   <name>instance-00000029</name>
Nov 16 10:29:44 user nova-compute[85141]:   <memory>524288</memory>
Nov 16 10:29:44 user nova-compute[85141]:   <vcpu>1</vcpu>
Nov 16 10:29:44 user nova-compute[85141]:   <metadata>
Nov 16 10:29:44 user nova-compute[85141]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 10:29:44 user nova-compute[85141]:       <nova:package version="0.0.0"/>
Nov 16 10:29:44 user nova-compute[85141]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-140608141</nova:name>
Nov 16 10:29:44 user nova-compute[85141]:       <nova:creationTime>2023-11-16 10:29:42</nova:creationTime>
Nov 16 10:29:44 user nova-compute[85141]:       <nova:flavor name="m1.tiny">
Nov 16 10:29:44 user nova-compute[85141]:         <nova:memory>512</nova:memory>
Nov 16 10:29:44 user nova-compute[85141]:         <nova:disk>1</nova:disk>
Nov 16 10:29:44 user nova-compute[85141]:         <nova:swap>0</nova:swap>
Nov 16 10:29:44 user nova-compute[85141]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 10:29:44 user nova-compute[85141]:         <nova:vcpus>1</nova:vcpus>
Nov 16 10:29:44 user nova-compute[85141]:       </nova:flavor>
Nov 16 10:29:44 user nova-compute[85141]:       <nova:owner>
Nov 16 10:29:44 user nova-compute[85141]:         <nova:user uuid="7261b57c36904fcda87a9ea32d4b5b31">tempest-TestVolumeBootPattern-1979039357-project-member</nova:user>
Nov 16 10:29:44 user nova-compute[85141]:         <nova:project uuid="aec3bb9fe5e6446590900b5adf65df0f">tempest-TestVolumeBootPattern-1979039357</nova:project>
Nov 16 10:29:44 user nova-compute[85141]:       </nova:owner>
Nov 16 10:29:44 user nova-compute[85141]:       <nova:root type="image" uuid="05b3847f-6c57-4cd1-866c-4094a2603dcb"/>
Nov 16 10:29:44 user nova-compute[85141]:       <nova:ports>
Nov 16 10:29:44 user nova-compute[85141]:         <nova:port uuid="440f9d6b-639a-4615-8b0c-e85b108f9734">
Nov 16 10:29:44 user nova-compute[85141]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 16 10:29:44 user nova-compute[85141]:         </nova:port>
Nov 16 10:29:44 user nova-compute[85141]:       </nova:ports>
Nov 16 10:29:44 user nova-compute[85141]:     </nova:instance>
Nov 16 10:29:44 user nova-compute[85141]:   </metadata>
Nov 16 10:29:44 user nova-compute[85141]:   <sysinfo type="smbios">
Nov 16 10:29:44 user nova-compute[85141]:     <system>
Nov 16 10:29:44 user nova-compute[85141]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 10:29:44 user nova-compute[85141]:       <entry name="product">OpenStack Nova</entry>
Nov 16 10:29:44 user nova-compute[85141]:       <entry name="version">0.0.0</entry>
Nov 16 10:29:44 user nova-compute[85141]:       <entry name="serial">97cbb145-d47e-4eb1-8c01-06361efa8720</entry>
Nov 16 10:29:44 user nova-compute[85141]:       <entry name="uuid">97cbb145-d47e-4eb1-8c01-06361efa8720</entry>
Nov 16 10:29:44 user nova-compute[85141]:       <entry name="family">Virtual Machine</entry>
Nov 16 10:29:44 user nova-compute[85141]:     </system>
Nov 16 10:29:44 user nova-compute[85141]:   </sysinfo>
Nov 16 10:29:44 user nova-compute[85141]:   <os>
Nov 16 10:29:44 user nova-compute[85141]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 10:29:44 user nova-compute[85141]:     <boot dev="hd"/>
Nov 16 10:29:44 user nova-compute[85141]:     <smbios mode="sysinfo"/>
Nov 16 10:29:44 user nova-compute[85141]:   </os>
Nov 16 10:29:44 user nova-compute[85141]:   <features>
Nov 16 10:29:44 user nova-compute[85141]:     <acpi/>
Nov 16 10:29:44 user nova-compute[85141]:     <apic/>
Nov 16 10:29:44 user nova-compute[85141]:     <vmcoreinfo/>
Nov 16 10:29:44 user nova-compute[85141]:   </features>
Nov 16 10:29:44 user nova-compute[85141]:   <clock offset="utc">
Nov 16 10:29:44 user nova-compute[85141]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 10:29:44 user nova-compute[85141]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 10:29:44 user nova-compute[85141]:     <timer name="hpet" present="no"/>
Nov 16 10:29:44 user nova-compute[85141]:   </clock>
Nov 16 10:29:44 user nova-compute[85141]:   <cpu mode="custom" match="exact">
Nov 16 10:29:44 user nova-compute[85141]:     <model>Nehalem</model>
Nov 16 10:29:44 user nova-compute[85141]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 10:29:44 user nova-compute[85141]:   </cpu>
Nov 16 10:29:44 user nova-compute[85141]:   <devices>
Nov 16 10:29:44 user nova-compute[85141]:     <disk type="block" device="disk">
Nov 16 10:29:44 user nova-compute[85141]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 10:29:44 user nova-compute[85141]:       <source dev="/dev/sdd"/>
Nov 16 10:29:44 user nova-compute[85141]:       <target dev="vda" bus="virtio"/>
Nov 16 10:29:44 user nova-compute[85141]:       <serial>925fd9db-7153-4861-bbc3-9cbb8822e196</serial>
Nov 16 10:29:44 user nova-compute[85141]:     </disk>
Nov 16 10:29:44 user nova-compute[85141]:     <interface type="ethernet">
Nov 16 10:29:44 user nova-compute[85141]:       <mac address="fa:16:3e:dd:8c:7c"/>
Nov 16 10:29:44 user nova-compute[85141]:       <model type="virtio"/>
Nov 16 10:29:44 user nova-compute[85141]:       <mtu size="1442"/>
Nov 16 10:29:44 user nova-compute[85141]:       <target dev="tap440f9d6b-63"/>
Nov 16 10:29:44 user nova-compute[85141]:     </interface>
Nov 16 10:29:44 user nova-compute[85141]:     <serial type="pty">
Nov 16 10:29:44 user nova-compute[85141]:       <log file="/opt/stack/data/nova/instances/97cbb145-d47e-4eb1-8c01-06361efa8720/console.log" append="off"/>
Nov 16 10:29:44 user nova-compute[85141]:     </serial>
Nov 16 10:29:44 user nova-compute[85141]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 10:29:44 user nova-compute[85141]:     <video>
Nov 16 10:29:44 user nova-compute[85141]:       <model type="virtio"/>
Nov 16 10:29:44 user nova-compute[85141]:     </video>
Nov 16 10:29:44 user nova-compute[85141]:     <rng model="virtio">
Nov 16 10:29:44 user nova-compute[85141]:       <backend model="random">/dev/urandom</backend>
Nov 16 10:29:44 user nova-compute[85141]:     </rng>
Nov 16 10:29:44 user nova-compute[85141]:     <controller type="usb" index="0" model="none"/>
Nov 16 10:29:44 user nova-compute[85141]:     <memballoon model="virtio">
Nov 16 10:29:44 user nova-compute[85141]:       <stats period="10"/>
Nov 16 10:29:44 user nova-compute[85141]:     </memballoon>
Nov 16 10:29:44 user nova-compute[85141]:   </devices>
Nov 16 10:29:44 user nova-compute[85141]: </domain>
Nov 16 10:29:44 user nova-compute[85141]:  {{(pid=85141) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 10:29:44 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-1105ced2-56ea-4297-ae9e-dae52f36d2f7 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T10:29:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-140608141',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-140608141',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-140608141',id=41,image_ref='05b3847f-6c57-4cd1-866c-4094a2603dcb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLWYpzou5qteDfpKjtLLBgnYXRlKBsUNYhK1xOldWyafK/a5K6wabtXFqbCOnvqPrKAwfaDJluhdqceCb7ORjv86e/EObTiPvk0xd6whyFbPAOlW8r2Nx+e3cy0isLTL2w==',key_name='tempest-keypair-1096079584',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aec3bb9fe5e6446590900b5adf65df0f',ramdisk_id='',reservation_id='r-a5nypv1s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1979039357',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1979039357-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1979039357',owner_user_name='tempest-TestVolumeBootPattern-1979039357-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T10:29:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7261b57c36904fcda87a9ea32d4b5b31',uuid=97cbb145-d47e-4eb1-8c01-06361efa8720,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "440f9d6b-639a-4615-8b0c-e85b108f9734", "address": "fa:16:3e:dd:8c:7c", "network": {"id": "b8ada47f-9721-4358-ac4f-0305f06dbbb8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1663922860-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aec3bb9fe5e6446590900b5adf65df0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap440f9d6b-63", "ovs_interfaceid": "440f9d6b-639a-4615-8b0c-e85b108f9734", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 10:29:44 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-1105ced2-56ea-4297-ae9e-dae52f36d2f7 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Converting VIF {"id": "440f9d6b-639a-4615-8b0c-e85b108f9734", "address": "fa:16:3e:dd:8c:7c", "network": {"id": "b8ada47f-9721-4358-ac4f-0305f06dbbb8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1663922860-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aec3bb9fe5e6446590900b5adf65df0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap440f9d6b-63", "ovs_interfaceid": "440f9d6b-639a-4615-8b0c-e85b108f9734", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:29:44 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-1105ced2-56ea-4297-ae9e-dae52f36d2f7 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:8c:7c,bridge_name='br-int',has_traffic_filtering=True,id=440f9d6b-639a-4615-8b0c-e85b108f9734,network=Network(b8ada47f-9721-4358-ac4f-0305f06dbbb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap440f9d6b-63') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:29:44 user nova-compute[85141]: DEBUG os_vif [None req-1105ced2-56ea-4297-ae9e-dae52f36d2f7 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:8c:7c,bridge_name='br-int',has_traffic_filtering=True,id=440f9d6b-639a-4615-8b0c-e85b108f9734,network=Network(b8ada47f-9721-4358-ac4f-0305f06dbbb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap440f9d6b-63') {{(pid=85141) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 10:29:44 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:29:44 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:29:44 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 10:29:44 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:29:44 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a111779f-1f2a-50c1-89f2-487cf5e00367', '_type': 'linux-noop'}}, row=False) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:29:44 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:29:44 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:29:44 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:29:44 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap440f9d6b-63, may_exist=True, interface_attrs={}) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:29:44 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap440f9d6b-63, col_values=(('qos', UUID('f0f2393c-0dff-4dda-bd6b-75677082d45f')),), if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:29:44 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap440f9d6b-63, col_values=(('external_ids', {'iface-id': '440f9d6b-639a-4615-8b0c-e85b108f9734', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:dd:8c:7c', 'vm-uuid': '97cbb145-d47e-4eb1-8c01-06361efa8720'}),), if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:29:44 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:29:44 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:29:44 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:29:44 user nova-compute[85141]: INFO os_vif [None req-1105ced2-56ea-4297-ae9e-dae52f36d2f7 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:8c:7c,bridge_name='br-int',has_traffic_filtering=True,id=440f9d6b-639a-4615-8b0c-e85b108f9734,network=Network(b8ada47f-9721-4358-ac4f-0305f06dbbb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap440f9d6b-63')
Nov 16 10:29:44 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-1105ced2-56ea-4297-ae9e-dae52f36d2f7 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] No BDM found with device name vda, not building metadata. {{(pid=85141) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 10:29:44 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-1105ced2-56ea-4297-ae9e-dae52f36d2f7 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] No VIF found with MAC fa:16:3e:dd:8c:7c, not building metadata {{(pid=85141) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 10:29:45 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:29:45 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:29:45 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:29:45 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:29:45 user nova-compute[85141]: DEBUG nova.compute.manager [req-3b69d2e6-0a6b-4337-a05b-85e0838058b1 req-05d1176c-9814-42b9-9908-c5d7b5bd260f service nova] [instance: 97cbb145-d47e-4eb1-8c01-06361efa8720] Received event network-vif-plugged-440f9d6b-639a-4615-8b0c-e85b108f9734 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:29:45 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-3b69d2e6-0a6b-4337-a05b-85e0838058b1 req-05d1176c-9814-42b9-9908-c5d7b5bd260f service nova] Acquiring lock "97cbb145-d47e-4eb1-8c01-06361efa8720-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:29:45 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-3b69d2e6-0a6b-4337-a05b-85e0838058b1 req-05d1176c-9814-42b9-9908-c5d7b5bd260f service nova] Lock "97cbb145-d47e-4eb1-8c01-06361efa8720-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:29:45 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-3b69d2e6-0a6b-4337-a05b-85e0838058b1 req-05d1176c-9814-42b9-9908-c5d7b5bd260f service nova] Lock "97cbb145-d47e-4eb1-8c01-06361efa8720-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:29:45 user nova-compute[85141]: DEBUG nova.compute.manager [req-3b69d2e6-0a6b-4337-a05b-85e0838058b1 req-05d1176c-9814-42b9-9908-c5d7b5bd260f service nova] [instance: 97cbb145-d47e-4eb1-8c01-06361efa8720] No waiting events found dispatching network-vif-plugged-440f9d6b-639a-4615-8b0c-e85b108f9734 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:29:45 user nova-compute[85141]: WARNING nova.compute.manager [req-3b69d2e6-0a6b-4337-a05b-85e0838058b1 req-05d1176c-9814-42b9-9908-c5d7b5bd260f service nova] [instance: 97cbb145-d47e-4eb1-8c01-06361efa8720] Received unexpected event network-vif-plugged-440f9d6b-639a-4615-8b0c-e85b108f9734 for instance with vm_state building and task_state spawning.
Nov 16 10:29:45 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:29:47 user nova-compute[85141]: DEBUG nova.compute.manager [None req-1105ced2-56ea-4297-ae9e-dae52f36d2f7 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: 97cbb145-d47e-4eb1-8c01-06361efa8720] Instance event wait completed in 0 seconds for  {{(pid=85141) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 10:29:47 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-1105ced2-56ea-4297-ae9e-dae52f36d2f7 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: 97cbb145-d47e-4eb1-8c01-06361efa8720] Guest created on hypervisor {{(pid=85141) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 10:29:47 user nova-compute[85141]: INFO nova.virt.libvirt.driver [-] [instance: 97cbb145-d47e-4eb1-8c01-06361efa8720] Instance spawned successfully.
Nov 16 10:29:47 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-1105ced2-56ea-4297-ae9e-dae52f36d2f7 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: 97cbb145-d47e-4eb1-8c01-06361efa8720] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 10:29:47 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-1105ced2-56ea-4297-ae9e-dae52f36d2f7 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: 97cbb145-d47e-4eb1-8c01-06361efa8720] Found default for hw_input_bus of None {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:29:47 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-1105ced2-56ea-4297-ae9e-dae52f36d2f7 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: 97cbb145-d47e-4eb1-8c01-06361efa8720] Found default for hw_pointer_model of None {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:29:47 user nova-compute[85141]: INFO nova.compute.manager [None req-1105ced2-56ea-4297-ae9e-dae52f36d2f7 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: 97cbb145-d47e-4eb1-8c01-06361efa8720] Took 5.06 seconds to spawn the instance on the hypervisor.
Nov 16 10:29:47 user nova-compute[85141]: DEBUG nova.compute.manager [None req-1105ced2-56ea-4297-ae9e-dae52f36d2f7 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: 97cbb145-d47e-4eb1-8c01-06361efa8720] Checking state {{(pid=85141) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 10:29:47 user nova-compute[85141]: DEBUG nova.compute.manager [req-2a464185-8159-4ef6-afb8-1f3bbce7dafc req-0e1aa175-41e2-42dd-898e-b85e64c14679 service nova] [instance: 97cbb145-d47e-4eb1-8c01-06361efa8720] Received event network-vif-plugged-440f9d6b-639a-4615-8b0c-e85b108f9734 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:29:47 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-2a464185-8159-4ef6-afb8-1f3bbce7dafc req-0e1aa175-41e2-42dd-898e-b85e64c14679 service nova] Acquiring lock "97cbb145-d47e-4eb1-8c01-06361efa8720-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:29:47 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-2a464185-8159-4ef6-afb8-1f3bbce7dafc req-0e1aa175-41e2-42dd-898e-b85e64c14679 service nova] Lock "97cbb145-d47e-4eb1-8c01-06361efa8720-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:29:47 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-2a464185-8159-4ef6-afb8-1f3bbce7dafc req-0e1aa175-41e2-42dd-898e-b85e64c14679 service nova] Lock "97cbb145-d47e-4eb1-8c01-06361efa8720-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:29:47 user nova-compute[85141]: DEBUG nova.compute.manager [req-2a464185-8159-4ef6-afb8-1f3bbce7dafc req-0e1aa175-41e2-42dd-898e-b85e64c14679 service nova] [instance: 97cbb145-d47e-4eb1-8c01-06361efa8720] No waiting events found dispatching network-vif-plugged-440f9d6b-639a-4615-8b0c-e85b108f9734 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:29:47 user nova-compute[85141]: WARNING nova.compute.manager [req-2a464185-8159-4ef6-afb8-1f3bbce7dafc req-0e1aa175-41e2-42dd-898e-b85e64c14679 service nova] [instance: 97cbb145-d47e-4eb1-8c01-06361efa8720] Received unexpected event network-vif-plugged-440f9d6b-639a-4615-8b0c-e85b108f9734 for instance with vm_state building and task_state spawning.
Nov 16 10:29:48 user nova-compute[85141]: INFO nova.compute.manager [None req-1105ced2-56ea-4297-ae9e-dae52f36d2f7 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: 97cbb145-d47e-4eb1-8c01-06361efa8720] Took 17.90 seconds to build instance.
Nov 16 10:29:48 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-1105ced2-56ea-4297-ae9e-dae52f36d2f7 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Lock "97cbb145-d47e-4eb1-8c01-06361efa8720" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.007s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:29:48 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:29:49 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:29:51 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-4daaa957-30da-4ccb-b0e8-c6c88f0c6d2c tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 463034ff-14ce-477a-9642-4d86aa6f9cd9 is timed out.
Nov 16 10:29:51 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-4daaa957-30da-4ccb-b0e8-c6c88f0c6d2c tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Successfully detached device vdb from instance 463034ff-14ce-477a-9642-4d86aa6f9cd9 from the live domain config.
Nov 16 10:29:51 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4daaa957-30da-4ccb-b0e8-c6c88f0c6d2c tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] [instance: 463034ff-14ce-477a-9642-4d86aa6f9cd9] calling os-brick to detach iSCSI Volume {{(pid=85141) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 10:29:51 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-4daaa957-30da-4ccb-b0e8-c6c88f0c6d2c tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51806b6080>, {'target_iqn': 'iqn.2010-10.org.openstack:e1b58025-0c18-41f6-a126-fb3c925399a1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SCyDABYj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 10:29:51 user nova-compute[85141]: WARNING os_brick.initiator.connectors.base [None req-4daaa957-30da-4ccb-b0e8-c6c88f0c6d2c tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 10:29:51 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-4daaa957-30da-4ccb-b0e8-c6c88f0c6d2c tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 10:29:51 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-4daaa957-30da-4ccb-b0e8-c6c88f0c6d2c tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 10:29:51 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:29:51 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:29:51 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[c61c2f26-ca94-41ec-ba71-4f0ecbb0b8db]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e0c5c19d-363b-4f5d-a04f-fb7de64423f2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:925fd9db-7153-4861-bbc3-9cbb8822e196\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e1b58025-0c18-41f6-a126-fb3c925399a1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2006a77c-e5e8-4ec5-8de5-a0f9505c429a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:29:51 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-4daaa957-30da-4ccb-b0e8-c6c88f0c6d2c tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 10:29:51 user nova-compute[85141]: No targets found.
Nov 16 10:29:51 user nova-compute[85141]: iSNS:
Nov 16 10:29:51 user nova-compute[85141]: No targets found.
Nov 16 10:29:51 user nova-compute[85141]: STATIC:
Nov 16 10:29:51 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:e0c5c19d-363b-4f5d-a04f-fb7de64423f2
Nov 16 10:29:51 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:29:51 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:29:51 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:925fd9db-7153-4861-bbc3-9cbb8822e196
Nov 16 10:29:51 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:29:51 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:29:51 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee
Nov 16 10:29:51 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:29:51 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:29:51 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:e1b58025-0c18-41f6-a126-fb3c925399a1
Nov 16 10:29:51 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:29:51 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:29:51 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:2006a77c-e5e8-4ec5-8de5-a0f9505c429a
Nov 16 10:29:51 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:29:51 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:29:51 user nova-compute[85141]: FIRMWARE:
Nov 16 10:29:51 user nova-compute[85141]: No targets found.
Nov 16 10:29:51 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:29:51 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-4daaa957-30da-4ccb-b0e8-c6c88f0c6d2c tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 10:29:51 user nova-compute[85141]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 10:29:51 user nova-compute[85141]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=85141) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 10:29:51 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-4daaa957-30da-4ccb-b0e8-c6c88f0c6d2c tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e1b58025-0c18-41f6-a126-fb3c925399a1', 0)] {{(pid=85141) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 10:29:51 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:29:51 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:29:51 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[a66c5d35-f0d7-4ad5-8a32-7b0f02152a01]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2006a77c-e5e8-4ec5-8de5-a0f9505c429a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:925fd9db-7153-4861-bbc3-9cbb8822e196\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e0c5c19d-363b-4f5d-a04f-fb7de64423f2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e1b58025-0c18-41f6-a126-fb3c925399a1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:29:51 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:29:51 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:29:51 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[80959df4-20a5-4bcc-b016-1ab3de9fb281]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b58025-0c18-41f6-a126-fb3c925399a1 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2006a77c-e5e8-4ec5-8de5-a0f9505c429a (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0c5c19d-363b-4f5d-a04f-fb7de64423f2 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:925fd9db-7153-4861-bbc3-9cbb8822e196 (non-flash)\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:29:51 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-4daaa957-30da-4ccb-b0e8-c6c88f0c6d2c tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)
Nov 16 10:29:51 user nova-compute[85141]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b58025-0c18-41f6-a126-fb3c925399a1 (non-flash)
Nov 16 10:29:51 user nova-compute[85141]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2006a77c-e5e8-4ec5-8de5-a0f9505c429a (non-flash)
Nov 16 10:29:51 user nova-compute[85141]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0c5c19d-363b-4f5d-a04f-fb7de64423f2 (non-flash)
Nov 16 10:29:51 user nova-compute[85141]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:925fd9db-7153-4861-bbc3-9cbb8822e196 (non-flash)
Nov 16 10:29:51 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:29:51 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-4daaa957-30da-4ccb-b0e8-c6c88f0c6d2c tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)
Nov 16 10:29:51 user nova-compute[85141]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1b58025-0c18-41f6-a126-fb3c925399a1 (non-flash)
Nov 16 10:29:51 user nova-compute[85141]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2006a77c-e5e8-4ec5-8de5-a0f9505c429a (non-flash)
Nov 16 10:29:51 user nova-compute[85141]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0c5c19d-363b-4f5d-a04f-fb7de64423f2 (non-flash)
Nov 16 10:29:51 user nova-compute[85141]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:925fd9db-7153-4861-bbc3-9cbb8822e196 (non-flash)
Nov 16 10:29:51 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 10:29:51 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-4daaa957-30da-4ccb-b0e8-c6c88f0c6d2c tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5198382b90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e1b58025-0c18-41f6-a126-fb3c925399a1'): ({'sdg'}, set())}) {{(pid=85141) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 10:29:51 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-4daaa957-30da-4ccb-b0e8-c6c88f0c6d2c tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Removing single pathed devices sdg {{(pid=85141) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 10:29:51 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:29:51 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:29:51 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[10206ece-f040-41b6-89ff-fc787a9cfc8a]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:29:51 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:29:51 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.019s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:29:51 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fa8c37f-159d-449c-b19f-a2ee408f7c2c]: (4, ('ok\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:29:51 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-4daaa957-30da-4ccb-b0e8-c6c88f0c6d2c tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Flushing IO for device /dev/sdg {{(pid=85141) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 10:29:51 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:29:51 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.017s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:29:51 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[74cb7c82-e289-446d-9e94-3f196d6c2ca4]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:29:51 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-4daaa957-30da-4ccb-b0e8-c6c88f0c6d2c tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=85141) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 10:29:51 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:29:51 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.046s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:29:51 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a95c764-d920-476f-a9a1-1378949fe7d5]: (4, ('1', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:29:51 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-4daaa957-30da-4ccb-b0e8-c6c88f0c6d2c tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=85141) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 10:29:51 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-4daaa957-30da-4ccb-b0e8-c6c88f0c6d2c tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] SCSI volumes sdg have been removed. {{(pid=85141) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 10:29:51 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-4daaa957-30da-4ccb-b0e8-c6c88f0c6d2c tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e1b58025-0c18-41f6-a126-fb3c925399a1')] {{(pid=85141) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 10:29:51 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1b58025-0c18-41f6-a126-fb3c925399a1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:29:51 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1b58025-0c18-41f6-a126-fb3c925399a1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:29:51 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ce1dd81-2a6c-47e0-b036-82a63f7ea021]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:29:51 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-4daaa957-30da-4ccb-b0e8-c6c88f0c6d2c tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:29:51 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1b58025-0c18-41f6-a126-fb3c925399a1 -p 172.16.0.220:3260 --logout {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:29:51 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1b58025-0c18-41f6-a126-fb3c925399a1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:29:51 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ebdd914-184d-4242-acd9-b2ba59b5fadb]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:e1b58025-0c18-41f6-a126-fb3c925399a1, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:e1b58025-0c18-41f6-a126-fb3c925399a1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:29:51 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-4daaa957-30da-4ccb-b0e8-c6c88f0c6d2c tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:e1b58025-0c18-41f6-a126-fb3c925399a1, portal: 172.16.0.220,3260]
Nov 16 10:29:51 user nova-compute[85141]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:e1b58025-0c18-41f6-a126-fb3c925399a1, portal: 172.16.0.220,3260] successful.
Nov 16 10:29:51 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:29:51 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1b58025-0c18-41f6-a126-fb3c925399a1 -p 172.16.0.220:3260 --op delete {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:29:51 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1b58025-0c18-41f6-a126-fb3c925399a1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:29:51 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce62bafd-e92a-4133-ba23-d9eb6d9828c5]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:29:51 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-4daaa957-30da-4ccb-b0e8-c6c88f0c6d2c tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:29:51 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-4daaa957-30da-4ccb-b0e8-c6c88f0c6d2c tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.326s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 10:29:51 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-4daaa957-30da-4ccb-b0e8-c6c88f0c6d2c tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] <== disconnect_volume: return (327ms) None {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 10:29:51 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4daaa957-30da-4ccb-b0e8-c6c88f0c6d2c tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] [instance: 463034ff-14ce-477a-9642-4d86aa6f9cd9] Disconnected iSCSI Volume {{(pid=85141) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 10:29:52 user nova-compute[85141]: DEBUG nova.objects.instance [None req-4daaa957-30da-4ccb-b0e8-c6c88f0c6d2c tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Lazy-loading 'flavor' on Instance uuid 463034ff-14ce-477a-9642-4d86aa6f9cd9 {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:29:52 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-4daaa957-30da-4ccb-b0e8-c6c88f0c6d2c tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Lock "463034ff-14ce-477a-9642-4d86aa6f9cd9" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.821s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:29:53 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:29:54 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:29:58 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:29:59 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:30:03 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:30:04 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-53039814-9757-4464-a99a-92a7bcbf0882 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Acquiring lock "f01dc8cf-1a69-4618-a15d-0c1075157f05" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:30:04 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-53039814-9757-4464-a99a-92a7bcbf0882 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Lock "f01dc8cf-1a69-4618-a15d-0c1075157f05" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:30:04 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-53039814-9757-4464-a99a-92a7bcbf0882 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Acquiring lock "f01dc8cf-1a69-4618-a15d-0c1075157f05-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:30:04 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-53039814-9757-4464-a99a-92a7bcbf0882 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Lock "f01dc8cf-1a69-4618-a15d-0c1075157f05-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:30:04 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-53039814-9757-4464-a99a-92a7bcbf0882 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Lock "f01dc8cf-1a69-4618-a15d-0c1075157f05-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:30:04 user nova-compute[85141]: INFO nova.compute.manager [None req-53039814-9757-4464-a99a-92a7bcbf0882 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] [instance: f01dc8cf-1a69-4618-a15d-0c1075157f05] Terminating instance
Nov 16 10:30:04 user nova-compute[85141]: DEBUG nova.compute.manager [None req-53039814-9757-4464-a99a-92a7bcbf0882 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] [instance: f01dc8cf-1a69-4618-a15d-0c1075157f05] Start destroying the instance on the hypervisor. {{(pid=85141) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 10:30:04 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:30:04 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:30:04 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:30:04 user nova-compute[85141]: DEBUG nova.compute.manager [req-d500dde8-d363-4f15-9190-d3aed3e4530e req-5b923f94-e1f6-4b16-a047-0787a9f1d0f2 service nova] [instance: f01dc8cf-1a69-4618-a15d-0c1075157f05] Received event network-vif-unplugged-52edc378-51f4-43c3-b9f3-2d0201ed125d {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:30:04 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-d500dde8-d363-4f15-9190-d3aed3e4530e req-5b923f94-e1f6-4b16-a047-0787a9f1d0f2 service nova] Acquiring lock "f01dc8cf-1a69-4618-a15d-0c1075157f05-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:30:04 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-d500dde8-d363-4f15-9190-d3aed3e4530e req-5b923f94-e1f6-4b16-a047-0787a9f1d0f2 service nova] Lock "f01dc8cf-1a69-4618-a15d-0c1075157f05-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:30:04 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-d500dde8-d363-4f15-9190-d3aed3e4530e req-5b923f94-e1f6-4b16-a047-0787a9f1d0f2 service nova] Lock "f01dc8cf-1a69-4618-a15d-0c1075157f05-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:30:04 user nova-compute[85141]: DEBUG nova.compute.manager [req-d500dde8-d363-4f15-9190-d3aed3e4530e req-5b923f94-e1f6-4b16-a047-0787a9f1d0f2 service nova] [instance: f01dc8cf-1a69-4618-a15d-0c1075157f05] No waiting events found dispatching network-vif-unplugged-52edc378-51f4-43c3-b9f3-2d0201ed125d {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:30:04 user nova-compute[85141]: DEBUG nova.compute.manager [req-d500dde8-d363-4f15-9190-d3aed3e4530e req-5b923f94-e1f6-4b16-a047-0787a9f1d0f2 service nova] [instance: f01dc8cf-1a69-4618-a15d-0c1075157f05] Received event network-vif-unplugged-52edc378-51f4-43c3-b9f3-2d0201ed125d for instance with task_state deleting. {{(pid=85141) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 10:30:04 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:30:04 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:30:04 user nova-compute[85141]: INFO nova.virt.libvirt.driver [-] [instance: f01dc8cf-1a69-4618-a15d-0c1075157f05] Instance destroyed successfully.
Nov 16 10:30:04 user nova-compute[85141]: DEBUG nova.objects.instance [None req-53039814-9757-4464-a99a-92a7bcbf0882 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Lazy-loading 'resources' on Instance uuid f01dc8cf-1a69-4618-a15d-0c1075157f05 {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:30:04 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-53039814-9757-4464-a99a-92a7bcbf0882 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T10:13:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-979622720',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-979622720',id=13,image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-16T10:15:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='733b504d4dbe4f028963cf2c197f0064',ramdisk_id='',reservation_id='r-ag7dsbiu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-742384119',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T10:17:15Z,user_data=None,user_id='ffe6ceff3cc346b59b4fbf294b9fc1a3',uuid=f01dc8cf-1a69-4618-a15d-0c1075157f05,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "52edc378-51f4-43c3-b9f3-2d0201ed125d", "address": "fa:16:3e:38:1f:8f", "network": {"id": "e40e4bd2-4277-40b1-9451-1c8365ffa488", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1333036447-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "733b504d4dbe4f028963cf2c197f0064", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52edc378-51", "ovs_interfaceid": "52edc378-51f4-43c3-b9f3-2d0201ed125d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 10:30:04 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-53039814-9757-4464-a99a-92a7bcbf0882 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Converting VIF {"id": "52edc378-51f4-43c3-b9f3-2d0201ed125d", "address": "fa:16:3e:38:1f:8f", "network": {"id": "e40e4bd2-4277-40b1-9451-1c8365ffa488", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1333036447-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "733b504d4dbe4f028963cf2c197f0064", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52edc378-51", "ovs_interfaceid": "52edc378-51f4-43c3-b9f3-2d0201ed125d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:30:04 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-53039814-9757-4464-a99a-92a7bcbf0882 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:38:1f:8f,bridge_name='br-int',has_traffic_filtering=True,id=52edc378-51f4-43c3-b9f3-2d0201ed125d,network=Network(e40e4bd2-4277-40b1-9451-1c8365ffa488),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52edc378-51') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:30:04 user nova-compute[85141]: DEBUG os_vif [None req-53039814-9757-4464-a99a-92a7bcbf0882 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:38:1f:8f,bridge_name='br-int',has_traffic_filtering=True,id=52edc378-51f4-43c3-b9f3-2d0201ed125d,network=Network(e40e4bd2-4277-40b1-9451-1c8365ffa488),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52edc378-51') {{(pid=85141) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 10:30:04 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:30:04 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap52edc378-51, bridge=br-int, if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:30:04 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:30:04 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:30:04 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:30:04 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b13d590b-1f58-416e-b01d-af1612cf6eae) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:30:04 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:30:04 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:30:04 user nova-compute[85141]: INFO os_vif [None req-53039814-9757-4464-a99a-92a7bcbf0882 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:38:1f:8f,bridge_name='br-int',has_traffic_filtering=True,id=52edc378-51f4-43c3-b9f3-2d0201ed125d,network=Network(e40e4bd2-4277-40b1-9451-1c8365ffa488),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52edc378-51')
Nov 16 10:30:04 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-53039814-9757-4464-a99a-92a7bcbf0882 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] [instance: f01dc8cf-1a69-4618-a15d-0c1075157f05] calling os-brick to detach iSCSI Volume {{(pid=85141) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 10:30:04 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-53039814-9757-4464-a99a-92a7bcbf0882 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51806b6080>, {'target_iqn': 'iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pHECSWij', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 10:30:04 user nova-compute[85141]: WARNING os_brick.initiator.connectors.base [None req-53039814-9757-4464-a99a-92a7bcbf0882 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 10:30:04 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-53039814-9757-4464-a99a-92a7bcbf0882 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 10:30:04 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-53039814-9757-4464-a99a-92a7bcbf0882 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 10:30:04 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:30:04 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:30:04 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[70647a28-6cad-452f-85e1-4477d85d68a6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e0c5c19d-363b-4f5d-a04f-fb7de64423f2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:925fd9db-7153-4861-bbc3-9cbb8822e196\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2006a77c-e5e8-4ec5-8de5-a0f9505c429a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:30:04 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-53039814-9757-4464-a99a-92a7bcbf0882 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 10:30:04 user nova-compute[85141]: No targets found.
Nov 16 10:30:04 user nova-compute[85141]: iSNS:
Nov 16 10:30:04 user nova-compute[85141]: No targets found.
Nov 16 10:30:04 user nova-compute[85141]: STATIC:
Nov 16 10:30:04 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:e0c5c19d-363b-4f5d-a04f-fb7de64423f2
Nov 16 10:30:04 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:30:04 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:30:04 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:925fd9db-7153-4861-bbc3-9cbb8822e196
Nov 16 10:30:04 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:30:04 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:30:04 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee
Nov 16 10:30:04 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:30:04 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:30:04 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:2006a77c-e5e8-4ec5-8de5-a0f9505c429a
Nov 16 10:30:04 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:30:04 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:30:04 user nova-compute[85141]: FIRMWARE:
Nov 16 10:30:04 user nova-compute[85141]: No targets found.
Nov 16 10:30:04 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:30:04 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-53039814-9757-4464-a99a-92a7bcbf0882 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 10:30:04 user nova-compute[85141]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 10:30:04 user nova-compute[85141]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=85141) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 10:30:04 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-53039814-9757-4464-a99a-92a7bcbf0882 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee', 0)] {{(pid=85141) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 10:30:04 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:30:04 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:30:04 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[a95be75a-2f1f-4a10-a919-bdf43ef2a08c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2006a77c-e5e8-4ec5-8de5-a0f9505c429a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:925fd9db-7153-4861-bbc3-9cbb8822e196\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e0c5c19d-363b-4f5d-a04f-fb7de64423f2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:30:04 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:30:04 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:30:04 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8b63c57-3ce5-4b52-a0fe-c890eaab3add]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2006a77c-e5e8-4ec5-8de5-a0f9505c429a (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0c5c19d-363b-4f5d-a04f-fb7de64423f2 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:925fd9db-7153-4861-bbc3-9cbb8822e196 (non-flash)\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:30:04 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-53039814-9757-4464-a99a-92a7bcbf0882 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)
Nov 16 10:30:04 user nova-compute[85141]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2006a77c-e5e8-4ec5-8de5-a0f9505c429a (non-flash)
Nov 16 10:30:04 user nova-compute[85141]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0c5c19d-363b-4f5d-a04f-fb7de64423f2 (non-flash)
Nov 16 10:30:04 user nova-compute[85141]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:925fd9db-7153-4861-bbc3-9cbb8822e196 (non-flash)
Nov 16 10:30:04 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:30:04 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-53039814-9757-4464-a99a-92a7bcbf0882 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee (non-flash)
Nov 16 10:30:04 user nova-compute[85141]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2006a77c-e5e8-4ec5-8de5-a0f9505c429a (non-flash)
Nov 16 10:30:04 user nova-compute[85141]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0c5c19d-363b-4f5d-a04f-fb7de64423f2 (non-flash)
Nov 16 10:30:04 user nova-compute[85141]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:925fd9db-7153-4861-bbc3-9cbb8822e196 (non-flash)
Nov 16 10:30:04 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 10:30:04 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-53039814-9757-4464-a99a-92a7bcbf0882 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f51981876d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee'): ({'sdc'}, set())}) {{(pid=85141) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 10:30:04 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-53039814-9757-4464-a99a-92a7bcbf0882 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Removing single pathed devices sdc {{(pid=85141) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 10:30:04 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:30:04 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:30:04 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ac3400e-91b5-4c7b-b6f1-a920f6427fb3]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:30:04 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:30:04 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:30:04 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd5c51ec-69a9-455c-8769-fd3a5d7b7a41]: (4, ('ok\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:30:04 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-53039814-9757-4464-a99a-92a7bcbf0882 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Flushing IO for device /dev/sdc {{(pid=85141) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 10:30:04 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:30:04 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:30:04 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad94cd9d-0e48-425e-8f6e-df9ab4c973c2]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:30:04 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-53039814-9757-4464-a99a-92a7bcbf0882 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=85141) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 10:30:04 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:30:04 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.041s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:30:04 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[693c3c11-dac2-4e10-a9a9-36d54c9b13a2]: (4, ('1', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:30:04 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-53039814-9757-4464-a99a-92a7bcbf0882 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=85141) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 10:30:05 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-53039814-9757-4464-a99a-92a7bcbf0882 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] SCSI volumes sdc have been removed. {{(pid=85141) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 10:30:05 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-53039814-9757-4464-a99a-92a7bcbf0882 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee')] {{(pid=85141) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 10:30:05 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:30:05 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:30:05 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[08fdff6b-5dac-4b7a-bf80-4667b53dfd39]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:30:05 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-53039814-9757-4464-a99a-92a7bcbf0882 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:30:05 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee -p 172.16.0.220:3260 --logout {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:30:05 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:30:05 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[1670fac9-9e64-4185-81ff-c812793fec69]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:30:05 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-53039814-9757-4464-a99a-92a7bcbf0882 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee, portal: 172.16.0.220,3260]
Nov 16 10:30:05 user nova-compute[85141]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee, portal: 172.16.0.220,3260] successful.
Nov 16 10:30:05 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:30:05 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee -p 172.16.0.220:3260 --op delete {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:30:05 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f762b977-47ad-490c-a516-0216703bebee -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:30:05 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f165b61-55c3-4b3e-969a-da12ac3f6c2f]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:30:05 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-53039814-9757-4464-a99a-92a7bcbf0882 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:30:05 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-53039814-9757-4464-a99a-92a7bcbf0882 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.293s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 10:30:05 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-53039814-9757-4464-a99a-92a7bcbf0882 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] <== disconnect_volume: return (293ms) None {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 10:30:05 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-53039814-9757-4464-a99a-92a7bcbf0882 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] [instance: f01dc8cf-1a69-4618-a15d-0c1075157f05] Disconnected iSCSI Volume {{(pid=85141) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 10:30:05 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-53039814-9757-4464-a99a-92a7bcbf0882 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] [instance: f01dc8cf-1a69-4618-a15d-0c1075157f05] Deleting instance files /opt/stack/data/nova/instances/f01dc8cf-1a69-4618-a15d-0c1075157f05_del
Nov 16 10:30:05 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-53039814-9757-4464-a99a-92a7bcbf0882 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] [instance: f01dc8cf-1a69-4618-a15d-0c1075157f05] Deletion of /opt/stack/data/nova/instances/f01dc8cf-1a69-4618-a15d-0c1075157f05_del complete
Nov 16 10:30:05 user nova-compute[85141]: INFO nova.compute.manager [None req-53039814-9757-4464-a99a-92a7bcbf0882 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] [instance: f01dc8cf-1a69-4618-a15d-0c1075157f05] Took 1.14 seconds to destroy the instance on the hypervisor.
Nov 16 10:30:05 user nova-compute[85141]: DEBUG oslo.service.loopingcall [None req-53039814-9757-4464-a99a-92a7bcbf0882 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=85141) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 10:30:05 user nova-compute[85141]: DEBUG nova.compute.manager [-] [instance: f01dc8cf-1a69-4618-a15d-0c1075157f05] Deallocating network for instance {{(pid=85141) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 10:30:05 user nova-compute[85141]: DEBUG nova.network.neutron [-] [instance: f01dc8cf-1a69-4618-a15d-0c1075157f05] deallocate_for_instance() {{(pid=85141) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 10:30:05 user nova-compute[85141]: DEBUG nova.network.neutron [-] [instance: f01dc8cf-1a69-4618-a15d-0c1075157f05] Updating instance_info_cache with network_info: [] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:30:05 user nova-compute[85141]: INFO nova.compute.manager [-] [instance: f01dc8cf-1a69-4618-a15d-0c1075157f05] Took 0.49 seconds to deallocate network for instance.
Nov 16 10:30:05 user nova-compute[85141]: DEBUG nova.compute.manager [req-a554b57c-f356-4f1c-a78a-96f991243b6b req-36d62853-c70a-4470-9cbf-24579cf48065 service nova] [instance: f01dc8cf-1a69-4618-a15d-0c1075157f05] Received event network-vif-deleted-52edc378-51f4-43c3-b9f3-2d0201ed125d {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:30:06 user nova-compute[85141]: INFO nova.compute.manager [None req-53039814-9757-4464-a99a-92a7bcbf0882 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] [instance: f01dc8cf-1a69-4618-a15d-0c1075157f05] Took 0.69 seconds to detach 1 volumes for instance.
Nov 16 10:30:06 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-53039814-9757-4464-a99a-92a7bcbf0882 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:30:06 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-53039814-9757-4464-a99a-92a7bcbf0882 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:30:06 user nova-compute[85141]: DEBUG nova.compute.manager [req-73fc78af-506d-4c80-a134-2ffa9fbd02e8 req-9f15f8fe-f9d5-42c7-baf2-d18f7c4f397b service nova] [instance: f01dc8cf-1a69-4618-a15d-0c1075157f05] Received event network-vif-plugged-52edc378-51f4-43c3-b9f3-2d0201ed125d {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:30:06 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-73fc78af-506d-4c80-a134-2ffa9fbd02e8 req-9f15f8fe-f9d5-42c7-baf2-d18f7c4f397b service nova] Acquiring lock "f01dc8cf-1a69-4618-a15d-0c1075157f05-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:30:06 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-73fc78af-506d-4c80-a134-2ffa9fbd02e8 req-9f15f8fe-f9d5-42c7-baf2-d18f7c4f397b service nova] Lock "f01dc8cf-1a69-4618-a15d-0c1075157f05-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:30:06 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-73fc78af-506d-4c80-a134-2ffa9fbd02e8 req-9f15f8fe-f9d5-42c7-baf2-d18f7c4f397b service nova] Lock "f01dc8cf-1a69-4618-a15d-0c1075157f05-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:30:06 user nova-compute[85141]: DEBUG nova.compute.manager [req-73fc78af-506d-4c80-a134-2ffa9fbd02e8 req-9f15f8fe-f9d5-42c7-baf2-d18f7c4f397b service nova] [instance: f01dc8cf-1a69-4618-a15d-0c1075157f05] No waiting events found dispatching network-vif-plugged-52edc378-51f4-43c3-b9f3-2d0201ed125d {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:30:06 user nova-compute[85141]: WARNING nova.compute.manager [req-73fc78af-506d-4c80-a134-2ffa9fbd02e8 req-9f15f8fe-f9d5-42c7-baf2-d18f7c4f397b service nova] [instance: f01dc8cf-1a69-4618-a15d-0c1075157f05] Received unexpected event network-vif-plugged-52edc378-51f4-43c3-b9f3-2d0201ed125d for instance with vm_state deleted and task_state None.
Nov 16 10:30:06 user nova-compute[85141]: DEBUG nova.compute.provider_tree [None req-53039814-9757-4464-a99a-92a7bcbf0882 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Inventory has not changed in ProviderTree for provider: bf8e0fa1-16b6-408f-9203-c4cd63916272 {{(pid=85141) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 10:30:06 user nova-compute[85141]: DEBUG nova.scheduler.client.report [None req-53039814-9757-4464-a99a-92a7bcbf0882 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Inventory has not changed for provider bf8e0fa1-16b6-408f-9203-c4cd63916272 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=85141) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 10:30:06 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-53039814-9757-4464-a99a-92a7bcbf0882 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.364s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:30:06 user nova-compute[85141]: INFO nova.scheduler.client.report [None req-53039814-9757-4464-a99a-92a7bcbf0882 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Deleted allocations for instance f01dc8cf-1a69-4618-a15d-0c1075157f05
Nov 16 10:30:06 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-53039814-9757-4464-a99a-92a7bcbf0882 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Lock "f01dc8cf-1a69-4618-a15d-0c1075157f05" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.862s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:30:08 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:30:09 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:30:09 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:30:10 user nova-compute[85141]: DEBUG nova.compute.manager [req-5b9818e8-1f66-479c-b308-ae1db3a31f9e req-8af8a01b-84cd-408f-9440-62d48abcad3f service nova] [instance: da42de06-4518-4c8a-8c63-9b5a2759a1bf] Received event network-changed-82a8c393-e062-47b9-a531-a6823f7d00a6 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:30:10 user nova-compute[85141]: DEBUG nova.compute.manager [req-5b9818e8-1f66-479c-b308-ae1db3a31f9e req-8af8a01b-84cd-408f-9440-62d48abcad3f service nova] [instance: da42de06-4518-4c8a-8c63-9b5a2759a1bf] Refreshing instance network info cache due to event network-changed-82a8c393-e062-47b9-a531-a6823f7d00a6. {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 10:30:10 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-5b9818e8-1f66-479c-b308-ae1db3a31f9e req-8af8a01b-84cd-408f-9440-62d48abcad3f service nova] Acquiring lock "refresh_cache-da42de06-4518-4c8a-8c63-9b5a2759a1bf" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:30:10 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-5b9818e8-1f66-479c-b308-ae1db3a31f9e req-8af8a01b-84cd-408f-9440-62d48abcad3f service nova] Acquired lock "refresh_cache-da42de06-4518-4c8a-8c63-9b5a2759a1bf" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:30:10 user nova-compute[85141]: DEBUG nova.network.neutron [req-5b9818e8-1f66-479c-b308-ae1db3a31f9e req-8af8a01b-84cd-408f-9440-62d48abcad3f service nova] [instance: da42de06-4518-4c8a-8c63-9b5a2759a1bf] Refreshing network info cache for port 82a8c393-e062-47b9-a531-a6823f7d00a6 {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 10:30:10 user nova-compute[85141]: DEBUG nova.network.neutron [req-5b9818e8-1f66-479c-b308-ae1db3a31f9e req-8af8a01b-84cd-408f-9440-62d48abcad3f service nova] [instance: da42de06-4518-4c8a-8c63-9b5a2759a1bf] Updated VIF entry in instance network info cache for port 82a8c393-e062-47b9-a531-a6823f7d00a6. {{(pid=85141) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 10:30:10 user nova-compute[85141]: DEBUG nova.network.neutron [req-5b9818e8-1f66-479c-b308-ae1db3a31f9e req-8af8a01b-84cd-408f-9440-62d48abcad3f service nova] [instance: da42de06-4518-4c8a-8c63-9b5a2759a1bf] Updating instance_info_cache with network_info: [{"id": "82a8c393-e062-47b9-a531-a6823f7d00a6", "address": "fa:16:3e:e4:f2:a7", "network": {"id": "a8f7d218-f758-44d8-adb3-120a5f724f70", "bridge": "br-int", "label": "tempest-TestStampPattern-1966889964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fb187d45ec54e74a0721973235f98b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82a8c393-e0", "ovs_interfaceid": "82a8c393-e062-47b9-a531-a6823f7d00a6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:30:10 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-5b9818e8-1f66-479c-b308-ae1db3a31f9e req-8af8a01b-84cd-408f-9440-62d48abcad3f service nova] Releasing lock "refresh_cache-da42de06-4518-4c8a-8c63-9b5a2759a1bf" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:30:10 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-541be059-fd8c-40b2-9eeb-d412d2359afc tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Acquiring lock "da42de06-4518-4c8a-8c63-9b5a2759a1bf" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:30:10 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-541be059-fd8c-40b2-9eeb-d412d2359afc tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Lock "da42de06-4518-4c8a-8c63-9b5a2759a1bf" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:30:10 user nova-compute[85141]: DEBUG nova.objects.instance [None req-541be059-fd8c-40b2-9eeb-d412d2359afc tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Lazy-loading 'flavor' on Instance uuid da42de06-4518-4c8a-8c63-9b5a2759a1bf {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:30:10 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-541be059-fd8c-40b2-9eeb-d412d2359afc tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Lock "da42de06-4518-4c8a-8c63-9b5a2759a1bf" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.050s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:30:10 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-541be059-fd8c-40b2-9eeb-d412d2359afc tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Acquiring lock "da42de06-4518-4c8a-8c63-9b5a2759a1bf" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:30:10 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-541be059-fd8c-40b2-9eeb-d412d2359afc tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Lock "da42de06-4518-4c8a-8c63-9b5a2759a1bf" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:30:10 user nova-compute[85141]: INFO nova.compute.manager [None req-541be059-fd8c-40b2-9eeb-d412d2359afc tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] [instance: da42de06-4518-4c8a-8c63-9b5a2759a1bf] Attaching volume e16e1ffd-2bca-4f15-a154-04cf7ecce772 to /dev/vdb
Nov 16 10:30:10 user nova-compute[85141]: DEBUG os_brick.utils [None req-541be059-fd8c-40b2-9eeb-d412d2359afc tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 10:30:10 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:30:10 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:30:10 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[afefc6c5-6142-4bfd-8933-c88e7baaa44c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c7834de5c295\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:30:10 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:30:10 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:30:10 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[27ff8076-0d1d-4799-aee7-6ab052a864ff]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:30:10 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:30:10 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:30:10 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[8892b483-1d9a-4ae6-a560-1fa1905ead91]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:30:10 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[afd64eda-b573-4030-9f0f-f9162ad1848f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:30:10 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-541be059-fd8c-40b2-9eeb-d412d2359afc tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Running cmd (subprocess): nvme version {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:30:10 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-541be059-fd8c-40b2-9eeb-d412d2359afc tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] 'nvme version' failed. Not Retrying. {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 10:30:10 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.nvmeof [None req-541be059-fd8c-40b2-9eeb-d412d2359afc tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] nvme not present on system {{(pid=85141) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 10:30:10 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:30:10 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 10:30:10 user nova-compute[85141]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 10:30:10 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[81dea300-f2a7-4396-9117-b1125d4fa580]: (4, '') {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:30:10 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.lightos [None req-541be059-fd8c-40b2-9eeb-d412d2359afc tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=85141) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 10:30:10 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.lightos [None req-541be059-fd8c-40b2-9eeb-d412d2359afc tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=85141) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 10:30:10 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.lightos [None req-541be059-fd8c-40b2-9eeb-d412d2359afc tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] LIGHTOS: no hostnqn found. {{(pid=85141) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 10:30:10 user nova-compute[85141]: DEBUG os_brick.utils [None req-541be059-fd8c-40b2-9eeb-d412d2359afc tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c7834de5c295', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 10:30:10 user nova-compute[85141]: DEBUG nova.virt.block_device [None req-541be059-fd8c-40b2-9eeb-d412d2359afc tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] [instance: da42de06-4518-4c8a-8c63-9b5a2759a1bf] Updating existing volume attachment record: 72fb7732-3dd3-4968-a6e2-8ed4b6e3778a {{(pid=85141) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 10:30:13 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:30:14 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:30:15 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-541be059-fd8c-40b2-9eeb-d412d2359afc tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] [instance: da42de06-4518-4c8a-8c63-9b5a2759a1bf] Calling os-brick to attach iSCSI Volume {{(pid=85141) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 10:30:15 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-541be059-fd8c-40b2-9eeb-d412d2359afc tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51806b6080>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e16e1ffd-2bca-4f15-a154-04cf7ecce772', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fMvZpdCi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 10:30:15 user nova-compute[85141]: WARNING os_brick.initiator.connectors.base [None req-541be059-fd8c-40b2-9eeb-d412d2359afc tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 10:30:15 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-541be059-fd8c-40b2-9eeb-d412d2359afc tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 10:30:15 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-541be059-fd8c-40b2-9eeb-d412d2359afc tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 10:30:15 user nova-compute[85141]: WARNING os_brick.initiator.connectors.base [None req-541be059-fd8c-40b2-9eeb-d412d2359afc tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 10:30:15 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-541be059-fd8c-40b2-9eeb-d412d2359afc tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e16e1ffd-2bca-4f15-a154-04cf7ecce772" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 10:30:15 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-541be059-fd8c-40b2-9eeb-d412d2359afc tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e16e1ffd-2bca-4f15-a154-04cf7ecce772" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 10:30:15 user nova-compute[85141]: INFO os_brick.initiator.connectors.iscsi [None req-541be059-fd8c-40b2-9eeb-d412d2359afc tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 10:30:15 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e16e1ffd-2bca-4f15-a154-04cf7ecce772 -p 172.16.0.220:3260 {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:30:15 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e16e1ffd-2bca-4f15-a154-04cf7ecce772 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:30:15 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e31daf6-c55e-4502-b991-839f857bb5e8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:30:15 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-541be059-fd8c-40b2-9eeb-d412d2359afc tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 10:30:15 user nova-compute[85141]:  {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:30:15 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e16e1ffd-2bca-4f15-a154-04cf7ecce772 -p 172.16.0.220:3260 --interface default --op new {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:30:15 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e16e1ffd-2bca-4f15-a154-04cf7ecce772 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:30:15 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[99f29226-38b9-4760-ab41-27614b097360]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e16e1ffd-2bca-4f15-a154-04cf7ecce772] added\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:30:15 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-541be059-fd8c-40b2-9eeb-d412d2359afc tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e16e1ffd-2bca-4f15-a154-04cf7ecce772] added
Nov 16 10:30:15 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:30:15 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e16e1ffd-2bca-4f15-a154-04cf7ecce772 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:30:16 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e16e1ffd-2bca-4f15-a154-04cf7ecce772 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:30:16 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[6102b500-0409-4b01-91d6-682f81e59728]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:30:16 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-541be059-fd8c-40b2-9eeb-d412d2359afc tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:30:16 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e16e1ffd-2bca-4f15-a154-04cf7ecce772 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:30:16 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e16e1ffd-2bca-4f15-a154-04cf7ecce772 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:30:16 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[f40e6b07-79a4-4b6e-b9da-5269dafebe54]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:30:16 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-541be059-fd8c-40b2-9eeb-d412d2359afc tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:30:16 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e16e1ffd-2bca-4f15-a154-04cf7ecce772 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fMvZpdCi {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:30:16 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e16e1ffd-2bca-4f15-a154-04cf7ecce772 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fMvZpdCi" returned: 0 in 0.019s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:30:16 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[5441f7b0-67f8-4c12-b677-754994dd9c55]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:30:16 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-541be059-fd8c-40b2-9eeb-d412d2359afc tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fMvZpdCi'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:30:16 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e16e1ffd-2bca-4f15-a154-04cf7ecce772 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:30:16 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e16e1ffd-2bca-4f15-a154-04cf7ecce772 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:30:16 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cb34b7f-d40c-4be3-9a25-0ac4416d2c57]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:30:16 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-541be059-fd8c-40b2-9eeb-d412d2359afc tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:30:16 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:30:16 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:30:16 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3d11b9e-62a2-4916-b094-48fe22fc9cf0]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2006a77c-e5e8-4ec5-8de5-a0f9505c429a (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0c5c19d-363b-4f5d-a04f-fb7de64423f2 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:925fd9db-7153-4861-bbc3-9cbb8822e196 (non-flash)\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:30:16 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-541be059-fd8c-40b2-9eeb-d412d2359afc tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2006a77c-e5e8-4ec5-8de5-a0f9505c429a (non-flash)
Nov 16 10:30:16 user nova-compute[85141]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0c5c19d-363b-4f5d-a04f-fb7de64423f2 (non-flash)
Nov 16 10:30:16 user nova-compute[85141]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:925fd9db-7153-4861-bbc3-9cbb8822e196 (non-flash)
Nov 16 10:30:16 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:30:16 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-541be059-fd8c-40b2-9eeb-d412d2359afc tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2006a77c-e5e8-4ec5-8de5-a0f9505c429a (non-flash)
Nov 16 10:30:16 user nova-compute[85141]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0c5c19d-363b-4f5d-a04f-fb7de64423f2 (non-flash)
Nov 16 10:30:16 user nova-compute[85141]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:925fd9db-7153-4861-bbc3-9cbb8822e196 (non-flash)
Nov 16 10:30:16 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 10:30:16 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e16e1ffd-2bca-4f15-a154-04cf7ecce772 -p 172.16.0.220:3260 --login {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:30:16 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e16e1ffd-2bca-4f15-a154-04cf7ecce772 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:30:16 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a168536-ebe5-42e2-a72b-1935877e24ec]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e16e1ffd-2bca-4f15-a154-04cf7ecce772, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e16e1ffd-2bca-4f15-a154-04cf7ecce772, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:30:16 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-541be059-fd8c-40b2-9eeb-d412d2359afc tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e16e1ffd-2bca-4f15-a154-04cf7ecce772, portal: 172.16.0.220,3260]
Nov 16 10:30:16 user nova-compute[85141]: Login to [iface: default, target: iqn.2010-10.org.openstack:e16e1ffd-2bca-4f15-a154-04cf7ecce772, portal: 172.16.0.220,3260] successful.
Nov 16 10:30:16 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:30:16 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e16e1ffd-2bca-4f15-a154-04cf7ecce772 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:30:16 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e16e1ffd-2bca-4f15-a154-04cf7ecce772 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:30:16 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b23a91e-505d-484a-b65a-6b1061128ddf]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:30:16 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-541be059-fd8c-40b2-9eeb-d412d2359afc tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:30:16 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:30:16 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:30:16 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d464430-d908-4cb9-a211-c60f933ed805]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2006a77c-e5e8-4ec5-8de5-a0f9505c429a (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0c5c19d-363b-4f5d-a04f-fb7de64423f2 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:925fd9db-7153-4861-bbc3-9cbb8822e196 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e16e1ffd-2bca-4f15-a154-04cf7ecce772 (non-flash)\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:30:16 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-541be059-fd8c-40b2-9eeb-d412d2359afc tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2006a77c-e5e8-4ec5-8de5-a0f9505c429a (non-flash)
Nov 16 10:30:16 user nova-compute[85141]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0c5c19d-363b-4f5d-a04f-fb7de64423f2 (non-flash)
Nov 16 10:30:16 user nova-compute[85141]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:925fd9db-7153-4861-bbc3-9cbb8822e196 (non-flash)
Nov 16 10:30:16 user nova-compute[85141]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e16e1ffd-2bca-4f15-a154-04cf7ecce772 (non-flash)
Nov 16 10:30:16 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:30:16 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-541be059-fd8c-40b2-9eeb-d412d2359afc tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2006a77c-e5e8-4ec5-8de5-a0f9505c429a (non-flash)
Nov 16 10:30:16 user nova-compute[85141]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0c5c19d-363b-4f5d-a04f-fb7de64423f2 (non-flash)
Nov 16 10:30:16 user nova-compute[85141]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:925fd9db-7153-4861-bbc3-9cbb8822e196 (non-flash)
Nov 16 10:30:16 user nova-compute[85141]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e16e1ffd-2bca-4f15-a154-04cf7ecce772 (non-flash)
Nov 16 10:30:16 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 10:30:16 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-541be059-fd8c-40b2-9eeb-d412d2359afc tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e16e1ffd-2bca-4f15-a154-04cf7ecce772" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.289s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 10:30:16 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-541be059-fd8c-40b2-9eeb-d412d2359afc tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Connected to 172.16.0.220:3260 {{(pid=85141) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 10:30:16 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-541be059-fd8c-40b2-9eeb-d412d2359afc tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] HCTL ('34', '-', '-', 0) found on session 44 with lun 0 {{(pid=85141) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 10:30:16 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-541be059-fd8c-40b2-9eeb-d412d2359afc tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=85141) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 10:30:16 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:30:16 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:30:16 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[827c5431-9ec6-42b0-b92d-46167a51906d]: (4, ('- - 0', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:30:16 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-541be059-fd8c-40b2-9eeb-d412d2359afc tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Searching for a device in session 44 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=85141) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 10:30:16 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-541be059-fd8c-40b2-9eeb-d412d2359afc tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:e16e1ffd-2bca-4f15-a154-04cf7ecce772', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fMvZpdCi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=85141) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 10:30:17 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-541be059-fd8c-40b2-9eeb-d412d2359afc tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.322s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 10:30:17 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-541be059-fd8c-40b2-9eeb-d412d2359afc tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] <== connect_volume: return (1324ms) {'type': 'block', 'scsi_wwn': '23430383136396166', 'path': '/dev/sdc'} {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 10:30:17 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-541be059-fd8c-40b2-9eeb-d412d2359afc tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] [instance: da42de06-4518-4c8a-8c63-9b5a2759a1bf] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23430383136396166', 'path': '/dev/sdc'} {{(pid=85141) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 10:30:17 user nova-compute[85141]: DEBUG nova.objects.instance [None req-541be059-fd8c-40b2-9eeb-d412d2359afc tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Lazy-loading 'flavor' on Instance uuid da42de06-4518-4c8a-8c63-9b5a2759a1bf {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:30:17 user nova-compute[85141]: DEBUG nova.virt.libvirt.guest [None req-541be059-fd8c-40b2-9eeb-d412d2359afc tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 10:30:17 user nova-compute[85141]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 10:30:17 user nova-compute[85141]:   <source dev="/dev/sdc"/>
Nov 16 10:30:17 user nova-compute[85141]:   <target dev="vdb" bus="virtio"/>
Nov 16 10:30:17 user nova-compute[85141]:   <serial>e16e1ffd-2bca-4f15-a154-04cf7ecce772</serial>
Nov 16 10:30:17 user nova-compute[85141]: </disk>
Nov 16 10:30:17 user nova-compute[85141]:  {{(pid=85141) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 10:30:17 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-541be059-fd8c-40b2-9eeb-d412d2359afc tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] No BDM found with device name vda, not building metadata. {{(pid=85141) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 10:30:17 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-541be059-fd8c-40b2-9eeb-d412d2359afc tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] No BDM found with device name vdb, not building metadata. {{(pid=85141) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 10:30:17 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-541be059-fd8c-40b2-9eeb-d412d2359afc tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] No VIF found with MAC fa:16:3e:e4:f2:a7, not building metadata {{(pid=85141) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 10:30:17 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-541be059-fd8c-40b2-9eeb-d412d2359afc tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Lock "da42de06-4518-4c8a-8c63-9b5a2759a1bf" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.013s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:30:18 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:30:19 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:30:20 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-307d8311-bbf4-4bd2-b49b-982d13256197 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Acquiring lock "da42de06-4518-4c8a-8c63-9b5a2759a1bf" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:30:20 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-307d8311-bbf4-4bd2-b49b-982d13256197 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Lock "da42de06-4518-4c8a-8c63-9b5a2759a1bf" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:30:20 user nova-compute[85141]: INFO nova.compute.manager [None req-307d8311-bbf4-4bd2-b49b-982d13256197 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] [instance: da42de06-4518-4c8a-8c63-9b5a2759a1bf] Detaching volume e16e1ffd-2bca-4f15-a154-04cf7ecce772
Nov 16 10:30:20 user nova-compute[85141]: INFO nova.virt.block_device [None req-307d8311-bbf4-4bd2-b49b-982d13256197 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] [instance: da42de06-4518-4c8a-8c63-9b5a2759a1bf] Attempting to driver detach volume e16e1ffd-2bca-4f15-a154-04cf7ecce772 from mountpoint /dev/vdb
Nov 16 10:30:20 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-307d8311-bbf4-4bd2-b49b-982d13256197 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Attempting to detach device vdb from instance da42de06-4518-4c8a-8c63-9b5a2759a1bf from the persistent domain config. {{(pid=85141) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 10:30:20 user nova-compute[85141]: DEBUG nova.virt.libvirt.guest [None req-307d8311-bbf4-4bd2-b49b-982d13256197 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 10:30:20 user nova-compute[85141]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 10:30:20 user nova-compute[85141]:   <source dev="/dev/sdc"/>
Nov 16 10:30:20 user nova-compute[85141]:   <target dev="vdb" bus="virtio"/>
Nov 16 10:30:20 user nova-compute[85141]:   <serial>e16e1ffd-2bca-4f15-a154-04cf7ecce772</serial>
Nov 16 10:30:20 user nova-compute[85141]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 10:30:20 user nova-compute[85141]: </disk>
Nov 16 10:30:20 user nova-compute[85141]:  {{(pid=85141) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 10:30:20 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-307d8311-bbf4-4bd2-b49b-982d13256197 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Successfully detached device vdb from instance da42de06-4518-4c8a-8c63-9b5a2759a1bf from the persistent domain config.
Nov 16 10:30:20 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-307d8311-bbf4-4bd2-b49b-982d13256197 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance da42de06-4518-4c8a-8c63-9b5a2759a1bf from the live domain config. {{(pid=85141) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 10:30:20 user nova-compute[85141]: DEBUG nova.virt.libvirt.guest [None req-307d8311-bbf4-4bd2-b49b-982d13256197 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 10:30:20 user nova-compute[85141]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 10:30:20 user nova-compute[85141]:   <source dev="/dev/sdc"/>
Nov 16 10:30:20 user nova-compute[85141]:   <target dev="vdb" bus="virtio"/>
Nov 16 10:30:20 user nova-compute[85141]:   <serial>e16e1ffd-2bca-4f15-a154-04cf7ecce772</serial>
Nov 16 10:30:20 user nova-compute[85141]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 10:30:20 user nova-compute[85141]: </disk>
Nov 16 10:30:20 user nova-compute[85141]:  {{(pid=85141) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 10:30:20 user nova-compute[85141]: DEBUG nova.compute.manager [req-ad5c9841-59b5-4976-9dcd-1986b7444a1c req-fcd96118-55df-472f-8ec1-874804d9f723 service nova] [instance: 89e358d7-0844-4742-853b-ff88800415d2] Received event network-changed-b60a8a3c-4aac-4af1-ba04-d8a61ab96324 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:30:20 user nova-compute[85141]: DEBUG nova.compute.manager [req-ad5c9841-59b5-4976-9dcd-1986b7444a1c req-fcd96118-55df-472f-8ec1-874804d9f723 service nova] [instance: 89e358d7-0844-4742-853b-ff88800415d2] Refreshing instance network info cache due to event network-changed-b60a8a3c-4aac-4af1-ba04-d8a61ab96324. {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 10:30:20 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-ad5c9841-59b5-4976-9dcd-1986b7444a1c req-fcd96118-55df-472f-8ec1-874804d9f723 service nova] Acquiring lock "refresh_cache-89e358d7-0844-4742-853b-ff88800415d2" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:30:20 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-ad5c9841-59b5-4976-9dcd-1986b7444a1c req-fcd96118-55df-472f-8ec1-874804d9f723 service nova] Acquired lock "refresh_cache-89e358d7-0844-4742-853b-ff88800415d2" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:30:20 user nova-compute[85141]: DEBUG nova.network.neutron [req-ad5c9841-59b5-4976-9dcd-1986b7444a1c req-fcd96118-55df-472f-8ec1-874804d9f723 service nova] [instance: 89e358d7-0844-4742-853b-ff88800415d2] Refreshing network info cache for port b60a8a3c-4aac-4af1-ba04-d8a61ab96324 {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 10:30:20 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-307d8311-bbf4-4bd2-b49b-982d13256197 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance da42de06-4518-4c8a-8c63-9b5a2759a1bf {{(pid=85141) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 10:30:20 user nova-compute[85141]: DEBUG nova.network.neutron [req-ad5c9841-59b5-4976-9dcd-1986b7444a1c req-fcd96118-55df-472f-8ec1-874804d9f723 service nova] [instance: 89e358d7-0844-4742-853b-ff88800415d2] Updated VIF entry in instance network info cache for port b60a8a3c-4aac-4af1-ba04-d8a61ab96324. {{(pid=85141) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 10:30:20 user nova-compute[85141]: DEBUG nova.network.neutron [req-ad5c9841-59b5-4976-9dcd-1986b7444a1c req-fcd96118-55df-472f-8ec1-874804d9f723 service nova] [instance: 89e358d7-0844-4742-853b-ff88800415d2] Updating instance_info_cache with network_info: [{"id": "b60a8a3c-4aac-4af1-ba04-d8a61ab96324", "address": "fa:16:3e:56:2d:dd", "network": {"id": "4e36c3d2-7d16-4305-a0a7-2358e1208df3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1030128743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2acc04e107d4a229c3580cf078a20f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb60a8a3c-4a", "ovs_interfaceid": "b60a8a3c-4aac-4af1-ba04-d8a61ab96324", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:30:20 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-ad5c9841-59b5-4976-9dcd-1986b7444a1c req-fcd96118-55df-472f-8ec1-874804d9f723 service nova] Releasing lock "refresh_cache-89e358d7-0844-4742-853b-ff88800415d2" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:30:21 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-ab183341-72fe-4eca-9e6a-2f8f2e0b3ef0 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Acquiring lock "463034ff-14ce-477a-9642-4d86aa6f9cd9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:30:21 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-ab183341-72fe-4eca-9e6a-2f8f2e0b3ef0 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Lock "463034ff-14ce-477a-9642-4d86aa6f9cd9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:30:21 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-ab183341-72fe-4eca-9e6a-2f8f2e0b3ef0 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Acquiring lock "463034ff-14ce-477a-9642-4d86aa6f9cd9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:30:21 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-ab183341-72fe-4eca-9e6a-2f8f2e0b3ef0 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Lock "463034ff-14ce-477a-9642-4d86aa6f9cd9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:30:21 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-ab183341-72fe-4eca-9e6a-2f8f2e0b3ef0 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Lock "463034ff-14ce-477a-9642-4d86aa6f9cd9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:30:21 user nova-compute[85141]: INFO nova.compute.manager [None req-ab183341-72fe-4eca-9e6a-2f8f2e0b3ef0 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] [instance: 463034ff-14ce-477a-9642-4d86aa6f9cd9] Terminating instance
Nov 16 10:30:21 user nova-compute[85141]: DEBUG nova.compute.manager [None req-ab183341-72fe-4eca-9e6a-2f8f2e0b3ef0 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] [instance: 463034ff-14ce-477a-9642-4d86aa6f9cd9] Start destroying the instance on the hypervisor. {{(pid=85141) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 10:30:21 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:30:21 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:30:21 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:30:21 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:30:21 user nova-compute[85141]: INFO nova.virt.libvirt.driver [-] [instance: 463034ff-14ce-477a-9642-4d86aa6f9cd9] Instance destroyed successfully.
Nov 16 10:30:21 user nova-compute[85141]: DEBUG nova.objects.instance [None req-ab183341-72fe-4eca-9e6a-2f8f2e0b3ef0 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Lazy-loading 'resources' on Instance uuid 463034ff-14ce-477a-9642-4d86aa6f9cd9 {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:30:21 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-ab183341-72fe-4eca-9e6a-2f8f2e0b3ef0 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T10:23:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-574895759',display_name='tempest-ServerRescueNegativeTestJSON-server-574895759',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-574895759',id=30,image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPy9eDkAgUcYCfTGhKLJIwUDyptUWD0jpoBJdtiaupfL19VFNXv7ziT8DtfeHqgz7E4YFUN6fJXfeX4wrZlUO//q/m/KCWJdqM1qmRa4ROfNjPo1wV8qmxBxFoKuN0LXfA==',key_name='tempest-keypair-392930711',keypairs=<?>,launch_index=0,launched_at=2023-11-16T10:25:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='09b520de67ac4290a4b779f50afeb1a4',ramdisk_id='',reservation_id='r-a1f5xtl2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-2068988845',owner_user_name='tempest-ServerRescueNegativeTestJSON-2068988845-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T10:27:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='76d4eaf5cef745c3bf3ae07068338b1a',uuid=463034ff-14ce-477a-9642-4d86aa6f9cd9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "121bbc09-53cf-4586-8585-655079b4c49b", "address": "fa:16:3e:b0:77:d5", "network": {"id": "5b67a3fd-ef1e-4f2c-b6e0-31766ef39d30", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2137186235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09b520de67ac4290a4b779f50afeb1a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap121bbc09-53", "ovs_interfaceid": "121bbc09-53cf-4586-8585-655079b4c49b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 10:30:21 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-ab183341-72fe-4eca-9e6a-2f8f2e0b3ef0 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Converting VIF {"id": "121bbc09-53cf-4586-8585-655079b4c49b", "address": "fa:16:3e:b0:77:d5", "network": {"id": "5b67a3fd-ef1e-4f2c-b6e0-31766ef39d30", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2137186235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09b520de67ac4290a4b779f50afeb1a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap121bbc09-53", "ovs_interfaceid": "121bbc09-53cf-4586-8585-655079b4c49b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:30:21 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-ab183341-72fe-4eca-9e6a-2f8f2e0b3ef0 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b0:77:d5,bridge_name='br-int',has_traffic_filtering=True,id=121bbc09-53cf-4586-8585-655079b4c49b,network=Network(5b67a3fd-ef1e-4f2c-b6e0-31766ef39d30),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap121bbc09-53') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:30:21 user nova-compute[85141]: DEBUG os_vif [None req-ab183341-72fe-4eca-9e6a-2f8f2e0b3ef0 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b0:77:d5,bridge_name='br-int',has_traffic_filtering=True,id=121bbc09-53cf-4586-8585-655079b4c49b,network=Network(5b67a3fd-ef1e-4f2c-b6e0-31766ef39d30),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap121bbc09-53') {{(pid=85141) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 10:30:21 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:30:21 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap121bbc09-53, bridge=br-int, if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:30:21 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:30:21 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:30:21 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:30:21 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d29664a6-e262-49d5-8560-f9e8578769f4) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:30:21 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:30:21 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:30:21 user nova-compute[85141]: INFO os_vif [None req-ab183341-72fe-4eca-9e6a-2f8f2e0b3ef0 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b0:77:d5,bridge_name='br-int',has_traffic_filtering=True,id=121bbc09-53cf-4586-8585-655079b4c49b,network=Network(5b67a3fd-ef1e-4f2c-b6e0-31766ef39d30),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap121bbc09-53')
Nov 16 10:30:21 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-ab183341-72fe-4eca-9e6a-2f8f2e0b3ef0 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] [instance: 463034ff-14ce-477a-9642-4d86aa6f9cd9] Deleting instance files /opt/stack/data/nova/instances/463034ff-14ce-477a-9642-4d86aa6f9cd9_del
Nov 16 10:30:21 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-ab183341-72fe-4eca-9e6a-2f8f2e0b3ef0 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] [instance: 463034ff-14ce-477a-9642-4d86aa6f9cd9] Deletion of /opt/stack/data/nova/instances/463034ff-14ce-477a-9642-4d86aa6f9cd9_del complete
Nov 16 10:30:21 user nova-compute[85141]: INFO nova.compute.manager [None req-ab183341-72fe-4eca-9e6a-2f8f2e0b3ef0 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] [instance: 463034ff-14ce-477a-9642-4d86aa6f9cd9] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 16 10:30:21 user nova-compute[85141]: DEBUG oslo.service.loopingcall [None req-ab183341-72fe-4eca-9e6a-2f8f2e0b3ef0 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=85141) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 10:30:21 user nova-compute[85141]: DEBUG nova.compute.manager [-] [instance: 463034ff-14ce-477a-9642-4d86aa6f9cd9] Deallocating network for instance {{(pid=85141) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 10:30:21 user nova-compute[85141]: DEBUG nova.network.neutron [-] [instance: 463034ff-14ce-477a-9642-4d86aa6f9cd9] deallocate_for_instance() {{(pid=85141) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 10:30:22 user nova-compute[85141]: DEBUG nova.compute.manager [req-093b7926-3184-47a1-bf47-de24d8a8ec1e req-b373153f-cfca-4553-856c-6966c0f82c34 service nova] [instance: 463034ff-14ce-477a-9642-4d86aa6f9cd9] Received event network-vif-unplugged-121bbc09-53cf-4586-8585-655079b4c49b {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:30:22 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-093b7926-3184-47a1-bf47-de24d8a8ec1e req-b373153f-cfca-4553-856c-6966c0f82c34 service nova] Acquiring lock "463034ff-14ce-477a-9642-4d86aa6f9cd9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:30:22 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-093b7926-3184-47a1-bf47-de24d8a8ec1e req-b373153f-cfca-4553-856c-6966c0f82c34 service nova] Lock "463034ff-14ce-477a-9642-4d86aa6f9cd9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:30:22 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-093b7926-3184-47a1-bf47-de24d8a8ec1e req-b373153f-cfca-4553-856c-6966c0f82c34 service nova] Lock "463034ff-14ce-477a-9642-4d86aa6f9cd9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:30:22 user nova-compute[85141]: DEBUG nova.compute.manager [req-093b7926-3184-47a1-bf47-de24d8a8ec1e req-b373153f-cfca-4553-856c-6966c0f82c34 service nova] [instance: 463034ff-14ce-477a-9642-4d86aa6f9cd9] No waiting events found dispatching network-vif-unplugged-121bbc09-53cf-4586-8585-655079b4c49b {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:30:22 user nova-compute[85141]: DEBUG nova.compute.manager [req-093b7926-3184-47a1-bf47-de24d8a8ec1e req-b373153f-cfca-4553-856c-6966c0f82c34 service nova] [instance: 463034ff-14ce-477a-9642-4d86aa6f9cd9] Received event network-vif-unplugged-121bbc09-53cf-4586-8585-655079b4c49b for instance with task_state deleting. {{(pid=85141) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 10:30:22 user nova-compute[85141]: DEBUG nova.compute.manager [req-093b7926-3184-47a1-bf47-de24d8a8ec1e req-b373153f-cfca-4553-856c-6966c0f82c34 service nova] [instance: 463034ff-14ce-477a-9642-4d86aa6f9cd9] Received event network-vif-plugged-121bbc09-53cf-4586-8585-655079b4c49b {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:30:22 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-093b7926-3184-47a1-bf47-de24d8a8ec1e req-b373153f-cfca-4553-856c-6966c0f82c34 service nova] Acquiring lock "463034ff-14ce-477a-9642-4d86aa6f9cd9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:30:22 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-093b7926-3184-47a1-bf47-de24d8a8ec1e req-b373153f-cfca-4553-856c-6966c0f82c34 service nova] Lock "463034ff-14ce-477a-9642-4d86aa6f9cd9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:30:22 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-093b7926-3184-47a1-bf47-de24d8a8ec1e req-b373153f-cfca-4553-856c-6966c0f82c34 service nova] Lock "463034ff-14ce-477a-9642-4d86aa6f9cd9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:30:22 user nova-compute[85141]: DEBUG nova.compute.manager [req-093b7926-3184-47a1-bf47-de24d8a8ec1e req-b373153f-cfca-4553-856c-6966c0f82c34 service nova] [instance: 463034ff-14ce-477a-9642-4d86aa6f9cd9] No waiting events found dispatching network-vif-plugged-121bbc09-53cf-4586-8585-655079b4c49b {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:30:22 user nova-compute[85141]: WARNING nova.compute.manager [req-093b7926-3184-47a1-bf47-de24d8a8ec1e req-b373153f-cfca-4553-856c-6966c0f82c34 service nova] [instance: 463034ff-14ce-477a-9642-4d86aa6f9cd9] Received unexpected event network-vif-plugged-121bbc09-53cf-4586-8585-655079b4c49b for instance with vm_state active and task_state deleting.
Nov 16 10:30:22 user nova-compute[85141]: DEBUG nova.network.neutron [-] [instance: 463034ff-14ce-477a-9642-4d86aa6f9cd9] Updating instance_info_cache with network_info: [] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:30:22 user nova-compute[85141]: INFO nova.compute.manager [-] [instance: 463034ff-14ce-477a-9642-4d86aa6f9cd9] Took 0.86 seconds to deallocate network for instance.
Nov 16 10:30:22 user nova-compute[85141]: DEBUG nova.compute.manager [req-4c5f0c3c-e9bf-4cfc-b6d9-6172957d4de4 req-bd2b596e-d277-4b0c-aa45-f7525e526379 service nova] [instance: 463034ff-14ce-477a-9642-4d86aa6f9cd9] Received event network-vif-deleted-121bbc09-53cf-4586-8585-655079b4c49b {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:30:22 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-ab183341-72fe-4eca-9e6a-2f8f2e0b3ef0 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:30:22 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-ab183341-72fe-4eca-9e6a-2f8f2e0b3ef0 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:30:23 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-cfb865d6-ce89-4e60-9463-426adf0ee7d3 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Acquiring lock "89e358d7-0844-4742-853b-ff88800415d2" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:30:23 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-cfb865d6-ce89-4e60-9463-426adf0ee7d3 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Lock "89e358d7-0844-4742-853b-ff88800415d2" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:30:23 user nova-compute[85141]: DEBUG nova.objects.instance [None req-cfb865d6-ce89-4e60-9463-426adf0ee7d3 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Lazy-loading 'flavor' on Instance uuid 89e358d7-0844-4742-853b-ff88800415d2 {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:30:23 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-cfb865d6-ce89-4e60-9463-426adf0ee7d3 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Lock "89e358d7-0844-4742-853b-ff88800415d2" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.078s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:30:23 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:30:23 user nova-compute[85141]: DEBUG nova.compute.provider_tree [None req-ab183341-72fe-4eca-9e6a-2f8f2e0b3ef0 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Inventory has not changed in ProviderTree for provider: bf8e0fa1-16b6-408f-9203-c4cd63916272 {{(pid=85141) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 10:30:23 user nova-compute[85141]: DEBUG nova.scheduler.client.report [None req-ab183341-72fe-4eca-9e6a-2f8f2e0b3ef0 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Inventory has not changed for provider bf8e0fa1-16b6-408f-9203-c4cd63916272 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=85141) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 10:30:23 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-cfb865d6-ce89-4e60-9463-426adf0ee7d3 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Acquiring lock "89e358d7-0844-4742-853b-ff88800415d2" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:30:23 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-cfb865d6-ce89-4e60-9463-426adf0ee7d3 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Lock "89e358d7-0844-4742-853b-ff88800415d2" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:30:23 user nova-compute[85141]: INFO nova.compute.manager [None req-cfb865d6-ce89-4e60-9463-426adf0ee7d3 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] [instance: 89e358d7-0844-4742-853b-ff88800415d2] Attaching volume f30b1bab-5fbb-4103-a00a-cf0e857ce92a to /dev/vdb
Nov 16 10:30:23 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-ab183341-72fe-4eca-9e6a-2f8f2e0b3ef0 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.437s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:30:23 user nova-compute[85141]: DEBUG os_brick.utils [None req-cfb865d6-ce89-4e60-9463-426adf0ee7d3 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 10:30:23 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:30:23 user nova-compute[85141]: INFO nova.scheduler.client.report [None req-ab183341-72fe-4eca-9e6a-2f8f2e0b3ef0 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Deleted allocations for instance 463034ff-14ce-477a-9642-4d86aa6f9cd9
Nov 16 10:30:23 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:30:23 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[743c14f1-1a83-4ded-b457-e60b5a5ebac4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c7834de5c295\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:30:23 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:30:23 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:30:23 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[0644001c-99a4-409d-b745-527e2b55d520]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:30:23 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:30:23 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:30:23 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1c85aad-4d04-451c-948b-ea028b20ce12]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:30:23 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[f98559af-f332-4723-8639-4a16220c3c4d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:30:23 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-cfb865d6-ce89-4e60-9463-426adf0ee7d3 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Running cmd (subprocess): nvme version {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:30:23 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-cfb865d6-ce89-4e60-9463-426adf0ee7d3 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] 'nvme version' failed. Not Retrying. {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 10:30:23 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cfb865d6-ce89-4e60-9463-426adf0ee7d3 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] nvme not present on system {{(pid=85141) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 10:30:23 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:30:23 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-ab183341-72fe-4eca-9e6a-2f8f2e0b3ef0 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Lock "463034ff-14ce-477a-9642-4d86aa6f9cd9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.371s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:30:23 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 10:30:23 user nova-compute[85141]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 10:30:23 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2f47c51-9b41-4f97-8e42-d8db1e241b57]: (4, '') {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:30:23 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.lightos [None req-cfb865d6-ce89-4e60-9463-426adf0ee7d3 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=85141) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 10:30:23 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.lightos [None req-cfb865d6-ce89-4e60-9463-426adf0ee7d3 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=85141) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 10:30:23 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.lightos [None req-cfb865d6-ce89-4e60-9463-426adf0ee7d3 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] LIGHTOS: no hostnqn found. {{(pid=85141) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 10:30:23 user nova-compute[85141]: DEBUG os_brick.utils [None req-cfb865d6-ce89-4e60-9463-426adf0ee7d3 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c7834de5c295', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 10:30:23 user nova-compute[85141]: DEBUG nova.virt.block_device [None req-cfb865d6-ce89-4e60-9463-426adf0ee7d3 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] [instance: 89e358d7-0844-4742-853b-ff88800415d2] Updating existing volume attachment record: a2625cb9-2e98-4603-95db-558ed9f1981d {{(pid=85141) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 10:30:26 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:30:28 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:30:28 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cfb865d6-ce89-4e60-9463-426adf0ee7d3 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] [instance: 89e358d7-0844-4742-853b-ff88800415d2] Calling os-brick to attach iSCSI Volume {{(pid=85141) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 10:30:28 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfb865d6-ce89-4e60-9463-426adf0ee7d3 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51806b6080>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f30b1bab-5fbb-4103-a00a-cf0e857ce92a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FBcOfdVM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 10:30:28 user nova-compute[85141]: WARNING os_brick.initiator.connectors.base [None req-cfb865d6-ce89-4e60-9463-426adf0ee7d3 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 10:30:28 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-cfb865d6-ce89-4e60-9463-426adf0ee7d3 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 10:30:28 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-cfb865d6-ce89-4e60-9463-426adf0ee7d3 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 10:30:28 user nova-compute[85141]: WARNING os_brick.initiator.connectors.base [None req-cfb865d6-ce89-4e60-9463-426adf0ee7d3 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 10:30:28 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-cfb865d6-ce89-4e60-9463-426adf0ee7d3 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f30b1bab-5fbb-4103-a00a-cf0e857ce92a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 10:30:28 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-cfb865d6-ce89-4e60-9463-426adf0ee7d3 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f30b1bab-5fbb-4103-a00a-cf0e857ce92a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 10:30:28 user nova-compute[85141]: INFO os_brick.initiator.connectors.iscsi [None req-cfb865d6-ce89-4e60-9463-426adf0ee7d3 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 10:30:28 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f30b1bab-5fbb-4103-a00a-cf0e857ce92a -p 172.16.0.220:3260 {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:30:28 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f30b1bab-5fbb-4103-a00a-cf0e857ce92a -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:30:28 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[b529a78e-eb48-41be-9663-ad4b5449a3a1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:30:28 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfb865d6-ce89-4e60-9463-426adf0ee7d3 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 10:30:28 user nova-compute[85141]:  {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:30:28 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f30b1bab-5fbb-4103-a00a-cf0e857ce92a -p 172.16.0.220:3260 --interface default --op new {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:30:28 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f30b1bab-5fbb-4103-a00a-cf0e857ce92a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:30:28 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5c74d74-33f8-45ae-8945-a2609f097b22]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f30b1bab-5fbb-4103-a00a-cf0e857ce92a] added\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:30:28 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfb865d6-ce89-4e60-9463-426adf0ee7d3 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f30b1bab-5fbb-4103-a00a-cf0e857ce92a] added
Nov 16 10:30:28 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:30:28 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f30b1bab-5fbb-4103-a00a-cf0e857ce92a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:30:28 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f30b1bab-5fbb-4103-a00a-cf0e857ce92a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:30:28 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c3c5df1-0d15-43dc-a4ec-21caac7c17f2]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:30:28 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfb865d6-ce89-4e60-9463-426adf0ee7d3 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:30:28 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f30b1bab-5fbb-4103-a00a-cf0e857ce92a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:30:28 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f30b1bab-5fbb-4103-a00a-cf0e857ce92a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:30:28 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[687d06d8-b63c-49f1-bfaa-af8cedf65049]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:30:28 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfb865d6-ce89-4e60-9463-426adf0ee7d3 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:30:28 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f30b1bab-5fbb-4103-a00a-cf0e857ce92a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FBcOfdVM {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:30:28 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f30b1bab-5fbb-4103-a00a-cf0e857ce92a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FBcOfdVM" returned: 0 in 0.017s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:30:28 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[a64620cc-9ca9-4dc6-9389-910c2327eb8a]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:30:28 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfb865d6-ce89-4e60-9463-426adf0ee7d3 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FBcOfdVM'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:30:28 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f30b1bab-5fbb-4103-a00a-cf0e857ce92a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:30:28 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f30b1bab-5fbb-4103-a00a-cf0e857ce92a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:30:28 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[29d73931-07a7-4010-9a2d-41e909a4f958]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:30:28 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfb865d6-ce89-4e60-9463-426adf0ee7d3 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:30:28 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:30:28 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:30:28 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[21215b7f-d476-48b2-bdd8-668cb601ef30]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2006a77c-e5e8-4ec5-8de5-a0f9505c429a (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0c5c19d-363b-4f5d-a04f-fb7de64423f2 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:925fd9db-7153-4861-bbc3-9cbb8822e196 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e16e1ffd-2bca-4f15-a154-04cf7ecce772 (non-flash)\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:30:28 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfb865d6-ce89-4e60-9463-426adf0ee7d3 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2006a77c-e5e8-4ec5-8de5-a0f9505c429a (non-flash)
Nov 16 10:30:28 user nova-compute[85141]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0c5c19d-363b-4f5d-a04f-fb7de64423f2 (non-flash)
Nov 16 10:30:28 user nova-compute[85141]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:925fd9db-7153-4861-bbc3-9cbb8822e196 (non-flash)
Nov 16 10:30:28 user nova-compute[85141]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e16e1ffd-2bca-4f15-a154-04cf7ecce772 (non-flash)
Nov 16 10:30:28 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:30:28 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfb865d6-ce89-4e60-9463-426adf0ee7d3 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2006a77c-e5e8-4ec5-8de5-a0f9505c429a (non-flash)
Nov 16 10:30:28 user nova-compute[85141]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0c5c19d-363b-4f5d-a04f-fb7de64423f2 (non-flash)
Nov 16 10:30:28 user nova-compute[85141]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:925fd9db-7153-4861-bbc3-9cbb8822e196 (non-flash)
Nov 16 10:30:28 user nova-compute[85141]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e16e1ffd-2bca-4f15-a154-04cf7ecce772 (non-flash)
Nov 16 10:30:28 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 10:30:28 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f30b1bab-5fbb-4103-a00a-cf0e857ce92a -p 172.16.0.220:3260 --login {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:30:28 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f30b1bab-5fbb-4103-a00a-cf0e857ce92a -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:30:28 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[486e5e86-ef63-4667-be56-b7e1068ce29a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f30b1bab-5fbb-4103-a00a-cf0e857ce92a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f30b1bab-5fbb-4103-a00a-cf0e857ce92a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:30:28 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfb865d6-ce89-4e60-9463-426adf0ee7d3 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f30b1bab-5fbb-4103-a00a-cf0e857ce92a, portal: 172.16.0.220,3260]
Nov 16 10:30:28 user nova-compute[85141]: Login to [iface: default, target: iqn.2010-10.org.openstack:f30b1bab-5fbb-4103-a00a-cf0e857ce92a, portal: 172.16.0.220,3260] successful.
Nov 16 10:30:28 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:30:28 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f30b1bab-5fbb-4103-a00a-cf0e857ce92a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:30:28 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f30b1bab-5fbb-4103-a00a-cf0e857ce92a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:30:28 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ed81223-4b62-4469-9a53-09de9ca3ab21]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:30:28 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfb865d6-ce89-4e60-9463-426adf0ee7d3 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:30:28 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:30:28 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:30:28 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6df9097-b401-4591-833c-aa483da152c5]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2006a77c-e5e8-4ec5-8de5-a0f9505c429a (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0c5c19d-363b-4f5d-a04f-fb7de64423f2 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:925fd9db-7153-4861-bbc3-9cbb8822e196 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e16e1ffd-2bca-4f15-a154-04cf7ecce772 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f30b1bab-5fbb-4103-a00a-cf0e857ce92a (non-flash)\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:30:28 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfb865d6-ce89-4e60-9463-426adf0ee7d3 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2006a77c-e5e8-4ec5-8de5-a0f9505c429a (non-flash)
Nov 16 10:30:28 user nova-compute[85141]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0c5c19d-363b-4f5d-a04f-fb7de64423f2 (non-flash)
Nov 16 10:30:28 user nova-compute[85141]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:925fd9db-7153-4861-bbc3-9cbb8822e196 (non-flash)
Nov 16 10:30:28 user nova-compute[85141]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e16e1ffd-2bca-4f15-a154-04cf7ecce772 (non-flash)
Nov 16 10:30:28 user nova-compute[85141]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f30b1bab-5fbb-4103-a00a-cf0e857ce92a (non-flash)
Nov 16 10:30:28 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:30:28 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfb865d6-ce89-4e60-9463-426adf0ee7d3 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2006a77c-e5e8-4ec5-8de5-a0f9505c429a (non-flash)
Nov 16 10:30:28 user nova-compute[85141]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0c5c19d-363b-4f5d-a04f-fb7de64423f2 (non-flash)
Nov 16 10:30:28 user nova-compute[85141]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:925fd9db-7153-4861-bbc3-9cbb8822e196 (non-flash)
Nov 16 10:30:28 user nova-compute[85141]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e16e1ffd-2bca-4f15-a154-04cf7ecce772 (non-flash)
Nov 16 10:30:28 user nova-compute[85141]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f30b1bab-5fbb-4103-a00a-cf0e857ce92a (non-flash)
Nov 16 10:30:28 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 10:30:28 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-cfb865d6-ce89-4e60-9463-426adf0ee7d3 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f30b1bab-5fbb-4103-a00a-cf0e857ce92a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.280s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 10:30:28 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfb865d6-ce89-4e60-9463-426adf0ee7d3 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Connected to 172.16.0.220:3260 {{(pid=85141) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 10:30:28 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-cfb865d6-ce89-4e60-9463-426adf0ee7d3 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] HCTL ('37', '-', '-', 0) found on session 45 with lun 0 {{(pid=85141) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 10:30:28 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-cfb865d6-ce89-4e60-9463-426adf0ee7d3 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=85141) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 10:30:28 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:30:28 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.016s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:30:28 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[58477356-6884-4c93-b273-2b8784a86464]: (4, ('- - 0', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:30:28 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-cfb865d6-ce89-4e60-9463-426adf0ee7d3 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Searching for a device in session 45 and hctl ['37', '*', '*', 0] yield: None {{(pid=85141) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 10:30:28 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-91d0ac47-bbfd-4ef8-b83c-92ec0e8e8fb4 tempest-VolumesNegativeTest-355403086 tempest-VolumesNegativeTest-355403086-project-member] Acquiring lock "7628b43b-5b22-440b-a27b-bf2e28b93cf6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:30:28 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-91d0ac47-bbfd-4ef8-b83c-92ec0e8e8fb4 tempest-VolumesNegativeTest-355403086 tempest-VolumesNegativeTest-355403086-project-member] Lock "7628b43b-5b22-440b-a27b-bf2e28b93cf6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:30:28 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-91d0ac47-bbfd-4ef8-b83c-92ec0e8e8fb4 tempest-VolumesNegativeTest-355403086 tempest-VolumesNegativeTest-355403086-project-member] Acquiring lock "7628b43b-5b22-440b-a27b-bf2e28b93cf6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:30:28 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-91d0ac47-bbfd-4ef8-b83c-92ec0e8e8fb4 tempest-VolumesNegativeTest-355403086 tempest-VolumesNegativeTest-355403086-project-member] Lock "7628b43b-5b22-440b-a27b-bf2e28b93cf6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:30:28 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-91d0ac47-bbfd-4ef8-b83c-92ec0e8e8fb4 tempest-VolumesNegativeTest-355403086 tempest-VolumesNegativeTest-355403086-project-member] Lock "7628b43b-5b22-440b-a27b-bf2e28b93cf6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:30:28 user nova-compute[85141]: INFO nova.compute.manager [None req-91d0ac47-bbfd-4ef8-b83c-92ec0e8e8fb4 tempest-VolumesNegativeTest-355403086 tempest-VolumesNegativeTest-355403086-project-member] [instance: 7628b43b-5b22-440b-a27b-bf2e28b93cf6] Terminating instance
Nov 16 10:30:28 user nova-compute[85141]: DEBUG nova.compute.manager [None req-91d0ac47-bbfd-4ef8-b83c-92ec0e8e8fb4 tempest-VolumesNegativeTest-355403086 tempest-VolumesNegativeTest-355403086-project-member] [instance: 7628b43b-5b22-440b-a27b-bf2e28b93cf6] Start destroying the instance on the hypervisor. {{(pid=85141) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 10:30:28 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:30:29 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:30:29 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:30:29 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:30:29 user nova-compute[85141]: DEBUG nova.compute.manager [req-f617d0a9-1913-4666-9096-62acce04d1ab req-3bb82739-6b1d-4911-a322-569ebe29b1cf service nova] [instance: 7628b43b-5b22-440b-a27b-bf2e28b93cf6] Received event network-vif-unplugged-9ac05886-79dc-4a75-a676-7db0abb46f99 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:30:29 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-f617d0a9-1913-4666-9096-62acce04d1ab req-3bb82739-6b1d-4911-a322-569ebe29b1cf service nova] Acquiring lock "7628b43b-5b22-440b-a27b-bf2e28b93cf6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:30:29 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-f617d0a9-1913-4666-9096-62acce04d1ab req-3bb82739-6b1d-4911-a322-569ebe29b1cf service nova] Lock "7628b43b-5b22-440b-a27b-bf2e28b93cf6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:30:29 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-f617d0a9-1913-4666-9096-62acce04d1ab req-3bb82739-6b1d-4911-a322-569ebe29b1cf service nova] Lock "7628b43b-5b22-440b-a27b-bf2e28b93cf6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:30:29 user nova-compute[85141]: DEBUG nova.compute.manager [req-f617d0a9-1913-4666-9096-62acce04d1ab req-3bb82739-6b1d-4911-a322-569ebe29b1cf service nova] [instance: 7628b43b-5b22-440b-a27b-bf2e28b93cf6] No waiting events found dispatching network-vif-unplugged-9ac05886-79dc-4a75-a676-7db0abb46f99 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:30:29 user nova-compute[85141]: DEBUG nova.compute.manager [req-f617d0a9-1913-4666-9096-62acce04d1ab req-3bb82739-6b1d-4911-a322-569ebe29b1cf service nova] [instance: 7628b43b-5b22-440b-a27b-bf2e28b93cf6] Received event network-vif-unplugged-9ac05886-79dc-4a75-a676-7db0abb46f99 for instance with task_state deleting. {{(pid=85141) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 10:30:29 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:30:29 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:30:29 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:30:29 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:30:29 user nova-compute[85141]: INFO nova.virt.libvirt.driver [-] [instance: 7628b43b-5b22-440b-a27b-bf2e28b93cf6] Instance destroyed successfully.
Nov 16 10:30:29 user nova-compute[85141]: DEBUG nova.objects.instance [None req-91d0ac47-bbfd-4ef8-b83c-92ec0e8e8fb4 tempest-VolumesNegativeTest-355403086 tempest-VolumesNegativeTest-355403086-project-member] Lazy-loading 'resources' on Instance uuid 7628b43b-5b22-440b-a27b-bf2e28b93cf6 {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:30:29 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-91d0ac47-bbfd-4ef8-b83c-92ec0e8e8fb4 tempest-VolumesNegativeTest-355403086 tempest-VolumesNegativeTest-355403086-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T10:28:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-690147246',display_name='tempest-VolumesNegativeTest-instance-690147246',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-690147246',id=40,image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-16T10:28:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='83a6d2c2eba5496dad2b9cba236f319d',ramdisk_id='',reservation_id='r-m1epctf0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-355403086',owner_user_name='tempest-VolumesNegativeTest-355403086-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T10:28:46Z,user_data=None,user_id='b8592a9c3715469b961e4bec8011c6f8',uuid=7628b43b-5b22-440b-a27b-bf2e28b93cf6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9ac05886-79dc-4a75-a676-7db0abb46f99", "address": "fa:16:3e:30:7f:49", "network": {"id": "cbda3d0f-0184-4ad3-b71f-97be51b488d9", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "1044631a5fe84ce8904864a7024049fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ac05886-79", "ovs_interfaceid": "9ac05886-79dc-4a75-a676-7db0abb46f99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 10:30:29 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-91d0ac47-bbfd-4ef8-b83c-92ec0e8e8fb4 tempest-VolumesNegativeTest-355403086 tempest-VolumesNegativeTest-355403086-project-member] Converting VIF {"id": "9ac05886-79dc-4a75-a676-7db0abb46f99", "address": "fa:16:3e:30:7f:49", "network": {"id": "cbda3d0f-0184-4ad3-b71f-97be51b488d9", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "1044631a5fe84ce8904864a7024049fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ac05886-79", "ovs_interfaceid": "9ac05886-79dc-4a75-a676-7db0abb46f99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:30:29 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-91d0ac47-bbfd-4ef8-b83c-92ec0e8e8fb4 tempest-VolumesNegativeTest-355403086 tempest-VolumesNegativeTest-355403086-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:30:7f:49,bridge_name='br-int',has_traffic_filtering=True,id=9ac05886-79dc-4a75-a676-7db0abb46f99,network=Network(cbda3d0f-0184-4ad3-b71f-97be51b488d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ac05886-79') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:30:29 user nova-compute[85141]: DEBUG os_vif [None req-91d0ac47-bbfd-4ef8-b83c-92ec0e8e8fb4 tempest-VolumesNegativeTest-355403086 tempest-VolumesNegativeTest-355403086-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:7f:49,bridge_name='br-int',has_traffic_filtering=True,id=9ac05886-79dc-4a75-a676-7db0abb46f99,network=Network(cbda3d0f-0184-4ad3-b71f-97be51b488d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ac05886-79') {{(pid=85141) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 10:30:29 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:30:29 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9ac05886-79, bridge=br-int, if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:30:29 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:30:29 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:30:29 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:30:29 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:30:29 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0436001a-d7f7-4928-a402-eff1e184aec6) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:30:29 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:30:29 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:30:29 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:30:29 user nova-compute[85141]: INFO os_vif [None req-91d0ac47-bbfd-4ef8-b83c-92ec0e8e8fb4 tempest-VolumesNegativeTest-355403086 tempest-VolumesNegativeTest-355403086-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:7f:49,bridge_name='br-int',has_traffic_filtering=True,id=9ac05886-79dc-4a75-a676-7db0abb46f99,network=Network(cbda3d0f-0184-4ad3-b71f-97be51b488d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ac05886-79')
Nov 16 10:30:29 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-91d0ac47-bbfd-4ef8-b83c-92ec0e8e8fb4 tempest-VolumesNegativeTest-355403086 tempest-VolumesNegativeTest-355403086-project-member] [instance: 7628b43b-5b22-440b-a27b-bf2e28b93cf6] Deleting instance files /opt/stack/data/nova/instances/7628b43b-5b22-440b-a27b-bf2e28b93cf6_del
Nov 16 10:30:29 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-91d0ac47-bbfd-4ef8-b83c-92ec0e8e8fb4 tempest-VolumesNegativeTest-355403086 tempest-VolumesNegativeTest-355403086-project-member] [instance: 7628b43b-5b22-440b-a27b-bf2e28b93cf6] Deletion of /opt/stack/data/nova/instances/7628b43b-5b22-440b-a27b-bf2e28b93cf6_del complete
Nov 16 10:30:29 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-cfb865d6-ce89-4e60-9463-426adf0ee7d3 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Searching for a device in session 45 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=85141) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 10:30:29 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfb865d6-ce89-4e60-9463-426adf0ee7d3 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:f30b1bab-5fbb-4103-a00a-cf0e857ce92a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FBcOfdVM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=85141) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 10:30:29 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-cfb865d6-ce89-4e60-9463-426adf0ee7d3 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.310s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 10:30:29 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfb865d6-ce89-4e60-9463-426adf0ee7d3 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] <== connect_volume: return (1311ms) {'type': 'block', 'scsi_wwn': '23661623235333630', 'path': '/dev/sdf'} {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 10:30:29 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cfb865d6-ce89-4e60-9463-426adf0ee7d3 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] [instance: 89e358d7-0844-4742-853b-ff88800415d2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23661623235333630', 'path': '/dev/sdf'} {{(pid=85141) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 10:30:29 user nova-compute[85141]: INFO nova.compute.manager [None req-91d0ac47-bbfd-4ef8-b83c-92ec0e8e8fb4 tempest-VolumesNegativeTest-355403086 tempest-VolumesNegativeTest-355403086-project-member] [instance: 7628b43b-5b22-440b-a27b-bf2e28b93cf6] Took 0.79 seconds to destroy the instance on the hypervisor.
Nov 16 10:30:29 user nova-compute[85141]: DEBUG oslo.service.loopingcall [None req-91d0ac47-bbfd-4ef8-b83c-92ec0e8e8fb4 tempest-VolumesNegativeTest-355403086 tempest-VolumesNegativeTest-355403086-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=85141) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 10:30:29 user nova-compute[85141]: DEBUG nova.compute.manager [-] [instance: 7628b43b-5b22-440b-a27b-bf2e28b93cf6] Deallocating network for instance {{(pid=85141) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 10:30:29 user nova-compute[85141]: DEBUG nova.network.neutron [-] [instance: 7628b43b-5b22-440b-a27b-bf2e28b93cf6] deallocate_for_instance() {{(pid=85141) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 10:30:29 user nova-compute[85141]: DEBUG nova.objects.instance [None req-cfb865d6-ce89-4e60-9463-426adf0ee7d3 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Lazy-loading 'flavor' on Instance uuid 89e358d7-0844-4742-853b-ff88800415d2 {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:30:29 user nova-compute[85141]: DEBUG nova.virt.libvirt.guest [None req-cfb865d6-ce89-4e60-9463-426adf0ee7d3 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 10:30:29 user nova-compute[85141]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 10:30:29 user nova-compute[85141]:   <source dev="/dev/sdf"/>
Nov 16 10:30:29 user nova-compute[85141]:   <target dev="vdb" bus="virtio"/>
Nov 16 10:30:29 user nova-compute[85141]:   <serial>f30b1bab-5fbb-4103-a00a-cf0e857ce92a</serial>
Nov 16 10:30:29 user nova-compute[85141]: </disk>
Nov 16 10:30:29 user nova-compute[85141]:  {{(pid=85141) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 10:30:30 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:30:30 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:30:30 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:30:30 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:30:30 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:30:30 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-cfb865d6-ce89-4e60-9463-426adf0ee7d3 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] No BDM found with device name vda, not building metadata. {{(pid=85141) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 10:30:30 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-cfb865d6-ce89-4e60-9463-426adf0ee7d3 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] No BDM found with device name vdb, not building metadata. {{(pid=85141) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 10:30:30 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-cfb865d6-ce89-4e60-9463-426adf0ee7d3 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] No VIF found with MAC fa:16:3e:56:2d:dd, not building metadata {{(pid=85141) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 10:30:30 user nova-compute[85141]: DEBUG nova.network.neutron [-] [instance: 7628b43b-5b22-440b-a27b-bf2e28b93cf6] Updating instance_info_cache with network_info: [] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:30:30 user nova-compute[85141]: INFO nova.compute.manager [-] [instance: 7628b43b-5b22-440b-a27b-bf2e28b93cf6] Took 0.64 seconds to deallocate network for instance.
Nov 16 10:30:30 user nova-compute[85141]: DEBUG nova.compute.manager [req-d3fbfd60-33c3-4ff0-a800-d46aca318d1c req-3ea71c57-f7eb-40c9-be9d-e9c55d64bab1 service nova] [instance: 7628b43b-5b22-440b-a27b-bf2e28b93cf6] Received event network-vif-deleted-9ac05886-79dc-4a75-a676-7db0abb46f99 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:30:30 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-cfb865d6-ce89-4e60-9463-426adf0ee7d3 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Lock "89e358d7-0844-4742-853b-ff88800415d2" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.052s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:30:30 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-91d0ac47-bbfd-4ef8-b83c-92ec0e8e8fb4 tempest-VolumesNegativeTest-355403086 tempest-VolumesNegativeTest-355403086-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:30:30 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-91d0ac47-bbfd-4ef8-b83c-92ec0e8e8fb4 tempest-VolumesNegativeTest-355403086 tempest-VolumesNegativeTest-355403086-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:30:30 user nova-compute[85141]: DEBUG nova.compute.provider_tree [None req-91d0ac47-bbfd-4ef8-b83c-92ec0e8e8fb4 tempest-VolumesNegativeTest-355403086 tempest-VolumesNegativeTest-355403086-project-member] Inventory has not changed in ProviderTree for provider: bf8e0fa1-16b6-408f-9203-c4cd63916272 {{(pid=85141) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 10:30:30 user nova-compute[85141]: DEBUG nova.scheduler.client.report [None req-91d0ac47-bbfd-4ef8-b83c-92ec0e8e8fb4 tempest-VolumesNegativeTest-355403086 tempest-VolumesNegativeTest-355403086-project-member] Inventory has not changed for provider bf8e0fa1-16b6-408f-9203-c4cd63916272 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=85141) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 10:30:30 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-91d0ac47-bbfd-4ef8-b83c-92ec0e8e8fb4 tempest-VolumesNegativeTest-355403086 tempest-VolumesNegativeTest-355403086-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.380s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:30:30 user nova-compute[85141]: INFO nova.scheduler.client.report [None req-91d0ac47-bbfd-4ef8-b83c-92ec0e8e8fb4 tempest-VolumesNegativeTest-355403086 tempest-VolumesNegativeTest-355403086-project-member] Deleted allocations for instance 7628b43b-5b22-440b-a27b-bf2e28b93cf6
Nov 16 10:30:30 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-91d0ac47-bbfd-4ef8-b83c-92ec0e8e8fb4 tempest-VolumesNegativeTest-355403086 tempest-VolumesNegativeTest-355403086-project-member] Lock "7628b43b-5b22-440b-a27b-bf2e28b93cf6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.993s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:30:31 user nova-compute[85141]: DEBUG nova.compute.manager [req-7d98ba7c-84da-4adc-a549-485578e6f33b req-f6b09b37-318b-42f6-94ab-6d4fac52131c service nova] [instance: 7628b43b-5b22-440b-a27b-bf2e28b93cf6] Received event network-vif-plugged-9ac05886-79dc-4a75-a676-7db0abb46f99 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:30:31 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-7d98ba7c-84da-4adc-a549-485578e6f33b req-f6b09b37-318b-42f6-94ab-6d4fac52131c service nova] Acquiring lock "7628b43b-5b22-440b-a27b-bf2e28b93cf6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:30:31 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-7d98ba7c-84da-4adc-a549-485578e6f33b req-f6b09b37-318b-42f6-94ab-6d4fac52131c service nova] Lock "7628b43b-5b22-440b-a27b-bf2e28b93cf6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:30:31 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-7d98ba7c-84da-4adc-a549-485578e6f33b req-f6b09b37-318b-42f6-94ab-6d4fac52131c service nova] Lock "7628b43b-5b22-440b-a27b-bf2e28b93cf6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:30:31 user nova-compute[85141]: DEBUG nova.compute.manager [req-7d98ba7c-84da-4adc-a549-485578e6f33b req-f6b09b37-318b-42f6-94ab-6d4fac52131c service nova] [instance: 7628b43b-5b22-440b-a27b-bf2e28b93cf6] No waiting events found dispatching network-vif-plugged-9ac05886-79dc-4a75-a676-7db0abb46f99 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:30:31 user nova-compute[85141]: WARNING nova.compute.manager [req-7d98ba7c-84da-4adc-a549-485578e6f33b req-f6b09b37-318b-42f6-94ab-6d4fac52131c service nova] [instance: 7628b43b-5b22-440b-a27b-bf2e28b93cf6] Received unexpected event network-vif-plugged-9ac05886-79dc-4a75-a676-7db0abb46f99 for instance with vm_state deleted and task_state None.
Nov 16 10:30:31 user nova-compute[85141]: DEBUG nova.compute.manager [req-7d98ba7c-84da-4adc-a549-485578e6f33b req-f6b09b37-318b-42f6-94ab-6d4fac52131c service nova] [instance: 7628b43b-5b22-440b-a27b-bf2e28b93cf6] Received event network-vif-plugged-9ac05886-79dc-4a75-a676-7db0abb46f99 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:30:31 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-7d98ba7c-84da-4adc-a549-485578e6f33b req-f6b09b37-318b-42f6-94ab-6d4fac52131c service nova] Acquiring lock "7628b43b-5b22-440b-a27b-bf2e28b93cf6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:30:31 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-7d98ba7c-84da-4adc-a549-485578e6f33b req-f6b09b37-318b-42f6-94ab-6d4fac52131c service nova] Lock "7628b43b-5b22-440b-a27b-bf2e28b93cf6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:30:31 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-7d98ba7c-84da-4adc-a549-485578e6f33b req-f6b09b37-318b-42f6-94ab-6d4fac52131c service nova] Lock "7628b43b-5b22-440b-a27b-bf2e28b93cf6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:30:31 user nova-compute[85141]: DEBUG nova.compute.manager [req-7d98ba7c-84da-4adc-a549-485578e6f33b req-f6b09b37-318b-42f6-94ab-6d4fac52131c service nova] [instance: 7628b43b-5b22-440b-a27b-bf2e28b93cf6] No waiting events found dispatching network-vif-plugged-9ac05886-79dc-4a75-a676-7db0abb46f99 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:30:31 user nova-compute[85141]: WARNING nova.compute.manager [req-7d98ba7c-84da-4adc-a549-485578e6f33b req-f6b09b37-318b-42f6-94ab-6d4fac52131c service nova] [instance: 7628b43b-5b22-440b-a27b-bf2e28b93cf6] Received unexpected event network-vif-plugged-9ac05886-79dc-4a75-a676-7db0abb46f99 for instance with vm_state deleted and task_state None.
Nov 16 10:30:31 user nova-compute[85141]: DEBUG nova.compute.manager [req-7d98ba7c-84da-4adc-a549-485578e6f33b req-f6b09b37-318b-42f6-94ab-6d4fac52131c service nova] [instance: 7628b43b-5b22-440b-a27b-bf2e28b93cf6] Received event network-vif-plugged-9ac05886-79dc-4a75-a676-7db0abb46f99 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:30:31 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-7d98ba7c-84da-4adc-a549-485578e6f33b req-f6b09b37-318b-42f6-94ab-6d4fac52131c service nova] Acquiring lock "7628b43b-5b22-440b-a27b-bf2e28b93cf6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:30:31 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-7d98ba7c-84da-4adc-a549-485578e6f33b req-f6b09b37-318b-42f6-94ab-6d4fac52131c service nova] Lock "7628b43b-5b22-440b-a27b-bf2e28b93cf6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:30:31 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-7d98ba7c-84da-4adc-a549-485578e6f33b req-f6b09b37-318b-42f6-94ab-6d4fac52131c service nova] Lock "7628b43b-5b22-440b-a27b-bf2e28b93cf6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:30:31 user nova-compute[85141]: DEBUG nova.compute.manager [req-7d98ba7c-84da-4adc-a549-485578e6f33b req-f6b09b37-318b-42f6-94ab-6d4fac52131c service nova] [instance: 7628b43b-5b22-440b-a27b-bf2e28b93cf6] No waiting events found dispatching network-vif-plugged-9ac05886-79dc-4a75-a676-7db0abb46f99 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:30:31 user nova-compute[85141]: WARNING nova.compute.manager [req-7d98ba7c-84da-4adc-a549-485578e6f33b req-f6b09b37-318b-42f6-94ab-6d4fac52131c service nova] [instance: 7628b43b-5b22-440b-a27b-bf2e28b93cf6] Received unexpected event network-vif-plugged-9ac05886-79dc-4a75-a676-7db0abb46f99 for instance with vm_state deleted and task_state None.
Nov 16 10:30:31 user nova-compute[85141]: DEBUG nova.compute.manager [req-7d98ba7c-84da-4adc-a549-485578e6f33b req-f6b09b37-318b-42f6-94ab-6d4fac52131c service nova] [instance: 7628b43b-5b22-440b-a27b-bf2e28b93cf6] Received event network-vif-unplugged-9ac05886-79dc-4a75-a676-7db0abb46f99 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:30:31 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-7d98ba7c-84da-4adc-a549-485578e6f33b req-f6b09b37-318b-42f6-94ab-6d4fac52131c service nova] Acquiring lock "7628b43b-5b22-440b-a27b-bf2e28b93cf6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:30:31 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-7d98ba7c-84da-4adc-a549-485578e6f33b req-f6b09b37-318b-42f6-94ab-6d4fac52131c service nova] Lock "7628b43b-5b22-440b-a27b-bf2e28b93cf6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:30:31 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-7d98ba7c-84da-4adc-a549-485578e6f33b req-f6b09b37-318b-42f6-94ab-6d4fac52131c service nova] Lock "7628b43b-5b22-440b-a27b-bf2e28b93cf6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:30:31 user nova-compute[85141]: DEBUG nova.compute.manager [req-7d98ba7c-84da-4adc-a549-485578e6f33b req-f6b09b37-318b-42f6-94ab-6d4fac52131c service nova] [instance: 7628b43b-5b22-440b-a27b-bf2e28b93cf6] No waiting events found dispatching network-vif-unplugged-9ac05886-79dc-4a75-a676-7db0abb46f99 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:30:31 user nova-compute[85141]: WARNING nova.compute.manager [req-7d98ba7c-84da-4adc-a549-485578e6f33b req-f6b09b37-318b-42f6-94ab-6d4fac52131c service nova] [instance: 7628b43b-5b22-440b-a27b-bf2e28b93cf6] Received unexpected event network-vif-unplugged-9ac05886-79dc-4a75-a676-7db0abb46f99 for instance with vm_state deleted and task_state None.
Nov 16 10:30:31 user nova-compute[85141]: DEBUG nova.compute.manager [req-7d98ba7c-84da-4adc-a549-485578e6f33b req-f6b09b37-318b-42f6-94ab-6d4fac52131c service nova] [instance: 7628b43b-5b22-440b-a27b-bf2e28b93cf6] Received event network-vif-plugged-9ac05886-79dc-4a75-a676-7db0abb46f99 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:30:31 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-7d98ba7c-84da-4adc-a549-485578e6f33b req-f6b09b37-318b-42f6-94ab-6d4fac52131c service nova] Acquiring lock "7628b43b-5b22-440b-a27b-bf2e28b93cf6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:30:31 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-7d98ba7c-84da-4adc-a549-485578e6f33b req-f6b09b37-318b-42f6-94ab-6d4fac52131c service nova] Lock "7628b43b-5b22-440b-a27b-bf2e28b93cf6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:30:31 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-7d98ba7c-84da-4adc-a549-485578e6f33b req-f6b09b37-318b-42f6-94ab-6d4fac52131c service nova] Lock "7628b43b-5b22-440b-a27b-bf2e28b93cf6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:30:31 user nova-compute[85141]: DEBUG nova.compute.manager [req-7d98ba7c-84da-4adc-a549-485578e6f33b req-f6b09b37-318b-42f6-94ab-6d4fac52131c service nova] [instance: 7628b43b-5b22-440b-a27b-bf2e28b93cf6] No waiting events found dispatching network-vif-plugged-9ac05886-79dc-4a75-a676-7db0abb46f99 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:30:31 user nova-compute[85141]: WARNING nova.compute.manager [req-7d98ba7c-84da-4adc-a549-485578e6f33b req-f6b09b37-318b-42f6-94ab-6d4fac52131c service nova] [instance: 7628b43b-5b22-440b-a27b-bf2e28b93cf6] Received unexpected event network-vif-plugged-9ac05886-79dc-4a75-a676-7db0abb46f99 for instance with vm_state deleted and task_state None.
Nov 16 10:30:31 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:30:33 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:30:33 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-0829a3bc-6e1b-4467-bcd3-9a3ec72562ec tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Acquiring lock "89e358d7-0844-4742-853b-ff88800415d2" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:30:33 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-0829a3bc-6e1b-4467-bcd3-9a3ec72562ec tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Lock "89e358d7-0844-4742-853b-ff88800415d2" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:30:33 user nova-compute[85141]: DEBUG nova.objects.instance [None req-0829a3bc-6e1b-4467-bcd3-9a3ec72562ec tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Lazy-loading 'flavor' on Instance uuid 89e358d7-0844-4742-853b-ff88800415d2 {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:30:33 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-0829a3bc-6e1b-4467-bcd3-9a3ec72562ec tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Lock "89e358d7-0844-4742-853b-ff88800415d2" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:30:33 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-0829a3bc-6e1b-4467-bcd3-9a3ec72562ec tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Acquiring lock "89e358d7-0844-4742-853b-ff88800415d2" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:30:33 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-0829a3bc-6e1b-4467-bcd3-9a3ec72562ec tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Lock "89e358d7-0844-4742-853b-ff88800415d2" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:30:33 user nova-compute[85141]: INFO nova.compute.manager [None req-0829a3bc-6e1b-4467-bcd3-9a3ec72562ec tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] [instance: 89e358d7-0844-4742-853b-ff88800415d2] Attaching volume 68965271-48ea-40f4-870f-2c9c54c02a7f to /dev/vdc
Nov 16 10:30:33 user nova-compute[85141]: DEBUG os_brick.utils [None req-0829a3bc-6e1b-4467-bcd3-9a3ec72562ec tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 10:30:33 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:30:33 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:30:33 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[69520f2b-5371-4241-b352-1a84300d7d60]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c7834de5c295\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:30:33 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:30:33 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:30:33 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[751ba4e9-fb8e-42bc-a448-83bd9f4db5c3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:30:33 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:30:33 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:30:33 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e40d7d8-ed59-4573-8879-4e3e2f8e82b9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:30:33 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[e70c54b6-e71f-41ce-b857-7c984e3b9f35]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:30:33 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-0829a3bc-6e1b-4467-bcd3-9a3ec72562ec tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Running cmd (subprocess): nvme version {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:30:33 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-0829a3bc-6e1b-4467-bcd3-9a3ec72562ec tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] 'nvme version' failed. Not Retrying. {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 10:30:33 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0829a3bc-6e1b-4467-bcd3-9a3ec72562ec tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] nvme not present on system {{(pid=85141) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 10:30:33 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:30:33 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 10:30:33 user nova-compute[85141]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 10:30:33 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[38d24543-297b-4a17-95d3-98e0102d1bc9]: (4, '') {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:30:33 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.lightos [None req-0829a3bc-6e1b-4467-bcd3-9a3ec72562ec tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=85141) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 10:30:33 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.lightos [None req-0829a3bc-6e1b-4467-bcd3-9a3ec72562ec tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=85141) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 10:30:33 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.lightos [None req-0829a3bc-6e1b-4467-bcd3-9a3ec72562ec tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] LIGHTOS: no hostnqn found. {{(pid=85141) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 10:30:33 user nova-compute[85141]: DEBUG os_brick.utils [None req-0829a3bc-6e1b-4467-bcd3-9a3ec72562ec tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c7834de5c295', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 10:30:33 user nova-compute[85141]: DEBUG nova.virt.block_device [None req-0829a3bc-6e1b-4467-bcd3-9a3ec72562ec tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] [instance: 89e358d7-0844-4742-853b-ff88800415d2] Updating existing volume attachment record: fef71fd2-3c2c-46a7-9cc9-26f9ea464a66 {{(pid=85141) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 10:30:34 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:30:34 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Starting heal instance info cache {{(pid=85141) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 10:30:34 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Acquiring lock "refresh_cache-5a507c85-0369-48ea-8858-3e7d346b4cb0" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:30:34 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Acquired lock "refresh_cache-5a507c85-0369-48ea-8858-3e7d346b4cb0" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:30:34 user nova-compute[85141]: DEBUG nova.network.neutron [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] [instance: 5a507c85-0369-48ea-8858-3e7d346b4cb0] Forcefully refreshing network info cache for instance {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 10:30:34 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:30:35 user nova-compute[85141]: DEBUG nova.network.neutron [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] [instance: 5a507c85-0369-48ea-8858-3e7d346b4cb0] Updating instance_info_cache with network_info: [{"id": "47904c84-f39f-4d8e-9675-0d8a535e3799", "address": "fa:16:3e:a7:9b:4f", "network": {"id": "a75d923b-3849-49c0-ba13-f8b356efda8f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1113409976-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79e4ebd46b4243c09f88927532b610f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47904c84-f3", "ovs_interfaceid": "47904c84-f39f-4d8e-9675-0d8a535e3799", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:30:35 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Releasing lock "refresh_cache-5a507c85-0369-48ea-8858-3e7d346b4cb0" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:30:35 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] [instance: 5a507c85-0369-48ea-8858-3e7d346b4cb0] Updated the network info_cache for instance {{(pid=85141) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 10:30:37 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:30:37 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager.update_available_resource {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:30:37 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:30:37 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:30:37 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:30:37 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Auditing locally available compute resources for user (node: user) {{(pid=85141) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 10:30:37 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a507c85-0369-48ea-8858-3e7d346b4cb0/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:30:37 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a507c85-0369-48ea-8858-3e7d346b4cb0/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:30:37 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a507c85-0369-48ea-8858-3e7d346b4cb0/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:30:37 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a507c85-0369-48ea-8858-3e7d346b4cb0/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:30:37 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e214bbb-5bbb-4e6f-ac09-9cb1412f068b/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:30:38 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e214bbb-5bbb-4e6f-ac09-9cb1412f068b/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:30:38 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e214bbb-5bbb-4e6f-ac09-9cb1412f068b/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:30:38 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e214bbb-5bbb-4e6f-ac09-9cb1412f068b/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:30:38 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:30:38 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d842f90e-663b-4c95-9d7c-d092d2bac41f/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:30:38 user nova-compute[85141]: INFO nova.compute.manager [None req-17beff40-0eaf-4886-be48-f167230ba517 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] [instance: bc76703d-9243-4277-9b13-d6f9639cd1bb] Get console output
Nov 16 10:30:38 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d842f90e-663b-4c95-9d7c-d092d2bac41f/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:30:38 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d842f90e-663b-4c95-9d7c-d092d2bac41f/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:30:38 user nova-compute[85141]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Nov 16 10:30:38 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d842f90e-663b-4c95-9d7c-d092d2bac41f/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:30:38 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=85141) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 10:30:38 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89e358d7-0844-4742-853b-ff88800415d2/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:30:38 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89e358d7-0844-4742-853b-ff88800415d2/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:30:38 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89e358d7-0844-4742-853b-ff88800415d2/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:30:39 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89e358d7-0844-4742-853b-ff88800415d2/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:30:39 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=85141) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 10:30:39 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7437a3a3-9b7f-489b-b20b-f1b877ebb253/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:30:39 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0829a3bc-6e1b-4467-bcd3-9a3ec72562ec tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] [instance: 89e358d7-0844-4742-853b-ff88800415d2] Calling os-brick to attach iSCSI Volume {{(pid=85141) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 10:30:39 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-0829a3bc-6e1b-4467-bcd3-9a3ec72562ec tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51806b6080>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:68965271-48ea-40f4-870f-2c9c54c02a7f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ixcPLZRD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 10:30:39 user nova-compute[85141]: WARNING os_brick.initiator.connectors.base [None req-0829a3bc-6e1b-4467-bcd3-9a3ec72562ec tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 10:30:39 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-0829a3bc-6e1b-4467-bcd3-9a3ec72562ec tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 10:30:39 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-0829a3bc-6e1b-4467-bcd3-9a3ec72562ec tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 10:30:39 user nova-compute[85141]: WARNING os_brick.initiator.connectors.base [None req-0829a3bc-6e1b-4467-bcd3-9a3ec72562ec tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 10:30:39 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-0829a3bc-6e1b-4467-bcd3-9a3ec72562ec tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:68965271-48ea-40f4-870f-2c9c54c02a7f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 10:30:39 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-0829a3bc-6e1b-4467-bcd3-9a3ec72562ec tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:68965271-48ea-40f4-870f-2c9c54c02a7f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 10:30:39 user nova-compute[85141]: INFO os_brick.initiator.connectors.iscsi [None req-0829a3bc-6e1b-4467-bcd3-9a3ec72562ec tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 10:30:39 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68965271-48ea-40f4-870f-2c9c54c02a7f -p 172.16.0.220:3260 {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:30:39 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68965271-48ea-40f4-870f-2c9c54c02a7f -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:30:39 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc8b0507-81bc-462d-b6a9-a011c4cdaf71]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:30:39 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-0829a3bc-6e1b-4467-bcd3-9a3ec72562ec tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 10:30:39 user nova-compute[85141]:  {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:30:39 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68965271-48ea-40f4-870f-2c9c54c02a7f -p 172.16.0.220:3260 --interface default --op new {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:30:39 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68965271-48ea-40f4-870f-2c9c54c02a7f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:30:39 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7acd51d-6ce5-45b4-a4a6-27c7026f40ed]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:68965271-48ea-40f4-870f-2c9c54c02a7f] added\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:30:39 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-0829a3bc-6e1b-4467-bcd3-9a3ec72562ec tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:68965271-48ea-40f4-870f-2c9c54c02a7f] added
Nov 16 10:30:39 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:30:39 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68965271-48ea-40f4-870f-2c9c54c02a7f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:30:39 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68965271-48ea-40f4-870f-2c9c54c02a7f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:30:39 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[aefdc044-a538-49b4-bdd0-209220e7843a]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:30:39 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-0829a3bc-6e1b-4467-bcd3-9a3ec72562ec tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:30:39 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68965271-48ea-40f4-870f-2c9c54c02a7f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:30:39 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68965271-48ea-40f4-870f-2c9c54c02a7f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.029s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:30:39 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0837880-580a-46c8-8094-2fd13ad24648]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:30:39 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-0829a3bc-6e1b-4467-bcd3-9a3ec72562ec tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:30:39 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68965271-48ea-40f4-870f-2c9c54c02a7f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ixcPLZRD {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:30:39 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68965271-48ea-40f4-870f-2c9c54c02a7f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ixcPLZRD" returned: 0 in 0.021s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:30:39 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6ce20fb-603d-4ec1-b7ae-fcc262df1183]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:30:39 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-0829a3bc-6e1b-4467-bcd3-9a3ec72562ec tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ixcPLZRD'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:30:39 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68965271-48ea-40f4-870f-2c9c54c02a7f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:30:39 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68965271-48ea-40f4-870f-2c9c54c02a7f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:30:39 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a49e2b3-401a-45b8-a0a2-bfd229f0c565]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:30:39 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-0829a3bc-6e1b-4467-bcd3-9a3ec72562ec tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:30:39 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:30:39 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7437a3a3-9b7f-489b-b20b-f1b877ebb253/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:30:39 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7437a3a3-9b7f-489b-b20b-f1b877ebb253/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:30:39 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:30:39 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdc107d4-b0ba-4d0b-b9fd-bf6a9c53d448]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2006a77c-e5e8-4ec5-8de5-a0f9505c429a (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0c5c19d-363b-4f5d-a04f-fb7de64423f2 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:925fd9db-7153-4861-bbc3-9cbb8822e196 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e16e1ffd-2bca-4f15-a154-04cf7ecce772 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f30b1bab-5fbb-4103-a00a-cf0e857ce92a (non-flash)\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:30:39 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-0829a3bc-6e1b-4467-bcd3-9a3ec72562ec tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2006a77c-e5e8-4ec5-8de5-a0f9505c429a (non-flash)
Nov 16 10:30:39 user nova-compute[85141]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0c5c19d-363b-4f5d-a04f-fb7de64423f2 (non-flash)
Nov 16 10:30:39 user nova-compute[85141]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:925fd9db-7153-4861-bbc3-9cbb8822e196 (non-flash)
Nov 16 10:30:39 user nova-compute[85141]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e16e1ffd-2bca-4f15-a154-04cf7ecce772 (non-flash)
Nov 16 10:30:39 user nova-compute[85141]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f30b1bab-5fbb-4103-a00a-cf0e857ce92a (non-flash)
Nov 16 10:30:39 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:30:39 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-0829a3bc-6e1b-4467-bcd3-9a3ec72562ec tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2006a77c-e5e8-4ec5-8de5-a0f9505c429a (non-flash)
Nov 16 10:30:39 user nova-compute[85141]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0c5c19d-363b-4f5d-a04f-fb7de64423f2 (non-flash)
Nov 16 10:30:39 user nova-compute[85141]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:925fd9db-7153-4861-bbc3-9cbb8822e196 (non-flash)
Nov 16 10:30:39 user nova-compute[85141]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e16e1ffd-2bca-4f15-a154-04cf7ecce772 (non-flash)
Nov 16 10:30:39 user nova-compute[85141]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f30b1bab-5fbb-4103-a00a-cf0e857ce92a (non-flash)
Nov 16 10:30:39 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 10:30:39 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68965271-48ea-40f4-870f-2c9c54c02a7f -p 172.16.0.220:3260 --login {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:30:39 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68965271-48ea-40f4-870f-2c9c54c02a7f -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:30:39 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b824f9c-10cf-4904-abba-e371f45e464d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:68965271-48ea-40f4-870f-2c9c54c02a7f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:68965271-48ea-40f4-870f-2c9c54c02a7f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:30:39 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-0829a3bc-6e1b-4467-bcd3-9a3ec72562ec tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:68965271-48ea-40f4-870f-2c9c54c02a7f, portal: 172.16.0.220,3260]
Nov 16 10:30:39 user nova-compute[85141]: Login to [iface: default, target: iqn.2010-10.org.openstack:68965271-48ea-40f4-870f-2c9c54c02a7f, portal: 172.16.0.220,3260] successful.
Nov 16 10:30:39 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:30:39 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68965271-48ea-40f4-870f-2c9c54c02a7f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:30:39 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68965271-48ea-40f4-870f-2c9c54c02a7f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:30:39 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[d87755c2-88ce-464a-96a4-e47dc19082a5]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:30:39 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-0829a3bc-6e1b-4467-bcd3-9a3ec72562ec tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:30:39 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:30:39 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:30:39 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a90bbe4-35c1-452e-a3d1-bef6ffbcc60c]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2006a77c-e5e8-4ec5-8de5-a0f9505c429a (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0c5c19d-363b-4f5d-a04f-fb7de64423f2 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:925fd9db-7153-4861-bbc3-9cbb8822e196 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e16e1ffd-2bca-4f15-a154-04cf7ecce772 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f30b1bab-5fbb-4103-a00a-cf0e857ce92a (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68965271-48ea-40f4-870f-2c9c54c02a7f (non-flash)\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:30:39 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-0829a3bc-6e1b-4467-bcd3-9a3ec72562ec tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2006a77c-e5e8-4ec5-8de5-a0f9505c429a (non-flash)
Nov 16 10:30:39 user nova-compute[85141]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0c5c19d-363b-4f5d-a04f-fb7de64423f2 (non-flash)
Nov 16 10:30:39 user nova-compute[85141]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:925fd9db-7153-4861-bbc3-9cbb8822e196 (non-flash)
Nov 16 10:30:39 user nova-compute[85141]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e16e1ffd-2bca-4f15-a154-04cf7ecce772 (non-flash)
Nov 16 10:30:39 user nova-compute[85141]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f30b1bab-5fbb-4103-a00a-cf0e857ce92a (non-flash)
Nov 16 10:30:39 user nova-compute[85141]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68965271-48ea-40f4-870f-2c9c54c02a7f (non-flash)
Nov 16 10:30:39 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:30:39 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-0829a3bc-6e1b-4467-bcd3-9a3ec72562ec tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2006a77c-e5e8-4ec5-8de5-a0f9505c429a (non-flash)
Nov 16 10:30:39 user nova-compute[85141]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0c5c19d-363b-4f5d-a04f-fb7de64423f2 (non-flash)
Nov 16 10:30:39 user nova-compute[85141]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:925fd9db-7153-4861-bbc3-9cbb8822e196 (non-flash)
Nov 16 10:30:39 user nova-compute[85141]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e16e1ffd-2bca-4f15-a154-04cf7ecce772 (non-flash)
Nov 16 10:30:39 user nova-compute[85141]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f30b1bab-5fbb-4103-a00a-cf0e857ce92a (non-flash)
Nov 16 10:30:39 user nova-compute[85141]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68965271-48ea-40f4-870f-2c9c54c02a7f (non-flash)
Nov 16 10:30:39 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 10:30:39 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-0829a3bc-6e1b-4467-bcd3-9a3ec72562ec tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:68965271-48ea-40f4-870f-2c9c54c02a7f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.326s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 10:30:39 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-0829a3bc-6e1b-4467-bcd3-9a3ec72562ec tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Connected to 172.16.0.220:3260 {{(pid=85141) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 10:30:39 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-0829a3bc-6e1b-4467-bcd3-9a3ec72562ec tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] HCTL ('38', '-', '-', 0) found on session 46 with lun 0 {{(pid=85141) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 10:30:39 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-0829a3bc-6e1b-4467-bcd3-9a3ec72562ec tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=85141) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 10:30:39 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:30:39 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7437a3a3-9b7f-489b-b20b-f1b877ebb253/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:30:39 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=85141) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 10:30:39 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.018s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:30:39 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[bed80519-6f92-47b9-bc5d-5dd51ef71a29]: (4, ('- - 0', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:30:39 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-0829a3bc-6e1b-4467-bcd3-9a3ec72562ec tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Searching for a device in session 46 and hctl ['38', '*', '*', 0] yield: None {{(pid=85141) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 10:30:39 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b24c3954-06ff-4e15-9e43-c65d1dae7a5d/disk.rescue --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:30:39 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:30:39 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b24c3954-06ff-4e15-9e43-c65d1dae7a5d/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:30:39 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b24c3954-06ff-4e15-9e43-c65d1dae7a5d/disk.rescue --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:30:39 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b24c3954-06ff-4e15-9e43-c65d1dae7a5d/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:30:39 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b24c3954-06ff-4e15-9e43-c65d1dae7a5d/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:30:39 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b24c3954-06ff-4e15-9e43-c65d1dae7a5d/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:30:39 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b24c3954-06ff-4e15-9e43-c65d1dae7a5d/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:30:40 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b24c3954-06ff-4e15-9e43-c65d1dae7a5d/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:30:40 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/059d6974-bd0c-4f73-91fc-8202ebda4238/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:30:40 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/059d6974-bd0c-4f73-91fc-8202ebda4238/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:30:40 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/059d6974-bd0c-4f73-91fc-8202ebda4238/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:30:40 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-0829a3bc-6e1b-4467-bcd3-9a3ec72562ec tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Searching for a device in session 46 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=85141) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 10:30:40 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-0829a3bc-6e1b-4467-bcd3-9a3ec72562ec tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:68965271-48ea-40f4-870f-2c9c54c02a7f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ixcPLZRD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=85141) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 10:30:40 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-0829a3bc-6e1b-4467-bcd3-9a3ec72562ec tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.364s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 10:30:40 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-0829a3bc-6e1b-4467-bcd3-9a3ec72562ec tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] <== connect_volume: return (1367ms) {'type': 'block', 'scsi_wwn': '26165623631663736', 'path': '/dev/sdg'} {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 10:30:40 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0829a3bc-6e1b-4467-bcd3-9a3ec72562ec tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] [instance: 89e358d7-0844-4742-853b-ff88800415d2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26165623631663736', 'path': '/dev/sdg'} {{(pid=85141) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 10:30:40 user nova-compute[85141]: DEBUG nova.objects.instance [None req-0829a3bc-6e1b-4467-bcd3-9a3ec72562ec tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Lazy-loading 'flavor' on Instance uuid 89e358d7-0844-4742-853b-ff88800415d2 {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:30:40 user nova-compute[85141]: DEBUG nova.virt.libvirt.guest [None req-0829a3bc-6e1b-4467-bcd3-9a3ec72562ec tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 10:30:40 user nova-compute[85141]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 10:30:40 user nova-compute[85141]:   <source dev="/dev/sdg"/>
Nov 16 10:30:40 user nova-compute[85141]:   <target dev="vdc" bus="virtio"/>
Nov 16 10:30:40 user nova-compute[85141]:   <serial>68965271-48ea-40f4-870f-2c9c54c02a7f</serial>
Nov 16 10:30:40 user nova-compute[85141]: </disk>
Nov 16 10:30:40 user nova-compute[85141]:  {{(pid=85141) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 10:30:40 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/059d6974-bd0c-4f73-91fc-8202ebda4238/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:30:40 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=85141) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 10:30:40 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da42de06-4518-4c8a-8c63-9b5a2759a1bf/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:30:40 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da42de06-4518-4c8a-8c63-9b5a2759a1bf/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:30:40 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da42de06-4518-4c8a-8c63-9b5a2759a1bf/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:30:40 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-307d8311-bbf4-4bd2-b49b-982d13256197 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance da42de06-4518-4c8a-8c63-9b5a2759a1bf is timed out.
Nov 16 10:30:40 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-307d8311-bbf4-4bd2-b49b-982d13256197 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Successfully detached device vdb from instance da42de06-4518-4c8a-8c63-9b5a2759a1bf from the live domain config.
Nov 16 10:30:40 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-307d8311-bbf4-4bd2-b49b-982d13256197 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] [instance: da42de06-4518-4c8a-8c63-9b5a2759a1bf] calling os-brick to detach iSCSI Volume {{(pid=85141) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 10:30:40 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-307d8311-bbf4-4bd2-b49b-982d13256197 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51806b6080>, {'target_iqn': 'iqn.2010-10.org.openstack:e16e1ffd-2bca-4f15-a154-04cf7ecce772', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fMvZpdCi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 10:30:40 user nova-compute[85141]: WARNING os_brick.initiator.connectors.base [None req-307d8311-bbf4-4bd2-b49b-982d13256197 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 10:30:40 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-307d8311-bbf4-4bd2-b49b-982d13256197 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 10:30:40 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-307d8311-bbf4-4bd2-b49b-982d13256197 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 10:30:40 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:30:40 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:30:40 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[739145a8-7609-4050-8cdb-05089e06b49b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e0c5c19d-363b-4f5d-a04f-fb7de64423f2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:925fd9db-7153-4861-bbc3-9cbb8822e196\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:68965271-48ea-40f4-870f-2c9c54c02a7f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e16e1ffd-2bca-4f15-a154-04cf7ecce772\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2006a77c-e5e8-4ec5-8de5-a0f9505c429a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f30b1bab-5fbb-4103-a00a-cf0e857ce92a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:30:40 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-307d8311-bbf4-4bd2-b49b-982d13256197 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 10:30:40 user nova-compute[85141]: No targets found.
Nov 16 10:30:40 user nova-compute[85141]: iSNS:
Nov 16 10:30:40 user nova-compute[85141]: No targets found.
Nov 16 10:30:40 user nova-compute[85141]: STATIC:
Nov 16 10:30:40 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:e0c5c19d-363b-4f5d-a04f-fb7de64423f2
Nov 16 10:30:40 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:30:40 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:30:40 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:925fd9db-7153-4861-bbc3-9cbb8822e196
Nov 16 10:30:40 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:30:40 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:30:40 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:68965271-48ea-40f4-870f-2c9c54c02a7f
Nov 16 10:30:40 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:30:40 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:30:40 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:e16e1ffd-2bca-4f15-a154-04cf7ecce772
Nov 16 10:30:40 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:30:40 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:30:40 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:2006a77c-e5e8-4ec5-8de5-a0f9505c429a
Nov 16 10:30:40 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:30:40 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:30:40 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:f30b1bab-5fbb-4103-a00a-cf0e857ce92a
Nov 16 10:30:40 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:30:40 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:30:40 user nova-compute[85141]: FIRMWARE:
Nov 16 10:30:40 user nova-compute[85141]: No targets found.
Nov 16 10:30:40 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:30:40 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-307d8311-bbf4-4bd2-b49b-982d13256197 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 10:30:40 user nova-compute[85141]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 10:30:40 user nova-compute[85141]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=85141) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 10:30:40 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-307d8311-bbf4-4bd2-b49b-982d13256197 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e16e1ffd-2bca-4f15-a154-04cf7ecce772', 0)] {{(pid=85141) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 10:30:40 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:30:40 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:30:40 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[04666c06-e891-4314-8137-5f65c8b50f9a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2006a77c-e5e8-4ec5-8de5-a0f9505c429a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:68965271-48ea-40f4-870f-2c9c54c02a7f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:925fd9db-7153-4861-bbc3-9cbb8822e196\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e0c5c19d-363b-4f5d-a04f-fb7de64423f2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e16e1ffd-2bca-4f15-a154-04cf7ecce772\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f30b1bab-5fbb-4103-a00a-cf0e857ce92a\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:30:40 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:30:40 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:30:40 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6996778-74a2-474a-8368-85d8f0460c48]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2006a77c-e5e8-4ec5-8de5-a0f9505c429a (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0c5c19d-363b-4f5d-a04f-fb7de64423f2 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:925fd9db-7153-4861-bbc3-9cbb8822e196 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e16e1ffd-2bca-4f15-a154-04cf7ecce772 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f30b1bab-5fbb-4103-a00a-cf0e857ce92a (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68965271-48ea-40f4-870f-2c9c54c02a7f (non-flash)\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:30:40 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-307d8311-bbf4-4bd2-b49b-982d13256197 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2006a77c-e5e8-4ec5-8de5-a0f9505c429a (non-flash)
Nov 16 10:30:40 user nova-compute[85141]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0c5c19d-363b-4f5d-a04f-fb7de64423f2 (non-flash)
Nov 16 10:30:40 user nova-compute[85141]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:925fd9db-7153-4861-bbc3-9cbb8822e196 (non-flash)
Nov 16 10:30:40 user nova-compute[85141]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e16e1ffd-2bca-4f15-a154-04cf7ecce772 (non-flash)
Nov 16 10:30:40 user nova-compute[85141]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f30b1bab-5fbb-4103-a00a-cf0e857ce92a (non-flash)
Nov 16 10:30:40 user nova-compute[85141]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68965271-48ea-40f4-870f-2c9c54c02a7f (non-flash)
Nov 16 10:30:40 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:30:40 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-307d8311-bbf4-4bd2-b49b-982d13256197 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2006a77c-e5e8-4ec5-8de5-a0f9505c429a (non-flash)
Nov 16 10:30:40 user nova-compute[85141]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0c5c19d-363b-4f5d-a04f-fb7de64423f2 (non-flash)
Nov 16 10:30:40 user nova-compute[85141]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:925fd9db-7153-4861-bbc3-9cbb8822e196 (non-flash)
Nov 16 10:30:40 user nova-compute[85141]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e16e1ffd-2bca-4f15-a154-04cf7ecce772 (non-flash)
Nov 16 10:30:40 user nova-compute[85141]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f30b1bab-5fbb-4103-a00a-cf0e857ce92a (non-flash)
Nov 16 10:30:40 user nova-compute[85141]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68965271-48ea-40f4-870f-2c9c54c02a7f (non-flash)
Nov 16 10:30:40 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 10:30:40 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-307d8311-bbf4-4bd2-b49b-982d13256197 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5180671870>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e16e1ffd-2bca-4f15-a154-04cf7ecce772'): ({'sdc'}, set())}) {{(pid=85141) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 10:30:40 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-307d8311-bbf4-4bd2-b49b-982d13256197 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Removing single pathed devices sdc {{(pid=85141) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 10:30:40 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:30:40 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:30:40 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4c49bb2-acaa-4442-ab59-4019072fa64b]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:30:40 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:30:40 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-0829a3bc-6e1b-4467-bcd3-9a3ec72562ec tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] No BDM found with device name vda, not building metadata. {{(pid=85141) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 10:30:40 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-0829a3bc-6e1b-4467-bcd3-9a3ec72562ec tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] No BDM found with device name vdb, not building metadata. {{(pid=85141) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 10:30:40 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-0829a3bc-6e1b-4467-bcd3-9a3ec72562ec tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] No BDM found with device name vdc, not building metadata. {{(pid=85141) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 10:30:40 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-0829a3bc-6e1b-4467-bcd3-9a3ec72562ec tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] No VIF found with MAC fa:16:3e:56:2d:dd, not building metadata {{(pid=85141) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 10:30:40 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:30:40 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[17ea85fc-4e31-4c16-97a4-3741f85fd41e]: (4, ('ok\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:30:40 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-307d8311-bbf4-4bd2-b49b-982d13256197 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Flushing IO for device /dev/sdc {{(pid=85141) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 10:30:40 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da42de06-4518-4c8a-8c63-9b5a2759a1bf/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:30:40 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:30:40 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:30:40 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6736b44-e9b1-41c8-96b4-7dc056360cbc]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:30:40 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-307d8311-bbf4-4bd2-b49b-982d13256197 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=85141) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 10:30:40 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:30:41 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.061s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:30:41 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[603e6c52-e42f-401a-b0d9-1fc235b45679]: (4, ('1', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:30:41 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-307d8311-bbf4-4bd2-b49b-982d13256197 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=85141) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 10:30:41 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-307d8311-bbf4-4bd2-b49b-982d13256197 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] SCSI volumes sdc have been removed. {{(pid=85141) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 10:30:41 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-307d8311-bbf4-4bd2-b49b-982d13256197 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e16e1ffd-2bca-4f15-a154-04cf7ecce772')] {{(pid=85141) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 10:30:41 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e16e1ffd-2bca-4f15-a154-04cf7ecce772 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:30:41 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:30:41 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:30:41 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Hypervisor/Node resource view: name=user free_ram=7396MB free_disk=24.91045379638672GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=85141) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 10:30:41 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:30:41 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:30:41 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-0829a3bc-6e1b-4467-bcd3-9a3ec72562ec tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Lock "89e358d7-0844-4742-853b-ff88800415d2" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.567s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:30:41 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e16e1ffd-2bca-4f15-a154-04cf7ecce772 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:30:41 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6aba421-12bd-4b77-a3b6-28e06166a9db]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:30:41 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-307d8311-bbf4-4bd2-b49b-982d13256197 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:30:41 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e16e1ffd-2bca-4f15-a154-04cf7ecce772 -p 172.16.0.220:3260 --logout {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:30:41 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e16e1ffd-2bca-4f15-a154-04cf7ecce772 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:30:41 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[f32052de-9d95-4792-ac8d-7cce070ed70a]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:e16e1ffd-2bca-4f15-a154-04cf7ecce772, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:e16e1ffd-2bca-4f15-a154-04cf7ecce772, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:30:41 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-307d8311-bbf4-4bd2-b49b-982d13256197 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:e16e1ffd-2bca-4f15-a154-04cf7ecce772, portal: 172.16.0.220,3260]
Nov 16 10:30:41 user nova-compute[85141]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:e16e1ffd-2bca-4f15-a154-04cf7ecce772, portal: 172.16.0.220,3260] successful.
Nov 16 10:30:41 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:30:41 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e16e1ffd-2bca-4f15-a154-04cf7ecce772 -p 172.16.0.220:3260 --op delete {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:30:41 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e16e1ffd-2bca-4f15-a154-04cf7ecce772 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:30:41 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[b12e58d1-d6bd-4f80-bf1e-752a08483ded]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:30:41 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-307d8311-bbf4-4bd2-b49b-982d13256197 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:30:41 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-307d8311-bbf4-4bd2-b49b-982d13256197 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.703s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 10:30:41 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-307d8311-bbf4-4bd2-b49b-982d13256197 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] <== disconnect_volume: return (706ms) None {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 10:30:41 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-307d8311-bbf4-4bd2-b49b-982d13256197 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] [instance: da42de06-4518-4c8a-8c63-9b5a2759a1bf] Disconnected iSCSI Volume {{(pid=85141) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 10:30:41 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance d842f90e-663b-4c95-9d7c-d092d2bac41f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:30:41 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance 059d6974-bd0c-4f73-91fc-8202ebda4238 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:30:41 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance 4e214bbb-5bbb-4e6f-ac09-9cb1412f068b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:30:41 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance b24c3954-06ff-4e15-9e43-c65d1dae7a5d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:30:41 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance 5a507c85-0369-48ea-8858-3e7d346b4cb0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:30:41 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance bc76703d-9243-4277-9b13-d6f9639cd1bb actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:30:41 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance e1253324-3ca1-4610-b9d6-3db7c6c76828 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:30:41 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance da42de06-4518-4c8a-8c63-9b5a2759a1bf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:30:41 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance 89e358d7-0844-4742-853b-ff88800415d2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:30:41 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance 97cbb145-d47e-4eb1-8c01-06361efa8720 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:30:41 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance 7437a3a3-9b7f-489b-b20b-f1b877ebb253 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:30:41 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=85141) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 10:30:41 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=85141) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 10:30:41 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-f41869e8-e5a6-4273-8629-7c251b70e294 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Acquiring lock "89e358d7-0844-4742-853b-ff88800415d2" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:30:41 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-f41869e8-e5a6-4273-8629-7c251b70e294 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Lock "89e358d7-0844-4742-853b-ff88800415d2" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:30:41 user nova-compute[85141]: INFO nova.compute.manager [None req-f41869e8-e5a6-4273-8629-7c251b70e294 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] [instance: 89e358d7-0844-4742-853b-ff88800415d2] Detaching volume f30b1bab-5fbb-4103-a00a-cf0e857ce92a
Nov 16 10:30:41 user nova-compute[85141]: DEBUG nova.compute.provider_tree [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Inventory has not changed in ProviderTree for provider: bf8e0fa1-16b6-408f-9203-c4cd63916272 {{(pid=85141) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 10:30:41 user nova-compute[85141]: DEBUG nova.scheduler.client.report [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Inventory has not changed for provider bf8e0fa1-16b6-408f-9203-c4cd63916272 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=85141) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 10:30:42 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Compute_service record updated for user:user {{(pid=85141) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 10:30:42 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.711s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:30:42 user nova-compute[85141]: INFO nova.virt.block_device [None req-f41869e8-e5a6-4273-8629-7c251b70e294 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] [instance: 89e358d7-0844-4742-853b-ff88800415d2] Attempting to driver detach volume f30b1bab-5fbb-4103-a00a-cf0e857ce92a from mountpoint /dev/vdb
Nov 16 10:30:42 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-f41869e8-e5a6-4273-8629-7c251b70e294 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Attempting to detach device vdb from instance 89e358d7-0844-4742-853b-ff88800415d2 from the persistent domain config. {{(pid=85141) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 10:30:42 user nova-compute[85141]: DEBUG nova.virt.libvirt.guest [None req-f41869e8-e5a6-4273-8629-7c251b70e294 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 10:30:42 user nova-compute[85141]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 10:30:42 user nova-compute[85141]:   <source dev="/dev/sdf"/>
Nov 16 10:30:42 user nova-compute[85141]:   <target dev="vdb" bus="virtio"/>
Nov 16 10:30:42 user nova-compute[85141]:   <serial>f30b1bab-5fbb-4103-a00a-cf0e857ce92a</serial>
Nov 16 10:30:42 user nova-compute[85141]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 10:30:42 user nova-compute[85141]: </disk>
Nov 16 10:30:42 user nova-compute[85141]:  {{(pid=85141) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 10:30:42 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-f41869e8-e5a6-4273-8629-7c251b70e294 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Successfully detached device vdb from instance 89e358d7-0844-4742-853b-ff88800415d2 from the persistent domain config.
Nov 16 10:30:42 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-f41869e8-e5a6-4273-8629-7c251b70e294 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 89e358d7-0844-4742-853b-ff88800415d2 from the live domain config. {{(pid=85141) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 10:30:42 user nova-compute[85141]: DEBUG nova.virt.libvirt.guest [None req-f41869e8-e5a6-4273-8629-7c251b70e294 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 10:30:42 user nova-compute[85141]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 10:30:42 user nova-compute[85141]:   <source dev="/dev/sdf"/>
Nov 16 10:30:42 user nova-compute[85141]:   <target dev="vdb" bus="virtio"/>
Nov 16 10:30:42 user nova-compute[85141]:   <serial>f30b1bab-5fbb-4103-a00a-cf0e857ce92a</serial>
Nov 16 10:30:42 user nova-compute[85141]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 10:30:42 user nova-compute[85141]: </disk>
Nov 16 10:30:42 user nova-compute[85141]:  {{(pid=85141) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 10:30:42 user nova-compute[85141]: DEBUG nova.objects.instance [None req-307d8311-bbf4-4bd2-b49b-982d13256197 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Lazy-loading 'flavor' on Instance uuid da42de06-4518-4c8a-8c63-9b5a2759a1bf {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:30:42 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-307d8311-bbf4-4bd2-b49b-982d13256197 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Lock "da42de06-4518-4c8a-8c63-9b5a2759a1bf" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.169s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:30:42 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-f41869e8-e5a6-4273-8629-7c251b70e294 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 89e358d7-0844-4742-853b-ff88800415d2 {{(pid=85141) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 10:30:43 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:30:43 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:30:43 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:30:43 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:30:43 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=85141) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 10:30:43 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:30:43 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:30:44 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:30:48 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:30:49 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:30:53 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:30:54 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:30:54 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-c1e70571-531d-4e96-8791-45dee276c978 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Acquiring lock "d842f90e-663b-4c95-9d7c-d092d2bac41f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:30:54 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-c1e70571-531d-4e96-8791-45dee276c978 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Lock "d842f90e-663b-4c95-9d7c-d092d2bac41f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:30:54 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-c1e70571-531d-4e96-8791-45dee276c978 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Acquiring lock "d842f90e-663b-4c95-9d7c-d092d2bac41f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:30:54 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-c1e70571-531d-4e96-8791-45dee276c978 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Lock "d842f90e-663b-4c95-9d7c-d092d2bac41f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:30:54 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-c1e70571-531d-4e96-8791-45dee276c978 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Lock "d842f90e-663b-4c95-9d7c-d092d2bac41f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:30:54 user nova-compute[85141]: INFO nova.compute.manager [None req-c1e70571-531d-4e96-8791-45dee276c978 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] [instance: d842f90e-663b-4c95-9d7c-d092d2bac41f] Terminating instance
Nov 16 10:30:54 user nova-compute[85141]: DEBUG nova.compute.manager [None req-c1e70571-531d-4e96-8791-45dee276c978 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] [instance: d842f90e-663b-4c95-9d7c-d092d2bac41f] Start destroying the instance on the hypervisor. {{(pid=85141) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 10:30:54 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:30:54 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:30:54 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:30:54 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:30:54 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:30:55 user nova-compute[85141]: INFO nova.virt.libvirt.driver [-] [instance: d842f90e-663b-4c95-9d7c-d092d2bac41f] Instance destroyed successfully.
Nov 16 10:30:55 user nova-compute[85141]: DEBUG nova.objects.instance [None req-c1e70571-531d-4e96-8791-45dee276c978 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Lazy-loading 'resources' on Instance uuid d842f90e-663b-4c95-9d7c-d092d2bac41f {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:30:55 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-c1e70571-531d-4e96-8791-45dee276c978 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T10:10:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-380941350',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-380941350',id=3,image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-16T10:10:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='733b504d4dbe4f028963cf2c197f0064',ramdisk_id='',reservation_id='r-gmnitpgy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-742384119',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T10:12:25Z,user_data=None,user_id='ffe6ceff3cc346b59b4fbf294b9fc1a3',uuid=d842f90e-663b-4c95-9d7c-d092d2bac41f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6ce8849e-50a1-4b8a-bf75-1016ef3c2315", "address": "fa:16:3e:a2:a8:01", "network": {"id": "e40e4bd2-4277-40b1-9451-1c8365ffa488", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1333036447-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "733b504d4dbe4f028963cf2c197f0064", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ce8849e-50", "ovs_interfaceid": "6ce8849e-50a1-4b8a-bf75-1016ef3c2315", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 10:30:55 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-c1e70571-531d-4e96-8791-45dee276c978 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Converting VIF {"id": "6ce8849e-50a1-4b8a-bf75-1016ef3c2315", "address": "fa:16:3e:a2:a8:01", "network": {"id": "e40e4bd2-4277-40b1-9451-1c8365ffa488", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1333036447-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "733b504d4dbe4f028963cf2c197f0064", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ce8849e-50", "ovs_interfaceid": "6ce8849e-50a1-4b8a-bf75-1016ef3c2315", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:30:55 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-c1e70571-531d-4e96-8791-45dee276c978 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a2:a8:01,bridge_name='br-int',has_traffic_filtering=True,id=6ce8849e-50a1-4b8a-bf75-1016ef3c2315,network=Network(e40e4bd2-4277-40b1-9451-1c8365ffa488),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ce8849e-50') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:30:55 user nova-compute[85141]: DEBUG os_vif [None req-c1e70571-531d-4e96-8791-45dee276c978 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a2:a8:01,bridge_name='br-int',has_traffic_filtering=True,id=6ce8849e-50a1-4b8a-bf75-1016ef3c2315,network=Network(e40e4bd2-4277-40b1-9451-1c8365ffa488),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ce8849e-50') {{(pid=85141) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 10:30:55 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:30:55 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6ce8849e-50, bridge=br-int, if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:30:55 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:30:55 user nova-compute[85141]: DEBUG nova.compute.manager [req-c7afc9d6-4359-4f2b-9cfc-f1660a8d3855 req-2526b2c1-f585-4178-8ca3-4c3985cfcad2 service nova] [instance: d842f90e-663b-4c95-9d7c-d092d2bac41f] Received event network-vif-unplugged-6ce8849e-50a1-4b8a-bf75-1016ef3c2315 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:30:55 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-c7afc9d6-4359-4f2b-9cfc-f1660a8d3855 req-2526b2c1-f585-4178-8ca3-4c3985cfcad2 service nova] Acquiring lock "d842f90e-663b-4c95-9d7c-d092d2bac41f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:30:55 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-c7afc9d6-4359-4f2b-9cfc-f1660a8d3855 req-2526b2c1-f585-4178-8ca3-4c3985cfcad2 service nova] Lock "d842f90e-663b-4c95-9d7c-d092d2bac41f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:30:55 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-c7afc9d6-4359-4f2b-9cfc-f1660a8d3855 req-2526b2c1-f585-4178-8ca3-4c3985cfcad2 service nova] Lock "d842f90e-663b-4c95-9d7c-d092d2bac41f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:30:55 user nova-compute[85141]: DEBUG nova.compute.manager [req-c7afc9d6-4359-4f2b-9cfc-f1660a8d3855 req-2526b2c1-f585-4178-8ca3-4c3985cfcad2 service nova] [instance: d842f90e-663b-4c95-9d7c-d092d2bac41f] No waiting events found dispatching network-vif-unplugged-6ce8849e-50a1-4b8a-bf75-1016ef3c2315 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:30:55 user nova-compute[85141]: DEBUG nova.compute.manager [req-c7afc9d6-4359-4f2b-9cfc-f1660a8d3855 req-2526b2c1-f585-4178-8ca3-4c3985cfcad2 service nova] [instance: d842f90e-663b-4c95-9d7c-d092d2bac41f] Received event network-vif-unplugged-6ce8849e-50a1-4b8a-bf75-1016ef3c2315 for instance with task_state deleting. {{(pid=85141) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 10:30:55 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:30:55 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:30:55 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3def61c7-f25a-4f69-8e50-2675c6a32124) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:30:55 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:30:55 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:30:55 user nova-compute[85141]: INFO os_vif [None req-c1e70571-531d-4e96-8791-45dee276c978 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a2:a8:01,bridge_name='br-int',has_traffic_filtering=True,id=6ce8849e-50a1-4b8a-bf75-1016ef3c2315,network=Network(e40e4bd2-4277-40b1-9451-1c8365ffa488),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ce8849e-50')
Nov 16 10:30:55 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-c1e70571-531d-4e96-8791-45dee276c978 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] [instance: d842f90e-663b-4c95-9d7c-d092d2bac41f] Deleting instance files /opt/stack/data/nova/instances/d842f90e-663b-4c95-9d7c-d092d2bac41f_del
Nov 16 10:30:55 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-c1e70571-531d-4e96-8791-45dee276c978 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] [instance: d842f90e-663b-4c95-9d7c-d092d2bac41f] Deletion of /opt/stack/data/nova/instances/d842f90e-663b-4c95-9d7c-d092d2bac41f_del complete
Nov 16 10:30:55 user nova-compute[85141]: INFO nova.compute.manager [None req-c1e70571-531d-4e96-8791-45dee276c978 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] [instance: d842f90e-663b-4c95-9d7c-d092d2bac41f] Took 0.68 seconds to destroy the instance on the hypervisor.
Nov 16 10:30:55 user nova-compute[85141]: DEBUG oslo.service.loopingcall [None req-c1e70571-531d-4e96-8791-45dee276c978 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=85141) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 10:30:55 user nova-compute[85141]: DEBUG nova.compute.manager [-] [instance: d842f90e-663b-4c95-9d7c-d092d2bac41f] Deallocating network for instance {{(pid=85141) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 10:30:55 user nova-compute[85141]: DEBUG nova.network.neutron [-] [instance: d842f90e-663b-4c95-9d7c-d092d2bac41f] deallocate_for_instance() {{(pid=85141) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 10:30:55 user nova-compute[85141]: DEBUG nova.network.neutron [-] [instance: d842f90e-663b-4c95-9d7c-d092d2bac41f] Updating instance_info_cache with network_info: [] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:30:55 user nova-compute[85141]: INFO nova.compute.manager [-] [instance: d842f90e-663b-4c95-9d7c-d092d2bac41f] Took 0.54 seconds to deallocate network for instance.
Nov 16 10:30:55 user nova-compute[85141]: DEBUG nova.compute.manager [req-1fddaa3a-59b7-4e0e-bab5-d5a49cd4d1d8 req-78c1e618-d0ef-41cd-a307-f3a012fbf55c service nova] [instance: d842f90e-663b-4c95-9d7c-d092d2bac41f] Received event network-vif-deleted-6ce8849e-50a1-4b8a-bf75-1016ef3c2315 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:30:55 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-c1e70571-531d-4e96-8791-45dee276c978 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:30:55 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-c1e70571-531d-4e96-8791-45dee276c978 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:30:56 user nova-compute[85141]: DEBUG nova.compute.provider_tree [None req-c1e70571-531d-4e96-8791-45dee276c978 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Inventory has not changed in ProviderTree for provider: bf8e0fa1-16b6-408f-9203-c4cd63916272 {{(pid=85141) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 10:30:56 user nova-compute[85141]: DEBUG nova.scheduler.client.report [None req-c1e70571-531d-4e96-8791-45dee276c978 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Inventory has not changed for provider bf8e0fa1-16b6-408f-9203-c4cd63916272 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=85141) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 10:30:56 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-c1e70571-531d-4e96-8791-45dee276c978 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.337s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:30:56 user nova-compute[85141]: INFO nova.scheduler.client.report [None req-c1e70571-531d-4e96-8791-45dee276c978 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Deleted allocations for instance d842f90e-663b-4c95-9d7c-d092d2bac41f
Nov 16 10:30:56 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-c1e70571-531d-4e96-8791-45dee276c978 tempest-ServerBootFromVolumeStableRescueTest-742384119 tempest-ServerBootFromVolumeStableRescueTest-742384119-project-member] Lock "d842f90e-663b-4c95-9d7c-d092d2bac41f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.716s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:30:57 user nova-compute[85141]: DEBUG nova.compute.manager [req-3316dbbe-76b9-4bed-92f3-296a89cb89ab req-e8cf8104-8b09-4e1e-b4e9-ea56e1b902a1 service nova] [instance: d842f90e-663b-4c95-9d7c-d092d2bac41f] Received event network-vif-plugged-6ce8849e-50a1-4b8a-bf75-1016ef3c2315 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:30:57 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-3316dbbe-76b9-4bed-92f3-296a89cb89ab req-e8cf8104-8b09-4e1e-b4e9-ea56e1b902a1 service nova] Acquiring lock "d842f90e-663b-4c95-9d7c-d092d2bac41f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:30:57 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-3316dbbe-76b9-4bed-92f3-296a89cb89ab req-e8cf8104-8b09-4e1e-b4e9-ea56e1b902a1 service nova] Lock "d842f90e-663b-4c95-9d7c-d092d2bac41f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:30:57 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-3316dbbe-76b9-4bed-92f3-296a89cb89ab req-e8cf8104-8b09-4e1e-b4e9-ea56e1b902a1 service nova] Lock "d842f90e-663b-4c95-9d7c-d092d2bac41f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:30:57 user nova-compute[85141]: DEBUG nova.compute.manager [req-3316dbbe-76b9-4bed-92f3-296a89cb89ab req-e8cf8104-8b09-4e1e-b4e9-ea56e1b902a1 service nova] [instance: d842f90e-663b-4c95-9d7c-d092d2bac41f] No waiting events found dispatching network-vif-plugged-6ce8849e-50a1-4b8a-bf75-1016ef3c2315 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:30:57 user nova-compute[85141]: WARNING nova.compute.manager [req-3316dbbe-76b9-4bed-92f3-296a89cb89ab req-e8cf8104-8b09-4e1e-b4e9-ea56e1b902a1 service nova] [instance: d842f90e-663b-4c95-9d7c-d092d2bac41f] Received unexpected event network-vif-plugged-6ce8849e-50a1-4b8a-bf75-1016ef3c2315 for instance with vm_state deleted and task_state None.
Nov 16 10:31:00 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:31:02 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-f41869e8-e5a6-4273-8629-7c251b70e294 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 89e358d7-0844-4742-853b-ff88800415d2 is timed out.
Nov 16 10:31:02 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-f41869e8-e5a6-4273-8629-7c251b70e294 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Successfully detached device vdb from instance 89e358d7-0844-4742-853b-ff88800415d2 from the live domain config.
Nov 16 10:31:02 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f41869e8-e5a6-4273-8629-7c251b70e294 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] [instance: 89e358d7-0844-4742-853b-ff88800415d2] calling os-brick to detach iSCSI Volume {{(pid=85141) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 10:31:02 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-f41869e8-e5a6-4273-8629-7c251b70e294 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51806b6080>, {'target_iqn': 'iqn.2010-10.org.openstack:f30b1bab-5fbb-4103-a00a-cf0e857ce92a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FBcOfdVM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 10:31:02 user nova-compute[85141]: WARNING os_brick.initiator.connectors.base [None req-f41869e8-e5a6-4273-8629-7c251b70e294 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 10:31:02 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-f41869e8-e5a6-4273-8629-7c251b70e294 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 10:31:02 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-f41869e8-e5a6-4273-8629-7c251b70e294 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 10:31:02 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:31:02 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:31:02 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[18589bbd-399e-43e1-99ee-09e387bf16e8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e0c5c19d-363b-4f5d-a04f-fb7de64423f2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:925fd9db-7153-4861-bbc3-9cbb8822e196\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:68965271-48ea-40f4-870f-2c9c54c02a7f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2006a77c-e5e8-4ec5-8de5-a0f9505c429a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f30b1bab-5fbb-4103-a00a-cf0e857ce92a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:31:02 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-f41869e8-e5a6-4273-8629-7c251b70e294 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 10:31:02 user nova-compute[85141]: No targets found.
Nov 16 10:31:02 user nova-compute[85141]: iSNS:
Nov 16 10:31:02 user nova-compute[85141]: No targets found.
Nov 16 10:31:02 user nova-compute[85141]: STATIC:
Nov 16 10:31:02 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:e0c5c19d-363b-4f5d-a04f-fb7de64423f2
Nov 16 10:31:02 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:31:02 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:31:02 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:925fd9db-7153-4861-bbc3-9cbb8822e196
Nov 16 10:31:02 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:31:02 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:31:02 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:68965271-48ea-40f4-870f-2c9c54c02a7f
Nov 16 10:31:02 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:31:02 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:31:02 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:2006a77c-e5e8-4ec5-8de5-a0f9505c429a
Nov 16 10:31:02 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:31:02 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:31:02 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:f30b1bab-5fbb-4103-a00a-cf0e857ce92a
Nov 16 10:31:02 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:31:02 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:31:02 user nova-compute[85141]: FIRMWARE:
Nov 16 10:31:02 user nova-compute[85141]: No targets found.
Nov 16 10:31:02 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:31:02 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-f41869e8-e5a6-4273-8629-7c251b70e294 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 10:31:02 user nova-compute[85141]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 10:31:02 user nova-compute[85141]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=85141) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 10:31:02 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-f41869e8-e5a6-4273-8629-7c251b70e294 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f30b1bab-5fbb-4103-a00a-cf0e857ce92a', 0)] {{(pid=85141) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 10:31:02 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:31:02 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:31:02 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[eea20f31-5994-412c-8c6a-780c304120f9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2006a77c-e5e8-4ec5-8de5-a0f9505c429a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:68965271-48ea-40f4-870f-2c9c54c02a7f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:925fd9db-7153-4861-bbc3-9cbb8822e196\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e0c5c19d-363b-4f5d-a04f-fb7de64423f2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f30b1bab-5fbb-4103-a00a-cf0e857ce92a\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:31:02 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:31:02 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:31:02 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[256bbd17-236e-481d-845d-cb1a0fb03751]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2006a77c-e5e8-4ec5-8de5-a0f9505c429a (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0c5c19d-363b-4f5d-a04f-fb7de64423f2 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:925fd9db-7153-4861-bbc3-9cbb8822e196 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f30b1bab-5fbb-4103-a00a-cf0e857ce92a (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68965271-48ea-40f4-870f-2c9c54c02a7f (non-flash)\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:31:02 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-f41869e8-e5a6-4273-8629-7c251b70e294 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2006a77c-e5e8-4ec5-8de5-a0f9505c429a (non-flash)
Nov 16 10:31:02 user nova-compute[85141]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0c5c19d-363b-4f5d-a04f-fb7de64423f2 (non-flash)
Nov 16 10:31:02 user nova-compute[85141]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:925fd9db-7153-4861-bbc3-9cbb8822e196 (non-flash)
Nov 16 10:31:02 user nova-compute[85141]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f30b1bab-5fbb-4103-a00a-cf0e857ce92a (non-flash)
Nov 16 10:31:02 user nova-compute[85141]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68965271-48ea-40f4-870f-2c9c54c02a7f (non-flash)
Nov 16 10:31:02 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:31:02 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-f41869e8-e5a6-4273-8629-7c251b70e294 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2006a77c-e5e8-4ec5-8de5-a0f9505c429a (non-flash)
Nov 16 10:31:02 user nova-compute[85141]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0c5c19d-363b-4f5d-a04f-fb7de64423f2 (non-flash)
Nov 16 10:31:02 user nova-compute[85141]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:925fd9db-7153-4861-bbc3-9cbb8822e196 (non-flash)
Nov 16 10:31:02 user nova-compute[85141]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f30b1bab-5fbb-4103-a00a-cf0e857ce92a (non-flash)
Nov 16 10:31:02 user nova-compute[85141]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68965271-48ea-40f4-870f-2c9c54c02a7f (non-flash)
Nov 16 10:31:02 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 10:31:02 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-f41869e8-e5a6-4273-8629-7c251b70e294 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f516065a830>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f30b1bab-5fbb-4103-a00a-cf0e857ce92a'): ({'sdf'}, set())}) {{(pid=85141) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 10:31:02 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-f41869e8-e5a6-4273-8629-7c251b70e294 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Removing single pathed devices sdf {{(pid=85141) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 10:31:02 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:31:02 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:31:02 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[292472e2-cd13-45ba-89b5-00532b973106]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:31:02 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:31:02 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:31:02 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[8581bc1d-d192-409d-9f9f-7dcc318c1597]: (4, ('ok\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:31:02 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-f41869e8-e5a6-4273-8629-7c251b70e294 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Flushing IO for device /dev/sdf {{(pid=85141) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 10:31:02 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:31:02 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:31:02 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd613097-bf33-4828-bd8c-f5be4ab19355]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:31:02 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-f41869e8-e5a6-4273-8629-7c251b70e294 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=85141) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 10:31:02 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:31:02 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.047s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:31:02 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccce0b9b-19bc-4f09-90c2-bafc399f6e00]: (4, ('1', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:31:02 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-f41869e8-e5a6-4273-8629-7c251b70e294 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=85141) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 10:31:02 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-f41869e8-e5a6-4273-8629-7c251b70e294 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] SCSI volumes sdf have been removed. {{(pid=85141) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 10:31:02 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-f41869e8-e5a6-4273-8629-7c251b70e294 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f30b1bab-5fbb-4103-a00a-cf0e857ce92a')] {{(pid=85141) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 10:31:02 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f30b1bab-5fbb-4103-a00a-cf0e857ce92a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:31:02 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f30b1bab-5fbb-4103-a00a-cf0e857ce92a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:31:02 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e720d5a-eec2-4bbe-9490-6c2317044b8c]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:31:02 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-f41869e8-e5a6-4273-8629-7c251b70e294 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:31:02 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f30b1bab-5fbb-4103-a00a-cf0e857ce92a -p 172.16.0.220:3260 --logout {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:31:02 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f30b1bab-5fbb-4103-a00a-cf0e857ce92a -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:31:02 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[2348c5c0-535b-4f95-93b8-ce8890915017]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:f30b1bab-5fbb-4103-a00a-cf0e857ce92a, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:f30b1bab-5fbb-4103-a00a-cf0e857ce92a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:31:02 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-f41869e8-e5a6-4273-8629-7c251b70e294 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:f30b1bab-5fbb-4103-a00a-cf0e857ce92a, portal: 172.16.0.220,3260]
Nov 16 10:31:02 user nova-compute[85141]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:f30b1bab-5fbb-4103-a00a-cf0e857ce92a, portal: 172.16.0.220,3260] successful.
Nov 16 10:31:02 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:31:02 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f30b1bab-5fbb-4103-a00a-cf0e857ce92a -p 172.16.0.220:3260 --op delete {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:31:02 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f30b1bab-5fbb-4103-a00a-cf0e857ce92a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:31:02 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[6500f097-f307-4b8f-a07c-ee767cf27c14]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:31:02 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-f41869e8-e5a6-4273-8629-7c251b70e294 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:31:02 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-f41869e8-e5a6-4273-8629-7c251b70e294 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.315s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 10:31:02 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-f41869e8-e5a6-4273-8629-7c251b70e294 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] <== disconnect_volume: return (316ms) None {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 10:31:02 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f41869e8-e5a6-4273-8629-7c251b70e294 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] [instance: 89e358d7-0844-4742-853b-ff88800415d2] Disconnected iSCSI Volume {{(pid=85141) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 10:31:03 user nova-compute[85141]: DEBUG nova.objects.instance [None req-f41869e8-e5a6-4273-8629-7c251b70e294 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Lazy-loading 'flavor' on Instance uuid 89e358d7-0844-4742-853b-ff88800415d2 {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:31:03 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-f41869e8-e5a6-4273-8629-7c251b70e294 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Lock "89e358d7-0844-4742-853b-ff88800415d2" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.637s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:31:04 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-557ca829-84ad-40c9-83f0-7ed39bbb6e06 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Acquiring lock "89e358d7-0844-4742-853b-ff88800415d2" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:31:04 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-557ca829-84ad-40c9-83f0-7ed39bbb6e06 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Lock "89e358d7-0844-4742-853b-ff88800415d2" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:31:04 user nova-compute[85141]: INFO nova.compute.manager [None req-557ca829-84ad-40c9-83f0-7ed39bbb6e06 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] [instance: 89e358d7-0844-4742-853b-ff88800415d2] Detaching volume 68965271-48ea-40f4-870f-2c9c54c02a7f
Nov 16 10:31:04 user nova-compute[85141]: INFO nova.virt.block_device [None req-557ca829-84ad-40c9-83f0-7ed39bbb6e06 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] [instance: 89e358d7-0844-4742-853b-ff88800415d2] Attempting to driver detach volume 68965271-48ea-40f4-870f-2c9c54c02a7f from mountpoint /dev/vdc
Nov 16 10:31:04 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-557ca829-84ad-40c9-83f0-7ed39bbb6e06 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Attempting to detach device vdc from instance 89e358d7-0844-4742-853b-ff88800415d2 from the persistent domain config. {{(pid=85141) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 10:31:04 user nova-compute[85141]: DEBUG nova.virt.libvirt.guest [None req-557ca829-84ad-40c9-83f0-7ed39bbb6e06 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 10:31:04 user nova-compute[85141]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 10:31:04 user nova-compute[85141]:   <source dev="/dev/sdg"/>
Nov 16 10:31:04 user nova-compute[85141]:   <target dev="vdc" bus="virtio"/>
Nov 16 10:31:04 user nova-compute[85141]:   <serial>68965271-48ea-40f4-870f-2c9c54c02a7f</serial>
Nov 16 10:31:04 user nova-compute[85141]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 16 10:31:04 user nova-compute[85141]: </disk>
Nov 16 10:31:04 user nova-compute[85141]:  {{(pid=85141) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 10:31:04 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-557ca829-84ad-40c9-83f0-7ed39bbb6e06 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Successfully detached device vdc from instance 89e358d7-0844-4742-853b-ff88800415d2 from the persistent domain config.
Nov 16 10:31:04 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-557ca829-84ad-40c9-83f0-7ed39bbb6e06 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 89e358d7-0844-4742-853b-ff88800415d2 from the live domain config. {{(pid=85141) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 10:31:04 user nova-compute[85141]: DEBUG nova.virt.libvirt.guest [None req-557ca829-84ad-40c9-83f0-7ed39bbb6e06 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 10:31:04 user nova-compute[85141]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 10:31:04 user nova-compute[85141]:   <source dev="/dev/sdg"/>
Nov 16 10:31:04 user nova-compute[85141]:   <target dev="vdc" bus="virtio"/>
Nov 16 10:31:04 user nova-compute[85141]:   <serial>68965271-48ea-40f4-870f-2c9c54c02a7f</serial>
Nov 16 10:31:04 user nova-compute[85141]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 16 10:31:04 user nova-compute[85141]: </disk>
Nov 16 10:31:04 user nova-compute[85141]:  {{(pid=85141) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 10:31:05 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-557ca829-84ad-40c9-83f0-7ed39bbb6e06 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 89e358d7-0844-4742-853b-ff88800415d2 {{(pid=85141) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 10:31:05 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:31:10 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:31:12 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:31:13 user nova-compute[85141]: DEBUG nova.compute.manager [None req-1f2ec588-67e7-4240-9208-42d41bc57b86 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] [instance: da42de06-4518-4c8a-8c63-9b5a2759a1bf] Checking state {{(pid=85141) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 10:31:13 user nova-compute[85141]: INFO nova.compute.manager [None req-1f2ec588-67e7-4240-9208-42d41bc57b86 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] [instance: da42de06-4518-4c8a-8c63-9b5a2759a1bf] instance snapshotting
Nov 16 10:31:13 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-1f2ec588-67e7-4240-9208-42d41bc57b86 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] [instance: da42de06-4518-4c8a-8c63-9b5a2759a1bf] Beginning live snapshot process
Nov 16 10:31:13 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-1f2ec588-67e7-4240-9208-42d41bc57b86 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da42de06-4518-4c8a-8c63-9b5a2759a1bf/disk --force-share --output=json -f qcow2 {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:31:13 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-1f2ec588-67e7-4240-9208-42d41bc57b86 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da42de06-4518-4c8a-8c63-9b5a2759a1bf/disk --force-share --output=json -f qcow2" returned: 0 in 0.175s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:31:13 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-1f2ec588-67e7-4240-9208-42d41bc57b86 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da42de06-4518-4c8a-8c63-9b5a2759a1bf/disk --force-share --output=json -f qcow2 {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:31:14 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-1f2ec588-67e7-4240-9208-42d41bc57b86 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da42de06-4518-4c8a-8c63-9b5a2759a1bf/disk --force-share --output=json -f qcow2" returned: 0 in 0.178s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:31:14 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-1f2ec588-67e7-4240-9208-42d41bc57b86 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:31:14 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-1f2ec588-67e7-4240-9208-42d41bc57b86 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json" returned: 0 in 0.178s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:31:14 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-1f2ec588-67e7-4240-9208-42d41bc57b86 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpuodq0vd7/e1d015165b3a48f58445119a27e339f5.delta 1073741824 {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:31:14 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-1f2ec588-67e7-4240-9208-42d41bc57b86 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpuodq0vd7/e1d015165b3a48f58445119a27e339f5.delta 1073741824" returned: 0 in 0.051s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:31:14 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-1f2ec588-67e7-4240-9208-42d41bc57b86 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] [instance: da42de06-4518-4c8a-8c63-9b5a2759a1bf] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 16 10:31:15 user nova-compute[85141]: DEBUG nova.virt.libvirt.guest [None req-1f2ec588-67e7-4240-9208-42d41bc57b86 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] COPY block job progress, current cursor: 327680 final cursor: 75563008 {{(pid=85141) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 10:31:15 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:31:15 user nova-compute[85141]: DEBUG nova.virt.libvirt.guest [None req-1f2ec588-67e7-4240-9208-42d41bc57b86 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=85141) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 10:31:15 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-1f2ec588-67e7-4240-9208-42d41bc57b86 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] [instance: da42de06-4518-4c8a-8c63-9b5a2759a1bf] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 16 10:31:15 user nova-compute[85141]: DEBUG nova.privsep.utils [None req-1f2ec588-67e7-4240-9208-42d41bc57b86 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=85141) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 16 10:31:15 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-1f2ec588-67e7-4240-9208-42d41bc57b86 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpuodq0vd7/e1d015165b3a48f58445119a27e339f5.delta /opt/stack/data/nova/instances/snapshots/tmpuodq0vd7/e1d015165b3a48f58445119a27e339f5 {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:31:16 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-1f2ec588-67e7-4240-9208-42d41bc57b86 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpuodq0vd7/e1d015165b3a48f58445119a27e339f5.delta /opt/stack/data/nova/instances/snapshots/tmpuodq0vd7/e1d015165b3a48f58445119a27e339f5" returned: 0 in 0.412s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:31:16 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-1f2ec588-67e7-4240-9208-42d41bc57b86 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] [instance: da42de06-4518-4c8a-8c63-9b5a2759a1bf] Snapshot extracted, beginning image upload
Nov 16 10:31:16 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-10d2d4c1-3785-4219-bb4e-e2e590fb7a26 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Acquiring lock "b24c3954-06ff-4e15-9e43-c65d1dae7a5d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:31:16 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-10d2d4c1-3785-4219-bb4e-e2e590fb7a26 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Lock "b24c3954-06ff-4e15-9e43-c65d1dae7a5d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:31:16 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-10d2d4c1-3785-4219-bb4e-e2e590fb7a26 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Acquiring lock "b24c3954-06ff-4e15-9e43-c65d1dae7a5d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:31:16 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-10d2d4c1-3785-4219-bb4e-e2e590fb7a26 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Lock "b24c3954-06ff-4e15-9e43-c65d1dae7a5d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:31:16 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-10d2d4c1-3785-4219-bb4e-e2e590fb7a26 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Lock "b24c3954-06ff-4e15-9e43-c65d1dae7a5d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:31:16 user nova-compute[85141]: INFO nova.compute.manager [None req-10d2d4c1-3785-4219-bb4e-e2e590fb7a26 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] [instance: b24c3954-06ff-4e15-9e43-c65d1dae7a5d] Terminating instance
Nov 16 10:31:16 user nova-compute[85141]: DEBUG nova.compute.manager [None req-10d2d4c1-3785-4219-bb4e-e2e590fb7a26 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] [instance: b24c3954-06ff-4e15-9e43-c65d1dae7a5d] Start destroying the instance on the hypervisor. {{(pid=85141) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 10:31:16 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:31:16 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:31:17 user nova-compute[85141]: DEBUG nova.compute.manager [req-0717ed80-316d-470d-96fe-769f7d3f1d7a req-0f9999db-fae8-4ca6-8b66-140faa48396b service nova] [instance: b24c3954-06ff-4e15-9e43-c65d1dae7a5d] Received event network-vif-unplugged-6becb779-bd08-4a40-bb56-3b8f03d1f844 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:31:17 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-0717ed80-316d-470d-96fe-769f7d3f1d7a req-0f9999db-fae8-4ca6-8b66-140faa48396b service nova] Acquiring lock "b24c3954-06ff-4e15-9e43-c65d1dae7a5d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:31:17 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-0717ed80-316d-470d-96fe-769f7d3f1d7a req-0f9999db-fae8-4ca6-8b66-140faa48396b service nova] Lock "b24c3954-06ff-4e15-9e43-c65d1dae7a5d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:31:17 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-0717ed80-316d-470d-96fe-769f7d3f1d7a req-0f9999db-fae8-4ca6-8b66-140faa48396b service nova] Lock "b24c3954-06ff-4e15-9e43-c65d1dae7a5d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:31:17 user nova-compute[85141]: DEBUG nova.compute.manager [req-0717ed80-316d-470d-96fe-769f7d3f1d7a req-0f9999db-fae8-4ca6-8b66-140faa48396b service nova] [instance: b24c3954-06ff-4e15-9e43-c65d1dae7a5d] No waiting events found dispatching network-vif-unplugged-6becb779-bd08-4a40-bb56-3b8f03d1f844 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:31:17 user nova-compute[85141]: DEBUG nova.compute.manager [req-0717ed80-316d-470d-96fe-769f7d3f1d7a req-0f9999db-fae8-4ca6-8b66-140faa48396b service nova] [instance: b24c3954-06ff-4e15-9e43-c65d1dae7a5d] Received event network-vif-unplugged-6becb779-bd08-4a40-bb56-3b8f03d1f844 for instance with task_state deleting. {{(pid=85141) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 10:31:17 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:31:17 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:31:17 user nova-compute[85141]: INFO nova.virt.libvirt.driver [-] [instance: b24c3954-06ff-4e15-9e43-c65d1dae7a5d] Instance destroyed successfully.
Nov 16 10:31:17 user nova-compute[85141]: DEBUG nova.objects.instance [None req-10d2d4c1-3785-4219-bb4e-e2e590fb7a26 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Lazy-loading 'resources' on Instance uuid b24c3954-06ff-4e15-9e43-c65d1dae7a5d {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:31:17 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-10d2d4c1-3785-4219-bb4e-e2e590fb7a26 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T10:15:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1886603118',display_name='tempest-ServerRescueNegativeTestJSON-server-1886603118',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1886603118',id=18,image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-16T10:17:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='09b520de67ac4290a4b779f50afeb1a4',ramdisk_id='',reservation_id='r-uoz0yc00',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-2068988845',owner_user_name='tempest-ServerRescueNegativeTestJSON-2068988845-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T10:17:12Z,user_data=None,user_id='76d4eaf5cef745c3bf3ae07068338b1a',uuid=b24c3954-06ff-4e15-9e43-c65d1dae7a5d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "6becb779-bd08-4a40-bb56-3b8f03d1f844", "address": "fa:16:3e:ca:42:7f", "network": {"id": "5b67a3fd-ef1e-4f2c-b6e0-31766ef39d30", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2137186235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09b520de67ac4290a4b779f50afeb1a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6becb779-bd", "ovs_interfaceid": "6becb779-bd08-4a40-bb56-3b8f03d1f844", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 10:31:17 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-10d2d4c1-3785-4219-bb4e-e2e590fb7a26 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Converting VIF {"id": "6becb779-bd08-4a40-bb56-3b8f03d1f844", "address": "fa:16:3e:ca:42:7f", "network": {"id": "5b67a3fd-ef1e-4f2c-b6e0-31766ef39d30", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2137186235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09b520de67ac4290a4b779f50afeb1a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6becb779-bd", "ovs_interfaceid": "6becb779-bd08-4a40-bb56-3b8f03d1f844", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:31:17 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-10d2d4c1-3785-4219-bb4e-e2e590fb7a26 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ca:42:7f,bridge_name='br-int',has_traffic_filtering=True,id=6becb779-bd08-4a40-bb56-3b8f03d1f844,network=Network(5b67a3fd-ef1e-4f2c-b6e0-31766ef39d30),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6becb779-bd') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:31:17 user nova-compute[85141]: DEBUG os_vif [None req-10d2d4c1-3785-4219-bb4e-e2e590fb7a26 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ca:42:7f,bridge_name='br-int',has_traffic_filtering=True,id=6becb779-bd08-4a40-bb56-3b8f03d1f844,network=Network(5b67a3fd-ef1e-4f2c-b6e0-31766ef39d30),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6becb779-bd') {{(pid=85141) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 10:31:17 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:31:17 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6becb779-bd, bridge=br-int, if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:31:17 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:31:17 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:31:17 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:31:17 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4d5e0616-56df-49dd-b7e5-9768745e7c65) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:31:17 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:31:17 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:31:17 user nova-compute[85141]: INFO os_vif [None req-10d2d4c1-3785-4219-bb4e-e2e590fb7a26 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ca:42:7f,bridge_name='br-int',has_traffic_filtering=True,id=6becb779-bd08-4a40-bb56-3b8f03d1f844,network=Network(5b67a3fd-ef1e-4f2c-b6e0-31766ef39d30),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6becb779-bd')
Nov 16 10:31:17 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-10d2d4c1-3785-4219-bb4e-e2e590fb7a26 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] [instance: b24c3954-06ff-4e15-9e43-c65d1dae7a5d] Deleting instance files /opt/stack/data/nova/instances/b24c3954-06ff-4e15-9e43-c65d1dae7a5d_del
Nov 16 10:31:17 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-10d2d4c1-3785-4219-bb4e-e2e590fb7a26 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] [instance: b24c3954-06ff-4e15-9e43-c65d1dae7a5d] Deletion of /opt/stack/data/nova/instances/b24c3954-06ff-4e15-9e43-c65d1dae7a5d_del complete
Nov 16 10:31:17 user nova-compute[85141]: INFO nova.compute.manager [None req-10d2d4c1-3785-4219-bb4e-e2e590fb7a26 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] [instance: b24c3954-06ff-4e15-9e43-c65d1dae7a5d] Took 0.93 seconds to destroy the instance on the hypervisor.
Nov 16 10:31:17 user nova-compute[85141]: DEBUG oslo.service.loopingcall [None req-10d2d4c1-3785-4219-bb4e-e2e590fb7a26 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=85141) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 10:31:17 user nova-compute[85141]: DEBUG nova.compute.manager [-] [instance: b24c3954-06ff-4e15-9e43-c65d1dae7a5d] Deallocating network for instance {{(pid=85141) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 10:31:17 user nova-compute[85141]: DEBUG nova.network.neutron [-] [instance: b24c3954-06ff-4e15-9e43-c65d1dae7a5d] deallocate_for_instance() {{(pid=85141) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 10:31:18 user nova-compute[85141]: DEBUG nova.network.neutron [-] [instance: b24c3954-06ff-4e15-9e43-c65d1dae7a5d] Updating instance_info_cache with network_info: [] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:31:18 user nova-compute[85141]: INFO nova.compute.manager [-] [instance: b24c3954-06ff-4e15-9e43-c65d1dae7a5d] Took 0.45 seconds to deallocate network for instance.
Nov 16 10:31:18 user nova-compute[85141]: DEBUG nova.compute.manager [req-41b0176d-bb61-47e0-8ebf-616947bd828b req-da08f2e1-ddd6-441f-bead-ad027f251365 service nova] [instance: b24c3954-06ff-4e15-9e43-c65d1dae7a5d] Received event network-vif-deleted-6becb779-bd08-4a40-bb56-3b8f03d1f844 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:31:18 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-10d2d4c1-3785-4219-bb4e-e2e590fb7a26 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:31:18 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-10d2d4c1-3785-4219-bb4e-e2e590fb7a26 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:31:18 user nova-compute[85141]: DEBUG nova.compute.provider_tree [None req-10d2d4c1-3785-4219-bb4e-e2e590fb7a26 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Inventory has not changed in ProviderTree for provider: bf8e0fa1-16b6-408f-9203-c4cd63916272 {{(pid=85141) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 10:31:18 user nova-compute[85141]: DEBUG nova.scheduler.client.report [None req-10d2d4c1-3785-4219-bb4e-e2e590fb7a26 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Inventory has not changed for provider bf8e0fa1-16b6-408f-9203-c4cd63916272 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=85141) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 10:31:18 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-10d2d4c1-3785-4219-bb4e-e2e590fb7a26 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.336s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:31:18 user nova-compute[85141]: INFO nova.scheduler.client.report [None req-10d2d4c1-3785-4219-bb4e-e2e590fb7a26 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Deleted allocations for instance b24c3954-06ff-4e15-9e43-c65d1dae7a5d
Nov 16 10:31:18 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-10d2d4c1-3785-4219-bb4e-e2e590fb7a26 tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Lock "b24c3954-06ff-4e15-9e43-c65d1dae7a5d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.935s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:31:18 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-1f2ec588-67e7-4240-9208-42d41bc57b86 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] [instance: da42de06-4518-4c8a-8c63-9b5a2759a1bf] Snapshot image upload complete
Nov 16 10:31:18 user nova-compute[85141]: INFO nova.compute.manager [None req-1f2ec588-67e7-4240-9208-42d41bc57b86 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] [instance: da42de06-4518-4c8a-8c63-9b5a2759a1bf] Took 5.13 seconds to snapshot the instance on the hypervisor.
Nov 16 10:31:19 user nova-compute[85141]: DEBUG nova.compute.manager [req-037791a6-88f4-4b9f-a0b1-dc3a35a952c6 req-de45ad30-e8e8-4936-9395-dcf9ac5fb65d service nova] [instance: b24c3954-06ff-4e15-9e43-c65d1dae7a5d] Received event network-vif-plugged-6becb779-bd08-4a40-bb56-3b8f03d1f844 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:31:19 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-037791a6-88f4-4b9f-a0b1-dc3a35a952c6 req-de45ad30-e8e8-4936-9395-dcf9ac5fb65d service nova] Acquiring lock "b24c3954-06ff-4e15-9e43-c65d1dae7a5d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:31:19 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-037791a6-88f4-4b9f-a0b1-dc3a35a952c6 req-de45ad30-e8e8-4936-9395-dcf9ac5fb65d service nova] Lock "b24c3954-06ff-4e15-9e43-c65d1dae7a5d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:31:19 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-037791a6-88f4-4b9f-a0b1-dc3a35a952c6 req-de45ad30-e8e8-4936-9395-dcf9ac5fb65d service nova] Lock "b24c3954-06ff-4e15-9e43-c65d1dae7a5d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:31:19 user nova-compute[85141]: DEBUG nova.compute.manager [req-037791a6-88f4-4b9f-a0b1-dc3a35a952c6 req-de45ad30-e8e8-4936-9395-dcf9ac5fb65d service nova] [instance: b24c3954-06ff-4e15-9e43-c65d1dae7a5d] No waiting events found dispatching network-vif-plugged-6becb779-bd08-4a40-bb56-3b8f03d1f844 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:31:19 user nova-compute[85141]: WARNING nova.compute.manager [req-037791a6-88f4-4b9f-a0b1-dc3a35a952c6 req-de45ad30-e8e8-4936-9395-dcf9ac5fb65d service nova] [instance: b24c3954-06ff-4e15-9e43-c65d1dae7a5d] Received unexpected event network-vif-plugged-6becb779-bd08-4a40-bb56-3b8f03d1f844 for instance with vm_state deleted and task_state None.
Nov 16 10:31:21 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-bef83356-a9fe-4f25-8fb2-5d16702c5ff2 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Acquiring lock "f432d8f9-10c4-49e3-bf3b-6389f52e21ab" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:31:21 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-bef83356-a9fe-4f25-8fb2-5d16702c5ff2 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Lock "f432d8f9-10c4-49e3-bf3b-6389f52e21ab" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:31:21 user nova-compute[85141]: DEBUG nova.compute.manager [None req-bef83356-a9fe-4f25-8fb2-5d16702c5ff2 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] [instance: f432d8f9-10c4-49e3-bf3b-6389f52e21ab] Starting instance... {{(pid=85141) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 10:31:21 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-bef83356-a9fe-4f25-8fb2-5d16702c5ff2 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:31:21 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-bef83356-a9fe-4f25-8fb2-5d16702c5ff2 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:31:21 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-bef83356-a9fe-4f25-8fb2-5d16702c5ff2 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=85141) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 10:31:21 user nova-compute[85141]: INFO nova.compute.claims [None req-bef83356-a9fe-4f25-8fb2-5d16702c5ff2 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] [instance: f432d8f9-10c4-49e3-bf3b-6389f52e21ab] Claim successful on node user
Nov 16 10:31:21 user nova-compute[85141]: DEBUG nova.compute.manager [req-6173dfb3-ab3c-40a8-a05a-2495e1505410 req-8175585d-2b2d-4d22-aea5-f27f37e404c2 service nova] [instance: 7437a3a3-9b7f-489b-b20b-f1b877ebb253] Received event network-changed-7ba5e576-d9a3-44c7-a741-a9d1e510d7bf {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:31:21 user nova-compute[85141]: DEBUG nova.compute.manager [req-6173dfb3-ab3c-40a8-a05a-2495e1505410 req-8175585d-2b2d-4d22-aea5-f27f37e404c2 service nova] [instance: 7437a3a3-9b7f-489b-b20b-f1b877ebb253] Refreshing instance network info cache due to event network-changed-7ba5e576-d9a3-44c7-a741-a9d1e510d7bf. {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 10:31:21 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-6173dfb3-ab3c-40a8-a05a-2495e1505410 req-8175585d-2b2d-4d22-aea5-f27f37e404c2 service nova] Acquiring lock "refresh_cache-7437a3a3-9b7f-489b-b20b-f1b877ebb253" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:31:21 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-6173dfb3-ab3c-40a8-a05a-2495e1505410 req-8175585d-2b2d-4d22-aea5-f27f37e404c2 service nova] Acquired lock "refresh_cache-7437a3a3-9b7f-489b-b20b-f1b877ebb253" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:31:21 user nova-compute[85141]: DEBUG nova.network.neutron [req-6173dfb3-ab3c-40a8-a05a-2495e1505410 req-8175585d-2b2d-4d22-aea5-f27f37e404c2 service nova] [instance: 7437a3a3-9b7f-489b-b20b-f1b877ebb253] Refreshing network info cache for port 7ba5e576-d9a3-44c7-a741-a9d1e510d7bf {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 10:31:21 user nova-compute[85141]: DEBUG nova.compute.manager [req-f0f6758e-8faa-42ac-a224-1132fa0299f7 req-03555715-dadf-4e81-83d6-73f2540406b4 service nova] [instance: 97cbb145-d47e-4eb1-8c01-06361efa8720] Received event network-changed-440f9d6b-639a-4615-8b0c-e85b108f9734 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:31:21 user nova-compute[85141]: DEBUG nova.compute.manager [req-f0f6758e-8faa-42ac-a224-1132fa0299f7 req-03555715-dadf-4e81-83d6-73f2540406b4 service nova] [instance: 97cbb145-d47e-4eb1-8c01-06361efa8720] Refreshing instance network info cache due to event network-changed-440f9d6b-639a-4615-8b0c-e85b108f9734. {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 10:31:21 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-f0f6758e-8faa-42ac-a224-1132fa0299f7 req-03555715-dadf-4e81-83d6-73f2540406b4 service nova] Acquiring lock "refresh_cache-97cbb145-d47e-4eb1-8c01-06361efa8720" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:31:21 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-f0f6758e-8faa-42ac-a224-1132fa0299f7 req-03555715-dadf-4e81-83d6-73f2540406b4 service nova] Acquired lock "refresh_cache-97cbb145-d47e-4eb1-8c01-06361efa8720" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:31:21 user nova-compute[85141]: DEBUG nova.network.neutron [req-f0f6758e-8faa-42ac-a224-1132fa0299f7 req-03555715-dadf-4e81-83d6-73f2540406b4 service nova] [instance: 97cbb145-d47e-4eb1-8c01-06361efa8720] Refreshing network info cache for port 440f9d6b-639a-4615-8b0c-e85b108f9734 {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 10:31:21 user nova-compute[85141]: DEBUG nova.compute.provider_tree [None req-bef83356-a9fe-4f25-8fb2-5d16702c5ff2 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Inventory has not changed in ProviderTree for provider: bf8e0fa1-16b6-408f-9203-c4cd63916272 {{(pid=85141) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 10:31:21 user nova-compute[85141]: DEBUG nova.scheduler.client.report [None req-bef83356-a9fe-4f25-8fb2-5d16702c5ff2 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Inventory has not changed for provider bf8e0fa1-16b6-408f-9203-c4cd63916272 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=85141) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 10:31:21 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-bef83356-a9fe-4f25-8fb2-5d16702c5ff2 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.464s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:31:21 user nova-compute[85141]: DEBUG nova.compute.manager [None req-bef83356-a9fe-4f25-8fb2-5d16702c5ff2 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] [instance: f432d8f9-10c4-49e3-bf3b-6389f52e21ab] Start building networks asynchronously for instance. {{(pid=85141) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 10:31:21 user nova-compute[85141]: DEBUG nova.compute.manager [None req-bef83356-a9fe-4f25-8fb2-5d16702c5ff2 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] [instance: f432d8f9-10c4-49e3-bf3b-6389f52e21ab] Allocating IP information in the background. {{(pid=85141) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 10:31:21 user nova-compute[85141]: DEBUG nova.network.neutron [None req-bef83356-a9fe-4f25-8fb2-5d16702c5ff2 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] [instance: f432d8f9-10c4-49e3-bf3b-6389f52e21ab] allocate_for_instance() {{(pid=85141) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 10:31:21 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-bef83356-a9fe-4f25-8fb2-5d16702c5ff2 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] [instance: f432d8f9-10c4-49e3-bf3b-6389f52e21ab] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 10:31:21 user nova-compute[85141]: DEBUG nova.compute.manager [None req-bef83356-a9fe-4f25-8fb2-5d16702c5ff2 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] [instance: f432d8f9-10c4-49e3-bf3b-6389f52e21ab] Start building block device mappings for instance. {{(pid=85141) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 10:31:22 user nova-compute[85141]: DEBUG nova.compute.manager [None req-bef83356-a9fe-4f25-8fb2-5d16702c5ff2 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] [instance: f432d8f9-10c4-49e3-bf3b-6389f52e21ab] Start spawning the instance on the hypervisor. {{(pid=85141) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 10:31:22 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-bef83356-a9fe-4f25-8fb2-5d16702c5ff2 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] [instance: f432d8f9-10c4-49e3-bf3b-6389f52e21ab] Creating instance directory {{(pid=85141) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 10:31:22 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-bef83356-a9fe-4f25-8fb2-5d16702c5ff2 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] [instance: f432d8f9-10c4-49e3-bf3b-6389f52e21ab] Creating image(s)
Nov 16 10:31:22 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-bef83356-a9fe-4f25-8fb2-5d16702c5ff2 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Acquiring lock "/opt/stack/data/nova/instances/f432d8f9-10c4-49e3-bf3b-6389f52e21ab/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:31:22 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-bef83356-a9fe-4f25-8fb2-5d16702c5ff2 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Lock "/opt/stack/data/nova/instances/f432d8f9-10c4-49e3-bf3b-6389f52e21ab/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:31:22 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-bef83356-a9fe-4f25-8fb2-5d16702c5ff2 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Lock "/opt/stack/data/nova/instances/f432d8f9-10c4-49e3-bf3b-6389f52e21ab/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:31:22 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-bef83356-a9fe-4f25-8fb2-5d16702c5ff2 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Acquiring lock "ec12e90ba9ae825f62708439675163a77f1f8d61" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:31:22 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-bef83356-a9fe-4f25-8fb2-5d16702c5ff2 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Lock "ec12e90ba9ae825f62708439675163a77f1f8d61" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:31:22 user nova-compute[85141]: DEBUG nova.policy [None req-bef83356-a9fe-4f25-8fb2-5d16702c5ff2 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ef2996a7b2b54ae38380743cf424dc18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fb187d45ec54e74a0721973235f98b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85141) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 10:31:23 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-bef83356-a9fe-4f25-8fb2-5d16702c5ff2 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ec12e90ba9ae825f62708439675163a77f1f8d61.part --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:31:23 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:31:23 user nova-compute[85141]: DEBUG nova.network.neutron [req-f0f6758e-8faa-42ac-a224-1132fa0299f7 req-03555715-dadf-4e81-83d6-73f2540406b4 service nova] [instance: 97cbb145-d47e-4eb1-8c01-06361efa8720] Updated VIF entry in instance network info cache for port 440f9d6b-639a-4615-8b0c-e85b108f9734. {{(pid=85141) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 10:31:23 user nova-compute[85141]: DEBUG nova.network.neutron [req-f0f6758e-8faa-42ac-a224-1132fa0299f7 req-03555715-dadf-4e81-83d6-73f2540406b4 service nova] [instance: 97cbb145-d47e-4eb1-8c01-06361efa8720] Updating instance_info_cache with network_info: [{"id": "440f9d6b-639a-4615-8b0c-e85b108f9734", "address": "fa:16:3e:dd:8c:7c", "network": {"id": "b8ada47f-9721-4358-ac4f-0305f06dbbb8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1663922860-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aec3bb9fe5e6446590900b5adf65df0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap440f9d6b-63", "ovs_interfaceid": "440f9d6b-639a-4615-8b0c-e85b108f9734", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:31:23 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-24f688f7-5344-420a-a420-b363d85eaaf0 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] Acquiring lock "7437a3a3-9b7f-489b-b20b-f1b877ebb253" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:31:23 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-24f688f7-5344-420a-a420-b363d85eaaf0 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] Lock "7437a3a3-9b7f-489b-b20b-f1b877ebb253" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:31:23 user nova-compute[85141]: DEBUG nova.objects.instance [None req-24f688f7-5344-420a-a420-b363d85eaaf0 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] Lazy-loading 'flavor' on Instance uuid 7437a3a3-9b7f-489b-b20b-f1b877ebb253 {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:31:23 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-f0f6758e-8faa-42ac-a224-1132fa0299f7 req-03555715-dadf-4e81-83d6-73f2540406b4 service nova] Releasing lock "refresh_cache-97cbb145-d47e-4eb1-8c01-06361efa8720" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:31:23 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:31:23 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-3aa56382-73b5-414f-9901-7977c7e59ffd tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Acquiring lock "97cbb145-d47e-4eb1-8c01-06361efa8720" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:31:23 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-3aa56382-73b5-414f-9901-7977c7e59ffd tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Lock "97cbb145-d47e-4eb1-8c01-06361efa8720" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:31:23 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-3aa56382-73b5-414f-9901-7977c7e59ffd tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Acquiring lock "97cbb145-d47e-4eb1-8c01-06361efa8720-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:31:23 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-3aa56382-73b5-414f-9901-7977c7e59ffd tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Lock "97cbb145-d47e-4eb1-8c01-06361efa8720-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:31:23 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-3aa56382-73b5-414f-9901-7977c7e59ffd tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Lock "97cbb145-d47e-4eb1-8c01-06361efa8720-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:31:23 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-24f688f7-5344-420a-a420-b363d85eaaf0 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] Lock "7437a3a3-9b7f-489b-b20b-f1b877ebb253" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.212s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:31:23 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-bef83356-a9fe-4f25-8fb2-5d16702c5ff2 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ec12e90ba9ae825f62708439675163a77f1f8d61.part --force-share --output=json" returned: 0 in 0.297s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:31:23 user nova-compute[85141]: INFO nova.compute.manager [None req-3aa56382-73b5-414f-9901-7977c7e59ffd tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: 97cbb145-d47e-4eb1-8c01-06361efa8720] Terminating instance
Nov 16 10:31:23 user nova-compute[85141]: DEBUG nova.virt.images [None req-bef83356-a9fe-4f25-8fb2-5d16702c5ff2 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] 94642f60-38cf-40f1-8b96-e14a357ee931 was qcow2, converting to raw {{(pid=85141) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 16 10:31:23 user nova-compute[85141]: DEBUG nova.privsep.utils [None req-bef83356-a9fe-4f25-8fb2-5d16702c5ff2 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=85141) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 16 10:31:23 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-bef83356-a9fe-4f25-8fb2-5d16702c5ff2 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ec12e90ba9ae825f62708439675163a77f1f8d61.part /opt/stack/data/nova/instances/_base/ec12e90ba9ae825f62708439675163a77f1f8d61.converted {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:31:23 user nova-compute[85141]: DEBUG nova.compute.manager [None req-3aa56382-73b5-414f-9901-7977c7e59ffd tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: 97cbb145-d47e-4eb1-8c01-06361efa8720] Start destroying the instance on the hypervisor. {{(pid=85141) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 10:31:23 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:31:23 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:31:23 user nova-compute[85141]: DEBUG nova.network.neutron [req-6173dfb3-ab3c-40a8-a05a-2495e1505410 req-8175585d-2b2d-4d22-aea5-f27f37e404c2 service nova] [instance: 7437a3a3-9b7f-489b-b20b-f1b877ebb253] Updated VIF entry in instance network info cache for port 7ba5e576-d9a3-44c7-a741-a9d1e510d7bf. {{(pid=85141) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 10:31:23 user nova-compute[85141]: DEBUG nova.network.neutron [req-6173dfb3-ab3c-40a8-a05a-2495e1505410 req-8175585d-2b2d-4d22-aea5-f27f37e404c2 service nova] [instance: 7437a3a3-9b7f-489b-b20b-f1b877ebb253] Updating instance_info_cache with network_info: [{"id": "7ba5e576-d9a3-44c7-a741-a9d1e510d7bf", "address": "fa:16:3e:7e:27:4c", "network": {"id": "c0ffc241-9899-4b62-b6bd-91034f92f286", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1997979107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f8eed15973c44ceb150fe51b6e55382", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ba5e576-d9", "ovs_interfaceid": "7ba5e576-d9a3-44c7-a741-a9d1e510d7bf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:31:23 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-6173dfb3-ab3c-40a8-a05a-2495e1505410 req-8175585d-2b2d-4d22-aea5-f27f37e404c2 service nova] Releasing lock "refresh_cache-7437a3a3-9b7f-489b-b20b-f1b877ebb253" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:31:23 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-bef83356-a9fe-4f25-8fb2-5d16702c5ff2 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ec12e90ba9ae825f62708439675163a77f1f8d61.part /opt/stack/data/nova/instances/_base/ec12e90ba9ae825f62708439675163a77f1f8d61.converted" returned: 0 in 0.382s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:31:23 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-bef83356-a9fe-4f25-8fb2-5d16702c5ff2 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ec12e90ba9ae825f62708439675163a77f1f8d61.converted --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:31:23 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-24f688f7-5344-420a-a420-b363d85eaaf0 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] Acquiring lock "7437a3a3-9b7f-489b-b20b-f1b877ebb253" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:31:23 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-24f688f7-5344-420a-a420-b363d85eaaf0 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] Lock "7437a3a3-9b7f-489b-b20b-f1b877ebb253" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.004s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:31:23 user nova-compute[85141]: INFO nova.compute.manager [None req-24f688f7-5344-420a-a420-b363d85eaaf0 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] [instance: 7437a3a3-9b7f-489b-b20b-f1b877ebb253] Attaching volume ebf4cfdf-97a5-4901-b8e0-df0704384909 to /dev/vdb
Nov 16 10:31:23 user nova-compute[85141]: DEBUG nova.compute.manager [req-03c0e603-4aa4-4488-95b8-889259a3ae11 req-2833af90-a378-4f4c-9c7d-6dd54c898bfa service nova] [instance: 97cbb145-d47e-4eb1-8c01-06361efa8720] Received event network-vif-unplugged-440f9d6b-639a-4615-8b0c-e85b108f9734 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:31:23 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-03c0e603-4aa4-4488-95b8-889259a3ae11 req-2833af90-a378-4f4c-9c7d-6dd54c898bfa service nova] Acquiring lock "97cbb145-d47e-4eb1-8c01-06361efa8720-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:31:23 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-03c0e603-4aa4-4488-95b8-889259a3ae11 req-2833af90-a378-4f4c-9c7d-6dd54c898bfa service nova] Lock "97cbb145-d47e-4eb1-8c01-06361efa8720-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:31:23 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-03c0e603-4aa4-4488-95b8-889259a3ae11 req-2833af90-a378-4f4c-9c7d-6dd54c898bfa service nova] Lock "97cbb145-d47e-4eb1-8c01-06361efa8720-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:31:23 user nova-compute[85141]: DEBUG nova.compute.manager [req-03c0e603-4aa4-4488-95b8-889259a3ae11 req-2833af90-a378-4f4c-9c7d-6dd54c898bfa service nova] [instance: 97cbb145-d47e-4eb1-8c01-06361efa8720] No waiting events found dispatching network-vif-unplugged-440f9d6b-639a-4615-8b0c-e85b108f9734 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:31:23 user nova-compute[85141]: DEBUG nova.compute.manager [req-03c0e603-4aa4-4488-95b8-889259a3ae11 req-2833af90-a378-4f4c-9c7d-6dd54c898bfa service nova] [instance: 97cbb145-d47e-4eb1-8c01-06361efa8720] Received event network-vif-unplugged-440f9d6b-639a-4615-8b0c-e85b108f9734 for instance with task_state deleting. {{(pid=85141) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 10:31:23 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:31:23 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:31:24 user nova-compute[85141]: DEBUG os_brick.utils [None req-24f688f7-5344-420a-a420-b363d85eaaf0 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 10:31:24 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:31:24 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:31:24 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[dca02c99-ae84-4d97-9990-7b4f4b424129]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c7834de5c295\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:31:24 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:31:24 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.024s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:31:24 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[9da673b1-a91e-40e8-a5ef-aaa7187a1e4a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:31:24 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:31:24 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-bef83356-a9fe-4f25-8fb2-5d16702c5ff2 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ec12e90ba9ae825f62708439675163a77f1f8d61.converted --force-share --output=json" returned: 0 in 0.211s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:31:24 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-bef83356-a9fe-4f25-8fb2-5d16702c5ff2 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Lock "ec12e90ba9ae825f62708439675163a77f1f8d61" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.005s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:31:24 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:31:24 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb6715a5-397b-4f25-ab23-14a7cfe69fff]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:31:24 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-bef83356-a9fe-4f25-8fb2-5d16702c5ff2 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ec12e90ba9ae825f62708439675163a77f1f8d61 --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:31:24 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[8693ad4a-a550-421d-a6a3-e48ee67fd050]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:31:24 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-24f688f7-5344-420a-a420-b363d85eaaf0 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] Running cmd (subprocess): nvme version {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:31:24 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-24f688f7-5344-420a-a420-b363d85eaaf0 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] 'nvme version' failed. Not Retrying. {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 10:31:24 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.nvmeof [None req-24f688f7-5344-420a-a420-b363d85eaaf0 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] nvme not present on system {{(pid=85141) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 10:31:24 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:31:24 user nova-compute[85141]: DEBUG nova.network.neutron [None req-bef83356-a9fe-4f25-8fb2-5d16702c5ff2 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] [instance: f432d8f9-10c4-49e3-bf3b-6389f52e21ab] Successfully created port: e8cc6756-287d-4451-9119-7ca5779ca62c {{(pid=85141) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 10:31:24 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 10:31:24 user nova-compute[85141]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 10:31:24 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[01f73b8e-30f5-4d5d-8ad1-9bffe923d8aa]: (4, '') {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:31:24 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.lightos [None req-24f688f7-5344-420a-a420-b363d85eaaf0 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=85141) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 10:31:24 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.lightos [None req-24f688f7-5344-420a-a420-b363d85eaaf0 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=85141) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 10:31:24 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.lightos [None req-24f688f7-5344-420a-a420-b363d85eaaf0 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] LIGHTOS: no hostnqn found. {{(pid=85141) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 10:31:24 user nova-compute[85141]: DEBUG os_brick.utils [None req-24f688f7-5344-420a-a420-b363d85eaaf0 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] <== get_connector_properties: return (207ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c7834de5c295', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 10:31:24 user nova-compute[85141]: DEBUG nova.virt.block_device [None req-24f688f7-5344-420a-a420-b363d85eaaf0 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] [instance: 7437a3a3-9b7f-489b-b20b-f1b877ebb253] Updating existing volume attachment record: b9178c61-f43b-469f-befb-a7072392620f {{(pid=85141) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 10:31:24 user nova-compute[85141]: INFO nova.virt.libvirt.driver [-] [instance: 97cbb145-d47e-4eb1-8c01-06361efa8720] Instance destroyed successfully.
Nov 16 10:31:24 user nova-compute[85141]: DEBUG nova.objects.instance [None req-3aa56382-73b5-414f-9901-7977c7e59ffd tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Lazy-loading 'resources' on Instance uuid 97cbb145-d47e-4eb1-8c01-06361efa8720 {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:31:24 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-3aa56382-73b5-414f-9901-7977c7e59ffd tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T10:29:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-140608141',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-140608141',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-140608141',id=41,image_ref='05b3847f-6c57-4cd1-866c-4094a2603dcb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLWYpzou5qteDfpKjtLLBgnYXRlKBsUNYhK1xOldWyafK/a5K6wabtXFqbCOnvqPrKAwfaDJluhdqceCb7ORjv86e/EObTiPvk0xd6whyFbPAOlW8r2Nx+e3cy0isLTL2w==',key_name='tempest-keypair-1096079584',keypairs=<?>,launch_index=0,launched_at=2023-11-16T10:29:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='aec3bb9fe5e6446590900b5adf65df0f',ramdisk_id='',reservation_id='r-a5nypv1s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1979039357',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1979039357-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-1979039357',owner_user_name='tempest-TestVolumeBootPattern-1979039357-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T10:29:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7261b57c36904fcda87a9ea32d4b5b31',uuid=97cbb145-d47e-4eb1-8c01-06361efa8720,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "440f9d6b-639a-4615-8b0c-e85b108f9734", "address": "fa:16:3e:dd:8c:7c", "network": {"id": "b8ada47f-9721-4358-ac4f-0305f06dbbb8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1663922860-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aec3bb9fe5e6446590900b5adf65df0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap440f9d6b-63", "ovs_interfaceid": "440f9d6b-639a-4615-8b0c-e85b108f9734", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 10:31:24 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-3aa56382-73b5-414f-9901-7977c7e59ffd tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Converting VIF {"id": "440f9d6b-639a-4615-8b0c-e85b108f9734", "address": "fa:16:3e:dd:8c:7c", "network": {"id": "b8ada47f-9721-4358-ac4f-0305f06dbbb8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1663922860-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aec3bb9fe5e6446590900b5adf65df0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap440f9d6b-63", "ovs_interfaceid": "440f9d6b-639a-4615-8b0c-e85b108f9734", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:31:24 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-3aa56382-73b5-414f-9901-7977c7e59ffd tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:8c:7c,bridge_name='br-int',has_traffic_filtering=True,id=440f9d6b-639a-4615-8b0c-e85b108f9734,network=Network(b8ada47f-9721-4358-ac4f-0305f06dbbb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap440f9d6b-63') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:31:24 user nova-compute[85141]: DEBUG os_vif [None req-3aa56382-73b5-414f-9901-7977c7e59ffd tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:8c:7c,bridge_name='br-int',has_traffic_filtering=True,id=440f9d6b-639a-4615-8b0c-e85b108f9734,network=Network(b8ada47f-9721-4358-ac4f-0305f06dbbb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap440f9d6b-63') {{(pid=85141) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 10:31:24 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-bef83356-a9fe-4f25-8fb2-5d16702c5ff2 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ec12e90ba9ae825f62708439675163a77f1f8d61 --force-share --output=json" returned: 0 in 0.201s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:31:24 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:31:24 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap440f9d6b-63, bridge=br-int, if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:31:24 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-bef83356-a9fe-4f25-8fb2-5d16702c5ff2 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Acquiring lock "ec12e90ba9ae825f62708439675163a77f1f8d61" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:31:24 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-bef83356-a9fe-4f25-8fb2-5d16702c5ff2 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Lock "ec12e90ba9ae825f62708439675163a77f1f8d61" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.006s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:31:24 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-bef83356-a9fe-4f25-8fb2-5d16702c5ff2 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ec12e90ba9ae825f62708439675163a77f1f8d61 --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:31:24 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:31:24 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:31:24 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:31:24 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f0f2393c-0dff-4dda-bd6b-75677082d45f) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:31:24 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:31:24 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:31:24 user nova-compute[85141]: INFO os_vif [None req-3aa56382-73b5-414f-9901-7977c7e59ffd tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:8c:7c,bridge_name='br-int',has_traffic_filtering=True,id=440f9d6b-639a-4615-8b0c-e85b108f9734,network=Network(b8ada47f-9721-4358-ac4f-0305f06dbbb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap440f9d6b-63')
Nov 16 10:31:24 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3aa56382-73b5-414f-9901-7977c7e59ffd tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: 97cbb145-d47e-4eb1-8c01-06361efa8720] calling os-brick to detach iSCSI Volume {{(pid=85141) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 10:31:24 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-3aa56382-73b5-414f-9901-7977c7e59ffd tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51806b6080>, {'target_iqn': 'iqn.2010-10.org.openstack:925fd9db-7153-4861-bbc3-9cbb8822e196', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GCObvuko', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 10:31:24 user nova-compute[85141]: WARNING os_brick.initiator.connectors.base [None req-3aa56382-73b5-414f-9901-7977c7e59ffd tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 10:31:24 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-3aa56382-73b5-414f-9901-7977c7e59ffd tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 10:31:24 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-3aa56382-73b5-414f-9901-7977c7e59ffd tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 10:31:24 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:31:24 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:31:24 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[e018ac18-1010-47b7-a7f9-5945e7fb450a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e0c5c19d-363b-4f5d-a04f-fb7de64423f2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:925fd9db-7153-4861-bbc3-9cbb8822e196\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:68965271-48ea-40f4-870f-2c9c54c02a7f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2006a77c-e5e8-4ec5-8de5-a0f9505c429a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:31:24 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-3aa56382-73b5-414f-9901-7977c7e59ffd tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 10:31:24 user nova-compute[85141]: No targets found.
Nov 16 10:31:24 user nova-compute[85141]: iSNS:
Nov 16 10:31:24 user nova-compute[85141]: No targets found.
Nov 16 10:31:24 user nova-compute[85141]: STATIC:
Nov 16 10:31:24 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:e0c5c19d-363b-4f5d-a04f-fb7de64423f2
Nov 16 10:31:24 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:31:24 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:31:24 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:925fd9db-7153-4861-bbc3-9cbb8822e196
Nov 16 10:31:24 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:31:24 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:31:24 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:68965271-48ea-40f4-870f-2c9c54c02a7f
Nov 16 10:31:24 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:31:24 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:31:24 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:2006a77c-e5e8-4ec5-8de5-a0f9505c429a
Nov 16 10:31:24 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:31:24 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:31:24 user nova-compute[85141]: FIRMWARE:
Nov 16 10:31:24 user nova-compute[85141]: No targets found.
Nov 16 10:31:24 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:31:24 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-3aa56382-73b5-414f-9901-7977c7e59ffd tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 10:31:24 user nova-compute[85141]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 10:31:24 user nova-compute[85141]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=85141) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 10:31:24 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-3aa56382-73b5-414f-9901-7977c7e59ffd tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:925fd9db-7153-4861-bbc3-9cbb8822e196', 0)] {{(pid=85141) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 10:31:24 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:31:24 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:31:24 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e950c16-c313-4e7e-8ef8-2327e246f5cc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2006a77c-e5e8-4ec5-8de5-a0f9505c429a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:68965271-48ea-40f4-870f-2c9c54c02a7f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:925fd9db-7153-4861-bbc3-9cbb8822e196\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e0c5c19d-363b-4f5d-a04f-fb7de64423f2\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:31:24 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:31:24 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:31:24 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3bd5f3a-88fc-41e4-b2ca-41118593d337]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2006a77c-e5e8-4ec5-8de5-a0f9505c429a (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0c5c19d-363b-4f5d-a04f-fb7de64423f2 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:925fd9db-7153-4861-bbc3-9cbb8822e196 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68965271-48ea-40f4-870f-2c9c54c02a7f (non-flash)\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:31:24 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-3aa56382-73b5-414f-9901-7977c7e59ffd tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2006a77c-e5e8-4ec5-8de5-a0f9505c429a (non-flash)
Nov 16 10:31:24 user nova-compute[85141]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0c5c19d-363b-4f5d-a04f-fb7de64423f2 (non-flash)
Nov 16 10:31:24 user nova-compute[85141]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:925fd9db-7153-4861-bbc3-9cbb8822e196 (non-flash)
Nov 16 10:31:24 user nova-compute[85141]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68965271-48ea-40f4-870f-2c9c54c02a7f (non-flash)
Nov 16 10:31:24 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:31:24 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-3aa56382-73b5-414f-9901-7977c7e59ffd tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2006a77c-e5e8-4ec5-8de5-a0f9505c429a (non-flash)
Nov 16 10:31:24 user nova-compute[85141]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0c5c19d-363b-4f5d-a04f-fb7de64423f2 (non-flash)
Nov 16 10:31:24 user nova-compute[85141]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:925fd9db-7153-4861-bbc3-9cbb8822e196 (non-flash)
Nov 16 10:31:24 user nova-compute[85141]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68965271-48ea-40f4-870f-2c9c54c02a7f (non-flash)
Nov 16 10:31:24 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 10:31:24 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-3aa56382-73b5-414f-9901-7977c7e59ffd tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5160659fc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:925fd9db-7153-4861-bbc3-9cbb8822e196'): ({'sdd'}, set())}) {{(pid=85141) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 10:31:24 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-3aa56382-73b5-414f-9901-7977c7e59ffd tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Removing single pathed devices sdd {{(pid=85141) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 10:31:24 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:31:24 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.028s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:31:24 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[0951eb55-9012-4baf-894e-ce84cfcec4b1]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:31:24 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:31:24 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-bef83356-a9fe-4f25-8fb2-5d16702c5ff2 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ec12e90ba9ae825f62708439675163a77f1f8d61 --force-share --output=json" returned: 0 in 0.223s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:31:24 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-bef83356-a9fe-4f25-8fb2-5d16702c5ff2 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ec12e90ba9ae825f62708439675163a77f1f8d61,backing_fmt=raw /opt/stack/data/nova/instances/f432d8f9-10c4-49e3-bf3b-6389f52e21ab/disk 1073741824 {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:31:24 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:31:24 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[34d77a65-4933-4fa3-8203-a0fb7d06c534]: (4, ('ok\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:31:24 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-3aa56382-73b5-414f-9901-7977c7e59ffd tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Flushing IO for device /dev/sdd {{(pid=85141) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 10:31:24 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:31:24 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-bef83356-a9fe-4f25-8fb2-5d16702c5ff2 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ec12e90ba9ae825f62708439675163a77f1f8d61,backing_fmt=raw /opt/stack/data/nova/instances/f432d8f9-10c4-49e3-bf3b-6389f52e21ab/disk 1073741824" returned: 0 in 0.064s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:31:24 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-bef83356-a9fe-4f25-8fb2-5d16702c5ff2 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Lock "ec12e90ba9ae825f62708439675163a77f1f8d61" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.290s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:31:24 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-bef83356-a9fe-4f25-8fb2-5d16702c5ff2 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ec12e90ba9ae825f62708439675163a77f1f8d61 --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:31:24 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.026s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:31:24 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[46089db8-e206-4743-9c55-9f95f5d57114]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:31:24 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-3aa56382-73b5-414f-9901-7977c7e59ffd tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=85141) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 10:31:24 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:31:24 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.052s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:31:24 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[25a3f9b4-70ce-444a-ac84-164142b841f2]: (4, ('1', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:31:24 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-3aa56382-73b5-414f-9901-7977c7e59ffd tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=85141) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 10:31:24 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-3aa56382-73b5-414f-9901-7977c7e59ffd tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] SCSI volumes sdd have been removed. {{(pid=85141) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 10:31:24 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-3aa56382-73b5-414f-9901-7977c7e59ffd tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:925fd9db-7153-4861-bbc3-9cbb8822e196')] {{(pid=85141) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 10:31:24 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:925fd9db-7153-4861-bbc3-9cbb8822e196 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:31:24 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:925fd9db-7153-4861-bbc3-9cbb8822e196 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.076s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:31:24 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdfdecb5-6fff-4738-aaca-fad2bce54cba]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:31:24 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-3aa56382-73b5-414f-9901-7977c7e59ffd tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:31:24 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:925fd9db-7153-4861-bbc3-9cbb8822e196 -p 172.16.0.220:3260 --logout {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:31:24 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-bef83356-a9fe-4f25-8fb2-5d16702c5ff2 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ec12e90ba9ae825f62708439675163a77f1f8d61 --force-share --output=json" returned: 0 in 0.198s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:31:24 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-bef83356-a9fe-4f25-8fb2-5d16702c5ff2 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] [instance: f432d8f9-10c4-49e3-bf3b-6389f52e21ab] Created local disks {{(pid=85141) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 10:31:24 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-bef83356-a9fe-4f25-8fb2-5d16702c5ff2 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] [instance: f432d8f9-10c4-49e3-bf3b-6389f52e21ab] Ensure instance console log exists: /opt/stack/data/nova/instances/f432d8f9-10c4-49e3-bf3b-6389f52e21ab/console.log {{(pid=85141) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 10:31:24 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-bef83356-a9fe-4f25-8fb2-5d16702c5ff2 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:31:24 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-bef83356-a9fe-4f25-8fb2-5d16702c5ff2 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:31:24 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-bef83356-a9fe-4f25-8fb2-5d16702c5ff2 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:31:24 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:925fd9db-7153-4861-bbc3-9cbb8822e196 -p 172.16.0.220:3260 --logout" returned: 0 in 0.080s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:31:24 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[29996886-c5a1-420b-aaaf-b587ba5e67a7]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:925fd9db-7153-4861-bbc3-9cbb8822e196, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:925fd9db-7153-4861-bbc3-9cbb8822e196, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:31:24 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-3aa56382-73b5-414f-9901-7977c7e59ffd tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:925fd9db-7153-4861-bbc3-9cbb8822e196, portal: 172.16.0.220,3260]
Nov 16 10:31:24 user nova-compute[85141]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:925fd9db-7153-4861-bbc3-9cbb8822e196, portal: 172.16.0.220,3260] successful.
Nov 16 10:31:24 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:31:24 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:925fd9db-7153-4861-bbc3-9cbb8822e196 -p 172.16.0.220:3260 --op delete {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:31:24 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:925fd9db-7153-4861-bbc3-9cbb8822e196 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:31:24 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c4b2aa4-e2bc-434e-9c62-299ae077ce25]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:31:24 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-3aa56382-73b5-414f-9901-7977c7e59ffd tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:31:24 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-3aa56382-73b5-414f-9901-7977c7e59ffd tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.516s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 10:31:24 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-3aa56382-73b5-414f-9901-7977c7e59ffd tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] <== disconnect_volume: return (519ms) None {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 10:31:24 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3aa56382-73b5-414f-9901-7977c7e59ffd tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: 97cbb145-d47e-4eb1-8c01-06361efa8720] Disconnected iSCSI Volume {{(pid=85141) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 10:31:24 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-3aa56382-73b5-414f-9901-7977c7e59ffd tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: 97cbb145-d47e-4eb1-8c01-06361efa8720] Deleting instance files /opt/stack/data/nova/instances/97cbb145-d47e-4eb1-8c01-06361efa8720_del
Nov 16 10:31:24 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-3aa56382-73b5-414f-9901-7977c7e59ffd tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: 97cbb145-d47e-4eb1-8c01-06361efa8720] Deletion of /opt/stack/data/nova/instances/97cbb145-d47e-4eb1-8c01-06361efa8720_del complete
Nov 16 10:31:24 user nova-compute[85141]: INFO nova.compute.manager [None req-3aa56382-73b5-414f-9901-7977c7e59ffd tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: 97cbb145-d47e-4eb1-8c01-06361efa8720] Took 1.48 seconds to destroy the instance on the hypervisor.
Nov 16 10:31:24 user nova-compute[85141]: DEBUG oslo.service.loopingcall [None req-3aa56382-73b5-414f-9901-7977c7e59ffd tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=85141) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 10:31:24 user nova-compute[85141]: DEBUG nova.compute.manager [-] [instance: 97cbb145-d47e-4eb1-8c01-06361efa8720] Deallocating network for instance {{(pid=85141) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 10:31:24 user nova-compute[85141]: DEBUG nova.network.neutron [-] [instance: 97cbb145-d47e-4eb1-8c01-06361efa8720] deallocate_for_instance() {{(pid=85141) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 10:31:25 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-557ca829-84ad-40c9-83f0-7ed39bbb6e06 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 89e358d7-0844-4742-853b-ff88800415d2 is timed out.
Nov 16 10:31:25 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-557ca829-84ad-40c9-83f0-7ed39bbb6e06 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Successfully detached device vdc from instance 89e358d7-0844-4742-853b-ff88800415d2 from the live domain config.
Nov 16 10:31:25 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-557ca829-84ad-40c9-83f0-7ed39bbb6e06 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] [instance: 89e358d7-0844-4742-853b-ff88800415d2] calling os-brick to detach iSCSI Volume {{(pid=85141) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 10:31:25 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-557ca829-84ad-40c9-83f0-7ed39bbb6e06 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51806b6080>, {'target_iqn': 'iqn.2010-10.org.openstack:68965271-48ea-40f4-870f-2c9c54c02a7f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ixcPLZRD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 10:31:25 user nova-compute[85141]: WARNING os_brick.initiator.connectors.base [None req-557ca829-84ad-40c9-83f0-7ed39bbb6e06 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 10:31:25 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-557ca829-84ad-40c9-83f0-7ed39bbb6e06 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 10:31:25 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-557ca829-84ad-40c9-83f0-7ed39bbb6e06 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 10:31:25 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:31:25 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:31:25 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[21d5d1ef-78b2-43af-ace3-ee1992a1cc74]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e0c5c19d-363b-4f5d-a04f-fb7de64423f2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:68965271-48ea-40f4-870f-2c9c54c02a7f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2006a77c-e5e8-4ec5-8de5-a0f9505c429a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:31:25 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-557ca829-84ad-40c9-83f0-7ed39bbb6e06 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 10:31:25 user nova-compute[85141]: No targets found.
Nov 16 10:31:25 user nova-compute[85141]: iSNS:
Nov 16 10:31:25 user nova-compute[85141]: No targets found.
Nov 16 10:31:25 user nova-compute[85141]: STATIC:
Nov 16 10:31:25 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:e0c5c19d-363b-4f5d-a04f-fb7de64423f2
Nov 16 10:31:25 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:31:25 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:31:25 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:68965271-48ea-40f4-870f-2c9c54c02a7f
Nov 16 10:31:25 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:31:25 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:31:25 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:2006a77c-e5e8-4ec5-8de5-a0f9505c429a
Nov 16 10:31:25 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:31:25 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:31:25 user nova-compute[85141]: FIRMWARE:
Nov 16 10:31:25 user nova-compute[85141]: No targets found.
Nov 16 10:31:25 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:31:25 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-557ca829-84ad-40c9-83f0-7ed39bbb6e06 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 10:31:25 user nova-compute[85141]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 10:31:25 user nova-compute[85141]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=85141) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 10:31:25 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-557ca829-84ad-40c9-83f0-7ed39bbb6e06 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:68965271-48ea-40f4-870f-2c9c54c02a7f', 0)] {{(pid=85141) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 10:31:25 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:31:25 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:31:25 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a8b83da-d12c-4465-a209-6262e5212e50]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2006a77c-e5e8-4ec5-8de5-a0f9505c429a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:68965271-48ea-40f4-870f-2c9c54c02a7f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e0c5c19d-363b-4f5d-a04f-fb7de64423f2\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:31:25 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:31:25 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:31:25 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[f57f8fe9-63f1-4492-8fa7-7bc112baa575]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2006a77c-e5e8-4ec5-8de5-a0f9505c429a (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0c5c19d-363b-4f5d-a04f-fb7de64423f2 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68965271-48ea-40f4-870f-2c9c54c02a7f (non-flash)\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:31:25 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-557ca829-84ad-40c9-83f0-7ed39bbb6e06 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2006a77c-e5e8-4ec5-8de5-a0f9505c429a (non-flash)
Nov 16 10:31:25 user nova-compute[85141]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0c5c19d-363b-4f5d-a04f-fb7de64423f2 (non-flash)
Nov 16 10:31:25 user nova-compute[85141]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68965271-48ea-40f4-870f-2c9c54c02a7f (non-flash)
Nov 16 10:31:25 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:31:25 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-557ca829-84ad-40c9-83f0-7ed39bbb6e06 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2006a77c-e5e8-4ec5-8de5-a0f9505c429a (non-flash)
Nov 16 10:31:25 user nova-compute[85141]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0c5c19d-363b-4f5d-a04f-fb7de64423f2 (non-flash)
Nov 16 10:31:25 user nova-compute[85141]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68965271-48ea-40f4-870f-2c9c54c02a7f (non-flash)
Nov 16 10:31:25 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 10:31:25 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-557ca829-84ad-40c9-83f0-7ed39bbb6e06 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f51982a65f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:68965271-48ea-40f4-870f-2c9c54c02a7f'): ({'sdg'}, set())}) {{(pid=85141) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 10:31:25 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-557ca829-84ad-40c9-83f0-7ed39bbb6e06 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Removing single pathed devices sdg {{(pid=85141) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 10:31:25 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:31:25 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:31:25 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[2beb0075-2646-4f44-8938-54dd4b3651da]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:31:25 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:31:25 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.020s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:31:25 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[55c67f05-b910-4975-9018-c2341cf45cad]: (4, ('ok\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:31:25 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-557ca829-84ad-40c9-83f0-7ed39bbb6e06 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Flushing IO for device /dev/sdg {{(pid=85141) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 10:31:25 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:31:25 user nova-compute[85141]: DEBUG nova.network.neutron [None req-bef83356-a9fe-4f25-8fb2-5d16702c5ff2 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] [instance: f432d8f9-10c4-49e3-bf3b-6389f52e21ab] Successfully updated port: e8cc6756-287d-4451-9119-7ca5779ca62c {{(pid=85141) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 10:31:25 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.019s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:31:25 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[b044820f-0055-4ffe-b901-dd4abe963db3]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:31:25 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-557ca829-84ad-40c9-83f0-7ed39bbb6e06 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=85141) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 10:31:25 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:31:25 user nova-compute[85141]: DEBUG nova.compute.manager [req-935ab9ae-2dc3-456a-803a-bbfd24b7756e req-f9fcf20b-3d74-45f2-9dfa-7c9762bbe0df service nova] [instance: f432d8f9-10c4-49e3-bf3b-6389f52e21ab] Received event network-changed-e8cc6756-287d-4451-9119-7ca5779ca62c {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:31:25 user nova-compute[85141]: DEBUG nova.compute.manager [req-935ab9ae-2dc3-456a-803a-bbfd24b7756e req-f9fcf20b-3d74-45f2-9dfa-7c9762bbe0df service nova] [instance: f432d8f9-10c4-49e3-bf3b-6389f52e21ab] Refreshing instance network info cache due to event network-changed-e8cc6756-287d-4451-9119-7ca5779ca62c. {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 10:31:25 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-935ab9ae-2dc3-456a-803a-bbfd24b7756e req-f9fcf20b-3d74-45f2-9dfa-7c9762bbe0df service nova] Acquiring lock "refresh_cache-f432d8f9-10c4-49e3-bf3b-6389f52e21ab" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:31:25 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-935ab9ae-2dc3-456a-803a-bbfd24b7756e req-f9fcf20b-3d74-45f2-9dfa-7c9762bbe0df service nova] Acquired lock "refresh_cache-f432d8f9-10c4-49e3-bf3b-6389f52e21ab" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:31:25 user nova-compute[85141]: DEBUG nova.network.neutron [req-935ab9ae-2dc3-456a-803a-bbfd24b7756e req-f9fcf20b-3d74-45f2-9dfa-7c9762bbe0df service nova] [instance: f432d8f9-10c4-49e3-bf3b-6389f52e21ab] Refreshing network info cache for port e8cc6756-287d-4451-9119-7ca5779ca62c {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 10:31:25 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-bef83356-a9fe-4f25-8fb2-5d16702c5ff2 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Acquiring lock "refresh_cache-f432d8f9-10c4-49e3-bf3b-6389f52e21ab" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:31:25 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.072s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:31:25 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7bb0900-7b04-4b17-b12a-f57e20382bf9]: (4, ('1', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:31:25 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-557ca829-84ad-40c9-83f0-7ed39bbb6e06 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=85141) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 10:31:25 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-557ca829-84ad-40c9-83f0-7ed39bbb6e06 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] SCSI volumes sdg have been removed. {{(pid=85141) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 10:31:25 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-557ca829-84ad-40c9-83f0-7ed39bbb6e06 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:68965271-48ea-40f4-870f-2c9c54c02a7f')] {{(pid=85141) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 10:31:25 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68965271-48ea-40f4-870f-2c9c54c02a7f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:31:25 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68965271-48ea-40f4-870f-2c9c54c02a7f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:31:25 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[c858996f-6457-4580-9da6-39fe7a29708f]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:31:25 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-557ca829-84ad-40c9-83f0-7ed39bbb6e06 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:31:25 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68965271-48ea-40f4-870f-2c9c54c02a7f -p 172.16.0.220:3260 --logout {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:31:25 user nova-compute[85141]: DEBUG nova.network.neutron [req-935ab9ae-2dc3-456a-803a-bbfd24b7756e req-f9fcf20b-3d74-45f2-9dfa-7c9762bbe0df service nova] [instance: f432d8f9-10c4-49e3-bf3b-6389f52e21ab] Instance cache missing network info. {{(pid=85141) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 10:31:25 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68965271-48ea-40f4-870f-2c9c54c02a7f -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:31:25 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ecf8278-d0f5-4329-bb08-26267875281c]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:68965271-48ea-40f4-870f-2c9c54c02a7f, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:68965271-48ea-40f4-870f-2c9c54c02a7f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:31:25 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-557ca829-84ad-40c9-83f0-7ed39bbb6e06 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:68965271-48ea-40f4-870f-2c9c54c02a7f, portal: 172.16.0.220,3260]
Nov 16 10:31:25 user nova-compute[85141]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:68965271-48ea-40f4-870f-2c9c54c02a7f, portal: 172.16.0.220,3260] successful.
Nov 16 10:31:25 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:31:25 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68965271-48ea-40f4-870f-2c9c54c02a7f -p 172.16.0.220:3260 --op delete {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:31:25 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68965271-48ea-40f4-870f-2c9c54c02a7f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:31:25 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[3695390f-f4c9-4ffe-8a6b-212ff44323e6]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:31:25 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-557ca829-84ad-40c9-83f0-7ed39bbb6e06 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:31:25 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-557ca829-84ad-40c9-83f0-7ed39bbb6e06 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.346s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 10:31:25 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-557ca829-84ad-40c9-83f0-7ed39bbb6e06 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] <== disconnect_volume: return (347ms) None {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 10:31:25 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-557ca829-84ad-40c9-83f0-7ed39bbb6e06 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] [instance: 89e358d7-0844-4742-853b-ff88800415d2] Disconnected iSCSI Volume {{(pid=85141) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 10:31:25 user nova-compute[85141]: DEBUG nova.network.neutron [req-935ab9ae-2dc3-456a-803a-bbfd24b7756e req-f9fcf20b-3d74-45f2-9dfa-7c9762bbe0df service nova] [instance: f432d8f9-10c4-49e3-bf3b-6389f52e21ab] Updating instance_info_cache with network_info: [] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:31:25 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-935ab9ae-2dc3-456a-803a-bbfd24b7756e req-f9fcf20b-3d74-45f2-9dfa-7c9762bbe0df service nova] Releasing lock "refresh_cache-f432d8f9-10c4-49e3-bf3b-6389f52e21ab" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:31:25 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-bef83356-a9fe-4f25-8fb2-5d16702c5ff2 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Acquired lock "refresh_cache-f432d8f9-10c4-49e3-bf3b-6389f52e21ab" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:31:25 user nova-compute[85141]: DEBUG nova.network.neutron [None req-bef83356-a9fe-4f25-8fb2-5d16702c5ff2 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] [instance: f432d8f9-10c4-49e3-bf3b-6389f52e21ab] Building network info cache for instance {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 10:31:25 user nova-compute[85141]: DEBUG nova.network.neutron [None req-bef83356-a9fe-4f25-8fb2-5d16702c5ff2 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] [instance: f432d8f9-10c4-49e3-bf3b-6389f52e21ab] Instance cache missing network info. {{(pid=85141) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 10:31:25 user nova-compute[85141]: DEBUG nova.compute.manager [req-fc96647d-477a-4864-b7c0-7241b0a45783 req-e04eb052-dcc8-47fb-a6fe-0d7841ca9914 service nova] [instance: 97cbb145-d47e-4eb1-8c01-06361efa8720] Received event network-vif-plugged-440f9d6b-639a-4615-8b0c-e85b108f9734 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:31:25 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-fc96647d-477a-4864-b7c0-7241b0a45783 req-e04eb052-dcc8-47fb-a6fe-0d7841ca9914 service nova] Acquiring lock "97cbb145-d47e-4eb1-8c01-06361efa8720-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:31:25 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-fc96647d-477a-4864-b7c0-7241b0a45783 req-e04eb052-dcc8-47fb-a6fe-0d7841ca9914 service nova] Lock "97cbb145-d47e-4eb1-8c01-06361efa8720-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:31:25 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-fc96647d-477a-4864-b7c0-7241b0a45783 req-e04eb052-dcc8-47fb-a6fe-0d7841ca9914 service nova] Lock "97cbb145-d47e-4eb1-8c01-06361efa8720-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:31:25 user nova-compute[85141]: DEBUG nova.compute.manager [req-fc96647d-477a-4864-b7c0-7241b0a45783 req-e04eb052-dcc8-47fb-a6fe-0d7841ca9914 service nova] [instance: 97cbb145-d47e-4eb1-8c01-06361efa8720] No waiting events found dispatching network-vif-plugged-440f9d6b-639a-4615-8b0c-e85b108f9734 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:31:25 user nova-compute[85141]: WARNING nova.compute.manager [req-fc96647d-477a-4864-b7c0-7241b0a45783 req-e04eb052-dcc8-47fb-a6fe-0d7841ca9914 service nova] [instance: 97cbb145-d47e-4eb1-8c01-06361efa8720] Received unexpected event network-vif-plugged-440f9d6b-639a-4615-8b0c-e85b108f9734 for instance with vm_state active and task_state deleting.
Nov 16 10:31:26 user nova-compute[85141]: DEBUG nova.objects.instance [None req-557ca829-84ad-40c9-83f0-7ed39bbb6e06 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Lazy-loading 'flavor' on Instance uuid 89e358d7-0844-4742-853b-ff88800415d2 {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:31:26 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-557ca829-84ad-40c9-83f0-7ed39bbb6e06 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Lock "89e358d7-0844-4742-853b-ff88800415d2" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.859s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:31:26 user nova-compute[85141]: DEBUG nova.network.neutron [None req-bef83356-a9fe-4f25-8fb2-5d16702c5ff2 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] [instance: f432d8f9-10c4-49e3-bf3b-6389f52e21ab] Updating instance_info_cache with network_info: [{"id": "e8cc6756-287d-4451-9119-7ca5779ca62c", "address": "fa:16:3e:c3:18:3e", "network": {"id": "a8f7d218-f758-44d8-adb3-120a5f724f70", "bridge": "br-int", "label": "tempest-TestStampPattern-1966889964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fb187d45ec54e74a0721973235f98b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8cc6756-28", "ovs_interfaceid": "e8cc6756-287d-4451-9119-7ca5779ca62c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:31:26 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-bef83356-a9fe-4f25-8fb2-5d16702c5ff2 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Releasing lock "refresh_cache-f432d8f9-10c4-49e3-bf3b-6389f52e21ab" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:31:26 user nova-compute[85141]: DEBUG nova.compute.manager [None req-bef83356-a9fe-4f25-8fb2-5d16702c5ff2 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] [instance: f432d8f9-10c4-49e3-bf3b-6389f52e21ab] Instance network_info: |[{"id": "e8cc6756-287d-4451-9119-7ca5779ca62c", "address": "fa:16:3e:c3:18:3e", "network": {"id": "a8f7d218-f758-44d8-adb3-120a5f724f70", "bridge": "br-int", "label": "tempest-TestStampPattern-1966889964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fb187d45ec54e74a0721973235f98b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8cc6756-28", "ovs_interfaceid": "e8cc6756-287d-4451-9119-7ca5779ca62c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=85141) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 10:31:26 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-bef83356-a9fe-4f25-8fb2-5d16702c5ff2 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] [instance: f432d8f9-10c4-49e3-bf3b-6389f52e21ab] Start _get_guest_xml network_info=[{"id": "e8cc6756-287d-4451-9119-7ca5779ca62c", "address": "fa:16:3e:c3:18:3e", "network": {"id": "a8f7d218-f758-44d8-adb3-120a5f724f70", "bridge": "br-int", "label": "tempest-TestStampPattern-1966889964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fb187d45ec54e74a0721973235f98b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8cc6756-28", "ovs_interfaceid": "e8cc6756-287d-4451-9119-7ca5779ca62c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b9111d6b7801dfc4dc06f25bf5a1dd3d',container_format='bare',created_at=2023-11-16T10:31:13Z,direct_url=<?>,disk_format='qcow2',id=94642f60-38cf-40f1-8b96-e14a357ee931,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1801567721',owner='5fb187d45ec54e74a0721973235f98b0',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-16T10:31:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_options': None, 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'image_id': '94642f60-38cf-40f1-8b96-e14a357ee931'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=85141) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 10:31:26 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-bef83356-a9fe-4f25-8fb2-5d16702c5ff2 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:31:26 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-bef83356-a9fe-4f25-8fb2-5d16702c5ff2 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:31:26 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-bef83356-a9fe-4f25-8fb2-5d16702c5ff2 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=85141) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 10:31:26 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-bef83356-a9fe-4f25-8fb2-5d16702c5ff2 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] CPU controller missing on host. {{(pid=85141) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 10:31:26 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-bef83356-a9fe-4f25-8fb2-5d16702c5ff2 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=85141) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 10:31:26 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-bef83356-a9fe-4f25-8fb2-5d16702c5ff2 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] CPU controller found on host. {{(pid=85141) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 10:31:26 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-bef83356-a9fe-4f25-8fb2-5d16702c5ff2 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=85141) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 10:31:26 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-bef83356-a9fe-4f25-8fb2-5d16702c5ff2 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T10:06:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b9111d6b7801dfc4dc06f25bf5a1dd3d',container_format='bare',created_at=2023-11-16T10:31:13Z,direct_url=<?>,disk_format='qcow2',id=94642f60-38cf-40f1-8b96-e14a357ee931,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1801567721',owner='5fb187d45ec54e74a0721973235f98b0',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-16T10:31:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 10:31:26 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-bef83356-a9fe-4f25-8fb2-5d16702c5ff2 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Flavor limits 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 10:31:26 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-bef83356-a9fe-4f25-8fb2-5d16702c5ff2 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Image limits 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 10:31:26 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-bef83356-a9fe-4f25-8fb2-5d16702c5ff2 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Flavor pref 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 10:31:26 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-bef83356-a9fe-4f25-8fb2-5d16702c5ff2 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Image pref 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 10:31:26 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-bef83356-a9fe-4f25-8fb2-5d16702c5ff2 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 10:31:26 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-bef83356-a9fe-4f25-8fb2-5d16702c5ff2 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 10:31:26 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-bef83356-a9fe-4f25-8fb2-5d16702c5ff2 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=85141) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 10:31:26 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-bef83356-a9fe-4f25-8fb2-5d16702c5ff2 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Got 1 possible topologies {{(pid=85141) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 10:31:26 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-bef83356-a9fe-4f25-8fb2-5d16702c5ff2 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 10:31:26 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-bef83356-a9fe-4f25-8fb2-5d16702c5ff2 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 10:31:26 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-bef83356-a9fe-4f25-8fb2-5d16702c5ff2 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T10:31:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-392613206',display_name='tempest-TestStampPattern-server-392613206',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-392613206',id=43,image_ref='94642f60-38cf-40f1-8b96-e14a357ee931',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHF1TofF/AHeRXw7sOS6/Y4wIEeeHYvjmPtqSMUQwk4rvI03M+9FGX8I4Wssar9zDuv0PRZIDidniJXR8tQIzSEDKx9zL7EpsVLQYl+cVUTa2/jPhGRM8ZPjKll4UR2MBA==',key_name='tempest-TestStampPattern-1189059507',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5fb187d45ec54e74a0721973235f98b0',ramdisk_id='',reservation_id='r-saobuqhi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='da42de06-4518-4c8a-8c63-9b5a2759a1bf',image_min_disk='1',image_min_ram='0',image_owner_id='5fb187d45ec54e74a0721973235f98b0',image_owner_project_name='tempest-TestStampPattern-2139210362',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-2139210362-project-member',image_user_id='ef2996a7b2b54ae38380743cf424dc18',network_allocated='True',owner_project_name='tempest-TestStampPattern-2139210362',owner_user_name='tempest-TestStampPattern-2139210362-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T10:31:22Z,user_data=None,user_id='ef2996a7b2b54ae38380743cf424dc18',uuid=f432d8f9-10c4-49e3-bf3b-6389f52e21ab,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e8cc6756-287d-4451-9119-7ca5779ca62c", "address": "fa:16:3e:c3:18:3e", "network": {"id": "a8f7d218-f758-44d8-adb3-120a5f724f70", "bridge": "br-int", "label": "tempest-TestStampPattern-1966889964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fb187d45ec54e74a0721973235f98b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8cc6756-28", "ovs_interfaceid": "e8cc6756-287d-4451-9119-7ca5779ca62c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=85141) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 10:31:26 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-bef83356-a9fe-4f25-8fb2-5d16702c5ff2 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Converting VIF {"id": "e8cc6756-287d-4451-9119-7ca5779ca62c", "address": "fa:16:3e:c3:18:3e", "network": {"id": "a8f7d218-f758-44d8-adb3-120a5f724f70", "bridge": "br-int", "label": "tempest-TestStampPattern-1966889964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fb187d45ec54e74a0721973235f98b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8cc6756-28", "ovs_interfaceid": "e8cc6756-287d-4451-9119-7ca5779ca62c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:31:26 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-bef83356-a9fe-4f25-8fb2-5d16702c5ff2 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:18:3e,bridge_name='br-int',has_traffic_filtering=True,id=e8cc6756-287d-4451-9119-7ca5779ca62c,network=Network(a8f7d218-f758-44d8-adb3-120a5f724f70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8cc6756-28') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:31:26 user nova-compute[85141]: DEBUG nova.objects.instance [None req-bef83356-a9fe-4f25-8fb2-5d16702c5ff2 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Lazy-loading 'pci_devices' on Instance uuid f432d8f9-10c4-49e3-bf3b-6389f52e21ab {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:31:26 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-bef83356-a9fe-4f25-8fb2-5d16702c5ff2 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] [instance: f432d8f9-10c4-49e3-bf3b-6389f52e21ab] End _get_guest_xml xml=<domain type="kvm">
Nov 16 10:31:26 user nova-compute[85141]:   <uuid>f432d8f9-10c4-49e3-bf3b-6389f52e21ab</uuid>
Nov 16 10:31:26 user nova-compute[85141]:   <name>instance-0000002b</name>
Nov 16 10:31:26 user nova-compute[85141]:   <memory>524288</memory>
Nov 16 10:31:26 user nova-compute[85141]:   <vcpu>1</vcpu>
Nov 16 10:31:26 user nova-compute[85141]:   <metadata>
Nov 16 10:31:26 user nova-compute[85141]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 10:31:26 user nova-compute[85141]:       <nova:package version="0.0.0"/>
Nov 16 10:31:26 user nova-compute[85141]:       <nova:name>tempest-TestStampPattern-server-392613206</nova:name>
Nov 16 10:31:26 user nova-compute[85141]:       <nova:creationTime>2023-11-16 10:31:26</nova:creationTime>
Nov 16 10:31:26 user nova-compute[85141]:       <nova:flavor name="m1.tiny">
Nov 16 10:31:26 user nova-compute[85141]:         <nova:memory>512</nova:memory>
Nov 16 10:31:26 user nova-compute[85141]:         <nova:disk>1</nova:disk>
Nov 16 10:31:26 user nova-compute[85141]:         <nova:swap>0</nova:swap>
Nov 16 10:31:26 user nova-compute[85141]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 10:31:26 user nova-compute[85141]:         <nova:vcpus>1</nova:vcpus>
Nov 16 10:31:26 user nova-compute[85141]:       </nova:flavor>
Nov 16 10:31:26 user nova-compute[85141]:       <nova:owner>
Nov 16 10:31:26 user nova-compute[85141]:         <nova:user uuid="ef2996a7b2b54ae38380743cf424dc18">tempest-TestStampPattern-2139210362-project-member</nova:user>
Nov 16 10:31:26 user nova-compute[85141]:         <nova:project uuid="5fb187d45ec54e74a0721973235f98b0">tempest-TestStampPattern-2139210362</nova:project>
Nov 16 10:31:26 user nova-compute[85141]:       </nova:owner>
Nov 16 10:31:26 user nova-compute[85141]:       <nova:root type="image" uuid="94642f60-38cf-40f1-8b96-e14a357ee931"/>
Nov 16 10:31:26 user nova-compute[85141]:       <nova:ports>
Nov 16 10:31:26 user nova-compute[85141]:         <nova:port uuid="e8cc6756-287d-4451-9119-7ca5779ca62c">
Nov 16 10:31:26 user nova-compute[85141]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 16 10:31:26 user nova-compute[85141]:         </nova:port>
Nov 16 10:31:26 user nova-compute[85141]:       </nova:ports>
Nov 16 10:31:26 user nova-compute[85141]:     </nova:instance>
Nov 16 10:31:26 user nova-compute[85141]:   </metadata>
Nov 16 10:31:26 user nova-compute[85141]:   <sysinfo type="smbios">
Nov 16 10:31:26 user nova-compute[85141]:     <system>
Nov 16 10:31:26 user nova-compute[85141]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 10:31:26 user nova-compute[85141]:       <entry name="product">OpenStack Nova</entry>
Nov 16 10:31:26 user nova-compute[85141]:       <entry name="version">0.0.0</entry>
Nov 16 10:31:26 user nova-compute[85141]:       <entry name="serial">f432d8f9-10c4-49e3-bf3b-6389f52e21ab</entry>
Nov 16 10:31:26 user nova-compute[85141]:       <entry name="uuid">f432d8f9-10c4-49e3-bf3b-6389f52e21ab</entry>
Nov 16 10:31:26 user nova-compute[85141]:       <entry name="family">Virtual Machine</entry>
Nov 16 10:31:26 user nova-compute[85141]:     </system>
Nov 16 10:31:26 user nova-compute[85141]:   </sysinfo>
Nov 16 10:31:26 user nova-compute[85141]:   <os>
Nov 16 10:31:26 user nova-compute[85141]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 10:31:26 user nova-compute[85141]:     <boot dev="hd"/>
Nov 16 10:31:26 user nova-compute[85141]:     <smbios mode="sysinfo"/>
Nov 16 10:31:26 user nova-compute[85141]:   </os>
Nov 16 10:31:26 user nova-compute[85141]:   <features>
Nov 16 10:31:26 user nova-compute[85141]:     <acpi/>
Nov 16 10:31:26 user nova-compute[85141]:     <apic/>
Nov 16 10:31:26 user nova-compute[85141]:     <vmcoreinfo/>
Nov 16 10:31:26 user nova-compute[85141]:   </features>
Nov 16 10:31:26 user nova-compute[85141]:   <clock offset="utc">
Nov 16 10:31:26 user nova-compute[85141]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 10:31:26 user nova-compute[85141]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 10:31:26 user nova-compute[85141]:     <timer name="hpet" present="no"/>
Nov 16 10:31:26 user nova-compute[85141]:   </clock>
Nov 16 10:31:26 user nova-compute[85141]:   <cpu mode="custom" match="exact">
Nov 16 10:31:26 user nova-compute[85141]:     <model>Nehalem</model>
Nov 16 10:31:26 user nova-compute[85141]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 10:31:26 user nova-compute[85141]:   </cpu>
Nov 16 10:31:26 user nova-compute[85141]:   <devices>
Nov 16 10:31:26 user nova-compute[85141]:     <disk type="file" device="disk">
Nov 16 10:31:26 user nova-compute[85141]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 10:31:26 user nova-compute[85141]:       <source file="/opt/stack/data/nova/instances/f432d8f9-10c4-49e3-bf3b-6389f52e21ab/disk"/>
Nov 16 10:31:26 user nova-compute[85141]:       <target dev="vda" bus="virtio"/>
Nov 16 10:31:26 user nova-compute[85141]:     </disk>
Nov 16 10:31:26 user nova-compute[85141]:     <interface type="ethernet">
Nov 16 10:31:26 user nova-compute[85141]:       <mac address="fa:16:3e:c3:18:3e"/>
Nov 16 10:31:26 user nova-compute[85141]:       <model type="virtio"/>
Nov 16 10:31:26 user nova-compute[85141]:       <mtu size="1442"/>
Nov 16 10:31:26 user nova-compute[85141]:       <target dev="tape8cc6756-28"/>
Nov 16 10:31:26 user nova-compute[85141]:     </interface>
Nov 16 10:31:26 user nova-compute[85141]:     <serial type="pty">
Nov 16 10:31:26 user nova-compute[85141]:       <log file="/opt/stack/data/nova/instances/f432d8f9-10c4-49e3-bf3b-6389f52e21ab/console.log" append="off"/>
Nov 16 10:31:26 user nova-compute[85141]:     </serial>
Nov 16 10:31:26 user nova-compute[85141]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 10:31:26 user nova-compute[85141]:     <video>
Nov 16 10:31:26 user nova-compute[85141]:       <model type="virtio"/>
Nov 16 10:31:26 user nova-compute[85141]:     </video>
Nov 16 10:31:26 user nova-compute[85141]:     <rng model="virtio">
Nov 16 10:31:26 user nova-compute[85141]:       <backend model="random">/dev/urandom</backend>
Nov 16 10:31:26 user nova-compute[85141]:     </rng>
Nov 16 10:31:26 user nova-compute[85141]:     <controller type="usb" index="0" model="none"/>
Nov 16 10:31:26 user nova-compute[85141]:     <memballoon model="virtio">
Nov 16 10:31:26 user nova-compute[85141]:       <stats period="10"/>
Nov 16 10:31:26 user nova-compute[85141]:     </memballoon>
Nov 16 10:31:26 user nova-compute[85141]:   </devices>
Nov 16 10:31:26 user nova-compute[85141]: </domain>
Nov 16 10:31:26 user nova-compute[85141]:  {{(pid=85141) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 10:31:26 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-bef83356-a9fe-4f25-8fb2-5d16702c5ff2 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T10:31:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-392613206',display_name='tempest-TestStampPattern-server-392613206',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-392613206',id=43,image_ref='94642f60-38cf-40f1-8b96-e14a357ee931',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHF1TofF/AHeRXw7sOS6/Y4wIEeeHYvjmPtqSMUQwk4rvI03M+9FGX8I4Wssar9zDuv0PRZIDidniJXR8tQIzSEDKx9zL7EpsVLQYl+cVUTa2/jPhGRM8ZPjKll4UR2MBA==',key_name='tempest-TestStampPattern-1189059507',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5fb187d45ec54e74a0721973235f98b0',ramdisk_id='',reservation_id='r-saobuqhi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='da42de06-4518-4c8a-8c63-9b5a2759a1bf',image_min_disk='1',image_min_ram='0',image_owner_id='5fb187d45ec54e74a0721973235f98b0',image_owner_project_name='tempest-TestStampPattern-2139210362',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-2139210362-project-member',image_user_id='ef2996a7b2b54ae38380743cf424dc18',network_allocated='True',owner_project_name='tempest-TestStampPattern-2139210362',owner_user_name='tempest-TestStampPattern-2139210362-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T10:31:22Z,user_data=None,user_id='ef2996a7b2b54ae38380743cf424dc18',uuid=f432d8f9-10c4-49e3-bf3b-6389f52e21ab,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e8cc6756-287d-4451-9119-7ca5779ca62c", "address": "fa:16:3e:c3:18:3e", "network": {"id": "a8f7d218-f758-44d8-adb3-120a5f724f70", "bridge": "br-int", "label": "tempest-TestStampPattern-1966889964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fb187d45ec54e74a0721973235f98b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8cc6756-28", "ovs_interfaceid": "e8cc6756-287d-4451-9119-7ca5779ca62c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 10:31:26 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-bef83356-a9fe-4f25-8fb2-5d16702c5ff2 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Converting VIF {"id": "e8cc6756-287d-4451-9119-7ca5779ca62c", "address": "fa:16:3e:c3:18:3e", "network": {"id": "a8f7d218-f758-44d8-adb3-120a5f724f70", "bridge": "br-int", "label": "tempest-TestStampPattern-1966889964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fb187d45ec54e74a0721973235f98b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8cc6756-28", "ovs_interfaceid": "e8cc6756-287d-4451-9119-7ca5779ca62c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:31:26 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-bef83356-a9fe-4f25-8fb2-5d16702c5ff2 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:18:3e,bridge_name='br-int',has_traffic_filtering=True,id=e8cc6756-287d-4451-9119-7ca5779ca62c,network=Network(a8f7d218-f758-44d8-adb3-120a5f724f70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8cc6756-28') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:31:26 user nova-compute[85141]: DEBUG os_vif [None req-bef83356-a9fe-4f25-8fb2-5d16702c5ff2 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:18:3e,bridge_name='br-int',has_traffic_filtering=True,id=e8cc6756-287d-4451-9119-7ca5779ca62c,network=Network(a8f7d218-f758-44d8-adb3-120a5f724f70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8cc6756-28') {{(pid=85141) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 10:31:26 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:31:26 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:31:26 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 10:31:26 user nova-compute[85141]: DEBUG nova.network.neutron [-] [instance: 97cbb145-d47e-4eb1-8c01-06361efa8720] Updating instance_info_cache with network_info: [] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:31:26 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:31:26 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ba9fb3e7-a4cc-5513-ae56-4e4c6f666ad9', '_type': 'linux-noop'}}, row=False) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:31:26 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:31:26 user nova-compute[85141]: INFO nova.compute.manager [-] [instance: 97cbb145-d47e-4eb1-8c01-06361efa8720] Took 1.74 seconds to deallocate network for instance.
Nov 16 10:31:26 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:31:26 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:31:26 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape8cc6756-28, may_exist=True, interface_attrs={}) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:31:26 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape8cc6756-28, col_values=(('qos', UUID('9b320f42-199f-43ce-a1fb-660709828657')),), if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:31:26 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape8cc6756-28, col_values=(('external_ids', {'iface-id': 'e8cc6756-287d-4451-9119-7ca5779ca62c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c3:18:3e', 'vm-uuid': 'f432d8f9-10c4-49e3-bf3b-6389f52e21ab'}),), if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:31:26 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:31:26 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:31:26 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:31:26 user nova-compute[85141]: INFO os_vif [None req-bef83356-a9fe-4f25-8fb2-5d16702c5ff2 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:18:3e,bridge_name='br-int',has_traffic_filtering=True,id=e8cc6756-287d-4451-9119-7ca5779ca62c,network=Network(a8f7d218-f758-44d8-adb3-120a5f724f70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8cc6756-28')
Nov 16 10:31:26 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-bef83356-a9fe-4f25-8fb2-5d16702c5ff2 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] No BDM found with device name vda, not building metadata. {{(pid=85141) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 10:31:26 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-bef83356-a9fe-4f25-8fb2-5d16702c5ff2 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] No VIF found with MAC fa:16:3e:c3:18:3e, not building metadata {{(pid=85141) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 10:31:27 user nova-compute[85141]: DEBUG nova.compute.manager [req-45137714-8058-4484-af08-2ed27568240a req-a6873941-f9b6-4a57-aa65-d71ab6515247 service nova] [instance: 97cbb145-d47e-4eb1-8c01-06361efa8720] Received event network-vif-deleted-440f9d6b-639a-4615-8b0c-e85b108f9734 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:31:27 user nova-compute[85141]: INFO nova.compute.manager [None req-3aa56382-73b5-414f-9901-7977c7e59ffd tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: 97cbb145-d47e-4eb1-8c01-06361efa8720] Took 0.82 seconds to detach 1 volumes for instance.
Nov 16 10:31:27 user nova-compute[85141]: DEBUG nova.compute.manager [None req-3aa56382-73b5-414f-9901-7977c7e59ffd tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: 97cbb145-d47e-4eb1-8c01-06361efa8720] Deleting volume: 925fd9db-7153-4861-bbc3-9cbb8822e196 {{(pid=85141) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 16 10:31:27 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-d909d8f7-7a52-4a77-8837-45c543655526 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Acquiring lock "89e358d7-0844-4742-853b-ff88800415d2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:31:27 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-d909d8f7-7a52-4a77-8837-45c543655526 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Lock "89e358d7-0844-4742-853b-ff88800415d2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:31:27 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-d909d8f7-7a52-4a77-8837-45c543655526 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Acquiring lock "89e358d7-0844-4742-853b-ff88800415d2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:31:27 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-d909d8f7-7a52-4a77-8837-45c543655526 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Lock "89e358d7-0844-4742-853b-ff88800415d2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:31:27 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-d909d8f7-7a52-4a77-8837-45c543655526 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Lock "89e358d7-0844-4742-853b-ff88800415d2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:31:27 user nova-compute[85141]: INFO nova.compute.manager [None req-d909d8f7-7a52-4a77-8837-45c543655526 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] [instance: 89e358d7-0844-4742-853b-ff88800415d2] Terminating instance
Nov 16 10:31:27 user nova-compute[85141]: DEBUG nova.compute.manager [None req-d909d8f7-7a52-4a77-8837-45c543655526 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] [instance: 89e358d7-0844-4742-853b-ff88800415d2] Start destroying the instance on the hypervisor. {{(pid=85141) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 10:31:27 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-3aa56382-73b5-414f-9901-7977c7e59ffd tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:31:27 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-3aa56382-73b5-414f-9901-7977c7e59ffd tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:31:27 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:31:27 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:31:27 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:31:27 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:31:28 user nova-compute[85141]: DEBUG nova.compute.provider_tree [None req-3aa56382-73b5-414f-9901-7977c7e59ffd tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Inventory has not changed in ProviderTree for provider: bf8e0fa1-16b6-408f-9203-c4cd63916272 {{(pid=85141) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 10:31:28 user nova-compute[85141]: DEBUG nova.scheduler.client.report [None req-3aa56382-73b5-414f-9901-7977c7e59ffd tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Inventory has not changed for provider bf8e0fa1-16b6-408f-9203-c4cd63916272 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=85141) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 10:31:28 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-3aa56382-73b5-414f-9901-7977c7e59ffd tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.445s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:31:28 user nova-compute[85141]: INFO nova.scheduler.client.report [None req-3aa56382-73b5-414f-9901-7977c7e59ffd tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Deleted allocations for instance 97cbb145-d47e-4eb1-8c01-06361efa8720
Nov 16 10:31:28 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-3aa56382-73b5-414f-9901-7977c7e59ffd tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Lock "97cbb145-d47e-4eb1-8c01-06361efa8720" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.827s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:31:28 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:31:28 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:31:28 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:31:28 user nova-compute[85141]: DEBUG nova.compute.manager [req-3c60517a-5dc8-4238-bf84-b4611744cc62 req-90237faa-7928-4da6-b40e-8ed24d79584f service nova] [instance: f432d8f9-10c4-49e3-bf3b-6389f52e21ab] Received event network-vif-plugged-e8cc6756-287d-4451-9119-7ca5779ca62c {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:31:28 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-3c60517a-5dc8-4238-bf84-b4611744cc62 req-90237faa-7928-4da6-b40e-8ed24d79584f service nova] Acquiring lock "f432d8f9-10c4-49e3-bf3b-6389f52e21ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:31:28 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-3c60517a-5dc8-4238-bf84-b4611744cc62 req-90237faa-7928-4da6-b40e-8ed24d79584f service nova] Lock "f432d8f9-10c4-49e3-bf3b-6389f52e21ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:31:28 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-3c60517a-5dc8-4238-bf84-b4611744cc62 req-90237faa-7928-4da6-b40e-8ed24d79584f service nova] Lock "f432d8f9-10c4-49e3-bf3b-6389f52e21ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:31:28 user nova-compute[85141]: DEBUG nova.compute.manager [req-3c60517a-5dc8-4238-bf84-b4611744cc62 req-90237faa-7928-4da6-b40e-8ed24d79584f service nova] [instance: f432d8f9-10c4-49e3-bf3b-6389f52e21ab] No waiting events found dispatching network-vif-plugged-e8cc6756-287d-4451-9119-7ca5779ca62c {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:31:28 user nova-compute[85141]: WARNING nova.compute.manager [req-3c60517a-5dc8-4238-bf84-b4611744cc62 req-90237faa-7928-4da6-b40e-8ed24d79584f service nova] [instance: f432d8f9-10c4-49e3-bf3b-6389f52e21ab] Received unexpected event network-vif-plugged-e8cc6756-287d-4451-9119-7ca5779ca62c for instance with vm_state building and task_state spawning.
Nov 16 10:31:28 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:31:28 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:31:28 user nova-compute[85141]: INFO nova.virt.libvirt.driver [-] [instance: 89e358d7-0844-4742-853b-ff88800415d2] Instance destroyed successfully.
Nov 16 10:31:28 user nova-compute[85141]: DEBUG nova.objects.instance [None req-d909d8f7-7a52-4a77-8837-45c543655526 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Lazy-loading 'resources' on Instance uuid 89e358d7-0844-4742-853b-ff88800415d2 {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:31:28 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-d909d8f7-7a52-4a77-8837-45c543655526 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T10:28:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1978887411',display_name='tempest-AttachVolumeTestJSON-server-1978887411',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1978887411',id=39,image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEtnGhEBueND8l7UfodG/3yX2PPWW+imcz+d5bVZlVPU/rWym+1QHZXKKfsccjLcvHnRnkF2UVQL++p1nntGQssXfyBeaUcIJXUn7Qmdy2roin1IEfhDyVzv5ajgVbp4vA==',key_name='tempest-keypair-2091170545',keypairs=<?>,launch_index=0,launched_at=2023-11-16T10:28:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c2acc04e107d4a229c3580cf078a20f7',ramdisk_id='',reservation_id='r-ffqa41ep',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1609390288',owner_user_name='tempest-AttachVolumeTestJSON-1609390288-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T10:28:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f58409e5923c42b685d0a3ad0ab42974',uuid=89e358d7-0844-4742-853b-ff88800415d2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b60a8a3c-4aac-4af1-ba04-d8a61ab96324", "address": "fa:16:3e:56:2d:dd", "network": {"id": "4e36c3d2-7d16-4305-a0a7-2358e1208df3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1030128743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2acc04e107d4a229c3580cf078a20f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb60a8a3c-4a", "ovs_interfaceid": "b60a8a3c-4aac-4af1-ba04-d8a61ab96324", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 10:31:28 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-d909d8f7-7a52-4a77-8837-45c543655526 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Converting VIF {"id": "b60a8a3c-4aac-4af1-ba04-d8a61ab96324", "address": "fa:16:3e:56:2d:dd", "network": {"id": "4e36c3d2-7d16-4305-a0a7-2358e1208df3", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1030128743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2acc04e107d4a229c3580cf078a20f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb60a8a3c-4a", "ovs_interfaceid": "b60a8a3c-4aac-4af1-ba04-d8a61ab96324", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:31:28 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-d909d8f7-7a52-4a77-8837-45c543655526 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:56:2d:dd,bridge_name='br-int',has_traffic_filtering=True,id=b60a8a3c-4aac-4af1-ba04-d8a61ab96324,network=Network(4e36c3d2-7d16-4305-a0a7-2358e1208df3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb60a8a3c-4a') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:31:28 user nova-compute[85141]: DEBUG os_vif [None req-d909d8f7-7a52-4a77-8837-45c543655526 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:56:2d:dd,bridge_name='br-int',has_traffic_filtering=True,id=b60a8a3c-4aac-4af1-ba04-d8a61ab96324,network=Network(4e36c3d2-7d16-4305-a0a7-2358e1208df3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb60a8a3c-4a') {{(pid=85141) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 10:31:28 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:31:28 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb60a8a3c-4a, bridge=br-int, if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:31:28 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:31:28 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:31:28 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:31:28 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cee54ef7-ae69-470a-a552-540fee9bb1a9) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:31:28 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:31:28 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:31:28 user nova-compute[85141]: INFO os_vif [None req-d909d8f7-7a52-4a77-8837-45c543655526 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:56:2d:dd,bridge_name='br-int',has_traffic_filtering=True,id=b60a8a3c-4aac-4af1-ba04-d8a61ab96324,network=Network(4e36c3d2-7d16-4305-a0a7-2358e1208df3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb60a8a3c-4a')
Nov 16 10:31:28 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-d909d8f7-7a52-4a77-8837-45c543655526 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] [instance: 89e358d7-0844-4742-853b-ff88800415d2] Deleting instance files /opt/stack/data/nova/instances/89e358d7-0844-4742-853b-ff88800415d2_del
Nov 16 10:31:28 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-d909d8f7-7a52-4a77-8837-45c543655526 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] [instance: 89e358d7-0844-4742-853b-ff88800415d2] Deletion of /opt/stack/data/nova/instances/89e358d7-0844-4742-853b-ff88800415d2_del complete
Nov 16 10:31:29 user nova-compute[85141]: INFO nova.compute.manager [None req-d909d8f7-7a52-4a77-8837-45c543655526 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] [instance: 89e358d7-0844-4742-853b-ff88800415d2] Took 1.47 seconds to destroy the instance on the hypervisor.
Nov 16 10:31:29 user nova-compute[85141]: DEBUG oslo.service.loopingcall [None req-d909d8f7-7a52-4a77-8837-45c543655526 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=85141) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 10:31:29 user nova-compute[85141]: DEBUG nova.compute.manager [-] [instance: 89e358d7-0844-4742-853b-ff88800415d2] Deallocating network for instance {{(pid=85141) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 10:31:29 user nova-compute[85141]: DEBUG nova.network.neutron [-] [instance: 89e358d7-0844-4742-853b-ff88800415d2] deallocate_for_instance() {{(pid=85141) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 10:31:29 user nova-compute[85141]: DEBUG nova.compute.manager [req-dd23ee50-5cfa-4023-98c5-668dce6dc147 req-442cd5d1-ad17-42aa-a1b1-47f7cec0b9c1 service nova] [instance: 89e358d7-0844-4742-853b-ff88800415d2] Received event network-vif-unplugged-b60a8a3c-4aac-4af1-ba04-d8a61ab96324 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:31:29 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-dd23ee50-5cfa-4023-98c5-668dce6dc147 req-442cd5d1-ad17-42aa-a1b1-47f7cec0b9c1 service nova] Acquiring lock "89e358d7-0844-4742-853b-ff88800415d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:31:29 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-dd23ee50-5cfa-4023-98c5-668dce6dc147 req-442cd5d1-ad17-42aa-a1b1-47f7cec0b9c1 service nova] Lock "89e358d7-0844-4742-853b-ff88800415d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:31:29 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-dd23ee50-5cfa-4023-98c5-668dce6dc147 req-442cd5d1-ad17-42aa-a1b1-47f7cec0b9c1 service nova] Lock "89e358d7-0844-4742-853b-ff88800415d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:31:29 user nova-compute[85141]: DEBUG nova.compute.manager [req-dd23ee50-5cfa-4023-98c5-668dce6dc147 req-442cd5d1-ad17-42aa-a1b1-47f7cec0b9c1 service nova] [instance: 89e358d7-0844-4742-853b-ff88800415d2] No waiting events found dispatching network-vif-unplugged-b60a8a3c-4aac-4af1-ba04-d8a61ab96324 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:31:29 user nova-compute[85141]: DEBUG nova.compute.manager [req-dd23ee50-5cfa-4023-98c5-668dce6dc147 req-442cd5d1-ad17-42aa-a1b1-47f7cec0b9c1 service nova] [instance: 89e358d7-0844-4742-853b-ff88800415d2] Received event network-vif-unplugged-b60a8a3c-4aac-4af1-ba04-d8a61ab96324 for instance with task_state deleting. {{(pid=85141) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 10:31:29 user nova-compute[85141]: DEBUG nova.compute.manager [req-dd23ee50-5cfa-4023-98c5-668dce6dc147 req-442cd5d1-ad17-42aa-a1b1-47f7cec0b9c1 service nova] [instance: 89e358d7-0844-4742-853b-ff88800415d2] Received event network-vif-plugged-b60a8a3c-4aac-4af1-ba04-d8a61ab96324 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:31:29 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-dd23ee50-5cfa-4023-98c5-668dce6dc147 req-442cd5d1-ad17-42aa-a1b1-47f7cec0b9c1 service nova] Acquiring lock "89e358d7-0844-4742-853b-ff88800415d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:31:29 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-dd23ee50-5cfa-4023-98c5-668dce6dc147 req-442cd5d1-ad17-42aa-a1b1-47f7cec0b9c1 service nova] Lock "89e358d7-0844-4742-853b-ff88800415d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:31:29 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-dd23ee50-5cfa-4023-98c5-668dce6dc147 req-442cd5d1-ad17-42aa-a1b1-47f7cec0b9c1 service nova] Lock "89e358d7-0844-4742-853b-ff88800415d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:31:29 user nova-compute[85141]: DEBUG nova.compute.manager [req-dd23ee50-5cfa-4023-98c5-668dce6dc147 req-442cd5d1-ad17-42aa-a1b1-47f7cec0b9c1 service nova] [instance: 89e358d7-0844-4742-853b-ff88800415d2] No waiting events found dispatching network-vif-plugged-b60a8a3c-4aac-4af1-ba04-d8a61ab96324 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:31:29 user nova-compute[85141]: WARNING nova.compute.manager [req-dd23ee50-5cfa-4023-98c5-668dce6dc147 req-442cd5d1-ad17-42aa-a1b1-47f7cec0b9c1 service nova] [instance: 89e358d7-0844-4742-853b-ff88800415d2] Received unexpected event network-vif-plugged-b60a8a3c-4aac-4af1-ba04-d8a61ab96324 for instance with vm_state active and task_state deleting.
Nov 16 10:31:29 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-24f688f7-5344-420a-a420-b363d85eaaf0 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] [instance: 7437a3a3-9b7f-489b-b20b-f1b877ebb253] Calling os-brick to attach iSCSI Volume {{(pid=85141) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 10:31:29 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-24f688f7-5344-420a-a420-b363d85eaaf0 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51806b6080>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ebf4cfdf-97a5-4901-b8e0-df0704384909', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SPscqJGr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 10:31:29 user nova-compute[85141]: WARNING os_brick.initiator.connectors.base [None req-24f688f7-5344-420a-a420-b363d85eaaf0 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 10:31:29 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-24f688f7-5344-420a-a420-b363d85eaaf0 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 10:31:29 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-24f688f7-5344-420a-a420-b363d85eaaf0 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 10:31:29 user nova-compute[85141]: WARNING os_brick.initiator.connectors.base [None req-24f688f7-5344-420a-a420-b363d85eaaf0 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 10:31:29 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-24f688f7-5344-420a-a420-b363d85eaaf0 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ebf4cfdf-97a5-4901-b8e0-df0704384909" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 10:31:29 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-24f688f7-5344-420a-a420-b363d85eaaf0 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ebf4cfdf-97a5-4901-b8e0-df0704384909" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 10:31:29 user nova-compute[85141]: INFO os_brick.initiator.connectors.iscsi [None req-24f688f7-5344-420a-a420-b363d85eaaf0 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 10:31:29 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ebf4cfdf-97a5-4901-b8e0-df0704384909 -p 172.16.0.220:3260 {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:31:29 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ebf4cfdf-97a5-4901-b8e0-df0704384909 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:31:29 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[13758cb0-37ce-47f2-a04a-24ed46ac89d5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:31:29 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-24f688f7-5344-420a-a420-b363d85eaaf0 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 10:31:29 user nova-compute[85141]:  {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:31:29 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ebf4cfdf-97a5-4901-b8e0-df0704384909 -p 172.16.0.220:3260 --interface default --op new {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:31:29 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ebf4cfdf-97a5-4901-b8e0-df0704384909 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:31:29 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[f24b5e10-540b-421f-b1db-05650e2641a5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ebf4cfdf-97a5-4901-b8e0-df0704384909] added\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:31:29 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-24f688f7-5344-420a-a420-b363d85eaaf0 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ebf4cfdf-97a5-4901-b8e0-df0704384909] added
Nov 16 10:31:29 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:31:29 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ebf4cfdf-97a5-4901-b8e0-df0704384909 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:31:29 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ebf4cfdf-97a5-4901-b8e0-df0704384909 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:31:29 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d8ce714-caa3-421c-9183-4e899458c2da]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:31:29 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-24f688f7-5344-420a-a420-b363d85eaaf0 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:31:29 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ebf4cfdf-97a5-4901-b8e0-df0704384909 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:31:29 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ebf4cfdf-97a5-4901-b8e0-df0704384909 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:31:29 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[baf440a6-ccd5-47e2-804f-d71bfc47f1cf]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:31:29 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-24f688f7-5344-420a-a420-b363d85eaaf0 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:31:29 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ebf4cfdf-97a5-4901-b8e0-df0704384909 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SPscqJGr {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:31:29 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ebf4cfdf-97a5-4901-b8e0-df0704384909 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SPscqJGr" returned: 0 in 0.018s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:31:29 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[211e8349-0ea0-4ca5-ad40-8c0d7ab94f02]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:31:29 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-24f688f7-5344-420a-a420-b363d85eaaf0 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SPscqJGr'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:31:29 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ebf4cfdf-97a5-4901-b8e0-df0704384909 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:31:29 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ebf4cfdf-97a5-4901-b8e0-df0704384909 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:31:29 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aa4d435-e8e7-4b48-88a3-197454ce92d9]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:31:29 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-24f688f7-5344-420a-a420-b363d85eaaf0 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:31:29 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:31:29 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:31:29 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5ecbf0e-100f-4b42-9004-6fbbeef104f7]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2006a77c-e5e8-4ec5-8de5-a0f9505c429a (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0c5c19d-363b-4f5d-a04f-fb7de64423f2 (non-flash)\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:31:29 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-24f688f7-5344-420a-a420-b363d85eaaf0 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2006a77c-e5e8-4ec5-8de5-a0f9505c429a (non-flash)
Nov 16 10:31:29 user nova-compute[85141]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0c5c19d-363b-4f5d-a04f-fb7de64423f2 (non-flash)
Nov 16 10:31:29 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:31:29 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-24f688f7-5344-420a-a420-b363d85eaaf0 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2006a77c-e5e8-4ec5-8de5-a0f9505c429a (non-flash)
Nov 16 10:31:29 user nova-compute[85141]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0c5c19d-363b-4f5d-a04f-fb7de64423f2 (non-flash)
Nov 16 10:31:29 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 10:31:29 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ebf4cfdf-97a5-4901-b8e0-df0704384909 -p 172.16.0.220:3260 --login {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:31:29 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ebf4cfdf-97a5-4901-b8e0-df0704384909 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:31:29 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[0326a250-fc62-4157-aed0-9ed3c45760ca]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ebf4cfdf-97a5-4901-b8e0-df0704384909, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ebf4cfdf-97a5-4901-b8e0-df0704384909, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:31:29 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-24f688f7-5344-420a-a420-b363d85eaaf0 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ebf4cfdf-97a5-4901-b8e0-df0704384909, portal: 172.16.0.220,3260]
Nov 16 10:31:29 user nova-compute[85141]: Login to [iface: default, target: iqn.2010-10.org.openstack:ebf4cfdf-97a5-4901-b8e0-df0704384909, portal: 172.16.0.220,3260] successful.
Nov 16 10:31:29 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:31:29 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ebf4cfdf-97a5-4901-b8e0-df0704384909 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:31:29 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ebf4cfdf-97a5-4901-b8e0-df0704384909 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:31:29 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d5cab07-1a1b-4783-9934-47c32863d4e7]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:31:29 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-24f688f7-5344-420a-a420-b363d85eaaf0 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:31:29 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:31:29 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:31:29 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfef5380-4f99-4242-8c21-044a1f086b17]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2006a77c-e5e8-4ec5-8de5-a0f9505c429a (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0c5c19d-363b-4f5d-a04f-fb7de64423f2 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebf4cfdf-97a5-4901-b8e0-df0704384909 (non-flash)\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:31:29 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-24f688f7-5344-420a-a420-b363d85eaaf0 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2006a77c-e5e8-4ec5-8de5-a0f9505c429a (non-flash)
Nov 16 10:31:29 user nova-compute[85141]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0c5c19d-363b-4f5d-a04f-fb7de64423f2 (non-flash)
Nov 16 10:31:29 user nova-compute[85141]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebf4cfdf-97a5-4901-b8e0-df0704384909 (non-flash)
Nov 16 10:31:29 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:31:29 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-24f688f7-5344-420a-a420-b363d85eaaf0 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2006a77c-e5e8-4ec5-8de5-a0f9505c429a (non-flash)
Nov 16 10:31:29 user nova-compute[85141]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0c5c19d-363b-4f5d-a04f-fb7de64423f2 (non-flash)
Nov 16 10:31:29 user nova-compute[85141]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebf4cfdf-97a5-4901-b8e0-df0704384909 (non-flash)
Nov 16 10:31:29 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 10:31:29 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-24f688f7-5344-420a-a420-b363d85eaaf0 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ebf4cfdf-97a5-4901-b8e0-df0704384909" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.302s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 10:31:29 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-24f688f7-5344-420a-a420-b363d85eaaf0 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] Connected to 172.16.0.220:3260 {{(pid=85141) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 10:31:29 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-24f688f7-5344-420a-a420-b363d85eaaf0 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] HCTL ('34', '-', '-', 0) found on session 47 with lun 0 {{(pid=85141) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 10:31:29 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-24f688f7-5344-420a-a420-b363d85eaaf0 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=85141) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 10:31:29 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:31:29 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:31:29 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[8998a544-3526-4da7-a483-78236c52e5f4]: (4, ('- - 0', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:31:29 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-24f688f7-5344-420a-a420-b363d85eaaf0 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] Searching for a device in session 47 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=85141) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 10:31:29 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-24f688f7-5344-420a-a420-b363d85eaaf0 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:ebf4cfdf-97a5-4901-b8e0-df0704384909', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SPscqJGr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=85141) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 10:31:29 user nova-compute[85141]: DEBUG nova.network.neutron [-] [instance: 89e358d7-0844-4742-853b-ff88800415d2] Updating instance_info_cache with network_info: [] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:31:30 user nova-compute[85141]: INFO nova.compute.manager [-] [instance: 89e358d7-0844-4742-853b-ff88800415d2] Took 0.95 seconds to deallocate network for instance.
Nov 16 10:31:30 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-d909d8f7-7a52-4a77-8837-45c543655526 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:31:30 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-d909d8f7-7a52-4a77-8837-45c543655526 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:31:30 user nova-compute[85141]: DEBUG nova.compute.provider_tree [None req-d909d8f7-7a52-4a77-8837-45c543655526 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Inventory has not changed in ProviderTree for provider: bf8e0fa1-16b6-408f-9203-c4cd63916272 {{(pid=85141) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 10:31:30 user nova-compute[85141]: DEBUG nova.scheduler.client.report [None req-d909d8f7-7a52-4a77-8837-45c543655526 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Inventory has not changed for provider bf8e0fa1-16b6-408f-9203-c4cd63916272 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=85141) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 10:31:30 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-d909d8f7-7a52-4a77-8837-45c543655526 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.304s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:31:30 user nova-compute[85141]: INFO nova.scheduler.client.report [None req-d909d8f7-7a52-4a77-8837-45c543655526 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Deleted allocations for instance 89e358d7-0844-4742-853b-ff88800415d2
Nov 16 10:31:30 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-d909d8f7-7a52-4a77-8837-45c543655526 tempest-AttachVolumeTestJSON-1609390288 tempest-AttachVolumeTestJSON-1609390288-project-member] Lock "89e358d7-0844-4742-853b-ff88800415d2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.929s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:31:30 user nova-compute[85141]: DEBUG nova.compute.manager [req-e8acfe01-bc08-4c02-8491-6ed79655c14e req-1691af2d-413a-4237-8f6c-b54af7816b17 service nova] [instance: f432d8f9-10c4-49e3-bf3b-6389f52e21ab] Received event network-vif-plugged-e8cc6756-287d-4451-9119-7ca5779ca62c {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:31:30 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-e8acfe01-bc08-4c02-8491-6ed79655c14e req-1691af2d-413a-4237-8f6c-b54af7816b17 service nova] Acquiring lock "f432d8f9-10c4-49e3-bf3b-6389f52e21ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:31:30 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-e8acfe01-bc08-4c02-8491-6ed79655c14e req-1691af2d-413a-4237-8f6c-b54af7816b17 service nova] Lock "f432d8f9-10c4-49e3-bf3b-6389f52e21ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:31:30 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-e8acfe01-bc08-4c02-8491-6ed79655c14e req-1691af2d-413a-4237-8f6c-b54af7816b17 service nova] Lock "f432d8f9-10c4-49e3-bf3b-6389f52e21ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:31:30 user nova-compute[85141]: DEBUG nova.compute.manager [req-e8acfe01-bc08-4c02-8491-6ed79655c14e req-1691af2d-413a-4237-8f6c-b54af7816b17 service nova] [instance: f432d8f9-10c4-49e3-bf3b-6389f52e21ab] No waiting events found dispatching network-vif-plugged-e8cc6756-287d-4451-9119-7ca5779ca62c {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:31:30 user nova-compute[85141]: WARNING nova.compute.manager [req-e8acfe01-bc08-4c02-8491-6ed79655c14e req-1691af2d-413a-4237-8f6c-b54af7816b17 service nova] [instance: f432d8f9-10c4-49e3-bf3b-6389f52e21ab] Received unexpected event network-vif-plugged-e8cc6756-287d-4451-9119-7ca5779ca62c for instance with vm_state building and task_state spawning.
Nov 16 10:31:30 user nova-compute[85141]: DEBUG nova.compute.manager [None req-bef83356-a9fe-4f25-8fb2-5d16702c5ff2 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] [instance: f432d8f9-10c4-49e3-bf3b-6389f52e21ab] Instance event wait completed in 0 seconds for  {{(pid=85141) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 10:31:30 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-bef83356-a9fe-4f25-8fb2-5d16702c5ff2 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] [instance: f432d8f9-10c4-49e3-bf3b-6389f52e21ab] Guest created on hypervisor {{(pid=85141) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 10:31:30 user nova-compute[85141]: INFO nova.virt.libvirt.driver [-] [instance: f432d8f9-10c4-49e3-bf3b-6389f52e21ab] Instance spawned successfully.
Nov 16 10:31:30 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-bef83356-a9fe-4f25-8fb2-5d16702c5ff2 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] [instance: f432d8f9-10c4-49e3-bf3b-6389f52e21ab] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 10:31:30 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-bef83356-a9fe-4f25-8fb2-5d16702c5ff2 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] [instance: f432d8f9-10c4-49e3-bf3b-6389f52e21ab] Found default for hw_input_bus of None {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:31:30 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-bef83356-a9fe-4f25-8fb2-5d16702c5ff2 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] [instance: f432d8f9-10c4-49e3-bf3b-6389f52e21ab] Found default for hw_pointer_model of None {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:31:30 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-24f688f7-5344-420a-a420-b363d85eaaf0 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.345s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 10:31:30 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-24f688f7-5344-420a-a420-b363d85eaaf0 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] <== connect_volume: return (1347ms) {'type': 'block', 'scsi_wwn': '23666393662633037', 'path': '/dev/sdc'} {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 10:31:30 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-24f688f7-5344-420a-a420-b363d85eaaf0 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] [instance: 7437a3a3-9b7f-489b-b20b-f1b877ebb253] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23666393662633037', 'path': '/dev/sdc'} {{(pid=85141) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 10:31:30 user nova-compute[85141]: DEBUG nova.objects.instance [None req-24f688f7-5344-420a-a420-b363d85eaaf0 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] Lazy-loading 'flavor' on Instance uuid 7437a3a3-9b7f-489b-b20b-f1b877ebb253 {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:31:30 user nova-compute[85141]: DEBUG nova.virt.libvirt.guest [None req-24f688f7-5344-420a-a420-b363d85eaaf0 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 10:31:30 user nova-compute[85141]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 10:31:30 user nova-compute[85141]:   <source dev="/dev/sdc"/>
Nov 16 10:31:30 user nova-compute[85141]:   <target dev="vdb" bus="virtio"/>
Nov 16 10:31:30 user nova-compute[85141]:   <serial>ebf4cfdf-97a5-4901-b8e0-df0704384909</serial>
Nov 16 10:31:30 user nova-compute[85141]: </disk>
Nov 16 10:31:30 user nova-compute[85141]:  {{(pid=85141) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 10:31:30 user nova-compute[85141]: INFO nova.compute.manager [None req-bef83356-a9fe-4f25-8fb2-5d16702c5ff2 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] [instance: f432d8f9-10c4-49e3-bf3b-6389f52e21ab] Took 8.90 seconds to spawn the instance on the hypervisor.
Nov 16 10:31:30 user nova-compute[85141]: DEBUG nova.compute.manager [None req-bef83356-a9fe-4f25-8fb2-5d16702c5ff2 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] [instance: f432d8f9-10c4-49e3-bf3b-6389f52e21ab] Checking state {{(pid=85141) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 10:31:31 user nova-compute[85141]: INFO nova.compute.manager [None req-bef83356-a9fe-4f25-8fb2-5d16702c5ff2 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] [instance: f432d8f9-10c4-49e3-bf3b-6389f52e21ab] Took 9.83 seconds to build instance.
Nov 16 10:31:31 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-bef83356-a9fe-4f25-8fb2-5d16702c5ff2 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Lock "f432d8f9-10c4-49e3-bf3b-6389f52e21ab" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.955s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:31:31 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-24f688f7-5344-420a-a420-b363d85eaaf0 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] No BDM found with device name vda, not building metadata. {{(pid=85141) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 10:31:31 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-24f688f7-5344-420a-a420-b363d85eaaf0 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] No BDM found with device name vdb, not building metadata. {{(pid=85141) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 10:31:31 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-24f688f7-5344-420a-a420-b363d85eaaf0 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] No VIF found with MAC fa:16:3e:7e:27:4c, not building metadata {{(pid=85141) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 10:31:31 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-24f688f7-5344-420a-a420-b363d85eaaf0 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] Lock "7437a3a3-9b7f-489b-b20b-f1b877ebb253" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.577s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:31:31 user nova-compute[85141]: DEBUG nova.compute.manager [req-14caa0ad-6358-46cd-a979-4508678fb1ca req-6f8aa6f1-1bf8-42e7-b178-d3c5074b1e24 service nova] [instance: 89e358d7-0844-4742-853b-ff88800415d2] Received event network-vif-deleted-b60a8a3c-4aac-4af1-ba04-d8a61ab96324 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:31:32 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:31:33 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:31:33 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:31:34 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:31:34 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Starting heal instance info cache {{(pid=85141) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 10:31:34 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Didn't find any instances for network info cache update. {{(pid=85141) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 16 10:31:34 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:31:36 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5a97d81e-49ce-4abd-903d-00478cf05fa4 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] Acquiring lock "7437a3a3-9b7f-489b-b20b-f1b877ebb253" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:31:36 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5a97d81e-49ce-4abd-903d-00478cf05fa4 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] Lock "7437a3a3-9b7f-489b-b20b-f1b877ebb253" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:31:36 user nova-compute[85141]: DEBUG nova.objects.instance [None req-5a97d81e-49ce-4abd-903d-00478cf05fa4 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] Lazy-loading 'flavor' on Instance uuid 7437a3a3-9b7f-489b-b20b-f1b877ebb253 {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:31:36 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5a97d81e-49ce-4abd-903d-00478cf05fa4 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] Lock "7437a3a3-9b7f-489b-b20b-f1b877ebb253" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:31:36 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:31:36 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Cleaning up deleted instances with incomplete migration  {{(pid=85141) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 16 10:31:36 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5a97d81e-49ce-4abd-903d-00478cf05fa4 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] Acquiring lock "7437a3a3-9b7f-489b-b20b-f1b877ebb253" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:31:36 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5a97d81e-49ce-4abd-903d-00478cf05fa4 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] Lock "7437a3a3-9b7f-489b-b20b-f1b877ebb253" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:31:36 user nova-compute[85141]: INFO nova.compute.manager [None req-5a97d81e-49ce-4abd-903d-00478cf05fa4 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] [instance: 7437a3a3-9b7f-489b-b20b-f1b877ebb253] Attaching volume aafe4bc8-430a-4d9d-93c7-ec25981b8bb0 to /dev/vdc
Nov 16 10:31:36 user nova-compute[85141]: DEBUG os_brick.utils [None req-5a97d81e-49ce-4abd-903d-00478cf05fa4 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 10:31:36 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:31:36 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:31:36 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[915b3f9d-0936-48e2-b163-7d97e4b32145]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c7834de5c295\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:31:36 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:31:36 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:31:36 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[13861ebd-721d-4352-a58a-ce9eee388d7a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:31:36 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:31:36 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:31:36 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:31:36 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d346d18-2067-43c4-b286-303de3757ce0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:31:36 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9f28398-6a2a-44b6-b84d-f2185cc8badb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:31:36 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5a97d81e-49ce-4abd-903d-00478cf05fa4 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] Running cmd (subprocess): nvme version {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:31:36 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5a97d81e-49ce-4abd-903d-00478cf05fa4 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] 'nvme version' failed. Not Retrying. {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 10:31:36 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5a97d81e-49ce-4abd-903d-00478cf05fa4 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] nvme not present on system {{(pid=85141) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 10:31:36 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:31:36 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 10:31:36 user nova-compute[85141]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 10:31:36 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[b66d8fa7-ce18-4e9a-8364-caed60454983]: (4, '') {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:31:36 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.lightos [None req-5a97d81e-49ce-4abd-903d-00478cf05fa4 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=85141) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 10:31:36 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.lightos [None req-5a97d81e-49ce-4abd-903d-00478cf05fa4 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=85141) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 10:31:36 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.lightos [None req-5a97d81e-49ce-4abd-903d-00478cf05fa4 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] LIGHTOS: no hostnqn found. {{(pid=85141) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 10:31:36 user nova-compute[85141]: DEBUG os_brick.utils [None req-5a97d81e-49ce-4abd-903d-00478cf05fa4 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c7834de5c295', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 10:31:36 user nova-compute[85141]: DEBUG nova.virt.block_device [None req-5a97d81e-49ce-4abd-903d-00478cf05fa4 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] [instance: 7437a3a3-9b7f-489b-b20b-f1b877ebb253] Updating existing volume attachment record: d7609738-fbc6-4ccc-a2df-3fa58638dd81 {{(pid=85141) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 10:31:37 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager.update_available_resource {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:31:37 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:31:37 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:31:37 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:31:37 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Auditing locally available compute resources for user (node: user) {{(pid=85141) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 10:31:37 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a507c85-0369-48ea-8858-3e7d346b4cb0/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:31:37 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a507c85-0369-48ea-8858-3e7d346b4cb0/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:31:37 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a507c85-0369-48ea-8858-3e7d346b4cb0/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:31:37 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a507c85-0369-48ea-8858-3e7d346b4cb0/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:31:37 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e214bbb-5bbb-4e6f-ac09-9cb1412f068b/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:31:38 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e214bbb-5bbb-4e6f-ac09-9cb1412f068b/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:31:38 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e214bbb-5bbb-4e6f-ac09-9cb1412f068b/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:31:38 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e214bbb-5bbb-4e6f-ac09-9cb1412f068b/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:31:38 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=85141) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 10:31:38 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7437a3a3-9b7f-489b-b20b-f1b877ebb253/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:31:38 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:31:38 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7437a3a3-9b7f-489b-b20b-f1b877ebb253/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:31:38 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7437a3a3-9b7f-489b-b20b-f1b877ebb253/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:31:38 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7437a3a3-9b7f-489b-b20b-f1b877ebb253/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:31:38 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=85141) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 10:31:38 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f432d8f9-10c4-49e3-bf3b-6389f52e21ab/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:31:38 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f432d8f9-10c4-49e3-bf3b-6389f52e21ab/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:31:38 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f432d8f9-10c4-49e3-bf3b-6389f52e21ab/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:31:38 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:31:39 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f432d8f9-10c4-49e3-bf3b-6389f52e21ab/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:31:39 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/059d6974-bd0c-4f73-91fc-8202ebda4238/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:31:39 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-c8ee4a36-790c-4d26-ade0-1f1645727e52 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Acquiring lock "bc76703d-9243-4277-9b13-d6f9639cd1bb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:31:39 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-c8ee4a36-790c-4d26-ade0-1f1645727e52 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Lock "bc76703d-9243-4277-9b13-d6f9639cd1bb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.008s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:31:39 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-c8ee4a36-790c-4d26-ade0-1f1645727e52 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Acquiring lock "bc76703d-9243-4277-9b13-d6f9639cd1bb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:31:39 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-c8ee4a36-790c-4d26-ade0-1f1645727e52 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Lock "bc76703d-9243-4277-9b13-d6f9639cd1bb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:31:39 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-c8ee4a36-790c-4d26-ade0-1f1645727e52 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Lock "bc76703d-9243-4277-9b13-d6f9639cd1bb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:31:39 user nova-compute[85141]: INFO nova.compute.manager [None req-c8ee4a36-790c-4d26-ade0-1f1645727e52 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] [instance: bc76703d-9243-4277-9b13-d6f9639cd1bb] Terminating instance
Nov 16 10:31:39 user nova-compute[85141]: DEBUG nova.compute.manager [None req-c8ee4a36-790c-4d26-ade0-1f1645727e52 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] [instance: bc76703d-9243-4277-9b13-d6f9639cd1bb] Start destroying the instance on the hypervisor. {{(pid=85141) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 10:31:39 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/059d6974-bd0c-4f73-91fc-8202ebda4238/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:31:39 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/059d6974-bd0c-4f73-91fc-8202ebda4238/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:31:39 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:31:39 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:31:39 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/059d6974-bd0c-4f73-91fc-8202ebda4238/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:31:39 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=85141) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 10:31:39 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da42de06-4518-4c8a-8c63-9b5a2759a1bf/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:31:39 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:31:39 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:31:39 user nova-compute[85141]: DEBUG nova.compute.manager [req-8a7ad392-572b-4e78-ae53-af5e9f4368fe req-536c9dba-6efc-4d42-afef-a814d86b112d service nova] [instance: bc76703d-9243-4277-9b13-d6f9639cd1bb] Received event network-vif-unplugged-fbf147e2-d8e0-4cb5-8ec5-79756fc53140 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:31:39 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-8a7ad392-572b-4e78-ae53-af5e9f4368fe req-536c9dba-6efc-4d42-afef-a814d86b112d service nova] Acquiring lock "bc76703d-9243-4277-9b13-d6f9639cd1bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:31:39 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-8a7ad392-572b-4e78-ae53-af5e9f4368fe req-536c9dba-6efc-4d42-afef-a814d86b112d service nova] Lock "bc76703d-9243-4277-9b13-d6f9639cd1bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:31:39 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-8a7ad392-572b-4e78-ae53-af5e9f4368fe req-536c9dba-6efc-4d42-afef-a814d86b112d service nova] Lock "bc76703d-9243-4277-9b13-d6f9639cd1bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:31:39 user nova-compute[85141]: DEBUG nova.compute.manager [req-8a7ad392-572b-4e78-ae53-af5e9f4368fe req-536c9dba-6efc-4d42-afef-a814d86b112d service nova] [instance: bc76703d-9243-4277-9b13-d6f9639cd1bb] No waiting events found dispatching network-vif-unplugged-fbf147e2-d8e0-4cb5-8ec5-79756fc53140 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:31:39 user nova-compute[85141]: DEBUG nova.compute.manager [req-8a7ad392-572b-4e78-ae53-af5e9f4368fe req-536c9dba-6efc-4d42-afef-a814d86b112d service nova] [instance: bc76703d-9243-4277-9b13-d6f9639cd1bb] Received event network-vif-unplugged-fbf147e2-d8e0-4cb5-8ec5-79756fc53140 for instance with task_state deleting. {{(pid=85141) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 10:31:39 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da42de06-4518-4c8a-8c63-9b5a2759a1bf/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:31:39 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da42de06-4518-4c8a-8c63-9b5a2759a1bf/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:31:39 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da42de06-4518-4c8a-8c63-9b5a2759a1bf/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:31:40 user nova-compute[85141]: INFO nova.virt.libvirt.driver [-] [instance: bc76703d-9243-4277-9b13-d6f9639cd1bb] Instance destroyed successfully.
Nov 16 10:31:40 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:31:40 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:31:40 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Hypervisor/Node resource view: name=user free_ram=7906MB free_disk=24.93572998046875GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=85141) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 10:31:40 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:31:40 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:31:40 user nova-compute[85141]: DEBUG nova.objects.instance [None req-c8ee4a36-790c-4d26-ade0-1f1645727e52 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Lazy-loading 'resources' on Instance uuid bc76703d-9243-4277-9b13-d6f9639cd1bb {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:31:40 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-c8ee4a36-790c-4d26-ade0-1f1645727e52 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T10:25:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-331499197',display_name='tempest-ServerActionsTestOtherA-server-331499197',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-331499197',id=34,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFB91nOE4JIg0PQZ9Fq9iMRTb/Qm6bpwHSXAkC8g5YxG6awy4b4nS0XAfWSm4O4f40Blu3eMfyuYdZY8eI6KFpQYslLrgvG2jeJNbK6AHNNiLWxDV8sQbQZDDAy7NeOUMQ==',key_name='tempest-keypair-799272913',keypairs=<?>,launch_index=0,launched_at=2023-11-16T10:27:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='879fa3f4dfc34726b20149b8a7db22dc',ramdisk_id='',reservation_id='r-01yoy1pt',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1137992555',owner_user_name='tempest-ServerActionsTestOtherA-1137992555-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T10:28:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e95802a919de4345add493a8d7873e48',uuid=bc76703d-9243-4277-9b13-d6f9639cd1bb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fbf147e2-d8e0-4cb5-8ec5-79756fc53140", "address": "fa:16:3e:a1:42:09", "network": {"id": "859d1f09-56c4-4c2b-b2c3-02b1938e8dbf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1562516834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "879fa3f4dfc34726b20149b8a7db22dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbf147e2-d8", "ovs_interfaceid": "fbf147e2-d8e0-4cb5-8ec5-79756fc53140", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 10:31:40 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-c8ee4a36-790c-4d26-ade0-1f1645727e52 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Converting VIF {"id": "fbf147e2-d8e0-4cb5-8ec5-79756fc53140", "address": "fa:16:3e:a1:42:09", "network": {"id": "859d1f09-56c4-4c2b-b2c3-02b1938e8dbf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1562516834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "879fa3f4dfc34726b20149b8a7db22dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbf147e2-d8", "ovs_interfaceid": "fbf147e2-d8e0-4cb5-8ec5-79756fc53140", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:31:40 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-c8ee4a36-790c-4d26-ade0-1f1645727e52 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a1:42:09,bridge_name='br-int',has_traffic_filtering=True,id=fbf147e2-d8e0-4cb5-8ec5-79756fc53140,network=Network(859d1f09-56c4-4c2b-b2c3-02b1938e8dbf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfbf147e2-d8') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:31:40 user nova-compute[85141]: DEBUG os_vif [None req-c8ee4a36-790c-4d26-ade0-1f1645727e52 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a1:42:09,bridge_name='br-int',has_traffic_filtering=True,id=fbf147e2-d8e0-4cb5-8ec5-79756fc53140,network=Network(859d1f09-56c4-4c2b-b2c3-02b1938e8dbf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfbf147e2-d8') {{(pid=85141) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 10:31:40 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:31:40 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfbf147e2-d8, bridge=br-int, if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:31:40 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:31:40 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:31:40 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:31:40 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4cb47623-7248-4fd8-8692-2e245b239624) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:31:40 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:31:40 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:31:40 user nova-compute[85141]: INFO os_vif [None req-c8ee4a36-790c-4d26-ade0-1f1645727e52 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a1:42:09,bridge_name='br-int',has_traffic_filtering=True,id=fbf147e2-d8e0-4cb5-8ec5-79756fc53140,network=Network(859d1f09-56c4-4c2b-b2c3-02b1938e8dbf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfbf147e2-d8')
Nov 16 10:31:40 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c8ee4a36-790c-4d26-ade0-1f1645727e52 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] [instance: bc76703d-9243-4277-9b13-d6f9639cd1bb] calling os-brick to detach iSCSI Volume {{(pid=85141) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 10:31:40 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8ee4a36-790c-4d26-ade0-1f1645727e52 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51806b6080>, {'target_iqn': 'iqn.2010-10.org.openstack:2006a77c-e5e8-4ec5-8de5-a0f9505c429a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vdtqwVjE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 10:31:40 user nova-compute[85141]: WARNING os_brick.initiator.connectors.base [None req-c8ee4a36-790c-4d26-ade0-1f1645727e52 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 10:31:40 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-c8ee4a36-790c-4d26-ade0-1f1645727e52 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 10:31:40 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-c8ee4a36-790c-4d26-ade0-1f1645727e52 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 10:31:40 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:31:40 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.035s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:31:40 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[55efa3a1-3833-4c10-8265-9cd1d93bc795]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e0c5c19d-363b-4f5d-a04f-fb7de64423f2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2006a77c-e5e8-4ec5-8de5-a0f9505c429a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ebf4cfdf-97a5-4901-b8e0-df0704384909\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:31:40 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8ee4a36-790c-4d26-ade0-1f1645727e52 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 10:31:40 user nova-compute[85141]: No targets found.
Nov 16 10:31:40 user nova-compute[85141]: iSNS:
Nov 16 10:31:40 user nova-compute[85141]: No targets found.
Nov 16 10:31:40 user nova-compute[85141]: STATIC:
Nov 16 10:31:40 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:e0c5c19d-363b-4f5d-a04f-fb7de64423f2
Nov 16 10:31:40 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:31:40 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:31:40 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:2006a77c-e5e8-4ec5-8de5-a0f9505c429a
Nov 16 10:31:40 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:31:40 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:31:40 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:ebf4cfdf-97a5-4901-b8e0-df0704384909
Nov 16 10:31:40 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:31:40 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:31:40 user nova-compute[85141]: FIRMWARE:
Nov 16 10:31:40 user nova-compute[85141]: No targets found.
Nov 16 10:31:40 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:31:40 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8ee4a36-790c-4d26-ade0-1f1645727e52 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 10:31:40 user nova-compute[85141]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 10:31:40 user nova-compute[85141]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=85141) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 10:31:40 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8ee4a36-790c-4d26-ade0-1f1645727e52 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2006a77c-e5e8-4ec5-8de5-a0f9505c429a', 0)] {{(pid=85141) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 10:31:40 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:31:40 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.049s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:31:40 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[b89d9cfe-6e82-4fb2-a170-c4cea6fec130]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2006a77c-e5e8-4ec5-8de5-a0f9505c429a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e0c5c19d-363b-4f5d-a04f-fb7de64423f2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ebf4cfdf-97a5-4901-b8e0-df0704384909\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:31:40 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:31:40 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:31:40 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:31:40 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c24f533-3b84-40ae-8704-aab2a40eb517]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2006a77c-e5e8-4ec5-8de5-a0f9505c429a (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0c5c19d-363b-4f5d-a04f-fb7de64423f2 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebf4cfdf-97a5-4901-b8e0-df0704384909 (non-flash)\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:31:40 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8ee4a36-790c-4d26-ade0-1f1645727e52 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2006a77c-e5e8-4ec5-8de5-a0f9505c429a (non-flash)
Nov 16 10:31:40 user nova-compute[85141]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0c5c19d-363b-4f5d-a04f-fb7de64423f2 (non-flash)
Nov 16 10:31:40 user nova-compute[85141]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebf4cfdf-97a5-4901-b8e0-df0704384909 (non-flash)
Nov 16 10:31:40 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:31:40 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8ee4a36-790c-4d26-ade0-1f1645727e52 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2006a77c-e5e8-4ec5-8de5-a0f9505c429a (non-flash)
Nov 16 10:31:40 user nova-compute[85141]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0c5c19d-363b-4f5d-a04f-fb7de64423f2 (non-flash)
Nov 16 10:31:40 user nova-compute[85141]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebf4cfdf-97a5-4901-b8e0-df0704384909 (non-flash)
Nov 16 10:31:40 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 10:31:40 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8ee4a36-790c-4d26-ade0-1f1645727e52 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f51802995a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2006a77c-e5e8-4ec5-8de5-a0f9505c429a'): ({'sdb'}, set())}) {{(pid=85141) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 10:31:40 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-c8ee4a36-790c-4d26-ade0-1f1645727e52 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Removing single pathed devices sdb {{(pid=85141) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 10:31:40 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:31:40 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:31:40 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[99216577-c6d1-467b-99c1-30bbd164808b]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:31:40 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:31:40 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.029s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:31:40 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a3f37cb-001c-40af-887a-91473e9e2fa9]: (4, ('ok\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:31:40 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-c8ee4a36-790c-4d26-ade0-1f1645727e52 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Flushing IO for device /dev/sdb {{(pid=85141) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 10:31:40 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:31:40 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.031s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:31:40 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[090b7a3e-e8b3-4514-bc16-ed41cb85d354]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:31:40 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-c8ee4a36-790c-4d26-ade0-1f1645727e52 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=85141) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 10:31:40 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:31:40 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.049s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:31:40 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[302eaa35-3cb1-4f19-952e-231751e5eb53]: (4, ('1', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:31:40 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-c8ee4a36-790c-4d26-ade0-1f1645727e52 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=85141) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 10:31:40 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-c8ee4a36-790c-4d26-ade0-1f1645727e52 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] SCSI volumes sdb have been removed. {{(pid=85141) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 10:31:40 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8ee4a36-790c-4d26-ade0-1f1645727e52 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2006a77c-e5e8-4ec5-8de5-a0f9505c429a')] {{(pid=85141) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 10:31:40 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2006a77c-e5e8-4ec5-8de5-a0f9505c429a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:31:40 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2006a77c-e5e8-4ec5-8de5-a0f9505c429a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:31:40 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fc7a9f1-e508-4a37-8aa8-79d33e1e0366]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:31:40 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8ee4a36-790c-4d26-ade0-1f1645727e52 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:31:40 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2006a77c-e5e8-4ec5-8de5-a0f9505c429a -p 172.16.0.220:3260 --logout {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:31:40 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance 059d6974-bd0c-4f73-91fc-8202ebda4238 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:31:40 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance 4e214bbb-5bbb-4e6f-ac09-9cb1412f068b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:31:40 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance 5a507c85-0369-48ea-8858-3e7d346b4cb0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:31:40 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance bc76703d-9243-4277-9b13-d6f9639cd1bb actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:31:40 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance e1253324-3ca1-4610-b9d6-3db7c6c76828 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:31:40 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance da42de06-4518-4c8a-8c63-9b5a2759a1bf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:31:40 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance 7437a3a3-9b7f-489b-b20b-f1b877ebb253 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:31:40 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance f432d8f9-10c4-49e3-bf3b-6389f52e21ab actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:31:40 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=85141) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 10:31:40 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=85141) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 10:31:40 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2006a77c-e5e8-4ec5-8de5-a0f9505c429a -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:31:40 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[58d53cb7-b3cc-47d3-b3c1-308ba5c11bb9]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:2006a77c-e5e8-4ec5-8de5-a0f9505c429a, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:2006a77c-e5e8-4ec5-8de5-a0f9505c429a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:31:40 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8ee4a36-790c-4d26-ade0-1f1645727e52 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:2006a77c-e5e8-4ec5-8de5-a0f9505c429a, portal: 172.16.0.220,3260]
Nov 16 10:31:40 user nova-compute[85141]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:2006a77c-e5e8-4ec5-8de5-a0f9505c429a, portal: 172.16.0.220,3260] successful.
Nov 16 10:31:40 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:31:40 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2006a77c-e5e8-4ec5-8de5-a0f9505c429a -p 172.16.0.220:3260 --op delete {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:31:41 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2006a77c-e5e8-4ec5-8de5-a0f9505c429a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:31:41 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[0621713e-789e-4b32-b75f-9f1ab8f55145]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:31:41 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8ee4a36-790c-4d26-ade0-1f1645727e52 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:31:41 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-c8ee4a36-790c-4d26-ade0-1f1645727e52 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.422s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 10:31:41 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8ee4a36-790c-4d26-ade0-1f1645727e52 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] <== disconnect_volume: return (424ms) None {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 10:31:41 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c8ee4a36-790c-4d26-ade0-1f1645727e52 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] [instance: bc76703d-9243-4277-9b13-d6f9639cd1bb] Disconnected iSCSI Volume {{(pid=85141) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 10:31:41 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-c8ee4a36-790c-4d26-ade0-1f1645727e52 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] [instance: bc76703d-9243-4277-9b13-d6f9639cd1bb] Deleting instance files /opt/stack/data/nova/instances/bc76703d-9243-4277-9b13-d6f9639cd1bb_del
Nov 16 10:31:41 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-c8ee4a36-790c-4d26-ade0-1f1645727e52 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] [instance: bc76703d-9243-4277-9b13-d6f9639cd1bb] Deletion of /opt/stack/data/nova/instances/bc76703d-9243-4277-9b13-d6f9639cd1bb_del complete
Nov 16 10:31:41 user nova-compute[85141]: INFO nova.compute.manager [None req-c8ee4a36-790c-4d26-ade0-1f1645727e52 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] [instance: bc76703d-9243-4277-9b13-d6f9639cd1bb] Took 1.82 seconds to destroy the instance on the hypervisor.
Nov 16 10:31:41 user nova-compute[85141]: DEBUG oslo.service.loopingcall [None req-c8ee4a36-790c-4d26-ade0-1f1645727e52 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=85141) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 10:31:41 user nova-compute[85141]: DEBUG nova.compute.manager [-] [instance: bc76703d-9243-4277-9b13-d6f9639cd1bb] Deallocating network for instance {{(pid=85141) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 10:31:41 user nova-compute[85141]: DEBUG nova.network.neutron [-] [instance: bc76703d-9243-4277-9b13-d6f9639cd1bb] deallocate_for_instance() {{(pid=85141) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 10:31:41 user nova-compute[85141]: DEBUG nova.compute.provider_tree [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Inventory has not changed in ProviderTree for provider: bf8e0fa1-16b6-408f-9203-c4cd63916272 {{(pid=85141) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 10:31:41 user nova-compute[85141]: DEBUG nova.scheduler.client.report [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Inventory has not changed for provider bf8e0fa1-16b6-408f-9203-c4cd63916272 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=85141) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 10:31:41 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Compute_service record updated for user:user {{(pid=85141) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 10:31:41 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.738s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:31:41 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:31:41 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Cleaning up deleted instances {{(pid=85141) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 16 10:31:41 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] There are 0 instances to clean {{(pid=85141) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 16 10:31:41 user nova-compute[85141]: DEBUG nova.compute.manager [req-bc8d2e10-b7ab-4e95-8fb7-c91816864d87 req-9aaa3c6b-a340-4dc5-9a36-9d95cbd91ac6 service nova] [instance: bc76703d-9243-4277-9b13-d6f9639cd1bb] Received event network-vif-plugged-fbf147e2-d8e0-4cb5-8ec5-79756fc53140 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:31:41 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-bc8d2e10-b7ab-4e95-8fb7-c91816864d87 req-9aaa3c6b-a340-4dc5-9a36-9d95cbd91ac6 service nova] Acquiring lock "bc76703d-9243-4277-9b13-d6f9639cd1bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:31:41 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-bc8d2e10-b7ab-4e95-8fb7-c91816864d87 req-9aaa3c6b-a340-4dc5-9a36-9d95cbd91ac6 service nova] Lock "bc76703d-9243-4277-9b13-d6f9639cd1bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:31:41 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-bc8d2e10-b7ab-4e95-8fb7-c91816864d87 req-9aaa3c6b-a340-4dc5-9a36-9d95cbd91ac6 service nova] Lock "bc76703d-9243-4277-9b13-d6f9639cd1bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:31:41 user nova-compute[85141]: DEBUG nova.compute.manager [req-bc8d2e10-b7ab-4e95-8fb7-c91816864d87 req-9aaa3c6b-a340-4dc5-9a36-9d95cbd91ac6 service nova] [instance: bc76703d-9243-4277-9b13-d6f9639cd1bb] No waiting events found dispatching network-vif-plugged-fbf147e2-d8e0-4cb5-8ec5-79756fc53140 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:31:41 user nova-compute[85141]: WARNING nova.compute.manager [req-bc8d2e10-b7ab-4e95-8fb7-c91816864d87 req-9aaa3c6b-a340-4dc5-9a36-9d95cbd91ac6 service nova] [instance: bc76703d-9243-4277-9b13-d6f9639cd1bb] Received unexpected event network-vif-plugged-fbf147e2-d8e0-4cb5-8ec5-79756fc53140 for instance with vm_state active and task_state deleting.
Nov 16 10:31:42 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:31:42 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:31:42 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:31:42 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:31:42 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=85141) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 10:31:42 user nova-compute[85141]: DEBUG nova.network.neutron [-] [instance: bc76703d-9243-4277-9b13-d6f9639cd1bb] Updating instance_info_cache with network_info: [] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:31:42 user nova-compute[85141]: INFO nova.compute.manager [-] [instance: bc76703d-9243-4277-9b13-d6f9639cd1bb] Took 1.24 seconds to deallocate network for instance.
Nov 16 10:31:42 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5a97d81e-49ce-4abd-903d-00478cf05fa4 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] [instance: 7437a3a3-9b7f-489b-b20b-f1b877ebb253] Calling os-brick to attach iSCSI Volume {{(pid=85141) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 10:31:42 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a97d81e-49ce-4abd-903d-00478cf05fa4 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51806b6080>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:aafe4bc8-430a-4d9d-93c7-ec25981b8bb0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kwVRpEhH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 10:31:42 user nova-compute[85141]: WARNING os_brick.initiator.connectors.base [None req-5a97d81e-49ce-4abd-903d-00478cf05fa4 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 10:31:42 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-5a97d81e-49ce-4abd-903d-00478cf05fa4 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 10:31:42 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-5a97d81e-49ce-4abd-903d-00478cf05fa4 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 10:31:42 user nova-compute[85141]: WARNING os_brick.initiator.connectors.base [None req-5a97d81e-49ce-4abd-903d-00478cf05fa4 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 10:31:42 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-5a97d81e-49ce-4abd-903d-00478cf05fa4 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aafe4bc8-430a-4d9d-93c7-ec25981b8bb0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 10:31:42 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-5a97d81e-49ce-4abd-903d-00478cf05fa4 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aafe4bc8-430a-4d9d-93c7-ec25981b8bb0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 10:31:42 user nova-compute[85141]: INFO os_brick.initiator.connectors.iscsi [None req-5a97d81e-49ce-4abd-903d-00478cf05fa4 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 10:31:42 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aafe4bc8-430a-4d9d-93c7-ec25981b8bb0 -p 172.16.0.220:3260 {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:31:42 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aafe4bc8-430a-4d9d-93c7-ec25981b8bb0 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:31:42 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[da8f9d4f-db26-4110-bc65-329e4a5f0cfd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:31:42 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a97d81e-49ce-4abd-903d-00478cf05fa4 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 10:31:42 user nova-compute[85141]:  {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:31:42 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aafe4bc8-430a-4d9d-93c7-ec25981b8bb0 -p 172.16.0.220:3260 --interface default --op new {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:31:42 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aafe4bc8-430a-4d9d-93c7-ec25981b8bb0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:31:42 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fbad12e-45c3-4d08-90c2-2657fb7e5d26]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:aafe4bc8-430a-4d9d-93c7-ec25981b8bb0] added\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:31:42 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a97d81e-49ce-4abd-903d-00478cf05fa4 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:aafe4bc8-430a-4d9d-93c7-ec25981b8bb0] added
Nov 16 10:31:42 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:31:42 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aafe4bc8-430a-4d9d-93c7-ec25981b8bb0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:31:42 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aafe4bc8-430a-4d9d-93c7-ec25981b8bb0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:31:42 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4f53a63-15b4-40da-ab0a-dee38c594113]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:31:42 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a97d81e-49ce-4abd-903d-00478cf05fa4 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:31:42 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aafe4bc8-430a-4d9d-93c7-ec25981b8bb0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:31:42 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aafe4bc8-430a-4d9d-93c7-ec25981b8bb0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:31:42 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c93bfbb-866e-4870-a293-20b9e5cf3edc]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:31:42 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a97d81e-49ce-4abd-903d-00478cf05fa4 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:31:42 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aafe4bc8-430a-4d9d-93c7-ec25981b8bb0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kwVRpEhH {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:31:42 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aafe4bc8-430a-4d9d-93c7-ec25981b8bb0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kwVRpEhH" returned: 0 in 0.024s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:31:42 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[065bbb49-aa94-4466-b12a-3e7548d27bf6]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:31:42 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a97d81e-49ce-4abd-903d-00478cf05fa4 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kwVRpEhH'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:31:42 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aafe4bc8-430a-4d9d-93c7-ec25981b8bb0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:31:42 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aafe4bc8-430a-4d9d-93c7-ec25981b8bb0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.029s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:31:42 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8b44272-d25f-41fc-8256-0aa80e1768f9]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:31:42 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a97d81e-49ce-4abd-903d-00478cf05fa4 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:31:42 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:31:42 user nova-compute[85141]: DEBUG nova.compute.manager [req-fa616cc0-3bd5-4e23-903f-e4777846f2c1 req-fa5ff020-7f92-4c0c-9867-8f699b09cc03 service nova] [instance: bc76703d-9243-4277-9b13-d6f9639cd1bb] Received event network-vif-deleted-fbf147e2-d8e0-4cb5-8ec5-79756fc53140 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:31:42 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:31:42 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f4ce49b-00ff-49c2-b95d-763dc7815b78]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0c5c19d-363b-4f5d-a04f-fb7de64423f2 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebf4cfdf-97a5-4901-b8e0-df0704384909 (non-flash)\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:31:42 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a97d81e-49ce-4abd-903d-00478cf05fa4 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0c5c19d-363b-4f5d-a04f-fb7de64423f2 (non-flash)
Nov 16 10:31:42 user nova-compute[85141]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebf4cfdf-97a5-4901-b8e0-df0704384909 (non-flash)
Nov 16 10:31:42 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:31:42 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a97d81e-49ce-4abd-903d-00478cf05fa4 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0c5c19d-363b-4f5d-a04f-fb7de64423f2 (non-flash)
Nov 16 10:31:42 user nova-compute[85141]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebf4cfdf-97a5-4901-b8e0-df0704384909 (non-flash)
Nov 16 10:31:42 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 10:31:42 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aafe4bc8-430a-4d9d-93c7-ec25981b8bb0 -p 172.16.0.220:3260 --login {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:31:42 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:31:42 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aafe4bc8-430a-4d9d-93c7-ec25981b8bb0 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:31:42 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[26d225f7-e0a4-479e-b942-7263e65b630e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:aafe4bc8-430a-4d9d-93c7-ec25981b8bb0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:aafe4bc8-430a-4d9d-93c7-ec25981b8bb0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:31:42 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a97d81e-49ce-4abd-903d-00478cf05fa4 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:aafe4bc8-430a-4d9d-93c7-ec25981b8bb0, portal: 172.16.0.220,3260]
Nov 16 10:31:42 user nova-compute[85141]: Login to [iface: default, target: iqn.2010-10.org.openstack:aafe4bc8-430a-4d9d-93c7-ec25981b8bb0, portal: 172.16.0.220,3260] successful.
Nov 16 10:31:42 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:31:42 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aafe4bc8-430a-4d9d-93c7-ec25981b8bb0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:31:42 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aafe4bc8-430a-4d9d-93c7-ec25981b8bb0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:31:42 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b662dac-17f2-45df-9b08-8c77430f7fef]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:31:42 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a97d81e-49ce-4abd-903d-00478cf05fa4 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:31:42 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:31:42 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:31:42 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[93b1b3a3-9542-4dcf-822b-48f9bca9d573]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0c5c19d-363b-4f5d-a04f-fb7de64423f2 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebf4cfdf-97a5-4901-b8e0-df0704384909 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aafe4bc8-430a-4d9d-93c7-ec25981b8bb0 (non-flash)\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:31:42 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a97d81e-49ce-4abd-903d-00478cf05fa4 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0c5c19d-363b-4f5d-a04f-fb7de64423f2 (non-flash)
Nov 16 10:31:42 user nova-compute[85141]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebf4cfdf-97a5-4901-b8e0-df0704384909 (non-flash)
Nov 16 10:31:42 user nova-compute[85141]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aafe4bc8-430a-4d9d-93c7-ec25981b8bb0 (non-flash)
Nov 16 10:31:42 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:31:42 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a97d81e-49ce-4abd-903d-00478cf05fa4 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0c5c19d-363b-4f5d-a04f-fb7de64423f2 (non-flash)
Nov 16 10:31:42 user nova-compute[85141]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebf4cfdf-97a5-4901-b8e0-df0704384909 (non-flash)
Nov 16 10:31:42 user nova-compute[85141]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aafe4bc8-430a-4d9d-93c7-ec25981b8bb0 (non-flash)
Nov 16 10:31:42 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 10:31:42 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-5a97d81e-49ce-4abd-903d-00478cf05fa4 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aafe4bc8-430a-4d9d-93c7-ec25981b8bb0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.339s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 10:31:42 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a97d81e-49ce-4abd-903d-00478cf05fa4 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] Connected to 172.16.0.220:3260 {{(pid=85141) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 10:31:42 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-5a97d81e-49ce-4abd-903d-00478cf05fa4 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] HCTL ('33', '-', '-', 0) found on session 48 with lun 0 {{(pid=85141) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 10:31:42 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-5a97d81e-49ce-4abd-903d-00478cf05fa4 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=85141) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 10:31:42 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:31:42 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:31:42 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fd21ee8-5e46-4d8a-9033-3c910cf7d751]: (4, ('- - 0', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:31:42 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-5a97d81e-49ce-4abd-903d-00478cf05fa4 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] Searching for a device in session 48 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=85141) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 10:31:42 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a97d81e-49ce-4abd-903d-00478cf05fa4 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:aafe4bc8-430a-4d9d-93c7-ec25981b8bb0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kwVRpEhH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=85141) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 10:31:43 user nova-compute[85141]: INFO nova.compute.manager [None req-c8ee4a36-790c-4d26-ade0-1f1645727e52 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] [instance: bc76703d-9243-4277-9b13-d6f9639cd1bb] Took 0.87 seconds to detach 1 volumes for instance.
Nov 16 10:31:43 user nova-compute[85141]: DEBUG nova.compute.manager [None req-c8ee4a36-790c-4d26-ade0-1f1645727e52 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] [instance: bc76703d-9243-4277-9b13-d6f9639cd1bb] Deleting volume: 2006a77c-e5e8-4ec5-8de5-a0f9505c429a {{(pid=85141) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 16 10:31:43 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:31:43 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:31:43 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-c8ee4a36-790c-4d26-ade0-1f1645727e52 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:31:43 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-c8ee4a36-790c-4d26-ade0-1f1645727e52 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:31:43 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:31:43 user nova-compute[85141]: DEBUG nova.scheduler.client.report [None req-c8ee4a36-790c-4d26-ade0-1f1645727e52 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Refreshing inventories for resource provider bf8e0fa1-16b6-408f-9203-c4cd63916272 {{(pid=85141) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 16 10:31:43 user nova-compute[85141]: DEBUG nova.scheduler.client.report [None req-c8ee4a36-790c-4d26-ade0-1f1645727e52 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Updating ProviderTree inventory for provider bf8e0fa1-16b6-408f-9203-c4cd63916272 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=85141) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 16 10:31:43 user nova-compute[85141]: DEBUG nova.compute.provider_tree [None req-c8ee4a36-790c-4d26-ade0-1f1645727e52 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Updating inventory in ProviderTree for provider bf8e0fa1-16b6-408f-9203-c4cd63916272 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=85141) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 16 10:31:43 user nova-compute[85141]: DEBUG nova.scheduler.client.report [None req-c8ee4a36-790c-4d26-ade0-1f1645727e52 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Refreshing aggregate associations for resource provider bf8e0fa1-16b6-408f-9203-c4cd63916272, aggregates: None {{(pid=85141) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 16 10:31:43 user nova-compute[85141]: DEBUG nova.scheduler.client.report [None req-c8ee4a36-790c-4d26-ade0-1f1645727e52 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Refreshing trait associations for resource provider bf8e0fa1-16b6-408f-9203-c4cd63916272, traits: COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE41,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_ACCELERATORS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_USB,COMPUTE_TRUSTED_CERTS,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_RESCUE_BFV,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VOLUME_ATTACH_WITH_TAG {{(pid=85141) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 16 10:31:43 user nova-compute[85141]: DEBUG nova.compute.provider_tree [None req-c8ee4a36-790c-4d26-ade0-1f1645727e52 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Inventory has not changed in ProviderTree for provider: bf8e0fa1-16b6-408f-9203-c4cd63916272 {{(pid=85141) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 10:31:43 user nova-compute[85141]: DEBUG nova.scheduler.client.report [None req-c8ee4a36-790c-4d26-ade0-1f1645727e52 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Inventory has not changed for provider bf8e0fa1-16b6-408f-9203-c4cd63916272 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=85141) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 10:31:43 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-5a97d81e-49ce-4abd-903d-00478cf05fa4 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.394s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 10:31:43 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a97d81e-49ce-4abd-903d-00478cf05fa4 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] <== connect_volume: return (1396ms) {'type': 'block', 'scsi_wwn': '23866393133373562', 'path': '/dev/sdb'} {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 10:31:43 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5a97d81e-49ce-4abd-903d-00478cf05fa4 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] [instance: 7437a3a3-9b7f-489b-b20b-f1b877ebb253] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23866393133373562', 'path': '/dev/sdb'} {{(pid=85141) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 10:31:43 user nova-compute[85141]: DEBUG nova.objects.instance [None req-5a97d81e-49ce-4abd-903d-00478cf05fa4 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] Lazy-loading 'flavor' on Instance uuid 7437a3a3-9b7f-489b-b20b-f1b877ebb253 {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:31:43 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-c8ee4a36-790c-4d26-ade0-1f1645727e52 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.419s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:31:43 user nova-compute[85141]: DEBUG nova.virt.libvirt.guest [None req-5a97d81e-49ce-4abd-903d-00478cf05fa4 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 10:31:43 user nova-compute[85141]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 10:31:43 user nova-compute[85141]:   <source dev="/dev/sdb"/>
Nov 16 10:31:43 user nova-compute[85141]:   <target dev="vdc" bus="virtio"/>
Nov 16 10:31:43 user nova-compute[85141]:   <serial>aafe4bc8-430a-4d9d-93c7-ec25981b8bb0</serial>
Nov 16 10:31:43 user nova-compute[85141]: </disk>
Nov 16 10:31:43 user nova-compute[85141]:  {{(pid=85141) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 10:31:43 user nova-compute[85141]: INFO nova.scheduler.client.report [None req-c8ee4a36-790c-4d26-ade0-1f1645727e52 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Deleted allocations for instance bc76703d-9243-4277-9b13-d6f9639cd1bb
Nov 16 10:31:43 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-c8ee4a36-790c-4d26-ade0-1f1645727e52 tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Lock "bc76703d-9243-4277-9b13-d6f9639cd1bb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.655s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:31:44 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-5a97d81e-49ce-4abd-903d-00478cf05fa4 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] No BDM found with device name vda, not building metadata. {{(pid=85141) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 10:31:44 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-5a97d81e-49ce-4abd-903d-00478cf05fa4 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] No BDM found with device name vdb, not building metadata. {{(pid=85141) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 10:31:44 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-5a97d81e-49ce-4abd-903d-00478cf05fa4 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] No BDM found with device name vdc, not building metadata. {{(pid=85141) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 10:31:44 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-5a97d81e-49ce-4abd-903d-00478cf05fa4 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] No VIF found with MAC fa:16:3e:7e:27:4c, not building metadata {{(pid=85141) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 10:31:44 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5a97d81e-49ce-4abd-903d-00478cf05fa4 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] Lock "7437a3a3-9b7f-489b-b20b-f1b877ebb253" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.146s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:31:45 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5eb28cf9-6662-419a-adaa-032ebf663de3 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] Acquiring lock "7437a3a3-9b7f-489b-b20b-f1b877ebb253" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:31:45 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5eb28cf9-6662-419a-adaa-032ebf663de3 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] Lock "7437a3a3-9b7f-489b-b20b-f1b877ebb253" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:31:45 user nova-compute[85141]: INFO nova.compute.manager [None req-5eb28cf9-6662-419a-adaa-032ebf663de3 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] [instance: 7437a3a3-9b7f-489b-b20b-f1b877ebb253] Detaching volume aafe4bc8-430a-4d9d-93c7-ec25981b8bb0
Nov 16 10:31:45 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:31:45 user nova-compute[85141]: INFO nova.virt.block_device [None req-5eb28cf9-6662-419a-adaa-032ebf663de3 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] [instance: 7437a3a3-9b7f-489b-b20b-f1b877ebb253] Attempting to driver detach volume aafe4bc8-430a-4d9d-93c7-ec25981b8bb0 from mountpoint /dev/vdc
Nov 16 10:31:45 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-5eb28cf9-6662-419a-adaa-032ebf663de3 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] Attempting to detach device vdc from instance 7437a3a3-9b7f-489b-b20b-f1b877ebb253 from the persistent domain config. {{(pid=85141) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 10:31:45 user nova-compute[85141]: DEBUG nova.virt.libvirt.guest [None req-5eb28cf9-6662-419a-adaa-032ebf663de3 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 10:31:45 user nova-compute[85141]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 10:31:45 user nova-compute[85141]:   <source dev="/dev/sdb"/>
Nov 16 10:31:45 user nova-compute[85141]:   <target dev="vdc" bus="virtio"/>
Nov 16 10:31:45 user nova-compute[85141]:   <serial>aafe4bc8-430a-4d9d-93c7-ec25981b8bb0</serial>
Nov 16 10:31:45 user nova-compute[85141]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 16 10:31:45 user nova-compute[85141]: </disk>
Nov 16 10:31:45 user nova-compute[85141]:  {{(pid=85141) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 10:31:45 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-54672304-7dc9-4075-80b1-a23f989a6710 tempest-TestServerVolumeAttachScenarioOldVersion-263106525 tempest-TestServerVolumeAttachScenarioOldVersion-263106525-project-member] Acquiring lock "ac3f3bc9-f5e2-4dc8-bf62-3649611da824" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:31:45 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-54672304-7dc9-4075-80b1-a23f989a6710 tempest-TestServerVolumeAttachScenarioOldVersion-263106525 tempest-TestServerVolumeAttachScenarioOldVersion-263106525-project-member] Lock "ac3f3bc9-f5e2-4dc8-bf62-3649611da824" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:31:45 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-5eb28cf9-6662-419a-adaa-032ebf663de3 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] Successfully detached device vdc from instance 7437a3a3-9b7f-489b-b20b-f1b877ebb253 from the persistent domain config.
Nov 16 10:31:45 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-5eb28cf9-6662-419a-adaa-032ebf663de3 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 7437a3a3-9b7f-489b-b20b-f1b877ebb253 from the live domain config. {{(pid=85141) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 10:31:45 user nova-compute[85141]: DEBUG nova.virt.libvirt.guest [None req-5eb28cf9-6662-419a-adaa-032ebf663de3 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 10:31:45 user nova-compute[85141]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 10:31:45 user nova-compute[85141]:   <source dev="/dev/sdb"/>
Nov 16 10:31:45 user nova-compute[85141]:   <target dev="vdc" bus="virtio"/>
Nov 16 10:31:45 user nova-compute[85141]:   <serial>aafe4bc8-430a-4d9d-93c7-ec25981b8bb0</serial>
Nov 16 10:31:45 user nova-compute[85141]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 16 10:31:45 user nova-compute[85141]: </disk>
Nov 16 10:31:45 user nova-compute[85141]:  {{(pid=85141) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 10:31:45 user nova-compute[85141]: DEBUG nova.compute.manager [None req-54672304-7dc9-4075-80b1-a23f989a6710 tempest-TestServerVolumeAttachScenarioOldVersion-263106525 tempest-TestServerVolumeAttachScenarioOldVersion-263106525-project-member] [instance: ac3f3bc9-f5e2-4dc8-bf62-3649611da824] Starting instance... {{(pid=85141) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 10:31:46 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-54672304-7dc9-4075-80b1-a23f989a6710 tempest-TestServerVolumeAttachScenarioOldVersion-263106525 tempest-TestServerVolumeAttachScenarioOldVersion-263106525-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:31:46 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-54672304-7dc9-4075-80b1-a23f989a6710 tempest-TestServerVolumeAttachScenarioOldVersion-263106525 tempest-TestServerVolumeAttachScenarioOldVersion-263106525-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:31:46 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-5eb28cf9-6662-419a-adaa-032ebf663de3 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 7437a3a3-9b7f-489b-b20b-f1b877ebb253 {{(pid=85141) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 10:31:46 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-54672304-7dc9-4075-80b1-a23f989a6710 tempest-TestServerVolumeAttachScenarioOldVersion-263106525 tempest-TestServerVolumeAttachScenarioOldVersion-263106525-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=85141) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 10:31:46 user nova-compute[85141]: INFO nova.compute.claims [None req-54672304-7dc9-4075-80b1-a23f989a6710 tempest-TestServerVolumeAttachScenarioOldVersion-263106525 tempest-TestServerVolumeAttachScenarioOldVersion-263106525-project-member] [instance: ac3f3bc9-f5e2-4dc8-bf62-3649611da824] Claim successful on node user
Nov 16 10:31:46 user nova-compute[85141]: DEBUG nova.compute.provider_tree [None req-54672304-7dc9-4075-80b1-a23f989a6710 tempest-TestServerVolumeAttachScenarioOldVersion-263106525 tempest-TestServerVolumeAttachScenarioOldVersion-263106525-project-member] Inventory has not changed in ProviderTree for provider: bf8e0fa1-16b6-408f-9203-c4cd63916272 {{(pid=85141) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 10:31:46 user nova-compute[85141]: DEBUG nova.scheduler.client.report [None req-54672304-7dc9-4075-80b1-a23f989a6710 tempest-TestServerVolumeAttachScenarioOldVersion-263106525 tempest-TestServerVolumeAttachScenarioOldVersion-263106525-project-member] Inventory has not changed for provider bf8e0fa1-16b6-408f-9203-c4cd63916272 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=85141) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 10:31:46 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-54672304-7dc9-4075-80b1-a23f989a6710 tempest-TestServerVolumeAttachScenarioOldVersion-263106525 tempest-TestServerVolumeAttachScenarioOldVersion-263106525-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.380s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:31:46 user nova-compute[85141]: DEBUG nova.compute.manager [None req-54672304-7dc9-4075-80b1-a23f989a6710 tempest-TestServerVolumeAttachScenarioOldVersion-263106525 tempest-TestServerVolumeAttachScenarioOldVersion-263106525-project-member] [instance: ac3f3bc9-f5e2-4dc8-bf62-3649611da824] Start building networks asynchronously for instance. {{(pid=85141) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 10:31:46 user nova-compute[85141]: DEBUG nova.compute.manager [None req-54672304-7dc9-4075-80b1-a23f989a6710 tempest-TestServerVolumeAttachScenarioOldVersion-263106525 tempest-TestServerVolumeAttachScenarioOldVersion-263106525-project-member] [instance: ac3f3bc9-f5e2-4dc8-bf62-3649611da824] Allocating IP information in the background. {{(pid=85141) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 10:31:46 user nova-compute[85141]: DEBUG nova.network.neutron [None req-54672304-7dc9-4075-80b1-a23f989a6710 tempest-TestServerVolumeAttachScenarioOldVersion-263106525 tempest-TestServerVolumeAttachScenarioOldVersion-263106525-project-member] [instance: ac3f3bc9-f5e2-4dc8-bf62-3649611da824] allocate_for_instance() {{(pid=85141) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 10:31:46 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-54672304-7dc9-4075-80b1-a23f989a6710 tempest-TestServerVolumeAttachScenarioOldVersion-263106525 tempest-TestServerVolumeAttachScenarioOldVersion-263106525-project-member] [instance: ac3f3bc9-f5e2-4dc8-bf62-3649611da824] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 10:31:46 user nova-compute[85141]: DEBUG nova.compute.manager [None req-54672304-7dc9-4075-80b1-a23f989a6710 tempest-TestServerVolumeAttachScenarioOldVersion-263106525 tempest-TestServerVolumeAttachScenarioOldVersion-263106525-project-member] [instance: ac3f3bc9-f5e2-4dc8-bf62-3649611da824] Start building block device mappings for instance. {{(pid=85141) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 10:31:46 user nova-compute[85141]: DEBUG nova.policy [None req-54672304-7dc9-4075-80b1-a23f989a6710 tempest-TestServerVolumeAttachScenarioOldVersion-263106525 tempest-TestServerVolumeAttachScenarioOldVersion-263106525-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1490d069bf4c4783a82300496a38b141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7439b97798684ddfb5c98026abe079d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85141) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 10:31:46 user nova-compute[85141]: DEBUG nova.compute.manager [None req-54672304-7dc9-4075-80b1-a23f989a6710 tempest-TestServerVolumeAttachScenarioOldVersion-263106525 tempest-TestServerVolumeAttachScenarioOldVersion-263106525-project-member] [instance: ac3f3bc9-f5e2-4dc8-bf62-3649611da824] Start spawning the instance on the hypervisor. {{(pid=85141) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 10:31:46 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-54672304-7dc9-4075-80b1-a23f989a6710 tempest-TestServerVolumeAttachScenarioOldVersion-263106525 tempest-TestServerVolumeAttachScenarioOldVersion-263106525-project-member] [instance: ac3f3bc9-f5e2-4dc8-bf62-3649611da824] Creating instance directory {{(pid=85141) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 10:31:46 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-54672304-7dc9-4075-80b1-a23f989a6710 tempest-TestServerVolumeAttachScenarioOldVersion-263106525 tempest-TestServerVolumeAttachScenarioOldVersion-263106525-project-member] [instance: ac3f3bc9-f5e2-4dc8-bf62-3649611da824] Creating image(s)
Nov 16 10:31:46 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-54672304-7dc9-4075-80b1-a23f989a6710 tempest-TestServerVolumeAttachScenarioOldVersion-263106525 tempest-TestServerVolumeAttachScenarioOldVersion-263106525-project-member] Acquiring lock "/opt/stack/data/nova/instances/ac3f3bc9-f5e2-4dc8-bf62-3649611da824/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:31:46 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-54672304-7dc9-4075-80b1-a23f989a6710 tempest-TestServerVolumeAttachScenarioOldVersion-263106525 tempest-TestServerVolumeAttachScenarioOldVersion-263106525-project-member] Lock "/opt/stack/data/nova/instances/ac3f3bc9-f5e2-4dc8-bf62-3649611da824/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:31:46 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-54672304-7dc9-4075-80b1-a23f989a6710 tempest-TestServerVolumeAttachScenarioOldVersion-263106525 tempest-TestServerVolumeAttachScenarioOldVersion-263106525-project-member] Lock "/opt/stack/data/nova/instances/ac3f3bc9-f5e2-4dc8-bf62-3649611da824/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:31:46 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-54672304-7dc9-4075-80b1-a23f989a6710 tempest-TestServerVolumeAttachScenarioOldVersion-263106525 tempest-TestServerVolumeAttachScenarioOldVersion-263106525-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:31:46 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-54672304-7dc9-4075-80b1-a23f989a6710 tempest-TestServerVolumeAttachScenarioOldVersion-263106525 tempest-TestServerVolumeAttachScenarioOldVersion-263106525-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json" returned: 0 in 0.181s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:31:46 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-54672304-7dc9-4075-80b1-a23f989a6710 tempest-TestServerVolumeAttachScenarioOldVersion-263106525 tempest-TestServerVolumeAttachScenarioOldVersion-263106525-project-member] Acquiring lock "60a78556fb399ed4a41bc3ca4bccf77c96d8e811" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:31:46 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-54672304-7dc9-4075-80b1-a23f989a6710 tempest-TestServerVolumeAttachScenarioOldVersion-263106525 tempest-TestServerVolumeAttachScenarioOldVersion-263106525-project-member] Lock "60a78556fb399ed4a41bc3ca4bccf77c96d8e811" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:31:46 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-54672304-7dc9-4075-80b1-a23f989a6710 tempest-TestServerVolumeAttachScenarioOldVersion-263106525 tempest-TestServerVolumeAttachScenarioOldVersion-263106525-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:31:47 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-54672304-7dc9-4075-80b1-a23f989a6710 tempest-TestServerVolumeAttachScenarioOldVersion-263106525 tempest-TestServerVolumeAttachScenarioOldVersion-263106525-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json" returned: 0 in 0.191s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:31:47 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-54672304-7dc9-4075-80b1-a23f989a6710 tempest-TestServerVolumeAttachScenarioOldVersion-263106525 tempest-TestServerVolumeAttachScenarioOldVersion-263106525-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811,backing_fmt=raw /opt/stack/data/nova/instances/ac3f3bc9-f5e2-4dc8-bf62-3649611da824/disk 1073741824 {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:31:47 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-54672304-7dc9-4075-80b1-a23f989a6710 tempest-TestServerVolumeAttachScenarioOldVersion-263106525 tempest-TestServerVolumeAttachScenarioOldVersion-263106525-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811,backing_fmt=raw /opt/stack/data/nova/instances/ac3f3bc9-f5e2-4dc8-bf62-3649611da824/disk 1073741824" returned: 0 in 0.073s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:31:47 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-54672304-7dc9-4075-80b1-a23f989a6710 tempest-TestServerVolumeAttachScenarioOldVersion-263106525 tempest-TestServerVolumeAttachScenarioOldVersion-263106525-project-member] Lock "60a78556fb399ed4a41bc3ca4bccf77c96d8e811" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.273s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:31:47 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-54672304-7dc9-4075-80b1-a23f989a6710 tempest-TestServerVolumeAttachScenarioOldVersion-263106525 tempest-TestServerVolumeAttachScenarioOldVersion-263106525-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:31:47 user nova-compute[85141]: DEBUG nova.network.neutron [None req-54672304-7dc9-4075-80b1-a23f989a6710 tempest-TestServerVolumeAttachScenarioOldVersion-263106525 tempest-TestServerVolumeAttachScenarioOldVersion-263106525-project-member] [instance: ac3f3bc9-f5e2-4dc8-bf62-3649611da824] Successfully created port: 57dd011e-4f3b-44bd-a8e1-e17a515e29e2 {{(pid=85141) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 10:31:47 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-54672304-7dc9-4075-80b1-a23f989a6710 tempest-TestServerVolumeAttachScenarioOldVersion-263106525 tempest-TestServerVolumeAttachScenarioOldVersion-263106525-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json" returned: 0 in 0.187s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:31:47 user nova-compute[85141]: DEBUG nova.virt.disk.api [None req-54672304-7dc9-4075-80b1-a23f989a6710 tempest-TestServerVolumeAttachScenarioOldVersion-263106525 tempest-TestServerVolumeAttachScenarioOldVersion-263106525-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ac3f3bc9-f5e2-4dc8-bf62-3649611da824/disk. size=1073741824 {{(pid=85141) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 10:31:47 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-54672304-7dc9-4075-80b1-a23f989a6710 tempest-TestServerVolumeAttachScenarioOldVersion-263106525 tempest-TestServerVolumeAttachScenarioOldVersion-263106525-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac3f3bc9-f5e2-4dc8-bf62-3649611da824/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:31:47 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-54672304-7dc9-4075-80b1-a23f989a6710 tempest-TestServerVolumeAttachScenarioOldVersion-263106525 tempest-TestServerVolumeAttachScenarioOldVersion-263106525-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac3f3bc9-f5e2-4dc8-bf62-3649611da824/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:31:47 user nova-compute[85141]: DEBUG nova.virt.disk.api [None req-54672304-7dc9-4075-80b1-a23f989a6710 tempest-TestServerVolumeAttachScenarioOldVersion-263106525 tempest-TestServerVolumeAttachScenarioOldVersion-263106525-project-member] Cannot resize image /opt/stack/data/nova/instances/ac3f3bc9-f5e2-4dc8-bf62-3649611da824/disk to a smaller size. {{(pid=85141) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 10:31:47 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-54672304-7dc9-4075-80b1-a23f989a6710 tempest-TestServerVolumeAttachScenarioOldVersion-263106525 tempest-TestServerVolumeAttachScenarioOldVersion-263106525-project-member] [instance: ac3f3bc9-f5e2-4dc8-bf62-3649611da824] Created local disks {{(pid=85141) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 10:31:47 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-54672304-7dc9-4075-80b1-a23f989a6710 tempest-TestServerVolumeAttachScenarioOldVersion-263106525 tempest-TestServerVolumeAttachScenarioOldVersion-263106525-project-member] [instance: ac3f3bc9-f5e2-4dc8-bf62-3649611da824] Ensure instance console log exists: /opt/stack/data/nova/instances/ac3f3bc9-f5e2-4dc8-bf62-3649611da824/console.log {{(pid=85141) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 10:31:47 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-54672304-7dc9-4075-80b1-a23f989a6710 tempest-TestServerVolumeAttachScenarioOldVersion-263106525 tempest-TestServerVolumeAttachScenarioOldVersion-263106525-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:31:47 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-54672304-7dc9-4075-80b1-a23f989a6710 tempest-TestServerVolumeAttachScenarioOldVersion-263106525 tempest-TestServerVolumeAttachScenarioOldVersion-263106525-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:31:47 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-54672304-7dc9-4075-80b1-a23f989a6710 tempest-TestServerVolumeAttachScenarioOldVersion-263106525 tempest-TestServerVolumeAttachScenarioOldVersion-263106525-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:31:47 user nova-compute[85141]: DEBUG nova.network.neutron [None req-54672304-7dc9-4075-80b1-a23f989a6710 tempest-TestServerVolumeAttachScenarioOldVersion-263106525 tempest-TestServerVolumeAttachScenarioOldVersion-263106525-project-member] [instance: ac3f3bc9-f5e2-4dc8-bf62-3649611da824] Successfully updated port: 57dd011e-4f3b-44bd-a8e1-e17a515e29e2 {{(pid=85141) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 10:31:47 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-54672304-7dc9-4075-80b1-a23f989a6710 tempest-TestServerVolumeAttachScenarioOldVersion-263106525 tempest-TestServerVolumeAttachScenarioOldVersion-263106525-project-member] Acquiring lock "refresh_cache-ac3f3bc9-f5e2-4dc8-bf62-3649611da824" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:31:47 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-54672304-7dc9-4075-80b1-a23f989a6710 tempest-TestServerVolumeAttachScenarioOldVersion-263106525 tempest-TestServerVolumeAttachScenarioOldVersion-263106525-project-member] Acquired lock "refresh_cache-ac3f3bc9-f5e2-4dc8-bf62-3649611da824" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:31:47 user nova-compute[85141]: DEBUG nova.network.neutron [None req-54672304-7dc9-4075-80b1-a23f989a6710 tempest-TestServerVolumeAttachScenarioOldVersion-263106525 tempest-TestServerVolumeAttachScenarioOldVersion-263106525-project-member] [instance: ac3f3bc9-f5e2-4dc8-bf62-3649611da824] Building network info cache for instance {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 10:31:48 user nova-compute[85141]: DEBUG nova.compute.manager [req-b6009e46-30b6-44f2-87bf-1efded41a7e2 req-4375c495-060c-4303-b19e-32036cb700c1 service nova] [instance: ac3f3bc9-f5e2-4dc8-bf62-3649611da824] Received event network-changed-57dd011e-4f3b-44bd-a8e1-e17a515e29e2 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:31:48 user nova-compute[85141]: DEBUG nova.compute.manager [req-b6009e46-30b6-44f2-87bf-1efded41a7e2 req-4375c495-060c-4303-b19e-32036cb700c1 service nova] [instance: ac3f3bc9-f5e2-4dc8-bf62-3649611da824] Refreshing instance network info cache due to event network-changed-57dd011e-4f3b-44bd-a8e1-e17a515e29e2. {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 10:31:48 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-b6009e46-30b6-44f2-87bf-1efded41a7e2 req-4375c495-060c-4303-b19e-32036cb700c1 service nova] Acquiring lock "refresh_cache-ac3f3bc9-f5e2-4dc8-bf62-3649611da824" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:31:48 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:31:48 user nova-compute[85141]: DEBUG nova.network.neutron [None req-54672304-7dc9-4075-80b1-a23f989a6710 tempest-TestServerVolumeAttachScenarioOldVersion-263106525 tempest-TestServerVolumeAttachScenarioOldVersion-263106525-project-member] [instance: ac3f3bc9-f5e2-4dc8-bf62-3649611da824] Instance cache missing network info. {{(pid=85141) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 10:31:48 user nova-compute[85141]: DEBUG nova.network.neutron [None req-54672304-7dc9-4075-80b1-a23f989a6710 tempest-TestServerVolumeAttachScenarioOldVersion-263106525 tempest-TestServerVolumeAttachScenarioOldVersion-263106525-project-member] [instance: ac3f3bc9-f5e2-4dc8-bf62-3649611da824] Updating instance_info_cache with network_info: [{"id": "57dd011e-4f3b-44bd-a8e1-e17a515e29e2", "address": "fa:16:3e:28:e8:42", "network": {"id": "ef4876c8-a963-4474-894f-71371d1313da", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-459369775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7439b97798684ddfb5c98026abe079d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57dd011e-4f", "ovs_interfaceid": "57dd011e-4f3b-44bd-a8e1-e17a515e29e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:31:48 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-54672304-7dc9-4075-80b1-a23f989a6710 tempest-TestServerVolumeAttachScenarioOldVersion-263106525 tempest-TestServerVolumeAttachScenarioOldVersion-263106525-project-member] Releasing lock "refresh_cache-ac3f3bc9-f5e2-4dc8-bf62-3649611da824" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:31:48 user nova-compute[85141]: DEBUG nova.compute.manager [None req-54672304-7dc9-4075-80b1-a23f989a6710 tempest-TestServerVolumeAttachScenarioOldVersion-263106525 tempest-TestServerVolumeAttachScenarioOldVersion-263106525-project-member] [instance: ac3f3bc9-f5e2-4dc8-bf62-3649611da824] Instance network_info: |[{"id": "57dd011e-4f3b-44bd-a8e1-e17a515e29e2", "address": "fa:16:3e:28:e8:42", "network": {"id": "ef4876c8-a963-4474-894f-71371d1313da", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-459369775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7439b97798684ddfb5c98026abe079d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57dd011e-4f", "ovs_interfaceid": "57dd011e-4f3b-44bd-a8e1-e17a515e29e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=85141) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 10:31:48 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-b6009e46-30b6-44f2-87bf-1efded41a7e2 req-4375c495-060c-4303-b19e-32036cb700c1 service nova] Acquired lock "refresh_cache-ac3f3bc9-f5e2-4dc8-bf62-3649611da824" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:31:48 user nova-compute[85141]: DEBUG nova.network.neutron [req-b6009e46-30b6-44f2-87bf-1efded41a7e2 req-4375c495-060c-4303-b19e-32036cb700c1 service nova] [instance: ac3f3bc9-f5e2-4dc8-bf62-3649611da824] Refreshing network info cache for port 57dd011e-4f3b-44bd-a8e1-e17a515e29e2 {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 10:31:48 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-54672304-7dc9-4075-80b1-a23f989a6710 tempest-TestServerVolumeAttachScenarioOldVersion-263106525 tempest-TestServerVolumeAttachScenarioOldVersion-263106525-project-member] [instance: ac3f3bc9-f5e2-4dc8-bf62-3649611da824] Start _get_guest_xml network_info=[{"id": "57dd011e-4f3b-44bd-a8e1-e17a515e29e2", "address": "fa:16:3e:28:e8:42", "network": {"id": "ef4876c8-a963-4474-894f-71371d1313da", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-459369775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7439b97798684ddfb5c98026abe079d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57dd011e-4f", "ovs_interfaceid": "57dd011e-4f3b-44bd-a8e1-e17a515e29e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T10:06:42Z,direct_url=<?>,disk_format='qcow2',id=bc4ca70f-a459-4d5c-a9e6-80f1948eb48b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1044631a5fe84ce8904864a7024049fa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T10:06:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_options': None, 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'image_id': 'bc4ca70f-a459-4d5c-a9e6-80f1948eb48b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=85141) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 10:31:48 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-54672304-7dc9-4075-80b1-a23f989a6710 tempest-TestServerVolumeAttachScenarioOldVersion-263106525 tempest-TestServerVolumeAttachScenarioOldVersion-263106525-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:31:48 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-54672304-7dc9-4075-80b1-a23f989a6710 tempest-TestServerVolumeAttachScenarioOldVersion-263106525 tempest-TestServerVolumeAttachScenarioOldVersion-263106525-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:31:48 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-54672304-7dc9-4075-80b1-a23f989a6710 tempest-TestServerVolumeAttachScenarioOldVersion-263106525 tempest-TestServerVolumeAttachScenarioOldVersion-263106525-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=85141) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 10:31:48 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-54672304-7dc9-4075-80b1-a23f989a6710 tempest-TestServerVolumeAttachScenarioOldVersion-263106525 tempest-TestServerVolumeAttachScenarioOldVersion-263106525-project-member] CPU controller missing on host. {{(pid=85141) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 10:31:48 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:31:48 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-54672304-7dc9-4075-80b1-a23f989a6710 tempest-TestServerVolumeAttachScenarioOldVersion-263106525 tempest-TestServerVolumeAttachScenarioOldVersion-263106525-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=85141) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 10:31:48 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-54672304-7dc9-4075-80b1-a23f989a6710 tempest-TestServerVolumeAttachScenarioOldVersion-263106525 tempest-TestServerVolumeAttachScenarioOldVersion-263106525-project-member] CPU controller found on host. {{(pid=85141) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 10:31:48 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-54672304-7dc9-4075-80b1-a23f989a6710 tempest-TestServerVolumeAttachScenarioOldVersion-263106525 tempest-TestServerVolumeAttachScenarioOldVersion-263106525-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=85141) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 10:31:48 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-54672304-7dc9-4075-80b1-a23f989a6710 tempest-TestServerVolumeAttachScenarioOldVersion-263106525 tempest-TestServerVolumeAttachScenarioOldVersion-263106525-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T10:06:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T10:06:42Z,direct_url=<?>,disk_format='qcow2',id=bc4ca70f-a459-4d5c-a9e6-80f1948eb48b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1044631a5fe84ce8904864a7024049fa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T10:06:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 10:31:48 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-54672304-7dc9-4075-80b1-a23f989a6710 tempest-TestServerVolumeAttachScenarioOldVersion-263106525 tempest-TestServerVolumeAttachScenarioOldVersion-263106525-project-member] Flavor limits 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 10:31:48 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-54672304-7dc9-4075-80b1-a23f989a6710 tempest-TestServerVolumeAttachScenarioOldVersion-263106525 tempest-TestServerVolumeAttachScenarioOldVersion-263106525-project-member] Image limits 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 10:31:48 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-54672304-7dc9-4075-80b1-a23f989a6710 tempest-TestServerVolumeAttachScenarioOldVersion-263106525 tempest-TestServerVolumeAttachScenarioOldVersion-263106525-project-member] Flavor pref 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 10:31:48 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-54672304-7dc9-4075-80b1-a23f989a6710 tempest-TestServerVolumeAttachScenarioOldVersion-263106525 tempest-TestServerVolumeAttachScenarioOldVersion-263106525-project-member] Image pref 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 10:31:48 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-54672304-7dc9-4075-80b1-a23f989a6710 tempest-TestServerVolumeAttachScenarioOldVersion-263106525 tempest-TestServerVolumeAttachScenarioOldVersion-263106525-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 10:31:48 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-54672304-7dc9-4075-80b1-a23f989a6710 tempest-TestServerVolumeAttachScenarioOldVersion-263106525 tempest-TestServerVolumeAttachScenarioOldVersion-263106525-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 10:31:48 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-54672304-7dc9-4075-80b1-a23f989a6710 tempest-TestServerVolumeAttachScenarioOldVersion-263106525 tempest-TestServerVolumeAttachScenarioOldVersion-263106525-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=85141) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 10:31:48 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-54672304-7dc9-4075-80b1-a23f989a6710 tempest-TestServerVolumeAttachScenarioOldVersion-263106525 tempest-TestServerVolumeAttachScenarioOldVersion-263106525-project-member] Got 1 possible topologies {{(pid=85141) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 10:31:48 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-54672304-7dc9-4075-80b1-a23f989a6710 tempest-TestServerVolumeAttachScenarioOldVersion-263106525 tempest-TestServerVolumeAttachScenarioOldVersion-263106525-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 10:31:48 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-54672304-7dc9-4075-80b1-a23f989a6710 tempest-TestServerVolumeAttachScenarioOldVersion-263106525 tempest-TestServerVolumeAttachScenarioOldVersion-263106525-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 10:31:48 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-54672304-7dc9-4075-80b1-a23f989a6710 tempest-TestServerVolumeAttachScenarioOldVersion-263106525 tempest-TestServerVolumeAttachScenarioOldVersion-263106525-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T10:31:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1630724157',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1630724157',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1630724',id=44,image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHLSgP+AL3EOr7wtsiRGgI+eODUyi+l+ylR0QErUYK/fxaI0AzjLVGrR+UJBFTC3sNOVDiWIFsHxiQsRr9FX+sFyoOnMVWkcrVdRrewE75k2+ICLMvfOikgPNgTTZOmelQ==',key_name='tempest-keypair-456696076',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7439b97798684ddfb5c98026abe079d0',ramdisk_id='',reservation_id='r-c2fk4efh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-263106525',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-263106525-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T10:31:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1490d069bf4c4783a82300496a38b141',uuid=ac3f3bc9-f5e2-4dc8-bf62-3649611da824,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "57dd011e-4f3b-44bd-a8e1-e17a515e29e2", "address": "fa:16:3e:28:e8:42", "network": {"id": "ef4876c8-a963-4474-894f-71371d1313da", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-459369775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7439b97798684ddfb5c98026abe079d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57dd011e-4f", "ovs_interfaceid": "57dd011e-4f3b-44bd-a8e1-e17a515e29e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=85141) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 10:31:48 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-54672304-7dc9-4075-80b1-a23f989a6710 tempest-TestServerVolumeAttachScenarioOldVersion-263106525 tempest-TestServerVolumeAttachScenarioOldVersion-263106525-project-member] Converting VIF {"id": "57dd011e-4f3b-44bd-a8e1-e17a515e29e2", "address": "fa:16:3e:28:e8:42", "network": {"id": "ef4876c8-a963-4474-894f-71371d1313da", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-459369775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7439b97798684ddfb5c98026abe079d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57dd011e-4f", "ovs_interfaceid": "57dd011e-4f3b-44bd-a8e1-e17a515e29e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:31:48 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-54672304-7dc9-4075-80b1-a23f989a6710 tempest-TestServerVolumeAttachScenarioOldVersion-263106525 tempest-TestServerVolumeAttachScenarioOldVersion-263106525-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:e8:42,bridge_name='br-int',has_traffic_filtering=True,id=57dd011e-4f3b-44bd-a8e1-e17a515e29e2,network=Network(ef4876c8-a963-4474-894f-71371d1313da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57dd011e-4f') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:31:48 user nova-compute[85141]: DEBUG nova.objects.instance [None req-54672304-7dc9-4075-80b1-a23f989a6710 tempest-TestServerVolumeAttachScenarioOldVersion-263106525 tempest-TestServerVolumeAttachScenarioOldVersion-263106525-project-member] Lazy-loading 'pci_devices' on Instance uuid ac3f3bc9-f5e2-4dc8-bf62-3649611da824 {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:31:48 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-54672304-7dc9-4075-80b1-a23f989a6710 tempest-TestServerVolumeAttachScenarioOldVersion-263106525 tempest-TestServerVolumeAttachScenarioOldVersion-263106525-project-member] [instance: ac3f3bc9-f5e2-4dc8-bf62-3649611da824] End _get_guest_xml xml=<domain type="kvm">
Nov 16 10:31:48 user nova-compute[85141]:   <uuid>ac3f3bc9-f5e2-4dc8-bf62-3649611da824</uuid>
Nov 16 10:31:48 user nova-compute[85141]:   <name>instance-0000002c</name>
Nov 16 10:31:48 user nova-compute[85141]:   <memory>524288</memory>
Nov 16 10:31:48 user nova-compute[85141]:   <vcpu>1</vcpu>
Nov 16 10:31:48 user nova-compute[85141]:   <metadata>
Nov 16 10:31:48 user nova-compute[85141]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 10:31:48 user nova-compute[85141]:       <nova:package version="0.0.0"/>
Nov 16 10:31:48 user nova-compute[85141]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-1630724157</nova:name>
Nov 16 10:31:48 user nova-compute[85141]:       <nova:creationTime>2023-11-16 10:31:48</nova:creationTime>
Nov 16 10:31:48 user nova-compute[85141]:       <nova:flavor name="m1.tiny">
Nov 16 10:31:48 user nova-compute[85141]:         <nova:memory>512</nova:memory>
Nov 16 10:31:48 user nova-compute[85141]:         <nova:disk>1</nova:disk>
Nov 16 10:31:48 user nova-compute[85141]:         <nova:swap>0</nova:swap>
Nov 16 10:31:48 user nova-compute[85141]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 10:31:48 user nova-compute[85141]:         <nova:vcpus>1</nova:vcpus>
Nov 16 10:31:48 user nova-compute[85141]:       </nova:flavor>
Nov 16 10:31:48 user nova-compute[85141]:       <nova:owner>
Nov 16 10:31:48 user nova-compute[85141]:         <nova:user uuid="1490d069bf4c4783a82300496a38b141">tempest-TestServerVolumeAttachScenarioOldVersion-263106525-project-member</nova:user>
Nov 16 10:31:48 user nova-compute[85141]:         <nova:project uuid="7439b97798684ddfb5c98026abe079d0">tempest-TestServerVolumeAttachScenarioOldVersion-263106525</nova:project>
Nov 16 10:31:48 user nova-compute[85141]:       </nova:owner>
Nov 16 10:31:48 user nova-compute[85141]:       <nova:root type="image" uuid="bc4ca70f-a459-4d5c-a9e6-80f1948eb48b"/>
Nov 16 10:31:48 user nova-compute[85141]:       <nova:ports>
Nov 16 10:31:48 user nova-compute[85141]:         <nova:port uuid="57dd011e-4f3b-44bd-a8e1-e17a515e29e2">
Nov 16 10:31:48 user nova-compute[85141]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 16 10:31:48 user nova-compute[85141]:         </nova:port>
Nov 16 10:31:48 user nova-compute[85141]:       </nova:ports>
Nov 16 10:31:48 user nova-compute[85141]:     </nova:instance>
Nov 16 10:31:48 user nova-compute[85141]:   </metadata>
Nov 16 10:31:48 user nova-compute[85141]:   <sysinfo type="smbios">
Nov 16 10:31:48 user nova-compute[85141]:     <system>
Nov 16 10:31:48 user nova-compute[85141]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 10:31:48 user nova-compute[85141]:       <entry name="product">OpenStack Nova</entry>
Nov 16 10:31:48 user nova-compute[85141]:       <entry name="version">0.0.0</entry>
Nov 16 10:31:48 user nova-compute[85141]:       <entry name="serial">ac3f3bc9-f5e2-4dc8-bf62-3649611da824</entry>
Nov 16 10:31:48 user nova-compute[85141]:       <entry name="uuid">ac3f3bc9-f5e2-4dc8-bf62-3649611da824</entry>
Nov 16 10:31:48 user nova-compute[85141]:       <entry name="family">Virtual Machine</entry>
Nov 16 10:31:48 user nova-compute[85141]:     </system>
Nov 16 10:31:48 user nova-compute[85141]:   </sysinfo>
Nov 16 10:31:48 user nova-compute[85141]:   <os>
Nov 16 10:31:48 user nova-compute[85141]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 10:31:48 user nova-compute[85141]:     <boot dev="hd"/>
Nov 16 10:31:48 user nova-compute[85141]:     <smbios mode="sysinfo"/>
Nov 16 10:31:48 user nova-compute[85141]:   </os>
Nov 16 10:31:48 user nova-compute[85141]:   <features>
Nov 16 10:31:48 user nova-compute[85141]:     <acpi/>
Nov 16 10:31:48 user nova-compute[85141]:     <apic/>
Nov 16 10:31:48 user nova-compute[85141]:     <vmcoreinfo/>
Nov 16 10:31:48 user nova-compute[85141]:   </features>
Nov 16 10:31:48 user nova-compute[85141]:   <clock offset="utc">
Nov 16 10:31:48 user nova-compute[85141]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 10:31:48 user nova-compute[85141]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 10:31:48 user nova-compute[85141]:     <timer name="hpet" present="no"/>
Nov 16 10:31:48 user nova-compute[85141]:   </clock>
Nov 16 10:31:48 user nova-compute[85141]:   <cpu mode="custom" match="exact">
Nov 16 10:31:48 user nova-compute[85141]:     <model>Nehalem</model>
Nov 16 10:31:48 user nova-compute[85141]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 10:31:48 user nova-compute[85141]:   </cpu>
Nov 16 10:31:48 user nova-compute[85141]:   <devices>
Nov 16 10:31:48 user nova-compute[85141]:     <disk type="file" device="disk">
Nov 16 10:31:48 user nova-compute[85141]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 10:31:48 user nova-compute[85141]:       <source file="/opt/stack/data/nova/instances/ac3f3bc9-f5e2-4dc8-bf62-3649611da824/disk"/>
Nov 16 10:31:48 user nova-compute[85141]:       <target dev="vda" bus="virtio"/>
Nov 16 10:31:48 user nova-compute[85141]:     </disk>
Nov 16 10:31:48 user nova-compute[85141]:     <interface type="ethernet">
Nov 16 10:31:48 user nova-compute[85141]:       <mac address="fa:16:3e:28:e8:42"/>
Nov 16 10:31:48 user nova-compute[85141]:       <model type="virtio"/>
Nov 16 10:31:48 user nova-compute[85141]:       <mtu size="1442"/>
Nov 16 10:31:48 user nova-compute[85141]:       <target dev="tap57dd011e-4f"/>
Nov 16 10:31:48 user nova-compute[85141]:     </interface>
Nov 16 10:31:48 user nova-compute[85141]:     <serial type="pty">
Nov 16 10:31:48 user nova-compute[85141]:       <log file="/opt/stack/data/nova/instances/ac3f3bc9-f5e2-4dc8-bf62-3649611da824/console.log" append="off"/>
Nov 16 10:31:48 user nova-compute[85141]:     </serial>
Nov 16 10:31:48 user nova-compute[85141]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 10:31:48 user nova-compute[85141]:     <video>
Nov 16 10:31:48 user nova-compute[85141]:       <model type="virtio"/>
Nov 16 10:31:48 user nova-compute[85141]:     </video>
Nov 16 10:31:48 user nova-compute[85141]:     <rng model="virtio">
Nov 16 10:31:48 user nova-compute[85141]:       <backend model="random">/dev/urandom</backend>
Nov 16 10:31:48 user nova-compute[85141]:     </rng>
Nov 16 10:31:48 user nova-compute[85141]:     <controller type="usb" index="0" model="none"/>
Nov 16 10:31:48 user nova-compute[85141]:     <memballoon model="virtio">
Nov 16 10:31:48 user nova-compute[85141]:       <stats period="10"/>
Nov 16 10:31:48 user nova-compute[85141]:     </memballoon>
Nov 16 10:31:48 user nova-compute[85141]:   </devices>
Nov 16 10:31:48 user nova-compute[85141]: </domain>
Nov 16 10:31:48 user nova-compute[85141]:  {{(pid=85141) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 10:31:48 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-54672304-7dc9-4075-80b1-a23f989a6710 tempest-TestServerVolumeAttachScenarioOldVersion-263106525 tempest-TestServerVolumeAttachScenarioOldVersion-263106525-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T10:31:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1630724157',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1630724157',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1630724',id=44,image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHLSgP+AL3EOr7wtsiRGgI+eODUyi+l+ylR0QErUYK/fxaI0AzjLVGrR+UJBFTC3sNOVDiWIFsHxiQsRr9FX+sFyoOnMVWkcrVdRrewE75k2+ICLMvfOikgPNgTTZOmelQ==',key_name='tempest-keypair-456696076',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7439b97798684ddfb5c98026abe079d0',ramdisk_id='',reservation_id='r-c2fk4efh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-263106525',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-263106525-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T10:31:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1490d069bf4c4783a82300496a38b141',uuid=ac3f3bc9-f5e2-4dc8-bf62-3649611da824,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "57dd011e-4f3b-44bd-a8e1-e17a515e29e2", "address": "fa:16:3e:28:e8:42", "network": {"id": "ef4876c8-a963-4474-894f-71371d1313da", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-459369775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7439b97798684ddfb5c98026abe079d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57dd011e-4f", "ovs_interfaceid": "57dd011e-4f3b-44bd-a8e1-e17a515e29e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 10:31:48 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-54672304-7dc9-4075-80b1-a23f989a6710 tempest-TestServerVolumeAttachScenarioOldVersion-263106525 tempest-TestServerVolumeAttachScenarioOldVersion-263106525-project-member] Converting VIF {"id": "57dd011e-4f3b-44bd-a8e1-e17a515e29e2", "address": "fa:16:3e:28:e8:42", "network": {"id": "ef4876c8-a963-4474-894f-71371d1313da", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-459369775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7439b97798684ddfb5c98026abe079d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57dd011e-4f", "ovs_interfaceid": "57dd011e-4f3b-44bd-a8e1-e17a515e29e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:31:48 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-54672304-7dc9-4075-80b1-a23f989a6710 tempest-TestServerVolumeAttachScenarioOldVersion-263106525 tempest-TestServerVolumeAttachScenarioOldVersion-263106525-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:e8:42,bridge_name='br-int',has_traffic_filtering=True,id=57dd011e-4f3b-44bd-a8e1-e17a515e29e2,network=Network(ef4876c8-a963-4474-894f-71371d1313da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57dd011e-4f') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:31:48 user nova-compute[85141]: DEBUG os_vif [None req-54672304-7dc9-4075-80b1-a23f989a6710 tempest-TestServerVolumeAttachScenarioOldVersion-263106525 tempest-TestServerVolumeAttachScenarioOldVersion-263106525-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:e8:42,bridge_name='br-int',has_traffic_filtering=True,id=57dd011e-4f3b-44bd-a8e1-e17a515e29e2,network=Network(ef4876c8-a963-4474-894f-71371d1313da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57dd011e-4f') {{(pid=85141) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 10:31:48 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:31:48 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:31:48 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 10:31:48 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:31:48 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3fa4702a-3d53-5ff8-a0c6-2e762239ef94', '_type': 'linux-noop'}}, row=False) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:31:48 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:31:48 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:31:48 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:31:48 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap57dd011e-4f, may_exist=True, interface_attrs={}) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:31:48 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap57dd011e-4f, col_values=(('qos', UUID('8d029781-332a-4b6a-9231-aaa8be7cbc35')),), if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:31:48 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap57dd011e-4f, col_values=(('external_ids', {'iface-id': '57dd011e-4f3b-44bd-a8e1-e17a515e29e2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:28:e8:42', 'vm-uuid': 'ac3f3bc9-f5e2-4dc8-bf62-3649611da824'}),), if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:31:48 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:31:48 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:31:48 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:31:48 user nova-compute[85141]: INFO os_vif [None req-54672304-7dc9-4075-80b1-a23f989a6710 tempest-TestServerVolumeAttachScenarioOldVersion-263106525 tempest-TestServerVolumeAttachScenarioOldVersion-263106525-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:e8:42,bridge_name='br-int',has_traffic_filtering=True,id=57dd011e-4f3b-44bd-a8e1-e17a515e29e2,network=Network(ef4876c8-a963-4474-894f-71371d1313da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57dd011e-4f')
Nov 16 10:31:48 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-54672304-7dc9-4075-80b1-a23f989a6710 tempest-TestServerVolumeAttachScenarioOldVersion-263106525 tempest-TestServerVolumeAttachScenarioOldVersion-263106525-project-member] No BDM found with device name vda, not building metadata. {{(pid=85141) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 10:31:48 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-54672304-7dc9-4075-80b1-a23f989a6710 tempest-TestServerVolumeAttachScenarioOldVersion-263106525 tempest-TestServerVolumeAttachScenarioOldVersion-263106525-project-member] No VIF found with MAC fa:16:3e:28:e8:42, not building metadata {{(pid=85141) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 10:31:49 user nova-compute[85141]: DEBUG nova.network.neutron [req-b6009e46-30b6-44f2-87bf-1efded41a7e2 req-4375c495-060c-4303-b19e-32036cb700c1 service nova] [instance: ac3f3bc9-f5e2-4dc8-bf62-3649611da824] Updated VIF entry in instance network info cache for port 57dd011e-4f3b-44bd-a8e1-e17a515e29e2. {{(pid=85141) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 10:31:49 user nova-compute[85141]: DEBUG nova.network.neutron [req-b6009e46-30b6-44f2-87bf-1efded41a7e2 req-4375c495-060c-4303-b19e-32036cb700c1 service nova] [instance: ac3f3bc9-f5e2-4dc8-bf62-3649611da824] Updating instance_info_cache with network_info: [{"id": "57dd011e-4f3b-44bd-a8e1-e17a515e29e2", "address": "fa:16:3e:28:e8:42", "network": {"id": "ef4876c8-a963-4474-894f-71371d1313da", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-459369775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7439b97798684ddfb5c98026abe079d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57dd011e-4f", "ovs_interfaceid": "57dd011e-4f3b-44bd-a8e1-e17a515e29e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:31:49 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-b6009e46-30b6-44f2-87bf-1efded41a7e2 req-4375c495-060c-4303-b19e-32036cb700c1 service nova] Releasing lock "refresh_cache-ac3f3bc9-f5e2-4dc8-bf62-3649611da824" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:31:49 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:31:49 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:31:49 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:31:50 user nova-compute[85141]: DEBUG nova.compute.manager [req-63dd08ef-7ddf-4c07-8a2d-3084ceb914db req-8461daa9-53b5-4602-86d3-a8eaac70cf25 service nova] [instance: ac3f3bc9-f5e2-4dc8-bf62-3649611da824] Received event network-vif-plugged-57dd011e-4f3b-44bd-a8e1-e17a515e29e2 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:31:50 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-63dd08ef-7ddf-4c07-8a2d-3084ceb914db req-8461daa9-53b5-4602-86d3-a8eaac70cf25 service nova] Acquiring lock "ac3f3bc9-f5e2-4dc8-bf62-3649611da824-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:31:50 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-63dd08ef-7ddf-4c07-8a2d-3084ceb914db req-8461daa9-53b5-4602-86d3-a8eaac70cf25 service nova] Lock "ac3f3bc9-f5e2-4dc8-bf62-3649611da824-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:31:50 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-63dd08ef-7ddf-4c07-8a2d-3084ceb914db req-8461daa9-53b5-4602-86d3-a8eaac70cf25 service nova] Lock "ac3f3bc9-f5e2-4dc8-bf62-3649611da824-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:31:50 user nova-compute[85141]: DEBUG nova.compute.manager [req-63dd08ef-7ddf-4c07-8a2d-3084ceb914db req-8461daa9-53b5-4602-86d3-a8eaac70cf25 service nova] [instance: ac3f3bc9-f5e2-4dc8-bf62-3649611da824] No waiting events found dispatching network-vif-plugged-57dd011e-4f3b-44bd-a8e1-e17a515e29e2 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:31:50 user nova-compute[85141]: WARNING nova.compute.manager [req-63dd08ef-7ddf-4c07-8a2d-3084ceb914db req-8461daa9-53b5-4602-86d3-a8eaac70cf25 service nova] [instance: ac3f3bc9-f5e2-4dc8-bf62-3649611da824] Received unexpected event network-vif-plugged-57dd011e-4f3b-44bd-a8e1-e17a515e29e2 for instance with vm_state building and task_state spawning.
Nov 16 10:31:50 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:31:50 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:31:51 user nova-compute[85141]: DEBUG nova.compute.manager [None req-54672304-7dc9-4075-80b1-a23f989a6710 tempest-TestServerVolumeAttachScenarioOldVersion-263106525 tempest-TestServerVolumeAttachScenarioOldVersion-263106525-project-member] [instance: ac3f3bc9-f5e2-4dc8-bf62-3649611da824] Instance event wait completed in 0 seconds for  {{(pid=85141) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 10:31:51 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-54672304-7dc9-4075-80b1-a23f989a6710 tempest-TestServerVolumeAttachScenarioOldVersion-263106525 tempest-TestServerVolumeAttachScenarioOldVersion-263106525-project-member] [instance: ac3f3bc9-f5e2-4dc8-bf62-3649611da824] Guest created on hypervisor {{(pid=85141) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 10:31:52 user nova-compute[85141]: INFO nova.virt.libvirt.driver [-] [instance: ac3f3bc9-f5e2-4dc8-bf62-3649611da824] Instance spawned successfully.
Nov 16 10:31:52 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-54672304-7dc9-4075-80b1-a23f989a6710 tempest-TestServerVolumeAttachScenarioOldVersion-263106525 tempest-TestServerVolumeAttachScenarioOldVersion-263106525-project-member] [instance: ac3f3bc9-f5e2-4dc8-bf62-3649611da824] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 10:31:52 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-54672304-7dc9-4075-80b1-a23f989a6710 tempest-TestServerVolumeAttachScenarioOldVersion-263106525 tempest-TestServerVolumeAttachScenarioOldVersion-263106525-project-member] [instance: ac3f3bc9-f5e2-4dc8-bf62-3649611da824] Found default for hw_cdrom_bus of ide {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:31:52 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-54672304-7dc9-4075-80b1-a23f989a6710 tempest-TestServerVolumeAttachScenarioOldVersion-263106525 tempest-TestServerVolumeAttachScenarioOldVersion-263106525-project-member] [instance: ac3f3bc9-f5e2-4dc8-bf62-3649611da824] Found default for hw_disk_bus of virtio {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:31:52 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-54672304-7dc9-4075-80b1-a23f989a6710 tempest-TestServerVolumeAttachScenarioOldVersion-263106525 tempest-TestServerVolumeAttachScenarioOldVersion-263106525-project-member] [instance: ac3f3bc9-f5e2-4dc8-bf62-3649611da824] Found default for hw_input_bus of None {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:31:52 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-54672304-7dc9-4075-80b1-a23f989a6710 tempest-TestServerVolumeAttachScenarioOldVersion-263106525 tempest-TestServerVolumeAttachScenarioOldVersion-263106525-project-member] [instance: ac3f3bc9-f5e2-4dc8-bf62-3649611da824] Found default for hw_pointer_model of None {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:31:52 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-54672304-7dc9-4075-80b1-a23f989a6710 tempest-TestServerVolumeAttachScenarioOldVersion-263106525 tempest-TestServerVolumeAttachScenarioOldVersion-263106525-project-member] [instance: ac3f3bc9-f5e2-4dc8-bf62-3649611da824] Found default for hw_video_model of virtio {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:31:52 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-54672304-7dc9-4075-80b1-a23f989a6710 tempest-TestServerVolumeAttachScenarioOldVersion-263106525 tempest-TestServerVolumeAttachScenarioOldVersion-263106525-project-member] [instance: ac3f3bc9-f5e2-4dc8-bf62-3649611da824] Found default for hw_vif_model of virtio {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:31:52 user nova-compute[85141]: INFO nova.compute.manager [None req-54672304-7dc9-4075-80b1-a23f989a6710 tempest-TestServerVolumeAttachScenarioOldVersion-263106525 tempest-TestServerVolumeAttachScenarioOldVersion-263106525-project-member] [instance: ac3f3bc9-f5e2-4dc8-bf62-3649611da824] Took 5.38 seconds to spawn the instance on the hypervisor.
Nov 16 10:31:52 user nova-compute[85141]: DEBUG nova.compute.manager [None req-54672304-7dc9-4075-80b1-a23f989a6710 tempest-TestServerVolumeAttachScenarioOldVersion-263106525 tempest-TestServerVolumeAttachScenarioOldVersion-263106525-project-member] [instance: ac3f3bc9-f5e2-4dc8-bf62-3649611da824] Checking state {{(pid=85141) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 10:31:52 user nova-compute[85141]: DEBUG nova.compute.manager [req-9a085e5a-e3d4-404c-b8d3-356cd124ba5f req-a0949ad5-35e9-4154-a254-3a6bf8742c84 service nova] [instance: ac3f3bc9-f5e2-4dc8-bf62-3649611da824] Received event network-vif-plugged-57dd011e-4f3b-44bd-a8e1-e17a515e29e2 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:31:52 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-9a085e5a-e3d4-404c-b8d3-356cd124ba5f req-a0949ad5-35e9-4154-a254-3a6bf8742c84 service nova] Acquiring lock "ac3f3bc9-f5e2-4dc8-bf62-3649611da824-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:31:52 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-9a085e5a-e3d4-404c-b8d3-356cd124ba5f req-a0949ad5-35e9-4154-a254-3a6bf8742c84 service nova] Lock "ac3f3bc9-f5e2-4dc8-bf62-3649611da824-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:31:52 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-9a085e5a-e3d4-404c-b8d3-356cd124ba5f req-a0949ad5-35e9-4154-a254-3a6bf8742c84 service nova] Lock "ac3f3bc9-f5e2-4dc8-bf62-3649611da824-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:31:52 user nova-compute[85141]: DEBUG nova.compute.manager [req-9a085e5a-e3d4-404c-b8d3-356cd124ba5f req-a0949ad5-35e9-4154-a254-3a6bf8742c84 service nova] [instance: ac3f3bc9-f5e2-4dc8-bf62-3649611da824] No waiting events found dispatching network-vif-plugged-57dd011e-4f3b-44bd-a8e1-e17a515e29e2 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:31:52 user nova-compute[85141]: WARNING nova.compute.manager [req-9a085e5a-e3d4-404c-b8d3-356cd124ba5f req-a0949ad5-35e9-4154-a254-3a6bf8742c84 service nova] [instance: ac3f3bc9-f5e2-4dc8-bf62-3649611da824] Received unexpected event network-vif-plugged-57dd011e-4f3b-44bd-a8e1-e17a515e29e2 for instance with vm_state building and task_state spawning.
Nov 16 10:31:52 user nova-compute[85141]: INFO nova.compute.manager [None req-54672304-7dc9-4075-80b1-a23f989a6710 tempest-TestServerVolumeAttachScenarioOldVersion-263106525 tempest-TestServerVolumeAttachScenarioOldVersion-263106525-project-member] [instance: ac3f3bc9-f5e2-4dc8-bf62-3649611da824] Took 6.38 seconds to build instance.
Nov 16 10:31:52 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-54672304-7dc9-4075-80b1-a23f989a6710 tempest-TestServerVolumeAttachScenarioOldVersion-263106525 tempest-TestServerVolumeAttachScenarioOldVersion-263106525-project-member] Lock "ac3f3bc9-f5e2-4dc8-bf62-3649611da824" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.561s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:31:52 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:31:53 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:31:53 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:31:53 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:31:55 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:31:58 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-59eb82a1-fbb8-40d9-b004-dd47a6c227de tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Acquiring lock "2f1b7a62-fdc2-4b8e-b9f8-61105c0fcb5c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:31:58 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-59eb82a1-fbb8-40d9-b004-dd47a6c227de tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Lock "2f1b7a62-fdc2-4b8e-b9f8-61105c0fcb5c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:31:58 user nova-compute[85141]: DEBUG nova.compute.manager [None req-59eb82a1-fbb8-40d9-b004-dd47a6c227de tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] [instance: 2f1b7a62-fdc2-4b8e-b9f8-61105c0fcb5c] Starting instance... {{(pid=85141) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 10:31:58 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-59eb82a1-fbb8-40d9-b004-dd47a6c227de tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:31:58 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-59eb82a1-fbb8-40d9-b004-dd47a6c227de tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:31:58 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-59eb82a1-fbb8-40d9-b004-dd47a6c227de tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=85141) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 10:31:58 user nova-compute[85141]: INFO nova.compute.claims [None req-59eb82a1-fbb8-40d9-b004-dd47a6c227de tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] [instance: 2f1b7a62-fdc2-4b8e-b9f8-61105c0fcb5c] Claim successful on node user
Nov 16 10:31:58 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:31:58 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:31:58 user nova-compute[85141]: DEBUG nova.compute.provider_tree [None req-59eb82a1-fbb8-40d9-b004-dd47a6c227de tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Inventory has not changed in ProviderTree for provider: bf8e0fa1-16b6-408f-9203-c4cd63916272 {{(pid=85141) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 10:31:58 user nova-compute[85141]: DEBUG nova.scheduler.client.report [None req-59eb82a1-fbb8-40d9-b004-dd47a6c227de tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Inventory has not changed for provider bf8e0fa1-16b6-408f-9203-c4cd63916272 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=85141) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 10:31:58 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-59eb82a1-fbb8-40d9-b004-dd47a6c227de tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.353s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:31:58 user nova-compute[85141]: DEBUG nova.compute.manager [None req-59eb82a1-fbb8-40d9-b004-dd47a6c227de tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] [instance: 2f1b7a62-fdc2-4b8e-b9f8-61105c0fcb5c] Start building networks asynchronously for instance. {{(pid=85141) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 10:31:58 user nova-compute[85141]: DEBUG nova.compute.manager [None req-59eb82a1-fbb8-40d9-b004-dd47a6c227de tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] [instance: 2f1b7a62-fdc2-4b8e-b9f8-61105c0fcb5c] Allocating IP information in the background. {{(pid=85141) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 10:31:58 user nova-compute[85141]: DEBUG nova.network.neutron [None req-59eb82a1-fbb8-40d9-b004-dd47a6c227de tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] [instance: 2f1b7a62-fdc2-4b8e-b9f8-61105c0fcb5c] allocate_for_instance() {{(pid=85141) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 10:31:58 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-59eb82a1-fbb8-40d9-b004-dd47a6c227de tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] [instance: 2f1b7a62-fdc2-4b8e-b9f8-61105c0fcb5c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 10:31:58 user nova-compute[85141]: DEBUG nova.compute.manager [None req-59eb82a1-fbb8-40d9-b004-dd47a6c227de tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] [instance: 2f1b7a62-fdc2-4b8e-b9f8-61105c0fcb5c] Start building block device mappings for instance. {{(pid=85141) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 10:31:58 user nova-compute[85141]: DEBUG nova.policy [None req-59eb82a1-fbb8-40d9-b004-dd47a6c227de tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5aa5beeeca5d4dc89cf5333942da756f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd13c6ff3c30549ca9ab44d9fc1fedc6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85141) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 10:31:58 user nova-compute[85141]: DEBUG nova.compute.manager [None req-59eb82a1-fbb8-40d9-b004-dd47a6c227de tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] [instance: 2f1b7a62-fdc2-4b8e-b9f8-61105c0fcb5c] Start spawning the instance on the hypervisor. {{(pid=85141) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 10:31:58 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-59eb82a1-fbb8-40d9-b004-dd47a6c227de tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] [instance: 2f1b7a62-fdc2-4b8e-b9f8-61105c0fcb5c] Creating instance directory {{(pid=85141) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 10:31:58 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-59eb82a1-fbb8-40d9-b004-dd47a6c227de tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] [instance: 2f1b7a62-fdc2-4b8e-b9f8-61105c0fcb5c] Creating image(s)
Nov 16 10:31:58 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-59eb82a1-fbb8-40d9-b004-dd47a6c227de tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Acquiring lock "/opt/stack/data/nova/instances/2f1b7a62-fdc2-4b8e-b9f8-61105c0fcb5c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:31:58 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-59eb82a1-fbb8-40d9-b004-dd47a6c227de tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Lock "/opt/stack/data/nova/instances/2f1b7a62-fdc2-4b8e-b9f8-61105c0fcb5c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:31:58 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-59eb82a1-fbb8-40d9-b004-dd47a6c227de tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Lock "/opt/stack/data/nova/instances/2f1b7a62-fdc2-4b8e-b9f8-61105c0fcb5c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:31:58 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-59eb82a1-fbb8-40d9-b004-dd47a6c227de tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:31:59 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-59eb82a1-fbb8-40d9-b004-dd47a6c227de tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json" returned: 0 in 0.197s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:31:59 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-59eb82a1-fbb8-40d9-b004-dd47a6c227de tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Acquiring lock "60a78556fb399ed4a41bc3ca4bccf77c96d8e811" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:31:59 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-59eb82a1-fbb8-40d9-b004-dd47a6c227de tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Lock "60a78556fb399ed4a41bc3ca4bccf77c96d8e811" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:31:59 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-59eb82a1-fbb8-40d9-b004-dd47a6c227de tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:31:59 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-59eb82a1-fbb8-40d9-b004-dd47a6c227de tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json" returned: 0 in 0.213s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:31:59 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-59eb82a1-fbb8-40d9-b004-dd47a6c227de tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811,backing_fmt=raw /opt/stack/data/nova/instances/2f1b7a62-fdc2-4b8e-b9f8-61105c0fcb5c/disk 1073741824 {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:31:59 user nova-compute[85141]: DEBUG nova.network.neutron [None req-59eb82a1-fbb8-40d9-b004-dd47a6c227de tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] [instance: 2f1b7a62-fdc2-4b8e-b9f8-61105c0fcb5c] Successfully created port: 3c3baa93-b4c3-4cf5-b363-aab7e937312b {{(pid=85141) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 10:31:59 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-59eb82a1-fbb8-40d9-b004-dd47a6c227de tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811,backing_fmt=raw /opt/stack/data/nova/instances/2f1b7a62-fdc2-4b8e-b9f8-61105c0fcb5c/disk 1073741824" returned: 0 in 0.050s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:31:59 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-59eb82a1-fbb8-40d9-b004-dd47a6c227de tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Lock "60a78556fb399ed4a41bc3ca4bccf77c96d8e811" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.269s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:31:59 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-59eb82a1-fbb8-40d9-b004-dd47a6c227de tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:31:59 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-59eb82a1-fbb8-40d9-b004-dd47a6c227de tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json" returned: 0 in 0.190s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:31:59 user nova-compute[85141]: DEBUG nova.virt.disk.api [None req-59eb82a1-fbb8-40d9-b004-dd47a6c227de tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2f1b7a62-fdc2-4b8e-b9f8-61105c0fcb5c/disk. size=1073741824 {{(pid=85141) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 10:31:59 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-59eb82a1-fbb8-40d9-b004-dd47a6c227de tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f1b7a62-fdc2-4b8e-b9f8-61105c0fcb5c/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:31:59 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-59eb82a1-fbb8-40d9-b004-dd47a6c227de tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f1b7a62-fdc2-4b8e-b9f8-61105c0fcb5c/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:31:59 user nova-compute[85141]: DEBUG nova.virt.disk.api [None req-59eb82a1-fbb8-40d9-b004-dd47a6c227de tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Cannot resize image /opt/stack/data/nova/instances/2f1b7a62-fdc2-4b8e-b9f8-61105c0fcb5c/disk to a smaller size. {{(pid=85141) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 10:31:59 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-59eb82a1-fbb8-40d9-b004-dd47a6c227de tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] [instance: 2f1b7a62-fdc2-4b8e-b9f8-61105c0fcb5c] Created local disks {{(pid=85141) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 10:31:59 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-59eb82a1-fbb8-40d9-b004-dd47a6c227de tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] [instance: 2f1b7a62-fdc2-4b8e-b9f8-61105c0fcb5c] Ensure instance console log exists: /opt/stack/data/nova/instances/2f1b7a62-fdc2-4b8e-b9f8-61105c0fcb5c/console.log {{(pid=85141) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 10:31:59 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-59eb82a1-fbb8-40d9-b004-dd47a6c227de tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:31:59 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-59eb82a1-fbb8-40d9-b004-dd47a6c227de tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:31:59 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-59eb82a1-fbb8-40d9-b004-dd47a6c227de tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:31:59 user nova-compute[85141]: DEBUG nova.network.neutron [None req-59eb82a1-fbb8-40d9-b004-dd47a6c227de tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] [instance: 2f1b7a62-fdc2-4b8e-b9f8-61105c0fcb5c] Successfully updated port: 3c3baa93-b4c3-4cf5-b363-aab7e937312b {{(pid=85141) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 10:31:59 user nova-compute[85141]: DEBUG nova.compute.manager [req-29f7dacc-b049-4ee3-89dd-0d48eb94f93c req-7407fbff-7b1f-4dad-b16f-3af6daa9d92e service nova] [instance: 2f1b7a62-fdc2-4b8e-b9f8-61105c0fcb5c] Received event network-changed-3c3baa93-b4c3-4cf5-b363-aab7e937312b {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:31:59 user nova-compute[85141]: DEBUG nova.compute.manager [req-29f7dacc-b049-4ee3-89dd-0d48eb94f93c req-7407fbff-7b1f-4dad-b16f-3af6daa9d92e service nova] [instance: 2f1b7a62-fdc2-4b8e-b9f8-61105c0fcb5c] Refreshing instance network info cache due to event network-changed-3c3baa93-b4c3-4cf5-b363-aab7e937312b. {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 10:31:59 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-29f7dacc-b049-4ee3-89dd-0d48eb94f93c req-7407fbff-7b1f-4dad-b16f-3af6daa9d92e service nova] Acquiring lock "refresh_cache-2f1b7a62-fdc2-4b8e-b9f8-61105c0fcb5c" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:31:59 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-29f7dacc-b049-4ee3-89dd-0d48eb94f93c req-7407fbff-7b1f-4dad-b16f-3af6daa9d92e service nova] Acquired lock "refresh_cache-2f1b7a62-fdc2-4b8e-b9f8-61105c0fcb5c" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:31:59 user nova-compute[85141]: DEBUG nova.network.neutron [req-29f7dacc-b049-4ee3-89dd-0d48eb94f93c req-7407fbff-7b1f-4dad-b16f-3af6daa9d92e service nova] [instance: 2f1b7a62-fdc2-4b8e-b9f8-61105c0fcb5c] Refreshing network info cache for port 3c3baa93-b4c3-4cf5-b363-aab7e937312b {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 10:31:59 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-59eb82a1-fbb8-40d9-b004-dd47a6c227de tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Acquiring lock "refresh_cache-2f1b7a62-fdc2-4b8e-b9f8-61105c0fcb5c" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:31:59 user nova-compute[85141]: DEBUG nova.network.neutron [req-29f7dacc-b049-4ee3-89dd-0d48eb94f93c req-7407fbff-7b1f-4dad-b16f-3af6daa9d92e service nova] [instance: 2f1b7a62-fdc2-4b8e-b9f8-61105c0fcb5c] Instance cache missing network info. {{(pid=85141) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 10:32:00 user nova-compute[85141]: DEBUG nova.network.neutron [req-29f7dacc-b049-4ee3-89dd-0d48eb94f93c req-7407fbff-7b1f-4dad-b16f-3af6daa9d92e service nova] [instance: 2f1b7a62-fdc2-4b8e-b9f8-61105c0fcb5c] Updating instance_info_cache with network_info: [] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:32:00 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-29f7dacc-b049-4ee3-89dd-0d48eb94f93c req-7407fbff-7b1f-4dad-b16f-3af6daa9d92e service nova] Releasing lock "refresh_cache-2f1b7a62-fdc2-4b8e-b9f8-61105c0fcb5c" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:32:00 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-59eb82a1-fbb8-40d9-b004-dd47a6c227de tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Acquired lock "refresh_cache-2f1b7a62-fdc2-4b8e-b9f8-61105c0fcb5c" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:32:00 user nova-compute[85141]: DEBUG nova.network.neutron [None req-59eb82a1-fbb8-40d9-b004-dd47a6c227de tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] [instance: 2f1b7a62-fdc2-4b8e-b9f8-61105c0fcb5c] Building network info cache for instance {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 10:32:00 user nova-compute[85141]: DEBUG nova.network.neutron [None req-59eb82a1-fbb8-40d9-b004-dd47a6c227de tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] [instance: 2f1b7a62-fdc2-4b8e-b9f8-61105c0fcb5c] Instance cache missing network info. {{(pid=85141) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 10:32:00 user nova-compute[85141]: DEBUG nova.network.neutron [None req-59eb82a1-fbb8-40d9-b004-dd47a6c227de tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] [instance: 2f1b7a62-fdc2-4b8e-b9f8-61105c0fcb5c] Updating instance_info_cache with network_info: [{"id": "3c3baa93-b4c3-4cf5-b363-aab7e937312b", "address": "fa:16:3e:d1:c8:21", "network": {"id": "8931cd8f-3c0b-4d49-ae98-48f818e854e7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1902653571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d13c6ff3c30549ca9ab44d9fc1fedc6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c3baa93-b4", "ovs_interfaceid": "3c3baa93-b4c3-4cf5-b363-aab7e937312b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:32:00 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-59eb82a1-fbb8-40d9-b004-dd47a6c227de tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Releasing lock "refresh_cache-2f1b7a62-fdc2-4b8e-b9f8-61105c0fcb5c" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:32:00 user nova-compute[85141]: DEBUG nova.compute.manager [None req-59eb82a1-fbb8-40d9-b004-dd47a6c227de tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] [instance: 2f1b7a62-fdc2-4b8e-b9f8-61105c0fcb5c] Instance network_info: |[{"id": "3c3baa93-b4c3-4cf5-b363-aab7e937312b", "address": "fa:16:3e:d1:c8:21", "network": {"id": "8931cd8f-3c0b-4d49-ae98-48f818e854e7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1902653571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d13c6ff3c30549ca9ab44d9fc1fedc6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c3baa93-b4", "ovs_interfaceid": "3c3baa93-b4c3-4cf5-b363-aab7e937312b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=85141) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 10:32:00 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-59eb82a1-fbb8-40d9-b004-dd47a6c227de tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] [instance: 2f1b7a62-fdc2-4b8e-b9f8-61105c0fcb5c] Start _get_guest_xml network_info=[{"id": "3c3baa93-b4c3-4cf5-b363-aab7e937312b", "address": "fa:16:3e:d1:c8:21", "network": {"id": "8931cd8f-3c0b-4d49-ae98-48f818e854e7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1902653571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d13c6ff3c30549ca9ab44d9fc1fedc6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c3baa93-b4", "ovs_interfaceid": "3c3baa93-b4c3-4cf5-b363-aab7e937312b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T10:06:42Z,direct_url=<?>,disk_format='qcow2',id=bc4ca70f-a459-4d5c-a9e6-80f1948eb48b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1044631a5fe84ce8904864a7024049fa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T10:06:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_options': None, 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'image_id': 'bc4ca70f-a459-4d5c-a9e6-80f1948eb48b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=85141) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 10:32:00 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-59eb82a1-fbb8-40d9-b004-dd47a6c227de tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:32:00 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-59eb82a1-fbb8-40d9-b004-dd47a6c227de tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:32:00 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-59eb82a1-fbb8-40d9-b004-dd47a6c227de tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=85141) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 10:32:00 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-59eb82a1-fbb8-40d9-b004-dd47a6c227de tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] CPU controller missing on host. {{(pid=85141) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 10:32:00 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-59eb82a1-fbb8-40d9-b004-dd47a6c227de tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=85141) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 10:32:00 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-59eb82a1-fbb8-40d9-b004-dd47a6c227de tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] CPU controller found on host. {{(pid=85141) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 10:32:00 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-59eb82a1-fbb8-40d9-b004-dd47a6c227de tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=85141) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 10:32:00 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-59eb82a1-fbb8-40d9-b004-dd47a6c227de tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T10:06:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T10:06:42Z,direct_url=<?>,disk_format='qcow2',id=bc4ca70f-a459-4d5c-a9e6-80f1948eb48b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1044631a5fe84ce8904864a7024049fa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T10:06:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 10:32:00 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-59eb82a1-fbb8-40d9-b004-dd47a6c227de tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Flavor limits 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 10:32:00 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-59eb82a1-fbb8-40d9-b004-dd47a6c227de tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Image limits 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 10:32:00 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-59eb82a1-fbb8-40d9-b004-dd47a6c227de tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Flavor pref 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 10:32:00 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-59eb82a1-fbb8-40d9-b004-dd47a6c227de tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Image pref 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 10:32:00 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-59eb82a1-fbb8-40d9-b004-dd47a6c227de tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 10:32:00 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-59eb82a1-fbb8-40d9-b004-dd47a6c227de tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 10:32:00 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-59eb82a1-fbb8-40d9-b004-dd47a6c227de tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=85141) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 10:32:00 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-59eb82a1-fbb8-40d9-b004-dd47a6c227de tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Got 1 possible topologies {{(pid=85141) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 10:32:00 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-59eb82a1-fbb8-40d9-b004-dd47a6c227de tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 10:32:00 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-59eb82a1-fbb8-40d9-b004-dd47a6c227de tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 10:32:00 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-59eb82a1-fbb8-40d9-b004-dd47a6c227de tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T10:31:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1378175750',display_name='tempest-AttachVolumeNegativeTest-server-1378175750',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1378175750',id=45,image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHkzme+UavyKmSDzV1as216oEyW9V6Nj6NWY0N5YJN3Zb18eJvmXEPhLTsLoj7DzKUhzrnnUSYSQonwxDZSZplU7nlmMxrnwyKdOV9cd9SsidWTFbneIsLLnPSGl8uqVhg==',key_name='tempest-keypair-1962877264',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d13c6ff3c30549ca9ab44d9fc1fedc6f',ramdisk_id='',reservation_id='r-kzfnhyif',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-2108292208',owner_user_name='tempest-AttachVolumeNegativeTest-2108292208-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T10:31:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5aa5beeeca5d4dc89cf5333942da756f',uuid=2f1b7a62-fdc2-4b8e-b9f8-61105c0fcb5c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3c3baa93-b4c3-4cf5-b363-aab7e937312b", "address": "fa:16:3e:d1:c8:21", "network": {"id": "8931cd8f-3c0b-4d49-ae98-48f818e854e7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1902653571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d13c6ff3c30549ca9ab44d9fc1fedc6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c3baa93-b4", "ovs_interfaceid": "3c3baa93-b4c3-4cf5-b363-aab7e937312b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=85141) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 10:32:00 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-59eb82a1-fbb8-40d9-b004-dd47a6c227de tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Converting VIF {"id": "3c3baa93-b4c3-4cf5-b363-aab7e937312b", "address": "fa:16:3e:d1:c8:21", "network": {"id": "8931cd8f-3c0b-4d49-ae98-48f818e854e7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1902653571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d13c6ff3c30549ca9ab44d9fc1fedc6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c3baa93-b4", "ovs_interfaceid": "3c3baa93-b4c3-4cf5-b363-aab7e937312b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:32:00 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-59eb82a1-fbb8-40d9-b004-dd47a6c227de tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d1:c8:21,bridge_name='br-int',has_traffic_filtering=True,id=3c3baa93-b4c3-4cf5-b363-aab7e937312b,network=Network(8931cd8f-3c0b-4d49-ae98-48f818e854e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c3baa93-b4') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:32:00 user nova-compute[85141]: DEBUG nova.objects.instance [None req-59eb82a1-fbb8-40d9-b004-dd47a6c227de tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Lazy-loading 'pci_devices' on Instance uuid 2f1b7a62-fdc2-4b8e-b9f8-61105c0fcb5c {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:32:00 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-59eb82a1-fbb8-40d9-b004-dd47a6c227de tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] [instance: 2f1b7a62-fdc2-4b8e-b9f8-61105c0fcb5c] End _get_guest_xml xml=<domain type="kvm">
Nov 16 10:32:00 user nova-compute[85141]:   <uuid>2f1b7a62-fdc2-4b8e-b9f8-61105c0fcb5c</uuid>
Nov 16 10:32:00 user nova-compute[85141]:   <name>instance-0000002d</name>
Nov 16 10:32:00 user nova-compute[85141]:   <memory>524288</memory>
Nov 16 10:32:00 user nova-compute[85141]:   <vcpu>1</vcpu>
Nov 16 10:32:00 user nova-compute[85141]:   <metadata>
Nov 16 10:32:00 user nova-compute[85141]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 10:32:00 user nova-compute[85141]:       <nova:package version="0.0.0"/>
Nov 16 10:32:00 user nova-compute[85141]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1378175750</nova:name>
Nov 16 10:32:00 user nova-compute[85141]:       <nova:creationTime>2023-11-16 10:32:00</nova:creationTime>
Nov 16 10:32:00 user nova-compute[85141]:       <nova:flavor name="m1.tiny">
Nov 16 10:32:00 user nova-compute[85141]:         <nova:memory>512</nova:memory>
Nov 16 10:32:00 user nova-compute[85141]:         <nova:disk>1</nova:disk>
Nov 16 10:32:00 user nova-compute[85141]:         <nova:swap>0</nova:swap>
Nov 16 10:32:00 user nova-compute[85141]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 10:32:00 user nova-compute[85141]:         <nova:vcpus>1</nova:vcpus>
Nov 16 10:32:00 user nova-compute[85141]:       </nova:flavor>
Nov 16 10:32:00 user nova-compute[85141]:       <nova:owner>
Nov 16 10:32:00 user nova-compute[85141]:         <nova:user uuid="5aa5beeeca5d4dc89cf5333942da756f">tempest-AttachVolumeNegativeTest-2108292208-project-member</nova:user>
Nov 16 10:32:00 user nova-compute[85141]:         <nova:project uuid="d13c6ff3c30549ca9ab44d9fc1fedc6f">tempest-AttachVolumeNegativeTest-2108292208</nova:project>
Nov 16 10:32:00 user nova-compute[85141]:       </nova:owner>
Nov 16 10:32:00 user nova-compute[85141]:       <nova:root type="image" uuid="bc4ca70f-a459-4d5c-a9e6-80f1948eb48b"/>
Nov 16 10:32:00 user nova-compute[85141]:       <nova:ports>
Nov 16 10:32:00 user nova-compute[85141]:         <nova:port uuid="3c3baa93-b4c3-4cf5-b363-aab7e937312b">
Nov 16 10:32:00 user nova-compute[85141]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 16 10:32:00 user nova-compute[85141]:         </nova:port>
Nov 16 10:32:00 user nova-compute[85141]:       </nova:ports>
Nov 16 10:32:00 user nova-compute[85141]:     </nova:instance>
Nov 16 10:32:00 user nova-compute[85141]:   </metadata>
Nov 16 10:32:00 user nova-compute[85141]:   <sysinfo type="smbios">
Nov 16 10:32:00 user nova-compute[85141]:     <system>
Nov 16 10:32:00 user nova-compute[85141]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 10:32:00 user nova-compute[85141]:       <entry name="product">OpenStack Nova</entry>
Nov 16 10:32:00 user nova-compute[85141]:       <entry name="version">0.0.0</entry>
Nov 16 10:32:00 user nova-compute[85141]:       <entry name="serial">2f1b7a62-fdc2-4b8e-b9f8-61105c0fcb5c</entry>
Nov 16 10:32:00 user nova-compute[85141]:       <entry name="uuid">2f1b7a62-fdc2-4b8e-b9f8-61105c0fcb5c</entry>
Nov 16 10:32:00 user nova-compute[85141]:       <entry name="family">Virtual Machine</entry>
Nov 16 10:32:00 user nova-compute[85141]:     </system>
Nov 16 10:32:00 user nova-compute[85141]:   </sysinfo>
Nov 16 10:32:00 user nova-compute[85141]:   <os>
Nov 16 10:32:00 user nova-compute[85141]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 10:32:00 user nova-compute[85141]:     <boot dev="hd"/>
Nov 16 10:32:00 user nova-compute[85141]:     <smbios mode="sysinfo"/>
Nov 16 10:32:00 user nova-compute[85141]:   </os>
Nov 16 10:32:00 user nova-compute[85141]:   <features>
Nov 16 10:32:00 user nova-compute[85141]:     <acpi/>
Nov 16 10:32:00 user nova-compute[85141]:     <apic/>
Nov 16 10:32:00 user nova-compute[85141]:     <vmcoreinfo/>
Nov 16 10:32:00 user nova-compute[85141]:   </features>
Nov 16 10:32:00 user nova-compute[85141]:   <clock offset="utc">
Nov 16 10:32:00 user nova-compute[85141]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 10:32:00 user nova-compute[85141]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 10:32:00 user nova-compute[85141]:     <timer name="hpet" present="no"/>
Nov 16 10:32:00 user nova-compute[85141]:   </clock>
Nov 16 10:32:00 user nova-compute[85141]:   <cpu mode="custom" match="exact">
Nov 16 10:32:00 user nova-compute[85141]:     <model>Nehalem</model>
Nov 16 10:32:00 user nova-compute[85141]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 10:32:00 user nova-compute[85141]:   </cpu>
Nov 16 10:32:00 user nova-compute[85141]:   <devices>
Nov 16 10:32:00 user nova-compute[85141]:     <disk type="file" device="disk">
Nov 16 10:32:00 user nova-compute[85141]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 10:32:00 user nova-compute[85141]:       <source file="/opt/stack/data/nova/instances/2f1b7a62-fdc2-4b8e-b9f8-61105c0fcb5c/disk"/>
Nov 16 10:32:00 user nova-compute[85141]:       <target dev="vda" bus="virtio"/>
Nov 16 10:32:00 user nova-compute[85141]:     </disk>
Nov 16 10:32:00 user nova-compute[85141]:     <interface type="ethernet">
Nov 16 10:32:00 user nova-compute[85141]:       <mac address="fa:16:3e:d1:c8:21"/>
Nov 16 10:32:00 user nova-compute[85141]:       <model type="virtio"/>
Nov 16 10:32:00 user nova-compute[85141]:       <mtu size="1442"/>
Nov 16 10:32:00 user nova-compute[85141]:       <target dev="tap3c3baa93-b4"/>
Nov 16 10:32:00 user nova-compute[85141]:     </interface>
Nov 16 10:32:00 user nova-compute[85141]:     <serial type="pty">
Nov 16 10:32:00 user nova-compute[85141]:       <log file="/opt/stack/data/nova/instances/2f1b7a62-fdc2-4b8e-b9f8-61105c0fcb5c/console.log" append="off"/>
Nov 16 10:32:00 user nova-compute[85141]:     </serial>
Nov 16 10:32:00 user nova-compute[85141]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 10:32:00 user nova-compute[85141]:     <video>
Nov 16 10:32:00 user nova-compute[85141]:       <model type="virtio"/>
Nov 16 10:32:00 user nova-compute[85141]:     </video>
Nov 16 10:32:00 user nova-compute[85141]:     <rng model="virtio">
Nov 16 10:32:00 user nova-compute[85141]:       <backend model="random">/dev/urandom</backend>
Nov 16 10:32:00 user nova-compute[85141]:     </rng>
Nov 16 10:32:00 user nova-compute[85141]:     <controller type="usb" index="0" model="none"/>
Nov 16 10:32:00 user nova-compute[85141]:     <memballoon model="virtio">
Nov 16 10:32:00 user nova-compute[85141]:       <stats period="10"/>
Nov 16 10:32:00 user nova-compute[85141]:     </memballoon>
Nov 16 10:32:00 user nova-compute[85141]:   </devices>
Nov 16 10:32:00 user nova-compute[85141]: </domain>
Nov 16 10:32:00 user nova-compute[85141]:  {{(pid=85141) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 10:32:00 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-59eb82a1-fbb8-40d9-b004-dd47a6c227de tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T10:31:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1378175750',display_name='tempest-AttachVolumeNegativeTest-server-1378175750',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1378175750',id=45,image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHkzme+UavyKmSDzV1as216oEyW9V6Nj6NWY0N5YJN3Zb18eJvmXEPhLTsLoj7DzKUhzrnnUSYSQonwxDZSZplU7nlmMxrnwyKdOV9cd9SsidWTFbneIsLLnPSGl8uqVhg==',key_name='tempest-keypair-1962877264',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d13c6ff3c30549ca9ab44d9fc1fedc6f',ramdisk_id='',reservation_id='r-kzfnhyif',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-2108292208',owner_user_name='tempest-AttachVolumeNegativeTest-2108292208-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T10:31:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5aa5beeeca5d4dc89cf5333942da756f',uuid=2f1b7a62-fdc2-4b8e-b9f8-61105c0fcb5c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3c3baa93-b4c3-4cf5-b363-aab7e937312b", "address": "fa:16:3e:d1:c8:21", "network": {"id": "8931cd8f-3c0b-4d49-ae98-48f818e854e7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1902653571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d13c6ff3c30549ca9ab44d9fc1fedc6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c3baa93-b4", "ovs_interfaceid": "3c3baa93-b4c3-4cf5-b363-aab7e937312b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 10:32:00 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-59eb82a1-fbb8-40d9-b004-dd47a6c227de tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Converting VIF {"id": "3c3baa93-b4c3-4cf5-b363-aab7e937312b", "address": "fa:16:3e:d1:c8:21", "network": {"id": "8931cd8f-3c0b-4d49-ae98-48f818e854e7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1902653571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d13c6ff3c30549ca9ab44d9fc1fedc6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c3baa93-b4", "ovs_interfaceid": "3c3baa93-b4c3-4cf5-b363-aab7e937312b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:32:00 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-59eb82a1-fbb8-40d9-b004-dd47a6c227de tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d1:c8:21,bridge_name='br-int',has_traffic_filtering=True,id=3c3baa93-b4c3-4cf5-b363-aab7e937312b,network=Network(8931cd8f-3c0b-4d49-ae98-48f818e854e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c3baa93-b4') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:32:00 user nova-compute[85141]: DEBUG os_vif [None req-59eb82a1-fbb8-40d9-b004-dd47a6c227de tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:c8:21,bridge_name='br-int',has_traffic_filtering=True,id=3c3baa93-b4c3-4cf5-b363-aab7e937312b,network=Network(8931cd8f-3c0b-4d49-ae98-48f818e854e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c3baa93-b4') {{(pid=85141) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 10:32:00 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:32:00 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:32:00 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 10:32:00 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:32:00 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6efc86df-6554-5037-9944-4a4b5f479be5', '_type': 'linux-noop'}}, row=False) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:32:00 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:32:00 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:32:00 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:32:00 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:32:00 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3c3baa93-b4, may_exist=True, interface_attrs={}) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:32:00 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3c3baa93-b4, col_values=(('qos', UUID('62b4e292-f08b-4359-85e6-8a32ea1ff07c')),), if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:32:00 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3c3baa93-b4, col_values=(('external_ids', {'iface-id': '3c3baa93-b4c3-4cf5-b363-aab7e937312b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d1:c8:21', 'vm-uuid': '2f1b7a62-fdc2-4b8e-b9f8-61105c0fcb5c'}),), if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:32:00 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:32:00 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:32:00 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:32:00 user nova-compute[85141]: INFO os_vif [None req-59eb82a1-fbb8-40d9-b004-dd47a6c227de tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:c8:21,bridge_name='br-int',has_traffic_filtering=True,id=3c3baa93-b4c3-4cf5-b363-aab7e937312b,network=Network(8931cd8f-3c0b-4d49-ae98-48f818e854e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c3baa93-b4')
Nov 16 10:32:00 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-59eb82a1-fbb8-40d9-b004-dd47a6c227de tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] No BDM found with device name vda, not building metadata. {{(pid=85141) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 10:32:00 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-59eb82a1-fbb8-40d9-b004-dd47a6c227de tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] No VIF found with MAC fa:16:3e:d1:c8:21, not building metadata {{(pid=85141) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 10:32:01 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:32:01 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:32:01 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:32:01 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:32:02 user nova-compute[85141]: DEBUG nova.compute.manager [req-221ae5f1-d4dd-4569-b715-f5c704175789 req-8e005c4b-949e-442f-945f-04dede5c9cf6 service nova] [instance: 2f1b7a62-fdc2-4b8e-b9f8-61105c0fcb5c] Received event network-vif-plugged-3c3baa93-b4c3-4cf5-b363-aab7e937312b {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:32:02 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-221ae5f1-d4dd-4569-b715-f5c704175789 req-8e005c4b-949e-442f-945f-04dede5c9cf6 service nova] Acquiring lock "2f1b7a62-fdc2-4b8e-b9f8-61105c0fcb5c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:32:02 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-221ae5f1-d4dd-4569-b715-f5c704175789 req-8e005c4b-949e-442f-945f-04dede5c9cf6 service nova] Lock "2f1b7a62-fdc2-4b8e-b9f8-61105c0fcb5c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:32:02 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-221ae5f1-d4dd-4569-b715-f5c704175789 req-8e005c4b-949e-442f-945f-04dede5c9cf6 service nova] Lock "2f1b7a62-fdc2-4b8e-b9f8-61105c0fcb5c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:32:02 user nova-compute[85141]: DEBUG nova.compute.manager [req-221ae5f1-d4dd-4569-b715-f5c704175789 req-8e005c4b-949e-442f-945f-04dede5c9cf6 service nova] [instance: 2f1b7a62-fdc2-4b8e-b9f8-61105c0fcb5c] No waiting events found dispatching network-vif-plugged-3c3baa93-b4c3-4cf5-b363-aab7e937312b {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:32:02 user nova-compute[85141]: WARNING nova.compute.manager [req-221ae5f1-d4dd-4569-b715-f5c704175789 req-8e005c4b-949e-442f-945f-04dede5c9cf6 service nova] [instance: 2f1b7a62-fdc2-4b8e-b9f8-61105c0fcb5c] Received unexpected event network-vif-plugged-3c3baa93-b4c3-4cf5-b363-aab7e937312b for instance with vm_state building and task_state spawning.
Nov 16 10:32:02 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:32:02 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:32:02 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:32:02 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:32:03 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:32:03 user nova-compute[85141]: DEBUG nova.compute.manager [None req-59eb82a1-fbb8-40d9-b004-dd47a6c227de tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] [instance: 2f1b7a62-fdc2-4b8e-b9f8-61105c0fcb5c] Instance event wait completed in 0 seconds for  {{(pid=85141) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 10:32:03 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-59eb82a1-fbb8-40d9-b004-dd47a6c227de tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] [instance: 2f1b7a62-fdc2-4b8e-b9f8-61105c0fcb5c] Guest created on hypervisor {{(pid=85141) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 10:32:03 user nova-compute[85141]: INFO nova.virt.libvirt.driver [-] [instance: 2f1b7a62-fdc2-4b8e-b9f8-61105c0fcb5c] Instance spawned successfully.
Nov 16 10:32:03 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-59eb82a1-fbb8-40d9-b004-dd47a6c227de tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] [instance: 2f1b7a62-fdc2-4b8e-b9f8-61105c0fcb5c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 10:32:03 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-59eb82a1-fbb8-40d9-b004-dd47a6c227de tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] [instance: 2f1b7a62-fdc2-4b8e-b9f8-61105c0fcb5c] Found default for hw_cdrom_bus of ide {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:32:03 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-59eb82a1-fbb8-40d9-b004-dd47a6c227de tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] [instance: 2f1b7a62-fdc2-4b8e-b9f8-61105c0fcb5c] Found default for hw_disk_bus of virtio {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:32:03 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-59eb82a1-fbb8-40d9-b004-dd47a6c227de tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] [instance: 2f1b7a62-fdc2-4b8e-b9f8-61105c0fcb5c] Found default for hw_input_bus of None {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:32:03 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-59eb82a1-fbb8-40d9-b004-dd47a6c227de tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] [instance: 2f1b7a62-fdc2-4b8e-b9f8-61105c0fcb5c] Found default for hw_pointer_model of None {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:32:04 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-59eb82a1-fbb8-40d9-b004-dd47a6c227de tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] [instance: 2f1b7a62-fdc2-4b8e-b9f8-61105c0fcb5c] Found default for hw_video_model of virtio {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:32:04 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-59eb82a1-fbb8-40d9-b004-dd47a6c227de tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] [instance: 2f1b7a62-fdc2-4b8e-b9f8-61105c0fcb5c] Found default for hw_vif_model of virtio {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:32:04 user nova-compute[85141]: INFO nova.compute.manager [None req-59eb82a1-fbb8-40d9-b004-dd47a6c227de tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] [instance: 2f1b7a62-fdc2-4b8e-b9f8-61105c0fcb5c] Took 5.20 seconds to spawn the instance on the hypervisor.
Nov 16 10:32:04 user nova-compute[85141]: DEBUG nova.compute.manager [None req-59eb82a1-fbb8-40d9-b004-dd47a6c227de tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] [instance: 2f1b7a62-fdc2-4b8e-b9f8-61105c0fcb5c] Checking state {{(pid=85141) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 10:32:04 user nova-compute[85141]: INFO nova.compute.manager [None req-59eb82a1-fbb8-40d9-b004-dd47a6c227de tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] [instance: 2f1b7a62-fdc2-4b8e-b9f8-61105c0fcb5c] Took 5.86 seconds to build instance.
Nov 16 10:32:04 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-59eb82a1-fbb8-40d9-b004-dd47a6c227de tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Lock "2f1b7a62-fdc2-4b8e-b9f8-61105c0fcb5c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.962s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:32:04 user nova-compute[85141]: DEBUG nova.compute.manager [req-3c2d9ec2-1f78-4843-9362-71dfdd3525c6 req-ba888732-c7bf-48b4-8e48-d2556a5eb779 service nova] [instance: 2f1b7a62-fdc2-4b8e-b9f8-61105c0fcb5c] Received event network-vif-plugged-3c3baa93-b4c3-4cf5-b363-aab7e937312b {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:32:04 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-3c2d9ec2-1f78-4843-9362-71dfdd3525c6 req-ba888732-c7bf-48b4-8e48-d2556a5eb779 service nova] Acquiring lock "2f1b7a62-fdc2-4b8e-b9f8-61105c0fcb5c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:32:04 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-3c2d9ec2-1f78-4843-9362-71dfdd3525c6 req-ba888732-c7bf-48b4-8e48-d2556a5eb779 service nova] Lock "2f1b7a62-fdc2-4b8e-b9f8-61105c0fcb5c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:32:04 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-3c2d9ec2-1f78-4843-9362-71dfdd3525c6 req-ba888732-c7bf-48b4-8e48-d2556a5eb779 service nova] Lock "2f1b7a62-fdc2-4b8e-b9f8-61105c0fcb5c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:32:04 user nova-compute[85141]: DEBUG nova.compute.manager [req-3c2d9ec2-1f78-4843-9362-71dfdd3525c6 req-ba888732-c7bf-48b4-8e48-d2556a5eb779 service nova] [instance: 2f1b7a62-fdc2-4b8e-b9f8-61105c0fcb5c] No waiting events found dispatching network-vif-plugged-3c3baa93-b4c3-4cf5-b363-aab7e937312b {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:32:04 user nova-compute[85141]: WARNING nova.compute.manager [req-3c2d9ec2-1f78-4843-9362-71dfdd3525c6 req-ba888732-c7bf-48b4-8e48-d2556a5eb779 service nova] [instance: 2f1b7a62-fdc2-4b8e-b9f8-61105c0fcb5c] Received unexpected event network-vif-plugged-3c3baa93-b4c3-4cf5-b363-aab7e937312b for instance with vm_state active and task_state None.
Nov 16 10:32:05 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:32:06 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-5eb28cf9-6662-419a-adaa-032ebf663de3 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 7437a3a3-9b7f-489b-b20b-f1b877ebb253 is timed out.
Nov 16 10:32:06 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-5eb28cf9-6662-419a-adaa-032ebf663de3 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] Successfully detached device vdc from instance 7437a3a3-9b7f-489b-b20b-f1b877ebb253 from the live domain config.
Nov 16 10:32:06 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5eb28cf9-6662-419a-adaa-032ebf663de3 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] [instance: 7437a3a3-9b7f-489b-b20b-f1b877ebb253] calling os-brick to detach iSCSI Volume {{(pid=85141) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 10:32:06 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eb28cf9-6662-419a-adaa-032ebf663de3 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51806b6080>, {'target_iqn': 'iqn.2010-10.org.openstack:aafe4bc8-430a-4d9d-93c7-ec25981b8bb0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kwVRpEhH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 10:32:06 user nova-compute[85141]: WARNING os_brick.initiator.connectors.base [None req-5eb28cf9-6662-419a-adaa-032ebf663de3 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 10:32:06 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-5eb28cf9-6662-419a-adaa-032ebf663de3 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 10:32:06 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-5eb28cf9-6662-419a-adaa-032ebf663de3 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 10:32:06 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:32:06 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:32:06 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3178390-17aa-4680-bca7-503c31652848]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e0c5c19d-363b-4f5d-a04f-fb7de64423f2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aafe4bc8-430a-4d9d-93c7-ec25981b8bb0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ebf4cfdf-97a5-4901-b8e0-df0704384909\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:32:06 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eb28cf9-6662-419a-adaa-032ebf663de3 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 10:32:06 user nova-compute[85141]: No targets found.
Nov 16 10:32:06 user nova-compute[85141]: iSNS:
Nov 16 10:32:06 user nova-compute[85141]: No targets found.
Nov 16 10:32:06 user nova-compute[85141]: STATIC:
Nov 16 10:32:06 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:e0c5c19d-363b-4f5d-a04f-fb7de64423f2
Nov 16 10:32:06 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:32:06 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:32:06 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:aafe4bc8-430a-4d9d-93c7-ec25981b8bb0
Nov 16 10:32:06 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:32:06 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:32:06 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:ebf4cfdf-97a5-4901-b8e0-df0704384909
Nov 16 10:32:06 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:32:06 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:32:06 user nova-compute[85141]: FIRMWARE:
Nov 16 10:32:06 user nova-compute[85141]: No targets found.
Nov 16 10:32:06 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:32:06 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eb28cf9-6662-419a-adaa-032ebf663de3 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 10:32:06 user nova-compute[85141]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 10:32:06 user nova-compute[85141]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=85141) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 10:32:06 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eb28cf9-6662-419a-adaa-032ebf663de3 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aafe4bc8-430a-4d9d-93c7-ec25981b8bb0', 0)] {{(pid=85141) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 10:32:06 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:32:06 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:32:06 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[c41947e5-7380-4ecd-94e8-2a67c176cbf1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aafe4bc8-430a-4d9d-93c7-ec25981b8bb0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e0c5c19d-363b-4f5d-a04f-fb7de64423f2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ebf4cfdf-97a5-4901-b8e0-df0704384909\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:32:06 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:32:06 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:32:06 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cfaffa5-d320-4903-a443-ce331ba70d49]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0c5c19d-363b-4f5d-a04f-fb7de64423f2 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebf4cfdf-97a5-4901-b8e0-df0704384909 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aafe4bc8-430a-4d9d-93c7-ec25981b8bb0 (non-flash)\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:32:06 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eb28cf9-6662-419a-adaa-032ebf663de3 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0c5c19d-363b-4f5d-a04f-fb7de64423f2 (non-flash)
Nov 16 10:32:06 user nova-compute[85141]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebf4cfdf-97a5-4901-b8e0-df0704384909 (non-flash)
Nov 16 10:32:06 user nova-compute[85141]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aafe4bc8-430a-4d9d-93c7-ec25981b8bb0 (non-flash)
Nov 16 10:32:06 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:32:06 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eb28cf9-6662-419a-adaa-032ebf663de3 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0c5c19d-363b-4f5d-a04f-fb7de64423f2 (non-flash)
Nov 16 10:32:06 user nova-compute[85141]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebf4cfdf-97a5-4901-b8e0-df0704384909 (non-flash)
Nov 16 10:32:06 user nova-compute[85141]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aafe4bc8-430a-4d9d-93c7-ec25981b8bb0 (non-flash)
Nov 16 10:32:06 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 10:32:06 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eb28cf9-6662-419a-adaa-032ebf663de3 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f518054f250>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aafe4bc8-430a-4d9d-93c7-ec25981b8bb0'): ({'sdb'}, set())}) {{(pid=85141) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 10:32:06 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-5eb28cf9-6662-419a-adaa-032ebf663de3 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] Removing single pathed devices sdb {{(pid=85141) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 10:32:06 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:32:06 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:32:06 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[78eec30d-29ae-432c-9f59-b5539bde459b]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:32:06 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:32:06 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:32:06 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[0312f5b0-5669-4f19-a57e-873c7c232b59]: (4, ('ok\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:32:06 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-5eb28cf9-6662-419a-adaa-032ebf663de3 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] Flushing IO for device /dev/sdb {{(pid=85141) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 10:32:06 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:32:06 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:32:06 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[175d7a61-9c70-4aa9-b5a6-5cff5f8dcc1c]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:32:06 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-5eb28cf9-6662-419a-adaa-032ebf663de3 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=85141) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 10:32:06 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:32:06 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.050s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:32:06 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd53bdee-bd37-4b4a-ae26-fdff140c170f]: (4, ('1', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:32:06 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-5eb28cf9-6662-419a-adaa-032ebf663de3 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=85141) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 10:32:06 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-5eb28cf9-6662-419a-adaa-032ebf663de3 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] SCSI volumes sdb have been removed. {{(pid=85141) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 10:32:06 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eb28cf9-6662-419a-adaa-032ebf663de3 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aafe4bc8-430a-4d9d-93c7-ec25981b8bb0')] {{(pid=85141) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 10:32:06 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aafe4bc8-430a-4d9d-93c7-ec25981b8bb0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:32:06 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aafe4bc8-430a-4d9d-93c7-ec25981b8bb0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:32:06 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[3478c0a0-a1ec-4e5e-873d-af9d8085033a]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:32:06 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eb28cf9-6662-419a-adaa-032ebf663de3 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:32:06 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aafe4bc8-430a-4d9d-93c7-ec25981b8bb0 -p 172.16.0.220:3260 --logout {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:32:06 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aafe4bc8-430a-4d9d-93c7-ec25981b8bb0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:32:06 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[3da2af18-312c-496b-8be2-3dac545e6be6]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:aafe4bc8-430a-4d9d-93c7-ec25981b8bb0, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:aafe4bc8-430a-4d9d-93c7-ec25981b8bb0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:32:06 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eb28cf9-6662-419a-adaa-032ebf663de3 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:aafe4bc8-430a-4d9d-93c7-ec25981b8bb0, portal: 172.16.0.220,3260]
Nov 16 10:32:06 user nova-compute[85141]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:aafe4bc8-430a-4d9d-93c7-ec25981b8bb0, portal: 172.16.0.220,3260] successful.
Nov 16 10:32:06 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:32:06 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aafe4bc8-430a-4d9d-93c7-ec25981b8bb0 -p 172.16.0.220:3260 --op delete {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:32:06 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aafe4bc8-430a-4d9d-93c7-ec25981b8bb0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:32:06 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8a77ab0-4c57-4e8f-a409-b3c9df77a18a]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:32:06 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eb28cf9-6662-419a-adaa-032ebf663de3 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:32:06 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-5eb28cf9-6662-419a-adaa-032ebf663de3 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.326s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 10:32:06 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eb28cf9-6662-419a-adaa-032ebf663de3 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] <== disconnect_volume: return (328ms) None {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 10:32:06 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5eb28cf9-6662-419a-adaa-032ebf663de3 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] [instance: 7437a3a3-9b7f-489b-b20b-f1b877ebb253] Disconnected iSCSI Volume {{(pid=85141) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 10:32:07 user nova-compute[85141]: DEBUG nova.objects.instance [None req-5eb28cf9-6662-419a-adaa-032ebf663de3 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] Lazy-loading 'flavor' on Instance uuid 7437a3a3-9b7f-489b-b20b-f1b877ebb253 {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:32:07 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5eb28cf9-6662-419a-adaa-032ebf663de3 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] Lock "7437a3a3-9b7f-489b-b20b-f1b877ebb253" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.844s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:32:07 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-a5c98d86-af4c-491b-90b4-81da984e3a2f tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Acquiring lock "4e214bbb-5bbb-4e6f-ac09-9cb1412f068b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:32:07 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-a5c98d86-af4c-491b-90b4-81da984e3a2f tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Lock "4e214bbb-5bbb-4e6f-ac09-9cb1412f068b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:32:07 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-a5c98d86-af4c-491b-90b4-81da984e3a2f tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Acquiring lock "4e214bbb-5bbb-4e6f-ac09-9cb1412f068b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:32:07 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-a5c98d86-af4c-491b-90b4-81da984e3a2f tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Lock "4e214bbb-5bbb-4e6f-ac09-9cb1412f068b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:32:07 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-a5c98d86-af4c-491b-90b4-81da984e3a2f tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Lock "4e214bbb-5bbb-4e6f-ac09-9cb1412f068b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:32:07 user nova-compute[85141]: INFO nova.compute.manager [None req-a5c98d86-af4c-491b-90b4-81da984e3a2f tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] [instance: 4e214bbb-5bbb-4e6f-ac09-9cb1412f068b] Terminating instance
Nov 16 10:32:07 user nova-compute[85141]: DEBUG nova.compute.manager [None req-a5c98d86-af4c-491b-90b4-81da984e3a2f tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] [instance: 4e214bbb-5bbb-4e6f-ac09-9cb1412f068b] Start destroying the instance on the hypervisor. {{(pid=85141) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 10:32:07 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:32:07 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:32:07 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:32:07 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:32:07 user nova-compute[85141]: DEBUG nova.compute.manager [req-175b219c-458e-4c77-91ad-bb013216b455 req-57a58cef-d376-459f-a6bf-1c3afb40b053 service nova] [instance: 4e214bbb-5bbb-4e6f-ac09-9cb1412f068b] Received event network-vif-unplugged-b0a1b07c-bdba-4ef8-893e-fb5dcdbac88c {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:32:07 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-175b219c-458e-4c77-91ad-bb013216b455 req-57a58cef-d376-459f-a6bf-1c3afb40b053 service nova] Acquiring lock "4e214bbb-5bbb-4e6f-ac09-9cb1412f068b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:32:07 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-175b219c-458e-4c77-91ad-bb013216b455 req-57a58cef-d376-459f-a6bf-1c3afb40b053 service nova] Lock "4e214bbb-5bbb-4e6f-ac09-9cb1412f068b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:32:07 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-175b219c-458e-4c77-91ad-bb013216b455 req-57a58cef-d376-459f-a6bf-1c3afb40b053 service nova] Lock "4e214bbb-5bbb-4e6f-ac09-9cb1412f068b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:32:07 user nova-compute[85141]: DEBUG nova.compute.manager [req-175b219c-458e-4c77-91ad-bb013216b455 req-57a58cef-d376-459f-a6bf-1c3afb40b053 service nova] [instance: 4e214bbb-5bbb-4e6f-ac09-9cb1412f068b] No waiting events found dispatching network-vif-unplugged-b0a1b07c-bdba-4ef8-893e-fb5dcdbac88c {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:32:07 user nova-compute[85141]: DEBUG nova.compute.manager [req-175b219c-458e-4c77-91ad-bb013216b455 req-57a58cef-d376-459f-a6bf-1c3afb40b053 service nova] [instance: 4e214bbb-5bbb-4e6f-ac09-9cb1412f068b] Received event network-vif-unplugged-b0a1b07c-bdba-4ef8-893e-fb5dcdbac88c for instance with task_state deleting. {{(pid=85141) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 10:32:07 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:32:07 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:32:07 user nova-compute[85141]: INFO nova.virt.libvirt.driver [-] [instance: 4e214bbb-5bbb-4e6f-ac09-9cb1412f068b] Instance destroyed successfully.
Nov 16 10:32:07 user nova-compute[85141]: DEBUG nova.objects.instance [None req-a5c98d86-af4c-491b-90b4-81da984e3a2f tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Lazy-loading 'resources' on Instance uuid 4e214bbb-5bbb-4e6f-ac09-9cb1412f068b {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:32:08 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-a5c98d86-af4c-491b-90b4-81da984e3a2f tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T10:15:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-936954893',display_name='tempest-ServerRescueNegativeTestJSON-server-936954893',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-936954893',id=17,image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-16T10:20:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='09b520de67ac4290a4b779f50afeb1a4',ramdisk_id='',reservation_id='r-xdeh19vp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-2068988845',owner_user_name='tempest-ServerRescueNegativeTestJSON-2068988845-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T10:21:57Z,user_data=None,user_id='76d4eaf5cef745c3bf3ae07068338b1a',uuid=4e214bbb-5bbb-4e6f-ac09-9cb1412f068b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b0a1b07c-bdba-4ef8-893e-fb5dcdbac88c", "address": "fa:16:3e:b9:03:60", "network": {"id": "5b67a3fd-ef1e-4f2c-b6e0-31766ef39d30", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2137186235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09b520de67ac4290a4b779f50afeb1a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0a1b07c-bd", "ovs_interfaceid": "b0a1b07c-bdba-4ef8-893e-fb5dcdbac88c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 10:32:08 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-a5c98d86-af4c-491b-90b4-81da984e3a2f tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Converting VIF {"id": "b0a1b07c-bdba-4ef8-893e-fb5dcdbac88c", "address": "fa:16:3e:b9:03:60", "network": {"id": "5b67a3fd-ef1e-4f2c-b6e0-31766ef39d30", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2137186235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09b520de67ac4290a4b779f50afeb1a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0a1b07c-bd", "ovs_interfaceid": "b0a1b07c-bdba-4ef8-893e-fb5dcdbac88c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:32:08 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-a5c98d86-af4c-491b-90b4-81da984e3a2f tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b9:03:60,bridge_name='br-int',has_traffic_filtering=True,id=b0a1b07c-bdba-4ef8-893e-fb5dcdbac88c,network=Network(5b67a3fd-ef1e-4f2c-b6e0-31766ef39d30),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0a1b07c-bd') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:32:08 user nova-compute[85141]: DEBUG os_vif [None req-a5c98d86-af4c-491b-90b4-81da984e3a2f tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b9:03:60,bridge_name='br-int',has_traffic_filtering=True,id=b0a1b07c-bdba-4ef8-893e-fb5dcdbac88c,network=Network(5b67a3fd-ef1e-4f2c-b6e0-31766ef39d30),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0a1b07c-bd') {{(pid=85141) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 10:32:08 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:32:08 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb0a1b07c-bd, bridge=br-int, if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:32:08 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:32:08 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:32:08 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:32:08 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1e1502b0-ea1d-4cc0-9a8b-3540b15362bb) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:32:08 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:32:08 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:32:08 user nova-compute[85141]: INFO os_vif [None req-a5c98d86-af4c-491b-90b4-81da984e3a2f tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b9:03:60,bridge_name='br-int',has_traffic_filtering=True,id=b0a1b07c-bdba-4ef8-893e-fb5dcdbac88c,network=Network(5b67a3fd-ef1e-4f2c-b6e0-31766ef39d30),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0a1b07c-bd')
Nov 16 10:32:08 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-a5c98d86-af4c-491b-90b4-81da984e3a2f tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] [instance: 4e214bbb-5bbb-4e6f-ac09-9cb1412f068b] Deleting instance files /opt/stack/data/nova/instances/4e214bbb-5bbb-4e6f-ac09-9cb1412f068b_del
Nov 16 10:32:08 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-a5c98d86-af4c-491b-90b4-81da984e3a2f tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] [instance: 4e214bbb-5bbb-4e6f-ac09-9cb1412f068b] Deletion of /opt/stack/data/nova/instances/4e214bbb-5bbb-4e6f-ac09-9cb1412f068b_del complete
Nov 16 10:32:08 user nova-compute[85141]: INFO nova.compute.manager [None req-a5c98d86-af4c-491b-90b4-81da984e3a2f tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] [instance: 4e214bbb-5bbb-4e6f-ac09-9cb1412f068b] Took 0.69 seconds to destroy the instance on the hypervisor.
Nov 16 10:32:08 user nova-compute[85141]: DEBUG oslo.service.loopingcall [None req-a5c98d86-af4c-491b-90b4-81da984e3a2f tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=85141) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 10:32:08 user nova-compute[85141]: DEBUG nova.compute.manager [-] [instance: 4e214bbb-5bbb-4e6f-ac09-9cb1412f068b] Deallocating network for instance {{(pid=85141) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 10:32:08 user nova-compute[85141]: DEBUG nova.network.neutron [-] [instance: 4e214bbb-5bbb-4e6f-ac09-9cb1412f068b] deallocate_for_instance() {{(pid=85141) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 10:32:08 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:32:08 user nova-compute[85141]: DEBUG nova.network.neutron [-] [instance: 4e214bbb-5bbb-4e6f-ac09-9cb1412f068b] Updating instance_info_cache with network_info: [] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:32:08 user nova-compute[85141]: INFO nova.compute.manager [-] [instance: 4e214bbb-5bbb-4e6f-ac09-9cb1412f068b] Took 0.57 seconds to deallocate network for instance.
Nov 16 10:32:08 user nova-compute[85141]: DEBUG nova.compute.manager [req-55e7fe40-a5e2-4601-b532-a39f55c5eb75 req-294640ad-4b51-4d5c-ace9-a5dc7a6e93e4 service nova] [instance: 4e214bbb-5bbb-4e6f-ac09-9cb1412f068b] Received event network-vif-deleted-b0a1b07c-bdba-4ef8-893e-fb5dcdbac88c {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:32:08 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-a5c98d86-af4c-491b-90b4-81da984e3a2f tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:32:08 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-a5c98d86-af4c-491b-90b4-81da984e3a2f tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:32:08 user nova-compute[85141]: DEBUG nova.compute.provider_tree [None req-a5c98d86-af4c-491b-90b4-81da984e3a2f tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Inventory has not changed in ProviderTree for provider: bf8e0fa1-16b6-408f-9203-c4cd63916272 {{(pid=85141) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 10:32:08 user nova-compute[85141]: DEBUG nova.scheduler.client.report [None req-a5c98d86-af4c-491b-90b4-81da984e3a2f tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Inventory has not changed for provider bf8e0fa1-16b6-408f-9203-c4cd63916272 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=85141) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 10:32:09 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-a5c98d86-af4c-491b-90b4-81da984e3a2f tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.270s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:32:09 user nova-compute[85141]: INFO nova.scheduler.client.report [None req-a5c98d86-af4c-491b-90b4-81da984e3a2f tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Deleted allocations for instance 4e214bbb-5bbb-4e6f-ac09-9cb1412f068b
Nov 16 10:32:09 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-a5c98d86-af4c-491b-90b4-81da984e3a2f tempest-ServerRescueNegativeTestJSON-2068988845 tempest-ServerRescueNegativeTestJSON-2068988845-project-member] Lock "4e214bbb-5bbb-4e6f-ac09-9cb1412f068b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.710s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:32:09 user nova-compute[85141]: DEBUG nova.compute.manager [req-10302223-0164-4a8b-bc35-2e8d36015ef5 req-cc4c42ac-83ce-4097-9f3d-c55a20cf5227 service nova] [instance: 4e214bbb-5bbb-4e6f-ac09-9cb1412f068b] Received event network-vif-plugged-b0a1b07c-bdba-4ef8-893e-fb5dcdbac88c {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:32:09 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-10302223-0164-4a8b-bc35-2e8d36015ef5 req-cc4c42ac-83ce-4097-9f3d-c55a20cf5227 service nova] Acquiring lock "4e214bbb-5bbb-4e6f-ac09-9cb1412f068b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:32:09 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-10302223-0164-4a8b-bc35-2e8d36015ef5 req-cc4c42ac-83ce-4097-9f3d-c55a20cf5227 service nova] Lock "4e214bbb-5bbb-4e6f-ac09-9cb1412f068b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:32:09 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-10302223-0164-4a8b-bc35-2e8d36015ef5 req-cc4c42ac-83ce-4097-9f3d-c55a20cf5227 service nova] Lock "4e214bbb-5bbb-4e6f-ac09-9cb1412f068b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:32:09 user nova-compute[85141]: DEBUG nova.compute.manager [req-10302223-0164-4a8b-bc35-2e8d36015ef5 req-cc4c42ac-83ce-4097-9f3d-c55a20cf5227 service nova] [instance: 4e214bbb-5bbb-4e6f-ac09-9cb1412f068b] No waiting events found dispatching network-vif-plugged-b0a1b07c-bdba-4ef8-893e-fb5dcdbac88c {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:32:09 user nova-compute[85141]: WARNING nova.compute.manager [req-10302223-0164-4a8b-bc35-2e8d36015ef5 req-cc4c42ac-83ce-4097-9f3d-c55a20cf5227 service nova] [instance: 4e214bbb-5bbb-4e6f-ac09-9cb1412f068b] Received unexpected event network-vif-plugged-b0a1b07c-bdba-4ef8-893e-fb5dcdbac88c for instance with vm_state deleted and task_state None.
Nov 16 10:32:13 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:32:13 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:32:14 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-be03123a-7203-4ea4-8b52-a6a7cd01a75c tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Acquiring lock "e1253324-3ca1-4610-b9d6-3db7c6c76828" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:32:14 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-be03123a-7203-4ea4-8b52-a6a7cd01a75c tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Lock "e1253324-3ca1-4610-b9d6-3db7c6c76828" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:32:14 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-be03123a-7203-4ea4-8b52-a6a7cd01a75c tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Acquiring lock "e1253324-3ca1-4610-b9d6-3db7c6c76828-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:32:14 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-be03123a-7203-4ea4-8b52-a6a7cd01a75c tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Lock "e1253324-3ca1-4610-b9d6-3db7c6c76828-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:32:14 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-be03123a-7203-4ea4-8b52-a6a7cd01a75c tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Lock "e1253324-3ca1-4610-b9d6-3db7c6c76828-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:32:14 user nova-compute[85141]: INFO nova.compute.manager [None req-be03123a-7203-4ea4-8b52-a6a7cd01a75c tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: e1253324-3ca1-4610-b9d6-3db7c6c76828] Terminating instance
Nov 16 10:32:14 user nova-compute[85141]: DEBUG nova.compute.manager [None req-be03123a-7203-4ea4-8b52-a6a7cd01a75c tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: e1253324-3ca1-4610-b9d6-3db7c6c76828] Start destroying the instance on the hypervisor. {{(pid=85141) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 10:32:14 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:32:14 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:32:14 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:32:14 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:32:14 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:32:15 user nova-compute[85141]: DEBUG nova.compute.manager [req-72c24e74-68f5-458e-bb59-bd680a453dce req-07a89ec2-5555-478b-ab7b-32ee9c11cb01 service nova] [instance: e1253324-3ca1-4610-b9d6-3db7c6c76828] Received event network-vif-unplugged-29a94474-9722-43fb-b61a-d8eca4d6d728 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:32:15 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-72c24e74-68f5-458e-bb59-bd680a453dce req-07a89ec2-5555-478b-ab7b-32ee9c11cb01 service nova] Acquiring lock "e1253324-3ca1-4610-b9d6-3db7c6c76828-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:32:15 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-72c24e74-68f5-458e-bb59-bd680a453dce req-07a89ec2-5555-478b-ab7b-32ee9c11cb01 service nova] Lock "e1253324-3ca1-4610-b9d6-3db7c6c76828-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:32:15 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-72c24e74-68f5-458e-bb59-bd680a453dce req-07a89ec2-5555-478b-ab7b-32ee9c11cb01 service nova] Lock "e1253324-3ca1-4610-b9d6-3db7c6c76828-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:32:15 user nova-compute[85141]: DEBUG nova.compute.manager [req-72c24e74-68f5-458e-bb59-bd680a453dce req-07a89ec2-5555-478b-ab7b-32ee9c11cb01 service nova] [instance: e1253324-3ca1-4610-b9d6-3db7c6c76828] No waiting events found dispatching network-vif-unplugged-29a94474-9722-43fb-b61a-d8eca4d6d728 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:32:15 user nova-compute[85141]: DEBUG nova.compute.manager [req-72c24e74-68f5-458e-bb59-bd680a453dce req-07a89ec2-5555-478b-ab7b-32ee9c11cb01 service nova] [instance: e1253324-3ca1-4610-b9d6-3db7c6c76828] Received event network-vif-unplugged-29a94474-9722-43fb-b61a-d8eca4d6d728 for instance with task_state deleting. {{(pid=85141) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 10:32:15 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:32:15 user nova-compute[85141]: INFO nova.virt.libvirt.driver [-] [instance: e1253324-3ca1-4610-b9d6-3db7c6c76828] Instance destroyed successfully.
Nov 16 10:32:15 user nova-compute[85141]: DEBUG nova.objects.instance [None req-be03123a-7203-4ea4-8b52-a6a7cd01a75c tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Lazy-loading 'resources' on Instance uuid e1253324-3ca1-4610-b9d6-3db7c6c76828 {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:32:15 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-be03123a-7203-4ea4-8b52-a6a7cd01a75c tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T10:27:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-615588371',display_name='tempest-TestVolumeBootPattern-volume-backed-server-615588371',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-615588371',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBYzzhkEK2/NjOq8Yn3s1/OzQQHvxzuiO6kqIBTDqgvHr65BPFUOAx5vszFFpF5ymvq8g8TtsBgjzBe0oF5cn8NT7CRg7igJehFG7Svi1to6c2aDBQ6RO7b9xkwKib4IUQ==',key_name='tempest-keypair-1027464512',keypairs=<?>,launch_index=0,launched_at=2023-11-16T10:27:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='aec3bb9fe5e6446590900b5adf65df0f',ramdisk_id='',reservation_id='r-ekv5wv10',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1979039357',owner_user_name='tempest-TestVolumeBootPattern-1979039357-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T10:27:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7261b57c36904fcda87a9ea32d4b5b31',uuid=e1253324-3ca1-4610-b9d6-3db7c6c76828,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "29a94474-9722-43fb-b61a-d8eca4d6d728", "address": "fa:16:3e:ea:fd:01", "network": {"id": "b8ada47f-9721-4358-ac4f-0305f06dbbb8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1663922860-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aec3bb9fe5e6446590900b5adf65df0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29a94474-97", "ovs_interfaceid": "29a94474-9722-43fb-b61a-d8eca4d6d728", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 10:32:15 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-be03123a-7203-4ea4-8b52-a6a7cd01a75c tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Converting VIF {"id": "29a94474-9722-43fb-b61a-d8eca4d6d728", "address": "fa:16:3e:ea:fd:01", "network": {"id": "b8ada47f-9721-4358-ac4f-0305f06dbbb8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1663922860-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aec3bb9fe5e6446590900b5adf65df0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29a94474-97", "ovs_interfaceid": "29a94474-9722-43fb-b61a-d8eca4d6d728", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:32:15 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-be03123a-7203-4ea4-8b52-a6a7cd01a75c tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ea:fd:01,bridge_name='br-int',has_traffic_filtering=True,id=29a94474-9722-43fb-b61a-d8eca4d6d728,network=Network(b8ada47f-9721-4358-ac4f-0305f06dbbb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29a94474-97') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:32:15 user nova-compute[85141]: DEBUG os_vif [None req-be03123a-7203-4ea4-8b52-a6a7cd01a75c tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ea:fd:01,bridge_name='br-int',has_traffic_filtering=True,id=29a94474-9722-43fb-b61a-d8eca4d6d728,network=Network(b8ada47f-9721-4358-ac4f-0305f06dbbb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29a94474-97') {{(pid=85141) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 10:32:15 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:32:15 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap29a94474-97, bridge=br-int, if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:32:15 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:32:15 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:32:15 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:32:15 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=47c866f4-2e4b-4cbc-8c69-270550ab144a) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:32:15 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:32:15 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:32:15 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:32:15 user nova-compute[85141]: INFO os_vif [None req-be03123a-7203-4ea4-8b52-a6a7cd01a75c tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ea:fd:01,bridge_name='br-int',has_traffic_filtering=True,id=29a94474-9722-43fb-b61a-d8eca4d6d728,network=Network(b8ada47f-9721-4358-ac4f-0305f06dbbb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29a94474-97')
Nov 16 10:32:15 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-be03123a-7203-4ea4-8b52-a6a7cd01a75c tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: e1253324-3ca1-4610-b9d6-3db7c6c76828] calling os-brick to detach iSCSI Volume {{(pid=85141) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 10:32:15 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-be03123a-7203-4ea4-8b52-a6a7cd01a75c tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51806b6080>, {'target_iqn': 'iqn.2010-10.org.openstack:e0c5c19d-363b-4f5d-a04f-fb7de64423f2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cfmRCWNK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 10:32:15 user nova-compute[85141]: WARNING os_brick.initiator.connectors.base [None req-be03123a-7203-4ea4-8b52-a6a7cd01a75c tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 10:32:15 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-be03123a-7203-4ea4-8b52-a6a7cd01a75c tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 10:32:15 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-be03123a-7203-4ea4-8b52-a6a7cd01a75c tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 10:32:15 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:32:15 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:32:15 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d40db25-2dd4-4cea-a9b6-28fa25ea7aa6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e0c5c19d-363b-4f5d-a04f-fb7de64423f2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ebf4cfdf-97a5-4901-b8e0-df0704384909\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:32:15 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-be03123a-7203-4ea4-8b52-a6a7cd01a75c tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 10:32:15 user nova-compute[85141]: No targets found.
Nov 16 10:32:15 user nova-compute[85141]: iSNS:
Nov 16 10:32:15 user nova-compute[85141]: No targets found.
Nov 16 10:32:15 user nova-compute[85141]: STATIC:
Nov 16 10:32:15 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:e0c5c19d-363b-4f5d-a04f-fb7de64423f2
Nov 16 10:32:15 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:32:15 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:32:15 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:ebf4cfdf-97a5-4901-b8e0-df0704384909
Nov 16 10:32:15 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:32:15 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:32:15 user nova-compute[85141]: FIRMWARE:
Nov 16 10:32:15 user nova-compute[85141]: No targets found.
Nov 16 10:32:15 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:32:15 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-be03123a-7203-4ea4-8b52-a6a7cd01a75c tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 10:32:15 user nova-compute[85141]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 10:32:15 user nova-compute[85141]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=85141) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 10:32:15 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-be03123a-7203-4ea4-8b52-a6a7cd01a75c tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e0c5c19d-363b-4f5d-a04f-fb7de64423f2', 0)] {{(pid=85141) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 10:32:15 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:32:15 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:32:15 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[92639947-fa62-4dfc-94bb-a0d2a092d94d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e0c5c19d-363b-4f5d-a04f-fb7de64423f2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ebf4cfdf-97a5-4901-b8e0-df0704384909\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:32:15 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:32:15 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:32:15 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[2609f873-9a40-4d78-8faa-20053410a378]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0c5c19d-363b-4f5d-a04f-fb7de64423f2 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebf4cfdf-97a5-4901-b8e0-df0704384909 (non-flash)\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:32:15 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-be03123a-7203-4ea4-8b52-a6a7cd01a75c tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0c5c19d-363b-4f5d-a04f-fb7de64423f2 (non-flash)
Nov 16 10:32:15 user nova-compute[85141]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebf4cfdf-97a5-4901-b8e0-df0704384909 (non-flash)
Nov 16 10:32:15 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:32:15 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-be03123a-7203-4ea4-8b52-a6a7cd01a75c tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0c5c19d-363b-4f5d-a04f-fb7de64423f2 (non-flash)
Nov 16 10:32:15 user nova-compute[85141]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebf4cfdf-97a5-4901-b8e0-df0704384909 (non-flash)
Nov 16 10:32:15 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 10:32:15 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-be03123a-7203-4ea4-8b52-a6a7cd01a75c tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5180692950>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e0c5c19d-363b-4f5d-a04f-fb7de64423f2'): ({'sde'}, set())}) {{(pid=85141) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 10:32:15 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-be03123a-7203-4ea4-8b52-a6a7cd01a75c tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Removing single pathed devices sde {{(pid=85141) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 10:32:15 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:32:15 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:32:15 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[b463c8ad-2bf0-4f37-9c06-5199dc58598e]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:32:15 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:32:15 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:32:15 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[84868ec8-ea4a-46f3-b113-204386076e15]: (4, ('ok\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:32:15 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-be03123a-7203-4ea4-8b52-a6a7cd01a75c tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Flushing IO for device /dev/sde {{(pid=85141) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 10:32:15 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:32:15 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:32:15 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7881b7e-623f-45f7-8ca4-fb0102c900a5]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:32:15 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-be03123a-7203-4ea4-8b52-a6a7cd01a75c tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=85141) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 10:32:15 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:32:15 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.047s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:32:15 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e08b345-4b8f-4fa3-a541-6d6086fd3e5d]: (4, ('1', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:32:15 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-be03123a-7203-4ea4-8b52-a6a7cd01a75c tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=85141) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 10:32:15 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-be03123a-7203-4ea4-8b52-a6a7cd01a75c tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] SCSI volumes sde have been removed. {{(pid=85141) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 10:32:15 user nova-compute[85141]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23563613235646439', '/dev/disk/by-id/scsi-1SCST_BIO3a431666-5ca25dd978cca602', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_3a431666') {{(pid=95342) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 16 10:32:15 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[640fd0be-63c6-4468-8382-7e090c8e275d]: (4, None) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:32:15 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-be03123a-7203-4ea4-8b52-a6a7cd01a75c tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e0c5c19d-363b-4f5d-a04f-fb7de64423f2')] {{(pid=85141) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 10:32:15 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0c5c19d-363b-4f5d-a04f-fb7de64423f2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:32:15 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0c5c19d-363b-4f5d-a04f-fb7de64423f2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:32:15 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[c83dad04-a175-45d2-a830-475c6ad3fc7c]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:32:15 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-be03123a-7203-4ea4-8b52-a6a7cd01a75c tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:32:15 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0c5c19d-363b-4f5d-a04f-fb7de64423f2 -p 172.16.0.220:3260 --logout {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:32:15 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0c5c19d-363b-4f5d-a04f-fb7de64423f2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:32:15 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[14637f58-bcab-48c1-b9ad-497103ed5954]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:e0c5c19d-363b-4f5d-a04f-fb7de64423f2, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:e0c5c19d-363b-4f5d-a04f-fb7de64423f2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:32:15 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-be03123a-7203-4ea4-8b52-a6a7cd01a75c tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:e0c5c19d-363b-4f5d-a04f-fb7de64423f2, portal: 172.16.0.220,3260]
Nov 16 10:32:15 user nova-compute[85141]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:e0c5c19d-363b-4f5d-a04f-fb7de64423f2, portal: 172.16.0.220,3260] successful.
Nov 16 10:32:15 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:32:15 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0c5c19d-363b-4f5d-a04f-fb7de64423f2 -p 172.16.0.220:3260 --op delete {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:32:15 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0c5c19d-363b-4f5d-a04f-fb7de64423f2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:32:15 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffc0be38-32ab-44e9-9a20-ed5e1520114b]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:32:15 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-be03123a-7203-4ea4-8b52-a6a7cd01a75c tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:32:15 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-be03123a-7203-4ea4-8b52-a6a7cd01a75c tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.309s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 10:32:15 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-be03123a-7203-4ea4-8b52-a6a7cd01a75c tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] <== disconnect_volume: return (311ms) None {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 10:32:15 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-be03123a-7203-4ea4-8b52-a6a7cd01a75c tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: e1253324-3ca1-4610-b9d6-3db7c6c76828] Disconnected iSCSI Volume {{(pid=85141) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 10:32:15 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-be03123a-7203-4ea4-8b52-a6a7cd01a75c tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: e1253324-3ca1-4610-b9d6-3db7c6c76828] Deleting instance files /opt/stack/data/nova/instances/e1253324-3ca1-4610-b9d6-3db7c6c76828_del
Nov 16 10:32:15 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-be03123a-7203-4ea4-8b52-a6a7cd01a75c tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: e1253324-3ca1-4610-b9d6-3db7c6c76828] Deletion of /opt/stack/data/nova/instances/e1253324-3ca1-4610-b9d6-3db7c6c76828_del complete
Nov 16 10:32:15 user nova-compute[85141]: INFO nova.compute.manager [None req-be03123a-7203-4ea4-8b52-a6a7cd01a75c tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: e1253324-3ca1-4610-b9d6-3db7c6c76828] Took 1.19 seconds to destroy the instance on the hypervisor.
Nov 16 10:32:15 user nova-compute[85141]: DEBUG oslo.service.loopingcall [None req-be03123a-7203-4ea4-8b52-a6a7cd01a75c tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=85141) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 10:32:15 user nova-compute[85141]: DEBUG nova.compute.manager [-] [instance: e1253324-3ca1-4610-b9d6-3db7c6c76828] Deallocating network for instance {{(pid=85141) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 10:32:15 user nova-compute[85141]: DEBUG nova.network.neutron [-] [instance: e1253324-3ca1-4610-b9d6-3db7c6c76828] deallocate_for_instance() {{(pid=85141) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 10:32:16 user nova-compute[85141]: DEBUG nova.network.neutron [-] [instance: e1253324-3ca1-4610-b9d6-3db7c6c76828] Updating instance_info_cache with network_info: [] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:32:16 user nova-compute[85141]: DEBUG nova.compute.manager [req-dbab868b-62a1-46c0-96ff-b190d4cf50f8 req-cc902893-4a6b-4e5b-8b8e-aa1f56b2a885 service nova] [instance: e1253324-3ca1-4610-b9d6-3db7c6c76828] Received event network-vif-deleted-29a94474-9722-43fb-b61a-d8eca4d6d728 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:32:16 user nova-compute[85141]: INFO nova.compute.manager [req-dbab868b-62a1-46c0-96ff-b190d4cf50f8 req-cc902893-4a6b-4e5b-8b8e-aa1f56b2a885 service nova] [instance: e1253324-3ca1-4610-b9d6-3db7c6c76828] Neutron deleted interface 29a94474-9722-43fb-b61a-d8eca4d6d728; detaching it from the instance and deleting it from the info cache
Nov 16 10:32:16 user nova-compute[85141]: DEBUG nova.network.neutron [req-dbab868b-62a1-46c0-96ff-b190d4cf50f8 req-cc902893-4a6b-4e5b-8b8e-aa1f56b2a885 service nova] [instance: e1253324-3ca1-4610-b9d6-3db7c6c76828] Updating instance_info_cache with network_info: [] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:32:16 user nova-compute[85141]: INFO nova.compute.manager [-] [instance: e1253324-3ca1-4610-b9d6-3db7c6c76828] Took 0.75 seconds to deallocate network for instance.
Nov 16 10:32:16 user nova-compute[85141]: DEBUG nova.compute.manager [req-dbab868b-62a1-46c0-96ff-b190d4cf50f8 req-cc902893-4a6b-4e5b-8b8e-aa1f56b2a885 service nova] [instance: e1253324-3ca1-4610-b9d6-3db7c6c76828] Detach interface failed, port_id=29a94474-9722-43fb-b61a-d8eca4d6d728, reason: Instance e1253324-3ca1-4610-b9d6-3db7c6c76828 could not be found. {{(pid=85141) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 16 10:32:17 user nova-compute[85141]: DEBUG nova.compute.manager [req-80d1b2f2-e99d-4644-a968-5dde4675ba60 req-a884b395-6134-4eba-8d8d-f871c122e337 service nova] [instance: e1253324-3ca1-4610-b9d6-3db7c6c76828] Received event network-vif-plugged-29a94474-9722-43fb-b61a-d8eca4d6d728 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:32:17 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-80d1b2f2-e99d-4644-a968-5dde4675ba60 req-a884b395-6134-4eba-8d8d-f871c122e337 service nova] Acquiring lock "e1253324-3ca1-4610-b9d6-3db7c6c76828-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:32:17 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-80d1b2f2-e99d-4644-a968-5dde4675ba60 req-a884b395-6134-4eba-8d8d-f871c122e337 service nova] Lock "e1253324-3ca1-4610-b9d6-3db7c6c76828-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:32:17 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-80d1b2f2-e99d-4644-a968-5dde4675ba60 req-a884b395-6134-4eba-8d8d-f871c122e337 service nova] Lock "e1253324-3ca1-4610-b9d6-3db7c6c76828-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:32:17 user nova-compute[85141]: DEBUG nova.compute.manager [req-80d1b2f2-e99d-4644-a968-5dde4675ba60 req-a884b395-6134-4eba-8d8d-f871c122e337 service nova] [instance: e1253324-3ca1-4610-b9d6-3db7c6c76828] No waiting events found dispatching network-vif-plugged-29a94474-9722-43fb-b61a-d8eca4d6d728 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:32:17 user nova-compute[85141]: WARNING nova.compute.manager [req-80d1b2f2-e99d-4644-a968-5dde4675ba60 req-a884b395-6134-4eba-8d8d-f871c122e337 service nova] [instance: e1253324-3ca1-4610-b9d6-3db7c6c76828] Received unexpected event network-vif-plugged-29a94474-9722-43fb-b61a-d8eca4d6d728 for instance with vm_state active and task_state deleting.
Nov 16 10:32:17 user nova-compute[85141]: INFO nova.compute.manager [None req-be03123a-7203-4ea4-8b52-a6a7cd01a75c tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: e1253324-3ca1-4610-b9d6-3db7c6c76828] Took 0.73 seconds to detach 1 volumes for instance.
Nov 16 10:32:17 user nova-compute[85141]: DEBUG nova.compute.manager [None req-be03123a-7203-4ea4-8b52-a6a7cd01a75c tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: e1253324-3ca1-4610-b9d6-3db7c6c76828] Deleting volume: e0c5c19d-363b-4f5d-a04f-fb7de64423f2 {{(pid=85141) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 16 10:32:17 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-be03123a-7203-4ea4-8b52-a6a7cd01a75c tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:32:17 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-be03123a-7203-4ea4-8b52-a6a7cd01a75c tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:32:17 user nova-compute[85141]: DEBUG nova.compute.provider_tree [None req-be03123a-7203-4ea4-8b52-a6a7cd01a75c tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Inventory has not changed in ProviderTree for provider: bf8e0fa1-16b6-408f-9203-c4cd63916272 {{(pid=85141) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 10:32:17 user nova-compute[85141]: DEBUG nova.scheduler.client.report [None req-be03123a-7203-4ea4-8b52-a6a7cd01a75c tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Inventory has not changed for provider bf8e0fa1-16b6-408f-9203-c4cd63916272 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=85141) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 10:32:17 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-be03123a-7203-4ea4-8b52-a6a7cd01a75c tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.270s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:32:17 user nova-compute[85141]: INFO nova.scheduler.client.report [None req-be03123a-7203-4ea4-8b52-a6a7cd01a75c tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Deleted allocations for instance e1253324-3ca1-4610-b9d6-3db7c6c76828
Nov 16 10:32:17 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-be03123a-7203-4ea4-8b52-a6a7cd01a75c tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Lock "e1253324-3ca1-4610-b9d6-3db7c6c76828" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.182s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:32:18 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:32:20 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:32:23 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:32:25 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:32:28 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:32:29 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:32:30 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:32:32 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-d344e3a3-c47f-4735-9c68-50f5e34dd2fb tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Acquiring lock "059d6974-bd0c-4f73-91fc-8202ebda4238" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:32:32 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-d344e3a3-c47f-4735-9c68-50f5e34dd2fb tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Lock "059d6974-bd0c-4f73-91fc-8202ebda4238" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:32:32 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-d344e3a3-c47f-4735-9c68-50f5e34dd2fb tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Acquiring lock "059d6974-bd0c-4f73-91fc-8202ebda4238-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:32:32 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-d344e3a3-c47f-4735-9c68-50f5e34dd2fb tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Lock "059d6974-bd0c-4f73-91fc-8202ebda4238-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:32:32 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-d344e3a3-c47f-4735-9c68-50f5e34dd2fb tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Lock "059d6974-bd0c-4f73-91fc-8202ebda4238-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:32:32 user nova-compute[85141]: INFO nova.compute.manager [None req-d344e3a3-c47f-4735-9c68-50f5e34dd2fb tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] [instance: 059d6974-bd0c-4f73-91fc-8202ebda4238] Terminating instance
Nov 16 10:32:32 user nova-compute[85141]: DEBUG nova.compute.manager [None req-d344e3a3-c47f-4735-9c68-50f5e34dd2fb tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] [instance: 059d6974-bd0c-4f73-91fc-8202ebda4238] Start destroying the instance on the hypervisor. {{(pid=85141) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 10:32:32 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:32:32 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:32:32 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:32:32 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:32:32 user nova-compute[85141]: DEBUG nova.compute.manager [req-9cb64ef6-76b4-42ba-88d7-d472e6dff046 req-dcd20c4d-c5e4-4659-b6b9-755340abaf0e service nova] [instance: 059d6974-bd0c-4f73-91fc-8202ebda4238] Received event network-vif-unplugged-89bf502f-593d-4c6e-aa83-a041e0ad7b28 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:32:32 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-9cb64ef6-76b4-42ba-88d7-d472e6dff046 req-dcd20c4d-c5e4-4659-b6b9-755340abaf0e service nova] Acquiring lock "059d6974-bd0c-4f73-91fc-8202ebda4238-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:32:32 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-9cb64ef6-76b4-42ba-88d7-d472e6dff046 req-dcd20c4d-c5e4-4659-b6b9-755340abaf0e service nova] Lock "059d6974-bd0c-4f73-91fc-8202ebda4238-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:32:32 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-9cb64ef6-76b4-42ba-88d7-d472e6dff046 req-dcd20c4d-c5e4-4659-b6b9-755340abaf0e service nova] Lock "059d6974-bd0c-4f73-91fc-8202ebda4238-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:32:32 user nova-compute[85141]: DEBUG nova.compute.manager [req-9cb64ef6-76b4-42ba-88d7-d472e6dff046 req-dcd20c4d-c5e4-4659-b6b9-755340abaf0e service nova] [instance: 059d6974-bd0c-4f73-91fc-8202ebda4238] No waiting events found dispatching network-vif-unplugged-89bf502f-593d-4c6e-aa83-a041e0ad7b28 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:32:32 user nova-compute[85141]: DEBUG nova.compute.manager [req-9cb64ef6-76b4-42ba-88d7-d472e6dff046 req-dcd20c4d-c5e4-4659-b6b9-755340abaf0e service nova] [instance: 059d6974-bd0c-4f73-91fc-8202ebda4238] Received event network-vif-unplugged-89bf502f-593d-4c6e-aa83-a041e0ad7b28 for instance with task_state deleting. {{(pid=85141) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 10:32:32 user nova-compute[85141]: INFO nova.virt.libvirt.driver [-] [instance: 059d6974-bd0c-4f73-91fc-8202ebda4238] Instance destroyed successfully.
Nov 16 10:32:32 user nova-compute[85141]: DEBUG nova.objects.instance [None req-d344e3a3-c47f-4735-9c68-50f5e34dd2fb tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Lazy-loading 'resources' on Instance uuid 059d6974-bd0c-4f73-91fc-8202ebda4238 {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:32:33 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-d344e3a3-c47f-4735-9c68-50f5e34dd2fb tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T10:13:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1354808700',display_name='tempest-ServerActionsTestOtherA-server-1354808700',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1354808700',id=15,image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFB91nOE4JIg0PQZ9Fq9iMRTb/Qm6bpwHSXAkC8g5YxG6awy4b4nS0XAfWSm4O4f40Blu3eMfyuYdZY8eI6KFpQYslLrgvG2jeJNbK6AHNNiLWxDV8sQbQZDDAy7NeOUMQ==',key_name='tempest-keypair-799272913',keypairs=<?>,launch_index=0,launched_at=2023-11-16T10:13:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='879fa3f4dfc34726b20149b8a7db22dc',ramdisk_id='',reservation_id='r-joc06p7i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1137992555',owner_user_name='tempest-ServerActionsTestOtherA-1137992555-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T10:13:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e95802a919de4345add493a8d7873e48',uuid=059d6974-bd0c-4f73-91fc-8202ebda4238,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "89bf502f-593d-4c6e-aa83-a041e0ad7b28", "address": "fa:16:3e:40:09:f4", "network": {"id": "859d1f09-56c4-4c2b-b2c3-02b1938e8dbf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1562516834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "879fa3f4dfc34726b20149b8a7db22dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89bf502f-59", "ovs_interfaceid": "89bf502f-593d-4c6e-aa83-a041e0ad7b28", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 10:32:33 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-d344e3a3-c47f-4735-9c68-50f5e34dd2fb tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Converting VIF {"id": "89bf502f-593d-4c6e-aa83-a041e0ad7b28", "address": "fa:16:3e:40:09:f4", "network": {"id": "859d1f09-56c4-4c2b-b2c3-02b1938e8dbf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1562516834-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "879fa3f4dfc34726b20149b8a7db22dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89bf502f-59", "ovs_interfaceid": "89bf502f-593d-4c6e-aa83-a041e0ad7b28", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:32:33 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-d344e3a3-c47f-4735-9c68-50f5e34dd2fb tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:40:09:f4,bridge_name='br-int',has_traffic_filtering=True,id=89bf502f-593d-4c6e-aa83-a041e0ad7b28,network=Network(859d1f09-56c4-4c2b-b2c3-02b1938e8dbf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89bf502f-59') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:32:33 user nova-compute[85141]: DEBUG os_vif [None req-d344e3a3-c47f-4735-9c68-50f5e34dd2fb tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:40:09:f4,bridge_name='br-int',has_traffic_filtering=True,id=89bf502f-593d-4c6e-aa83-a041e0ad7b28,network=Network(859d1f09-56c4-4c2b-b2c3-02b1938e8dbf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89bf502f-59') {{(pid=85141) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 10:32:33 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:32:33 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap89bf502f-59, bridge=br-int, if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:32:33 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:32:33 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:32:33 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:32:33 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=47a99a10-7ac9-43a5-bd88-0a4d84a30769) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:32:33 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:32:33 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:32:33 user nova-compute[85141]: INFO os_vif [None req-d344e3a3-c47f-4735-9c68-50f5e34dd2fb tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:40:09:f4,bridge_name='br-int',has_traffic_filtering=True,id=89bf502f-593d-4c6e-aa83-a041e0ad7b28,network=Network(859d1f09-56c4-4c2b-b2c3-02b1938e8dbf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89bf502f-59')
Nov 16 10:32:33 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-d344e3a3-c47f-4735-9c68-50f5e34dd2fb tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] [instance: 059d6974-bd0c-4f73-91fc-8202ebda4238] Deleting instance files /opt/stack/data/nova/instances/059d6974-bd0c-4f73-91fc-8202ebda4238_del
Nov 16 10:32:33 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-d344e3a3-c47f-4735-9c68-50f5e34dd2fb tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] [instance: 059d6974-bd0c-4f73-91fc-8202ebda4238] Deletion of /opt/stack/data/nova/instances/059d6974-bd0c-4f73-91fc-8202ebda4238_del complete
Nov 16 10:32:33 user nova-compute[85141]: INFO nova.compute.manager [None req-d344e3a3-c47f-4735-9c68-50f5e34dd2fb tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] [instance: 059d6974-bd0c-4f73-91fc-8202ebda4238] Took 0.96 seconds to destroy the instance on the hypervisor.
Nov 16 10:32:33 user nova-compute[85141]: DEBUG oslo.service.loopingcall [None req-d344e3a3-c47f-4735-9c68-50f5e34dd2fb tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=85141) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 10:32:33 user nova-compute[85141]: DEBUG nova.compute.manager [-] [instance: 059d6974-bd0c-4f73-91fc-8202ebda4238] Deallocating network for instance {{(pid=85141) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 10:32:33 user nova-compute[85141]: DEBUG nova.network.neutron [-] [instance: 059d6974-bd0c-4f73-91fc-8202ebda4238] deallocate_for_instance() {{(pid=85141) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 10:32:33 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:32:33 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:32:33 user nova-compute[85141]: DEBUG nova.network.neutron [-] [instance: 059d6974-bd0c-4f73-91fc-8202ebda4238] Updating instance_info_cache with network_info: [] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:32:33 user nova-compute[85141]: INFO nova.compute.manager [-] [instance: 059d6974-bd0c-4f73-91fc-8202ebda4238] Took 0.85 seconds to deallocate network for instance.
Nov 16 10:32:33 user nova-compute[85141]: DEBUG nova.compute.manager [req-1970f818-a469-41a1-80ec-bcf73a1de6fb req-03336f54-500c-463b-b6fe-3272606e1dc4 service nova] [instance: 059d6974-bd0c-4f73-91fc-8202ebda4238] Received event network-vif-deleted-89bf502f-593d-4c6e-aa83-a041e0ad7b28 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:32:33 user nova-compute[85141]: INFO nova.compute.manager [req-1970f818-a469-41a1-80ec-bcf73a1de6fb req-03336f54-500c-463b-b6fe-3272606e1dc4 service nova] [instance: 059d6974-bd0c-4f73-91fc-8202ebda4238] Neutron deleted interface 89bf502f-593d-4c6e-aa83-a041e0ad7b28; detaching it from the instance and deleting it from the info cache
Nov 16 10:32:33 user nova-compute[85141]: DEBUG nova.network.neutron [req-1970f818-a469-41a1-80ec-bcf73a1de6fb req-03336f54-500c-463b-b6fe-3272606e1dc4 service nova] [instance: 059d6974-bd0c-4f73-91fc-8202ebda4238] Updating instance_info_cache with network_info: [] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:32:34 user nova-compute[85141]: DEBUG nova.compute.manager [req-1970f818-a469-41a1-80ec-bcf73a1de6fb req-03336f54-500c-463b-b6fe-3272606e1dc4 service nova] [instance: 059d6974-bd0c-4f73-91fc-8202ebda4238] Detach interface failed, port_id=89bf502f-593d-4c6e-aa83-a041e0ad7b28, reason: Instance 059d6974-bd0c-4f73-91fc-8202ebda4238 could not be found. {{(pid=85141) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 16 10:32:34 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-d344e3a3-c47f-4735-9c68-50f5e34dd2fb tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:32:34 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-d344e3a3-c47f-4735-9c68-50f5e34dd2fb tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:32:34 user nova-compute[85141]: DEBUG nova.compute.provider_tree [None req-d344e3a3-c47f-4735-9c68-50f5e34dd2fb tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Inventory has not changed in ProviderTree for provider: bf8e0fa1-16b6-408f-9203-c4cd63916272 {{(pid=85141) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 10:32:34 user nova-compute[85141]: DEBUG nova.scheduler.client.report [None req-d344e3a3-c47f-4735-9c68-50f5e34dd2fb tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Inventory has not changed for provider bf8e0fa1-16b6-408f-9203-c4cd63916272 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=85141) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 10:32:34 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-d344e3a3-c47f-4735-9c68-50f5e34dd2fb tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.265s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:32:34 user nova-compute[85141]: INFO nova.scheduler.client.report [None req-d344e3a3-c47f-4735-9c68-50f5e34dd2fb tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Deleted allocations for instance 059d6974-bd0c-4f73-91fc-8202ebda4238
Nov 16 10:32:34 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-d344e3a3-c47f-4735-9c68-50f5e34dd2fb tempest-ServerActionsTestOtherA-1137992555 tempest-ServerActionsTestOtherA-1137992555-project-member] Lock "059d6974-bd0c-4f73-91fc-8202ebda4238" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.286s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:32:34 user nova-compute[85141]: DEBUG nova.compute.manager [req-4c7a113d-26a5-4be8-965f-987e5591e4cd req-5cd2db65-6bb3-4fa0-93f9-294a174023ba service nova] [instance: 059d6974-bd0c-4f73-91fc-8202ebda4238] Received event network-vif-plugged-89bf502f-593d-4c6e-aa83-a041e0ad7b28 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:32:34 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-4c7a113d-26a5-4be8-965f-987e5591e4cd req-5cd2db65-6bb3-4fa0-93f9-294a174023ba service nova] Acquiring lock "059d6974-bd0c-4f73-91fc-8202ebda4238-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:32:34 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-4c7a113d-26a5-4be8-965f-987e5591e4cd req-5cd2db65-6bb3-4fa0-93f9-294a174023ba service nova] Lock "059d6974-bd0c-4f73-91fc-8202ebda4238-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:32:34 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-4c7a113d-26a5-4be8-965f-987e5591e4cd req-5cd2db65-6bb3-4fa0-93f9-294a174023ba service nova] Lock "059d6974-bd0c-4f73-91fc-8202ebda4238-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:32:34 user nova-compute[85141]: DEBUG nova.compute.manager [req-4c7a113d-26a5-4be8-965f-987e5591e4cd req-5cd2db65-6bb3-4fa0-93f9-294a174023ba service nova] [instance: 059d6974-bd0c-4f73-91fc-8202ebda4238] No waiting events found dispatching network-vif-plugged-89bf502f-593d-4c6e-aa83-a041e0ad7b28 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:32:34 user nova-compute[85141]: WARNING nova.compute.manager [req-4c7a113d-26a5-4be8-965f-987e5591e4cd req-5cd2db65-6bb3-4fa0-93f9-294a174023ba service nova] [instance: 059d6974-bd0c-4f73-91fc-8202ebda4238] Received unexpected event network-vif-plugged-89bf502f-593d-4c6e-aa83-a041e0ad7b28 for instance with vm_state deleted and task_state None.
Nov 16 10:32:36 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-4a0a488f-cdae-4983-a94e-922d556ef07e tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] Acquiring lock "7437a3a3-9b7f-489b-b20b-f1b877ebb253" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:32:36 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-4a0a488f-cdae-4983-a94e-922d556ef07e tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] Lock "7437a3a3-9b7f-489b-b20b-f1b877ebb253" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:32:36 user nova-compute[85141]: INFO nova.compute.manager [None req-4a0a488f-cdae-4983-a94e-922d556ef07e tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] [instance: 7437a3a3-9b7f-489b-b20b-f1b877ebb253] Detaching volume ebf4cfdf-97a5-4901-b8e0-df0704384909
Nov 16 10:32:36 user nova-compute[85141]: INFO nova.virt.block_device [None req-4a0a488f-cdae-4983-a94e-922d556ef07e tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] [instance: 7437a3a3-9b7f-489b-b20b-f1b877ebb253] Attempting to driver detach volume ebf4cfdf-97a5-4901-b8e0-df0704384909 from mountpoint /dev/vdb
Nov 16 10:32:36 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-4a0a488f-cdae-4983-a94e-922d556ef07e tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] Attempting to detach device vdb from instance 7437a3a3-9b7f-489b-b20b-f1b877ebb253 from the persistent domain config. {{(pid=85141) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 10:32:36 user nova-compute[85141]: DEBUG nova.virt.libvirt.guest [None req-4a0a488f-cdae-4983-a94e-922d556ef07e tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 10:32:36 user nova-compute[85141]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 10:32:36 user nova-compute[85141]:   <source dev="/dev/sdc"/>
Nov 16 10:32:36 user nova-compute[85141]:   <target dev="vdb" bus="virtio"/>
Nov 16 10:32:36 user nova-compute[85141]:   <serial>ebf4cfdf-97a5-4901-b8e0-df0704384909</serial>
Nov 16 10:32:36 user nova-compute[85141]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 10:32:36 user nova-compute[85141]: </disk>
Nov 16 10:32:36 user nova-compute[85141]:  {{(pid=85141) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 10:32:36 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-4a0a488f-cdae-4983-a94e-922d556ef07e tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] Successfully detached device vdb from instance 7437a3a3-9b7f-489b-b20b-f1b877ebb253 from the persistent domain config.
Nov 16 10:32:36 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-4a0a488f-cdae-4983-a94e-922d556ef07e tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 7437a3a3-9b7f-489b-b20b-f1b877ebb253 from the live domain config. {{(pid=85141) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 10:32:36 user nova-compute[85141]: DEBUG nova.virt.libvirt.guest [None req-4a0a488f-cdae-4983-a94e-922d556ef07e tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 10:32:36 user nova-compute[85141]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 10:32:36 user nova-compute[85141]:   <source dev="/dev/sdc"/>
Nov 16 10:32:36 user nova-compute[85141]:   <target dev="vdb" bus="virtio"/>
Nov 16 10:32:36 user nova-compute[85141]:   <serial>ebf4cfdf-97a5-4901-b8e0-df0704384909</serial>
Nov 16 10:32:36 user nova-compute[85141]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 10:32:36 user nova-compute[85141]: </disk>
Nov 16 10:32:36 user nova-compute[85141]:  {{(pid=85141) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 10:32:36 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:32:36 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Starting heal instance info cache {{(pid=85141) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 10:32:36 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Rebuilding the list of instances to heal {{(pid=85141) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 10:32:36 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Acquiring lock "refresh_cache-5a507c85-0369-48ea-8858-3e7d346b4cb0" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:32:36 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Acquired lock "refresh_cache-5a507c85-0369-48ea-8858-3e7d346b4cb0" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:32:36 user nova-compute[85141]: DEBUG nova.network.neutron [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] [instance: 5a507c85-0369-48ea-8858-3e7d346b4cb0] Forcefully refreshing network info cache for instance {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 10:32:36 user nova-compute[85141]: DEBUG nova.objects.instance [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lazy-loading 'info_cache' on Instance uuid 5a507c85-0369-48ea-8858-3e7d346b4cb0 {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:32:36 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-4a0a488f-cdae-4983-a94e-922d556ef07e tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 7437a3a3-9b7f-489b-b20b-f1b877ebb253 {{(pid=85141) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 10:32:36 user nova-compute[85141]: DEBUG nova.network.neutron [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] [instance: 5a507c85-0369-48ea-8858-3e7d346b4cb0] Updating instance_info_cache with network_info: [{"id": "47904c84-f39f-4d8e-9675-0d8a535e3799", "address": "fa:16:3e:a7:9b:4f", "network": {"id": "a75d923b-3849-49c0-ba13-f8b356efda8f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1113409976-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79e4ebd46b4243c09f88927532b610f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47904c84-f3", "ovs_interfaceid": "47904c84-f39f-4d8e-9675-0d8a535e3799", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:32:36 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Releasing lock "refresh_cache-5a507c85-0369-48ea-8858-3e7d346b4cb0" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:32:36 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] [instance: 5a507c85-0369-48ea-8858-3e7d346b4cb0] Updated the network info_cache for instance {{(pid=85141) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 10:32:38 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:32:38 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:32:38 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager.update_available_resource {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:32:38 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:32:38 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:32:38 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:32:38 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Auditing locally available compute resources for user (node: user) {{(pid=85141) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 10:32:38 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f1b7a62-fdc2-4b8e-b9f8-61105c0fcb5c/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:32:38 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f1b7a62-fdc2-4b8e-b9f8-61105c0fcb5c/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:32:38 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f1b7a62-fdc2-4b8e-b9f8-61105c0fcb5c/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:32:38 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f1b7a62-fdc2-4b8e-b9f8-61105c0fcb5c/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:32:38 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f432d8f9-10c4-49e3-bf3b-6389f52e21ab/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:32:39 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f432d8f9-10c4-49e3-bf3b-6389f52e21ab/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:32:39 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f432d8f9-10c4-49e3-bf3b-6389f52e21ab/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:32:39 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f432d8f9-10c4-49e3-bf3b-6389f52e21ab/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:32:39 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da42de06-4518-4c8a-8c63-9b5a2759a1bf/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:32:39 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da42de06-4518-4c8a-8c63-9b5a2759a1bf/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:32:39 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da42de06-4518-4c8a-8c63-9b5a2759a1bf/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:32:39 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da42de06-4518-4c8a-8c63-9b5a2759a1bf/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:32:39 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac3f3bc9-f5e2-4dc8-bf62-3649611da824/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:32:39 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac3f3bc9-f5e2-4dc8-bf62-3649611da824/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:32:39 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac3f3bc9-f5e2-4dc8-bf62-3649611da824/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:32:40 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac3f3bc9-f5e2-4dc8-bf62-3649611da824/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:32:40 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a507c85-0369-48ea-8858-3e7d346b4cb0/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:32:40 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a507c85-0369-48ea-8858-3e7d346b4cb0/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:32:40 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a507c85-0369-48ea-8858-3e7d346b4cb0/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:32:40 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a507c85-0369-48ea-8858-3e7d346b4cb0/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:32:40 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7437a3a3-9b7f-489b-b20b-f1b877ebb253/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:32:40 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7437a3a3-9b7f-489b-b20b-f1b877ebb253/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:32:40 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7437a3a3-9b7f-489b-b20b-f1b877ebb253/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:32:40 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7437a3a3-9b7f-489b-b20b-f1b877ebb253/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:32:40 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-3e746f8a-c092-44b1-b600-22f577250828 tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] Acquiring lock "5a507c85-0369-48ea-8858-3e7d346b4cb0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:32:40 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-3e746f8a-c092-44b1-b600-22f577250828 tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] Lock "5a507c85-0369-48ea-8858-3e7d346b4cb0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:32:40 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-3e746f8a-c092-44b1-b600-22f577250828 tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] Acquiring lock "5a507c85-0369-48ea-8858-3e7d346b4cb0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:32:40 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-3e746f8a-c092-44b1-b600-22f577250828 tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] Lock "5a507c85-0369-48ea-8858-3e7d346b4cb0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:32:40 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-3e746f8a-c092-44b1-b600-22f577250828 tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] Lock "5a507c85-0369-48ea-8858-3e7d346b4cb0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:32:40 user nova-compute[85141]: INFO nova.compute.manager [None req-3e746f8a-c092-44b1-b600-22f577250828 tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] [instance: 5a507c85-0369-48ea-8858-3e7d346b4cb0] Terminating instance
Nov 16 10:32:41 user nova-compute[85141]: DEBUG nova.compute.manager [None req-3e746f8a-c092-44b1-b600-22f577250828 tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] [instance: 5a507c85-0369-48ea-8858-3e7d346b4cb0] Start destroying the instance on the hypervisor. {{(pid=85141) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 10:32:41 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:32:41 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:32:41 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Hypervisor/Node resource view: name=user free_ram=7876MB free_disk=24.92096710205078GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=85141) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 10:32:41 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:32:41 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:32:41 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:32:41 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:32:41 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:32:41 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance 5a507c85-0369-48ea-8858-3e7d346b4cb0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:32:41 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance da42de06-4518-4c8a-8c63-9b5a2759a1bf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:32:41 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance 7437a3a3-9b7f-489b-b20b-f1b877ebb253 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:32:41 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance f432d8f9-10c4-49e3-bf3b-6389f52e21ab actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:32:41 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance ac3f3bc9-f5e2-4dc8-bf62-3649611da824 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:32:41 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance 2f1b7a62-fdc2-4b8e-b9f8-61105c0fcb5c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:32:41 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=85141) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 10:32:41 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=85141) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 10:32:41 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:32:41 user nova-compute[85141]: DEBUG nova.compute.manager [req-5c47d970-ff9e-4806-99a1-44389ca4bc72 req-7e84cb99-8590-4de7-b2a7-b0ab155c3cef service nova] [instance: 5a507c85-0369-48ea-8858-3e7d346b4cb0] Received event network-vif-unplugged-47904c84-f39f-4d8e-9675-0d8a535e3799 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:32:41 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-5c47d970-ff9e-4806-99a1-44389ca4bc72 req-7e84cb99-8590-4de7-b2a7-b0ab155c3cef service nova] Acquiring lock "5a507c85-0369-48ea-8858-3e7d346b4cb0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:32:41 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-5c47d970-ff9e-4806-99a1-44389ca4bc72 req-7e84cb99-8590-4de7-b2a7-b0ab155c3cef service nova] Lock "5a507c85-0369-48ea-8858-3e7d346b4cb0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:32:41 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-5c47d970-ff9e-4806-99a1-44389ca4bc72 req-7e84cb99-8590-4de7-b2a7-b0ab155c3cef service nova] Lock "5a507c85-0369-48ea-8858-3e7d346b4cb0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:32:41 user nova-compute[85141]: DEBUG nova.compute.manager [req-5c47d970-ff9e-4806-99a1-44389ca4bc72 req-7e84cb99-8590-4de7-b2a7-b0ab155c3cef service nova] [instance: 5a507c85-0369-48ea-8858-3e7d346b4cb0] No waiting events found dispatching network-vif-unplugged-47904c84-f39f-4d8e-9675-0d8a535e3799 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:32:41 user nova-compute[85141]: DEBUG nova.compute.manager [req-5c47d970-ff9e-4806-99a1-44389ca4bc72 req-7e84cb99-8590-4de7-b2a7-b0ab155c3cef service nova] [instance: 5a507c85-0369-48ea-8858-3e7d346b4cb0] Received event network-vif-unplugged-47904c84-f39f-4d8e-9675-0d8a535e3799 for instance with task_state deleting. {{(pid=85141) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 10:32:41 user nova-compute[85141]: DEBUG nova.compute.provider_tree [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Inventory has not changed in ProviderTree for provider: bf8e0fa1-16b6-408f-9203-c4cd63916272 {{(pid=85141) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 10:32:41 user nova-compute[85141]: DEBUG nova.scheduler.client.report [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Inventory has not changed for provider bf8e0fa1-16b6-408f-9203-c4cd63916272 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=85141) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 10:32:41 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Compute_service record updated for user:user {{(pid=85141) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 10:32:41 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.370s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:32:42 user nova-compute[85141]: INFO nova.virt.libvirt.driver [-] [instance: 5a507c85-0369-48ea-8858-3e7d346b4cb0] Instance destroyed successfully.
Nov 16 10:32:42 user nova-compute[85141]: DEBUG nova.objects.instance [None req-3e746f8a-c092-44b1-b600-22f577250828 tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] Lazy-loading 'resources' on Instance uuid 5a507c85-0369-48ea-8858-3e7d346b4cb0 {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:32:42 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-3e746f8a-c092-44b1-b600-22f577250828 tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T10:23:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-849506790',display_name='tempest-ServersNegativeTestJSON-server-849506790',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-849506790',id=31,image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-16T10:24:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='79e4ebd46b4243c09f88927532b610f0',ramdisk_id='',reservation_id='r-u0a4vcl3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1452286076',owner_user_name='tempest-ServersNegativeTestJSON-1452286076-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T10:24:03Z,user_data=None,user_id='a7b52c2f46234602ae4925447a7d39a0',uuid=5a507c85-0369-48ea-8858-3e7d346b4cb0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "47904c84-f39f-4d8e-9675-0d8a535e3799", "address": "fa:16:3e:a7:9b:4f", "network": {"id": "a75d923b-3849-49c0-ba13-f8b356efda8f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1113409976-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79e4ebd46b4243c09f88927532b610f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47904c84-f3", "ovs_interfaceid": "47904c84-f39f-4d8e-9675-0d8a535e3799", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 10:32:42 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-3e746f8a-c092-44b1-b600-22f577250828 tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] Converting VIF {"id": "47904c84-f39f-4d8e-9675-0d8a535e3799", "address": "fa:16:3e:a7:9b:4f", "network": {"id": "a75d923b-3849-49c0-ba13-f8b356efda8f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1113409976-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79e4ebd46b4243c09f88927532b610f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47904c84-f3", "ovs_interfaceid": "47904c84-f39f-4d8e-9675-0d8a535e3799", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:32:42 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-3e746f8a-c092-44b1-b600-22f577250828 tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a7:9b:4f,bridge_name='br-int',has_traffic_filtering=True,id=47904c84-f39f-4d8e-9675-0d8a535e3799,network=Network(a75d923b-3849-49c0-ba13-f8b356efda8f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47904c84-f3') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:32:42 user nova-compute[85141]: DEBUG os_vif [None req-3e746f8a-c092-44b1-b600-22f577250828 tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a7:9b:4f,bridge_name='br-int',has_traffic_filtering=True,id=47904c84-f39f-4d8e-9675-0d8a535e3799,network=Network(a75d923b-3849-49c0-ba13-f8b356efda8f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47904c84-f3') {{(pid=85141) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 10:32:42 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:32:42 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap47904c84-f3, bridge=br-int, if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:32:42 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:32:42 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:32:42 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:32:42 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ba0c7d05-f753-4586-a4ff-84a0886b76ab) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:32:42 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:32:42 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:32:42 user nova-compute[85141]: INFO os_vif [None req-3e746f8a-c092-44b1-b600-22f577250828 tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a7:9b:4f,bridge_name='br-int',has_traffic_filtering=True,id=47904c84-f39f-4d8e-9675-0d8a535e3799,network=Network(a75d923b-3849-49c0-ba13-f8b356efda8f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47904c84-f3')
Nov 16 10:32:42 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-3e746f8a-c092-44b1-b600-22f577250828 tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] [instance: 5a507c85-0369-48ea-8858-3e7d346b4cb0] Deleting instance files /opt/stack/data/nova/instances/5a507c85-0369-48ea-8858-3e7d346b4cb0_del
Nov 16 10:32:42 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-3e746f8a-c092-44b1-b600-22f577250828 tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] [instance: 5a507c85-0369-48ea-8858-3e7d346b4cb0] Deletion of /opt/stack/data/nova/instances/5a507c85-0369-48ea-8858-3e7d346b4cb0_del complete
Nov 16 10:32:42 user nova-compute[85141]: INFO nova.compute.manager [None req-3e746f8a-c092-44b1-b600-22f577250828 tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] [instance: 5a507c85-0369-48ea-8858-3e7d346b4cb0] Took 0.91 seconds to destroy the instance on the hypervisor.
Nov 16 10:32:42 user nova-compute[85141]: DEBUG oslo.service.loopingcall [None req-3e746f8a-c092-44b1-b600-22f577250828 tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=85141) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 10:32:42 user nova-compute[85141]: DEBUG nova.compute.manager [-] [instance: 5a507c85-0369-48ea-8858-3e7d346b4cb0] Deallocating network for instance {{(pid=85141) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 10:32:42 user nova-compute[85141]: DEBUG nova.network.neutron [-] [instance: 5a507c85-0369-48ea-8858-3e7d346b4cb0] deallocate_for_instance() {{(pid=85141) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 10:32:42 user nova-compute[85141]: DEBUG nova.network.neutron [-] [instance: 5a507c85-0369-48ea-8858-3e7d346b4cb0] Updating instance_info_cache with network_info: [] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:32:42 user nova-compute[85141]: INFO nova.compute.manager [-] [instance: 5a507c85-0369-48ea-8858-3e7d346b4cb0] Took 0.44 seconds to deallocate network for instance.
Nov 16 10:32:42 user nova-compute[85141]: DEBUG nova.compute.manager [req-bee190a3-bd81-463d-887c-6a466997cdaa req-e2a32823-9a4c-41ff-ac09-6aeef0f472d2 service nova] [instance: 5a507c85-0369-48ea-8858-3e7d346b4cb0] Received event network-vif-deleted-47904c84-f39f-4d8e-9675-0d8a535e3799 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:32:42 user nova-compute[85141]: INFO nova.compute.manager [req-bee190a3-bd81-463d-887c-6a466997cdaa req-e2a32823-9a4c-41ff-ac09-6aeef0f472d2 service nova] [instance: 5a507c85-0369-48ea-8858-3e7d346b4cb0] Neutron deleted interface 47904c84-f39f-4d8e-9675-0d8a535e3799; detaching it from the instance and deleting it from the info cache
Nov 16 10:32:42 user nova-compute[85141]: DEBUG nova.network.neutron [req-bee190a3-bd81-463d-887c-6a466997cdaa req-e2a32823-9a4c-41ff-ac09-6aeef0f472d2 service nova] [instance: 5a507c85-0369-48ea-8858-3e7d346b4cb0] Updating instance_info_cache with network_info: [] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:32:42 user nova-compute[85141]: DEBUG nova.compute.manager [req-bee190a3-bd81-463d-887c-6a466997cdaa req-e2a32823-9a4c-41ff-ac09-6aeef0f472d2 service nova] [instance: 5a507c85-0369-48ea-8858-3e7d346b4cb0] Detach interface failed, port_id=47904c84-f39f-4d8e-9675-0d8a535e3799, reason: Instance 5a507c85-0369-48ea-8858-3e7d346b4cb0 could not be found. {{(pid=85141) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 16 10:32:42 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-3e746f8a-c092-44b1-b600-22f577250828 tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:32:42 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-3e746f8a-c092-44b1-b600-22f577250828 tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:32:42 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:32:42 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:32:42 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:32:42 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:32:42 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=85141) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 10:32:42 user nova-compute[85141]: DEBUG nova.compute.provider_tree [None req-3e746f8a-c092-44b1-b600-22f577250828 tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] Inventory has not changed in ProviderTree for provider: bf8e0fa1-16b6-408f-9203-c4cd63916272 {{(pid=85141) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 10:32:42 user nova-compute[85141]: DEBUG nova.scheduler.client.report [None req-3e746f8a-c092-44b1-b600-22f577250828 tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] Inventory has not changed for provider bf8e0fa1-16b6-408f-9203-c4cd63916272 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=85141) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 10:32:42 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-3e746f8a-c092-44b1-b600-22f577250828 tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.205s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:32:42 user nova-compute[85141]: INFO nova.scheduler.client.report [None req-3e746f8a-c092-44b1-b600-22f577250828 tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] Deleted allocations for instance 5a507c85-0369-48ea-8858-3e7d346b4cb0
Nov 16 10:32:43 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-3e746f8a-c092-44b1-b600-22f577250828 tempest-ServersNegativeTestJSON-1452286076 tempest-ServersNegativeTestJSON-1452286076-project-member] Lock "5a507c85-0369-48ea-8858-3e7d346b4cb0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.114s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:32:43 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:32:43 user nova-compute[85141]: DEBUG nova.compute.manager [req-67679c14-1595-4b15-a15a-1fee18eb9e3e req-29deac07-5f82-46b3-aa63-b349acc9c47f service nova] [instance: 5a507c85-0369-48ea-8858-3e7d346b4cb0] Received event network-vif-plugged-47904c84-f39f-4d8e-9675-0d8a535e3799 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:32:43 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-67679c14-1595-4b15-a15a-1fee18eb9e3e req-29deac07-5f82-46b3-aa63-b349acc9c47f service nova] Acquiring lock "5a507c85-0369-48ea-8858-3e7d346b4cb0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:32:43 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-67679c14-1595-4b15-a15a-1fee18eb9e3e req-29deac07-5f82-46b3-aa63-b349acc9c47f service nova] Lock "5a507c85-0369-48ea-8858-3e7d346b4cb0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:32:43 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-67679c14-1595-4b15-a15a-1fee18eb9e3e req-29deac07-5f82-46b3-aa63-b349acc9c47f service nova] Lock "5a507c85-0369-48ea-8858-3e7d346b4cb0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:32:43 user nova-compute[85141]: DEBUG nova.compute.manager [req-67679c14-1595-4b15-a15a-1fee18eb9e3e req-29deac07-5f82-46b3-aa63-b349acc9c47f service nova] [instance: 5a507c85-0369-48ea-8858-3e7d346b4cb0] No waiting events found dispatching network-vif-plugged-47904c84-f39f-4d8e-9675-0d8a535e3799 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:32:43 user nova-compute[85141]: WARNING nova.compute.manager [req-67679c14-1595-4b15-a15a-1fee18eb9e3e req-29deac07-5f82-46b3-aa63-b349acc9c47f service nova] [instance: 5a507c85-0369-48ea-8858-3e7d346b4cb0] Received unexpected event network-vif-plugged-47904c84-f39f-4d8e-9675-0d8a535e3799 for instance with vm_state deleted and task_state None.
Nov 16 10:32:45 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:32:47 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:32:52 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:32:56 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-4a0a488f-cdae-4983-a94e-922d556ef07e tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 7437a3a3-9b7f-489b-b20b-f1b877ebb253 is timed out.
Nov 16 10:32:56 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-4a0a488f-cdae-4983-a94e-922d556ef07e tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] Successfully detached device vdb from instance 7437a3a3-9b7f-489b-b20b-f1b877ebb253 from the live domain config.
Nov 16 10:32:56 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4a0a488f-cdae-4983-a94e-922d556ef07e tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] [instance: 7437a3a3-9b7f-489b-b20b-f1b877ebb253] calling os-brick to detach iSCSI Volume {{(pid=85141) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 10:32:56 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a0a488f-cdae-4983-a94e-922d556ef07e tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51806b6080>, {'target_iqn': 'iqn.2010-10.org.openstack:ebf4cfdf-97a5-4901-b8e0-df0704384909', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SPscqJGr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 10:32:56 user nova-compute[85141]: WARNING os_brick.initiator.connectors.base [None req-4a0a488f-cdae-4983-a94e-922d556ef07e tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 10:32:56 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-4a0a488f-cdae-4983-a94e-922d556ef07e tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 10:32:56 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-4a0a488f-cdae-4983-a94e-922d556ef07e tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 10:32:56 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:32:56 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:32:56 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[77bbb2fb-eb9f-4931-8e8b-de3697875b58]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ebf4cfdf-97a5-4901-b8e0-df0704384909\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:32:56 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a0a488f-cdae-4983-a94e-922d556ef07e tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 10:32:56 user nova-compute[85141]: No targets found.
Nov 16 10:32:56 user nova-compute[85141]: iSNS:
Nov 16 10:32:56 user nova-compute[85141]: No targets found.
Nov 16 10:32:56 user nova-compute[85141]: STATIC:
Nov 16 10:32:56 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:ebf4cfdf-97a5-4901-b8e0-df0704384909
Nov 16 10:32:56 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:32:56 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:32:56 user nova-compute[85141]: FIRMWARE:
Nov 16 10:32:56 user nova-compute[85141]: No targets found.
Nov 16 10:32:56 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:32:56 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a0a488f-cdae-4983-a94e-922d556ef07e tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 10:32:56 user nova-compute[85141]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 10:32:56 user nova-compute[85141]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=85141) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 10:32:56 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a0a488f-cdae-4983-a94e-922d556ef07e tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ebf4cfdf-97a5-4901-b8e0-df0704384909', 0)] {{(pid=85141) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 10:32:56 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:32:56 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:32:56 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[52e3a45e-e154-4986-a5ed-ce57edfbf183]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ebf4cfdf-97a5-4901-b8e0-df0704384909\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:32:56 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:32:56 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:32:56 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[82e36274-8809-4057-a2b1-de1708a979b8]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebf4cfdf-97a5-4901-b8e0-df0704384909 (non-flash)\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:32:56 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a0a488f-cdae-4983-a94e-922d556ef07e tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebf4cfdf-97a5-4901-b8e0-df0704384909 (non-flash)
Nov 16 10:32:56 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:32:56 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a0a488f-cdae-4983-a94e-922d556ef07e tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebf4cfdf-97a5-4901-b8e0-df0704384909 (non-flash)
Nov 16 10:32:56 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 10:32:56 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a0a488f-cdae-4983-a94e-922d556ef07e tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5198186170>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ebf4cfdf-97a5-4901-b8e0-df0704384909'): ({'sdc'}, set())}) {{(pid=85141) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 10:32:56 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-4a0a488f-cdae-4983-a94e-922d556ef07e tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] Removing single pathed devices sdc {{(pid=85141) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 10:32:56 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:32:56 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:32:56 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[507fa5b1-f61d-49ab-9435-d7511a18296f]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:32:56 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:32:56 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:32:56 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8af8a51-082f-47c3-8d24-c08c60c085c4]: (4, ('ok\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:32:56 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-4a0a488f-cdae-4983-a94e-922d556ef07e tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] Flushing IO for device /dev/sdc {{(pid=85141) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 10:32:56 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:32:56 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:32:56 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[b88391f9-83c6-4c78-b85b-10992023bf55]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:32:56 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-4a0a488f-cdae-4983-a94e-922d556ef07e tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=85141) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 10:32:56 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:32:56 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.040s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:32:56 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0043ef6-8cf0-4ca4-9738-08d98a0bbe69]: (4, ('1', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:32:56 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-4a0a488f-cdae-4983-a94e-922d556ef07e tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=85141) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 10:32:56 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-4a0a488f-cdae-4983-a94e-922d556ef07e tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] SCSI volumes sdc have been removed. {{(pid=85141) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 10:32:56 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a0a488f-cdae-4983-a94e-922d556ef07e tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ebf4cfdf-97a5-4901-b8e0-df0704384909')] {{(pid=85141) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 10:32:56 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ebf4cfdf-97a5-4901-b8e0-df0704384909 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:32:56 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ebf4cfdf-97a5-4901-b8e0-df0704384909 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:32:56 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[c743fd00-584d-4fe3-943d-7dd4f35be110]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:32:56 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a0a488f-cdae-4983-a94e-922d556ef07e tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:32:56 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ebf4cfdf-97a5-4901-b8e0-df0704384909 -p 172.16.0.220:3260 --logout {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:32:56 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ebf4cfdf-97a5-4901-b8e0-df0704384909 -p 172.16.0.220:3260 --logout" returned: 0 in 0.044s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:32:56 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fb13350-b860-47de-8c13-22ac792969f0]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:ebf4cfdf-97a5-4901-b8e0-df0704384909, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:ebf4cfdf-97a5-4901-b8e0-df0704384909, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:32:56 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a0a488f-cdae-4983-a94e-922d556ef07e tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:ebf4cfdf-97a5-4901-b8e0-df0704384909, portal: 172.16.0.220,3260]
Nov 16 10:32:56 user nova-compute[85141]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:ebf4cfdf-97a5-4901-b8e0-df0704384909, portal: 172.16.0.220,3260] successful.
Nov 16 10:32:56 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:32:56 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ebf4cfdf-97a5-4901-b8e0-df0704384909 -p 172.16.0.220:3260 --op delete {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:32:56 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ebf4cfdf-97a5-4901-b8e0-df0704384909 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:32:56 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[e540bb04-6dfb-4ee1-8602-cffeba9c319d]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:32:56 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a0a488f-cdae-4983-a94e-922d556ef07e tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:32:56 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-4a0a488f-cdae-4983-a94e-922d556ef07e tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.268s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 10:32:56 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a0a488f-cdae-4983-a94e-922d556ef07e tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] <== disconnect_volume: return (271ms) None {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 10:32:56 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4a0a488f-cdae-4983-a94e-922d556ef07e tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] [instance: 7437a3a3-9b7f-489b-b20b-f1b877ebb253] Disconnected iSCSI Volume {{(pid=85141) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 10:32:57 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:32:57 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:32:57 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=85141) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 10:32:57 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=85141) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 10:32:57 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=85141) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 10:32:57 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:32:57 user nova-compute[85141]: DEBUG nova.objects.instance [None req-4a0a488f-cdae-4983-a94e-922d556ef07e tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] Lazy-loading 'flavor' on Instance uuid 7437a3a3-9b7f-489b-b20b-f1b877ebb253 {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:32:57 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-4a0a488f-cdae-4983-a94e-922d556ef07e tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] Lock "7437a3a3-9b7f-489b-b20b-f1b877ebb253" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.631s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:33:00 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:33:02 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:33:07 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:33:12 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:33:12 user nova-compute[85141]: DEBUG nova.compute.manager [req-b0382a2f-db79-4860-8aec-ec9a264c75d1 req-f1b84cc1-3a85-4bf9-a47f-c353adf90bdf service nova] [instance: f432d8f9-10c4-49e3-bf3b-6389f52e21ab] Received event network-changed-e8cc6756-287d-4451-9119-7ca5779ca62c {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:33:12 user nova-compute[85141]: DEBUG nova.compute.manager [req-b0382a2f-db79-4860-8aec-ec9a264c75d1 req-f1b84cc1-3a85-4bf9-a47f-c353adf90bdf service nova] [instance: f432d8f9-10c4-49e3-bf3b-6389f52e21ab] Refreshing instance network info cache due to event network-changed-e8cc6756-287d-4451-9119-7ca5779ca62c. {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 10:33:12 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-b0382a2f-db79-4860-8aec-ec9a264c75d1 req-f1b84cc1-3a85-4bf9-a47f-c353adf90bdf service nova] Acquiring lock "refresh_cache-f432d8f9-10c4-49e3-bf3b-6389f52e21ab" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:33:12 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-b0382a2f-db79-4860-8aec-ec9a264c75d1 req-f1b84cc1-3a85-4bf9-a47f-c353adf90bdf service nova] Acquired lock "refresh_cache-f432d8f9-10c4-49e3-bf3b-6389f52e21ab" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:33:12 user nova-compute[85141]: DEBUG nova.network.neutron [req-b0382a2f-db79-4860-8aec-ec9a264c75d1 req-f1b84cc1-3a85-4bf9-a47f-c353adf90bdf service nova] [instance: f432d8f9-10c4-49e3-bf3b-6389f52e21ab] Refreshing network info cache for port e8cc6756-287d-4451-9119-7ca5779ca62c {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 10:33:13 user nova-compute[85141]: DEBUG nova.network.neutron [req-b0382a2f-db79-4860-8aec-ec9a264c75d1 req-f1b84cc1-3a85-4bf9-a47f-c353adf90bdf service nova] [instance: f432d8f9-10c4-49e3-bf3b-6389f52e21ab] Updated VIF entry in instance network info cache for port e8cc6756-287d-4451-9119-7ca5779ca62c. {{(pid=85141) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 10:33:13 user nova-compute[85141]: DEBUG nova.network.neutron [req-b0382a2f-db79-4860-8aec-ec9a264c75d1 req-f1b84cc1-3a85-4bf9-a47f-c353adf90bdf service nova] [instance: f432d8f9-10c4-49e3-bf3b-6389f52e21ab] Updating instance_info_cache with network_info: [{"id": "e8cc6756-287d-4451-9119-7ca5779ca62c", "address": "fa:16:3e:c3:18:3e", "network": {"id": "a8f7d218-f758-44d8-adb3-120a5f724f70", "bridge": "br-int", "label": "tempest-TestStampPattern-1966889964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fb187d45ec54e74a0721973235f98b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8cc6756-28", "ovs_interfaceid": "e8cc6756-287d-4451-9119-7ca5779ca62c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:33:13 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-b0382a2f-db79-4860-8aec-ec9a264c75d1 req-f1b84cc1-3a85-4bf9-a47f-c353adf90bdf service nova] Releasing lock "refresh_cache-f432d8f9-10c4-49e3-bf3b-6389f52e21ab" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:33:13 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-9119232c-d10d-4bc9-854d-2a3519e13c1f tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Acquiring lock "f432d8f9-10c4-49e3-bf3b-6389f52e21ab" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:33:13 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-9119232c-d10d-4bc9-854d-2a3519e13c1f tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Lock "f432d8f9-10c4-49e3-bf3b-6389f52e21ab" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:33:13 user nova-compute[85141]: DEBUG nova.objects.instance [None req-9119232c-d10d-4bc9-854d-2a3519e13c1f tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Lazy-loading 'flavor' on Instance uuid f432d8f9-10c4-49e3-bf3b-6389f52e21ab {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:33:13 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-9119232c-d10d-4bc9-854d-2a3519e13c1f tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Lock "f432d8f9-10c4-49e3-bf3b-6389f52e21ab" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.048s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:33:13 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:33:13 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-9119232c-d10d-4bc9-854d-2a3519e13c1f tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Acquiring lock "f432d8f9-10c4-49e3-bf3b-6389f52e21ab" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:33:13 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-9119232c-d10d-4bc9-854d-2a3519e13c1f tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Lock "f432d8f9-10c4-49e3-bf3b-6389f52e21ab" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:33:13 user nova-compute[85141]: INFO nova.compute.manager [None req-9119232c-d10d-4bc9-854d-2a3519e13c1f tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] [instance: f432d8f9-10c4-49e3-bf3b-6389f52e21ab] Attaching volume ca6daac8-c9e0-4fdf-903f-1fcd2f9bc544 to /dev/vdb
Nov 16 10:33:13 user nova-compute[85141]: DEBUG os_brick.utils [None req-9119232c-d10d-4bc9-854d-2a3519e13c1f tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 10:33:13 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:33:13 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:33:13 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[f04bee6e-005f-4dea-a7b3-58162f135adc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c7834de5c295\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:33:13 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:33:13 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:33:13 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[01347506-ecee-400a-b578-b8ef24f4b39d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:33:13 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:33:13 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:33:13 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[5abb83a7-e83f-4a21-8ace-6f7871bd2505]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:33:13 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdf1e24c-3e09-476e-aa3a-700e37b6ce98]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:33:13 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-9119232c-d10d-4bc9-854d-2a3519e13c1f tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Running cmd (subprocess): nvme version {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:33:13 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-9119232c-d10d-4bc9-854d-2a3519e13c1f tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] 'nvme version' failed. Not Retrying. {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 10:33:13 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9119232c-d10d-4bc9-854d-2a3519e13c1f tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] nvme not present on system {{(pid=85141) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 10:33:13 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:33:13 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 10:33:13 user nova-compute[85141]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 10:33:13 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ffd85e7-9db0-4dae-8bc9-36656a62b031]: (4, '') {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:33:13 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.lightos [None req-9119232c-d10d-4bc9-854d-2a3519e13c1f tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=85141) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 10:33:13 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.lightos [None req-9119232c-d10d-4bc9-854d-2a3519e13c1f tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=85141) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 10:33:13 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.lightos [None req-9119232c-d10d-4bc9-854d-2a3519e13c1f tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] LIGHTOS: no hostnqn found. {{(pid=85141) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 10:33:13 user nova-compute[85141]: DEBUG os_brick.utils [None req-9119232c-d10d-4bc9-854d-2a3519e13c1f tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c7834de5c295', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 10:33:13 user nova-compute[85141]: DEBUG nova.virt.block_device [None req-9119232c-d10d-4bc9-854d-2a3519e13c1f tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] [instance: f432d8f9-10c4-49e3-bf3b-6389f52e21ab] Updating existing volume attachment record: 764e247c-fea5-40b5-b4de-9994bbbb7131 {{(pid=85141) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 10:33:14 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-e4c395a3-37f2-4f8b-a928-bf358ca2382d tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Acquiring lock "6c284db0-2aa8-4680-ab40-7e9861f8449b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:33:14 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-e4c395a3-37f2-4f8b-a928-bf358ca2382d tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Lock "6c284db0-2aa8-4680-ab40-7e9861f8449b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:33:14 user nova-compute[85141]: DEBUG nova.compute.manager [None req-e4c395a3-37f2-4f8b-a928-bf358ca2382d tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: 6c284db0-2aa8-4680-ab40-7e9861f8449b] Starting instance... {{(pid=85141) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 10:33:14 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-e4c395a3-37f2-4f8b-a928-bf358ca2382d tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:33:14 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-e4c395a3-37f2-4f8b-a928-bf358ca2382d tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:33:14 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-e4c395a3-37f2-4f8b-a928-bf358ca2382d tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=85141) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 10:33:14 user nova-compute[85141]: INFO nova.compute.claims [None req-e4c395a3-37f2-4f8b-a928-bf358ca2382d tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: 6c284db0-2aa8-4680-ab40-7e9861f8449b] Claim successful on node user
Nov 16 10:33:14 user nova-compute[85141]: DEBUG nova.compute.provider_tree [None req-e4c395a3-37f2-4f8b-a928-bf358ca2382d tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Inventory has not changed in ProviderTree for provider: bf8e0fa1-16b6-408f-9203-c4cd63916272 {{(pid=85141) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 10:33:14 user nova-compute[85141]: DEBUG nova.scheduler.client.report [None req-e4c395a3-37f2-4f8b-a928-bf358ca2382d tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Inventory has not changed for provider bf8e0fa1-16b6-408f-9203-c4cd63916272 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=85141) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 10:33:14 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-e4c395a3-37f2-4f8b-a928-bf358ca2382d tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.331s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:33:14 user nova-compute[85141]: DEBUG nova.compute.manager [None req-e4c395a3-37f2-4f8b-a928-bf358ca2382d tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: 6c284db0-2aa8-4680-ab40-7e9861f8449b] Start building networks asynchronously for instance. {{(pid=85141) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 10:33:14 user nova-compute[85141]: DEBUG nova.compute.manager [None req-e4c395a3-37f2-4f8b-a928-bf358ca2382d tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: 6c284db0-2aa8-4680-ab40-7e9861f8449b] Allocating IP information in the background. {{(pid=85141) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 10:33:14 user nova-compute[85141]: DEBUG nova.network.neutron [None req-e4c395a3-37f2-4f8b-a928-bf358ca2382d tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: 6c284db0-2aa8-4680-ab40-7e9861f8449b] allocate_for_instance() {{(pid=85141) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 10:33:14 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-e4c395a3-37f2-4f8b-a928-bf358ca2382d tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: 6c284db0-2aa8-4680-ab40-7e9861f8449b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 10:33:14 user nova-compute[85141]: DEBUG nova.compute.manager [None req-e4c395a3-37f2-4f8b-a928-bf358ca2382d tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: 6c284db0-2aa8-4680-ab40-7e9861f8449b] Start building block device mappings for instance. {{(pid=85141) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 10:33:14 user nova-compute[85141]: DEBUG nova.policy [None req-e4c395a3-37f2-4f8b-a928-bf358ca2382d tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7261b57c36904fcda87a9ea32d4b5b31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aec3bb9fe5e6446590900b5adf65df0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85141) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 10:33:14 user nova-compute[85141]: INFO nova.virt.block_device [None req-e4c395a3-37f2-4f8b-a928-bf358ca2382d tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: 6c284db0-2aa8-4680-ab40-7e9861f8449b] Booting with volume 584dd8df-f6a2-4e35-be7e-8de1e759491b at /dev/vda
Nov 16 10:33:14 user nova-compute[85141]: DEBUG os_brick.utils [None req-e4c395a3-37f2-4f8b-a928-bf358ca2382d tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 10:33:14 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:33:14 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:33:14 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbfbb4ea-ee1d-44c1-a93f-3c46185f57d6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c7834de5c295\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:33:14 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:33:14 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:33:14 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1b407b4-d185-41d9-b4c2-3cffaedf3b88]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:33:14 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:33:14 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:33:14 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c6c546a-2d64-4dca-90dd-88e31391ee03]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:33:14 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[87eea50b-8f6c-4255-87f2-da94d37ebcde]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:33:14 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-e4c395a3-37f2-4f8b-a928-bf358ca2382d tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Running cmd (subprocess): nvme version {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:33:14 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-e4c395a3-37f2-4f8b-a928-bf358ca2382d tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] 'nvme version' failed. Not Retrying. {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 10:33:14 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e4c395a3-37f2-4f8b-a928-bf358ca2382d tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] nvme not present on system {{(pid=85141) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 10:33:14 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:33:14 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 10:33:14 user nova-compute[85141]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 10:33:14 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e1eaf29-71e0-46ff-b391-9b4077193308]: (4, '') {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:33:14 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.lightos [None req-e4c395a3-37f2-4f8b-a928-bf358ca2382d tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=85141) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 10:33:14 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.lightos [None req-e4c395a3-37f2-4f8b-a928-bf358ca2382d tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=85141) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 10:33:14 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.lightos [None req-e4c395a3-37f2-4f8b-a928-bf358ca2382d tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] LIGHTOS: no hostnqn found. {{(pid=85141) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 10:33:14 user nova-compute[85141]: DEBUG os_brick.utils [None req-e4c395a3-37f2-4f8b-a928-bf358ca2382d tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c7834de5c295', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 10:33:14 user nova-compute[85141]: DEBUG nova.virt.block_device [None req-e4c395a3-37f2-4f8b-a928-bf358ca2382d tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: 6c284db0-2aa8-4680-ab40-7e9861f8449b] Updating existing volume attachment record: cd637ce9-ce67-4188-a5b2-2f17564dbd5a {{(pid=85141) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 10:33:15 user nova-compute[85141]: DEBUG nova.network.neutron [None req-e4c395a3-37f2-4f8b-a928-bf358ca2382d tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: 6c284db0-2aa8-4680-ab40-7e9861f8449b] Successfully created port: 4c31827f-7de8-49d3-a461-d6e83b8faa0d {{(pid=85141) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 10:33:15 user nova-compute[85141]: DEBUG nova.network.neutron [None req-e4c395a3-37f2-4f8b-a928-bf358ca2382d tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: 6c284db0-2aa8-4680-ab40-7e9861f8449b] Successfully updated port: 4c31827f-7de8-49d3-a461-d6e83b8faa0d {{(pid=85141) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 10:33:15 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-e4c395a3-37f2-4f8b-a928-bf358ca2382d tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Acquiring lock "refresh_cache-6c284db0-2aa8-4680-ab40-7e9861f8449b" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:33:15 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-e4c395a3-37f2-4f8b-a928-bf358ca2382d tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Acquired lock "refresh_cache-6c284db0-2aa8-4680-ab40-7e9861f8449b" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:33:15 user nova-compute[85141]: DEBUG nova.network.neutron [None req-e4c395a3-37f2-4f8b-a928-bf358ca2382d tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: 6c284db0-2aa8-4680-ab40-7e9861f8449b] Building network info cache for instance {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 10:33:16 user nova-compute[85141]: DEBUG nova.compute.manager [req-74053a92-849f-4de4-973e-e268f36dc134 req-324bd55a-bd5b-48f3-af7b-6afce5fcf98c service nova] [instance: 6c284db0-2aa8-4680-ab40-7e9861f8449b] Received event network-changed-4c31827f-7de8-49d3-a461-d6e83b8faa0d {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:33:16 user nova-compute[85141]: DEBUG nova.compute.manager [req-74053a92-849f-4de4-973e-e268f36dc134 req-324bd55a-bd5b-48f3-af7b-6afce5fcf98c service nova] [instance: 6c284db0-2aa8-4680-ab40-7e9861f8449b] Refreshing instance network info cache due to event network-changed-4c31827f-7de8-49d3-a461-d6e83b8faa0d. {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 10:33:16 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-74053a92-849f-4de4-973e-e268f36dc134 req-324bd55a-bd5b-48f3-af7b-6afce5fcf98c service nova] Acquiring lock "refresh_cache-6c284db0-2aa8-4680-ab40-7e9861f8449b" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:33:16 user nova-compute[85141]: DEBUG nova.network.neutron [None req-e4c395a3-37f2-4f8b-a928-bf358ca2382d tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: 6c284db0-2aa8-4680-ab40-7e9861f8449b] Instance cache missing network info. {{(pid=85141) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 10:33:16 user nova-compute[85141]: DEBUG nova.network.neutron [None req-e4c395a3-37f2-4f8b-a928-bf358ca2382d tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: 6c284db0-2aa8-4680-ab40-7e9861f8449b] Updating instance_info_cache with network_info: [{"id": "4c31827f-7de8-49d3-a461-d6e83b8faa0d", "address": "fa:16:3e:85:13:75", "network": {"id": "b8ada47f-9721-4358-ac4f-0305f06dbbb8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1663922860-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aec3bb9fe5e6446590900b5adf65df0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c31827f-7d", "ovs_interfaceid": "4c31827f-7de8-49d3-a461-d6e83b8faa0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:33:16 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-e4c395a3-37f2-4f8b-a928-bf358ca2382d tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Releasing lock "refresh_cache-6c284db0-2aa8-4680-ab40-7e9861f8449b" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:33:16 user nova-compute[85141]: DEBUG nova.compute.manager [None req-e4c395a3-37f2-4f8b-a928-bf358ca2382d tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: 6c284db0-2aa8-4680-ab40-7e9861f8449b] Instance network_info: |[{"id": "4c31827f-7de8-49d3-a461-d6e83b8faa0d", "address": "fa:16:3e:85:13:75", "network": {"id": "b8ada47f-9721-4358-ac4f-0305f06dbbb8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1663922860-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aec3bb9fe5e6446590900b5adf65df0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c31827f-7d", "ovs_interfaceid": "4c31827f-7de8-49d3-a461-d6e83b8faa0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=85141) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 10:33:16 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-74053a92-849f-4de4-973e-e268f36dc134 req-324bd55a-bd5b-48f3-af7b-6afce5fcf98c service nova] Acquired lock "refresh_cache-6c284db0-2aa8-4680-ab40-7e9861f8449b" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:33:16 user nova-compute[85141]: DEBUG nova.network.neutron [req-74053a92-849f-4de4-973e-e268f36dc134 req-324bd55a-bd5b-48f3-af7b-6afce5fcf98c service nova] [instance: 6c284db0-2aa8-4680-ab40-7e9861f8449b] Refreshing network info cache for port 4c31827f-7de8-49d3-a461-d6e83b8faa0d {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 10:33:16 user nova-compute[85141]: DEBUG nova.network.neutron [req-74053a92-849f-4de4-973e-e268f36dc134 req-324bd55a-bd5b-48f3-af7b-6afce5fcf98c service nova] [instance: 6c284db0-2aa8-4680-ab40-7e9861f8449b] Updated VIF entry in instance network info cache for port 4c31827f-7de8-49d3-a461-d6e83b8faa0d. {{(pid=85141) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 10:33:16 user nova-compute[85141]: DEBUG nova.network.neutron [req-74053a92-849f-4de4-973e-e268f36dc134 req-324bd55a-bd5b-48f3-af7b-6afce5fcf98c service nova] [instance: 6c284db0-2aa8-4680-ab40-7e9861f8449b] Updating instance_info_cache with network_info: [{"id": "4c31827f-7de8-49d3-a461-d6e83b8faa0d", "address": "fa:16:3e:85:13:75", "network": {"id": "b8ada47f-9721-4358-ac4f-0305f06dbbb8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1663922860-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aec3bb9fe5e6446590900b5adf65df0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c31827f-7d", "ovs_interfaceid": "4c31827f-7de8-49d3-a461-d6e83b8faa0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:33:16 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-74053a92-849f-4de4-973e-e268f36dc134 req-324bd55a-bd5b-48f3-af7b-6afce5fcf98c service nova] Releasing lock "refresh_cache-6c284db0-2aa8-4680-ab40-7e9861f8449b" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:33:17 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:33:18 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:33:19 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9119232c-d10d-4bc9-854d-2a3519e13c1f tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] [instance: f432d8f9-10c4-49e3-bf3b-6389f52e21ab] Calling os-brick to attach iSCSI Volume {{(pid=85141) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 10:33:19 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-9119232c-d10d-4bc9-854d-2a3519e13c1f tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51806b6080>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ca6daac8-c9e0-4fdf-903f-1fcd2f9bc544', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mMWCPzrx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 10:33:19 user nova-compute[85141]: WARNING os_brick.initiator.connectors.base [None req-9119232c-d10d-4bc9-854d-2a3519e13c1f tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 10:33:19 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-9119232c-d10d-4bc9-854d-2a3519e13c1f tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 10:33:19 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-9119232c-d10d-4bc9-854d-2a3519e13c1f tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 10:33:19 user nova-compute[85141]: WARNING os_brick.initiator.connectors.base [None req-9119232c-d10d-4bc9-854d-2a3519e13c1f tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 10:33:19 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-9119232c-d10d-4bc9-854d-2a3519e13c1f tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ca6daac8-c9e0-4fdf-903f-1fcd2f9bc544" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 10:33:19 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-9119232c-d10d-4bc9-854d-2a3519e13c1f tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ca6daac8-c9e0-4fdf-903f-1fcd2f9bc544" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 10:33:19 user nova-compute[85141]: INFO os_brick.initiator.connectors.iscsi [None req-9119232c-d10d-4bc9-854d-2a3519e13c1f tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 10:33:19 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca6daac8-c9e0-4fdf-903f-1fcd2f9bc544 -p 172.16.0.220:3260 {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:33:19 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca6daac8-c9e0-4fdf-903f-1fcd2f9bc544 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:33:19 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fe86281-deb0-419d-a24a-1b4699b05dec]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:33:19 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-9119232c-d10d-4bc9-854d-2a3519e13c1f tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 10:33:19 user nova-compute[85141]:  {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:33:19 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca6daac8-c9e0-4fdf-903f-1fcd2f9bc544 -p 172.16.0.220:3260 --interface default --op new {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:33:19 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca6daac8-c9e0-4fdf-903f-1fcd2f9bc544 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:33:19 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5be0bee-3f02-4b72-85d5-a71072efac90]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ca6daac8-c9e0-4fdf-903f-1fcd2f9bc544] added\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:33:19 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-9119232c-d10d-4bc9-854d-2a3519e13c1f tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ca6daac8-c9e0-4fdf-903f-1fcd2f9bc544] added
Nov 16 10:33:19 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:33:19 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca6daac8-c9e0-4fdf-903f-1fcd2f9bc544 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:33:19 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca6daac8-c9e0-4fdf-903f-1fcd2f9bc544 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:33:19 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[35e5a443-ac24-4bf6-87d9-ef8ec44b0a12]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:33:19 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-9119232c-d10d-4bc9-854d-2a3519e13c1f tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:33:19 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca6daac8-c9e0-4fdf-903f-1fcd2f9bc544 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:33:19 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca6daac8-c9e0-4fdf-903f-1fcd2f9bc544 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:33:19 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[1906ebed-1e7a-45ff-9403-1d83272f8a13]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:33:19 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-9119232c-d10d-4bc9-854d-2a3519e13c1f tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:33:19 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca6daac8-c9e0-4fdf-903f-1fcd2f9bc544 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mMWCPzrx {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:33:19 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca6daac8-c9e0-4fdf-903f-1fcd2f9bc544 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mMWCPzrx" returned: 0 in 0.018s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:33:19 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c7bf057-310f-47b1-9c1a-a115f4611660]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:33:19 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-9119232c-d10d-4bc9-854d-2a3519e13c1f tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mMWCPzrx'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:33:19 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca6daac8-c9e0-4fdf-903f-1fcd2f9bc544 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:33:19 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca6daac8-c9e0-4fdf-903f-1fcd2f9bc544 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:33:19 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[65a24274-1b87-4aa7-b5dd-d42805d7b532]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:33:19 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-9119232c-d10d-4bc9-854d-2a3519e13c1f tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:33:19 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:33:19 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:33:19 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[6af6ef3c-5715-49c9-aa73-1b8e3f48cce9]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:33:19 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-9119232c-d10d-4bc9-854d-2a3519e13c1f tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 16 10:33:19 user nova-compute[85141]:  {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:33:19 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-9119232c-d10d-4bc9-854d-2a3519e13c1f tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 16 10:33:19 user nova-compute[85141]:  {{(pid=85141) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 10:33:19 user nova-compute[85141]: WARNING os_brick.initiator.connectors.iscsi [None req-9119232c-d10d-4bc9-854d-2a3519e13c1f tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 16 10:33:19 user nova-compute[85141]: 
Nov 16 10:33:19 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca6daac8-c9e0-4fdf-903f-1fcd2f9bc544 -p 172.16.0.220:3260 --login {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:33:19 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca6daac8-c9e0-4fdf-903f-1fcd2f9bc544 -p 172.16.0.220:3260 --login" returned: 0 in 0.174s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:33:19 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[f049539d-f800-4de6-bf7a-5ce2d550402c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ca6daac8-c9e0-4fdf-903f-1fcd2f9bc544, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ca6daac8-c9e0-4fdf-903f-1fcd2f9bc544, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:33:19 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-9119232c-d10d-4bc9-854d-2a3519e13c1f tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ca6daac8-c9e0-4fdf-903f-1fcd2f9bc544, portal: 172.16.0.220,3260]
Nov 16 10:33:19 user nova-compute[85141]: Login to [iface: default, target: iqn.2010-10.org.openstack:ca6daac8-c9e0-4fdf-903f-1fcd2f9bc544, portal: 172.16.0.220,3260] successful.
Nov 16 10:33:19 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:33:19 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca6daac8-c9e0-4fdf-903f-1fcd2f9bc544 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:33:19 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca6daac8-c9e0-4fdf-903f-1fcd2f9bc544 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:33:19 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[307931d2-1da0-4055-8b13-1fee6d263c49]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:33:19 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-9119232c-d10d-4bc9-854d-2a3519e13c1f tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:33:19 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:33:19 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:33:19 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[72c43834-2f08-479a-926b-926cf3ffb99d]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca6daac8-c9e0-4fdf-903f-1fcd2f9bc544 (non-flash)\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:33:19 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-9119232c-d10d-4bc9-854d-2a3519e13c1f tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca6daac8-c9e0-4fdf-903f-1fcd2f9bc544 (non-flash)
Nov 16 10:33:19 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:33:19 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-9119232c-d10d-4bc9-854d-2a3519e13c1f tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca6daac8-c9e0-4fdf-903f-1fcd2f9bc544 (non-flash)
Nov 16 10:33:19 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 10:33:19 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-9119232c-d10d-4bc9-854d-2a3519e13c1f tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ca6daac8-c9e0-4fdf-903f-1fcd2f9bc544" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.369s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 10:33:19 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-9119232c-d10d-4bc9-854d-2a3519e13c1f tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Connected to 172.16.0.220:3260 {{(pid=85141) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 10:33:19 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-9119232c-d10d-4bc9-854d-2a3519e13c1f tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] HCTL ('33', '-', '-', 0) found on session 49 with lun 0 {{(pid=85141) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 10:33:19 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-9119232c-d10d-4bc9-854d-2a3519e13c1f tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=85141) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 10:33:19 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:33:19 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:33:19 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[30fa858d-9a30-41f8-99e2-03d63bae5151]: (4, ('- - 0', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:33:19 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-9119232c-d10d-4bc9-854d-2a3519e13c1f tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Searching for a device in session 49 and hctl ['33', '*', '*', 0] yield: None {{(pid=85141) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 10:33:20 user nova-compute[85141]: DEBUG nova.compute.manager [None req-e4c395a3-37f2-4f8b-a928-bf358ca2382d tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: 6c284db0-2aa8-4680-ab40-7e9861f8449b] Start spawning the instance on the hypervisor. {{(pid=85141) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 10:33:20 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-e4c395a3-37f2-4f8b-a928-bf358ca2382d tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: 6c284db0-2aa8-4680-ab40-7e9861f8449b] Creating instance directory {{(pid=85141) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 10:33:20 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-e4c395a3-37f2-4f8b-a928-bf358ca2382d tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: 6c284db0-2aa8-4680-ab40-7e9861f8449b] Creating image(s)
Nov 16 10:33:20 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-e4c395a3-37f2-4f8b-a928-bf358ca2382d tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: 6c284db0-2aa8-4680-ab40-7e9861f8449b] Did not create local disks {{(pid=85141) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 16 10:33:20 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-e4c395a3-37f2-4f8b-a928-bf358ca2382d tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: 6c284db0-2aa8-4680-ab40-7e9861f8449b] Ensure instance console log exists: /opt/stack/data/nova/instances/6c284db0-2aa8-4680-ab40-7e9861f8449b/console.log {{(pid=85141) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 10:33:20 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-e4c395a3-37f2-4f8b-a928-bf358ca2382d tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:33:20 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-e4c395a3-37f2-4f8b-a928-bf358ca2382d tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:33:20 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-e4c395a3-37f2-4f8b-a928-bf358ca2382d tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:33:20 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-e4c395a3-37f2-4f8b-a928-bf358ca2382d tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: 6c284db0-2aa8-4680-ab40-7e9861f8449b] Start _get_guest_xml network_info=[{"id": "4c31827f-7de8-49d3-a461-d6e83b8faa0d", "address": "fa:16:3e:85:13:75", "network": {"id": "b8ada47f-9721-4358-ac4f-0305f06dbbb8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1663922860-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aec3bb9fe5e6446590900b5adf65df0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c31827f-7d", "ovs_interfaceid": "4c31827f-7de8-49d3-a461-d6e83b8faa0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:584dd8df-f6a2-4e35-be7e-8de1e759491b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XoQOTquf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '6c284db0-2aa8-4680-ab40-7e9861f8449b', 'attached_at': '', 'detached_at': '', 'volume_id': '584dd8df-f6a2-4e35-be7e-8de1e759491b', 'serial': '584dd8df-f6a2-4e35-be7e-8de1e759491b'}, 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'attachment_id': 'cd637ce9-ce67-4188-a5b2-2f17564dbd5a', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=85141) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 10:33:20 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-e4c395a3-37f2-4f8b-a928-bf358ca2382d tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:33:20 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-e4c395a3-37f2-4f8b-a928-bf358ca2382d tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:33:20 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-e4c395a3-37f2-4f8b-a928-bf358ca2382d tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=85141) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 10:33:20 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-e4c395a3-37f2-4f8b-a928-bf358ca2382d tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] CPU controller missing on host. {{(pid=85141) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 10:33:20 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-e4c395a3-37f2-4f8b-a928-bf358ca2382d tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=85141) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 10:33:20 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-e4c395a3-37f2-4f8b-a928-bf358ca2382d tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] CPU controller found on host. {{(pid=85141) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 10:33:20 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-e4c395a3-37f2-4f8b-a928-bf358ca2382d tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=85141) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 10:33:20 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-e4c395a3-37f2-4f8b-a928-bf358ca2382d tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T10:06:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 10:33:20 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-e4c395a3-37f2-4f8b-a928-bf358ca2382d tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Flavor limits 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 10:33:20 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-e4c395a3-37f2-4f8b-a928-bf358ca2382d tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Image limits 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 10:33:20 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-e4c395a3-37f2-4f8b-a928-bf358ca2382d tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Flavor pref 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 10:33:20 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-e4c395a3-37f2-4f8b-a928-bf358ca2382d tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Image pref 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 10:33:20 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-e4c395a3-37f2-4f8b-a928-bf358ca2382d tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 10:33:20 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-e4c395a3-37f2-4f8b-a928-bf358ca2382d tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 10:33:20 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-e4c395a3-37f2-4f8b-a928-bf358ca2382d tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=85141) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 10:33:20 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-e4c395a3-37f2-4f8b-a928-bf358ca2382d tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Got 1 possible topologies {{(pid=85141) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 10:33:20 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-e4c395a3-37f2-4f8b-a928-bf358ca2382d tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 10:33:20 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-e4c395a3-37f2-4f8b-a928-bf358ca2382d tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 10:33:20 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e4c395a3-37f2-4f8b-a928-bf358ca2382d tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: 6c284db0-2aa8-4680-ab40-7e9861f8449b] Calling os-brick to attach iSCSI Volume {{(pid=85141) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 10:33:20 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4c395a3-37f2-4f8b-a928-bf358ca2382d tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51806b6080>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:584dd8df-f6a2-4e35-be7e-8de1e759491b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XoQOTquf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 10:33:20 user nova-compute[85141]: WARNING os_brick.initiator.connectors.base [None req-e4c395a3-37f2-4f8b-a928-bf358ca2382d tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 10:33:20 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-e4c395a3-37f2-4f8b-a928-bf358ca2382d tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 10:33:20 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-9119232c-d10d-4bc9-854d-2a3519e13c1f tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Searching for a device in session 49 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=85141) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 10:33:20 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-9119232c-d10d-4bc9-854d-2a3519e13c1f tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:ca6daac8-c9e0-4fdf-903f-1fcd2f9bc544', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mMWCPzrx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=85141) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 10:33:20 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-9119232c-d10d-4bc9-854d-2a3519e13c1f tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.395s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 10:33:20 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-9119232c-d10d-4bc9-854d-2a3519e13c1f tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] <== connect_volume: return (1396ms) {'type': 'block', 'scsi_wwn': '26165343564323133', 'path': '/dev/sdb'} {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 10:33:20 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9119232c-d10d-4bc9-854d-2a3519e13c1f tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] [instance: f432d8f9-10c4-49e3-bf3b-6389f52e21ab] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26165343564323133', 'path': '/dev/sdb'} {{(pid=85141) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 10:33:20 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-e4c395a3-37f2-4f8b-a928-bf358ca2382d tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.150s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 10:33:20 user nova-compute[85141]: WARNING os_brick.initiator.connectors.base [None req-e4c395a3-37f2-4f8b-a928-bf358ca2382d tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 10:33:20 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-e4c395a3-37f2-4f8b-a928-bf358ca2382d tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:584dd8df-f6a2-4e35-be7e-8de1e759491b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 10:33:20 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-e4c395a3-37f2-4f8b-a928-bf358ca2382d tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:584dd8df-f6a2-4e35-be7e-8de1e759491b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 10:33:20 user nova-compute[85141]: INFO os_brick.initiator.connectors.iscsi [None req-e4c395a3-37f2-4f8b-a928-bf358ca2382d tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 10:33:20 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:584dd8df-f6a2-4e35-be7e-8de1e759491b -p 172.16.0.220:3260 {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:33:20 user nova-compute[85141]: DEBUG nova.objects.instance [None req-9119232c-d10d-4bc9-854d-2a3519e13c1f tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Lazy-loading 'flavor' on Instance uuid f432d8f9-10c4-49e3-bf3b-6389f52e21ab {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:33:20 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:584dd8df-f6a2-4e35-be7e-8de1e759491b -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:33:20 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[0957e762-5af5-4c22-b77e-3fb0bcd23a2d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:33:20 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4c395a3-37f2-4f8b-a928-bf358ca2382d tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 10:33:20 user nova-compute[85141]:  {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:33:20 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:584dd8df-f6a2-4e35-be7e-8de1e759491b -p 172.16.0.220:3260 --interface default --op new {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:33:20 user nova-compute[85141]: DEBUG nova.virt.libvirt.guest [None req-9119232c-d10d-4bc9-854d-2a3519e13c1f tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 10:33:20 user nova-compute[85141]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 10:33:20 user nova-compute[85141]:   <source dev="/dev/sdb"/>
Nov 16 10:33:20 user nova-compute[85141]:   <target dev="vdb" bus="virtio"/>
Nov 16 10:33:20 user nova-compute[85141]:   <serial>ca6daac8-c9e0-4fdf-903f-1fcd2f9bc544</serial>
Nov 16 10:33:20 user nova-compute[85141]: </disk>
Nov 16 10:33:20 user nova-compute[85141]:  {{(pid=85141) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 10:33:20 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:584dd8df-f6a2-4e35-be7e-8de1e759491b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:33:20 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[a573f179-0bab-4fa6-aceb-8316d5aee1ad]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:584dd8df-f6a2-4e35-be7e-8de1e759491b] added\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:33:20 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4c395a3-37f2-4f8b-a928-bf358ca2382d tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:584dd8df-f6a2-4e35-be7e-8de1e759491b] added
Nov 16 10:33:20 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:33:20 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:584dd8df-f6a2-4e35-be7e-8de1e759491b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:33:20 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:584dd8df-f6a2-4e35-be7e-8de1e759491b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:33:20 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4fe5ca4-bfac-4ef4-8716-b7d555baadae]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:33:20 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4c395a3-37f2-4f8b-a928-bf358ca2382d tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:33:20 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:584dd8df-f6a2-4e35-be7e-8de1e759491b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:33:20 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:584dd8df-f6a2-4e35-be7e-8de1e759491b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:33:20 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ad55217-1ab3-4ed4-9c92-3f5b5a823b12]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:33:20 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4c395a3-37f2-4f8b-a928-bf358ca2382d tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:33:20 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:584dd8df-f6a2-4e35-be7e-8de1e759491b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XoQOTquf {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:33:20 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:584dd8df-f6a2-4e35-be7e-8de1e759491b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XoQOTquf" returned: 0 in 0.017s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:33:20 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[c13eb206-9077-4f16-8f4c-eb46f533d098]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:33:20 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4c395a3-37f2-4f8b-a928-bf358ca2382d tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XoQOTquf'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:33:20 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:584dd8df-f6a2-4e35-be7e-8de1e759491b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:33:20 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:584dd8df-f6a2-4e35-be7e-8de1e759491b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:33:20 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[88e2c855-bd16-446d-9c64-5aee83a8b431]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:33:20 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4c395a3-37f2-4f8b-a928-bf358ca2382d tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:33:20 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:33:20 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:33:20 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[a29a202a-edb5-4eef-a23b-0dcb667f5d5b]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca6daac8-c9e0-4fdf-903f-1fcd2f9bc544 (non-flash)\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:33:20 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4c395a3-37f2-4f8b-a928-bf358ca2382d tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca6daac8-c9e0-4fdf-903f-1fcd2f9bc544 (non-flash)
Nov 16 10:33:20 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:33:20 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4c395a3-37f2-4f8b-a928-bf358ca2382d tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca6daac8-c9e0-4fdf-903f-1fcd2f9bc544 (non-flash)
Nov 16 10:33:20 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 10:33:20 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:584dd8df-f6a2-4e35-be7e-8de1e759491b -p 172.16.0.220:3260 --login {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:33:20 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:584dd8df-f6a2-4e35-be7e-8de1e759491b -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:33:20 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b5e2af1-0629-450d-8814-b114cf6d1d72]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:584dd8df-f6a2-4e35-be7e-8de1e759491b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:584dd8df-f6a2-4e35-be7e-8de1e759491b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:33:20 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4c395a3-37f2-4f8b-a928-bf358ca2382d tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:584dd8df-f6a2-4e35-be7e-8de1e759491b, portal: 172.16.0.220,3260]
Nov 16 10:33:20 user nova-compute[85141]: Login to [iface: default, target: iqn.2010-10.org.openstack:584dd8df-f6a2-4e35-be7e-8de1e759491b, portal: 172.16.0.220,3260] successful.
Nov 16 10:33:20 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:33:20 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:584dd8df-f6a2-4e35-be7e-8de1e759491b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:33:20 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:584dd8df-f6a2-4e35-be7e-8de1e759491b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:33:20 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cc05359-c013-4ed8-bc48-7742ae18ea4a]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:33:20 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4c395a3-37f2-4f8b-a928-bf358ca2382d tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:33:20 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:33:20 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:33:20 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfab0e48-a83b-4e1b-b482-7c97812487c5]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca6daac8-c9e0-4fdf-903f-1fcd2f9bc544 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:584dd8df-f6a2-4e35-be7e-8de1e759491b (non-flash)\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:33:20 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4c395a3-37f2-4f8b-a928-bf358ca2382d tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca6daac8-c9e0-4fdf-903f-1fcd2f9bc544 (non-flash)
Nov 16 10:33:20 user nova-compute[85141]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:584dd8df-f6a2-4e35-be7e-8de1e759491b (non-flash)
Nov 16 10:33:20 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:33:20 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4c395a3-37f2-4f8b-a928-bf358ca2382d tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca6daac8-c9e0-4fdf-903f-1fcd2f9bc544 (non-flash)
Nov 16 10:33:20 user nova-compute[85141]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:584dd8df-f6a2-4e35-be7e-8de1e759491b (non-flash)
Nov 16 10:33:20 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 10:33:20 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-e4c395a3-37f2-4f8b-a928-bf358ca2382d tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:584dd8df-f6a2-4e35-be7e-8de1e759491b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.252s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 10:33:20 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4c395a3-37f2-4f8b-a928-bf358ca2382d tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Connected to 172.16.0.220:3260 {{(pid=85141) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 10:33:20 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-e4c395a3-37f2-4f8b-a928-bf358ca2382d tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] HCTL ('34', '-', '-', 0) found on session 50 with lun 0 {{(pid=85141) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 10:33:20 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-e4c395a3-37f2-4f8b-a928-bf358ca2382d tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=85141) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 10:33:20 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:33:20 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.015s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:33:20 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[302e7309-469c-4e43-aeb7-3f7ebfee9004]: (4, ('- - 0', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:33:20 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-e4c395a3-37f2-4f8b-a928-bf358ca2382d tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Searching for a device in session 50 and hctl ['34', '*', '*', 0] yield: None {{(pid=85141) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 10:33:20 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-9119232c-d10d-4bc9-854d-2a3519e13c1f tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] No BDM found with device name vda, not building metadata. {{(pid=85141) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 10:33:20 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-9119232c-d10d-4bc9-854d-2a3519e13c1f tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] No BDM found with device name vdb, not building metadata. {{(pid=85141) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 10:33:20 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-9119232c-d10d-4bc9-854d-2a3519e13c1f tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] No VIF found with MAC fa:16:3e:c3:18:3e, not building metadata {{(pid=85141) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 10:33:21 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-9119232c-d10d-4bc9-854d-2a3519e13c1f tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Lock "f432d8f9-10c4-49e3-bf3b-6389f52e21ab" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.520s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:33:21 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-e4c395a3-37f2-4f8b-a928-bf358ca2382d tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Searching for a device in session 50 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=85141) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 10:33:21 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4c395a3-37f2-4f8b-a928-bf358ca2382d tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:584dd8df-f6a2-4e35-be7e-8de1e759491b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XoQOTquf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=85141) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 10:33:21 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-e4c395a3-37f2-4f8b-a928-bf358ca2382d tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.279s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 10:33:21 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4c395a3-37f2-4f8b-a928-bf358ca2382d tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] <== connect_volume: return (1429ms) {'type': 'block', 'scsi_wwn': '23335306261396637', 'path': '/dev/sdc'} {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 10:33:21 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e4c395a3-37f2-4f8b-a928-bf358ca2382d tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: 6c284db0-2aa8-4680-ab40-7e9861f8449b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23335306261396637', 'path': '/dev/sdc'} {{(pid=85141) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 10:33:21 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-e4c395a3-37f2-4f8b-a928-bf358ca2382d tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T10:33:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-927511500',display_name='tempest-TestVolumeBootPattern-server-927511500',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-927511500',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK2tiQ/yBbFjZdjBIR2tKrAVD3soVHRqo5J6ZL2tZkf+/CHlij0TJEEFuVTAcbccfWNw+REn7xM/u4NrsIPLxGXc8EfsNWZLl3/YiEOdS+xhO6c08a6foGqxQYJ8pZUDrQ==',key_name='tempest-TestVolumeBootPattern-1363391981',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aec3bb9fe5e6446590900b5adf65df0f',ramdisk_id='',reservation_id='r-t9zwuyvc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1979039357',owner_user_name='tempest-TestVolumeBootPattern-1979039357-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T10:33:15Z,user_data=None,user_id='7261b57c36904fcda87a9ea32d4b5b31',uuid=6c284db0-2aa8-4680-ab40-7e9861f8449b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4c31827f-7de8-49d3-a461-d6e83b8faa0d", "address": "fa:16:3e:85:13:75", "network": {"id": "b8ada47f-9721-4358-ac4f-0305f06dbbb8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1663922860-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aec3bb9fe5e6446590900b5adf65df0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c31827f-7d", "ovs_interfaceid": "4c31827f-7de8-49d3-a461-d6e83b8faa0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=85141) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 10:33:21 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-e4c395a3-37f2-4f8b-a928-bf358ca2382d tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Converting VIF {"id": "4c31827f-7de8-49d3-a461-d6e83b8faa0d", "address": "fa:16:3e:85:13:75", "network": {"id": "b8ada47f-9721-4358-ac4f-0305f06dbbb8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1663922860-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aec3bb9fe5e6446590900b5adf65df0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c31827f-7d", "ovs_interfaceid": "4c31827f-7de8-49d3-a461-d6e83b8faa0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:33:21 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-e4c395a3-37f2-4f8b-a928-bf358ca2382d tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:85:13:75,bridge_name='br-int',has_traffic_filtering=True,id=4c31827f-7de8-49d3-a461-d6e83b8faa0d,network=Network(b8ada47f-9721-4358-ac4f-0305f06dbbb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c31827f-7d') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:33:21 user nova-compute[85141]: DEBUG nova.objects.instance [None req-e4c395a3-37f2-4f8b-a928-bf358ca2382d tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Lazy-loading 'pci_devices' on Instance uuid 6c284db0-2aa8-4680-ab40-7e9861f8449b {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:33:21 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-e4c395a3-37f2-4f8b-a928-bf358ca2382d tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: 6c284db0-2aa8-4680-ab40-7e9861f8449b] End _get_guest_xml xml=<domain type="kvm">
Nov 16 10:33:21 user nova-compute[85141]:   <uuid>6c284db0-2aa8-4680-ab40-7e9861f8449b</uuid>
Nov 16 10:33:21 user nova-compute[85141]:   <name>instance-0000002e</name>
Nov 16 10:33:21 user nova-compute[85141]:   <memory>524288</memory>
Nov 16 10:33:21 user nova-compute[85141]:   <vcpu>1</vcpu>
Nov 16 10:33:21 user nova-compute[85141]:   <metadata>
Nov 16 10:33:21 user nova-compute[85141]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 10:33:21 user nova-compute[85141]:       <nova:package version="0.0.0"/>
Nov 16 10:33:21 user nova-compute[85141]:       <nova:name>tempest-TestVolumeBootPattern-server-927511500</nova:name>
Nov 16 10:33:21 user nova-compute[85141]:       <nova:creationTime>2023-11-16 10:33:20</nova:creationTime>
Nov 16 10:33:21 user nova-compute[85141]:       <nova:flavor name="m1.tiny">
Nov 16 10:33:21 user nova-compute[85141]:         <nova:memory>512</nova:memory>
Nov 16 10:33:21 user nova-compute[85141]:         <nova:disk>1</nova:disk>
Nov 16 10:33:21 user nova-compute[85141]:         <nova:swap>0</nova:swap>
Nov 16 10:33:21 user nova-compute[85141]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 10:33:21 user nova-compute[85141]:         <nova:vcpus>1</nova:vcpus>
Nov 16 10:33:21 user nova-compute[85141]:       </nova:flavor>
Nov 16 10:33:21 user nova-compute[85141]:       <nova:owner>
Nov 16 10:33:21 user nova-compute[85141]:         <nova:user uuid="7261b57c36904fcda87a9ea32d4b5b31">tempest-TestVolumeBootPattern-1979039357-project-member</nova:user>
Nov 16 10:33:21 user nova-compute[85141]:         <nova:project uuid="aec3bb9fe5e6446590900b5adf65df0f">tempest-TestVolumeBootPattern-1979039357</nova:project>
Nov 16 10:33:21 user nova-compute[85141]:       </nova:owner>
Nov 16 10:33:21 user nova-compute[85141]:       <nova:ports>
Nov 16 10:33:21 user nova-compute[85141]:         <nova:port uuid="4c31827f-7de8-49d3-a461-d6e83b8faa0d">
Nov 16 10:33:21 user nova-compute[85141]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 16 10:33:21 user nova-compute[85141]:         </nova:port>
Nov 16 10:33:21 user nova-compute[85141]:       </nova:ports>
Nov 16 10:33:21 user nova-compute[85141]:     </nova:instance>
Nov 16 10:33:21 user nova-compute[85141]:   </metadata>
Nov 16 10:33:21 user nova-compute[85141]:   <sysinfo type="smbios">
Nov 16 10:33:21 user nova-compute[85141]:     <system>
Nov 16 10:33:21 user nova-compute[85141]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 10:33:21 user nova-compute[85141]:       <entry name="product">OpenStack Nova</entry>
Nov 16 10:33:21 user nova-compute[85141]:       <entry name="version">0.0.0</entry>
Nov 16 10:33:21 user nova-compute[85141]:       <entry name="serial">6c284db0-2aa8-4680-ab40-7e9861f8449b</entry>
Nov 16 10:33:21 user nova-compute[85141]:       <entry name="uuid">6c284db0-2aa8-4680-ab40-7e9861f8449b</entry>
Nov 16 10:33:21 user nova-compute[85141]:       <entry name="family">Virtual Machine</entry>
Nov 16 10:33:21 user nova-compute[85141]:     </system>
Nov 16 10:33:21 user nova-compute[85141]:   </sysinfo>
Nov 16 10:33:21 user nova-compute[85141]:   <os>
Nov 16 10:33:21 user nova-compute[85141]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 10:33:21 user nova-compute[85141]:     <boot dev="hd"/>
Nov 16 10:33:21 user nova-compute[85141]:     <smbios mode="sysinfo"/>
Nov 16 10:33:21 user nova-compute[85141]:   </os>
Nov 16 10:33:21 user nova-compute[85141]:   <features>
Nov 16 10:33:21 user nova-compute[85141]:     <acpi/>
Nov 16 10:33:21 user nova-compute[85141]:     <apic/>
Nov 16 10:33:21 user nova-compute[85141]:     <vmcoreinfo/>
Nov 16 10:33:21 user nova-compute[85141]:   </features>
Nov 16 10:33:21 user nova-compute[85141]:   <clock offset="utc">
Nov 16 10:33:21 user nova-compute[85141]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 10:33:21 user nova-compute[85141]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 10:33:21 user nova-compute[85141]:     <timer name="hpet" present="no"/>
Nov 16 10:33:21 user nova-compute[85141]:   </clock>
Nov 16 10:33:21 user nova-compute[85141]:   <cpu mode="custom" match="exact">
Nov 16 10:33:21 user nova-compute[85141]:     <model>Nehalem</model>
Nov 16 10:33:21 user nova-compute[85141]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 10:33:21 user nova-compute[85141]:   </cpu>
Nov 16 10:33:21 user nova-compute[85141]:   <devices>
Nov 16 10:33:21 user nova-compute[85141]:     <disk type="block" device="disk">
Nov 16 10:33:21 user nova-compute[85141]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 10:33:21 user nova-compute[85141]:       <source dev="/dev/sdc"/>
Nov 16 10:33:21 user nova-compute[85141]:       <target dev="vda" bus="virtio"/>
Nov 16 10:33:21 user nova-compute[85141]:       <serial>584dd8df-f6a2-4e35-be7e-8de1e759491b</serial>
Nov 16 10:33:21 user nova-compute[85141]:     </disk>
Nov 16 10:33:21 user nova-compute[85141]:     <interface type="ethernet">
Nov 16 10:33:21 user nova-compute[85141]:       <mac address="fa:16:3e:85:13:75"/>
Nov 16 10:33:21 user nova-compute[85141]:       <model type="virtio"/>
Nov 16 10:33:21 user nova-compute[85141]:       <mtu size="1442"/>
Nov 16 10:33:21 user nova-compute[85141]:       <target dev="tap4c31827f-7d"/>
Nov 16 10:33:21 user nova-compute[85141]:     </interface>
Nov 16 10:33:21 user nova-compute[85141]:     <serial type="pty">
Nov 16 10:33:21 user nova-compute[85141]:       <log file="/opt/stack/data/nova/instances/6c284db0-2aa8-4680-ab40-7e9861f8449b/console.log" append="off"/>
Nov 16 10:33:21 user nova-compute[85141]:     </serial>
Nov 16 10:33:21 user nova-compute[85141]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 10:33:21 user nova-compute[85141]:     <video>
Nov 16 10:33:21 user nova-compute[85141]:       <model type="virtio"/>
Nov 16 10:33:21 user nova-compute[85141]:     </video>
Nov 16 10:33:21 user nova-compute[85141]:     <rng model="virtio">
Nov 16 10:33:21 user nova-compute[85141]:       <backend model="random">/dev/urandom</backend>
Nov 16 10:33:21 user nova-compute[85141]:     </rng>
Nov 16 10:33:21 user nova-compute[85141]:     <controller type="usb" index="0" model="none"/>
Nov 16 10:33:21 user nova-compute[85141]:     <memballoon model="virtio">
Nov 16 10:33:21 user nova-compute[85141]:       <stats period="10"/>
Nov 16 10:33:21 user nova-compute[85141]:     </memballoon>
Nov 16 10:33:21 user nova-compute[85141]:   </devices>
Nov 16 10:33:21 user nova-compute[85141]: </domain>
Nov 16 10:33:21 user nova-compute[85141]:  {{(pid=85141) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 10:33:21 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-e4c395a3-37f2-4f8b-a928-bf358ca2382d tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T10:33:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-927511500',display_name='tempest-TestVolumeBootPattern-server-927511500',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-927511500',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK2tiQ/yBbFjZdjBIR2tKrAVD3soVHRqo5J6ZL2tZkf+/CHlij0TJEEFuVTAcbccfWNw+REn7xM/u4NrsIPLxGXc8EfsNWZLl3/YiEOdS+xhO6c08a6foGqxQYJ8pZUDrQ==',key_name='tempest-TestVolumeBootPattern-1363391981',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aec3bb9fe5e6446590900b5adf65df0f',ramdisk_id='',reservation_id='r-t9zwuyvc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1979039357',owner_user_name='tempest-TestVolumeBootPattern-1979039357-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T10:33:15Z,user_data=None,user_id='7261b57c36904fcda87a9ea32d4b5b31',uuid=6c284db0-2aa8-4680-ab40-7e9861f8449b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4c31827f-7de8-49d3-a461-d6e83b8faa0d", "address": "fa:16:3e:85:13:75", "network": {"id": "b8ada47f-9721-4358-ac4f-0305f06dbbb8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1663922860-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aec3bb9fe5e6446590900b5adf65df0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c31827f-7d", "ovs_interfaceid": "4c31827f-7de8-49d3-a461-d6e83b8faa0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 10:33:21 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-e4c395a3-37f2-4f8b-a928-bf358ca2382d tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Converting VIF {"id": "4c31827f-7de8-49d3-a461-d6e83b8faa0d", "address": "fa:16:3e:85:13:75", "network": {"id": "b8ada47f-9721-4358-ac4f-0305f06dbbb8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1663922860-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aec3bb9fe5e6446590900b5adf65df0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c31827f-7d", "ovs_interfaceid": "4c31827f-7de8-49d3-a461-d6e83b8faa0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:33:21 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-e4c395a3-37f2-4f8b-a928-bf358ca2382d tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:85:13:75,bridge_name='br-int',has_traffic_filtering=True,id=4c31827f-7de8-49d3-a461-d6e83b8faa0d,network=Network(b8ada47f-9721-4358-ac4f-0305f06dbbb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c31827f-7d') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:33:21 user nova-compute[85141]: DEBUG os_vif [None req-e4c395a3-37f2-4f8b-a928-bf358ca2382d tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:85:13:75,bridge_name='br-int',has_traffic_filtering=True,id=4c31827f-7de8-49d3-a461-d6e83b8faa0d,network=Network(b8ada47f-9721-4358-ac4f-0305f06dbbb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c31827f-7d') {{(pid=85141) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 10:33:21 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:33:21 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:33:21 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 10:33:21 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:33:21 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b011345a-c9be-54e6-9191-894d78a2a6d6', '_type': 'linux-noop'}}, row=False) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:33:21 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:33:21 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:33:21 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:33:21 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4c31827f-7d, may_exist=True, interface_attrs={}) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:33:21 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4c31827f-7d, col_values=(('qos', UUID('de72765a-0379-4ee6-840d-f737c77912f6')),), if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:33:21 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4c31827f-7d, col_values=(('external_ids', {'iface-id': '4c31827f-7de8-49d3-a461-d6e83b8faa0d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:85:13:75', 'vm-uuid': '6c284db0-2aa8-4680-ab40-7e9861f8449b'}),), if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:33:21 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:33:21 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:33:21 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:33:21 user nova-compute[85141]: INFO os_vif [None req-e4c395a3-37f2-4f8b-a928-bf358ca2382d tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:85:13:75,bridge_name='br-int',has_traffic_filtering=True,id=4c31827f-7de8-49d3-a461-d6e83b8faa0d,network=Network(b8ada47f-9721-4358-ac4f-0305f06dbbb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c31827f-7d')
Nov 16 10:33:21 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-e4c395a3-37f2-4f8b-a928-bf358ca2382d tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] No BDM found with device name vda, not building metadata. {{(pid=85141) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 10:33:21 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-e4c395a3-37f2-4f8b-a928-bf358ca2382d tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] No VIF found with MAC fa:16:3e:85:13:75, not building metadata {{(pid=85141) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 10:33:23 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:33:23 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:33:23 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:33:23 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:33:23 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:33:23 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-6b360ff5-b9b5-47cd-99ff-4feb4f32a991 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Acquiring lock "f432d8f9-10c4-49e3-bf3b-6389f52e21ab" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:33:23 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-6b360ff5-b9b5-47cd-99ff-4feb4f32a991 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Lock "f432d8f9-10c4-49e3-bf3b-6389f52e21ab" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:33:23 user nova-compute[85141]: INFO nova.compute.manager [None req-6b360ff5-b9b5-47cd-99ff-4feb4f32a991 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] [instance: f432d8f9-10c4-49e3-bf3b-6389f52e21ab] Detaching volume ca6daac8-c9e0-4fdf-903f-1fcd2f9bc544
Nov 16 10:33:23 user nova-compute[85141]: DEBUG nova.compute.manager [req-a3bd06fd-b801-4ddb-aac6-1cad83b6f74e req-746bf7e5-5e5e-47e2-ac2c-8e7c1dc5f16e service nova] [instance: 6c284db0-2aa8-4680-ab40-7e9861f8449b] Received event network-vif-plugged-4c31827f-7de8-49d3-a461-d6e83b8faa0d {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:33:23 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-a3bd06fd-b801-4ddb-aac6-1cad83b6f74e req-746bf7e5-5e5e-47e2-ac2c-8e7c1dc5f16e service nova] Acquiring lock "6c284db0-2aa8-4680-ab40-7e9861f8449b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:33:23 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-a3bd06fd-b801-4ddb-aac6-1cad83b6f74e req-746bf7e5-5e5e-47e2-ac2c-8e7c1dc5f16e service nova] Lock "6c284db0-2aa8-4680-ab40-7e9861f8449b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:33:23 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-a3bd06fd-b801-4ddb-aac6-1cad83b6f74e req-746bf7e5-5e5e-47e2-ac2c-8e7c1dc5f16e service nova] Lock "6c284db0-2aa8-4680-ab40-7e9861f8449b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:33:23 user nova-compute[85141]: DEBUG nova.compute.manager [req-a3bd06fd-b801-4ddb-aac6-1cad83b6f74e req-746bf7e5-5e5e-47e2-ac2c-8e7c1dc5f16e service nova] [instance: 6c284db0-2aa8-4680-ab40-7e9861f8449b] No waiting events found dispatching network-vif-plugged-4c31827f-7de8-49d3-a461-d6e83b8faa0d {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:33:23 user nova-compute[85141]: WARNING nova.compute.manager [req-a3bd06fd-b801-4ddb-aac6-1cad83b6f74e req-746bf7e5-5e5e-47e2-ac2c-8e7c1dc5f16e service nova] [instance: 6c284db0-2aa8-4680-ab40-7e9861f8449b] Received unexpected event network-vif-plugged-4c31827f-7de8-49d3-a461-d6e83b8faa0d for instance with vm_state building and task_state spawning.
Nov 16 10:33:23 user nova-compute[85141]: INFO nova.virt.block_device [None req-6b360ff5-b9b5-47cd-99ff-4feb4f32a991 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] [instance: f432d8f9-10c4-49e3-bf3b-6389f52e21ab] Attempting to driver detach volume ca6daac8-c9e0-4fdf-903f-1fcd2f9bc544 from mountpoint /dev/vdb
Nov 16 10:33:23 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-6b360ff5-b9b5-47cd-99ff-4feb4f32a991 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Attempting to detach device vdb from instance f432d8f9-10c4-49e3-bf3b-6389f52e21ab from the persistent domain config. {{(pid=85141) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 10:33:23 user nova-compute[85141]: DEBUG nova.virt.libvirt.guest [None req-6b360ff5-b9b5-47cd-99ff-4feb4f32a991 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 10:33:23 user nova-compute[85141]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 10:33:23 user nova-compute[85141]:   <source dev="/dev/sdb"/>
Nov 16 10:33:23 user nova-compute[85141]:   <target dev="vdb" bus="virtio"/>
Nov 16 10:33:23 user nova-compute[85141]:   <serial>ca6daac8-c9e0-4fdf-903f-1fcd2f9bc544</serial>
Nov 16 10:33:23 user nova-compute[85141]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 10:33:23 user nova-compute[85141]: </disk>
Nov 16 10:33:23 user nova-compute[85141]:  {{(pid=85141) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 10:33:23 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-6b360ff5-b9b5-47cd-99ff-4feb4f32a991 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Successfully detached device vdb from instance f432d8f9-10c4-49e3-bf3b-6389f52e21ab from the persistent domain config.
Nov 16 10:33:23 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-6b360ff5-b9b5-47cd-99ff-4feb4f32a991 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f432d8f9-10c4-49e3-bf3b-6389f52e21ab from the live domain config. {{(pid=85141) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 10:33:23 user nova-compute[85141]: DEBUG nova.virt.libvirt.guest [None req-6b360ff5-b9b5-47cd-99ff-4feb4f32a991 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 10:33:23 user nova-compute[85141]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 10:33:23 user nova-compute[85141]:   <source dev="/dev/sdb"/>
Nov 16 10:33:23 user nova-compute[85141]:   <target dev="vdb" bus="virtio"/>
Nov 16 10:33:23 user nova-compute[85141]:   <serial>ca6daac8-c9e0-4fdf-903f-1fcd2f9bc544</serial>
Nov 16 10:33:23 user nova-compute[85141]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 10:33:23 user nova-compute[85141]: </disk>
Nov 16 10:33:23 user nova-compute[85141]:  {{(pid=85141) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 10:33:23 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:33:23 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:33:23 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:33:23 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:33:24 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-6b360ff5-b9b5-47cd-99ff-4feb4f32a991 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f432d8f9-10c4-49e3-bf3b-6389f52e21ab {{(pid=85141) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 10:33:25 user nova-compute[85141]: DEBUG nova.compute.manager [None req-e4c395a3-37f2-4f8b-a928-bf358ca2382d tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: 6c284db0-2aa8-4680-ab40-7e9861f8449b] Instance event wait completed in 0 seconds for  {{(pid=85141) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 10:33:25 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-e4c395a3-37f2-4f8b-a928-bf358ca2382d tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: 6c284db0-2aa8-4680-ab40-7e9861f8449b] Guest created on hypervisor {{(pid=85141) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 10:33:25 user nova-compute[85141]: INFO nova.virt.libvirt.driver [-] [instance: 6c284db0-2aa8-4680-ab40-7e9861f8449b] Instance spawned successfully.
Nov 16 10:33:25 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-e4c395a3-37f2-4f8b-a928-bf358ca2382d tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: 6c284db0-2aa8-4680-ab40-7e9861f8449b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 10:33:25 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-e4c395a3-37f2-4f8b-a928-bf358ca2382d tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: 6c284db0-2aa8-4680-ab40-7e9861f8449b] Found default for hw_cdrom_bus of ide {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:33:25 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-e4c395a3-37f2-4f8b-a928-bf358ca2382d tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: 6c284db0-2aa8-4680-ab40-7e9861f8449b] Found default for hw_disk_bus of virtio {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:33:25 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-e4c395a3-37f2-4f8b-a928-bf358ca2382d tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: 6c284db0-2aa8-4680-ab40-7e9861f8449b] Found default for hw_input_bus of None {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:33:25 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-e4c395a3-37f2-4f8b-a928-bf358ca2382d tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: 6c284db0-2aa8-4680-ab40-7e9861f8449b] Found default for hw_pointer_model of None {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:33:25 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-e4c395a3-37f2-4f8b-a928-bf358ca2382d tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: 6c284db0-2aa8-4680-ab40-7e9861f8449b] Found default for hw_video_model of virtio {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:33:25 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-e4c395a3-37f2-4f8b-a928-bf358ca2382d tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: 6c284db0-2aa8-4680-ab40-7e9861f8449b] Found default for hw_vif_model of virtio {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:33:25 user nova-compute[85141]: INFO nova.compute.manager [None req-e4c395a3-37f2-4f8b-a928-bf358ca2382d tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: 6c284db0-2aa8-4680-ab40-7e9861f8449b] Took 5.15 seconds to spawn the instance on the hypervisor.
Nov 16 10:33:25 user nova-compute[85141]: DEBUG nova.compute.manager [None req-e4c395a3-37f2-4f8b-a928-bf358ca2382d tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: 6c284db0-2aa8-4680-ab40-7e9861f8449b] Checking state {{(pid=85141) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 10:33:25 user nova-compute[85141]: INFO nova.compute.manager [None req-e4c395a3-37f2-4f8b-a928-bf358ca2382d tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: 6c284db0-2aa8-4680-ab40-7e9861f8449b] Took 11.28 seconds to build instance.
Nov 16 10:33:25 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-e4c395a3-37f2-4f8b-a928-bf358ca2382d tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Lock "6c284db0-2aa8-4680-ab40-7e9861f8449b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.430s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:33:25 user nova-compute[85141]: DEBUG nova.compute.manager [req-2f2cc69e-3e70-482d-b252-150de0fa4f4a req-3df2274d-c0ac-46b1-9884-80df782b0cc3 service nova] [instance: 6c284db0-2aa8-4680-ab40-7e9861f8449b] Received event network-vif-plugged-4c31827f-7de8-49d3-a461-d6e83b8faa0d {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:33:25 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-2f2cc69e-3e70-482d-b252-150de0fa4f4a req-3df2274d-c0ac-46b1-9884-80df782b0cc3 service nova] Acquiring lock "6c284db0-2aa8-4680-ab40-7e9861f8449b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:33:25 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-2f2cc69e-3e70-482d-b252-150de0fa4f4a req-3df2274d-c0ac-46b1-9884-80df782b0cc3 service nova] Lock "6c284db0-2aa8-4680-ab40-7e9861f8449b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:33:25 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-2f2cc69e-3e70-482d-b252-150de0fa4f4a req-3df2274d-c0ac-46b1-9884-80df782b0cc3 service nova] Lock "6c284db0-2aa8-4680-ab40-7e9861f8449b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:33:25 user nova-compute[85141]: DEBUG nova.compute.manager [req-2f2cc69e-3e70-482d-b252-150de0fa4f4a req-3df2274d-c0ac-46b1-9884-80df782b0cc3 service nova] [instance: 6c284db0-2aa8-4680-ab40-7e9861f8449b] No waiting events found dispatching network-vif-plugged-4c31827f-7de8-49d3-a461-d6e83b8faa0d {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:33:25 user nova-compute[85141]: WARNING nova.compute.manager [req-2f2cc69e-3e70-482d-b252-150de0fa4f4a req-3df2274d-c0ac-46b1-9884-80df782b0cc3 service nova] [instance: 6c284db0-2aa8-4680-ab40-7e9861f8449b] Received unexpected event network-vif-plugged-4c31827f-7de8-49d3-a461-d6e83b8faa0d for instance with vm_state active and task_state None.
Nov 16 10:33:25 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:33:26 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-9204c0ef-b414-4c61-b1b2-f2fb96a5ce73 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] Acquiring lock "7437a3a3-9b7f-489b-b20b-f1b877ebb253" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:33:26 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-9204c0ef-b414-4c61-b1b2-f2fb96a5ce73 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] Lock "7437a3a3-9b7f-489b-b20b-f1b877ebb253" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:33:26 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-9204c0ef-b414-4c61-b1b2-f2fb96a5ce73 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] Acquiring lock "7437a3a3-9b7f-489b-b20b-f1b877ebb253-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:33:26 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-9204c0ef-b414-4c61-b1b2-f2fb96a5ce73 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] Lock "7437a3a3-9b7f-489b-b20b-f1b877ebb253-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:33:26 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-9204c0ef-b414-4c61-b1b2-f2fb96a5ce73 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] Lock "7437a3a3-9b7f-489b-b20b-f1b877ebb253-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:33:26 user nova-compute[85141]: INFO nova.compute.manager [None req-9204c0ef-b414-4c61-b1b2-f2fb96a5ce73 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] [instance: 7437a3a3-9b7f-489b-b20b-f1b877ebb253] Terminating instance
Nov 16 10:33:26 user nova-compute[85141]: DEBUG nova.compute.manager [None req-9204c0ef-b414-4c61-b1b2-f2fb96a5ce73 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] [instance: 7437a3a3-9b7f-489b-b20b-f1b877ebb253] Start destroying the instance on the hypervisor. {{(pid=85141) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 10:33:26 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:33:26 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:33:26 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:33:26 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:33:26 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:33:27 user nova-compute[85141]: INFO nova.virt.libvirt.driver [-] [instance: 7437a3a3-9b7f-489b-b20b-f1b877ebb253] Instance destroyed successfully.
Nov 16 10:33:27 user nova-compute[85141]: DEBUG nova.objects.instance [None req-9204c0ef-b414-4c61-b1b2-f2fb96a5ce73 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] Lazy-loading 'resources' on Instance uuid 7437a3a3-9b7f-489b-b20b-f1b877ebb253 {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:33:27 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-9204c0ef-b414-4c61-b1b2-f2fb96a5ce73 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T10:29:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-344901009',display_name='tempest-TestServerVolumeAttachmentScenario-server-344901009',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-344901009',id=42,image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMPvNrJSbRFMMDGjY7pKVtR6fsIphJmAIkVfmPnNBpGgwuYrzeznF0GPJnZpOJW4HMhScDqKhb10B+EJdjQGkSKKZhgNAGBFRTq8D4waukkY4mEvjEABbIM0+P6o1SOizQ==',key_name='tempest-keypair-461665202',keypairs=<?>,launch_index=0,launched_at=2023-11-16T10:29:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0f8eed15973c44ceb150fe51b6e55382',ramdisk_id='',reservation_id='r-zkqkb6dl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-808328756',owner_user_name='tempest-TestServerVolumeAttachmentScenario-808328756-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T10:29:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7127276ead2d4cae9d562bec932c5512',uuid=7437a3a3-9b7f-489b-b20b-f1b877ebb253,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7ba5e576-d9a3-44c7-a741-a9d1e510d7bf", "address": "fa:16:3e:7e:27:4c", "network": {"id": "c0ffc241-9899-4b62-b6bd-91034f92f286", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1997979107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f8eed15973c44ceb150fe51b6e55382", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ba5e576-d9", "ovs_interfaceid": "7ba5e576-d9a3-44c7-a741-a9d1e510d7bf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 10:33:27 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-9204c0ef-b414-4c61-b1b2-f2fb96a5ce73 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] Converting VIF {"id": "7ba5e576-d9a3-44c7-a741-a9d1e510d7bf", "address": "fa:16:3e:7e:27:4c", "network": {"id": "c0ffc241-9899-4b62-b6bd-91034f92f286", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1997979107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f8eed15973c44ceb150fe51b6e55382", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ba5e576-d9", "ovs_interfaceid": "7ba5e576-d9a3-44c7-a741-a9d1e510d7bf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:33:27 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-9204c0ef-b414-4c61-b1b2-f2fb96a5ce73 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7e:27:4c,bridge_name='br-int',has_traffic_filtering=True,id=7ba5e576-d9a3-44c7-a741-a9d1e510d7bf,network=Network(c0ffc241-9899-4b62-b6bd-91034f92f286),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ba5e576-d9') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:33:27 user nova-compute[85141]: DEBUG os_vif [None req-9204c0ef-b414-4c61-b1b2-f2fb96a5ce73 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7e:27:4c,bridge_name='br-int',has_traffic_filtering=True,id=7ba5e576-d9a3-44c7-a741-a9d1e510d7bf,network=Network(c0ffc241-9899-4b62-b6bd-91034f92f286),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ba5e576-d9') {{(pid=85141) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 10:33:27 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:33:27 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7ba5e576-d9, bridge=br-int, if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:33:27 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:33:27 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:33:27 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:33:27 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b8a7ced1-9c7e-4267-b56e-aa58d894cbea) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:33:27 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:33:27 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:33:27 user nova-compute[85141]: INFO os_vif [None req-9204c0ef-b414-4c61-b1b2-f2fb96a5ce73 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7e:27:4c,bridge_name='br-int',has_traffic_filtering=True,id=7ba5e576-d9a3-44c7-a741-a9d1e510d7bf,network=Network(c0ffc241-9899-4b62-b6bd-91034f92f286),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ba5e576-d9')
Nov 16 10:33:27 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-9204c0ef-b414-4c61-b1b2-f2fb96a5ce73 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] [instance: 7437a3a3-9b7f-489b-b20b-f1b877ebb253] Deleting instance files /opt/stack/data/nova/instances/7437a3a3-9b7f-489b-b20b-f1b877ebb253_del
Nov 16 10:33:27 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-9204c0ef-b414-4c61-b1b2-f2fb96a5ce73 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] [instance: 7437a3a3-9b7f-489b-b20b-f1b877ebb253] Deletion of /opt/stack/data/nova/instances/7437a3a3-9b7f-489b-b20b-f1b877ebb253_del complete
Nov 16 10:33:27 user nova-compute[85141]: INFO nova.compute.manager [None req-9204c0ef-b414-4c61-b1b2-f2fb96a5ce73 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] [instance: 7437a3a3-9b7f-489b-b20b-f1b877ebb253] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 16 10:33:27 user nova-compute[85141]: DEBUG oslo.service.loopingcall [None req-9204c0ef-b414-4c61-b1b2-f2fb96a5ce73 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=85141) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 10:33:27 user nova-compute[85141]: DEBUG nova.compute.manager [-] [instance: 7437a3a3-9b7f-489b-b20b-f1b877ebb253] Deallocating network for instance {{(pid=85141) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 10:33:27 user nova-compute[85141]: DEBUG nova.network.neutron [-] [instance: 7437a3a3-9b7f-489b-b20b-f1b877ebb253] deallocate_for_instance() {{(pid=85141) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 10:33:27 user nova-compute[85141]: DEBUG nova.compute.manager [req-71c6cf56-f6c6-456e-86c9-27ff8a36c9fc req-6e741d07-dc2e-46fd-916b-d8fff74081ea service nova] [instance: 7437a3a3-9b7f-489b-b20b-f1b877ebb253] Received event network-vif-unplugged-7ba5e576-d9a3-44c7-a741-a9d1e510d7bf {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:33:27 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-71c6cf56-f6c6-456e-86c9-27ff8a36c9fc req-6e741d07-dc2e-46fd-916b-d8fff74081ea service nova] Acquiring lock "7437a3a3-9b7f-489b-b20b-f1b877ebb253-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:33:27 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-71c6cf56-f6c6-456e-86c9-27ff8a36c9fc req-6e741d07-dc2e-46fd-916b-d8fff74081ea service nova] Lock "7437a3a3-9b7f-489b-b20b-f1b877ebb253-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:33:27 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-71c6cf56-f6c6-456e-86c9-27ff8a36c9fc req-6e741d07-dc2e-46fd-916b-d8fff74081ea service nova] Lock "7437a3a3-9b7f-489b-b20b-f1b877ebb253-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:33:27 user nova-compute[85141]: DEBUG nova.compute.manager [req-71c6cf56-f6c6-456e-86c9-27ff8a36c9fc req-6e741d07-dc2e-46fd-916b-d8fff74081ea service nova] [instance: 7437a3a3-9b7f-489b-b20b-f1b877ebb253] No waiting events found dispatching network-vif-unplugged-7ba5e576-d9a3-44c7-a741-a9d1e510d7bf {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:33:27 user nova-compute[85141]: DEBUG nova.compute.manager [req-71c6cf56-f6c6-456e-86c9-27ff8a36c9fc req-6e741d07-dc2e-46fd-916b-d8fff74081ea service nova] [instance: 7437a3a3-9b7f-489b-b20b-f1b877ebb253] Received event network-vif-unplugged-7ba5e576-d9a3-44c7-a741-a9d1e510d7bf for instance with task_state deleting. {{(pid=85141) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 10:33:27 user nova-compute[85141]: DEBUG nova.compute.manager [req-71c6cf56-f6c6-456e-86c9-27ff8a36c9fc req-6e741d07-dc2e-46fd-916b-d8fff74081ea service nova] [instance: 7437a3a3-9b7f-489b-b20b-f1b877ebb253] Received event network-vif-plugged-7ba5e576-d9a3-44c7-a741-a9d1e510d7bf {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:33:27 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-71c6cf56-f6c6-456e-86c9-27ff8a36c9fc req-6e741d07-dc2e-46fd-916b-d8fff74081ea service nova] Acquiring lock "7437a3a3-9b7f-489b-b20b-f1b877ebb253-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:33:27 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-71c6cf56-f6c6-456e-86c9-27ff8a36c9fc req-6e741d07-dc2e-46fd-916b-d8fff74081ea service nova] Lock "7437a3a3-9b7f-489b-b20b-f1b877ebb253-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:33:27 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-71c6cf56-f6c6-456e-86c9-27ff8a36c9fc req-6e741d07-dc2e-46fd-916b-d8fff74081ea service nova] Lock "7437a3a3-9b7f-489b-b20b-f1b877ebb253-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:33:27 user nova-compute[85141]: DEBUG nova.compute.manager [req-71c6cf56-f6c6-456e-86c9-27ff8a36c9fc req-6e741d07-dc2e-46fd-916b-d8fff74081ea service nova] [instance: 7437a3a3-9b7f-489b-b20b-f1b877ebb253] No waiting events found dispatching network-vif-plugged-7ba5e576-d9a3-44c7-a741-a9d1e510d7bf {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:33:27 user nova-compute[85141]: WARNING nova.compute.manager [req-71c6cf56-f6c6-456e-86c9-27ff8a36c9fc req-6e741d07-dc2e-46fd-916b-d8fff74081ea service nova] [instance: 7437a3a3-9b7f-489b-b20b-f1b877ebb253] Received unexpected event network-vif-plugged-7ba5e576-d9a3-44c7-a741-a9d1e510d7bf for instance with vm_state active and task_state deleting.
Nov 16 10:33:28 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:33:28 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:33:28 user nova-compute[85141]: DEBUG nova.network.neutron [-] [instance: 7437a3a3-9b7f-489b-b20b-f1b877ebb253] Updating instance_info_cache with network_info: [] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:33:28 user nova-compute[85141]: INFO nova.compute.manager [-] [instance: 7437a3a3-9b7f-489b-b20b-f1b877ebb253] Took 1.03 seconds to deallocate network for instance.
Nov 16 10:33:28 user nova-compute[85141]: DEBUG nova.compute.manager [req-3c0625c6-5bc2-4935-96b9-fed9f4d4c16e req-ead94a0b-fc0d-4a55-8028-0e0b4389fe1e service nova] [instance: 7437a3a3-9b7f-489b-b20b-f1b877ebb253] Received event network-vif-deleted-7ba5e576-d9a3-44c7-a741-a9d1e510d7bf {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:33:28 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-9204c0ef-b414-4c61-b1b2-f2fb96a5ce73 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:33:28 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-9204c0ef-b414-4c61-b1b2-f2fb96a5ce73 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:33:28 user nova-compute[85141]: DEBUG nova.compute.provider_tree [None req-9204c0ef-b414-4c61-b1b2-f2fb96a5ce73 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] Inventory has not changed in ProviderTree for provider: bf8e0fa1-16b6-408f-9203-c4cd63916272 {{(pid=85141) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 10:33:28 user nova-compute[85141]: DEBUG nova.scheduler.client.report [None req-9204c0ef-b414-4c61-b1b2-f2fb96a5ce73 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] Inventory has not changed for provider bf8e0fa1-16b6-408f-9203-c4cd63916272 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=85141) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 10:33:28 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-9204c0ef-b414-4c61-b1b2-f2fb96a5ce73 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.266s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:33:28 user nova-compute[85141]: INFO nova.scheduler.client.report [None req-9204c0ef-b414-4c61-b1b2-f2fb96a5ce73 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] Deleted allocations for instance 7437a3a3-9b7f-489b-b20b-f1b877ebb253
Nov 16 10:33:29 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-9204c0ef-b414-4c61-b1b2-f2fb96a5ce73 tempest-TestServerVolumeAttachmentScenario-808328756 tempest-TestServerVolumeAttachmentScenario-808328756-project-member] Lock "7437a3a3-9b7f-489b-b20b-f1b877ebb253" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.396s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:33:32 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:33:34 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:33:35 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:33:37 user nova-compute[85141]: DEBUG nova.compute.manager [req-67d9e0ad-a43b-4388-b66f-ca634e14bf4b req-17853d19-d53f-4af4-9c88-64e02f0edac2 service nova] [instance: ac3f3bc9-f5e2-4dc8-bf62-3649611da824] Received event network-changed-57dd011e-4f3b-44bd-a8e1-e17a515e29e2 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:33:37 user nova-compute[85141]: DEBUG nova.compute.manager [req-67d9e0ad-a43b-4388-b66f-ca634e14bf4b req-17853d19-d53f-4af4-9c88-64e02f0edac2 service nova] [instance: ac3f3bc9-f5e2-4dc8-bf62-3649611da824] Refreshing instance network info cache due to event network-changed-57dd011e-4f3b-44bd-a8e1-e17a515e29e2. {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 10:33:37 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-67d9e0ad-a43b-4388-b66f-ca634e14bf4b req-17853d19-d53f-4af4-9c88-64e02f0edac2 service nova] Acquiring lock "refresh_cache-ac3f3bc9-f5e2-4dc8-bf62-3649611da824" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:33:37 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-67d9e0ad-a43b-4388-b66f-ca634e14bf4b req-17853d19-d53f-4af4-9c88-64e02f0edac2 service nova] Acquired lock "refresh_cache-ac3f3bc9-f5e2-4dc8-bf62-3649611da824" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:33:37 user nova-compute[85141]: DEBUG nova.network.neutron [req-67d9e0ad-a43b-4388-b66f-ca634e14bf4b req-17853d19-d53f-4af4-9c88-64e02f0edac2 service nova] [instance: ac3f3bc9-f5e2-4dc8-bf62-3649611da824] Refreshing network info cache for port 57dd011e-4f3b-44bd-a8e1-e17a515e29e2 {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 10:33:37 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:33:37 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Starting heal instance info cache {{(pid=85141) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 10:33:37 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Acquiring lock "refresh_cache-da42de06-4518-4c8a-8c63-9b5a2759a1bf" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:33:37 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Acquired lock "refresh_cache-da42de06-4518-4c8a-8c63-9b5a2759a1bf" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:33:37 user nova-compute[85141]: DEBUG nova.network.neutron [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] [instance: da42de06-4518-4c8a-8c63-9b5a2759a1bf] Forcefully refreshing network info cache for instance {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 10:33:37 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:33:38 user nova-compute[85141]: DEBUG nova.network.neutron [req-67d9e0ad-a43b-4388-b66f-ca634e14bf4b req-17853d19-d53f-4af4-9c88-64e02f0edac2 service nova] [instance: ac3f3bc9-f5e2-4dc8-bf62-3649611da824] Updated VIF entry in instance network info cache for port 57dd011e-4f3b-44bd-a8e1-e17a515e29e2. {{(pid=85141) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 10:33:38 user nova-compute[85141]: DEBUG nova.network.neutron [req-67d9e0ad-a43b-4388-b66f-ca634e14bf4b req-17853d19-d53f-4af4-9c88-64e02f0edac2 service nova] [instance: ac3f3bc9-f5e2-4dc8-bf62-3649611da824] Updating instance_info_cache with network_info: [{"id": "57dd011e-4f3b-44bd-a8e1-e17a515e29e2", "address": "fa:16:3e:28:e8:42", "network": {"id": "ef4876c8-a963-4474-894f-71371d1313da", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-459369775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7439b97798684ddfb5c98026abe079d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57dd011e-4f", "ovs_interfaceid": "57dd011e-4f3b-44bd-a8e1-e17a515e29e2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:33:38 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-67d9e0ad-a43b-4388-b66f-ca634e14bf4b req-17853d19-d53f-4af4-9c88-64e02f0edac2 service nova] Releasing lock "refresh_cache-ac3f3bc9-f5e2-4dc8-bf62-3649611da824" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:33:38 user nova-compute[85141]: DEBUG nova.network.neutron [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] [instance: da42de06-4518-4c8a-8c63-9b5a2759a1bf] Updating instance_info_cache with network_info: [{"id": "82a8c393-e062-47b9-a531-a6823f7d00a6", "address": "fa:16:3e:e4:f2:a7", "network": {"id": "a8f7d218-f758-44d8-adb3-120a5f724f70", "bridge": "br-int", "label": "tempest-TestStampPattern-1966889964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fb187d45ec54e74a0721973235f98b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82a8c393-e0", "ovs_interfaceid": "82a8c393-e062-47b9-a531-a6823f7d00a6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:33:38 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Releasing lock "refresh_cache-da42de06-4518-4c8a-8c63-9b5a2759a1bf" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:33:38 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] [instance: da42de06-4518-4c8a-8c63-9b5a2759a1bf] Updated the network info_cache for instance {{(pid=85141) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 10:33:38 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:33:39 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:33:39 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=85141) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 10:33:40 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager.update_available_resource {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:33:40 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:33:40 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:33:40 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:33:40 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Auditing locally available compute resources for user (node: user) {{(pid=85141) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 10:33:40 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-236250e3-0919-4482-9dfe-86964c20227f tempest-TestServerVolumeAttachScenarioOldVersion-263106525 tempest-TestServerVolumeAttachScenarioOldVersion-263106525-project-member] Acquiring lock "ac3f3bc9-f5e2-4dc8-bf62-3649611da824" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:33:40 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-236250e3-0919-4482-9dfe-86964c20227f tempest-TestServerVolumeAttachScenarioOldVersion-263106525 tempest-TestServerVolumeAttachScenarioOldVersion-263106525-project-member] Lock "ac3f3bc9-f5e2-4dc8-bf62-3649611da824" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:33:40 user nova-compute[85141]: DEBUG nova.objects.instance [None req-236250e3-0919-4482-9dfe-86964c20227f tempest-TestServerVolumeAttachScenarioOldVersion-263106525 tempest-TestServerVolumeAttachScenarioOldVersion-263106525-project-member] Lazy-loading 'flavor' on Instance uuid ac3f3bc9-f5e2-4dc8-bf62-3649611da824 {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:33:40 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-236250e3-0919-4482-9dfe-86964c20227f tempest-TestServerVolumeAttachScenarioOldVersion-263106525 tempest-TestServerVolumeAttachScenarioOldVersion-263106525-project-member] Lock "ac3f3bc9-f5e2-4dc8-bf62-3649611da824" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.079s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:33:40 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f1b7a62-fdc2-4b8e-b9f8-61105c0fcb5c/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:33:40 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-236250e3-0919-4482-9dfe-86964c20227f tempest-TestServerVolumeAttachScenarioOldVersion-263106525 tempest-TestServerVolumeAttachScenarioOldVersion-263106525-project-member] Acquiring lock "ac3f3bc9-f5e2-4dc8-bf62-3649611da824" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:33:40 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-236250e3-0919-4482-9dfe-86964c20227f tempest-TestServerVolumeAttachScenarioOldVersion-263106525 tempest-TestServerVolumeAttachScenarioOldVersion-263106525-project-member] Lock "ac3f3bc9-f5e2-4dc8-bf62-3649611da824" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:33:40 user nova-compute[85141]: INFO nova.compute.manager [None req-236250e3-0919-4482-9dfe-86964c20227f tempest-TestServerVolumeAttachScenarioOldVersion-263106525 tempest-TestServerVolumeAttachScenarioOldVersion-263106525-project-member] [instance: ac3f3bc9-f5e2-4dc8-bf62-3649611da824] Attaching volume 0c5db83a-dcda-47de-9106-4e6336994778 to /dev/vdb
Nov 16 10:33:40 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f1b7a62-fdc2-4b8e-b9f8-61105c0fcb5c/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:33:40 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f1b7a62-fdc2-4b8e-b9f8-61105c0fcb5c/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:33:40 user nova-compute[85141]: DEBUG os_brick.utils [None req-236250e3-0919-4482-9dfe-86964c20227f tempest-TestServerVolumeAttachScenarioOldVersion-263106525 tempest-TestServerVolumeAttachScenarioOldVersion-263106525-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 10:33:40 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:33:40 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:33:40 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[d656a756-7ba6-4013-99d0-c5bc0f4d5129]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c7834de5c295\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:33:40 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:33:40 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:33:40 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[7af6b342-731d-4ab0-9149-9a8fc399aa2b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:33:40 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:33:40 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f1b7a62-fdc2-4b8e-b9f8-61105c0fcb5c/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:33:40 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=85141) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 10:33:40 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:33:40 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[18f273ba-6b7b-4b49-bf7a-fc39e28cd968]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:33:40 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f432d8f9-10c4-49e3-bf3b-6389f52e21ab/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:33:40 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[91f526e8-36ad-4ee4-9199-18166a3fc934]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:33:40 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-236250e3-0919-4482-9dfe-86964c20227f tempest-TestServerVolumeAttachScenarioOldVersion-263106525 tempest-TestServerVolumeAttachScenarioOldVersion-263106525-project-member] Running cmd (subprocess): nvme version {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:33:41 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-236250e3-0919-4482-9dfe-86964c20227f tempest-TestServerVolumeAttachScenarioOldVersion-263106525 tempest-TestServerVolumeAttachScenarioOldVersion-263106525-project-member] 'nvme version' failed. Not Retrying. {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 10:33:41 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.nvmeof [None req-236250e3-0919-4482-9dfe-86964c20227f tempest-TestServerVolumeAttachScenarioOldVersion-263106525 tempest-TestServerVolumeAttachScenarioOldVersion-263106525-project-member] nvme not present on system {{(pid=85141) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 10:33:41 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:33:41 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 10:33:41 user nova-compute[85141]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 10:33:41 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[740b6dd9-ed23-477f-a912-3d3e820ddc0a]: (4, '') {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:33:41 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.lightos [None req-236250e3-0919-4482-9dfe-86964c20227f tempest-TestServerVolumeAttachScenarioOldVersion-263106525 tempest-TestServerVolumeAttachScenarioOldVersion-263106525-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=85141) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 10:33:41 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.lightos [None req-236250e3-0919-4482-9dfe-86964c20227f tempest-TestServerVolumeAttachScenarioOldVersion-263106525 tempest-TestServerVolumeAttachScenarioOldVersion-263106525-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=85141) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 10:33:41 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.lightos [None req-236250e3-0919-4482-9dfe-86964c20227f tempest-TestServerVolumeAttachScenarioOldVersion-263106525 tempest-TestServerVolumeAttachScenarioOldVersion-263106525-project-member] LIGHTOS: no hostnqn found. {{(pid=85141) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 10:33:41 user nova-compute[85141]: DEBUG os_brick.utils [None req-236250e3-0919-4482-9dfe-86964c20227f tempest-TestServerVolumeAttachScenarioOldVersion-263106525 tempest-TestServerVolumeAttachScenarioOldVersion-263106525-project-member] <== get_connector_properties: return (171ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c7834de5c295', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 10:33:41 user nova-compute[85141]: DEBUG nova.virt.block_device [None req-236250e3-0919-4482-9dfe-86964c20227f tempest-TestServerVolumeAttachScenarioOldVersion-263106525 tempest-TestServerVolumeAttachScenarioOldVersion-263106525-project-member] [instance: ac3f3bc9-f5e2-4dc8-bf62-3649611da824] Updating existing volume attachment record: 878d3cb1-d678-4c6a-b53e-bbb150d459c8 {{(pid=85141) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 10:33:41 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f432d8f9-10c4-49e3-bf3b-6389f52e21ab/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:33:41 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f432d8f9-10c4-49e3-bf3b-6389f52e21ab/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:33:41 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f432d8f9-10c4-49e3-bf3b-6389f52e21ab/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:33:41 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da42de06-4518-4c8a-8c63-9b5a2759a1bf/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:33:41 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da42de06-4518-4c8a-8c63-9b5a2759a1bf/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:33:41 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da42de06-4518-4c8a-8c63-9b5a2759a1bf/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:33:41 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da42de06-4518-4c8a-8c63-9b5a2759a1bf/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:33:41 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac3f3bc9-f5e2-4dc8-bf62-3649611da824/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:33:42 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac3f3bc9-f5e2-4dc8-bf62-3649611da824/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:33:42 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac3f3bc9-f5e2-4dc8-bf62-3649611da824/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:33:42 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac3f3bc9-f5e2-4dc8-bf62-3649611da824/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:33:42 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:33:42 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:33:42 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:33:42 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Hypervisor/Node resource view: name=user free_ram=8086MB free_disk=24.953895568847656GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=85141) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 10:33:42 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:33:42 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:33:42 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance da42de06-4518-4c8a-8c63-9b5a2759a1bf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:33:42 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance f432d8f9-10c4-49e3-bf3b-6389f52e21ab actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:33:42 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance ac3f3bc9-f5e2-4dc8-bf62-3649611da824 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:33:42 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance 2f1b7a62-fdc2-4b8e-b9f8-61105c0fcb5c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:33:42 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance 6c284db0-2aa8-4680-ab40-7e9861f8449b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:33:42 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=85141) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 10:33:42 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=85141) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 10:33:43 user nova-compute[85141]: DEBUG nova.compute.provider_tree [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Inventory has not changed in ProviderTree for provider: bf8e0fa1-16b6-408f-9203-c4cd63916272 {{(pid=85141) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 10:33:43 user nova-compute[85141]: DEBUG nova.scheduler.client.report [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Inventory has not changed for provider bf8e0fa1-16b6-408f-9203-c4cd63916272 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=85141) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 10:33:43 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Compute_service record updated for user:user {{(pid=85141) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 10:33:43 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.364s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:33:43 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:33:44 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-6b360ff5-b9b5-47cd-99ff-4feb4f32a991 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance f432d8f9-10c4-49e3-bf3b-6389f52e21ab is timed out.
Nov 16 10:33:44 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-6b360ff5-b9b5-47cd-99ff-4feb4f32a991 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Successfully detached device vdb from instance f432d8f9-10c4-49e3-bf3b-6389f52e21ab from the live domain config.
Nov 16 10:33:44 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b360ff5-b9b5-47cd-99ff-4feb4f32a991 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] [instance: f432d8f9-10c4-49e3-bf3b-6389f52e21ab] calling os-brick to detach iSCSI Volume {{(pid=85141) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 10:33:44 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b360ff5-b9b5-47cd-99ff-4feb4f32a991 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51806b6080>, {'target_iqn': 'iqn.2010-10.org.openstack:ca6daac8-c9e0-4fdf-903f-1fcd2f9bc544', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mMWCPzrx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 10:33:44 user nova-compute[85141]: WARNING os_brick.initiator.connectors.base [None req-6b360ff5-b9b5-47cd-99ff-4feb4f32a991 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 10:33:44 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-6b360ff5-b9b5-47cd-99ff-4feb4f32a991 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 10:33:44 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-6b360ff5-b9b5-47cd-99ff-4feb4f32a991 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 10:33:44 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:33:44 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:33:44 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:33:44 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:33:44 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:33:44 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d4cd29d-cb08-4892-9a77-d78e2a508e25]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:584dd8df-f6a2-4e35-be7e-8de1e759491b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1c7a1bfd-d26c-4607-8843-cddcfef164d3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5b5c1ec2-adc4-4b62-a8ed-c38dd97bbbaf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ca6daac8-c9e0-4fdf-903f-1fcd2f9bc544\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:33:44 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b360ff5-b9b5-47cd-99ff-4feb4f32a991 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 10:33:44 user nova-compute[85141]: No targets found.
Nov 16 10:33:44 user nova-compute[85141]: iSNS:
Nov 16 10:33:44 user nova-compute[85141]: No targets found.
Nov 16 10:33:44 user nova-compute[85141]: STATIC:
Nov 16 10:33:44 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:584dd8df-f6a2-4e35-be7e-8de1e759491b
Nov 16 10:33:44 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:33:44 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:33:44 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:1c7a1bfd-d26c-4607-8843-cddcfef164d3
Nov 16 10:33:44 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:33:44 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:33:44 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:5b5c1ec2-adc4-4b62-a8ed-c38dd97bbbaf
Nov 16 10:33:44 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:33:44 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:33:44 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:ca6daac8-c9e0-4fdf-903f-1fcd2f9bc544
Nov 16 10:33:44 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:33:44 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:33:44 user nova-compute[85141]: FIRMWARE:
Nov 16 10:33:44 user nova-compute[85141]: No targets found.
Nov 16 10:33:44 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:33:44 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b360ff5-b9b5-47cd-99ff-4feb4f32a991 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 10:33:44 user nova-compute[85141]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 10:33:44 user nova-compute[85141]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=85141) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 10:33:44 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b360ff5-b9b5-47cd-99ff-4feb4f32a991 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ca6daac8-c9e0-4fdf-903f-1fcd2f9bc544', 0)] {{(pid=85141) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 10:33:44 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:33:44 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:33:44 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7c5386f-3e28-46f7-96ed-ffb7b3f0fcb9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1c7a1bfd-d26c-4607-8843-cddcfef164d3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:584dd8df-f6a2-4e35-be7e-8de1e759491b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5b5c1ec2-adc4-4b62-a8ed-c38dd97bbbaf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ca6daac8-c9e0-4fdf-903f-1fcd2f9bc544\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:33:44 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:33:44 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:33:44 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eda458d-736e-41d2-8fd7-d4965ac0b785]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca6daac8-c9e0-4fdf-903f-1fcd2f9bc544 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:584dd8df-f6a2-4e35-be7e-8de1e759491b (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b5c1ec2-adc4-4b62-a8ed-c38dd97bbbaf (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c7a1bfd-d26c-4607-8843-cddcfef164d3 (non-flash)\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:33:44 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b360ff5-b9b5-47cd-99ff-4feb4f32a991 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca6daac8-c9e0-4fdf-903f-1fcd2f9bc544 (non-flash)
Nov 16 10:33:44 user nova-compute[85141]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:584dd8df-f6a2-4e35-be7e-8de1e759491b (non-flash)
Nov 16 10:33:44 user nova-compute[85141]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b5c1ec2-adc4-4b62-a8ed-c38dd97bbbaf (non-flash)
Nov 16 10:33:44 user nova-compute[85141]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c7a1bfd-d26c-4607-8843-cddcfef164d3 (non-flash)
Nov 16 10:33:44 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:33:44 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b360ff5-b9b5-47cd-99ff-4feb4f32a991 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca6daac8-c9e0-4fdf-903f-1fcd2f9bc544 (non-flash)
Nov 16 10:33:44 user nova-compute[85141]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:584dd8df-f6a2-4e35-be7e-8de1e759491b (non-flash)
Nov 16 10:33:44 user nova-compute[85141]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b5c1ec2-adc4-4b62-a8ed-c38dd97bbbaf (non-flash)
Nov 16 10:33:44 user nova-compute[85141]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c7a1bfd-d26c-4607-8843-cddcfef164d3 (non-flash)
Nov 16 10:33:44 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 10:33:44 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b360ff5-b9b5-47cd-99ff-4feb4f32a991 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f51805f3a30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ca6daac8-c9e0-4fdf-903f-1fcd2f9bc544'): ({'sdb'}, set())}) {{(pid=85141) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 10:33:44 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-6b360ff5-b9b5-47cd-99ff-4feb4f32a991 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Removing single pathed devices sdb {{(pid=85141) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 10:33:44 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:33:44 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.034s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:33:44 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[325d0607-4b9e-49ba-bf28-ffaa6d75170a]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:33:44 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:33:44 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.024s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:33:44 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2408826-900f-4de9-8820-dd1480db5789]: (4, ('ok\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:33:44 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-6b360ff5-b9b5-47cd-99ff-4feb4f32a991 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Flushing IO for device /dev/sdb {{(pid=85141) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 10:33:44 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:33:44 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:33:44 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cd89a00-be5f-4562-b957-aa9763df21e1]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:33:44 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-6b360ff5-b9b5-47cd-99ff-4feb4f32a991 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=85141) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 10:33:44 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:33:44 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.068s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:33:44 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[3459f4ce-ca0c-48d9-b07c-9108bf24a74c]: (4, ('1', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:33:44 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-6b360ff5-b9b5-47cd-99ff-4feb4f32a991 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=85141) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 10:33:44 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-6b360ff5-b9b5-47cd-99ff-4feb4f32a991 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] SCSI volumes sdb have been removed. {{(pid=85141) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 10:33:44 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b360ff5-b9b5-47cd-99ff-4feb4f32a991 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ca6daac8-c9e0-4fdf-903f-1fcd2f9bc544')] {{(pid=85141) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 10:33:44 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca6daac8-c9e0-4fdf-903f-1fcd2f9bc544 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:33:44 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:33:44 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca6daac8-c9e0-4fdf-903f-1fcd2f9bc544 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:33:44 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b7db268-0144-4a24-9c85-d2ad53b5378d]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:33:44 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b360ff5-b9b5-47cd-99ff-4feb4f32a991 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:33:44 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca6daac8-c9e0-4fdf-903f-1fcd2f9bc544 -p 172.16.0.220:3260 --logout {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:33:44 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca6daac8-c9e0-4fdf-903f-1fcd2f9bc544 -p 172.16.0.220:3260 --logout" returned: 0 in 0.077s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:33:44 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[4facfcce-d345-4f3f-8494-39de8305b9ce]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:ca6daac8-c9e0-4fdf-903f-1fcd2f9bc544, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:ca6daac8-c9e0-4fdf-903f-1fcd2f9bc544, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:33:44 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b360ff5-b9b5-47cd-99ff-4feb4f32a991 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:ca6daac8-c9e0-4fdf-903f-1fcd2f9bc544, portal: 172.16.0.220,3260]
Nov 16 10:33:44 user nova-compute[85141]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:ca6daac8-c9e0-4fdf-903f-1fcd2f9bc544, portal: 172.16.0.220,3260] successful.
Nov 16 10:33:44 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:33:44 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca6daac8-c9e0-4fdf-903f-1fcd2f9bc544 -p 172.16.0.220:3260 --op delete {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:33:44 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca6daac8-c9e0-4fdf-903f-1fcd2f9bc544 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:33:44 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6feaeac-f88e-4a4c-8f9a-2ae6ac1e6c0e]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:33:44 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b360ff5-b9b5-47cd-99ff-4feb4f32a991 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:33:44 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-6b360ff5-b9b5-47cd-99ff-4feb4f32a991 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.386s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 10:33:44 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b360ff5-b9b5-47cd-99ff-4feb4f32a991 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] <== disconnect_volume: return (387ms) None {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 10:33:44 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b360ff5-b9b5-47cd-99ff-4feb4f32a991 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] [instance: f432d8f9-10c4-49e3-bf3b-6389f52e21ab] Disconnected iSCSI Volume {{(pid=85141) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 10:33:45 user nova-compute[85141]: DEBUG nova.objects.instance [None req-6b360ff5-b9b5-47cd-99ff-4feb4f32a991 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Lazy-loading 'flavor' on Instance uuid f432d8f9-10c4-49e3-bf3b-6389f52e21ab {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:33:45 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-6b360ff5-b9b5-47cd-99ff-4feb4f32a991 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Lock "f432d8f9-10c4-49e3-bf3b-6389f52e21ab" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.983s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:33:46 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-236250e3-0919-4482-9dfe-86964c20227f tempest-TestServerVolumeAttachScenarioOldVersion-263106525 tempest-TestServerVolumeAttachScenarioOldVersion-263106525-project-member] [instance: ac3f3bc9-f5e2-4dc8-bf62-3649611da824] Calling os-brick to attach iSCSI Volume {{(pid=85141) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 10:33:46 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-236250e3-0919-4482-9dfe-86964c20227f tempest-TestServerVolumeAttachScenarioOldVersion-263106525 tempest-TestServerVolumeAttachScenarioOldVersion-263106525-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51806b6080>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0c5db83a-dcda-47de-9106-4e6336994778', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pYtVBKWl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 10:33:46 user nova-compute[85141]: WARNING os_brick.initiator.connectors.base [None req-236250e3-0919-4482-9dfe-86964c20227f tempest-TestServerVolumeAttachScenarioOldVersion-263106525 tempest-TestServerVolumeAttachScenarioOldVersion-263106525-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 10:33:46 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-236250e3-0919-4482-9dfe-86964c20227f tempest-TestServerVolumeAttachScenarioOldVersion-263106525 tempest-TestServerVolumeAttachScenarioOldVersion-263106525-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 10:33:46 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-236250e3-0919-4482-9dfe-86964c20227f tempest-TestServerVolumeAttachScenarioOldVersion-263106525 tempest-TestServerVolumeAttachScenarioOldVersion-263106525-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 10:33:46 user nova-compute[85141]: WARNING os_brick.initiator.connectors.base [None req-236250e3-0919-4482-9dfe-86964c20227f tempest-TestServerVolumeAttachScenarioOldVersion-263106525 tempest-TestServerVolumeAttachScenarioOldVersion-263106525-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 10:33:46 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-236250e3-0919-4482-9dfe-86964c20227f tempest-TestServerVolumeAttachScenarioOldVersion-263106525 tempest-TestServerVolumeAttachScenarioOldVersion-263106525-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0c5db83a-dcda-47de-9106-4e6336994778" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 10:33:46 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-236250e3-0919-4482-9dfe-86964c20227f tempest-TestServerVolumeAttachScenarioOldVersion-263106525 tempest-TestServerVolumeAttachScenarioOldVersion-263106525-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0c5db83a-dcda-47de-9106-4e6336994778" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 10:33:46 user nova-compute[85141]: INFO os_brick.initiator.connectors.iscsi [None req-236250e3-0919-4482-9dfe-86964c20227f tempest-TestServerVolumeAttachScenarioOldVersion-263106525 tempest-TestServerVolumeAttachScenarioOldVersion-263106525-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 10:33:46 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c5db83a-dcda-47de-9106-4e6336994778 -p 172.16.0.220:3260 {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:33:46 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c5db83a-dcda-47de-9106-4e6336994778 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:33:46 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[818bc9a7-ac45-42c6-9cc7-38b385e23ed6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:33:46 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-236250e3-0919-4482-9dfe-86964c20227f tempest-TestServerVolumeAttachScenarioOldVersion-263106525 tempest-TestServerVolumeAttachScenarioOldVersion-263106525-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 10:33:46 user nova-compute[85141]:  {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:33:46 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c5db83a-dcda-47de-9106-4e6336994778 -p 172.16.0.220:3260 --interface default --op new {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:33:46 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c5db83a-dcda-47de-9106-4e6336994778 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:33:46 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[16eff9dc-0a3c-4f95-a841-cb2c3f59c511]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0c5db83a-dcda-47de-9106-4e6336994778] added\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:33:46 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-236250e3-0919-4482-9dfe-86964c20227f tempest-TestServerVolumeAttachScenarioOldVersion-263106525 tempest-TestServerVolumeAttachScenarioOldVersion-263106525-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0c5db83a-dcda-47de-9106-4e6336994778] added
Nov 16 10:33:46 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:33:46 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c5db83a-dcda-47de-9106-4e6336994778 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:33:46 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c5db83a-dcda-47de-9106-4e6336994778 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:33:46 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[882f7829-50ec-4389-8eb4-941337e75eed]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:33:46 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-236250e3-0919-4482-9dfe-86964c20227f tempest-TestServerVolumeAttachScenarioOldVersion-263106525 tempest-TestServerVolumeAttachScenarioOldVersion-263106525-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:33:46 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c5db83a-dcda-47de-9106-4e6336994778 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:33:46 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c5db83a-dcda-47de-9106-4e6336994778 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.034s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:33:46 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[45db8b98-835b-4f80-ab4f-e34e06193dfe]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:33:46 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-236250e3-0919-4482-9dfe-86964c20227f tempest-TestServerVolumeAttachScenarioOldVersion-263106525 tempest-TestServerVolumeAttachScenarioOldVersion-263106525-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:33:47 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c5db83a-dcda-47de-9106-4e6336994778 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pYtVBKWl {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:33:47 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c5db83a-dcda-47de-9106-4e6336994778 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pYtVBKWl" returned: 0 in 0.020s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:33:47 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[23e70592-b798-424b-b7c0-2dfb48832848]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:33:47 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-236250e3-0919-4482-9dfe-86964c20227f tempest-TestServerVolumeAttachScenarioOldVersion-263106525 tempest-TestServerVolumeAttachScenarioOldVersion-263106525-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pYtVBKWl'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:33:47 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c5db83a-dcda-47de-9106-4e6336994778 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:33:47 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c5db83a-dcda-47de-9106-4e6336994778 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:33:47 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[ede74ea8-0313-44e5-913a-a6a92077fb59]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:33:47 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-236250e3-0919-4482-9dfe-86964c20227f tempest-TestServerVolumeAttachScenarioOldVersion-263106525 tempest-TestServerVolumeAttachScenarioOldVersion-263106525-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:33:47 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:33:47 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:33:47 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[91156d59-90e5-4267-9c38-252e06c691b6]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:584dd8df-f6a2-4e35-be7e-8de1e759491b (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b5c1ec2-adc4-4b62-a8ed-c38dd97bbbaf (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c7a1bfd-d26c-4607-8843-cddcfef164d3 (non-flash)\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:33:47 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-236250e3-0919-4482-9dfe-86964c20227f tempest-TestServerVolumeAttachScenarioOldVersion-263106525 tempest-TestServerVolumeAttachScenarioOldVersion-263106525-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:584dd8df-f6a2-4e35-be7e-8de1e759491b (non-flash)
Nov 16 10:33:47 user nova-compute[85141]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b5c1ec2-adc4-4b62-a8ed-c38dd97bbbaf (non-flash)
Nov 16 10:33:47 user nova-compute[85141]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c7a1bfd-d26c-4607-8843-cddcfef164d3 (non-flash)
Nov 16 10:33:47 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:33:47 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-236250e3-0919-4482-9dfe-86964c20227f tempest-TestServerVolumeAttachScenarioOldVersion-263106525 tempest-TestServerVolumeAttachScenarioOldVersion-263106525-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:584dd8df-f6a2-4e35-be7e-8de1e759491b (non-flash)
Nov 16 10:33:47 user nova-compute[85141]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b5c1ec2-adc4-4b62-a8ed-c38dd97bbbaf (non-flash)
Nov 16 10:33:47 user nova-compute[85141]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c7a1bfd-d26c-4607-8843-cddcfef164d3 (non-flash)
Nov 16 10:33:47 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 10:33:47 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c5db83a-dcda-47de-9106-4e6336994778 -p 172.16.0.220:3260 --login {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:33:47 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c5db83a-dcda-47de-9106-4e6336994778 -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:33:47 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3f86a9d-6c1a-4888-8a27-f1cd7bb3bcbd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0c5db83a-dcda-47de-9106-4e6336994778, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0c5db83a-dcda-47de-9106-4e6336994778, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:33:47 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-236250e3-0919-4482-9dfe-86964c20227f tempest-TestServerVolumeAttachScenarioOldVersion-263106525 tempest-TestServerVolumeAttachScenarioOldVersion-263106525-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0c5db83a-dcda-47de-9106-4e6336994778, portal: 172.16.0.220,3260]
Nov 16 10:33:47 user nova-compute[85141]: Login to [iface: default, target: iqn.2010-10.org.openstack:0c5db83a-dcda-47de-9106-4e6336994778, portal: 172.16.0.220,3260] successful.
Nov 16 10:33:47 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:33:47 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c5db83a-dcda-47de-9106-4e6336994778 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:33:47 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c5db83a-dcda-47de-9106-4e6336994778 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:33:47 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[99f6d71c-cb1d-48c3-9afd-df6beec2f191]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:33:47 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-236250e3-0919-4482-9dfe-86964c20227f tempest-TestServerVolumeAttachScenarioOldVersion-263106525 tempest-TestServerVolumeAttachScenarioOldVersion-263106525-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:33:47 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:33:47 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:33:47 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[33e0d75a-c00e-4ef8-bc9f-c52a50e5136e]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:584dd8df-f6a2-4e35-be7e-8de1e759491b (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b5c1ec2-adc4-4b62-a8ed-c38dd97bbbaf (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c7a1bfd-d26c-4607-8843-cddcfef164d3 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c5db83a-dcda-47de-9106-4e6336994778 (non-flash)\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:33:47 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-236250e3-0919-4482-9dfe-86964c20227f tempest-TestServerVolumeAttachScenarioOldVersion-263106525 tempest-TestServerVolumeAttachScenarioOldVersion-263106525-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:584dd8df-f6a2-4e35-be7e-8de1e759491b (non-flash)
Nov 16 10:33:47 user nova-compute[85141]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b5c1ec2-adc4-4b62-a8ed-c38dd97bbbaf (non-flash)
Nov 16 10:33:47 user nova-compute[85141]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c7a1bfd-d26c-4607-8843-cddcfef164d3 (non-flash)
Nov 16 10:33:47 user nova-compute[85141]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c5db83a-dcda-47de-9106-4e6336994778 (non-flash)
Nov 16 10:33:47 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:33:47 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-236250e3-0919-4482-9dfe-86964c20227f tempest-TestServerVolumeAttachScenarioOldVersion-263106525 tempest-TestServerVolumeAttachScenarioOldVersion-263106525-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:584dd8df-f6a2-4e35-be7e-8de1e759491b (non-flash)
Nov 16 10:33:47 user nova-compute[85141]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b5c1ec2-adc4-4b62-a8ed-c38dd97bbbaf (non-flash)
Nov 16 10:33:47 user nova-compute[85141]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c7a1bfd-d26c-4607-8843-cddcfef164d3 (non-flash)
Nov 16 10:33:47 user nova-compute[85141]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c5db83a-dcda-47de-9106-4e6336994778 (non-flash)
Nov 16 10:33:47 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 10:33:47 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-236250e3-0919-4482-9dfe-86964c20227f tempest-TestServerVolumeAttachScenarioOldVersion-263106525 tempest-TestServerVolumeAttachScenarioOldVersion-263106525-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0c5db83a-dcda-47de-9106-4e6336994778" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.341s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 10:33:47 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-236250e3-0919-4482-9dfe-86964c20227f tempest-TestServerVolumeAttachScenarioOldVersion-263106525 tempest-TestServerVolumeAttachScenarioOldVersion-263106525-project-member] Connected to 172.16.0.220:3260 {{(pid=85141) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 10:33:47 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-236250e3-0919-4482-9dfe-86964c20227f tempest-TestServerVolumeAttachScenarioOldVersion-263106525 tempest-TestServerVolumeAttachScenarioOldVersion-263106525-project-member] HCTL ('33', '-', '-', 0) found on session 53 with lun 0 {{(pid=85141) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 10:33:47 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-236250e3-0919-4482-9dfe-86964c20227f tempest-TestServerVolumeAttachScenarioOldVersion-263106525 tempest-TestServerVolumeAttachScenarioOldVersion-263106525-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=85141) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 10:33:47 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:33:47 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:33:47 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cb2a38f-6ee1-4678-89be-20286f896e79]: (4, ('- - 0', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:33:47 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-236250e3-0919-4482-9dfe-86964c20227f tempest-TestServerVolumeAttachScenarioOldVersion-263106525 tempest-TestServerVolumeAttachScenarioOldVersion-263106525-project-member] Searching for a device in session 53 and hctl ['33', '*', '*', 0] yield: None {{(pid=85141) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 10:33:47 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:33:47 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:33:48 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-236250e3-0919-4482-9dfe-86964c20227f tempest-TestServerVolumeAttachScenarioOldVersion-263106525 tempest-TestServerVolumeAttachScenarioOldVersion-263106525-project-member] Searching for a device in session 53 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=85141) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 10:33:48 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-236250e3-0919-4482-9dfe-86964c20227f tempest-TestServerVolumeAttachScenarioOldVersion-263106525 tempest-TestServerVolumeAttachScenarioOldVersion-263106525-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:0c5db83a-dcda-47de-9106-4e6336994778', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pYtVBKWl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=85141) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 10:33:48 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-236250e3-0919-4482-9dfe-86964c20227f tempest-TestServerVolumeAttachScenarioOldVersion-263106525 tempest-TestServerVolumeAttachScenarioOldVersion-263106525-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.377s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 10:33:48 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-236250e3-0919-4482-9dfe-86964c20227f tempest-TestServerVolumeAttachScenarioOldVersion-263106525 tempest-TestServerVolumeAttachScenarioOldVersion-263106525-project-member] <== connect_volume: return (1378ms) {'type': 'block', 'scsi_wwn': '23164353738323763', 'path': '/dev/sdb'} {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 10:33:48 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-236250e3-0919-4482-9dfe-86964c20227f tempest-TestServerVolumeAttachScenarioOldVersion-263106525 tempest-TestServerVolumeAttachScenarioOldVersion-263106525-project-member] [instance: ac3f3bc9-f5e2-4dc8-bf62-3649611da824] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23164353738323763', 'path': '/dev/sdb'} {{(pid=85141) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 10:33:48 user nova-compute[85141]: DEBUG nova.objects.instance [None req-236250e3-0919-4482-9dfe-86964c20227f tempest-TestServerVolumeAttachScenarioOldVersion-263106525 tempest-TestServerVolumeAttachScenarioOldVersion-263106525-project-member] Lazy-loading 'flavor' on Instance uuid ac3f3bc9-f5e2-4dc8-bf62-3649611da824 {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:33:48 user nova-compute[85141]: DEBUG nova.virt.libvirt.guest [None req-236250e3-0919-4482-9dfe-86964c20227f tempest-TestServerVolumeAttachScenarioOldVersion-263106525 tempest-TestServerVolumeAttachScenarioOldVersion-263106525-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 10:33:48 user nova-compute[85141]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 10:33:48 user nova-compute[85141]:   <source dev="/dev/sdb"/>
Nov 16 10:33:48 user nova-compute[85141]:   <target dev="vdb" bus="virtio"/>
Nov 16 10:33:48 user nova-compute[85141]:   <serial>0c5db83a-dcda-47de-9106-4e6336994778</serial>
Nov 16 10:33:48 user nova-compute[85141]: </disk>
Nov 16 10:33:48 user nova-compute[85141]:  {{(pid=85141) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 10:33:48 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:33:48 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-236250e3-0919-4482-9dfe-86964c20227f tempest-TestServerVolumeAttachScenarioOldVersion-263106525 tempest-TestServerVolumeAttachScenarioOldVersion-263106525-project-member] No BDM found with device name vda, not building metadata. {{(pid=85141) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 10:33:48 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-236250e3-0919-4482-9dfe-86964c20227f tempest-TestServerVolumeAttachScenarioOldVersion-263106525 tempest-TestServerVolumeAttachScenarioOldVersion-263106525-project-member] No BDM found with device name vdb, not building metadata. {{(pid=85141) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 10:33:48 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-236250e3-0919-4482-9dfe-86964c20227f tempest-TestServerVolumeAttachScenarioOldVersion-263106525 tempest-TestServerVolumeAttachScenarioOldVersion-263106525-project-member] No VIF found with MAC fa:16:3e:28:e8:42, not building metadata {{(pid=85141) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 10:33:48 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-236250e3-0919-4482-9dfe-86964c20227f tempest-TestServerVolumeAttachScenarioOldVersion-263106525 tempest-TestServerVolumeAttachScenarioOldVersion-263106525-project-member] Lock "ac3f3bc9-f5e2-4dc8-bf62-3649611da824" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.205s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:33:49 user nova-compute[85141]: DEBUG nova.compute.manager [req-fb31dfb9-432e-44a4-a68f-29c10313abe2 req-539e21bc-9dad-427b-b39b-a7a285561825 service nova] [instance: 2f1b7a62-fdc2-4b8e-b9f8-61105c0fcb5c] Received event network-changed-3c3baa93-b4c3-4cf5-b363-aab7e937312b {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:33:49 user nova-compute[85141]: DEBUG nova.compute.manager [req-fb31dfb9-432e-44a4-a68f-29c10313abe2 req-539e21bc-9dad-427b-b39b-a7a285561825 service nova] [instance: 2f1b7a62-fdc2-4b8e-b9f8-61105c0fcb5c] Refreshing instance network info cache due to event network-changed-3c3baa93-b4c3-4cf5-b363-aab7e937312b. {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 10:33:49 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-fb31dfb9-432e-44a4-a68f-29c10313abe2 req-539e21bc-9dad-427b-b39b-a7a285561825 service nova] Acquiring lock "refresh_cache-2f1b7a62-fdc2-4b8e-b9f8-61105c0fcb5c" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:33:49 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-fb31dfb9-432e-44a4-a68f-29c10313abe2 req-539e21bc-9dad-427b-b39b-a7a285561825 service nova] Acquired lock "refresh_cache-2f1b7a62-fdc2-4b8e-b9f8-61105c0fcb5c" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:33:49 user nova-compute[85141]: DEBUG nova.network.neutron [req-fb31dfb9-432e-44a4-a68f-29c10313abe2 req-539e21bc-9dad-427b-b39b-a7a285561825 service nova] [instance: 2f1b7a62-fdc2-4b8e-b9f8-61105c0fcb5c] Refreshing network info cache for port 3c3baa93-b4c3-4cf5-b363-aab7e937312b {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 10:33:50 user nova-compute[85141]: DEBUG nova.network.neutron [req-fb31dfb9-432e-44a4-a68f-29c10313abe2 req-539e21bc-9dad-427b-b39b-a7a285561825 service nova] [instance: 2f1b7a62-fdc2-4b8e-b9f8-61105c0fcb5c] Updated VIF entry in instance network info cache for port 3c3baa93-b4c3-4cf5-b363-aab7e937312b. {{(pid=85141) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 10:33:50 user nova-compute[85141]: DEBUG nova.network.neutron [req-fb31dfb9-432e-44a4-a68f-29c10313abe2 req-539e21bc-9dad-427b-b39b-a7a285561825 service nova] [instance: 2f1b7a62-fdc2-4b8e-b9f8-61105c0fcb5c] Updating instance_info_cache with network_info: [{"id": "3c3baa93-b4c3-4cf5-b363-aab7e937312b", "address": "fa:16:3e:d1:c8:21", "network": {"id": "8931cd8f-3c0b-4d49-ae98-48f818e854e7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1902653571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d13c6ff3c30549ca9ab44d9fc1fedc6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c3baa93-b4", "ovs_interfaceid": "3c3baa93-b4c3-4cf5-b363-aab7e937312b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:33:50 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-fb31dfb9-432e-44a4-a68f-29c10313abe2 req-539e21bc-9dad-427b-b39b-a7a285561825 service nova] Releasing lock "refresh_cache-2f1b7a62-fdc2-4b8e-b9f8-61105c0fcb5c" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:33:50 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-ef6cf334-0109-4bc0-ab1d-10ea0fb96f28 tempest-TestServerVolumeAttachScenarioOldVersion-263106525 tempest-TestServerVolumeAttachScenarioOldVersion-263106525-project-member] Acquiring lock "ac3f3bc9-f5e2-4dc8-bf62-3649611da824" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:33:50 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-ef6cf334-0109-4bc0-ab1d-10ea0fb96f28 tempest-TestServerVolumeAttachScenarioOldVersion-263106525 tempest-TestServerVolumeAttachScenarioOldVersion-263106525-project-member] Lock "ac3f3bc9-f5e2-4dc8-bf62-3649611da824" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:33:50 user nova-compute[85141]: INFO nova.compute.manager [None req-ef6cf334-0109-4bc0-ab1d-10ea0fb96f28 tempest-TestServerVolumeAttachScenarioOldVersion-263106525 tempest-TestServerVolumeAttachScenarioOldVersion-263106525-project-member] [instance: ac3f3bc9-f5e2-4dc8-bf62-3649611da824] Detaching volume 0c5db83a-dcda-47de-9106-4e6336994778
Nov 16 10:33:50 user nova-compute[85141]: INFO nova.virt.block_device [None req-ef6cf334-0109-4bc0-ab1d-10ea0fb96f28 tempest-TestServerVolumeAttachScenarioOldVersion-263106525 tempest-TestServerVolumeAttachScenarioOldVersion-263106525-project-member] [instance: ac3f3bc9-f5e2-4dc8-bf62-3649611da824] Attempting to driver detach volume 0c5db83a-dcda-47de-9106-4e6336994778 from mountpoint /dev/vdb
Nov 16 10:33:50 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-ef6cf334-0109-4bc0-ab1d-10ea0fb96f28 tempest-TestServerVolumeAttachScenarioOldVersion-263106525 tempest-TestServerVolumeAttachScenarioOldVersion-263106525-project-member] Attempting to detach device vdb from instance ac3f3bc9-f5e2-4dc8-bf62-3649611da824 from the persistent domain config. {{(pid=85141) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 10:33:50 user nova-compute[85141]: DEBUG nova.virt.libvirt.guest [None req-ef6cf334-0109-4bc0-ab1d-10ea0fb96f28 tempest-TestServerVolumeAttachScenarioOldVersion-263106525 tempest-TestServerVolumeAttachScenarioOldVersion-263106525-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 10:33:50 user nova-compute[85141]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 10:33:50 user nova-compute[85141]:   <source dev="/dev/sdb"/>
Nov 16 10:33:50 user nova-compute[85141]:   <target dev="vdb" bus="virtio"/>
Nov 16 10:33:50 user nova-compute[85141]:   <serial>0c5db83a-dcda-47de-9106-4e6336994778</serial>
Nov 16 10:33:50 user nova-compute[85141]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 10:33:50 user nova-compute[85141]: </disk>
Nov 16 10:33:50 user nova-compute[85141]:  {{(pid=85141) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 10:33:50 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-ef6cf334-0109-4bc0-ab1d-10ea0fb96f28 tempest-TestServerVolumeAttachScenarioOldVersion-263106525 tempest-TestServerVolumeAttachScenarioOldVersion-263106525-project-member] Successfully detached device vdb from instance ac3f3bc9-f5e2-4dc8-bf62-3649611da824 from the persistent domain config.
Nov 16 10:33:50 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-ef6cf334-0109-4bc0-ab1d-10ea0fb96f28 tempest-TestServerVolumeAttachScenarioOldVersion-263106525 tempest-TestServerVolumeAttachScenarioOldVersion-263106525-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ac3f3bc9-f5e2-4dc8-bf62-3649611da824 from the live domain config. {{(pid=85141) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 10:33:50 user nova-compute[85141]: DEBUG nova.virt.libvirt.guest [None req-ef6cf334-0109-4bc0-ab1d-10ea0fb96f28 tempest-TestServerVolumeAttachScenarioOldVersion-263106525 tempest-TestServerVolumeAttachScenarioOldVersion-263106525-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 10:33:50 user nova-compute[85141]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 10:33:50 user nova-compute[85141]:   <source dev="/dev/sdb"/>
Nov 16 10:33:50 user nova-compute[85141]:   <target dev="vdb" bus="virtio"/>
Nov 16 10:33:50 user nova-compute[85141]:   <serial>0c5db83a-dcda-47de-9106-4e6336994778</serial>
Nov 16 10:33:50 user nova-compute[85141]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 10:33:50 user nova-compute[85141]: </disk>
Nov 16 10:33:50 user nova-compute[85141]:  {{(pid=85141) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 10:33:51 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-ef6cf334-0109-4bc0-ab1d-10ea0fb96f28 tempest-TestServerVolumeAttachScenarioOldVersion-263106525 tempest-TestServerVolumeAttachScenarioOldVersion-263106525-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ac3f3bc9-f5e2-4dc8-bf62-3649611da824 {{(pid=85141) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 10:33:52 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-6350c989-60d3-4cf1-8bf8-0326ebf02280 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Acquiring lock "2f1b7a62-fdc2-4b8e-b9f8-61105c0fcb5c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:33:52 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-6350c989-60d3-4cf1-8bf8-0326ebf02280 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Lock "2f1b7a62-fdc2-4b8e-b9f8-61105c0fcb5c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:33:52 user nova-compute[85141]: DEBUG nova.objects.instance [None req-6350c989-60d3-4cf1-8bf8-0326ebf02280 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Lazy-loading 'flavor' on Instance uuid 2f1b7a62-fdc2-4b8e-b9f8-61105c0fcb5c {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:33:52 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-6350c989-60d3-4cf1-8bf8-0326ebf02280 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Lock "2f1b7a62-fdc2-4b8e-b9f8-61105c0fcb5c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:33:52 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-6350c989-60d3-4cf1-8bf8-0326ebf02280 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Acquiring lock "2f1b7a62-fdc2-4b8e-b9f8-61105c0fcb5c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:33:52 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-6350c989-60d3-4cf1-8bf8-0326ebf02280 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Lock "2f1b7a62-fdc2-4b8e-b9f8-61105c0fcb5c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:33:52 user nova-compute[85141]: INFO nova.compute.manager [None req-6350c989-60d3-4cf1-8bf8-0326ebf02280 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] [instance: 2f1b7a62-fdc2-4b8e-b9f8-61105c0fcb5c] Attaching volume 1fd95458-b13d-439d-b30c-6dcfe2fa8419 to /dev/vdb
Nov 16 10:33:52 user nova-compute[85141]: DEBUG os_brick.utils [None req-6350c989-60d3-4cf1-8bf8-0326ebf02280 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 10:33:52 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:33:52 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:33:52 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[41a78877-76a7-4c5e-ae91-80d544b62999]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c7834de5c295\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:33:52 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:33:52 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:33:52 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[db6526eb-009d-4bd3-aab6-f018c6b7e3f6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:33:52 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:33:52 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:33:52 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b998e53-cae9-4cea-a82b-35266a573c5e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:33:52 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[eea8924f-d5f7-4d74-b718-3e433a80a6aa]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:33:52 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-6350c989-60d3-4cf1-8bf8-0326ebf02280 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Running cmd (subprocess): nvme version {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:33:52 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-6350c989-60d3-4cf1-8bf8-0326ebf02280 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] 'nvme version' failed. Not Retrying. {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 10:33:52 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6350c989-60d3-4cf1-8bf8-0326ebf02280 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] nvme not present on system {{(pid=85141) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 10:33:52 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:33:52 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 10:33:52 user nova-compute[85141]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 10:33:52 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[923baf89-f615-4a3c-979b-11454ce47fc5]: (4, '') {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:33:52 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.lightos [None req-6350c989-60d3-4cf1-8bf8-0326ebf02280 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=85141) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 10:33:52 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.lightos [None req-6350c989-60d3-4cf1-8bf8-0326ebf02280 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=85141) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 10:33:52 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.lightos [None req-6350c989-60d3-4cf1-8bf8-0326ebf02280 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] LIGHTOS: no hostnqn found. {{(pid=85141) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 10:33:52 user nova-compute[85141]: DEBUG os_brick.utils [None req-6350c989-60d3-4cf1-8bf8-0326ebf02280 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c7834de5c295', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 10:33:52 user nova-compute[85141]: DEBUG nova.virt.block_device [None req-6350c989-60d3-4cf1-8bf8-0326ebf02280 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] [instance: 2f1b7a62-fdc2-4b8e-b9f8-61105c0fcb5c] Updating existing volume attachment record: 9933c642-c4df-4e64-b44d-6ec879786f27 {{(pid=85141) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 10:33:52 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:33:53 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:33:57 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:33:58 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6350c989-60d3-4cf1-8bf8-0326ebf02280 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] [instance: 2f1b7a62-fdc2-4b8e-b9f8-61105c0fcb5c] Calling os-brick to attach iSCSI Volume {{(pid=85141) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 10:33:58 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-6350c989-60d3-4cf1-8bf8-0326ebf02280 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51806b6080>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1fd95458-b13d-439d-b30c-6dcfe2fa8419', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GwnfhSHM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 10:33:58 user nova-compute[85141]: WARNING os_brick.initiator.connectors.base [None req-6350c989-60d3-4cf1-8bf8-0326ebf02280 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 10:33:58 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-6350c989-60d3-4cf1-8bf8-0326ebf02280 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 10:33:58 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-6350c989-60d3-4cf1-8bf8-0326ebf02280 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 10:33:58 user nova-compute[85141]: WARNING os_brick.initiator.connectors.base [None req-6350c989-60d3-4cf1-8bf8-0326ebf02280 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 10:33:58 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-6350c989-60d3-4cf1-8bf8-0326ebf02280 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1fd95458-b13d-439d-b30c-6dcfe2fa8419" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 10:33:58 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-6350c989-60d3-4cf1-8bf8-0326ebf02280 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1fd95458-b13d-439d-b30c-6dcfe2fa8419" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 10:33:58 user nova-compute[85141]: INFO os_brick.initiator.connectors.iscsi [None req-6350c989-60d3-4cf1-8bf8-0326ebf02280 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 10:33:58 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1fd95458-b13d-439d-b30c-6dcfe2fa8419 -p 172.16.0.220:3260 {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:33:58 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1fd95458-b13d-439d-b30c-6dcfe2fa8419 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:33:58 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f14bbb3-ef4b-490f-b278-930d0775e0c8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:33:58 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-6350c989-60d3-4cf1-8bf8-0326ebf02280 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 10:33:58 user nova-compute[85141]:  {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:33:58 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1fd95458-b13d-439d-b30c-6dcfe2fa8419 -p 172.16.0.220:3260 --interface default --op new {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:33:58 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1fd95458-b13d-439d-b30c-6dcfe2fa8419 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:33:58 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ca12808-7dda-4f64-9e1e-e9aece899293]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1fd95458-b13d-439d-b30c-6dcfe2fa8419] added\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:33:58 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-6350c989-60d3-4cf1-8bf8-0326ebf02280 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1fd95458-b13d-439d-b30c-6dcfe2fa8419] added
Nov 16 10:33:58 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:33:58 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1fd95458-b13d-439d-b30c-6dcfe2fa8419 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:33:58 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1fd95458-b13d-439d-b30c-6dcfe2fa8419 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:33:58 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba003619-c723-4acc-b048-8af011f8e4cc]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:33:58 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-6350c989-60d3-4cf1-8bf8-0326ebf02280 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:33:58 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1fd95458-b13d-439d-b30c-6dcfe2fa8419 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:33:58 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1fd95458-b13d-439d-b30c-6dcfe2fa8419 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:33:58 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad42e586-80b1-4fea-8a68-c1ab41a1b7cb]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:33:58 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-6350c989-60d3-4cf1-8bf8-0326ebf02280 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:33:58 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1fd95458-b13d-439d-b30c-6dcfe2fa8419 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GwnfhSHM {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:33:58 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1fd95458-b13d-439d-b30c-6dcfe2fa8419 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GwnfhSHM" returned: 0 in 0.016s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:33:58 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e90e5fd-2a37-4fc3-8b38-76060abb6921]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:33:58 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-6350c989-60d3-4cf1-8bf8-0326ebf02280 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GwnfhSHM'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:33:58 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1fd95458-b13d-439d-b30c-6dcfe2fa8419 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:33:58 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1fd95458-b13d-439d-b30c-6dcfe2fa8419 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:33:58 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f21ebb1-4ecd-4565-95f2-c9628b09fed7]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:33:58 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-6350c989-60d3-4cf1-8bf8-0326ebf02280 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:33:58 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:33:58 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:33:58 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8fe8d77-cc6d-4fe2-9186-81fae72b9c60]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:584dd8df-f6a2-4e35-be7e-8de1e759491b (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c5db83a-dcda-47de-9106-4e6336994778 (non-flash)\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:33:58 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-6350c989-60d3-4cf1-8bf8-0326ebf02280 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:584dd8df-f6a2-4e35-be7e-8de1e759491b (non-flash)
Nov 16 10:33:58 user nova-compute[85141]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c5db83a-dcda-47de-9106-4e6336994778 (non-flash)
Nov 16 10:33:58 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:33:58 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-6350c989-60d3-4cf1-8bf8-0326ebf02280 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:584dd8df-f6a2-4e35-be7e-8de1e759491b (non-flash)
Nov 16 10:33:58 user nova-compute[85141]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c5db83a-dcda-47de-9106-4e6336994778 (non-flash)
Nov 16 10:33:58 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 10:33:58 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1fd95458-b13d-439d-b30c-6dcfe2fa8419 -p 172.16.0.220:3260 --login {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:33:58 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:33:58 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1fd95458-b13d-439d-b30c-6dcfe2fa8419 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:33:58 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[c29a9875-5381-43f2-bf97-08887a0e7e05]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1fd95458-b13d-439d-b30c-6dcfe2fa8419, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1fd95458-b13d-439d-b30c-6dcfe2fa8419, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:33:58 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-6350c989-60d3-4cf1-8bf8-0326ebf02280 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1fd95458-b13d-439d-b30c-6dcfe2fa8419, portal: 172.16.0.220,3260]
Nov 16 10:33:58 user nova-compute[85141]: Login to [iface: default, target: iqn.2010-10.org.openstack:1fd95458-b13d-439d-b30c-6dcfe2fa8419, portal: 172.16.0.220,3260] successful.
Nov 16 10:33:58 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:33:58 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1fd95458-b13d-439d-b30c-6dcfe2fa8419 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:33:58 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1fd95458-b13d-439d-b30c-6dcfe2fa8419 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:33:58 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[a823c1d3-0e1f-44b6-8368-71a80f4b0d97]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:33:58 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-6350c989-60d3-4cf1-8bf8-0326ebf02280 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:33:58 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:33:58 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:33:58 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[c21e7434-a6aa-4e50-9b82-e64f792361b0]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:584dd8df-f6a2-4e35-be7e-8de1e759491b (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c5db83a-dcda-47de-9106-4e6336994778 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fd95458-b13d-439d-b30c-6dcfe2fa8419 (non-flash)\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:33:58 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-6350c989-60d3-4cf1-8bf8-0326ebf02280 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:584dd8df-f6a2-4e35-be7e-8de1e759491b (non-flash)
Nov 16 10:33:58 user nova-compute[85141]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c5db83a-dcda-47de-9106-4e6336994778 (non-flash)
Nov 16 10:33:58 user nova-compute[85141]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fd95458-b13d-439d-b30c-6dcfe2fa8419 (non-flash)
Nov 16 10:33:58 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:33:58 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-6350c989-60d3-4cf1-8bf8-0326ebf02280 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:584dd8df-f6a2-4e35-be7e-8de1e759491b (non-flash)
Nov 16 10:33:58 user nova-compute[85141]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c5db83a-dcda-47de-9106-4e6336994778 (non-flash)
Nov 16 10:33:58 user nova-compute[85141]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fd95458-b13d-439d-b30c-6dcfe2fa8419 (non-flash)
Nov 16 10:33:58 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 10:33:58 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-6350c989-60d3-4cf1-8bf8-0326ebf02280 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1fd95458-b13d-439d-b30c-6dcfe2fa8419" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.261s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 10:33:58 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-6350c989-60d3-4cf1-8bf8-0326ebf02280 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Connected to 172.16.0.220:3260 {{(pid=85141) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 10:33:58 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-6350c989-60d3-4cf1-8bf8-0326ebf02280 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] HCTL ('35', '-', '-', 0) found on session 54 with lun 0 {{(pid=85141) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 10:33:58 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-6350c989-60d3-4cf1-8bf8-0326ebf02280 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=85141) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 10:33:58 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:33:58 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:33:58 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[dad3559a-3f6d-4497-bf1a-f25a46baaf42]: (4, ('- - 0', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:33:58 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-6350c989-60d3-4cf1-8bf8-0326ebf02280 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Searching for a device in session 54 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=85141) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 10:33:58 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-6350c989-60d3-4cf1-8bf8-0326ebf02280 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:1fd95458-b13d-439d-b30c-6dcfe2fa8419', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GwnfhSHM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=85141) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 10:33:59 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-6350c989-60d3-4cf1-8bf8-0326ebf02280 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.294s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 10:33:59 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-6350c989-60d3-4cf1-8bf8-0326ebf02280 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] <== connect_volume: return (1297ms) {'type': 'block', 'scsi_wwn': '26438653130646664', 'path': '/dev/sdd'} {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 10:33:59 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6350c989-60d3-4cf1-8bf8-0326ebf02280 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] [instance: 2f1b7a62-fdc2-4b8e-b9f8-61105c0fcb5c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26438653130646664', 'path': '/dev/sdd'} {{(pid=85141) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 10:33:59 user nova-compute[85141]: DEBUG nova.objects.instance [None req-6350c989-60d3-4cf1-8bf8-0326ebf02280 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Lazy-loading 'flavor' on Instance uuid 2f1b7a62-fdc2-4b8e-b9f8-61105c0fcb5c {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:33:59 user nova-compute[85141]: DEBUG nova.virt.libvirt.guest [None req-6350c989-60d3-4cf1-8bf8-0326ebf02280 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 10:33:59 user nova-compute[85141]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 10:33:59 user nova-compute[85141]:   <source dev="/dev/sdd"/>
Nov 16 10:33:59 user nova-compute[85141]:   <target dev="vdb" bus="virtio"/>
Nov 16 10:33:59 user nova-compute[85141]:   <serial>1fd95458-b13d-439d-b30c-6dcfe2fa8419</serial>
Nov 16 10:33:59 user nova-compute[85141]: </disk>
Nov 16 10:33:59 user nova-compute[85141]:  {{(pid=85141) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 10:34:00 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-6350c989-60d3-4cf1-8bf8-0326ebf02280 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] No BDM found with device name vda, not building metadata. {{(pid=85141) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 10:34:00 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-6350c989-60d3-4cf1-8bf8-0326ebf02280 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] No BDM found with device name vdb, not building metadata. {{(pid=85141) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 10:34:00 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-6350c989-60d3-4cf1-8bf8-0326ebf02280 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] No VIF found with MAC fa:16:3e:d1:c8:21, not building metadata {{(pid=85141) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 10:34:00 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-6350c989-60d3-4cf1-8bf8-0326ebf02280 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Lock "2f1b7a62-fdc2-4b8e-b9f8-61105c0fcb5c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.739s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:34:02 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:34:03 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-b30bd5d0-27b9-4fe6-aaad-d6cdbd7085bf tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Acquiring lock "b29fe8bd-8169-497f-91b4-0e03360f5a1c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:34:03 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-b30bd5d0-27b9-4fe6-aaad-d6cdbd7085bf tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Lock "b29fe8bd-8169-497f-91b4-0e03360f5a1c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:34:03 user nova-compute[85141]: DEBUG nova.compute.manager [None req-b30bd5d0-27b9-4fe6-aaad-d6cdbd7085bf tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] [instance: b29fe8bd-8169-497f-91b4-0e03360f5a1c] Starting instance... {{(pid=85141) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 10:34:03 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-b30bd5d0-27b9-4fe6-aaad-d6cdbd7085bf tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:34:03 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-b30bd5d0-27b9-4fe6-aaad-d6cdbd7085bf tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:34:03 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-b30bd5d0-27b9-4fe6-aaad-d6cdbd7085bf tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=85141) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 10:34:03 user nova-compute[85141]: INFO nova.compute.claims [None req-b30bd5d0-27b9-4fe6-aaad-d6cdbd7085bf tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] [instance: b29fe8bd-8169-497f-91b4-0e03360f5a1c] Claim successful on node user
Nov 16 10:34:04 user nova-compute[85141]: DEBUG nova.compute.provider_tree [None req-b30bd5d0-27b9-4fe6-aaad-d6cdbd7085bf tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Inventory has not changed in ProviderTree for provider: bf8e0fa1-16b6-408f-9203-c4cd63916272 {{(pid=85141) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 10:34:04 user nova-compute[85141]: DEBUG nova.scheduler.client.report [None req-b30bd5d0-27b9-4fe6-aaad-d6cdbd7085bf tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Inventory has not changed for provider bf8e0fa1-16b6-408f-9203-c4cd63916272 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=85141) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 10:34:04 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-b30bd5d0-27b9-4fe6-aaad-d6cdbd7085bf tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.345s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:34:04 user nova-compute[85141]: DEBUG nova.compute.manager [None req-b30bd5d0-27b9-4fe6-aaad-d6cdbd7085bf tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] [instance: b29fe8bd-8169-497f-91b4-0e03360f5a1c] Start building networks asynchronously for instance. {{(pid=85141) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 10:34:04 user nova-compute[85141]: DEBUG nova.compute.manager [None req-b30bd5d0-27b9-4fe6-aaad-d6cdbd7085bf tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] [instance: b29fe8bd-8169-497f-91b4-0e03360f5a1c] Allocating IP information in the background. {{(pid=85141) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 10:34:04 user nova-compute[85141]: DEBUG nova.network.neutron [None req-b30bd5d0-27b9-4fe6-aaad-d6cdbd7085bf tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] [instance: b29fe8bd-8169-497f-91b4-0e03360f5a1c] allocate_for_instance() {{(pid=85141) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 10:34:04 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-b30bd5d0-27b9-4fe6-aaad-d6cdbd7085bf tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] [instance: b29fe8bd-8169-497f-91b4-0e03360f5a1c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 10:34:04 user nova-compute[85141]: DEBUG nova.compute.manager [None req-b30bd5d0-27b9-4fe6-aaad-d6cdbd7085bf tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] [instance: b29fe8bd-8169-497f-91b4-0e03360f5a1c] Start building block device mappings for instance. {{(pid=85141) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 10:34:04 user nova-compute[85141]: DEBUG nova.policy [None req-b30bd5d0-27b9-4fe6-aaad-d6cdbd7085bf tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5aa5beeeca5d4dc89cf5333942da756f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd13c6ff3c30549ca9ab44d9fc1fedc6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85141) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 10:34:04 user nova-compute[85141]: DEBUG nova.compute.manager [None req-b30bd5d0-27b9-4fe6-aaad-d6cdbd7085bf tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] [instance: b29fe8bd-8169-497f-91b4-0e03360f5a1c] Start spawning the instance on the hypervisor. {{(pid=85141) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 10:34:04 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-b30bd5d0-27b9-4fe6-aaad-d6cdbd7085bf tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] [instance: b29fe8bd-8169-497f-91b4-0e03360f5a1c] Creating instance directory {{(pid=85141) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 10:34:04 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-b30bd5d0-27b9-4fe6-aaad-d6cdbd7085bf tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] [instance: b29fe8bd-8169-497f-91b4-0e03360f5a1c] Creating image(s)
Nov 16 10:34:04 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-b30bd5d0-27b9-4fe6-aaad-d6cdbd7085bf tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Acquiring lock "/opt/stack/data/nova/instances/b29fe8bd-8169-497f-91b4-0e03360f5a1c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:34:04 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-b30bd5d0-27b9-4fe6-aaad-d6cdbd7085bf tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Lock "/opt/stack/data/nova/instances/b29fe8bd-8169-497f-91b4-0e03360f5a1c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:34:04 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-b30bd5d0-27b9-4fe6-aaad-d6cdbd7085bf tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Lock "/opt/stack/data/nova/instances/b29fe8bd-8169-497f-91b4-0e03360f5a1c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:34:04 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-b30bd5d0-27b9-4fe6-aaad-d6cdbd7085bf tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:34:04 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-b30bd5d0-27b9-4fe6-aaad-d6cdbd7085bf tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json" returned: 0 in 0.196s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:34:04 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-b30bd5d0-27b9-4fe6-aaad-d6cdbd7085bf tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Acquiring lock "60a78556fb399ed4a41bc3ca4bccf77c96d8e811" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:34:04 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-b30bd5d0-27b9-4fe6-aaad-d6cdbd7085bf tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Lock "60a78556fb399ed4a41bc3ca4bccf77c96d8e811" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:34:04 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-b30bd5d0-27b9-4fe6-aaad-d6cdbd7085bf tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:34:04 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-b30bd5d0-27b9-4fe6-aaad-d6cdbd7085bf tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json" returned: 0 in 0.189s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:34:04 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-b30bd5d0-27b9-4fe6-aaad-d6cdbd7085bf tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811,backing_fmt=raw /opt/stack/data/nova/instances/b29fe8bd-8169-497f-91b4-0e03360f5a1c/disk 1073741824 {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:34:05 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-b30bd5d0-27b9-4fe6-aaad-d6cdbd7085bf tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811,backing_fmt=raw /opt/stack/data/nova/instances/b29fe8bd-8169-497f-91b4-0e03360f5a1c/disk 1073741824" returned: 0 in 0.059s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:34:05 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-b30bd5d0-27b9-4fe6-aaad-d6cdbd7085bf tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Lock "60a78556fb399ed4a41bc3ca4bccf77c96d8e811" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.257s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:34:05 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-b30bd5d0-27b9-4fe6-aaad-d6cdbd7085bf tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:34:05 user nova-compute[85141]: DEBUG nova.network.neutron [None req-b30bd5d0-27b9-4fe6-aaad-d6cdbd7085bf tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] [instance: b29fe8bd-8169-497f-91b4-0e03360f5a1c] Successfully created port: 88f5ab37-029f-45b9-a240-bd30eb5c89a2 {{(pid=85141) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 10:34:05 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-b30bd5d0-27b9-4fe6-aaad-d6cdbd7085bf tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json" returned: 0 in 0.185s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:34:05 user nova-compute[85141]: DEBUG nova.virt.disk.api [None req-b30bd5d0-27b9-4fe6-aaad-d6cdbd7085bf tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b29fe8bd-8169-497f-91b4-0e03360f5a1c/disk. size=1073741824 {{(pid=85141) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 10:34:05 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-b30bd5d0-27b9-4fe6-aaad-d6cdbd7085bf tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b29fe8bd-8169-497f-91b4-0e03360f5a1c/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:34:05 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-b30bd5d0-27b9-4fe6-aaad-d6cdbd7085bf tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b29fe8bd-8169-497f-91b4-0e03360f5a1c/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:34:05 user nova-compute[85141]: DEBUG nova.virt.disk.api [None req-b30bd5d0-27b9-4fe6-aaad-d6cdbd7085bf tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Cannot resize image /opt/stack/data/nova/instances/b29fe8bd-8169-497f-91b4-0e03360f5a1c/disk to a smaller size. {{(pid=85141) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 10:34:05 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-b30bd5d0-27b9-4fe6-aaad-d6cdbd7085bf tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] [instance: b29fe8bd-8169-497f-91b4-0e03360f5a1c] Created local disks {{(pid=85141) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 10:34:05 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-b30bd5d0-27b9-4fe6-aaad-d6cdbd7085bf tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] [instance: b29fe8bd-8169-497f-91b4-0e03360f5a1c] Ensure instance console log exists: /opt/stack/data/nova/instances/b29fe8bd-8169-497f-91b4-0e03360f5a1c/console.log {{(pid=85141) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 10:34:05 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-b30bd5d0-27b9-4fe6-aaad-d6cdbd7085bf tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:34:05 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-b30bd5d0-27b9-4fe6-aaad-d6cdbd7085bf tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:34:05 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-b30bd5d0-27b9-4fe6-aaad-d6cdbd7085bf tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:34:05 user nova-compute[85141]: DEBUG nova.network.neutron [None req-b30bd5d0-27b9-4fe6-aaad-d6cdbd7085bf tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] [instance: b29fe8bd-8169-497f-91b4-0e03360f5a1c] Successfully updated port: 88f5ab37-029f-45b9-a240-bd30eb5c89a2 {{(pid=85141) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 10:34:05 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-b30bd5d0-27b9-4fe6-aaad-d6cdbd7085bf tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Acquiring lock "refresh_cache-b29fe8bd-8169-497f-91b4-0e03360f5a1c" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:34:05 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-b30bd5d0-27b9-4fe6-aaad-d6cdbd7085bf tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Acquired lock "refresh_cache-b29fe8bd-8169-497f-91b4-0e03360f5a1c" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:34:05 user nova-compute[85141]: DEBUG nova.network.neutron [None req-b30bd5d0-27b9-4fe6-aaad-d6cdbd7085bf tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] [instance: b29fe8bd-8169-497f-91b4-0e03360f5a1c] Building network info cache for instance {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 10:34:05 user nova-compute[85141]: DEBUG nova.compute.manager [req-5dc2f881-52ca-4268-ab06-872556487a83 req-9ff85844-e656-4b20-8814-64dfcec986c1 service nova] [instance: b29fe8bd-8169-497f-91b4-0e03360f5a1c] Received event network-changed-88f5ab37-029f-45b9-a240-bd30eb5c89a2 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:34:05 user nova-compute[85141]: DEBUG nova.compute.manager [req-5dc2f881-52ca-4268-ab06-872556487a83 req-9ff85844-e656-4b20-8814-64dfcec986c1 service nova] [instance: b29fe8bd-8169-497f-91b4-0e03360f5a1c] Refreshing instance network info cache due to event network-changed-88f5ab37-029f-45b9-a240-bd30eb5c89a2. {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 10:34:05 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-5dc2f881-52ca-4268-ab06-872556487a83 req-9ff85844-e656-4b20-8814-64dfcec986c1 service nova] Acquiring lock "refresh_cache-b29fe8bd-8169-497f-91b4-0e03360f5a1c" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:34:05 user nova-compute[85141]: DEBUG nova.network.neutron [None req-b30bd5d0-27b9-4fe6-aaad-d6cdbd7085bf tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] [instance: b29fe8bd-8169-497f-91b4-0e03360f5a1c] Instance cache missing network info. {{(pid=85141) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 10:34:06 user nova-compute[85141]: DEBUG nova.network.neutron [None req-b30bd5d0-27b9-4fe6-aaad-d6cdbd7085bf tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] [instance: b29fe8bd-8169-497f-91b4-0e03360f5a1c] Updating instance_info_cache with network_info: [{"id": "88f5ab37-029f-45b9-a240-bd30eb5c89a2", "address": "fa:16:3e:f0:80:ce", "network": {"id": "8931cd8f-3c0b-4d49-ae98-48f818e854e7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1902653571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d13c6ff3c30549ca9ab44d9fc1fedc6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88f5ab37-02", "ovs_interfaceid": "88f5ab37-029f-45b9-a240-bd30eb5c89a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:34:06 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-b30bd5d0-27b9-4fe6-aaad-d6cdbd7085bf tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Releasing lock "refresh_cache-b29fe8bd-8169-497f-91b4-0e03360f5a1c" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:34:06 user nova-compute[85141]: DEBUG nova.compute.manager [None req-b30bd5d0-27b9-4fe6-aaad-d6cdbd7085bf tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] [instance: b29fe8bd-8169-497f-91b4-0e03360f5a1c] Instance network_info: |[{"id": "88f5ab37-029f-45b9-a240-bd30eb5c89a2", "address": "fa:16:3e:f0:80:ce", "network": {"id": "8931cd8f-3c0b-4d49-ae98-48f818e854e7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1902653571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d13c6ff3c30549ca9ab44d9fc1fedc6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88f5ab37-02", "ovs_interfaceid": "88f5ab37-029f-45b9-a240-bd30eb5c89a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=85141) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 10:34:06 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-5dc2f881-52ca-4268-ab06-872556487a83 req-9ff85844-e656-4b20-8814-64dfcec986c1 service nova] Acquired lock "refresh_cache-b29fe8bd-8169-497f-91b4-0e03360f5a1c" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:34:06 user nova-compute[85141]: DEBUG nova.network.neutron [req-5dc2f881-52ca-4268-ab06-872556487a83 req-9ff85844-e656-4b20-8814-64dfcec986c1 service nova] [instance: b29fe8bd-8169-497f-91b4-0e03360f5a1c] Refreshing network info cache for port 88f5ab37-029f-45b9-a240-bd30eb5c89a2 {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 10:34:06 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-b30bd5d0-27b9-4fe6-aaad-d6cdbd7085bf tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] [instance: b29fe8bd-8169-497f-91b4-0e03360f5a1c] Start _get_guest_xml network_info=[{"id": "88f5ab37-029f-45b9-a240-bd30eb5c89a2", "address": "fa:16:3e:f0:80:ce", "network": {"id": "8931cd8f-3c0b-4d49-ae98-48f818e854e7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1902653571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d13c6ff3c30549ca9ab44d9fc1fedc6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88f5ab37-02", "ovs_interfaceid": "88f5ab37-029f-45b9-a240-bd30eb5c89a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T10:06:42Z,direct_url=<?>,disk_format='qcow2',id=bc4ca70f-a459-4d5c-a9e6-80f1948eb48b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1044631a5fe84ce8904864a7024049fa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T10:06:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_options': None, 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'image_id': 'bc4ca70f-a459-4d5c-a9e6-80f1948eb48b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=85141) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 10:34:06 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-b30bd5d0-27b9-4fe6-aaad-d6cdbd7085bf tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:34:06 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-b30bd5d0-27b9-4fe6-aaad-d6cdbd7085bf tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:34:06 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-b30bd5d0-27b9-4fe6-aaad-d6cdbd7085bf tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=85141) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 10:34:06 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-b30bd5d0-27b9-4fe6-aaad-d6cdbd7085bf tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] CPU controller missing on host. {{(pid=85141) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 10:34:06 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-b30bd5d0-27b9-4fe6-aaad-d6cdbd7085bf tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=85141) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 10:34:06 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-b30bd5d0-27b9-4fe6-aaad-d6cdbd7085bf tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] CPU controller found on host. {{(pid=85141) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 10:34:06 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-b30bd5d0-27b9-4fe6-aaad-d6cdbd7085bf tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=85141) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 10:34:06 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-b30bd5d0-27b9-4fe6-aaad-d6cdbd7085bf tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T10:06:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T10:06:42Z,direct_url=<?>,disk_format='qcow2',id=bc4ca70f-a459-4d5c-a9e6-80f1948eb48b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1044631a5fe84ce8904864a7024049fa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T10:06:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 10:34:06 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-b30bd5d0-27b9-4fe6-aaad-d6cdbd7085bf tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Flavor limits 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 10:34:06 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-b30bd5d0-27b9-4fe6-aaad-d6cdbd7085bf tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Image limits 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 10:34:06 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-b30bd5d0-27b9-4fe6-aaad-d6cdbd7085bf tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Flavor pref 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 10:34:06 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-b30bd5d0-27b9-4fe6-aaad-d6cdbd7085bf tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Image pref 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 10:34:06 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-b30bd5d0-27b9-4fe6-aaad-d6cdbd7085bf tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 10:34:06 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-b30bd5d0-27b9-4fe6-aaad-d6cdbd7085bf tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 10:34:06 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-b30bd5d0-27b9-4fe6-aaad-d6cdbd7085bf tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=85141) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 10:34:06 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-b30bd5d0-27b9-4fe6-aaad-d6cdbd7085bf tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Got 1 possible topologies {{(pid=85141) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 10:34:06 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-b30bd5d0-27b9-4fe6-aaad-d6cdbd7085bf tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 10:34:06 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-b30bd5d0-27b9-4fe6-aaad-d6cdbd7085bf tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 10:34:06 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-b30bd5d0-27b9-4fe6-aaad-d6cdbd7085bf tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T10:34:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1540884992',display_name='tempest-AttachVolumeNegativeTest-server-1540884992',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1540884992',id=47,image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNRLjP8qVAmIkwY0nt33B+zouKG4J1s4862Ojdrqrw19lhqRgNRAmgNw/slEfiXv0CDCCajGLCUc/g3T46dlANdOiM9iy2fvbry+r+EZzRzv3yWWaGaOjfRl3G2marGwbQ==',key_name='tempest-keypair-1599369444',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d13c6ff3c30549ca9ab44d9fc1fedc6f',ramdisk_id='',reservation_id='r-0ak5y4t4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-2108292208',owner_user_name='tempest-AttachVolumeNegativeTest-2108292208-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T10:34:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5aa5beeeca5d4dc89cf5333942da756f',uuid=b29fe8bd-8169-497f-91b4-0e03360f5a1c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "88f5ab37-029f-45b9-a240-bd30eb5c89a2", "address": "fa:16:3e:f0:80:ce", "network": {"id": "8931cd8f-3c0b-4d49-ae98-48f818e854e7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1902653571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d13c6ff3c30549ca9ab44d9fc1fedc6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88f5ab37-02", "ovs_interfaceid": "88f5ab37-029f-45b9-a240-bd30eb5c89a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=85141) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 10:34:06 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-b30bd5d0-27b9-4fe6-aaad-d6cdbd7085bf tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Converting VIF {"id": "88f5ab37-029f-45b9-a240-bd30eb5c89a2", "address": "fa:16:3e:f0:80:ce", "network": {"id": "8931cd8f-3c0b-4d49-ae98-48f818e854e7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1902653571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d13c6ff3c30549ca9ab44d9fc1fedc6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88f5ab37-02", "ovs_interfaceid": "88f5ab37-029f-45b9-a240-bd30eb5c89a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:34:06 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-b30bd5d0-27b9-4fe6-aaad-d6cdbd7085bf tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:80:ce,bridge_name='br-int',has_traffic_filtering=True,id=88f5ab37-029f-45b9-a240-bd30eb5c89a2,network=Network(8931cd8f-3c0b-4d49-ae98-48f818e854e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88f5ab37-02') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:34:06 user nova-compute[85141]: DEBUG nova.objects.instance [None req-b30bd5d0-27b9-4fe6-aaad-d6cdbd7085bf tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Lazy-loading 'pci_devices' on Instance uuid b29fe8bd-8169-497f-91b4-0e03360f5a1c {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:34:06 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-b30bd5d0-27b9-4fe6-aaad-d6cdbd7085bf tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] [instance: b29fe8bd-8169-497f-91b4-0e03360f5a1c] End _get_guest_xml xml=<domain type="kvm">
Nov 16 10:34:06 user nova-compute[85141]:   <uuid>b29fe8bd-8169-497f-91b4-0e03360f5a1c</uuid>
Nov 16 10:34:06 user nova-compute[85141]:   <name>instance-0000002f</name>
Nov 16 10:34:06 user nova-compute[85141]:   <memory>524288</memory>
Nov 16 10:34:06 user nova-compute[85141]:   <vcpu>1</vcpu>
Nov 16 10:34:06 user nova-compute[85141]:   <metadata>
Nov 16 10:34:06 user nova-compute[85141]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 10:34:06 user nova-compute[85141]:       <nova:package version="0.0.0"/>
Nov 16 10:34:06 user nova-compute[85141]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1540884992</nova:name>
Nov 16 10:34:06 user nova-compute[85141]:       <nova:creationTime>2023-11-16 10:34:06</nova:creationTime>
Nov 16 10:34:06 user nova-compute[85141]:       <nova:flavor name="m1.tiny">
Nov 16 10:34:06 user nova-compute[85141]:         <nova:memory>512</nova:memory>
Nov 16 10:34:06 user nova-compute[85141]:         <nova:disk>1</nova:disk>
Nov 16 10:34:06 user nova-compute[85141]:         <nova:swap>0</nova:swap>
Nov 16 10:34:06 user nova-compute[85141]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 10:34:06 user nova-compute[85141]:         <nova:vcpus>1</nova:vcpus>
Nov 16 10:34:06 user nova-compute[85141]:       </nova:flavor>
Nov 16 10:34:06 user nova-compute[85141]:       <nova:owner>
Nov 16 10:34:06 user nova-compute[85141]:         <nova:user uuid="5aa5beeeca5d4dc89cf5333942da756f">tempest-AttachVolumeNegativeTest-2108292208-project-member</nova:user>
Nov 16 10:34:06 user nova-compute[85141]:         <nova:project uuid="d13c6ff3c30549ca9ab44d9fc1fedc6f">tempest-AttachVolumeNegativeTest-2108292208</nova:project>
Nov 16 10:34:06 user nova-compute[85141]:       </nova:owner>
Nov 16 10:34:06 user nova-compute[85141]:       <nova:root type="image" uuid="bc4ca70f-a459-4d5c-a9e6-80f1948eb48b"/>
Nov 16 10:34:06 user nova-compute[85141]:       <nova:ports>
Nov 16 10:34:06 user nova-compute[85141]:         <nova:port uuid="88f5ab37-029f-45b9-a240-bd30eb5c89a2">
Nov 16 10:34:06 user nova-compute[85141]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 16 10:34:06 user nova-compute[85141]:         </nova:port>
Nov 16 10:34:06 user nova-compute[85141]:       </nova:ports>
Nov 16 10:34:06 user nova-compute[85141]:     </nova:instance>
Nov 16 10:34:06 user nova-compute[85141]:   </metadata>
Nov 16 10:34:06 user nova-compute[85141]:   <sysinfo type="smbios">
Nov 16 10:34:06 user nova-compute[85141]:     <system>
Nov 16 10:34:06 user nova-compute[85141]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 10:34:06 user nova-compute[85141]:       <entry name="product">OpenStack Nova</entry>
Nov 16 10:34:06 user nova-compute[85141]:       <entry name="version">0.0.0</entry>
Nov 16 10:34:06 user nova-compute[85141]:       <entry name="serial">b29fe8bd-8169-497f-91b4-0e03360f5a1c</entry>
Nov 16 10:34:06 user nova-compute[85141]:       <entry name="uuid">b29fe8bd-8169-497f-91b4-0e03360f5a1c</entry>
Nov 16 10:34:06 user nova-compute[85141]:       <entry name="family">Virtual Machine</entry>
Nov 16 10:34:06 user nova-compute[85141]:     </system>
Nov 16 10:34:06 user nova-compute[85141]:   </sysinfo>
Nov 16 10:34:06 user nova-compute[85141]:   <os>
Nov 16 10:34:06 user nova-compute[85141]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 10:34:06 user nova-compute[85141]:     <boot dev="hd"/>
Nov 16 10:34:06 user nova-compute[85141]:     <smbios mode="sysinfo"/>
Nov 16 10:34:06 user nova-compute[85141]:   </os>
Nov 16 10:34:06 user nova-compute[85141]:   <features>
Nov 16 10:34:06 user nova-compute[85141]:     <acpi/>
Nov 16 10:34:06 user nova-compute[85141]:     <apic/>
Nov 16 10:34:06 user nova-compute[85141]:     <vmcoreinfo/>
Nov 16 10:34:06 user nova-compute[85141]:   </features>
Nov 16 10:34:06 user nova-compute[85141]:   <clock offset="utc">
Nov 16 10:34:06 user nova-compute[85141]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 10:34:06 user nova-compute[85141]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 10:34:06 user nova-compute[85141]:     <timer name="hpet" present="no"/>
Nov 16 10:34:06 user nova-compute[85141]:   </clock>
Nov 16 10:34:06 user nova-compute[85141]:   <cpu mode="custom" match="exact">
Nov 16 10:34:06 user nova-compute[85141]:     <model>Nehalem</model>
Nov 16 10:34:06 user nova-compute[85141]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 10:34:06 user nova-compute[85141]:   </cpu>
Nov 16 10:34:06 user nova-compute[85141]:   <devices>
Nov 16 10:34:06 user nova-compute[85141]:     <disk type="file" device="disk">
Nov 16 10:34:06 user nova-compute[85141]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 10:34:06 user nova-compute[85141]:       <source file="/opt/stack/data/nova/instances/b29fe8bd-8169-497f-91b4-0e03360f5a1c/disk"/>
Nov 16 10:34:06 user nova-compute[85141]:       <target dev="vda" bus="virtio"/>
Nov 16 10:34:06 user nova-compute[85141]:     </disk>
Nov 16 10:34:06 user nova-compute[85141]:     <interface type="ethernet">
Nov 16 10:34:06 user nova-compute[85141]:       <mac address="fa:16:3e:f0:80:ce"/>
Nov 16 10:34:06 user nova-compute[85141]:       <model type="virtio"/>
Nov 16 10:34:06 user nova-compute[85141]:       <mtu size="1442"/>
Nov 16 10:34:06 user nova-compute[85141]:       <target dev="tap88f5ab37-02"/>
Nov 16 10:34:06 user nova-compute[85141]:     </interface>
Nov 16 10:34:06 user nova-compute[85141]:     <serial type="pty">
Nov 16 10:34:06 user nova-compute[85141]:       <log file="/opt/stack/data/nova/instances/b29fe8bd-8169-497f-91b4-0e03360f5a1c/console.log" append="off"/>
Nov 16 10:34:06 user nova-compute[85141]:     </serial>
Nov 16 10:34:06 user nova-compute[85141]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 10:34:06 user nova-compute[85141]:     <video>
Nov 16 10:34:06 user nova-compute[85141]:       <model type="virtio"/>
Nov 16 10:34:06 user nova-compute[85141]:     </video>
Nov 16 10:34:06 user nova-compute[85141]:     <rng model="virtio">
Nov 16 10:34:06 user nova-compute[85141]:       <backend model="random">/dev/urandom</backend>
Nov 16 10:34:06 user nova-compute[85141]:     </rng>
Nov 16 10:34:06 user nova-compute[85141]:     <controller type="usb" index="0" model="none"/>
Nov 16 10:34:06 user nova-compute[85141]:     <memballoon model="virtio">
Nov 16 10:34:06 user nova-compute[85141]:       <stats period="10"/>
Nov 16 10:34:06 user nova-compute[85141]:     </memballoon>
Nov 16 10:34:06 user nova-compute[85141]:   </devices>
Nov 16 10:34:06 user nova-compute[85141]: </domain>
Nov 16 10:34:06 user nova-compute[85141]:  {{(pid=85141) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 10:34:06 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-b30bd5d0-27b9-4fe6-aaad-d6cdbd7085bf tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T10:34:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1540884992',display_name='tempest-AttachVolumeNegativeTest-server-1540884992',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1540884992',id=47,image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNRLjP8qVAmIkwY0nt33B+zouKG4J1s4862Ojdrqrw19lhqRgNRAmgNw/slEfiXv0CDCCajGLCUc/g3T46dlANdOiM9iy2fvbry+r+EZzRzv3yWWaGaOjfRl3G2marGwbQ==',key_name='tempest-keypair-1599369444',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d13c6ff3c30549ca9ab44d9fc1fedc6f',ramdisk_id='',reservation_id='r-0ak5y4t4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-2108292208',owner_user_name='tempest-AttachVolumeNegativeTest-2108292208-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T10:34:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5aa5beeeca5d4dc89cf5333942da756f',uuid=b29fe8bd-8169-497f-91b4-0e03360f5a1c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "88f5ab37-029f-45b9-a240-bd30eb5c89a2", "address": "fa:16:3e:f0:80:ce", "network": {"id": "8931cd8f-3c0b-4d49-ae98-48f818e854e7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1902653571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d13c6ff3c30549ca9ab44d9fc1fedc6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88f5ab37-02", "ovs_interfaceid": "88f5ab37-029f-45b9-a240-bd30eb5c89a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 10:34:06 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-b30bd5d0-27b9-4fe6-aaad-d6cdbd7085bf tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Converting VIF {"id": "88f5ab37-029f-45b9-a240-bd30eb5c89a2", "address": "fa:16:3e:f0:80:ce", "network": {"id": "8931cd8f-3c0b-4d49-ae98-48f818e854e7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1902653571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d13c6ff3c30549ca9ab44d9fc1fedc6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88f5ab37-02", "ovs_interfaceid": "88f5ab37-029f-45b9-a240-bd30eb5c89a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:34:06 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-b30bd5d0-27b9-4fe6-aaad-d6cdbd7085bf tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:80:ce,bridge_name='br-int',has_traffic_filtering=True,id=88f5ab37-029f-45b9-a240-bd30eb5c89a2,network=Network(8931cd8f-3c0b-4d49-ae98-48f818e854e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88f5ab37-02') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:34:06 user nova-compute[85141]: DEBUG os_vif [None req-b30bd5d0-27b9-4fe6-aaad-d6cdbd7085bf tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:80:ce,bridge_name='br-int',has_traffic_filtering=True,id=88f5ab37-029f-45b9-a240-bd30eb5c89a2,network=Network(8931cd8f-3c0b-4d49-ae98-48f818e854e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88f5ab37-02') {{(pid=85141) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 10:34:06 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:34:06 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:34:06 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 10:34:06 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:34:06 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd5f6b6c3-cf48-584c-aef2-6865da052019', '_type': 'linux-noop'}}, row=False) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:34:06 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:34:06 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:34:06 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:34:06 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap88f5ab37-02, may_exist=True, interface_attrs={}) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:34:06 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap88f5ab37-02, col_values=(('qos', UUID('8df9d557-4f6d-4fd1-832e-a68f19399825')),), if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:34:06 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap88f5ab37-02, col_values=(('external_ids', {'iface-id': '88f5ab37-029f-45b9-a240-bd30eb5c89a2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f0:80:ce', 'vm-uuid': 'b29fe8bd-8169-497f-91b4-0e03360f5a1c'}),), if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:34:06 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:34:06 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:34:06 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:34:06 user nova-compute[85141]: INFO os_vif [None req-b30bd5d0-27b9-4fe6-aaad-d6cdbd7085bf tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:80:ce,bridge_name='br-int',has_traffic_filtering=True,id=88f5ab37-029f-45b9-a240-bd30eb5c89a2,network=Network(8931cd8f-3c0b-4d49-ae98-48f818e854e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88f5ab37-02')
Nov 16 10:34:06 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-b30bd5d0-27b9-4fe6-aaad-d6cdbd7085bf tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] No BDM found with device name vda, not building metadata. {{(pid=85141) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 10:34:06 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-b30bd5d0-27b9-4fe6-aaad-d6cdbd7085bf tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] No VIF found with MAC fa:16:3e:f0:80:ce, not building metadata {{(pid=85141) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 10:34:06 user nova-compute[85141]: DEBUG nova.network.neutron [req-5dc2f881-52ca-4268-ab06-872556487a83 req-9ff85844-e656-4b20-8814-64dfcec986c1 service nova] [instance: b29fe8bd-8169-497f-91b4-0e03360f5a1c] Updated VIF entry in instance network info cache for port 88f5ab37-029f-45b9-a240-bd30eb5c89a2. {{(pid=85141) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 10:34:06 user nova-compute[85141]: DEBUG nova.network.neutron [req-5dc2f881-52ca-4268-ab06-872556487a83 req-9ff85844-e656-4b20-8814-64dfcec986c1 service nova] [instance: b29fe8bd-8169-497f-91b4-0e03360f5a1c] Updating instance_info_cache with network_info: [{"id": "88f5ab37-029f-45b9-a240-bd30eb5c89a2", "address": "fa:16:3e:f0:80:ce", "network": {"id": "8931cd8f-3c0b-4d49-ae98-48f818e854e7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1902653571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d13c6ff3c30549ca9ab44d9fc1fedc6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88f5ab37-02", "ovs_interfaceid": "88f5ab37-029f-45b9-a240-bd30eb5c89a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:34:06 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-5dc2f881-52ca-4268-ab06-872556487a83 req-9ff85844-e656-4b20-8814-64dfcec986c1 service nova] Releasing lock "refresh_cache-b29fe8bd-8169-497f-91b4-0e03360f5a1c" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:34:07 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:34:07 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:34:07 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:34:07 user nova-compute[85141]: DEBUG nova.compute.manager [req-31613051-56b4-491f-bc3c-0b52395065cb req-2b6fcbf1-0f76-47d5-9000-77fd318e9f79 service nova] [instance: b29fe8bd-8169-497f-91b4-0e03360f5a1c] Received event network-vif-plugged-88f5ab37-029f-45b9-a240-bd30eb5c89a2 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:34:07 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-31613051-56b4-491f-bc3c-0b52395065cb req-2b6fcbf1-0f76-47d5-9000-77fd318e9f79 service nova] Acquiring lock "b29fe8bd-8169-497f-91b4-0e03360f5a1c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:34:07 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-31613051-56b4-491f-bc3c-0b52395065cb req-2b6fcbf1-0f76-47d5-9000-77fd318e9f79 service nova] Lock "b29fe8bd-8169-497f-91b4-0e03360f5a1c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:34:07 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-31613051-56b4-491f-bc3c-0b52395065cb req-2b6fcbf1-0f76-47d5-9000-77fd318e9f79 service nova] Lock "b29fe8bd-8169-497f-91b4-0e03360f5a1c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:34:07 user nova-compute[85141]: DEBUG nova.compute.manager [req-31613051-56b4-491f-bc3c-0b52395065cb req-2b6fcbf1-0f76-47d5-9000-77fd318e9f79 service nova] [instance: b29fe8bd-8169-497f-91b4-0e03360f5a1c] No waiting events found dispatching network-vif-plugged-88f5ab37-029f-45b9-a240-bd30eb5c89a2 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:34:07 user nova-compute[85141]: WARNING nova.compute.manager [req-31613051-56b4-491f-bc3c-0b52395065cb req-2b6fcbf1-0f76-47d5-9000-77fd318e9f79 service nova] [instance: b29fe8bd-8169-497f-91b4-0e03360f5a1c] Received unexpected event network-vif-plugged-88f5ab37-029f-45b9-a240-bd30eb5c89a2 for instance with vm_state building and task_state spawning.
Nov 16 10:34:07 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:34:08 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:34:09 user nova-compute[85141]: DEBUG nova.compute.manager [None req-b30bd5d0-27b9-4fe6-aaad-d6cdbd7085bf tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] [instance: b29fe8bd-8169-497f-91b4-0e03360f5a1c] Instance event wait completed in 0 seconds for  {{(pid=85141) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 10:34:09 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-b30bd5d0-27b9-4fe6-aaad-d6cdbd7085bf tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] [instance: b29fe8bd-8169-497f-91b4-0e03360f5a1c] Guest created on hypervisor {{(pid=85141) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 10:34:09 user nova-compute[85141]: INFO nova.virt.libvirt.driver [-] [instance: b29fe8bd-8169-497f-91b4-0e03360f5a1c] Instance spawned successfully.
Nov 16 10:34:09 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-b30bd5d0-27b9-4fe6-aaad-d6cdbd7085bf tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] [instance: b29fe8bd-8169-497f-91b4-0e03360f5a1c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 10:34:09 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-b30bd5d0-27b9-4fe6-aaad-d6cdbd7085bf tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] [instance: b29fe8bd-8169-497f-91b4-0e03360f5a1c] Found default for hw_cdrom_bus of ide {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:34:09 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-b30bd5d0-27b9-4fe6-aaad-d6cdbd7085bf tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] [instance: b29fe8bd-8169-497f-91b4-0e03360f5a1c] Found default for hw_disk_bus of virtio {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:34:09 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-b30bd5d0-27b9-4fe6-aaad-d6cdbd7085bf tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] [instance: b29fe8bd-8169-497f-91b4-0e03360f5a1c] Found default for hw_input_bus of None {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:34:09 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-b30bd5d0-27b9-4fe6-aaad-d6cdbd7085bf tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] [instance: b29fe8bd-8169-497f-91b4-0e03360f5a1c] Found default for hw_pointer_model of None {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:34:09 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-b30bd5d0-27b9-4fe6-aaad-d6cdbd7085bf tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] [instance: b29fe8bd-8169-497f-91b4-0e03360f5a1c] Found default for hw_video_model of virtio {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:34:09 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-b30bd5d0-27b9-4fe6-aaad-d6cdbd7085bf tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] [instance: b29fe8bd-8169-497f-91b4-0e03360f5a1c] Found default for hw_vif_model of virtio {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:34:09 user nova-compute[85141]: DEBUG nova.compute.manager [req-41854668-b86d-40e0-92c3-ca25069c2aa6 req-c81e94d4-8e6f-45b1-9f35-3ad1ad33390e service nova] [instance: b29fe8bd-8169-497f-91b4-0e03360f5a1c] Received event network-vif-plugged-88f5ab37-029f-45b9-a240-bd30eb5c89a2 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:34:09 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-41854668-b86d-40e0-92c3-ca25069c2aa6 req-c81e94d4-8e6f-45b1-9f35-3ad1ad33390e service nova] Acquiring lock "b29fe8bd-8169-497f-91b4-0e03360f5a1c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:34:09 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-41854668-b86d-40e0-92c3-ca25069c2aa6 req-c81e94d4-8e6f-45b1-9f35-3ad1ad33390e service nova] Lock "b29fe8bd-8169-497f-91b4-0e03360f5a1c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:34:09 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-41854668-b86d-40e0-92c3-ca25069c2aa6 req-c81e94d4-8e6f-45b1-9f35-3ad1ad33390e service nova] Lock "b29fe8bd-8169-497f-91b4-0e03360f5a1c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:34:09 user nova-compute[85141]: DEBUG nova.compute.manager [req-41854668-b86d-40e0-92c3-ca25069c2aa6 req-c81e94d4-8e6f-45b1-9f35-3ad1ad33390e service nova] [instance: b29fe8bd-8169-497f-91b4-0e03360f5a1c] No waiting events found dispatching network-vif-plugged-88f5ab37-029f-45b9-a240-bd30eb5c89a2 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:34:09 user nova-compute[85141]: WARNING nova.compute.manager [req-41854668-b86d-40e0-92c3-ca25069c2aa6 req-c81e94d4-8e6f-45b1-9f35-3ad1ad33390e service nova] [instance: b29fe8bd-8169-497f-91b4-0e03360f5a1c] Received unexpected event network-vif-plugged-88f5ab37-029f-45b9-a240-bd30eb5c89a2 for instance with vm_state building and task_state spawning.
Nov 16 10:34:09 user nova-compute[85141]: INFO nova.compute.manager [None req-b30bd5d0-27b9-4fe6-aaad-d6cdbd7085bf tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] [instance: b29fe8bd-8169-497f-91b4-0e03360f5a1c] Took 5.38 seconds to spawn the instance on the hypervisor.
Nov 16 10:34:09 user nova-compute[85141]: DEBUG nova.compute.manager [None req-b30bd5d0-27b9-4fe6-aaad-d6cdbd7085bf tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] [instance: b29fe8bd-8169-497f-91b4-0e03360f5a1c] Checking state {{(pid=85141) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 10:34:10 user nova-compute[85141]: INFO nova.compute.manager [None req-b30bd5d0-27b9-4fe6-aaad-d6cdbd7085bf tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] [instance: b29fe8bd-8169-497f-91b4-0e03360f5a1c] Took 6.20 seconds to build instance.
Nov 16 10:34:10 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-b30bd5d0-27b9-4fe6-aaad-d6cdbd7085bf tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Lock "b29fe8bd-8169-497f-91b4-0e03360f5a1c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.305s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:34:11 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-ef6cf334-0109-4bc0-ab1d-10ea0fb96f28 tempest-TestServerVolumeAttachScenarioOldVersion-263106525 tempest-TestServerVolumeAttachScenarioOldVersion-263106525-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance ac3f3bc9-f5e2-4dc8-bf62-3649611da824 is timed out.
Nov 16 10:34:11 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-ef6cf334-0109-4bc0-ab1d-10ea0fb96f28 tempest-TestServerVolumeAttachScenarioOldVersion-263106525 tempest-TestServerVolumeAttachScenarioOldVersion-263106525-project-member] Successfully detached device vdb from instance ac3f3bc9-f5e2-4dc8-bf62-3649611da824 from the live domain config.
Nov 16 10:34:11 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ef6cf334-0109-4bc0-ab1d-10ea0fb96f28 tempest-TestServerVolumeAttachScenarioOldVersion-263106525 tempest-TestServerVolumeAttachScenarioOldVersion-263106525-project-member] [instance: ac3f3bc9-f5e2-4dc8-bf62-3649611da824] calling os-brick to detach iSCSI Volume {{(pid=85141) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 10:34:11 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef6cf334-0109-4bc0-ab1d-10ea0fb96f28 tempest-TestServerVolumeAttachScenarioOldVersion-263106525 tempest-TestServerVolumeAttachScenarioOldVersion-263106525-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51806b6080>, {'target_iqn': 'iqn.2010-10.org.openstack:0c5db83a-dcda-47de-9106-4e6336994778', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pYtVBKWl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 10:34:11 user nova-compute[85141]: WARNING os_brick.initiator.connectors.base [None req-ef6cf334-0109-4bc0-ab1d-10ea0fb96f28 tempest-TestServerVolumeAttachScenarioOldVersion-263106525 tempest-TestServerVolumeAttachScenarioOldVersion-263106525-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 10:34:11 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-ef6cf334-0109-4bc0-ab1d-10ea0fb96f28 tempest-TestServerVolumeAttachScenarioOldVersion-263106525 tempest-TestServerVolumeAttachScenarioOldVersion-263106525-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 10:34:11 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-ef6cf334-0109-4bc0-ab1d-10ea0fb96f28 tempest-TestServerVolumeAttachScenarioOldVersion-263106525 tempest-TestServerVolumeAttachScenarioOldVersion-263106525-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 10:34:11 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:34:11 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:34:11 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[59926c93-c2da-44d3-8212-1660408c9c29]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:584dd8df-f6a2-4e35-be7e-8de1e759491b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0c5db83a-dcda-47de-9106-4e6336994778\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1fd95458-b13d-439d-b30c-6dcfe2fa8419\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:34:11 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef6cf334-0109-4bc0-ab1d-10ea0fb96f28 tempest-TestServerVolumeAttachScenarioOldVersion-263106525 tempest-TestServerVolumeAttachScenarioOldVersion-263106525-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 10:34:11 user nova-compute[85141]: No targets found.
Nov 16 10:34:11 user nova-compute[85141]: iSNS:
Nov 16 10:34:11 user nova-compute[85141]: No targets found.
Nov 16 10:34:11 user nova-compute[85141]: STATIC:
Nov 16 10:34:11 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:584dd8df-f6a2-4e35-be7e-8de1e759491b
Nov 16 10:34:11 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:34:11 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:34:11 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:0c5db83a-dcda-47de-9106-4e6336994778
Nov 16 10:34:11 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:34:11 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:34:11 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:1fd95458-b13d-439d-b30c-6dcfe2fa8419
Nov 16 10:34:11 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:34:11 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:34:11 user nova-compute[85141]: FIRMWARE:
Nov 16 10:34:11 user nova-compute[85141]: No targets found.
Nov 16 10:34:11 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:34:11 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef6cf334-0109-4bc0-ab1d-10ea0fb96f28 tempest-TestServerVolumeAttachScenarioOldVersion-263106525 tempest-TestServerVolumeAttachScenarioOldVersion-263106525-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 10:34:11 user nova-compute[85141]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 10:34:11 user nova-compute[85141]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=85141) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 10:34:11 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef6cf334-0109-4bc0-ab1d-10ea0fb96f28 tempest-TestServerVolumeAttachScenarioOldVersion-263106525 tempest-TestServerVolumeAttachScenarioOldVersion-263106525-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0c5db83a-dcda-47de-9106-4e6336994778', 0)] {{(pid=85141) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 10:34:11 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:34:11 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:34:11 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:34:11 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6ba9507-b4c2-4aef-aaf8-2599ef4e8822]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0c5db83a-dcda-47de-9106-4e6336994778\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1fd95458-b13d-439d-b30c-6dcfe2fa8419\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:584dd8df-f6a2-4e35-be7e-8de1e759491b\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:34:11 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:34:11 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:34:11 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0bfc6fe-40e1-45e0-8a32-5deb1f78c8fc]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:584dd8df-f6a2-4e35-be7e-8de1e759491b (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c5db83a-dcda-47de-9106-4e6336994778 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fd95458-b13d-439d-b30c-6dcfe2fa8419 (non-flash)\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:34:11 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef6cf334-0109-4bc0-ab1d-10ea0fb96f28 tempest-TestServerVolumeAttachScenarioOldVersion-263106525 tempest-TestServerVolumeAttachScenarioOldVersion-263106525-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:584dd8df-f6a2-4e35-be7e-8de1e759491b (non-flash)
Nov 16 10:34:11 user nova-compute[85141]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c5db83a-dcda-47de-9106-4e6336994778 (non-flash)
Nov 16 10:34:11 user nova-compute[85141]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fd95458-b13d-439d-b30c-6dcfe2fa8419 (non-flash)
Nov 16 10:34:11 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:34:11 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef6cf334-0109-4bc0-ab1d-10ea0fb96f28 tempest-TestServerVolumeAttachScenarioOldVersion-263106525 tempest-TestServerVolumeAttachScenarioOldVersion-263106525-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:584dd8df-f6a2-4e35-be7e-8de1e759491b (non-flash)
Nov 16 10:34:11 user nova-compute[85141]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c5db83a-dcda-47de-9106-4e6336994778 (non-flash)
Nov 16 10:34:11 user nova-compute[85141]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fd95458-b13d-439d-b30c-6dcfe2fa8419 (non-flash)
Nov 16 10:34:11 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 10:34:11 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef6cf334-0109-4bc0-ab1d-10ea0fb96f28 tempest-TestServerVolumeAttachScenarioOldVersion-263106525 tempest-TestServerVolumeAttachScenarioOldVersion-263106525-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5198184d30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0c5db83a-dcda-47de-9106-4e6336994778'): ({'sdb'}, set())}) {{(pid=85141) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 10:34:11 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-ef6cf334-0109-4bc0-ab1d-10ea0fb96f28 tempest-TestServerVolumeAttachScenarioOldVersion-263106525 tempest-TestServerVolumeAttachScenarioOldVersion-263106525-project-member] Removing single pathed devices sdb {{(pid=85141) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 10:34:11 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:34:11 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.031s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:34:11 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[1636ad47-b844-4aea-a51c-0de8ac7b6256]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:34:11 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:34:11 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:34:11 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbba834d-a55a-4bdc-a23d-f19cfcd1ddd6]: (4, ('ok\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:34:11 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-ef6cf334-0109-4bc0-ab1d-10ea0fb96f28 tempest-TestServerVolumeAttachScenarioOldVersion-263106525 tempest-TestServerVolumeAttachScenarioOldVersion-263106525-project-member] Flushing IO for device /dev/sdb {{(pid=85141) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 10:34:11 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:34:11 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:34:11 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[98465b8f-6cab-43dd-a440-804cf29957d6]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:34:11 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-ef6cf334-0109-4bc0-ab1d-10ea0fb96f28 tempest-TestServerVolumeAttachScenarioOldVersion-263106525 tempest-TestServerVolumeAttachScenarioOldVersion-263106525-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=85141) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 10:34:11 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:34:11 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.053s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:34:11 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[751ccd30-1e97-4745-b32e-1adcfb5542ba]: (4, ('1', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:34:11 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-ef6cf334-0109-4bc0-ab1d-10ea0fb96f28 tempest-TestServerVolumeAttachScenarioOldVersion-263106525 tempest-TestServerVolumeAttachScenarioOldVersion-263106525-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=85141) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 10:34:11 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-ef6cf334-0109-4bc0-ab1d-10ea0fb96f28 tempest-TestServerVolumeAttachScenarioOldVersion-263106525 tempest-TestServerVolumeAttachScenarioOldVersion-263106525-project-member] SCSI volumes sdb have been removed. {{(pid=85141) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 10:34:11 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef6cf334-0109-4bc0-ab1d-10ea0fb96f28 tempest-TestServerVolumeAttachScenarioOldVersion-263106525 tempest-TestServerVolumeAttachScenarioOldVersion-263106525-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0c5db83a-dcda-47de-9106-4e6336994778')] {{(pid=85141) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 10:34:11 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c5db83a-dcda-47de-9106-4e6336994778 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:34:11 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c5db83a-dcda-47de-9106-4e6336994778 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:34:11 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f66c497-f10a-417b-819d-ffd88206a56a]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:34:11 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef6cf334-0109-4bc0-ab1d-10ea0fb96f28 tempest-TestServerVolumeAttachScenarioOldVersion-263106525 tempest-TestServerVolumeAttachScenarioOldVersion-263106525-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:34:11 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c5db83a-dcda-47de-9106-4e6336994778 -p 172.16.0.220:3260 --logout {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:34:11 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c5db83a-dcda-47de-9106-4e6336994778 -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:34:11 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce4f7102-a33c-492d-ad73-7fc0321406dc]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:0c5db83a-dcda-47de-9106-4e6336994778, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:0c5db83a-dcda-47de-9106-4e6336994778, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:34:11 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef6cf334-0109-4bc0-ab1d-10ea0fb96f28 tempest-TestServerVolumeAttachScenarioOldVersion-263106525 tempest-TestServerVolumeAttachScenarioOldVersion-263106525-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:0c5db83a-dcda-47de-9106-4e6336994778, portal: 172.16.0.220,3260]
Nov 16 10:34:11 user nova-compute[85141]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:0c5db83a-dcda-47de-9106-4e6336994778, portal: 172.16.0.220,3260] successful.
Nov 16 10:34:11 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:34:11 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c5db83a-dcda-47de-9106-4e6336994778 -p 172.16.0.220:3260 --op delete {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:34:11 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c5db83a-dcda-47de-9106-4e6336994778 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:34:11 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[5baf6d37-8177-4f10-aebf-599e637e5e86]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:34:11 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef6cf334-0109-4bc0-ab1d-10ea0fb96f28 tempest-TestServerVolumeAttachScenarioOldVersion-263106525 tempest-TestServerVolumeAttachScenarioOldVersion-263106525-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:34:11 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-ef6cf334-0109-4bc0-ab1d-10ea0fb96f28 tempest-TestServerVolumeAttachScenarioOldVersion-263106525 tempest-TestServerVolumeAttachScenarioOldVersion-263106525-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.381s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 10:34:11 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef6cf334-0109-4bc0-ab1d-10ea0fb96f28 tempest-TestServerVolumeAttachScenarioOldVersion-263106525 tempest-TestServerVolumeAttachScenarioOldVersion-263106525-project-member] <== disconnect_volume: return (382ms) None {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 10:34:11 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ef6cf334-0109-4bc0-ab1d-10ea0fb96f28 tempest-TestServerVolumeAttachScenarioOldVersion-263106525 tempest-TestServerVolumeAttachScenarioOldVersion-263106525-project-member] [instance: ac3f3bc9-f5e2-4dc8-bf62-3649611da824] Disconnected iSCSI Volume {{(pid=85141) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 10:34:12 user nova-compute[85141]: DEBUG nova.objects.instance [None req-ef6cf334-0109-4bc0-ab1d-10ea0fb96f28 tempest-TestServerVolumeAttachScenarioOldVersion-263106525 tempest-TestServerVolumeAttachScenarioOldVersion-263106525-project-member] Lazy-loading 'flavor' on Instance uuid ac3f3bc9-f5e2-4dc8-bf62-3649611da824 {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:34:12 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-ef6cf334-0109-4bc0-ab1d-10ea0fb96f28 tempest-TestServerVolumeAttachScenarioOldVersion-263106525 tempest-TestServerVolumeAttachScenarioOldVersion-263106525-project-member] Lock "ac3f3bc9-f5e2-4dc8-bf62-3649611da824" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.840s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:34:14 user nova-compute[85141]: DEBUG nova.compute.manager [req-c8bf2610-f24b-421c-a88f-bf32835cc0e4 req-37ccdcf7-089a-4291-8761-7266e70d07b8 service nova] [instance: f432d8f9-10c4-49e3-bf3b-6389f52e21ab] Received event network-changed-e8cc6756-287d-4451-9119-7ca5779ca62c {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:34:14 user nova-compute[85141]: DEBUG nova.compute.manager [req-c8bf2610-f24b-421c-a88f-bf32835cc0e4 req-37ccdcf7-089a-4291-8761-7266e70d07b8 service nova] [instance: f432d8f9-10c4-49e3-bf3b-6389f52e21ab] Refreshing instance network info cache due to event network-changed-e8cc6756-287d-4451-9119-7ca5779ca62c. {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 10:34:14 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-c8bf2610-f24b-421c-a88f-bf32835cc0e4 req-37ccdcf7-089a-4291-8761-7266e70d07b8 service nova] Acquiring lock "refresh_cache-f432d8f9-10c4-49e3-bf3b-6389f52e21ab" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:34:14 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-c8bf2610-f24b-421c-a88f-bf32835cc0e4 req-37ccdcf7-089a-4291-8761-7266e70d07b8 service nova] Acquired lock "refresh_cache-f432d8f9-10c4-49e3-bf3b-6389f52e21ab" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:34:14 user nova-compute[85141]: DEBUG nova.network.neutron [req-c8bf2610-f24b-421c-a88f-bf32835cc0e4 req-37ccdcf7-089a-4291-8761-7266e70d07b8 service nova] [instance: f432d8f9-10c4-49e3-bf3b-6389f52e21ab] Refreshing network info cache for port e8cc6756-287d-4451-9119-7ca5779ca62c {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 10:34:14 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5ff03b5e-98ec-4cc9-ae11-05d8489404d0 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Acquiring lock "f432d8f9-10c4-49e3-bf3b-6389f52e21ab" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:34:14 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5ff03b5e-98ec-4cc9-ae11-05d8489404d0 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Lock "f432d8f9-10c4-49e3-bf3b-6389f52e21ab" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:34:14 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5ff03b5e-98ec-4cc9-ae11-05d8489404d0 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Acquiring lock "f432d8f9-10c4-49e3-bf3b-6389f52e21ab-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:34:14 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5ff03b5e-98ec-4cc9-ae11-05d8489404d0 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Lock "f432d8f9-10c4-49e3-bf3b-6389f52e21ab-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:34:14 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5ff03b5e-98ec-4cc9-ae11-05d8489404d0 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Lock "f432d8f9-10c4-49e3-bf3b-6389f52e21ab-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:34:14 user nova-compute[85141]: INFO nova.compute.manager [None req-5ff03b5e-98ec-4cc9-ae11-05d8489404d0 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] [instance: f432d8f9-10c4-49e3-bf3b-6389f52e21ab] Terminating instance
Nov 16 10:34:14 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5ff03b5e-98ec-4cc9-ae11-05d8489404d0 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] [instance: f432d8f9-10c4-49e3-bf3b-6389f52e21ab] Start destroying the instance on the hypervisor. {{(pid=85141) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 10:34:14 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:34:14 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:34:14 user nova-compute[85141]: DEBUG nova.network.neutron [req-c8bf2610-f24b-421c-a88f-bf32835cc0e4 req-37ccdcf7-089a-4291-8761-7266e70d07b8 service nova] [instance: f432d8f9-10c4-49e3-bf3b-6389f52e21ab] Updated VIF entry in instance network info cache for port e8cc6756-287d-4451-9119-7ca5779ca62c. {{(pid=85141) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 10:34:14 user nova-compute[85141]: DEBUG nova.network.neutron [req-c8bf2610-f24b-421c-a88f-bf32835cc0e4 req-37ccdcf7-089a-4291-8761-7266e70d07b8 service nova] [instance: f432d8f9-10c4-49e3-bf3b-6389f52e21ab] Updating instance_info_cache with network_info: [{"id": "e8cc6756-287d-4451-9119-7ca5779ca62c", "address": "fa:16:3e:c3:18:3e", "network": {"id": "a8f7d218-f758-44d8-adb3-120a5f724f70", "bridge": "br-int", "label": "tempest-TestStampPattern-1966889964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fb187d45ec54e74a0721973235f98b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8cc6756-28", "ovs_interfaceid": "e8cc6756-287d-4451-9119-7ca5779ca62c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:34:14 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:34:14 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-c8bf2610-f24b-421c-a88f-bf32835cc0e4 req-37ccdcf7-089a-4291-8761-7266e70d07b8 service nova] Releasing lock "refresh_cache-f432d8f9-10c4-49e3-bf3b-6389f52e21ab" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:34:14 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:34:14 user nova-compute[85141]: DEBUG nova.compute.manager [req-fa69cc94-5370-4a78-9a78-0ab8ccaa56c0 req-c6c926df-50ac-43ed-8d27-feef9e083a5b service nova] [instance: f432d8f9-10c4-49e3-bf3b-6389f52e21ab] Received event network-vif-unplugged-e8cc6756-287d-4451-9119-7ca5779ca62c {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:34:14 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-fa69cc94-5370-4a78-9a78-0ab8ccaa56c0 req-c6c926df-50ac-43ed-8d27-feef9e083a5b service nova] Acquiring lock "f432d8f9-10c4-49e3-bf3b-6389f52e21ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:34:14 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-fa69cc94-5370-4a78-9a78-0ab8ccaa56c0 req-c6c926df-50ac-43ed-8d27-feef9e083a5b service nova] Lock "f432d8f9-10c4-49e3-bf3b-6389f52e21ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:34:14 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-fa69cc94-5370-4a78-9a78-0ab8ccaa56c0 req-c6c926df-50ac-43ed-8d27-feef9e083a5b service nova] Lock "f432d8f9-10c4-49e3-bf3b-6389f52e21ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:34:14 user nova-compute[85141]: DEBUG nova.compute.manager [req-fa69cc94-5370-4a78-9a78-0ab8ccaa56c0 req-c6c926df-50ac-43ed-8d27-feef9e083a5b service nova] [instance: f432d8f9-10c4-49e3-bf3b-6389f52e21ab] No waiting events found dispatching network-vif-unplugged-e8cc6756-287d-4451-9119-7ca5779ca62c {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:34:14 user nova-compute[85141]: DEBUG nova.compute.manager [req-fa69cc94-5370-4a78-9a78-0ab8ccaa56c0 req-c6c926df-50ac-43ed-8d27-feef9e083a5b service nova] [instance: f432d8f9-10c4-49e3-bf3b-6389f52e21ab] Received event network-vif-unplugged-e8cc6756-287d-4451-9119-7ca5779ca62c for instance with task_state deleting. {{(pid=85141) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 10:34:15 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:34:15 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:34:15 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:34:15 user nova-compute[85141]: INFO nova.virt.libvirt.driver [-] [instance: f432d8f9-10c4-49e3-bf3b-6389f52e21ab] Instance destroyed successfully.
Nov 16 10:34:15 user nova-compute[85141]: DEBUG nova.objects.instance [None req-5ff03b5e-98ec-4cc9-ae11-05d8489404d0 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Lazy-loading 'resources' on Instance uuid f432d8f9-10c4-49e3-bf3b-6389f52e21ab {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:34:15 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-5ff03b5e-98ec-4cc9-ae11-05d8489404d0 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T10:31:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-392613206',display_name='tempest-TestStampPattern-server-392613206',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-392613206',id=43,image_ref='94642f60-38cf-40f1-8b96-e14a357ee931',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHF1TofF/AHeRXw7sOS6/Y4wIEeeHYvjmPtqSMUQwk4rvI03M+9FGX8I4Wssar9zDuv0PRZIDidniJXR8tQIzSEDKx9zL7EpsVLQYl+cVUTa2/jPhGRM8ZPjKll4UR2MBA==',key_name='tempest-TestStampPattern-1189059507',keypairs=<?>,launch_index=0,launched_at=2023-11-16T10:31:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5fb187d45ec54e74a0721973235f98b0',ramdisk_id='',reservation_id='r-saobuqhi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='da42de06-4518-4c8a-8c63-9b5a2759a1bf',image_min_disk='1',image_min_ram='0',image_owner_id='5fb187d45ec54e74a0721973235f98b0',image_owner_project_name='tempest-TestStampPattern-2139210362',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-2139210362-project-member',image_user_id='ef2996a7b2b54ae38380743cf424dc18',owner_project_name='tempest-TestStampPattern-2139210362',owner_user_name='tempest-TestStampPattern-2139210362-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T10:31:31Z,user_data=None,user_id='ef2996a7b2b54ae38380743cf424dc18',uuid=f432d8f9-10c4-49e3-bf3b-6389f52e21ab,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e8cc6756-287d-4451-9119-7ca5779ca62c", "address": "fa:16:3e:c3:18:3e", "network": {"id": "a8f7d218-f758-44d8-adb3-120a5f724f70", "bridge": "br-int", "label": "tempest-TestStampPattern-1966889964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fb187d45ec54e74a0721973235f98b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8cc6756-28", "ovs_interfaceid": "e8cc6756-287d-4451-9119-7ca5779ca62c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 10:34:15 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-5ff03b5e-98ec-4cc9-ae11-05d8489404d0 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Converting VIF {"id": "e8cc6756-287d-4451-9119-7ca5779ca62c", "address": "fa:16:3e:c3:18:3e", "network": {"id": "a8f7d218-f758-44d8-adb3-120a5f724f70", "bridge": "br-int", "label": "tempest-TestStampPattern-1966889964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fb187d45ec54e74a0721973235f98b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8cc6756-28", "ovs_interfaceid": "e8cc6756-287d-4451-9119-7ca5779ca62c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:34:15 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-5ff03b5e-98ec-4cc9-ae11-05d8489404d0 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c3:18:3e,bridge_name='br-int',has_traffic_filtering=True,id=e8cc6756-287d-4451-9119-7ca5779ca62c,network=Network(a8f7d218-f758-44d8-adb3-120a5f724f70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8cc6756-28') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:34:15 user nova-compute[85141]: DEBUG os_vif [None req-5ff03b5e-98ec-4cc9-ae11-05d8489404d0 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c3:18:3e,bridge_name='br-int',has_traffic_filtering=True,id=e8cc6756-287d-4451-9119-7ca5779ca62c,network=Network(a8f7d218-f758-44d8-adb3-120a5f724f70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8cc6756-28') {{(pid=85141) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 10:34:15 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:34:15 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape8cc6756-28, bridge=br-int, if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:34:15 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:34:15 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:34:15 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:34:15 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9b320f42-199f-43ce-a1fb-660709828657) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:34:15 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:34:15 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:34:15 user nova-compute[85141]: INFO os_vif [None req-5ff03b5e-98ec-4cc9-ae11-05d8489404d0 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c3:18:3e,bridge_name='br-int',has_traffic_filtering=True,id=e8cc6756-287d-4451-9119-7ca5779ca62c,network=Network(a8f7d218-f758-44d8-adb3-120a5f724f70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8cc6756-28')
Nov 16 10:34:15 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-5ff03b5e-98ec-4cc9-ae11-05d8489404d0 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] [instance: f432d8f9-10c4-49e3-bf3b-6389f52e21ab] Deleting instance files /opt/stack/data/nova/instances/f432d8f9-10c4-49e3-bf3b-6389f52e21ab_del
Nov 16 10:34:15 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-5ff03b5e-98ec-4cc9-ae11-05d8489404d0 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] [instance: f432d8f9-10c4-49e3-bf3b-6389f52e21ab] Deletion of /opt/stack/data/nova/instances/f432d8f9-10c4-49e3-bf3b-6389f52e21ab_del complete
Nov 16 10:34:15 user nova-compute[85141]: INFO nova.compute.manager [None req-5ff03b5e-98ec-4cc9-ae11-05d8489404d0 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] [instance: f432d8f9-10c4-49e3-bf3b-6389f52e21ab] Took 0.95 seconds to destroy the instance on the hypervisor.
Nov 16 10:34:15 user nova-compute[85141]: DEBUG oslo.service.loopingcall [None req-5ff03b5e-98ec-4cc9-ae11-05d8489404d0 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=85141) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 10:34:15 user nova-compute[85141]: DEBUG nova.compute.manager [-] [instance: f432d8f9-10c4-49e3-bf3b-6389f52e21ab] Deallocating network for instance {{(pid=85141) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 10:34:15 user nova-compute[85141]: DEBUG nova.network.neutron [-] [instance: f432d8f9-10c4-49e3-bf3b-6389f52e21ab] deallocate_for_instance() {{(pid=85141) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 10:34:15 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:34:15 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:34:15 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:34:15 user nova-compute[85141]: DEBUG nova.network.neutron [-] [instance: f432d8f9-10c4-49e3-bf3b-6389f52e21ab] Updating instance_info_cache with network_info: [] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:34:15 user nova-compute[85141]: INFO nova.compute.manager [-] [instance: f432d8f9-10c4-49e3-bf3b-6389f52e21ab] Took 0.58 seconds to deallocate network for instance.
Nov 16 10:34:15 user nova-compute[85141]: DEBUG nova.compute.manager [req-abd03c8e-bdf5-45b9-9f2c-33e49710557d req-87faa397-e722-4ca2-9c35-ca8e9cfa42cb service nova] [instance: f432d8f9-10c4-49e3-bf3b-6389f52e21ab] Received event network-vif-deleted-e8cc6756-287d-4451-9119-7ca5779ca62c {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:34:15 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5ff03b5e-98ec-4cc9-ae11-05d8489404d0 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:34:15 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5ff03b5e-98ec-4cc9-ae11-05d8489404d0 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:34:16 user nova-compute[85141]: DEBUG nova.compute.provider_tree [None req-5ff03b5e-98ec-4cc9-ae11-05d8489404d0 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Inventory has not changed in ProviderTree for provider: bf8e0fa1-16b6-408f-9203-c4cd63916272 {{(pid=85141) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 10:34:16 user nova-compute[85141]: DEBUG nova.scheduler.client.report [None req-5ff03b5e-98ec-4cc9-ae11-05d8489404d0 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Inventory has not changed for provider bf8e0fa1-16b6-408f-9203-c4cd63916272 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=85141) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 10:34:16 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5ff03b5e-98ec-4cc9-ae11-05d8489404d0 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.272s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:34:16 user nova-compute[85141]: INFO nova.scheduler.client.report [None req-5ff03b5e-98ec-4cc9-ae11-05d8489404d0 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Deleted allocations for instance f432d8f9-10c4-49e3-bf3b-6389f52e21ab
Nov 16 10:34:16 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5ff03b5e-98ec-4cc9-ae11-05d8489404d0 tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Lock "f432d8f9-10c4-49e3-bf3b-6389f52e21ab" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.197s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:34:16 user nova-compute[85141]: DEBUG nova.compute.manager [req-e5ff4623-c909-4273-81e9-8cdb7f28321b req-a373f8de-275f-4144-8727-5f4585313680 service nova] [instance: f432d8f9-10c4-49e3-bf3b-6389f52e21ab] Received event network-vif-plugged-e8cc6756-287d-4451-9119-7ca5779ca62c {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:34:16 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-e5ff4623-c909-4273-81e9-8cdb7f28321b req-a373f8de-275f-4144-8727-5f4585313680 service nova] Acquiring lock "f432d8f9-10c4-49e3-bf3b-6389f52e21ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:34:16 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-e5ff4623-c909-4273-81e9-8cdb7f28321b req-a373f8de-275f-4144-8727-5f4585313680 service nova] Lock "f432d8f9-10c4-49e3-bf3b-6389f52e21ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:34:16 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-e5ff4623-c909-4273-81e9-8cdb7f28321b req-a373f8de-275f-4144-8727-5f4585313680 service nova] Lock "f432d8f9-10c4-49e3-bf3b-6389f52e21ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:34:16 user nova-compute[85141]: DEBUG nova.compute.manager [req-e5ff4623-c909-4273-81e9-8cdb7f28321b req-a373f8de-275f-4144-8727-5f4585313680 service nova] [instance: f432d8f9-10c4-49e3-bf3b-6389f52e21ab] No waiting events found dispatching network-vif-plugged-e8cc6756-287d-4451-9119-7ca5779ca62c {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:34:16 user nova-compute[85141]: WARNING nova.compute.manager [req-e5ff4623-c909-4273-81e9-8cdb7f28321b req-a373f8de-275f-4144-8727-5f4585313680 service nova] [instance: f432d8f9-10c4-49e3-bf3b-6389f52e21ab] Received unexpected event network-vif-plugged-e8cc6756-287d-4451-9119-7ca5779ca62c for instance with vm_state deleted and task_state None.
Nov 16 10:34:20 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:34:23 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:34:25 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:34:25 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:34:28 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:34:28 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:34:30 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:34:31 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:34:33 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:34:35 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:34:36 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:34:36 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:34:38 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:34:38 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:34:39 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:34:39 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Starting heal instance info cache {{(pid=85141) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 10:34:39 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Acquiring lock "refresh_cache-ac3f3bc9-f5e2-4dc8-bf62-3649611da824" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:34:39 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Acquired lock "refresh_cache-ac3f3bc9-f5e2-4dc8-bf62-3649611da824" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:34:39 user nova-compute[85141]: DEBUG nova.network.neutron [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] [instance: ac3f3bc9-f5e2-4dc8-bf62-3649611da824] Forcefully refreshing network info cache for instance {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 10:34:40 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:34:40 user nova-compute[85141]: DEBUG nova.network.neutron [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] [instance: ac3f3bc9-f5e2-4dc8-bf62-3649611da824] Updating instance_info_cache with network_info: [{"id": "57dd011e-4f3b-44bd-a8e1-e17a515e29e2", "address": "fa:16:3e:28:e8:42", "network": {"id": "ef4876c8-a963-4474-894f-71371d1313da", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-459369775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7439b97798684ddfb5c98026abe079d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57dd011e-4f", "ovs_interfaceid": "57dd011e-4f3b-44bd-a8e1-e17a515e29e2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:34:40 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Releasing lock "refresh_cache-ac3f3bc9-f5e2-4dc8-bf62-3649611da824" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:34:40 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] [instance: ac3f3bc9-f5e2-4dc8-bf62-3649611da824] Updated the network info_cache for instance {{(pid=85141) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 10:34:40 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:34:40 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=85141) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 10:34:41 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:34:42 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:34:42 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:34:42 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager.update_available_resource {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:34:42 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:34:42 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:34:42 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:34:42 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Auditing locally available compute resources for user (node: user) {{(pid=85141) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 10:34:42 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f1b7a62-fdc2-4b8e-b9f8-61105c0fcb5c/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:34:42 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f1b7a62-fdc2-4b8e-b9f8-61105c0fcb5c/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:34:42 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f1b7a62-fdc2-4b8e-b9f8-61105c0fcb5c/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:34:42 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f1b7a62-fdc2-4b8e-b9f8-61105c0fcb5c/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:34:42 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=85141) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 10:34:42 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=85141) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 10:34:42 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da42de06-4518-4c8a-8c63-9b5a2759a1bf/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:34:43 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da42de06-4518-4c8a-8c63-9b5a2759a1bf/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:34:43 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da42de06-4518-4c8a-8c63-9b5a2759a1bf/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:34:43 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-a8fb9010-539b-4bcd-b70f-98734b9bfb56 tempest-TestServerVolumeAttachScenarioOldVersion-263106525 tempest-TestServerVolumeAttachScenarioOldVersion-263106525-project-member] Acquiring lock "ac3f3bc9-f5e2-4dc8-bf62-3649611da824" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:34:43 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-a8fb9010-539b-4bcd-b70f-98734b9bfb56 tempest-TestServerVolumeAttachScenarioOldVersion-263106525 tempest-TestServerVolumeAttachScenarioOldVersion-263106525-project-member] Lock "ac3f3bc9-f5e2-4dc8-bf62-3649611da824" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:34:43 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-a8fb9010-539b-4bcd-b70f-98734b9bfb56 tempest-TestServerVolumeAttachScenarioOldVersion-263106525 tempest-TestServerVolumeAttachScenarioOldVersion-263106525-project-member] Acquiring lock "ac3f3bc9-f5e2-4dc8-bf62-3649611da824-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:34:43 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-a8fb9010-539b-4bcd-b70f-98734b9bfb56 tempest-TestServerVolumeAttachScenarioOldVersion-263106525 tempest-TestServerVolumeAttachScenarioOldVersion-263106525-project-member] Lock "ac3f3bc9-f5e2-4dc8-bf62-3649611da824-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:34:43 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-a8fb9010-539b-4bcd-b70f-98734b9bfb56 tempest-TestServerVolumeAttachScenarioOldVersion-263106525 tempest-TestServerVolumeAttachScenarioOldVersion-263106525-project-member] Lock "ac3f3bc9-f5e2-4dc8-bf62-3649611da824-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:34:43 user nova-compute[85141]: INFO nova.compute.manager [None req-a8fb9010-539b-4bcd-b70f-98734b9bfb56 tempest-TestServerVolumeAttachScenarioOldVersion-263106525 tempest-TestServerVolumeAttachScenarioOldVersion-263106525-project-member] [instance: ac3f3bc9-f5e2-4dc8-bf62-3649611da824] Terminating instance
Nov 16 10:34:43 user nova-compute[85141]: DEBUG nova.compute.manager [None req-a8fb9010-539b-4bcd-b70f-98734b9bfb56 tempest-TestServerVolumeAttachScenarioOldVersion-263106525 tempest-TestServerVolumeAttachScenarioOldVersion-263106525-project-member] [instance: ac3f3bc9-f5e2-4dc8-bf62-3649611da824] Start destroying the instance on the hypervisor. {{(pid=85141) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 10:34:43 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da42de06-4518-4c8a-8c63-9b5a2759a1bf/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:34:43 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b29fe8bd-8169-497f-91b4-0e03360f5a1c/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:34:43 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:34:43 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:34:43 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:34:43 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:34:43 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:34:43 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b29fe8bd-8169-497f-91b4-0e03360f5a1c/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:34:43 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b29fe8bd-8169-497f-91b4-0e03360f5a1c/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:34:43 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:34:43 user nova-compute[85141]: DEBUG nova.compute.manager [req-bfd38fa3-985d-41b7-8e59-43a2877207ae req-b545e0ac-187f-4b79-a999-3a8a75deac9e service nova] [instance: ac3f3bc9-f5e2-4dc8-bf62-3649611da824] Received event network-vif-unplugged-57dd011e-4f3b-44bd-a8e1-e17a515e29e2 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:34:43 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-bfd38fa3-985d-41b7-8e59-43a2877207ae req-b545e0ac-187f-4b79-a999-3a8a75deac9e service nova] Acquiring lock "ac3f3bc9-f5e2-4dc8-bf62-3649611da824-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:34:43 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-bfd38fa3-985d-41b7-8e59-43a2877207ae req-b545e0ac-187f-4b79-a999-3a8a75deac9e service nova] Lock "ac3f3bc9-f5e2-4dc8-bf62-3649611da824-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:34:43 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-bfd38fa3-985d-41b7-8e59-43a2877207ae req-b545e0ac-187f-4b79-a999-3a8a75deac9e service nova] Lock "ac3f3bc9-f5e2-4dc8-bf62-3649611da824-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:34:43 user nova-compute[85141]: DEBUG nova.compute.manager [req-bfd38fa3-985d-41b7-8e59-43a2877207ae req-b545e0ac-187f-4b79-a999-3a8a75deac9e service nova] [instance: ac3f3bc9-f5e2-4dc8-bf62-3649611da824] No waiting events found dispatching network-vif-unplugged-57dd011e-4f3b-44bd-a8e1-e17a515e29e2 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:34:43 user nova-compute[85141]: DEBUG nova.compute.manager [req-bfd38fa3-985d-41b7-8e59-43a2877207ae req-b545e0ac-187f-4b79-a999-3a8a75deac9e service nova] [instance: ac3f3bc9-f5e2-4dc8-bf62-3649611da824] Received event network-vif-unplugged-57dd011e-4f3b-44bd-a8e1-e17a515e29e2 for instance with task_state deleting. {{(pid=85141) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 10:34:43 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b29fe8bd-8169-497f-91b4-0e03360f5a1c/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:34:44 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac3f3bc9-f5e2-4dc8-bf62-3649611da824/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:34:44 user nova-compute[85141]: INFO nova.virt.libvirt.driver [-] [instance: ac3f3bc9-f5e2-4dc8-bf62-3649611da824] Instance destroyed successfully.
Nov 16 10:34:44 user nova-compute[85141]: DEBUG nova.objects.instance [None req-a8fb9010-539b-4bcd-b70f-98734b9bfb56 tempest-TestServerVolumeAttachScenarioOldVersion-263106525 tempest-TestServerVolumeAttachScenarioOldVersion-263106525-project-member] Lazy-loading 'resources' on Instance uuid ac3f3bc9-f5e2-4dc8-bf62-3649611da824 {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:34:44 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-a8fb9010-539b-4bcd-b70f-98734b9bfb56 tempest-TestServerVolumeAttachScenarioOldVersion-263106525 tempest-TestServerVolumeAttachScenarioOldVersion-263106525-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T10:31:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1630724157',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1630724157',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1630724',id=44,image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHLSgP+AL3EOr7wtsiRGgI+eODUyi+l+ylR0QErUYK/fxaI0AzjLVGrR+UJBFTC3sNOVDiWIFsHxiQsRr9FX+sFyoOnMVWkcrVdRrewE75k2+ICLMvfOikgPNgTTZOmelQ==',key_name='tempest-keypair-456696076',keypairs=<?>,launch_index=0,launched_at=2023-11-16T10:31:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7439b97798684ddfb5c98026abe079d0',ramdisk_id='',reservation_id='r-c2fk4efh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-263106525',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-263106525-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T10:31:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1490d069bf4c4783a82300496a38b141',uuid=ac3f3bc9-f5e2-4dc8-bf62-3649611da824,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "57dd011e-4f3b-44bd-a8e1-e17a515e29e2", "address": "fa:16:3e:28:e8:42", "network": {"id": "ef4876c8-a963-4474-894f-71371d1313da", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-459369775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7439b97798684ddfb5c98026abe079d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57dd011e-4f", "ovs_interfaceid": "57dd011e-4f3b-44bd-a8e1-e17a515e29e2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 10:34:44 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-a8fb9010-539b-4bcd-b70f-98734b9bfb56 tempest-TestServerVolumeAttachScenarioOldVersion-263106525 tempest-TestServerVolumeAttachScenarioOldVersion-263106525-project-member] Converting VIF {"id": "57dd011e-4f3b-44bd-a8e1-e17a515e29e2", "address": "fa:16:3e:28:e8:42", "network": {"id": "ef4876c8-a963-4474-894f-71371d1313da", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-459369775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7439b97798684ddfb5c98026abe079d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57dd011e-4f", "ovs_interfaceid": "57dd011e-4f3b-44bd-a8e1-e17a515e29e2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:34:44 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-a8fb9010-539b-4bcd-b70f-98734b9bfb56 tempest-TestServerVolumeAttachScenarioOldVersion-263106525 tempest-TestServerVolumeAttachScenarioOldVersion-263106525-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:28:e8:42,bridge_name='br-int',has_traffic_filtering=True,id=57dd011e-4f3b-44bd-a8e1-e17a515e29e2,network=Network(ef4876c8-a963-4474-894f-71371d1313da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57dd011e-4f') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:34:44 user nova-compute[85141]: DEBUG os_vif [None req-a8fb9010-539b-4bcd-b70f-98734b9bfb56 tempest-TestServerVolumeAttachScenarioOldVersion-263106525 tempest-TestServerVolumeAttachScenarioOldVersion-263106525-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:28:e8:42,bridge_name='br-int',has_traffic_filtering=True,id=57dd011e-4f3b-44bd-a8e1-e17a515e29e2,network=Network(ef4876c8-a963-4474-894f-71371d1313da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57dd011e-4f') {{(pid=85141) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 10:34:44 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:34:44 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap57dd011e-4f, bridge=br-int, if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:34:44 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:34:44 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:34:44 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:34:44 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8d029781-332a-4b6a-9231-aaa8be7cbc35) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:34:44 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:34:44 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:34:44 user nova-compute[85141]: INFO os_vif [None req-a8fb9010-539b-4bcd-b70f-98734b9bfb56 tempest-TestServerVolumeAttachScenarioOldVersion-263106525 tempest-TestServerVolumeAttachScenarioOldVersion-263106525-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:28:e8:42,bridge_name='br-int',has_traffic_filtering=True,id=57dd011e-4f3b-44bd-a8e1-e17a515e29e2,network=Network(ef4876c8-a963-4474-894f-71371d1313da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57dd011e-4f')
Nov 16 10:34:44 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-a8fb9010-539b-4bcd-b70f-98734b9bfb56 tempest-TestServerVolumeAttachScenarioOldVersion-263106525 tempest-TestServerVolumeAttachScenarioOldVersion-263106525-project-member] [instance: ac3f3bc9-f5e2-4dc8-bf62-3649611da824] Deleting instance files /opt/stack/data/nova/instances/ac3f3bc9-f5e2-4dc8-bf62-3649611da824_del
Nov 16 10:34:44 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-a8fb9010-539b-4bcd-b70f-98734b9bfb56 tempest-TestServerVolumeAttachScenarioOldVersion-263106525 tempest-TestServerVolumeAttachScenarioOldVersion-263106525-project-member] [instance: ac3f3bc9-f5e2-4dc8-bf62-3649611da824] Deletion of /opt/stack/data/nova/instances/ac3f3bc9-f5e2-4dc8-bf62-3649611da824_del complete
Nov 16 10:34:44 user nova-compute[85141]: INFO nova.compute.manager [None req-a8fb9010-539b-4bcd-b70f-98734b9bfb56 tempest-TestServerVolumeAttachScenarioOldVersion-263106525 tempest-TestServerVolumeAttachScenarioOldVersion-263106525-project-member] [instance: ac3f3bc9-f5e2-4dc8-bf62-3649611da824] Took 0.96 seconds to destroy the instance on the hypervisor.
Nov 16 10:34:44 user nova-compute[85141]: DEBUG oslo.service.loopingcall [None req-a8fb9010-539b-4bcd-b70f-98734b9bfb56 tempest-TestServerVolumeAttachScenarioOldVersion-263106525 tempest-TestServerVolumeAttachScenarioOldVersion-263106525-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=85141) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 10:34:44 user nova-compute[85141]: DEBUG nova.compute.manager [-] [instance: ac3f3bc9-f5e2-4dc8-bf62-3649611da824] Deallocating network for instance {{(pid=85141) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 10:34:44 user nova-compute[85141]: DEBUG nova.network.neutron [-] [instance: ac3f3bc9-f5e2-4dc8-bf62-3649611da824] deallocate_for_instance() {{(pid=85141) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 10:34:44 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac3f3bc9-f5e2-4dc8-bf62-3649611da824/disk --force-share --output=json" returned: 1 in 0.194s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:34:44 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac3f3bc9-f5e2-4dc8-bf62-3649611da824/disk --force-share --output=json' failed. Not Retrying. {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 10:34:44 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Periodic task is updating the host stats, it is trying to get disk info for instance-0000002c, but the backing disk storage was removed by a concurrent operation such as resize. Error: No disk at /opt/stack/data/nova/instances/ac3f3bc9-f5e2-4dc8-bf62-3649611da824/disk: nova.exception.DiskNotFound: No disk at /opt/stack/data/nova/instances/ac3f3bc9-f5e2-4dc8-bf62-3649611da824/disk
Nov 16 10:34:44 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:34:44 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:34:44 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Hypervisor/Node resource view: name=user free_ram=8180MB free_disk=24.902725219726562GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=85141) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 10:34:44 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:34:44 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:34:44 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance da42de06-4518-4c8a-8c63-9b5a2759a1bf actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:34:44 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance ac3f3bc9-f5e2-4dc8-bf62-3649611da824 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:34:44 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance 2f1b7a62-fdc2-4b8e-b9f8-61105c0fcb5c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:34:44 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance 6c284db0-2aa8-4680-ab40-7e9861f8449b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:34:44 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance b29fe8bd-8169-497f-91b4-0e03360f5a1c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:34:44 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=85141) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 10:34:44 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=85141) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 10:34:44 user nova-compute[85141]: DEBUG nova.compute.provider_tree [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Inventory has not changed in ProviderTree for provider: bf8e0fa1-16b6-408f-9203-c4cd63916272 {{(pid=85141) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 10:34:44 user nova-compute[85141]: DEBUG nova.scheduler.client.report [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Inventory has not changed for provider bf8e0fa1-16b6-408f-9203-c4cd63916272 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=85141) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 10:34:44 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Compute_service record updated for user:user {{(pid=85141) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 10:34:44 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.293s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:34:45 user nova-compute[85141]: DEBUG nova.compute.manager [req-9fa01d12-155b-4db0-b581-d9fb2879b5c5 req-f4ae37bc-204b-4a8c-a3db-2c7de9e98bd6 service nova] [instance: ac3f3bc9-f5e2-4dc8-bf62-3649611da824] Received event network-vif-plugged-57dd011e-4f3b-44bd-a8e1-e17a515e29e2 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:34:45 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-9fa01d12-155b-4db0-b581-d9fb2879b5c5 req-f4ae37bc-204b-4a8c-a3db-2c7de9e98bd6 service nova] Acquiring lock "ac3f3bc9-f5e2-4dc8-bf62-3649611da824-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:34:45 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-9fa01d12-155b-4db0-b581-d9fb2879b5c5 req-f4ae37bc-204b-4a8c-a3db-2c7de9e98bd6 service nova] Lock "ac3f3bc9-f5e2-4dc8-bf62-3649611da824-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:34:45 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-9fa01d12-155b-4db0-b581-d9fb2879b5c5 req-f4ae37bc-204b-4a8c-a3db-2c7de9e98bd6 service nova] Lock "ac3f3bc9-f5e2-4dc8-bf62-3649611da824-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:34:45 user nova-compute[85141]: DEBUG nova.compute.manager [req-9fa01d12-155b-4db0-b581-d9fb2879b5c5 req-f4ae37bc-204b-4a8c-a3db-2c7de9e98bd6 service nova] [instance: ac3f3bc9-f5e2-4dc8-bf62-3649611da824] No waiting events found dispatching network-vif-plugged-57dd011e-4f3b-44bd-a8e1-e17a515e29e2 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:34:45 user nova-compute[85141]: WARNING nova.compute.manager [req-9fa01d12-155b-4db0-b581-d9fb2879b5c5 req-f4ae37bc-204b-4a8c-a3db-2c7de9e98bd6 service nova] [instance: ac3f3bc9-f5e2-4dc8-bf62-3649611da824] Received unexpected event network-vif-plugged-57dd011e-4f3b-44bd-a8e1-e17a515e29e2 for instance with vm_state active and task_state deleting.
Nov 16 10:34:45 user nova-compute[85141]: DEBUG nova.network.neutron [-] [instance: ac3f3bc9-f5e2-4dc8-bf62-3649611da824] Updating instance_info_cache with network_info: [] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:34:45 user nova-compute[85141]: INFO nova.compute.manager [-] [instance: ac3f3bc9-f5e2-4dc8-bf62-3649611da824] Took 1.68 seconds to deallocate network for instance.
Nov 16 10:34:45 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-a8fb9010-539b-4bcd-b70f-98734b9bfb56 tempest-TestServerVolumeAttachScenarioOldVersion-263106525 tempest-TestServerVolumeAttachScenarioOldVersion-263106525-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:34:45 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-a8fb9010-539b-4bcd-b70f-98734b9bfb56 tempest-TestServerVolumeAttachScenarioOldVersion-263106525 tempest-TestServerVolumeAttachScenarioOldVersion-263106525-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:34:46 user nova-compute[85141]: DEBUG nova.compute.provider_tree [None req-a8fb9010-539b-4bcd-b70f-98734b9bfb56 tempest-TestServerVolumeAttachScenarioOldVersion-263106525 tempest-TestServerVolumeAttachScenarioOldVersion-263106525-project-member] Inventory has not changed in ProviderTree for provider: bf8e0fa1-16b6-408f-9203-c4cd63916272 {{(pid=85141) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 10:34:46 user nova-compute[85141]: DEBUG nova.scheduler.client.report [None req-a8fb9010-539b-4bcd-b70f-98734b9bfb56 tempest-TestServerVolumeAttachScenarioOldVersion-263106525 tempest-TestServerVolumeAttachScenarioOldVersion-263106525-project-member] Inventory has not changed for provider bf8e0fa1-16b6-408f-9203-c4cd63916272 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=85141) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 10:34:46 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-a8fb9010-539b-4bcd-b70f-98734b9bfb56 tempest-TestServerVolumeAttachScenarioOldVersion-263106525 tempest-TestServerVolumeAttachScenarioOldVersion-263106525-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.243s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:34:46 user nova-compute[85141]: INFO nova.scheduler.client.report [None req-a8fb9010-539b-4bcd-b70f-98734b9bfb56 tempest-TestServerVolumeAttachScenarioOldVersion-263106525 tempest-TestServerVolumeAttachScenarioOldVersion-263106525-project-member] Deleted allocations for instance ac3f3bc9-f5e2-4dc8-bf62-3649611da824
Nov 16 10:34:46 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-a8fb9010-539b-4bcd-b70f-98734b9bfb56 tempest-TestServerVolumeAttachScenarioOldVersion-263106525 tempest-TestServerVolumeAttachScenarioOldVersion-263106525-project-member] Lock "ac3f3bc9-f5e2-4dc8-bf62-3649611da824" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.125s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:34:46 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:34:46 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:34:46 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:34:47 user nova-compute[85141]: DEBUG nova.compute.manager [req-eebaa2e4-e5bc-4043-ab15-c9939cda56ad req-52e9a590-5911-45d7-8fe4-c366ba229495 service nova] [instance: ac3f3bc9-f5e2-4dc8-bf62-3649611da824] Received event network-vif-deleted-57dd011e-4f3b-44bd-a8e1-e17a515e29e2 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:34:48 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:34:48 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:34:49 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:34:51 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-eb0b26f3-1705-44f4-bd67-90ebe458b3fb tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Acquiring lock "1e01e0e9-5eef-4af4-8633-814d59860b8d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:34:51 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-eb0b26f3-1705-44f4-bd67-90ebe458b3fb tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Lock "1e01e0e9-5eef-4af4-8633-814d59860b8d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:34:51 user nova-compute[85141]: DEBUG nova.compute.manager [None req-eb0b26f3-1705-44f4-bd67-90ebe458b3fb tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] [instance: 1e01e0e9-5eef-4af4-8633-814d59860b8d] Starting instance... {{(pid=85141) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 10:34:51 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-eb0b26f3-1705-44f4-bd67-90ebe458b3fb tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:34:51 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-eb0b26f3-1705-44f4-bd67-90ebe458b3fb tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:34:51 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-eb0b26f3-1705-44f4-bd67-90ebe458b3fb tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=85141) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 10:34:51 user nova-compute[85141]: INFO nova.compute.claims [None req-eb0b26f3-1705-44f4-bd67-90ebe458b3fb tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] [instance: 1e01e0e9-5eef-4af4-8633-814d59860b8d] Claim successful on node user
Nov 16 10:34:51 user nova-compute[85141]: DEBUG nova.compute.provider_tree [None req-eb0b26f3-1705-44f4-bd67-90ebe458b3fb tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Inventory has not changed in ProviderTree for provider: bf8e0fa1-16b6-408f-9203-c4cd63916272 {{(pid=85141) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 10:34:51 user nova-compute[85141]: DEBUG nova.scheduler.client.report [None req-eb0b26f3-1705-44f4-bd67-90ebe458b3fb tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Inventory has not changed for provider bf8e0fa1-16b6-408f-9203-c4cd63916272 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=85141) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 10:34:51 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-eb0b26f3-1705-44f4-bd67-90ebe458b3fb tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.297s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:34:51 user nova-compute[85141]: DEBUG nova.compute.manager [None req-eb0b26f3-1705-44f4-bd67-90ebe458b3fb tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] [instance: 1e01e0e9-5eef-4af4-8633-814d59860b8d] Start building networks asynchronously for instance. {{(pid=85141) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 10:34:51 user nova-compute[85141]: DEBUG nova.compute.manager [None req-eb0b26f3-1705-44f4-bd67-90ebe458b3fb tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] [instance: 1e01e0e9-5eef-4af4-8633-814d59860b8d] Allocating IP information in the background. {{(pid=85141) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 10:34:51 user nova-compute[85141]: DEBUG nova.network.neutron [None req-eb0b26f3-1705-44f4-bd67-90ebe458b3fb tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] [instance: 1e01e0e9-5eef-4af4-8633-814d59860b8d] allocate_for_instance() {{(pid=85141) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 10:34:51 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-eb0b26f3-1705-44f4-bd67-90ebe458b3fb tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] [instance: 1e01e0e9-5eef-4af4-8633-814d59860b8d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 10:34:51 user nova-compute[85141]: DEBUG nova.compute.manager [None req-eb0b26f3-1705-44f4-bd67-90ebe458b3fb tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] [instance: 1e01e0e9-5eef-4af4-8633-814d59860b8d] Start building block device mappings for instance. {{(pid=85141) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 10:34:51 user nova-compute[85141]: DEBUG nova.policy [None req-eb0b26f3-1705-44f4-bd67-90ebe458b3fb tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f111c3a73e2845eaa5d2238680805018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a6ef16a7b496a9568f9d777e38412', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85141) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 10:34:51 user nova-compute[85141]: DEBUG nova.compute.manager [None req-eb0b26f3-1705-44f4-bd67-90ebe458b3fb tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] [instance: 1e01e0e9-5eef-4af4-8633-814d59860b8d] Start spawning the instance on the hypervisor. {{(pid=85141) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 10:34:51 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-eb0b26f3-1705-44f4-bd67-90ebe458b3fb tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] [instance: 1e01e0e9-5eef-4af4-8633-814d59860b8d] Creating instance directory {{(pid=85141) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 10:34:51 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-eb0b26f3-1705-44f4-bd67-90ebe458b3fb tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] [instance: 1e01e0e9-5eef-4af4-8633-814d59860b8d] Creating image(s)
Nov 16 10:34:51 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-eb0b26f3-1705-44f4-bd67-90ebe458b3fb tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Acquiring lock "/opt/stack/data/nova/instances/1e01e0e9-5eef-4af4-8633-814d59860b8d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:34:51 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-eb0b26f3-1705-44f4-bd67-90ebe458b3fb tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Lock "/opt/stack/data/nova/instances/1e01e0e9-5eef-4af4-8633-814d59860b8d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:34:51 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-eb0b26f3-1705-44f4-bd67-90ebe458b3fb tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Lock "/opt/stack/data/nova/instances/1e01e0e9-5eef-4af4-8633-814d59860b8d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:34:51 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-eb0b26f3-1705-44f4-bd67-90ebe458b3fb tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:34:52 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-eb0b26f3-1705-44f4-bd67-90ebe458b3fb tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json" returned: 0 in 0.181s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:34:52 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-eb0b26f3-1705-44f4-bd67-90ebe458b3fb tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Acquiring lock "60a78556fb399ed4a41bc3ca4bccf77c96d8e811" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:34:52 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-eb0b26f3-1705-44f4-bd67-90ebe458b3fb tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Lock "60a78556fb399ed4a41bc3ca4bccf77c96d8e811" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:34:52 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-eb0b26f3-1705-44f4-bd67-90ebe458b3fb tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:34:52 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-eb0b26f3-1705-44f4-bd67-90ebe458b3fb tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json" returned: 0 in 0.178s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:34:52 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-eb0b26f3-1705-44f4-bd67-90ebe458b3fb tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811,backing_fmt=raw /opt/stack/data/nova/instances/1e01e0e9-5eef-4af4-8633-814d59860b8d/disk 1073741824 {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:34:52 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-eb0b26f3-1705-44f4-bd67-90ebe458b3fb tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811,backing_fmt=raw /opt/stack/data/nova/instances/1e01e0e9-5eef-4af4-8633-814d59860b8d/disk 1073741824" returned: 0 in 0.056s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:34:52 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-eb0b26f3-1705-44f4-bd67-90ebe458b3fb tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Lock "60a78556fb399ed4a41bc3ca4bccf77c96d8e811" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.241s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:34:52 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-eb0b26f3-1705-44f4-bd67-90ebe458b3fb tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:34:52 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-eb0b26f3-1705-44f4-bd67-90ebe458b3fb tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json" returned: 0 in 0.176s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:34:52 user nova-compute[85141]: DEBUG nova.virt.disk.api [None req-eb0b26f3-1705-44f4-bd67-90ebe458b3fb tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1e01e0e9-5eef-4af4-8633-814d59860b8d/disk. size=1073741824 {{(pid=85141) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 10:34:52 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-eb0b26f3-1705-44f4-bd67-90ebe458b3fb tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e01e0e9-5eef-4af4-8633-814d59860b8d/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:34:52 user nova-compute[85141]: DEBUG nova.network.neutron [None req-eb0b26f3-1705-44f4-bd67-90ebe458b3fb tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] [instance: 1e01e0e9-5eef-4af4-8633-814d59860b8d] Successfully created port: 6f4c8e31-7ee9-4257-9441-12fff78fb8d1 {{(pid=85141) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 10:34:52 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-eb0b26f3-1705-44f4-bd67-90ebe458b3fb tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e01e0e9-5eef-4af4-8633-814d59860b8d/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:34:52 user nova-compute[85141]: DEBUG nova.virt.disk.api [None req-eb0b26f3-1705-44f4-bd67-90ebe458b3fb tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Cannot resize image /opt/stack/data/nova/instances/1e01e0e9-5eef-4af4-8633-814d59860b8d/disk to a smaller size. {{(pid=85141) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 10:34:52 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-eb0b26f3-1705-44f4-bd67-90ebe458b3fb tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] [instance: 1e01e0e9-5eef-4af4-8633-814d59860b8d] Created local disks {{(pid=85141) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 10:34:52 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-eb0b26f3-1705-44f4-bd67-90ebe458b3fb tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] [instance: 1e01e0e9-5eef-4af4-8633-814d59860b8d] Ensure instance console log exists: /opt/stack/data/nova/instances/1e01e0e9-5eef-4af4-8633-814d59860b8d/console.log {{(pid=85141) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 10:34:52 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-eb0b26f3-1705-44f4-bd67-90ebe458b3fb tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:34:52 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-eb0b26f3-1705-44f4-bd67-90ebe458b3fb tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:34:52 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-eb0b26f3-1705-44f4-bd67-90ebe458b3fb tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:34:53 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:34:53 user nova-compute[85141]: DEBUG nova.network.neutron [None req-eb0b26f3-1705-44f4-bd67-90ebe458b3fb tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] [instance: 1e01e0e9-5eef-4af4-8633-814d59860b8d] Successfully updated port: 6f4c8e31-7ee9-4257-9441-12fff78fb8d1 {{(pid=85141) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 10:34:53 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-eb0b26f3-1705-44f4-bd67-90ebe458b3fb tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Acquiring lock "refresh_cache-1e01e0e9-5eef-4af4-8633-814d59860b8d" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:34:53 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-eb0b26f3-1705-44f4-bd67-90ebe458b3fb tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Acquired lock "refresh_cache-1e01e0e9-5eef-4af4-8633-814d59860b8d" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:34:53 user nova-compute[85141]: DEBUG nova.network.neutron [None req-eb0b26f3-1705-44f4-bd67-90ebe458b3fb tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] [instance: 1e01e0e9-5eef-4af4-8633-814d59860b8d] Building network info cache for instance {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 10:34:53 user nova-compute[85141]: DEBUG nova.compute.manager [req-056b8eed-15ff-4cd9-b1e4-4f5bb76ea6c1 req-c0f6ab8b-73c8-409f-a090-b739e2253a44 service nova] [instance: 1e01e0e9-5eef-4af4-8633-814d59860b8d] Received event network-changed-6f4c8e31-7ee9-4257-9441-12fff78fb8d1 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:34:53 user nova-compute[85141]: DEBUG nova.compute.manager [req-056b8eed-15ff-4cd9-b1e4-4f5bb76ea6c1 req-c0f6ab8b-73c8-409f-a090-b739e2253a44 service nova] [instance: 1e01e0e9-5eef-4af4-8633-814d59860b8d] Refreshing instance network info cache due to event network-changed-6f4c8e31-7ee9-4257-9441-12fff78fb8d1. {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 10:34:53 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-056b8eed-15ff-4cd9-b1e4-4f5bb76ea6c1 req-c0f6ab8b-73c8-409f-a090-b739e2253a44 service nova] Acquiring lock "refresh_cache-1e01e0e9-5eef-4af4-8633-814d59860b8d" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:34:53 user nova-compute[85141]: DEBUG nova.network.neutron [None req-eb0b26f3-1705-44f4-bd67-90ebe458b3fb tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] [instance: 1e01e0e9-5eef-4af4-8633-814d59860b8d] Instance cache missing network info. {{(pid=85141) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 10:34:54 user nova-compute[85141]: DEBUG nova.network.neutron [None req-eb0b26f3-1705-44f4-bd67-90ebe458b3fb tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] [instance: 1e01e0e9-5eef-4af4-8633-814d59860b8d] Updating instance_info_cache with network_info: [{"id": "6f4c8e31-7ee9-4257-9441-12fff78fb8d1", "address": "fa:16:3e:40:7a:69", "network": {"id": "609e6198-811e-4b40-a518-f960e9fc5b91", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1628388169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "647a6ef16a7b496a9568f9d777e38412", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f4c8e31-7e", "ovs_interfaceid": "6f4c8e31-7ee9-4257-9441-12fff78fb8d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:34:54 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-eb0b26f3-1705-44f4-bd67-90ebe458b3fb tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Releasing lock "refresh_cache-1e01e0e9-5eef-4af4-8633-814d59860b8d" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:34:54 user nova-compute[85141]: DEBUG nova.compute.manager [None req-eb0b26f3-1705-44f4-bd67-90ebe458b3fb tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] [instance: 1e01e0e9-5eef-4af4-8633-814d59860b8d] Instance network_info: |[{"id": "6f4c8e31-7ee9-4257-9441-12fff78fb8d1", "address": "fa:16:3e:40:7a:69", "network": {"id": "609e6198-811e-4b40-a518-f960e9fc5b91", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1628388169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "647a6ef16a7b496a9568f9d777e38412", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f4c8e31-7e", "ovs_interfaceid": "6f4c8e31-7ee9-4257-9441-12fff78fb8d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=85141) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 10:34:54 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-056b8eed-15ff-4cd9-b1e4-4f5bb76ea6c1 req-c0f6ab8b-73c8-409f-a090-b739e2253a44 service nova] Acquired lock "refresh_cache-1e01e0e9-5eef-4af4-8633-814d59860b8d" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:34:54 user nova-compute[85141]: DEBUG nova.network.neutron [req-056b8eed-15ff-4cd9-b1e4-4f5bb76ea6c1 req-c0f6ab8b-73c8-409f-a090-b739e2253a44 service nova] [instance: 1e01e0e9-5eef-4af4-8633-814d59860b8d] Refreshing network info cache for port 6f4c8e31-7ee9-4257-9441-12fff78fb8d1 {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 10:34:54 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-eb0b26f3-1705-44f4-bd67-90ebe458b3fb tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] [instance: 1e01e0e9-5eef-4af4-8633-814d59860b8d] Start _get_guest_xml network_info=[{"id": "6f4c8e31-7ee9-4257-9441-12fff78fb8d1", "address": "fa:16:3e:40:7a:69", "network": {"id": "609e6198-811e-4b40-a518-f960e9fc5b91", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1628388169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "647a6ef16a7b496a9568f9d777e38412", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f4c8e31-7e", "ovs_interfaceid": "6f4c8e31-7ee9-4257-9441-12fff78fb8d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T10:06:42Z,direct_url=<?>,disk_format='qcow2',id=bc4ca70f-a459-4d5c-a9e6-80f1948eb48b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1044631a5fe84ce8904864a7024049fa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T10:06:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_options': None, 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'image_id': 'bc4ca70f-a459-4d5c-a9e6-80f1948eb48b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=85141) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 10:34:54 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-eb0b26f3-1705-44f4-bd67-90ebe458b3fb tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:34:54 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-eb0b26f3-1705-44f4-bd67-90ebe458b3fb tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:34:54 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-eb0b26f3-1705-44f4-bd67-90ebe458b3fb tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=85141) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 10:34:54 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-eb0b26f3-1705-44f4-bd67-90ebe458b3fb tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] CPU controller missing on host. {{(pid=85141) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 10:34:54 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-eb0b26f3-1705-44f4-bd67-90ebe458b3fb tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=85141) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 10:34:54 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-eb0b26f3-1705-44f4-bd67-90ebe458b3fb tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] CPU controller found on host. {{(pid=85141) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 10:34:54 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-eb0b26f3-1705-44f4-bd67-90ebe458b3fb tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=85141) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 10:34:54 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-eb0b26f3-1705-44f4-bd67-90ebe458b3fb tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T10:06:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T10:06:42Z,direct_url=<?>,disk_format='qcow2',id=bc4ca70f-a459-4d5c-a9e6-80f1948eb48b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1044631a5fe84ce8904864a7024049fa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T10:06:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 10:34:54 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-eb0b26f3-1705-44f4-bd67-90ebe458b3fb tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Flavor limits 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 10:34:54 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-eb0b26f3-1705-44f4-bd67-90ebe458b3fb tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Image limits 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 10:34:54 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-eb0b26f3-1705-44f4-bd67-90ebe458b3fb tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Flavor pref 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 10:34:54 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-eb0b26f3-1705-44f4-bd67-90ebe458b3fb tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Image pref 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 10:34:54 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-eb0b26f3-1705-44f4-bd67-90ebe458b3fb tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 10:34:54 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-eb0b26f3-1705-44f4-bd67-90ebe458b3fb tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 10:34:54 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-eb0b26f3-1705-44f4-bd67-90ebe458b3fb tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=85141) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 10:34:54 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-eb0b26f3-1705-44f4-bd67-90ebe458b3fb tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Got 1 possible topologies {{(pid=85141) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 10:34:54 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-eb0b26f3-1705-44f4-bd67-90ebe458b3fb tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 10:34:54 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-eb0b26f3-1705-44f4-bd67-90ebe458b3fb tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 10:34:54 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-eb0b26f3-1705-44f4-bd67-90ebe458b3fb tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T10:34:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-571407805',display_name='tempest-SnapshotDataIntegrityTests-server-571407805',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-571407805',id=48,image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJAIjQAU3XGtvIoCMPWRPlLywfyklBRcbuTI4zNVM6Vys6PqP2eeNdXzYKUlSt5eu1ShpmoUNG9dnOTirwdkIIDNCAcRDlJunZZo63ChrJWo0eiovmZYl5WVEuaOjeQH2w==',key_name='tempest-keypair-320551232',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='647a6ef16a7b496a9568f9d777e38412',ramdisk_id='',reservation_id='r-6b6nyvtq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-254660638',owner_user_name='tempest-SnapshotDataIntegrityTests-254660638-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T10:34:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f111c3a73e2845eaa5d2238680805018',uuid=1e01e0e9-5eef-4af4-8633-814d59860b8d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6f4c8e31-7ee9-4257-9441-12fff78fb8d1", "address": "fa:16:3e:40:7a:69", "network": {"id": "609e6198-811e-4b40-a518-f960e9fc5b91", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1628388169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "647a6ef16a7b496a9568f9d777e38412", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f4c8e31-7e", "ovs_interfaceid": "6f4c8e31-7ee9-4257-9441-12fff78fb8d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=85141) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 10:34:54 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-eb0b26f3-1705-44f4-bd67-90ebe458b3fb tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Converting VIF {"id": "6f4c8e31-7ee9-4257-9441-12fff78fb8d1", "address": "fa:16:3e:40:7a:69", "network": {"id": "609e6198-811e-4b40-a518-f960e9fc5b91", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1628388169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "647a6ef16a7b496a9568f9d777e38412", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f4c8e31-7e", "ovs_interfaceid": "6f4c8e31-7ee9-4257-9441-12fff78fb8d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:34:54 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-eb0b26f3-1705-44f4-bd67-90ebe458b3fb tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:40:7a:69,bridge_name='br-int',has_traffic_filtering=True,id=6f4c8e31-7ee9-4257-9441-12fff78fb8d1,network=Network(609e6198-811e-4b40-a518-f960e9fc5b91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f4c8e31-7e') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:34:54 user nova-compute[85141]: DEBUG nova.objects.instance [None req-eb0b26f3-1705-44f4-bd67-90ebe458b3fb tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Lazy-loading 'pci_devices' on Instance uuid 1e01e0e9-5eef-4af4-8633-814d59860b8d {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:34:54 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-eb0b26f3-1705-44f4-bd67-90ebe458b3fb tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] [instance: 1e01e0e9-5eef-4af4-8633-814d59860b8d] End _get_guest_xml xml=<domain type="kvm">
Nov 16 10:34:54 user nova-compute[85141]:   <uuid>1e01e0e9-5eef-4af4-8633-814d59860b8d</uuid>
Nov 16 10:34:54 user nova-compute[85141]:   <name>instance-00000030</name>
Nov 16 10:34:54 user nova-compute[85141]:   <memory>524288</memory>
Nov 16 10:34:54 user nova-compute[85141]:   <vcpu>1</vcpu>
Nov 16 10:34:54 user nova-compute[85141]:   <metadata>
Nov 16 10:34:54 user nova-compute[85141]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 10:34:54 user nova-compute[85141]:       <nova:package version="0.0.0"/>
Nov 16 10:34:54 user nova-compute[85141]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-571407805</nova:name>
Nov 16 10:34:54 user nova-compute[85141]:       <nova:creationTime>2023-11-16 10:34:54</nova:creationTime>
Nov 16 10:34:54 user nova-compute[85141]:       <nova:flavor name="m1.tiny">
Nov 16 10:34:54 user nova-compute[85141]:         <nova:memory>512</nova:memory>
Nov 16 10:34:54 user nova-compute[85141]:         <nova:disk>1</nova:disk>
Nov 16 10:34:54 user nova-compute[85141]:         <nova:swap>0</nova:swap>
Nov 16 10:34:54 user nova-compute[85141]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 10:34:54 user nova-compute[85141]:         <nova:vcpus>1</nova:vcpus>
Nov 16 10:34:54 user nova-compute[85141]:       </nova:flavor>
Nov 16 10:34:54 user nova-compute[85141]:       <nova:owner>
Nov 16 10:34:54 user nova-compute[85141]:         <nova:user uuid="f111c3a73e2845eaa5d2238680805018">tempest-SnapshotDataIntegrityTests-254660638-project-member</nova:user>
Nov 16 10:34:54 user nova-compute[85141]:         <nova:project uuid="647a6ef16a7b496a9568f9d777e38412">tempest-SnapshotDataIntegrityTests-254660638</nova:project>
Nov 16 10:34:54 user nova-compute[85141]:       </nova:owner>
Nov 16 10:34:54 user nova-compute[85141]:       <nova:root type="image" uuid="bc4ca70f-a459-4d5c-a9e6-80f1948eb48b"/>
Nov 16 10:34:54 user nova-compute[85141]:       <nova:ports>
Nov 16 10:34:54 user nova-compute[85141]:         <nova:port uuid="6f4c8e31-7ee9-4257-9441-12fff78fb8d1">
Nov 16 10:34:54 user nova-compute[85141]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 16 10:34:54 user nova-compute[85141]:         </nova:port>
Nov 16 10:34:54 user nova-compute[85141]:       </nova:ports>
Nov 16 10:34:54 user nova-compute[85141]:     </nova:instance>
Nov 16 10:34:54 user nova-compute[85141]:   </metadata>
Nov 16 10:34:54 user nova-compute[85141]:   <sysinfo type="smbios">
Nov 16 10:34:54 user nova-compute[85141]:     <system>
Nov 16 10:34:54 user nova-compute[85141]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 10:34:54 user nova-compute[85141]:       <entry name="product">OpenStack Nova</entry>
Nov 16 10:34:54 user nova-compute[85141]:       <entry name="version">0.0.0</entry>
Nov 16 10:34:54 user nova-compute[85141]:       <entry name="serial">1e01e0e9-5eef-4af4-8633-814d59860b8d</entry>
Nov 16 10:34:54 user nova-compute[85141]:       <entry name="uuid">1e01e0e9-5eef-4af4-8633-814d59860b8d</entry>
Nov 16 10:34:54 user nova-compute[85141]:       <entry name="family">Virtual Machine</entry>
Nov 16 10:34:54 user nova-compute[85141]:     </system>
Nov 16 10:34:54 user nova-compute[85141]:   </sysinfo>
Nov 16 10:34:54 user nova-compute[85141]:   <os>
Nov 16 10:34:54 user nova-compute[85141]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 10:34:54 user nova-compute[85141]:     <boot dev="hd"/>
Nov 16 10:34:54 user nova-compute[85141]:     <smbios mode="sysinfo"/>
Nov 16 10:34:54 user nova-compute[85141]:   </os>
Nov 16 10:34:54 user nova-compute[85141]:   <features>
Nov 16 10:34:54 user nova-compute[85141]:     <acpi/>
Nov 16 10:34:54 user nova-compute[85141]:     <apic/>
Nov 16 10:34:54 user nova-compute[85141]:     <vmcoreinfo/>
Nov 16 10:34:54 user nova-compute[85141]:   </features>
Nov 16 10:34:54 user nova-compute[85141]:   <clock offset="utc">
Nov 16 10:34:54 user nova-compute[85141]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 10:34:54 user nova-compute[85141]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 10:34:54 user nova-compute[85141]:     <timer name="hpet" present="no"/>
Nov 16 10:34:54 user nova-compute[85141]:   </clock>
Nov 16 10:34:54 user nova-compute[85141]:   <cpu mode="custom" match="exact">
Nov 16 10:34:54 user nova-compute[85141]:     <model>Nehalem</model>
Nov 16 10:34:54 user nova-compute[85141]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 10:34:54 user nova-compute[85141]:   </cpu>
Nov 16 10:34:54 user nova-compute[85141]:   <devices>
Nov 16 10:34:54 user nova-compute[85141]:     <disk type="file" device="disk">
Nov 16 10:34:54 user nova-compute[85141]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 10:34:54 user nova-compute[85141]:       <source file="/opt/stack/data/nova/instances/1e01e0e9-5eef-4af4-8633-814d59860b8d/disk"/>
Nov 16 10:34:54 user nova-compute[85141]:       <target dev="vda" bus="virtio"/>
Nov 16 10:34:54 user nova-compute[85141]:     </disk>
Nov 16 10:34:54 user nova-compute[85141]:     <interface type="ethernet">
Nov 16 10:34:54 user nova-compute[85141]:       <mac address="fa:16:3e:40:7a:69"/>
Nov 16 10:34:54 user nova-compute[85141]:       <model type="virtio"/>
Nov 16 10:34:54 user nova-compute[85141]:       <mtu size="1442"/>
Nov 16 10:34:54 user nova-compute[85141]:       <target dev="tap6f4c8e31-7e"/>
Nov 16 10:34:54 user nova-compute[85141]:     </interface>
Nov 16 10:34:54 user nova-compute[85141]:     <serial type="pty">
Nov 16 10:34:54 user nova-compute[85141]:       <log file="/opt/stack/data/nova/instances/1e01e0e9-5eef-4af4-8633-814d59860b8d/console.log" append="off"/>
Nov 16 10:34:54 user nova-compute[85141]:     </serial>
Nov 16 10:34:54 user nova-compute[85141]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 10:34:54 user nova-compute[85141]:     <video>
Nov 16 10:34:54 user nova-compute[85141]:       <model type="virtio"/>
Nov 16 10:34:54 user nova-compute[85141]:     </video>
Nov 16 10:34:54 user nova-compute[85141]:     <rng model="virtio">
Nov 16 10:34:54 user nova-compute[85141]:       <backend model="random">/dev/urandom</backend>
Nov 16 10:34:54 user nova-compute[85141]:     </rng>
Nov 16 10:34:54 user nova-compute[85141]:     <controller type="usb" index="0" model="none"/>
Nov 16 10:34:54 user nova-compute[85141]:     <memballoon model="virtio">
Nov 16 10:34:54 user nova-compute[85141]:       <stats period="10"/>
Nov 16 10:34:54 user nova-compute[85141]:     </memballoon>
Nov 16 10:34:54 user nova-compute[85141]:   </devices>
Nov 16 10:34:54 user nova-compute[85141]: </domain>
Nov 16 10:34:54 user nova-compute[85141]:  {{(pid=85141) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 10:34:54 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-eb0b26f3-1705-44f4-bd67-90ebe458b3fb tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T10:34:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-571407805',display_name='tempest-SnapshotDataIntegrityTests-server-571407805',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-571407805',id=48,image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJAIjQAU3XGtvIoCMPWRPlLywfyklBRcbuTI4zNVM6Vys6PqP2eeNdXzYKUlSt5eu1ShpmoUNG9dnOTirwdkIIDNCAcRDlJunZZo63ChrJWo0eiovmZYl5WVEuaOjeQH2w==',key_name='tempest-keypair-320551232',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='647a6ef16a7b496a9568f9d777e38412',ramdisk_id='',reservation_id='r-6b6nyvtq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-254660638',owner_user_name='tempest-SnapshotDataIntegrityTests-254660638-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T10:34:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f111c3a73e2845eaa5d2238680805018',uuid=1e01e0e9-5eef-4af4-8633-814d59860b8d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6f4c8e31-7ee9-4257-9441-12fff78fb8d1", "address": "fa:16:3e:40:7a:69", "network": {"id": "609e6198-811e-4b40-a518-f960e9fc5b91", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1628388169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "647a6ef16a7b496a9568f9d777e38412", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f4c8e31-7e", "ovs_interfaceid": "6f4c8e31-7ee9-4257-9441-12fff78fb8d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 10:34:54 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-eb0b26f3-1705-44f4-bd67-90ebe458b3fb tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Converting VIF {"id": "6f4c8e31-7ee9-4257-9441-12fff78fb8d1", "address": "fa:16:3e:40:7a:69", "network": {"id": "609e6198-811e-4b40-a518-f960e9fc5b91", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1628388169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "647a6ef16a7b496a9568f9d777e38412", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f4c8e31-7e", "ovs_interfaceid": "6f4c8e31-7ee9-4257-9441-12fff78fb8d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:34:54 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-eb0b26f3-1705-44f4-bd67-90ebe458b3fb tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:40:7a:69,bridge_name='br-int',has_traffic_filtering=True,id=6f4c8e31-7ee9-4257-9441-12fff78fb8d1,network=Network(609e6198-811e-4b40-a518-f960e9fc5b91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f4c8e31-7e') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:34:54 user nova-compute[85141]: DEBUG os_vif [None req-eb0b26f3-1705-44f4-bd67-90ebe458b3fb tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:7a:69,bridge_name='br-int',has_traffic_filtering=True,id=6f4c8e31-7ee9-4257-9441-12fff78fb8d1,network=Network(609e6198-811e-4b40-a518-f960e9fc5b91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f4c8e31-7e') {{(pid=85141) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 10:34:54 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:34:54 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:34:54 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 10:34:54 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:34:54 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:34:54 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a0879256-67ce-5052-95bd-0a4824ff6bba', '_type': 'linux-noop'}}, row=False) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:34:54 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:34:54 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:34:54 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:34:54 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6f4c8e31-7e, may_exist=True, interface_attrs={}) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:34:54 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6f4c8e31-7e, col_values=(('qos', UUID('c3f9a956-f382-4e25-8bbe-693c42c8100a')),), if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:34:54 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6f4c8e31-7e, col_values=(('external_ids', {'iface-id': '6f4c8e31-7ee9-4257-9441-12fff78fb8d1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:40:7a:69', 'vm-uuid': '1e01e0e9-5eef-4af4-8633-814d59860b8d'}),), if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:34:54 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:34:54 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:34:54 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:34:54 user nova-compute[85141]: INFO os_vif [None req-eb0b26f3-1705-44f4-bd67-90ebe458b3fb tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:7a:69,bridge_name='br-int',has_traffic_filtering=True,id=6f4c8e31-7ee9-4257-9441-12fff78fb8d1,network=Network(609e6198-811e-4b40-a518-f960e9fc5b91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f4c8e31-7e')
Nov 16 10:34:54 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-eb0b26f3-1705-44f4-bd67-90ebe458b3fb tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] No BDM found with device name vda, not building metadata. {{(pid=85141) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 10:34:54 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-eb0b26f3-1705-44f4-bd67-90ebe458b3fb tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] No VIF found with MAC fa:16:3e:40:7a:69, not building metadata {{(pid=85141) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 10:34:54 user nova-compute[85141]: DEBUG nova.network.neutron [req-056b8eed-15ff-4cd9-b1e4-4f5bb76ea6c1 req-c0f6ab8b-73c8-409f-a090-b739e2253a44 service nova] [instance: 1e01e0e9-5eef-4af4-8633-814d59860b8d] Updated VIF entry in instance network info cache for port 6f4c8e31-7ee9-4257-9441-12fff78fb8d1. {{(pid=85141) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 10:34:54 user nova-compute[85141]: DEBUG nova.network.neutron [req-056b8eed-15ff-4cd9-b1e4-4f5bb76ea6c1 req-c0f6ab8b-73c8-409f-a090-b739e2253a44 service nova] [instance: 1e01e0e9-5eef-4af4-8633-814d59860b8d] Updating instance_info_cache with network_info: [{"id": "6f4c8e31-7ee9-4257-9441-12fff78fb8d1", "address": "fa:16:3e:40:7a:69", "network": {"id": "609e6198-811e-4b40-a518-f960e9fc5b91", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1628388169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "647a6ef16a7b496a9568f9d777e38412", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f4c8e31-7e", "ovs_interfaceid": "6f4c8e31-7ee9-4257-9441-12fff78fb8d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:34:54 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-056b8eed-15ff-4cd9-b1e4-4f5bb76ea6c1 req-c0f6ab8b-73c8-409f-a090-b739e2253a44 service nova] Releasing lock "refresh_cache-1e01e0e9-5eef-4af4-8633-814d59860b8d" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:34:55 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:34:55 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:34:55 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:34:55 user nova-compute[85141]: DEBUG nova.compute.manager [req-75757106-25f6-4340-b2c0-82dc661e4f68 req-6b305723-a72b-48be-958f-750c0fa0cdf1 service nova] [instance: 1e01e0e9-5eef-4af4-8633-814d59860b8d] Received event network-vif-plugged-6f4c8e31-7ee9-4257-9441-12fff78fb8d1 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:34:55 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-75757106-25f6-4340-b2c0-82dc661e4f68 req-6b305723-a72b-48be-958f-750c0fa0cdf1 service nova] Acquiring lock "1e01e0e9-5eef-4af4-8633-814d59860b8d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:34:55 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-75757106-25f6-4340-b2c0-82dc661e4f68 req-6b305723-a72b-48be-958f-750c0fa0cdf1 service nova] Lock "1e01e0e9-5eef-4af4-8633-814d59860b8d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:34:55 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-75757106-25f6-4340-b2c0-82dc661e4f68 req-6b305723-a72b-48be-958f-750c0fa0cdf1 service nova] Lock "1e01e0e9-5eef-4af4-8633-814d59860b8d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:34:55 user nova-compute[85141]: DEBUG nova.compute.manager [req-75757106-25f6-4340-b2c0-82dc661e4f68 req-6b305723-a72b-48be-958f-750c0fa0cdf1 service nova] [instance: 1e01e0e9-5eef-4af4-8633-814d59860b8d] No waiting events found dispatching network-vif-plugged-6f4c8e31-7ee9-4257-9441-12fff78fb8d1 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:34:55 user nova-compute[85141]: WARNING nova.compute.manager [req-75757106-25f6-4340-b2c0-82dc661e4f68 req-6b305723-a72b-48be-958f-750c0fa0cdf1 service nova] [instance: 1e01e0e9-5eef-4af4-8633-814d59860b8d] Received unexpected event network-vif-plugged-6f4c8e31-7ee9-4257-9441-12fff78fb8d1 for instance with vm_state building and task_state spawning.
Nov 16 10:34:56 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:34:56 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:34:56 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:34:57 user nova-compute[85141]: DEBUG nova.compute.manager [None req-eb0b26f3-1705-44f4-bd67-90ebe458b3fb tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] [instance: 1e01e0e9-5eef-4af4-8633-814d59860b8d] Instance event wait completed in 0 seconds for  {{(pid=85141) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 10:34:57 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-eb0b26f3-1705-44f4-bd67-90ebe458b3fb tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] [instance: 1e01e0e9-5eef-4af4-8633-814d59860b8d] Guest created on hypervisor {{(pid=85141) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 10:34:57 user nova-compute[85141]: INFO nova.virt.libvirt.driver [-] [instance: 1e01e0e9-5eef-4af4-8633-814d59860b8d] Instance spawned successfully.
Nov 16 10:34:57 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-eb0b26f3-1705-44f4-bd67-90ebe458b3fb tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] [instance: 1e01e0e9-5eef-4af4-8633-814d59860b8d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 10:34:57 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-eb0b26f3-1705-44f4-bd67-90ebe458b3fb tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] [instance: 1e01e0e9-5eef-4af4-8633-814d59860b8d] Found default for hw_cdrom_bus of ide {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:34:57 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-eb0b26f3-1705-44f4-bd67-90ebe458b3fb tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] [instance: 1e01e0e9-5eef-4af4-8633-814d59860b8d] Found default for hw_disk_bus of virtio {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:34:57 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-eb0b26f3-1705-44f4-bd67-90ebe458b3fb tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] [instance: 1e01e0e9-5eef-4af4-8633-814d59860b8d] Found default for hw_input_bus of None {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:34:57 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-eb0b26f3-1705-44f4-bd67-90ebe458b3fb tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] [instance: 1e01e0e9-5eef-4af4-8633-814d59860b8d] Found default for hw_pointer_model of None {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:34:57 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-eb0b26f3-1705-44f4-bd67-90ebe458b3fb tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] [instance: 1e01e0e9-5eef-4af4-8633-814d59860b8d] Found default for hw_video_model of virtio {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:34:57 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-eb0b26f3-1705-44f4-bd67-90ebe458b3fb tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] [instance: 1e01e0e9-5eef-4af4-8633-814d59860b8d] Found default for hw_vif_model of virtio {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:34:57 user nova-compute[85141]: INFO nova.compute.manager [None req-eb0b26f3-1705-44f4-bd67-90ebe458b3fb tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] [instance: 1e01e0e9-5eef-4af4-8633-814d59860b8d] Took 6.03 seconds to spawn the instance on the hypervisor.
Nov 16 10:34:57 user nova-compute[85141]: DEBUG nova.compute.manager [None req-eb0b26f3-1705-44f4-bd67-90ebe458b3fb tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] [instance: 1e01e0e9-5eef-4af4-8633-814d59860b8d] Checking state {{(pid=85141) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 10:34:57 user nova-compute[85141]: DEBUG nova.compute.manager [req-9d398e63-8b90-45ed-bb94-e8c05981e59e req-a2d3e9a1-85fd-488f-8641-41c98f8c4775 service nova] [instance: 1e01e0e9-5eef-4af4-8633-814d59860b8d] Received event network-vif-plugged-6f4c8e31-7ee9-4257-9441-12fff78fb8d1 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:34:57 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-9d398e63-8b90-45ed-bb94-e8c05981e59e req-a2d3e9a1-85fd-488f-8641-41c98f8c4775 service nova] Acquiring lock "1e01e0e9-5eef-4af4-8633-814d59860b8d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:34:57 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-9d398e63-8b90-45ed-bb94-e8c05981e59e req-a2d3e9a1-85fd-488f-8641-41c98f8c4775 service nova] Lock "1e01e0e9-5eef-4af4-8633-814d59860b8d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:34:57 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-9d398e63-8b90-45ed-bb94-e8c05981e59e req-a2d3e9a1-85fd-488f-8641-41c98f8c4775 service nova] Lock "1e01e0e9-5eef-4af4-8633-814d59860b8d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:34:57 user nova-compute[85141]: DEBUG nova.compute.manager [req-9d398e63-8b90-45ed-bb94-e8c05981e59e req-a2d3e9a1-85fd-488f-8641-41c98f8c4775 service nova] [instance: 1e01e0e9-5eef-4af4-8633-814d59860b8d] No waiting events found dispatching network-vif-plugged-6f4c8e31-7ee9-4257-9441-12fff78fb8d1 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:34:57 user nova-compute[85141]: WARNING nova.compute.manager [req-9d398e63-8b90-45ed-bb94-e8c05981e59e req-a2d3e9a1-85fd-488f-8641-41c98f8c4775 service nova] [instance: 1e01e0e9-5eef-4af4-8633-814d59860b8d] Received unexpected event network-vif-plugged-6f4c8e31-7ee9-4257-9441-12fff78fb8d1 for instance with vm_state building and task_state spawning.
Nov 16 10:34:57 user nova-compute[85141]: INFO nova.compute.manager [None req-eb0b26f3-1705-44f4-bd67-90ebe458b3fb tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] [instance: 1e01e0e9-5eef-4af4-8633-814d59860b8d] Took 6.65 seconds to build instance.
Nov 16 10:34:57 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-eb0b26f3-1705-44f4-bd67-90ebe458b3fb tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Lock "1e01e0e9-5eef-4af4-8633-814d59860b8d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.768s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:34:58 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:34:59 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:35:03 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:35:04 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:35:06 user nova-compute[85141]: DEBUG nova.compute.manager [req-39b532ec-39f2-4466-ad3c-e290e208004a req-69fe53dd-960e-4b9e-849c-310fcf32622d service nova] [instance: 6c284db0-2aa8-4680-ab40-7e9861f8449b] Received event network-changed-4c31827f-7de8-49d3-a461-d6e83b8faa0d {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:35:06 user nova-compute[85141]: DEBUG nova.compute.manager [req-39b532ec-39f2-4466-ad3c-e290e208004a req-69fe53dd-960e-4b9e-849c-310fcf32622d service nova] [instance: 6c284db0-2aa8-4680-ab40-7e9861f8449b] Refreshing instance network info cache due to event network-changed-4c31827f-7de8-49d3-a461-d6e83b8faa0d. {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 10:35:06 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-39b532ec-39f2-4466-ad3c-e290e208004a req-69fe53dd-960e-4b9e-849c-310fcf32622d service nova] Acquiring lock "refresh_cache-6c284db0-2aa8-4680-ab40-7e9861f8449b" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:35:06 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-39b532ec-39f2-4466-ad3c-e290e208004a req-69fe53dd-960e-4b9e-849c-310fcf32622d service nova] Acquired lock "refresh_cache-6c284db0-2aa8-4680-ab40-7e9861f8449b" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:35:06 user nova-compute[85141]: DEBUG nova.network.neutron [req-39b532ec-39f2-4466-ad3c-e290e208004a req-69fe53dd-960e-4b9e-849c-310fcf32622d service nova] [instance: 6c284db0-2aa8-4680-ab40-7e9861f8449b] Refreshing network info cache for port 4c31827f-7de8-49d3-a461-d6e83b8faa0d {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 10:35:06 user nova-compute[85141]: DEBUG nova.network.neutron [req-39b532ec-39f2-4466-ad3c-e290e208004a req-69fe53dd-960e-4b9e-849c-310fcf32622d service nova] [instance: 6c284db0-2aa8-4680-ab40-7e9861f8449b] Updated VIF entry in instance network info cache for port 4c31827f-7de8-49d3-a461-d6e83b8faa0d. {{(pid=85141) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 10:35:06 user nova-compute[85141]: DEBUG nova.network.neutron [req-39b532ec-39f2-4466-ad3c-e290e208004a req-69fe53dd-960e-4b9e-849c-310fcf32622d service nova] [instance: 6c284db0-2aa8-4680-ab40-7e9861f8449b] Updating instance_info_cache with network_info: [{"id": "4c31827f-7de8-49d3-a461-d6e83b8faa0d", "address": "fa:16:3e:85:13:75", "network": {"id": "b8ada47f-9721-4358-ac4f-0305f06dbbb8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1663922860-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.73", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aec3bb9fe5e6446590900b5adf65df0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c31827f-7d", "ovs_interfaceid": "4c31827f-7de8-49d3-a461-d6e83b8faa0d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:35:06 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-39b532ec-39f2-4466-ad3c-e290e208004a req-69fe53dd-960e-4b9e-849c-310fcf32622d service nova] Releasing lock "refresh_cache-6c284db0-2aa8-4680-ab40-7e9861f8449b" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:35:06 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-238b310f-9713-42e5-9879-5cd4f378211e tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Acquiring lock "6c284db0-2aa8-4680-ab40-7e9861f8449b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:35:06 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-238b310f-9713-42e5-9879-5cd4f378211e tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Lock "6c284db0-2aa8-4680-ab40-7e9861f8449b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:35:06 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-238b310f-9713-42e5-9879-5cd4f378211e tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Acquiring lock "6c284db0-2aa8-4680-ab40-7e9861f8449b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:35:06 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-238b310f-9713-42e5-9879-5cd4f378211e tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Lock "6c284db0-2aa8-4680-ab40-7e9861f8449b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:35:06 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-238b310f-9713-42e5-9879-5cd4f378211e tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Lock "6c284db0-2aa8-4680-ab40-7e9861f8449b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:35:06 user nova-compute[85141]: INFO nova.compute.manager [None req-238b310f-9713-42e5-9879-5cd4f378211e tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: 6c284db0-2aa8-4680-ab40-7e9861f8449b] Terminating instance
Nov 16 10:35:06 user nova-compute[85141]: DEBUG nova.compute.manager [None req-238b310f-9713-42e5-9879-5cd4f378211e tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: 6c284db0-2aa8-4680-ab40-7e9861f8449b] Start destroying the instance on the hypervisor. {{(pid=85141) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 10:35:07 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:35:07 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:35:07 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:35:07 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:35:07 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:35:07 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:35:07 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:35:07 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:35:07 user nova-compute[85141]: INFO nova.virt.libvirt.driver [-] [instance: 6c284db0-2aa8-4680-ab40-7e9861f8449b] Instance destroyed successfully.
Nov 16 10:35:07 user nova-compute[85141]: DEBUG nova.objects.instance [None req-238b310f-9713-42e5-9879-5cd4f378211e tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Lazy-loading 'resources' on Instance uuid 6c284db0-2aa8-4680-ab40-7e9861f8449b {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:35:07 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-238b310f-9713-42e5-9879-5cd4f378211e tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T10:33:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-927511500',display_name='tempest-TestVolumeBootPattern-server-927511500',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-927511500',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK2tiQ/yBbFjZdjBIR2tKrAVD3soVHRqo5J6ZL2tZkf+/CHlij0TJEEFuVTAcbccfWNw+REn7xM/u4NrsIPLxGXc8EfsNWZLl3/YiEOdS+xhO6c08a6foGqxQYJ8pZUDrQ==',key_name='tempest-TestVolumeBootPattern-1363391981',keypairs=<?>,launch_index=0,launched_at=2023-11-16T10:33:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='aec3bb9fe5e6446590900b5adf65df0f',ramdisk_id='',reservation_id='r-t9zwuyvc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1979039357',owner_user_name='tempest-TestVolumeBootPattern-1979039357-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T10:33:26Z,user_data=None,user_id='7261b57c36904fcda87a9ea32d4b5b31',uuid=6c284db0-2aa8-4680-ab40-7e9861f8449b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4c31827f-7de8-49d3-a461-d6e83b8faa0d", "address": "fa:16:3e:85:13:75", "network": {"id": "b8ada47f-9721-4358-ac4f-0305f06dbbb8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1663922860-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.73", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aec3bb9fe5e6446590900b5adf65df0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c31827f-7d", "ovs_interfaceid": "4c31827f-7de8-49d3-a461-d6e83b8faa0d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 10:35:07 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-238b310f-9713-42e5-9879-5cd4f378211e tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Converting VIF {"id": "4c31827f-7de8-49d3-a461-d6e83b8faa0d", "address": "fa:16:3e:85:13:75", "network": {"id": "b8ada47f-9721-4358-ac4f-0305f06dbbb8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1663922860-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.73", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aec3bb9fe5e6446590900b5adf65df0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c31827f-7d", "ovs_interfaceid": "4c31827f-7de8-49d3-a461-d6e83b8faa0d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:35:07 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-238b310f-9713-42e5-9879-5cd4f378211e tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:85:13:75,bridge_name='br-int',has_traffic_filtering=True,id=4c31827f-7de8-49d3-a461-d6e83b8faa0d,network=Network(b8ada47f-9721-4358-ac4f-0305f06dbbb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c31827f-7d') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:35:07 user nova-compute[85141]: DEBUG os_vif [None req-238b310f-9713-42e5-9879-5cd4f378211e tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:85:13:75,bridge_name='br-int',has_traffic_filtering=True,id=4c31827f-7de8-49d3-a461-d6e83b8faa0d,network=Network(b8ada47f-9721-4358-ac4f-0305f06dbbb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c31827f-7d') {{(pid=85141) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 10:35:07 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:35:07 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4c31827f-7d, bridge=br-int, if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:35:07 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:35:07 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:35:07 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:35:07 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=de72765a-0379-4ee6-840d-f737c77912f6) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:35:07 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:35:07 user nova-compute[85141]: DEBUG nova.compute.manager [req-fa917818-5b0c-4a91-9064-c15d21c64feb req-9f674dd3-4191-4ff9-9546-85d1e919c6f9 service nova] [instance: 6c284db0-2aa8-4680-ab40-7e9861f8449b] Received event network-vif-unplugged-4c31827f-7de8-49d3-a461-d6e83b8faa0d {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:35:07 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-fa917818-5b0c-4a91-9064-c15d21c64feb req-9f674dd3-4191-4ff9-9546-85d1e919c6f9 service nova] Acquiring lock "6c284db0-2aa8-4680-ab40-7e9861f8449b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:35:07 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-fa917818-5b0c-4a91-9064-c15d21c64feb req-9f674dd3-4191-4ff9-9546-85d1e919c6f9 service nova] Lock "6c284db0-2aa8-4680-ab40-7e9861f8449b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:35:07 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-fa917818-5b0c-4a91-9064-c15d21c64feb req-9f674dd3-4191-4ff9-9546-85d1e919c6f9 service nova] Lock "6c284db0-2aa8-4680-ab40-7e9861f8449b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:35:07 user nova-compute[85141]: DEBUG nova.compute.manager [req-fa917818-5b0c-4a91-9064-c15d21c64feb req-9f674dd3-4191-4ff9-9546-85d1e919c6f9 service nova] [instance: 6c284db0-2aa8-4680-ab40-7e9861f8449b] No waiting events found dispatching network-vif-unplugged-4c31827f-7de8-49d3-a461-d6e83b8faa0d {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:35:07 user nova-compute[85141]: DEBUG nova.compute.manager [req-fa917818-5b0c-4a91-9064-c15d21c64feb req-9f674dd3-4191-4ff9-9546-85d1e919c6f9 service nova] [instance: 6c284db0-2aa8-4680-ab40-7e9861f8449b] Received event network-vif-unplugged-4c31827f-7de8-49d3-a461-d6e83b8faa0d for instance with task_state deleting. {{(pid=85141) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 10:35:07 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:35:07 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:35:07 user nova-compute[85141]: INFO os_vif [None req-238b310f-9713-42e5-9879-5cd4f378211e tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:85:13:75,bridge_name='br-int',has_traffic_filtering=True,id=4c31827f-7de8-49d3-a461-d6e83b8faa0d,network=Network(b8ada47f-9721-4358-ac4f-0305f06dbbb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c31827f-7d')
Nov 16 10:35:07 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-238b310f-9713-42e5-9879-5cd4f378211e tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: 6c284db0-2aa8-4680-ab40-7e9861f8449b] calling os-brick to detach iSCSI Volume {{(pid=85141) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 10:35:07 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-238b310f-9713-42e5-9879-5cd4f378211e tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51806b6080>, {'target_iqn': 'iqn.2010-10.org.openstack:584dd8df-f6a2-4e35-be7e-8de1e759491b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XoQOTquf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 10:35:07 user nova-compute[85141]: WARNING os_brick.initiator.connectors.base [None req-238b310f-9713-42e5-9879-5cd4f378211e tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 10:35:07 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-238b310f-9713-42e5-9879-5cd4f378211e tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 10:35:07 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-238b310f-9713-42e5-9879-5cd4f378211e tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.004s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 10:35:07 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:35:07 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:35:07 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[7547f7a7-c9f0-4dab-9b3b-90994a137f45]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:584dd8df-f6a2-4e35-be7e-8de1e759491b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1fd95458-b13d-439d-b30c-6dcfe2fa8419\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:35:07 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-238b310f-9713-42e5-9879-5cd4f378211e tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 10:35:07 user nova-compute[85141]: No targets found.
Nov 16 10:35:07 user nova-compute[85141]: iSNS:
Nov 16 10:35:07 user nova-compute[85141]: No targets found.
Nov 16 10:35:07 user nova-compute[85141]: STATIC:
Nov 16 10:35:07 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:584dd8df-f6a2-4e35-be7e-8de1e759491b
Nov 16 10:35:07 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:35:07 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:35:07 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:1fd95458-b13d-439d-b30c-6dcfe2fa8419
Nov 16 10:35:07 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:35:07 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:35:07 user nova-compute[85141]: FIRMWARE:
Nov 16 10:35:07 user nova-compute[85141]: No targets found.
Nov 16 10:35:07 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:35:07 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-238b310f-9713-42e5-9879-5cd4f378211e tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 10:35:07 user nova-compute[85141]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 10:35:07 user nova-compute[85141]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=85141) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 10:35:07 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-238b310f-9713-42e5-9879-5cd4f378211e tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:584dd8df-f6a2-4e35-be7e-8de1e759491b', 0)] {{(pid=85141) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 10:35:07 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:35:07 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:35:07 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[e71f5a4e-1b2a-446a-a876-da458729b041]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1fd95458-b13d-439d-b30c-6dcfe2fa8419\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:584dd8df-f6a2-4e35-be7e-8de1e759491b\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:35:07 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:35:07 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:35:07 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e3d5b3b-0a34-4f25-95fd-79f90a8e010e]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:584dd8df-f6a2-4e35-be7e-8de1e759491b (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fd95458-b13d-439d-b30c-6dcfe2fa8419 (non-flash)\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:35:07 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-238b310f-9713-42e5-9879-5cd4f378211e tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:584dd8df-f6a2-4e35-be7e-8de1e759491b (non-flash)
Nov 16 10:35:07 user nova-compute[85141]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fd95458-b13d-439d-b30c-6dcfe2fa8419 (non-flash)
Nov 16 10:35:07 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:35:07 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-238b310f-9713-42e5-9879-5cd4f378211e tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:584dd8df-f6a2-4e35-be7e-8de1e759491b (non-flash)
Nov 16 10:35:07 user nova-compute[85141]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fd95458-b13d-439d-b30c-6dcfe2fa8419 (non-flash)
Nov 16 10:35:07 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 10:35:07 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-238b310f-9713-42e5-9879-5cd4f378211e tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5180691750>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:584dd8df-f6a2-4e35-be7e-8de1e759491b'): ({'sdc'}, set())}) {{(pid=85141) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 10:35:07 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-238b310f-9713-42e5-9879-5cd4f378211e tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Removing single pathed devices sdc {{(pid=85141) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 10:35:07 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:35:07 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:35:07 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef6073a5-a9bd-4fb4-a890-e5ed0719990f]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:35:07 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:35:07 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.028s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:35:07 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a311628-ad95-4ec4-b512-6abe3297802e]: (4, ('ok\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:35:08 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-238b310f-9713-42e5-9879-5cd4f378211e tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Flushing IO for device /dev/sdc {{(pid=85141) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 10:35:08 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:35:08 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.026s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:35:08 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[7deb570c-b995-416e-8968-8fc3ad641d09]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:35:08 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-238b310f-9713-42e5-9879-5cd4f378211e tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=85141) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 10:35:08 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:35:08 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.057s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:35:08 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[112bbc06-ee08-40b5-b2fb-2c1866347902]: (4, ('1', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:35:08 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-238b310f-9713-42e5-9879-5cd4f378211e tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=85141) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 10:35:08 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-238b310f-9713-42e5-9879-5cd4f378211e tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] SCSI volumes sdc have been removed. {{(pid=85141) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 10:35:08 user nova-compute[85141]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_f3fe7dc2', '/dev/disk/by-id/scsi-23335306261396637') {{(pid=95342) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 16 10:35:08 user nova-compute[85141]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_f3fe7dc2
Nov 16 10:35:08 user nova-compute[85141]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-23335306261396637
Nov 16 10:35:08 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[909dc54d-e072-4756-a304-925a4e9ace9c]: (4, None) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:35:08 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-238b310f-9713-42e5-9879-5cd4f378211e tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:584dd8df-f6a2-4e35-be7e-8de1e759491b')] {{(pid=85141) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 10:35:08 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:584dd8df-f6a2-4e35-be7e-8de1e759491b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:35:08 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:584dd8df-f6a2-4e35-be7e-8de1e759491b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:35:08 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[362a8519-b0e2-44c0-a7cd-1108e745fcda]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:35:08 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-238b310f-9713-42e5-9879-5cd4f378211e tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:35:08 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:584dd8df-f6a2-4e35-be7e-8de1e759491b -p 172.16.0.220:3260 --logout {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:35:08 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:584dd8df-f6a2-4e35-be7e-8de1e759491b -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:35:08 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c9077b2-c8b6-4ca4-a45d-2ec9f6dae659]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:584dd8df-f6a2-4e35-be7e-8de1e759491b, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:584dd8df-f6a2-4e35-be7e-8de1e759491b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:35:08 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-238b310f-9713-42e5-9879-5cd4f378211e tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:584dd8df-f6a2-4e35-be7e-8de1e759491b, portal: 172.16.0.220,3260]
Nov 16 10:35:08 user nova-compute[85141]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:584dd8df-f6a2-4e35-be7e-8de1e759491b, portal: 172.16.0.220,3260] successful.
Nov 16 10:35:08 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:35:08 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:584dd8df-f6a2-4e35-be7e-8de1e759491b -p 172.16.0.220:3260 --op delete {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:35:08 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:584dd8df-f6a2-4e35-be7e-8de1e759491b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:35:08 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe8daa0c-4b19-42ba-ad8c-037284bea0c5]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:35:08 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-238b310f-9713-42e5-9879-5cd4f378211e tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:35:08 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-238b310f-9713-42e5-9879-5cd4f378211e tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.405s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 10:35:08 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-238b310f-9713-42e5-9879-5cd4f378211e tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] <== disconnect_volume: return (409ms) None {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 10:35:08 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-238b310f-9713-42e5-9879-5cd4f378211e tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: 6c284db0-2aa8-4680-ab40-7e9861f8449b] Disconnected iSCSI Volume {{(pid=85141) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 10:35:08 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-238b310f-9713-42e5-9879-5cd4f378211e tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: 6c284db0-2aa8-4680-ab40-7e9861f8449b] Deleting instance files /opt/stack/data/nova/instances/6c284db0-2aa8-4680-ab40-7e9861f8449b_del
Nov 16 10:35:08 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-238b310f-9713-42e5-9879-5cd4f378211e tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: 6c284db0-2aa8-4680-ab40-7e9861f8449b] Deletion of /opt/stack/data/nova/instances/6c284db0-2aa8-4680-ab40-7e9861f8449b_del complete
Nov 16 10:35:08 user nova-compute[85141]: INFO nova.compute.manager [None req-238b310f-9713-42e5-9879-5cd4f378211e tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: 6c284db0-2aa8-4680-ab40-7e9861f8449b] Took 1.38 seconds to destroy the instance on the hypervisor.
Nov 16 10:35:08 user nova-compute[85141]: DEBUG oslo.service.loopingcall [None req-238b310f-9713-42e5-9879-5cd4f378211e tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=85141) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 10:35:08 user nova-compute[85141]: DEBUG nova.compute.manager [-] [instance: 6c284db0-2aa8-4680-ab40-7e9861f8449b] Deallocating network for instance {{(pid=85141) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 10:35:08 user nova-compute[85141]: DEBUG nova.network.neutron [-] [instance: 6c284db0-2aa8-4680-ab40-7e9861f8449b] deallocate_for_instance() {{(pid=85141) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 10:35:08 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:35:08 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:35:08 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:35:08 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:35:08 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:35:09 user nova-compute[85141]: DEBUG nova.network.neutron [-] [instance: 6c284db0-2aa8-4680-ab40-7e9861f8449b] Updating instance_info_cache with network_info: [] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:35:09 user nova-compute[85141]: INFO nova.compute.manager [-] [instance: 6c284db0-2aa8-4680-ab40-7e9861f8449b] Took 0.81 seconds to deallocate network for instance.
Nov 16 10:35:09 user nova-compute[85141]: DEBUG nova.compute.manager [req-0e246415-8885-4303-91cd-07a72d9e7c28 req-ad3fafe3-9930-4e18-bf4d-b3cd3978fdb3 service nova] [instance: 6c284db0-2aa8-4680-ab40-7e9861f8449b] Received event network-vif-deleted-4c31827f-7de8-49d3-a461-d6e83b8faa0d {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:35:09 user nova-compute[85141]: INFO nova.compute.manager [req-0e246415-8885-4303-91cd-07a72d9e7c28 req-ad3fafe3-9930-4e18-bf4d-b3cd3978fdb3 service nova] [instance: 6c284db0-2aa8-4680-ab40-7e9861f8449b] Neutron deleted interface 4c31827f-7de8-49d3-a461-d6e83b8faa0d; detaching it from the instance and deleting it from the info cache
Nov 16 10:35:09 user nova-compute[85141]: DEBUG nova.network.neutron [req-0e246415-8885-4303-91cd-07a72d9e7c28 req-ad3fafe3-9930-4e18-bf4d-b3cd3978fdb3 service nova] [instance: 6c284db0-2aa8-4680-ab40-7e9861f8449b] Updating instance_info_cache with network_info: [] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:35:09 user nova-compute[85141]: DEBUG nova.compute.manager [req-0e246415-8885-4303-91cd-07a72d9e7c28 req-ad3fafe3-9930-4e18-bf4d-b3cd3978fdb3 service nova] [instance: 6c284db0-2aa8-4680-ab40-7e9861f8449b] Detach interface failed, port_id=4c31827f-7de8-49d3-a461-d6e83b8faa0d, reason: Instance 6c284db0-2aa8-4680-ab40-7e9861f8449b could not be found. {{(pid=85141) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 16 10:35:09 user nova-compute[85141]: DEBUG nova.compute.manager [req-c2089224-1832-4afd-9518-69b0d260d98d req-dccf5ed7-8514-432b-b383-8a746e3bba9a service nova] [instance: 6c284db0-2aa8-4680-ab40-7e9861f8449b] Received event network-vif-plugged-4c31827f-7de8-49d3-a461-d6e83b8faa0d {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:35:09 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-c2089224-1832-4afd-9518-69b0d260d98d req-dccf5ed7-8514-432b-b383-8a746e3bba9a service nova] Acquiring lock "6c284db0-2aa8-4680-ab40-7e9861f8449b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:35:09 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-c2089224-1832-4afd-9518-69b0d260d98d req-dccf5ed7-8514-432b-b383-8a746e3bba9a service nova] Lock "6c284db0-2aa8-4680-ab40-7e9861f8449b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:35:09 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-c2089224-1832-4afd-9518-69b0d260d98d req-dccf5ed7-8514-432b-b383-8a746e3bba9a service nova] Lock "6c284db0-2aa8-4680-ab40-7e9861f8449b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:35:09 user nova-compute[85141]: DEBUG nova.compute.manager [req-c2089224-1832-4afd-9518-69b0d260d98d req-dccf5ed7-8514-432b-b383-8a746e3bba9a service nova] [instance: 6c284db0-2aa8-4680-ab40-7e9861f8449b] No waiting events found dispatching network-vif-plugged-4c31827f-7de8-49d3-a461-d6e83b8faa0d {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:35:09 user nova-compute[85141]: WARNING nova.compute.manager [req-c2089224-1832-4afd-9518-69b0d260d98d req-dccf5ed7-8514-432b-b383-8a746e3bba9a service nova] [instance: 6c284db0-2aa8-4680-ab40-7e9861f8449b] Received unexpected event network-vif-plugged-4c31827f-7de8-49d3-a461-d6e83b8faa0d for instance with vm_state active and task_state deleting.
Nov 16 10:35:09 user nova-compute[85141]: DEBUG nova.compute.manager [req-c2089224-1832-4afd-9518-69b0d260d98d req-dccf5ed7-8514-432b-b383-8a746e3bba9a service nova] [instance: 6c284db0-2aa8-4680-ab40-7e9861f8449b] Received event network-vif-plugged-4c31827f-7de8-49d3-a461-d6e83b8faa0d {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:35:09 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-c2089224-1832-4afd-9518-69b0d260d98d req-dccf5ed7-8514-432b-b383-8a746e3bba9a service nova] Acquiring lock "6c284db0-2aa8-4680-ab40-7e9861f8449b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:35:09 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-c2089224-1832-4afd-9518-69b0d260d98d req-dccf5ed7-8514-432b-b383-8a746e3bba9a service nova] Lock "6c284db0-2aa8-4680-ab40-7e9861f8449b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:35:09 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-c2089224-1832-4afd-9518-69b0d260d98d req-dccf5ed7-8514-432b-b383-8a746e3bba9a service nova] Lock "6c284db0-2aa8-4680-ab40-7e9861f8449b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:35:09 user nova-compute[85141]: DEBUG nova.compute.manager [req-c2089224-1832-4afd-9518-69b0d260d98d req-dccf5ed7-8514-432b-b383-8a746e3bba9a service nova] [instance: 6c284db0-2aa8-4680-ab40-7e9861f8449b] No waiting events found dispatching network-vif-plugged-4c31827f-7de8-49d3-a461-d6e83b8faa0d {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:35:09 user nova-compute[85141]: WARNING nova.compute.manager [req-c2089224-1832-4afd-9518-69b0d260d98d req-dccf5ed7-8514-432b-b383-8a746e3bba9a service nova] [instance: 6c284db0-2aa8-4680-ab40-7e9861f8449b] Received unexpected event network-vif-plugged-4c31827f-7de8-49d3-a461-d6e83b8faa0d for instance with vm_state active and task_state deleting.
Nov 16 10:35:09 user nova-compute[85141]: DEBUG nova.compute.manager [req-c2089224-1832-4afd-9518-69b0d260d98d req-dccf5ed7-8514-432b-b383-8a746e3bba9a service nova] [instance: 6c284db0-2aa8-4680-ab40-7e9861f8449b] Received event network-vif-plugged-4c31827f-7de8-49d3-a461-d6e83b8faa0d {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:35:09 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-c2089224-1832-4afd-9518-69b0d260d98d req-dccf5ed7-8514-432b-b383-8a746e3bba9a service nova] Acquiring lock "6c284db0-2aa8-4680-ab40-7e9861f8449b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:35:09 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-c2089224-1832-4afd-9518-69b0d260d98d req-dccf5ed7-8514-432b-b383-8a746e3bba9a service nova] Lock "6c284db0-2aa8-4680-ab40-7e9861f8449b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:35:09 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-c2089224-1832-4afd-9518-69b0d260d98d req-dccf5ed7-8514-432b-b383-8a746e3bba9a service nova] Lock "6c284db0-2aa8-4680-ab40-7e9861f8449b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:35:09 user nova-compute[85141]: DEBUG nova.compute.manager [req-c2089224-1832-4afd-9518-69b0d260d98d req-dccf5ed7-8514-432b-b383-8a746e3bba9a service nova] [instance: 6c284db0-2aa8-4680-ab40-7e9861f8449b] No waiting events found dispatching network-vif-plugged-4c31827f-7de8-49d3-a461-d6e83b8faa0d {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:35:09 user nova-compute[85141]: WARNING nova.compute.manager [req-c2089224-1832-4afd-9518-69b0d260d98d req-dccf5ed7-8514-432b-b383-8a746e3bba9a service nova] [instance: 6c284db0-2aa8-4680-ab40-7e9861f8449b] Received unexpected event network-vif-plugged-4c31827f-7de8-49d3-a461-d6e83b8faa0d for instance with vm_state active and task_state deleting.
Nov 16 10:35:09 user nova-compute[85141]: DEBUG nova.compute.manager [req-c2089224-1832-4afd-9518-69b0d260d98d req-dccf5ed7-8514-432b-b383-8a746e3bba9a service nova] [instance: 6c284db0-2aa8-4680-ab40-7e9861f8449b] Received event network-vif-unplugged-4c31827f-7de8-49d3-a461-d6e83b8faa0d {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:35:09 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-c2089224-1832-4afd-9518-69b0d260d98d req-dccf5ed7-8514-432b-b383-8a746e3bba9a service nova] Acquiring lock "6c284db0-2aa8-4680-ab40-7e9861f8449b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:35:09 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-c2089224-1832-4afd-9518-69b0d260d98d req-dccf5ed7-8514-432b-b383-8a746e3bba9a service nova] Lock "6c284db0-2aa8-4680-ab40-7e9861f8449b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:35:09 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-c2089224-1832-4afd-9518-69b0d260d98d req-dccf5ed7-8514-432b-b383-8a746e3bba9a service nova] Lock "6c284db0-2aa8-4680-ab40-7e9861f8449b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:35:09 user nova-compute[85141]: DEBUG nova.compute.manager [req-c2089224-1832-4afd-9518-69b0d260d98d req-dccf5ed7-8514-432b-b383-8a746e3bba9a service nova] [instance: 6c284db0-2aa8-4680-ab40-7e9861f8449b] No waiting events found dispatching network-vif-unplugged-4c31827f-7de8-49d3-a461-d6e83b8faa0d {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:35:09 user nova-compute[85141]: DEBUG nova.compute.manager [req-c2089224-1832-4afd-9518-69b0d260d98d req-dccf5ed7-8514-432b-b383-8a746e3bba9a service nova] [instance: 6c284db0-2aa8-4680-ab40-7e9861f8449b] Received event network-vif-unplugged-4c31827f-7de8-49d3-a461-d6e83b8faa0d for instance with task_state deleting. {{(pid=85141) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 10:35:09 user nova-compute[85141]: DEBUG nova.compute.manager [req-c2089224-1832-4afd-9518-69b0d260d98d req-dccf5ed7-8514-432b-b383-8a746e3bba9a service nova] [instance: 6c284db0-2aa8-4680-ab40-7e9861f8449b] Received event network-vif-plugged-4c31827f-7de8-49d3-a461-d6e83b8faa0d {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:35:09 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-c2089224-1832-4afd-9518-69b0d260d98d req-dccf5ed7-8514-432b-b383-8a746e3bba9a service nova] Acquiring lock "6c284db0-2aa8-4680-ab40-7e9861f8449b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:35:09 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-c2089224-1832-4afd-9518-69b0d260d98d req-dccf5ed7-8514-432b-b383-8a746e3bba9a service nova] Lock "6c284db0-2aa8-4680-ab40-7e9861f8449b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:35:09 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-c2089224-1832-4afd-9518-69b0d260d98d req-dccf5ed7-8514-432b-b383-8a746e3bba9a service nova] Lock "6c284db0-2aa8-4680-ab40-7e9861f8449b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:35:09 user nova-compute[85141]: DEBUG nova.compute.manager [req-c2089224-1832-4afd-9518-69b0d260d98d req-dccf5ed7-8514-432b-b383-8a746e3bba9a service nova] [instance: 6c284db0-2aa8-4680-ab40-7e9861f8449b] No waiting events found dispatching network-vif-plugged-4c31827f-7de8-49d3-a461-d6e83b8faa0d {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:35:09 user nova-compute[85141]: WARNING nova.compute.manager [req-c2089224-1832-4afd-9518-69b0d260d98d req-dccf5ed7-8514-432b-b383-8a746e3bba9a service nova] [instance: 6c284db0-2aa8-4680-ab40-7e9861f8449b] Received unexpected event network-vif-plugged-4c31827f-7de8-49d3-a461-d6e83b8faa0d for instance with vm_state active and task_state deleting.
Nov 16 10:35:09 user nova-compute[85141]: INFO nova.compute.manager [None req-238b310f-9713-42e5-9879-5cd4f378211e tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: 6c284db0-2aa8-4680-ab40-7e9861f8449b] Took 0.76 seconds to detach 1 volumes for instance.
Nov 16 10:35:09 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-238b310f-9713-42e5-9879-5cd4f378211e tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:35:09 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-238b310f-9713-42e5-9879-5cd4f378211e tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:35:10 user nova-compute[85141]: DEBUG nova.compute.provider_tree [None req-238b310f-9713-42e5-9879-5cd4f378211e tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Inventory has not changed in ProviderTree for provider: bf8e0fa1-16b6-408f-9203-c4cd63916272 {{(pid=85141) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 10:35:10 user nova-compute[85141]: DEBUG nova.scheduler.client.report [None req-238b310f-9713-42e5-9879-5cd4f378211e tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Inventory has not changed for provider bf8e0fa1-16b6-408f-9203-c4cd63916272 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=85141) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 10:35:10 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-238b310f-9713-42e5-9879-5cd4f378211e tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.229s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:35:10 user nova-compute[85141]: INFO nova.scheduler.client.report [None req-238b310f-9713-42e5-9879-5cd4f378211e tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Deleted allocations for instance 6c284db0-2aa8-4680-ab40-7e9861f8449b
Nov 16 10:35:10 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-238b310f-9713-42e5-9879-5cd4f378211e tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Lock "6c284db0-2aa8-4680-ab40-7e9861f8449b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.393s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:35:11 user nova-compute[85141]: DEBUG nova.compute.manager [req-b156d1a0-1485-4356-99a9-37dc3c3d15ac req-d8dffc40-123c-428e-a1b2-e067a01d5c22 service nova] [instance: da42de06-4518-4c8a-8c63-9b5a2759a1bf] Received event network-changed-82a8c393-e062-47b9-a531-a6823f7d00a6 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:35:11 user nova-compute[85141]: DEBUG nova.compute.manager [req-b156d1a0-1485-4356-99a9-37dc3c3d15ac req-d8dffc40-123c-428e-a1b2-e067a01d5c22 service nova] [instance: da42de06-4518-4c8a-8c63-9b5a2759a1bf] Refreshing instance network info cache due to event network-changed-82a8c393-e062-47b9-a531-a6823f7d00a6. {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 10:35:11 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-b156d1a0-1485-4356-99a9-37dc3c3d15ac req-d8dffc40-123c-428e-a1b2-e067a01d5c22 service nova] Acquiring lock "refresh_cache-da42de06-4518-4c8a-8c63-9b5a2759a1bf" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:35:11 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-b156d1a0-1485-4356-99a9-37dc3c3d15ac req-d8dffc40-123c-428e-a1b2-e067a01d5c22 service nova] Acquired lock "refresh_cache-da42de06-4518-4c8a-8c63-9b5a2759a1bf" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:35:11 user nova-compute[85141]: DEBUG nova.network.neutron [req-b156d1a0-1485-4356-99a9-37dc3c3d15ac req-d8dffc40-123c-428e-a1b2-e067a01d5c22 service nova] [instance: da42de06-4518-4c8a-8c63-9b5a2759a1bf] Refreshing network info cache for port 82a8c393-e062-47b9-a531-a6823f7d00a6 {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 10:35:11 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-86a3987d-c441-4d44-99dc-166e6ff5550d tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Acquiring lock "da42de06-4518-4c8a-8c63-9b5a2759a1bf" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:35:11 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-86a3987d-c441-4d44-99dc-166e6ff5550d tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Lock "da42de06-4518-4c8a-8c63-9b5a2759a1bf" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:35:11 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-86a3987d-c441-4d44-99dc-166e6ff5550d tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Acquiring lock "da42de06-4518-4c8a-8c63-9b5a2759a1bf-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:35:11 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-86a3987d-c441-4d44-99dc-166e6ff5550d tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Lock "da42de06-4518-4c8a-8c63-9b5a2759a1bf-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:35:11 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-86a3987d-c441-4d44-99dc-166e6ff5550d tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Lock "da42de06-4518-4c8a-8c63-9b5a2759a1bf-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:35:11 user nova-compute[85141]: INFO nova.compute.manager [None req-86a3987d-c441-4d44-99dc-166e6ff5550d tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] [instance: da42de06-4518-4c8a-8c63-9b5a2759a1bf] Terminating instance
Nov 16 10:35:11 user nova-compute[85141]: DEBUG nova.compute.manager [None req-86a3987d-c441-4d44-99dc-166e6ff5550d tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] [instance: da42de06-4518-4c8a-8c63-9b5a2759a1bf] Start destroying the instance on the hypervisor. {{(pid=85141) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 10:35:11 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:35:11 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:35:11 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:35:11 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:35:11 user nova-compute[85141]: DEBUG nova.compute.manager [req-3dfb0e36-0708-45e4-96dc-af8442212319 req-dabc96ae-4cce-42d2-9edf-4b4375edf17a service nova] [instance: da42de06-4518-4c8a-8c63-9b5a2759a1bf] Received event network-vif-unplugged-82a8c393-e062-47b9-a531-a6823f7d00a6 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:35:11 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-3dfb0e36-0708-45e4-96dc-af8442212319 req-dabc96ae-4cce-42d2-9edf-4b4375edf17a service nova] Acquiring lock "da42de06-4518-4c8a-8c63-9b5a2759a1bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:35:11 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-3dfb0e36-0708-45e4-96dc-af8442212319 req-dabc96ae-4cce-42d2-9edf-4b4375edf17a service nova] Lock "da42de06-4518-4c8a-8c63-9b5a2759a1bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:35:11 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-3dfb0e36-0708-45e4-96dc-af8442212319 req-dabc96ae-4cce-42d2-9edf-4b4375edf17a service nova] Lock "da42de06-4518-4c8a-8c63-9b5a2759a1bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:35:11 user nova-compute[85141]: DEBUG nova.compute.manager [req-3dfb0e36-0708-45e4-96dc-af8442212319 req-dabc96ae-4cce-42d2-9edf-4b4375edf17a service nova] [instance: da42de06-4518-4c8a-8c63-9b5a2759a1bf] No waiting events found dispatching network-vif-unplugged-82a8c393-e062-47b9-a531-a6823f7d00a6 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:35:11 user nova-compute[85141]: DEBUG nova.compute.manager [req-3dfb0e36-0708-45e4-96dc-af8442212319 req-dabc96ae-4cce-42d2-9edf-4b4375edf17a service nova] [instance: da42de06-4518-4c8a-8c63-9b5a2759a1bf] Received event network-vif-unplugged-82a8c393-e062-47b9-a531-a6823f7d00a6 for instance with task_state deleting. {{(pid=85141) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 10:35:11 user nova-compute[85141]: DEBUG nova.network.neutron [req-b156d1a0-1485-4356-99a9-37dc3c3d15ac req-d8dffc40-123c-428e-a1b2-e067a01d5c22 service nova] [instance: da42de06-4518-4c8a-8c63-9b5a2759a1bf] Updated VIF entry in instance network info cache for port 82a8c393-e062-47b9-a531-a6823f7d00a6. {{(pid=85141) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 10:35:11 user nova-compute[85141]: DEBUG nova.network.neutron [req-b156d1a0-1485-4356-99a9-37dc3c3d15ac req-d8dffc40-123c-428e-a1b2-e067a01d5c22 service nova] [instance: da42de06-4518-4c8a-8c63-9b5a2759a1bf] Updating instance_info_cache with network_info: [{"id": "82a8c393-e062-47b9-a531-a6823f7d00a6", "address": "fa:16:3e:e4:f2:a7", "network": {"id": "a8f7d218-f758-44d8-adb3-120a5f724f70", "bridge": "br-int", "label": "tempest-TestStampPattern-1966889964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fb187d45ec54e74a0721973235f98b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82a8c393-e0", "ovs_interfaceid": "82a8c393-e062-47b9-a531-a6823f7d00a6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:35:11 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-b156d1a0-1485-4356-99a9-37dc3c3d15ac req-d8dffc40-123c-428e-a1b2-e067a01d5c22 service nova] Releasing lock "refresh_cache-da42de06-4518-4c8a-8c63-9b5a2759a1bf" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:35:12 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:35:12 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:35:12 user nova-compute[85141]: INFO nova.virt.libvirt.driver [-] [instance: da42de06-4518-4c8a-8c63-9b5a2759a1bf] Instance destroyed successfully.
Nov 16 10:35:12 user nova-compute[85141]: DEBUG nova.objects.instance [None req-86a3987d-c441-4d44-99dc-166e6ff5550d tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Lazy-loading 'resources' on Instance uuid da42de06-4518-4c8a-8c63-9b5a2759a1bf {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:35:12 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-86a3987d-c441-4d44-99dc-166e6ff5550d tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T10:28:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-603665308',display_name='tempest-TestStampPattern-server-603665308',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-603665308',id=38,image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHF1TofF/AHeRXw7sOS6/Y4wIEeeHYvjmPtqSMUQwk4rvI03M+9FGX8I4Wssar9zDuv0PRZIDidniJXR8tQIzSEDKx9zL7EpsVLQYl+cVUTa2/jPhGRM8ZPjKll4UR2MBA==',key_name='tempest-TestStampPattern-1189059507',keypairs=<?>,launch_index=0,launched_at=2023-11-16T10:28:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5fb187d45ec54e74a0721973235f98b0',ramdisk_id='',reservation_id='r-21zebp1m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-2139210362',owner_user_name='tempest-TestStampPattern-2139210362-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T10:31:19Z,user_data=None,user_id='ef2996a7b2b54ae38380743cf424dc18',uuid=da42de06-4518-4c8a-8c63-9b5a2759a1bf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "82a8c393-e062-47b9-a531-a6823f7d00a6", "address": "fa:16:3e:e4:f2:a7", "network": {"id": "a8f7d218-f758-44d8-adb3-120a5f724f70", "bridge": "br-int", "label": "tempest-TestStampPattern-1966889964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fb187d45ec54e74a0721973235f98b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82a8c393-e0", "ovs_interfaceid": "82a8c393-e062-47b9-a531-a6823f7d00a6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 10:35:12 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-86a3987d-c441-4d44-99dc-166e6ff5550d tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Converting VIF {"id": "82a8c393-e062-47b9-a531-a6823f7d00a6", "address": "fa:16:3e:e4:f2:a7", "network": {"id": "a8f7d218-f758-44d8-adb3-120a5f724f70", "bridge": "br-int", "label": "tempest-TestStampPattern-1966889964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fb187d45ec54e74a0721973235f98b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82a8c393-e0", "ovs_interfaceid": "82a8c393-e062-47b9-a531-a6823f7d00a6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:35:12 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-86a3987d-c441-4d44-99dc-166e6ff5550d tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e4:f2:a7,bridge_name='br-int',has_traffic_filtering=True,id=82a8c393-e062-47b9-a531-a6823f7d00a6,network=Network(a8f7d218-f758-44d8-adb3-120a5f724f70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82a8c393-e0') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:35:12 user nova-compute[85141]: DEBUG os_vif [None req-86a3987d-c441-4d44-99dc-166e6ff5550d tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e4:f2:a7,bridge_name='br-int',has_traffic_filtering=True,id=82a8c393-e062-47b9-a531-a6823f7d00a6,network=Network(a8f7d218-f758-44d8-adb3-120a5f724f70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82a8c393-e0') {{(pid=85141) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 10:35:12 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:35:12 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap82a8c393-e0, bridge=br-int, if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:35:12 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:35:12 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:35:12 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:35:12 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=934a9041-4590-45b4-b08d-476f2e9febc6) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:35:12 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:35:12 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:35:12 user nova-compute[85141]: INFO os_vif [None req-86a3987d-c441-4d44-99dc-166e6ff5550d tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e4:f2:a7,bridge_name='br-int',has_traffic_filtering=True,id=82a8c393-e062-47b9-a531-a6823f7d00a6,network=Network(a8f7d218-f758-44d8-adb3-120a5f724f70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82a8c393-e0')
Nov 16 10:35:12 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-86a3987d-c441-4d44-99dc-166e6ff5550d tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] [instance: da42de06-4518-4c8a-8c63-9b5a2759a1bf] Deleting instance files /opt/stack/data/nova/instances/da42de06-4518-4c8a-8c63-9b5a2759a1bf_del
Nov 16 10:35:12 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-86a3987d-c441-4d44-99dc-166e6ff5550d tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] [instance: da42de06-4518-4c8a-8c63-9b5a2759a1bf] Deletion of /opt/stack/data/nova/instances/da42de06-4518-4c8a-8c63-9b5a2759a1bf_del complete
Nov 16 10:35:12 user nova-compute[85141]: INFO nova.compute.manager [None req-86a3987d-c441-4d44-99dc-166e6ff5550d tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] [instance: da42de06-4518-4c8a-8c63-9b5a2759a1bf] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 16 10:35:12 user nova-compute[85141]: DEBUG oslo.service.loopingcall [None req-86a3987d-c441-4d44-99dc-166e6ff5550d tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=85141) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 10:35:12 user nova-compute[85141]: DEBUG nova.compute.manager [-] [instance: da42de06-4518-4c8a-8c63-9b5a2759a1bf] Deallocating network for instance {{(pid=85141) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 10:35:12 user nova-compute[85141]: DEBUG nova.network.neutron [-] [instance: da42de06-4518-4c8a-8c63-9b5a2759a1bf] deallocate_for_instance() {{(pid=85141) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 10:35:12 user nova-compute[85141]: DEBUG nova.network.neutron [-] [instance: da42de06-4518-4c8a-8c63-9b5a2759a1bf] Updating instance_info_cache with network_info: [] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:35:12 user nova-compute[85141]: INFO nova.compute.manager [-] [instance: da42de06-4518-4c8a-8c63-9b5a2759a1bf] Took 0.36 seconds to deallocate network for instance.
Nov 16 10:35:12 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-86a3987d-c441-4d44-99dc-166e6ff5550d tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:35:12 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-86a3987d-c441-4d44-99dc-166e6ff5550d tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:35:12 user nova-compute[85141]: DEBUG nova.compute.provider_tree [None req-86a3987d-c441-4d44-99dc-166e6ff5550d tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Inventory has not changed in ProviderTree for provider: bf8e0fa1-16b6-408f-9203-c4cd63916272 {{(pid=85141) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 10:35:12 user nova-compute[85141]: DEBUG nova.scheduler.client.report [None req-86a3987d-c441-4d44-99dc-166e6ff5550d tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Inventory has not changed for provider bf8e0fa1-16b6-408f-9203-c4cd63916272 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=85141) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 10:35:12 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-86a3987d-c441-4d44-99dc-166e6ff5550d tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.166s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:35:12 user nova-compute[85141]: INFO nova.scheduler.client.report [None req-86a3987d-c441-4d44-99dc-166e6ff5550d tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Deleted allocations for instance da42de06-4518-4c8a-8c63-9b5a2759a1bf
Nov 16 10:35:12 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-86a3987d-c441-4d44-99dc-166e6ff5550d tempest-TestStampPattern-2139210362 tempest-TestStampPattern-2139210362-project-member] Lock "da42de06-4518-4c8a-8c63-9b5a2759a1bf" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.575s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:35:13 user nova-compute[85141]: DEBUG nova.compute.manager [req-4f44c444-e84c-41a4-bb89-24b454ee0125 req-9a53c1ea-ecd5-44c5-ba20-3d4a05d98a72 service nova] [instance: da42de06-4518-4c8a-8c63-9b5a2759a1bf] Received event network-vif-deleted-82a8c393-e062-47b9-a531-a6823f7d00a6 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:35:13 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:35:13 user nova-compute[85141]: DEBUG nova.compute.manager [req-844977c4-520c-4c23-a7dd-f0ecfbaf8032 req-c8922a7e-6cbc-4d85-b308-38cd88ff56e5 service nova] [instance: da42de06-4518-4c8a-8c63-9b5a2759a1bf] Received event network-vif-plugged-82a8c393-e062-47b9-a531-a6823f7d00a6 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:35:13 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-844977c4-520c-4c23-a7dd-f0ecfbaf8032 req-c8922a7e-6cbc-4d85-b308-38cd88ff56e5 service nova] Acquiring lock "da42de06-4518-4c8a-8c63-9b5a2759a1bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:35:13 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-844977c4-520c-4c23-a7dd-f0ecfbaf8032 req-c8922a7e-6cbc-4d85-b308-38cd88ff56e5 service nova] Lock "da42de06-4518-4c8a-8c63-9b5a2759a1bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:35:13 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-844977c4-520c-4c23-a7dd-f0ecfbaf8032 req-c8922a7e-6cbc-4d85-b308-38cd88ff56e5 service nova] Lock "da42de06-4518-4c8a-8c63-9b5a2759a1bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:35:13 user nova-compute[85141]: DEBUG nova.compute.manager [req-844977c4-520c-4c23-a7dd-f0ecfbaf8032 req-c8922a7e-6cbc-4d85-b308-38cd88ff56e5 service nova] [instance: da42de06-4518-4c8a-8c63-9b5a2759a1bf] No waiting events found dispatching network-vif-plugged-82a8c393-e062-47b9-a531-a6823f7d00a6 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:35:13 user nova-compute[85141]: WARNING nova.compute.manager [req-844977c4-520c-4c23-a7dd-f0ecfbaf8032 req-c8922a7e-6cbc-4d85-b308-38cd88ff56e5 service nova] [instance: da42de06-4518-4c8a-8c63-9b5a2759a1bf] Received unexpected event network-vif-plugged-82a8c393-e062-47b9-a531-a6823f7d00a6 for instance with vm_state deleted and task_state None.
Nov 16 10:35:17 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:35:18 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:35:22 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:35:23 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:35:27 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:35:28 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:35:32 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:35:33 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:35:36 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:35:36 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:35:37 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:35:39 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:35:40 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:35:40 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Starting heal instance info cache {{(pid=85141) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 10:35:40 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Acquiring lock "refresh_cache-2f1b7a62-fdc2-4b8e-b9f8-61105c0fcb5c" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:35:40 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Acquired lock "refresh_cache-2f1b7a62-fdc2-4b8e-b9f8-61105c0fcb5c" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:35:40 user nova-compute[85141]: DEBUG nova.network.neutron [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] [instance: 2f1b7a62-fdc2-4b8e-b9f8-61105c0fcb5c] Forcefully refreshing network info cache for instance {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 10:35:40 user nova-compute[85141]: DEBUG nova.network.neutron [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] [instance: 2f1b7a62-fdc2-4b8e-b9f8-61105c0fcb5c] Updating instance_info_cache with network_info: [{"id": "3c3baa93-b4c3-4cf5-b363-aab7e937312b", "address": "fa:16:3e:d1:c8:21", "network": {"id": "8931cd8f-3c0b-4d49-ae98-48f818e854e7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1902653571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d13c6ff3c30549ca9ab44d9fc1fedc6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c3baa93-b4", "ovs_interfaceid": "3c3baa93-b4c3-4cf5-b363-aab7e937312b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:35:40 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Releasing lock "refresh_cache-2f1b7a62-fdc2-4b8e-b9f8-61105c0fcb5c" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:35:40 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] [instance: 2f1b7a62-fdc2-4b8e-b9f8-61105c0fcb5c] Updated the network info_cache for instance {{(pid=85141) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 10:35:40 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:35:40 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=85141) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 10:35:42 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:35:42 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager.update_available_resource {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:35:42 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:35:42 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:35:42 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:35:42 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Auditing locally available compute resources for user (node: user) {{(pid=85141) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 10:35:42 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b29fe8bd-8169-497f-91b4-0e03360f5a1c/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:35:42 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b29fe8bd-8169-497f-91b4-0e03360f5a1c/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:35:42 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b29fe8bd-8169-497f-91b4-0e03360f5a1c/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:35:42 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b29fe8bd-8169-497f-91b4-0e03360f5a1c/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:35:42 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f1b7a62-fdc2-4b8e-b9f8-61105c0fcb5c/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:35:42 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f1b7a62-fdc2-4b8e-b9f8-61105c0fcb5c/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:35:42 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f1b7a62-fdc2-4b8e-b9f8-61105c0fcb5c/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:35:43 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f1b7a62-fdc2-4b8e-b9f8-61105c0fcb5c/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:35:43 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=85141) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 10:35:43 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e01e0e9-5eef-4af4-8633-814d59860b8d/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:35:43 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e01e0e9-5eef-4af4-8633-814d59860b8d/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:35:43 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e01e0e9-5eef-4af4-8633-814d59860b8d/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:35:43 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e01e0e9-5eef-4af4-8633-814d59860b8d/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:35:43 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:35:43 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:35:43 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Hypervisor/Node resource view: name=user free_ram=8630MB free_disk=25.02362060546875GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=85141) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 10:35:43 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:35:43 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:35:44 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance 2f1b7a62-fdc2-4b8e-b9f8-61105c0fcb5c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:35:44 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance b29fe8bd-8169-497f-91b4-0e03360f5a1c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:35:44 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance 1e01e0e9-5eef-4af4-8633-814d59860b8d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:35:44 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=85141) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 10:35:44 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=85141) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 10:35:44 user nova-compute[85141]: DEBUG nova.compute.provider_tree [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Inventory has not changed in ProviderTree for provider: bf8e0fa1-16b6-408f-9203-c4cd63916272 {{(pid=85141) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 10:35:44 user nova-compute[85141]: DEBUG nova.scheduler.client.report [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Inventory has not changed for provider bf8e0fa1-16b6-408f-9203-c4cd63916272 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=85141) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 10:35:44 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Compute_service record updated for user:user {{(pid=85141) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 10:35:44 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.284s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:35:45 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:35:45 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:35:46 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:35:46 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:35:47 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:35:50 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:35:52 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:35:54 user nova-compute[85141]: DEBUG nova.compute.manager [req-ede1e118-3fec-4bba-87ec-7a967ae75cec req-551e1358-4115-40c8-8f9c-70675966079b service nova] [instance: b29fe8bd-8169-497f-91b4-0e03360f5a1c] Received event network-changed-88f5ab37-029f-45b9-a240-bd30eb5c89a2 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:35:54 user nova-compute[85141]: DEBUG nova.compute.manager [req-ede1e118-3fec-4bba-87ec-7a967ae75cec req-551e1358-4115-40c8-8f9c-70675966079b service nova] [instance: b29fe8bd-8169-497f-91b4-0e03360f5a1c] Refreshing instance network info cache due to event network-changed-88f5ab37-029f-45b9-a240-bd30eb5c89a2. {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 10:35:54 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-ede1e118-3fec-4bba-87ec-7a967ae75cec req-551e1358-4115-40c8-8f9c-70675966079b service nova] Acquiring lock "refresh_cache-b29fe8bd-8169-497f-91b4-0e03360f5a1c" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:35:54 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-ede1e118-3fec-4bba-87ec-7a967ae75cec req-551e1358-4115-40c8-8f9c-70675966079b service nova] Acquired lock "refresh_cache-b29fe8bd-8169-497f-91b4-0e03360f5a1c" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:35:54 user nova-compute[85141]: DEBUG nova.network.neutron [req-ede1e118-3fec-4bba-87ec-7a967ae75cec req-551e1358-4115-40c8-8f9c-70675966079b service nova] [instance: b29fe8bd-8169-497f-91b4-0e03360f5a1c] Refreshing network info cache for port 88f5ab37-029f-45b9-a240-bd30eb5c89a2 {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 10:35:55 user nova-compute[85141]: DEBUG nova.network.neutron [req-ede1e118-3fec-4bba-87ec-7a967ae75cec req-551e1358-4115-40c8-8f9c-70675966079b service nova] [instance: b29fe8bd-8169-497f-91b4-0e03360f5a1c] Updated VIF entry in instance network info cache for port 88f5ab37-029f-45b9-a240-bd30eb5c89a2. {{(pid=85141) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 10:35:55 user nova-compute[85141]: DEBUG nova.network.neutron [req-ede1e118-3fec-4bba-87ec-7a967ae75cec req-551e1358-4115-40c8-8f9c-70675966079b service nova] [instance: b29fe8bd-8169-497f-91b4-0e03360f5a1c] Updating instance_info_cache with network_info: [{"id": "88f5ab37-029f-45b9-a240-bd30eb5c89a2", "address": "fa:16:3e:f0:80:ce", "network": {"id": "8931cd8f-3c0b-4d49-ae98-48f818e854e7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1902653571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d13c6ff3c30549ca9ab44d9fc1fedc6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88f5ab37-02", "ovs_interfaceid": "88f5ab37-029f-45b9-a240-bd30eb5c89a2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:35:55 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-ede1e118-3fec-4bba-87ec-7a967ae75cec req-551e1358-4115-40c8-8f9c-70675966079b service nova] Releasing lock "refresh_cache-b29fe8bd-8169-497f-91b4-0e03360f5a1c" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:35:56 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-d39a3a95-90f5-468c-9e38-4ebe11f4cc1c tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Acquiring lock "b29fe8bd-8169-497f-91b4-0e03360f5a1c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:35:56 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-d39a3a95-90f5-468c-9e38-4ebe11f4cc1c tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Lock "b29fe8bd-8169-497f-91b4-0e03360f5a1c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:35:56 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-d39a3a95-90f5-468c-9e38-4ebe11f4cc1c tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Acquiring lock "b29fe8bd-8169-497f-91b4-0e03360f5a1c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:35:56 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-d39a3a95-90f5-468c-9e38-4ebe11f4cc1c tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Lock "b29fe8bd-8169-497f-91b4-0e03360f5a1c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:35:56 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-d39a3a95-90f5-468c-9e38-4ebe11f4cc1c tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Lock "b29fe8bd-8169-497f-91b4-0e03360f5a1c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:35:56 user nova-compute[85141]: INFO nova.compute.manager [None req-d39a3a95-90f5-468c-9e38-4ebe11f4cc1c tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] [instance: b29fe8bd-8169-497f-91b4-0e03360f5a1c] Terminating instance
Nov 16 10:35:56 user nova-compute[85141]: DEBUG nova.compute.manager [None req-d39a3a95-90f5-468c-9e38-4ebe11f4cc1c tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] [instance: b29fe8bd-8169-497f-91b4-0e03360f5a1c] Start destroying the instance on the hypervisor. {{(pid=85141) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 10:35:56 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:35:56 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:35:56 user nova-compute[85141]: DEBUG nova.compute.manager [req-ba6dd242-1eb0-4934-98d0-ab39a02dedd8 req-67c9f26e-2e17-4438-a344-c5763d61c992 service nova] [instance: b29fe8bd-8169-497f-91b4-0e03360f5a1c] Received event network-vif-unplugged-88f5ab37-029f-45b9-a240-bd30eb5c89a2 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:35:56 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-ba6dd242-1eb0-4934-98d0-ab39a02dedd8 req-67c9f26e-2e17-4438-a344-c5763d61c992 service nova] Acquiring lock "b29fe8bd-8169-497f-91b4-0e03360f5a1c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:35:56 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-ba6dd242-1eb0-4934-98d0-ab39a02dedd8 req-67c9f26e-2e17-4438-a344-c5763d61c992 service nova] Lock "b29fe8bd-8169-497f-91b4-0e03360f5a1c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:35:56 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-ba6dd242-1eb0-4934-98d0-ab39a02dedd8 req-67c9f26e-2e17-4438-a344-c5763d61c992 service nova] Lock "b29fe8bd-8169-497f-91b4-0e03360f5a1c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:35:56 user nova-compute[85141]: DEBUG nova.compute.manager [req-ba6dd242-1eb0-4934-98d0-ab39a02dedd8 req-67c9f26e-2e17-4438-a344-c5763d61c992 service nova] [instance: b29fe8bd-8169-497f-91b4-0e03360f5a1c] No waiting events found dispatching network-vif-unplugged-88f5ab37-029f-45b9-a240-bd30eb5c89a2 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:35:56 user nova-compute[85141]: DEBUG nova.compute.manager [req-ba6dd242-1eb0-4934-98d0-ab39a02dedd8 req-67c9f26e-2e17-4438-a344-c5763d61c992 service nova] [instance: b29fe8bd-8169-497f-91b4-0e03360f5a1c] Received event network-vif-unplugged-88f5ab37-029f-45b9-a240-bd30eb5c89a2 for instance with task_state deleting. {{(pid=85141) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 10:35:56 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:35:56 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:35:56 user nova-compute[85141]: INFO nova.virt.libvirt.driver [-] [instance: b29fe8bd-8169-497f-91b4-0e03360f5a1c] Instance destroyed successfully.
Nov 16 10:35:56 user nova-compute[85141]: DEBUG nova.objects.instance [None req-d39a3a95-90f5-468c-9e38-4ebe11f4cc1c tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Lazy-loading 'resources' on Instance uuid b29fe8bd-8169-497f-91b4-0e03360f5a1c {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:35:57 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-d39a3a95-90f5-468c-9e38-4ebe11f4cc1c tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T10:34:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1540884992',display_name='tempest-AttachVolumeNegativeTest-server-1540884992',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1540884992',id=47,image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNRLjP8qVAmIkwY0nt33B+zouKG4J1s4862Ojdrqrw19lhqRgNRAmgNw/slEfiXv0CDCCajGLCUc/g3T46dlANdOiM9iy2fvbry+r+EZzRzv3yWWaGaOjfRl3G2marGwbQ==',key_name='tempest-keypair-1599369444',keypairs=<?>,launch_index=0,launched_at=2023-11-16T10:34:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d13c6ff3c30549ca9ab44d9fc1fedc6f',ramdisk_id='',reservation_id='r-0ak5y4t4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-2108292208',owner_user_name='tempest-AttachVolumeNegativeTest-2108292208-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T10:34:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5aa5beeeca5d4dc89cf5333942da756f',uuid=b29fe8bd-8169-497f-91b4-0e03360f5a1c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "88f5ab37-029f-45b9-a240-bd30eb5c89a2", "address": "fa:16:3e:f0:80:ce", "network": {"id": "8931cd8f-3c0b-4d49-ae98-48f818e854e7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1902653571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d13c6ff3c30549ca9ab44d9fc1fedc6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88f5ab37-02", "ovs_interfaceid": "88f5ab37-029f-45b9-a240-bd30eb5c89a2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 10:35:57 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-d39a3a95-90f5-468c-9e38-4ebe11f4cc1c tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Converting VIF {"id": "88f5ab37-029f-45b9-a240-bd30eb5c89a2", "address": "fa:16:3e:f0:80:ce", "network": {"id": "8931cd8f-3c0b-4d49-ae98-48f818e854e7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1902653571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d13c6ff3c30549ca9ab44d9fc1fedc6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88f5ab37-02", "ovs_interfaceid": "88f5ab37-029f-45b9-a240-bd30eb5c89a2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:35:57 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-d39a3a95-90f5-468c-9e38-4ebe11f4cc1c tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f0:80:ce,bridge_name='br-int',has_traffic_filtering=True,id=88f5ab37-029f-45b9-a240-bd30eb5c89a2,network=Network(8931cd8f-3c0b-4d49-ae98-48f818e854e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88f5ab37-02') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:35:57 user nova-compute[85141]: DEBUG os_vif [None req-d39a3a95-90f5-468c-9e38-4ebe11f4cc1c tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f0:80:ce,bridge_name='br-int',has_traffic_filtering=True,id=88f5ab37-029f-45b9-a240-bd30eb5c89a2,network=Network(8931cd8f-3c0b-4d49-ae98-48f818e854e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88f5ab37-02') {{(pid=85141) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 10:35:57 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:35:57 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap88f5ab37-02, bridge=br-int, if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:35:57 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:35:57 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:35:57 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:35:57 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8df9d557-4f6d-4fd1-832e-a68f19399825) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:35:57 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:35:57 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:35:57 user nova-compute[85141]: INFO os_vif [None req-d39a3a95-90f5-468c-9e38-4ebe11f4cc1c tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f0:80:ce,bridge_name='br-int',has_traffic_filtering=True,id=88f5ab37-029f-45b9-a240-bd30eb5c89a2,network=Network(8931cd8f-3c0b-4d49-ae98-48f818e854e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88f5ab37-02')
Nov 16 10:35:57 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-d39a3a95-90f5-468c-9e38-4ebe11f4cc1c tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] [instance: b29fe8bd-8169-497f-91b4-0e03360f5a1c] Deleting instance files /opt/stack/data/nova/instances/b29fe8bd-8169-497f-91b4-0e03360f5a1c_del
Nov 16 10:35:57 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-d39a3a95-90f5-468c-9e38-4ebe11f4cc1c tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] [instance: b29fe8bd-8169-497f-91b4-0e03360f5a1c] Deletion of /opt/stack/data/nova/instances/b29fe8bd-8169-497f-91b4-0e03360f5a1c_del complete
Nov 16 10:35:57 user nova-compute[85141]: INFO nova.compute.manager [None req-d39a3a95-90f5-468c-9e38-4ebe11f4cc1c tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] [instance: b29fe8bd-8169-497f-91b4-0e03360f5a1c] Took 0.84 seconds to destroy the instance on the hypervisor.
Nov 16 10:35:57 user nova-compute[85141]: DEBUG oslo.service.loopingcall [None req-d39a3a95-90f5-468c-9e38-4ebe11f4cc1c tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=85141) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 10:35:57 user nova-compute[85141]: DEBUG nova.compute.manager [-] [instance: b29fe8bd-8169-497f-91b4-0e03360f5a1c] Deallocating network for instance {{(pid=85141) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 10:35:57 user nova-compute[85141]: DEBUG nova.network.neutron [-] [instance: b29fe8bd-8169-497f-91b4-0e03360f5a1c] deallocate_for_instance() {{(pid=85141) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 10:35:57 user nova-compute[85141]: DEBUG nova.network.neutron [-] [instance: b29fe8bd-8169-497f-91b4-0e03360f5a1c] Updating instance_info_cache with network_info: [] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:35:57 user nova-compute[85141]: INFO nova.compute.manager [-] [instance: b29fe8bd-8169-497f-91b4-0e03360f5a1c] Took 0.66 seconds to deallocate network for instance.
Nov 16 10:35:57 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-d39a3a95-90f5-468c-9e38-4ebe11f4cc1c tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:35:57 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-d39a3a95-90f5-468c-9e38-4ebe11f4cc1c tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:35:57 user nova-compute[85141]: DEBUG nova.compute.provider_tree [None req-d39a3a95-90f5-468c-9e38-4ebe11f4cc1c tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Inventory has not changed in ProviderTree for provider: bf8e0fa1-16b6-408f-9203-c4cd63916272 {{(pid=85141) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 10:35:57 user nova-compute[85141]: DEBUG nova.scheduler.client.report [None req-d39a3a95-90f5-468c-9e38-4ebe11f4cc1c tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Inventory has not changed for provider bf8e0fa1-16b6-408f-9203-c4cd63916272 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=85141) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 10:35:57 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-d39a3a95-90f5-468c-9e38-4ebe11f4cc1c tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.145s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:35:57 user nova-compute[85141]: INFO nova.scheduler.client.report [None req-d39a3a95-90f5-468c-9e38-4ebe11f4cc1c tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Deleted allocations for instance b29fe8bd-8169-497f-91b4-0e03360f5a1c
Nov 16 10:35:58 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-d39a3a95-90f5-468c-9e38-4ebe11f4cc1c tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Lock "b29fe8bd-8169-497f-91b4-0e03360f5a1c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.815s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:35:58 user nova-compute[85141]: DEBUG nova.compute.manager [req-be16cc44-fcab-4eba-bab5-55dacbe97a7b req-a27c53ea-d87c-47a9-b5b7-022ebdd3b1a1 service nova] [instance: b29fe8bd-8169-497f-91b4-0e03360f5a1c] Received event network-vif-plugged-88f5ab37-029f-45b9-a240-bd30eb5c89a2 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:35:58 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-be16cc44-fcab-4eba-bab5-55dacbe97a7b req-a27c53ea-d87c-47a9-b5b7-022ebdd3b1a1 service nova] Acquiring lock "b29fe8bd-8169-497f-91b4-0e03360f5a1c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:35:58 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-be16cc44-fcab-4eba-bab5-55dacbe97a7b req-a27c53ea-d87c-47a9-b5b7-022ebdd3b1a1 service nova] Lock "b29fe8bd-8169-497f-91b4-0e03360f5a1c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:35:58 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-be16cc44-fcab-4eba-bab5-55dacbe97a7b req-a27c53ea-d87c-47a9-b5b7-022ebdd3b1a1 service nova] Lock "b29fe8bd-8169-497f-91b4-0e03360f5a1c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:35:58 user nova-compute[85141]: DEBUG nova.compute.manager [req-be16cc44-fcab-4eba-bab5-55dacbe97a7b req-a27c53ea-d87c-47a9-b5b7-022ebdd3b1a1 service nova] [instance: b29fe8bd-8169-497f-91b4-0e03360f5a1c] No waiting events found dispatching network-vif-plugged-88f5ab37-029f-45b9-a240-bd30eb5c89a2 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:35:58 user nova-compute[85141]: WARNING nova.compute.manager [req-be16cc44-fcab-4eba-bab5-55dacbe97a7b req-a27c53ea-d87c-47a9-b5b7-022ebdd3b1a1 service nova] [instance: b29fe8bd-8169-497f-91b4-0e03360f5a1c] Received unexpected event network-vif-plugged-88f5ab37-029f-45b9-a240-bd30eb5c89a2 for instance with vm_state deleted and task_state None.
Nov 16 10:35:58 user nova-compute[85141]: DEBUG nova.compute.manager [req-be16cc44-fcab-4eba-bab5-55dacbe97a7b req-a27c53ea-d87c-47a9-b5b7-022ebdd3b1a1 service nova] [instance: b29fe8bd-8169-497f-91b4-0e03360f5a1c] Received event network-vif-deleted-88f5ab37-029f-45b9-a240-bd30eb5c89a2 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:35:58 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:35:58 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-4b1bc4bd-5088-4520-ae55-82c1ddecb9e3 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Acquiring lock "797c873e-cf15-4d3c-a3bc-bd2a81a80014" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:35:58 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-4b1bc4bd-5088-4520-ae55-82c1ddecb9e3 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Lock "797c873e-cf15-4d3c-a3bc-bd2a81a80014" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:35:58 user nova-compute[85141]: DEBUG nova.compute.manager [None req-4b1bc4bd-5088-4520-ae55-82c1ddecb9e3 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: 797c873e-cf15-4d3c-a3bc-bd2a81a80014] Starting instance... {{(pid=85141) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 10:35:58 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-4b1bc4bd-5088-4520-ae55-82c1ddecb9e3 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:35:58 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-4b1bc4bd-5088-4520-ae55-82c1ddecb9e3 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:35:58 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-4b1bc4bd-5088-4520-ae55-82c1ddecb9e3 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=85141) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 10:35:58 user nova-compute[85141]: INFO nova.compute.claims [None req-4b1bc4bd-5088-4520-ae55-82c1ddecb9e3 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: 797c873e-cf15-4d3c-a3bc-bd2a81a80014] Claim successful on node user
Nov 16 10:35:59 user nova-compute[85141]: DEBUG nova.compute.provider_tree [None req-4b1bc4bd-5088-4520-ae55-82c1ddecb9e3 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Inventory has not changed in ProviderTree for provider: bf8e0fa1-16b6-408f-9203-c4cd63916272 {{(pid=85141) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 10:35:59 user nova-compute[85141]: DEBUG nova.scheduler.client.report [None req-4b1bc4bd-5088-4520-ae55-82c1ddecb9e3 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Inventory has not changed for provider bf8e0fa1-16b6-408f-9203-c4cd63916272 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=85141) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 10:35:59 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-4b1bc4bd-5088-4520-ae55-82c1ddecb9e3 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.267s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:35:59 user nova-compute[85141]: DEBUG nova.compute.manager [None req-4b1bc4bd-5088-4520-ae55-82c1ddecb9e3 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: 797c873e-cf15-4d3c-a3bc-bd2a81a80014] Start building networks asynchronously for instance. {{(pid=85141) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 10:35:59 user nova-compute[85141]: DEBUG nova.compute.manager [None req-4b1bc4bd-5088-4520-ae55-82c1ddecb9e3 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: 797c873e-cf15-4d3c-a3bc-bd2a81a80014] Allocating IP information in the background. {{(pid=85141) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 10:35:59 user nova-compute[85141]: DEBUG nova.network.neutron [None req-4b1bc4bd-5088-4520-ae55-82c1ddecb9e3 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: 797c873e-cf15-4d3c-a3bc-bd2a81a80014] allocate_for_instance() {{(pid=85141) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 10:35:59 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-4b1bc4bd-5088-4520-ae55-82c1ddecb9e3 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: 797c873e-cf15-4d3c-a3bc-bd2a81a80014] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 10:35:59 user nova-compute[85141]: DEBUG nova.compute.manager [None req-4b1bc4bd-5088-4520-ae55-82c1ddecb9e3 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: 797c873e-cf15-4d3c-a3bc-bd2a81a80014] Start building block device mappings for instance. {{(pid=85141) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 10:35:59 user nova-compute[85141]: DEBUG nova.policy [None req-4b1bc4bd-5088-4520-ae55-82c1ddecb9e3 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7261b57c36904fcda87a9ea32d4b5b31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aec3bb9fe5e6446590900b5adf65df0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85141) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 10:35:59 user nova-compute[85141]: INFO nova.virt.block_device [None req-4b1bc4bd-5088-4520-ae55-82c1ddecb9e3 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: 797c873e-cf15-4d3c-a3bc-bd2a81a80014] Booting with volume 584dd8df-f6a2-4e35-be7e-8de1e759491b at /dev/vda
Nov 16 10:35:59 user nova-compute[85141]: DEBUG os_brick.utils [None req-4b1bc4bd-5088-4520-ae55-82c1ddecb9e3 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 10:35:59 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:35:59 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:35:59 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e1ebabb-f67f-45e6-a3e2-7cdeeeaa6570]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c7834de5c295\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:35:59 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:35:59 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:35:59 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[5761790b-f9ff-43c4-ad28-6296409a3b3c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:35:59 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:35:59 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:35:59 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f77e3bc-cd6c-40a6-b9b4-d0da3925a047]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:35:59 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[8862b919-27fd-41e0-ad03-5093d619b906]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:35:59 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-4b1bc4bd-5088-4520-ae55-82c1ddecb9e3 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Running cmd (subprocess): nvme version {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:35:59 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-4b1bc4bd-5088-4520-ae55-82c1ddecb9e3 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] 'nvme version' failed. Not Retrying. {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 10:35:59 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4b1bc4bd-5088-4520-ae55-82c1ddecb9e3 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] nvme not present on system {{(pid=85141) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 10:35:59 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:35:59 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 10:35:59 user nova-compute[85141]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 10:35:59 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[caad7020-9418-4df4-b4df-e0f00d01344b]: (4, '') {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:35:59 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.lightos [None req-4b1bc4bd-5088-4520-ae55-82c1ddecb9e3 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=85141) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 10:35:59 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.lightos [None req-4b1bc4bd-5088-4520-ae55-82c1ddecb9e3 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=85141) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 10:35:59 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.lightos [None req-4b1bc4bd-5088-4520-ae55-82c1ddecb9e3 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] LIGHTOS: no hostnqn found. {{(pid=85141) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 10:35:59 user nova-compute[85141]: DEBUG os_brick.utils [None req-4b1bc4bd-5088-4520-ae55-82c1ddecb9e3 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c7834de5c295', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 10:35:59 user nova-compute[85141]: DEBUG nova.virt.block_device [None req-4b1bc4bd-5088-4520-ae55-82c1ddecb9e3 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: 797c873e-cf15-4d3c-a3bc-bd2a81a80014] Updating existing volume attachment record: f25dc5e4-ca53-4c8c-880d-57c80b7adbe4 {{(pid=85141) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 10:35:59 user nova-compute[85141]: DEBUG nova.network.neutron [None req-4b1bc4bd-5088-4520-ae55-82c1ddecb9e3 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: 797c873e-cf15-4d3c-a3bc-bd2a81a80014] Successfully created port: 27c72f03-eb45-49ad-b17e-330eecf72cb1 {{(pid=85141) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 10:36:00 user nova-compute[85141]: DEBUG nova.network.neutron [None req-4b1bc4bd-5088-4520-ae55-82c1ddecb9e3 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: 797c873e-cf15-4d3c-a3bc-bd2a81a80014] Successfully updated port: 27c72f03-eb45-49ad-b17e-330eecf72cb1 {{(pid=85141) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 10:36:00 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-4b1bc4bd-5088-4520-ae55-82c1ddecb9e3 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Acquiring lock "refresh_cache-797c873e-cf15-4d3c-a3bc-bd2a81a80014" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:36:00 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-4b1bc4bd-5088-4520-ae55-82c1ddecb9e3 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Acquired lock "refresh_cache-797c873e-cf15-4d3c-a3bc-bd2a81a80014" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:36:00 user nova-compute[85141]: DEBUG nova.network.neutron [None req-4b1bc4bd-5088-4520-ae55-82c1ddecb9e3 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: 797c873e-cf15-4d3c-a3bc-bd2a81a80014] Building network info cache for instance {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 10:36:00 user nova-compute[85141]: DEBUG nova.compute.manager [req-6568f0b0-2deb-4bc0-8002-068accd4cd61 req-796c8be5-8cd8-44c5-9577-64769d0f79d1 service nova] [instance: 797c873e-cf15-4d3c-a3bc-bd2a81a80014] Received event network-changed-27c72f03-eb45-49ad-b17e-330eecf72cb1 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:36:00 user nova-compute[85141]: DEBUG nova.compute.manager [req-6568f0b0-2deb-4bc0-8002-068accd4cd61 req-796c8be5-8cd8-44c5-9577-64769d0f79d1 service nova] [instance: 797c873e-cf15-4d3c-a3bc-bd2a81a80014] Refreshing instance network info cache due to event network-changed-27c72f03-eb45-49ad-b17e-330eecf72cb1. {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 10:36:00 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-6568f0b0-2deb-4bc0-8002-068accd4cd61 req-796c8be5-8cd8-44c5-9577-64769d0f79d1 service nova] Acquiring lock "refresh_cache-797c873e-cf15-4d3c-a3bc-bd2a81a80014" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:36:00 user nova-compute[85141]: DEBUG nova.network.neutron [None req-4b1bc4bd-5088-4520-ae55-82c1ddecb9e3 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: 797c873e-cf15-4d3c-a3bc-bd2a81a80014] Instance cache missing network info. {{(pid=85141) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 10:36:01 user nova-compute[85141]: DEBUG nova.network.neutron [None req-4b1bc4bd-5088-4520-ae55-82c1ddecb9e3 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: 797c873e-cf15-4d3c-a3bc-bd2a81a80014] Updating instance_info_cache with network_info: [{"id": "27c72f03-eb45-49ad-b17e-330eecf72cb1", "address": "fa:16:3e:0d:32:17", "network": {"id": "b8ada47f-9721-4358-ac4f-0305f06dbbb8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1663922860-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aec3bb9fe5e6446590900b5adf65df0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27c72f03-eb", "ovs_interfaceid": "27c72f03-eb45-49ad-b17e-330eecf72cb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:36:01 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-4b1bc4bd-5088-4520-ae55-82c1ddecb9e3 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Releasing lock "refresh_cache-797c873e-cf15-4d3c-a3bc-bd2a81a80014" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:36:01 user nova-compute[85141]: DEBUG nova.compute.manager [None req-4b1bc4bd-5088-4520-ae55-82c1ddecb9e3 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: 797c873e-cf15-4d3c-a3bc-bd2a81a80014] Instance network_info: |[{"id": "27c72f03-eb45-49ad-b17e-330eecf72cb1", "address": "fa:16:3e:0d:32:17", "network": {"id": "b8ada47f-9721-4358-ac4f-0305f06dbbb8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1663922860-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aec3bb9fe5e6446590900b5adf65df0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27c72f03-eb", "ovs_interfaceid": "27c72f03-eb45-49ad-b17e-330eecf72cb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=85141) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 10:36:01 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-6568f0b0-2deb-4bc0-8002-068accd4cd61 req-796c8be5-8cd8-44c5-9577-64769d0f79d1 service nova] Acquired lock "refresh_cache-797c873e-cf15-4d3c-a3bc-bd2a81a80014" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:36:01 user nova-compute[85141]: DEBUG nova.network.neutron [req-6568f0b0-2deb-4bc0-8002-068accd4cd61 req-796c8be5-8cd8-44c5-9577-64769d0f79d1 service nova] [instance: 797c873e-cf15-4d3c-a3bc-bd2a81a80014] Refreshing network info cache for port 27c72f03-eb45-49ad-b17e-330eecf72cb1 {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 10:36:01 user nova-compute[85141]: DEBUG nova.network.neutron [req-6568f0b0-2deb-4bc0-8002-068accd4cd61 req-796c8be5-8cd8-44c5-9577-64769d0f79d1 service nova] [instance: 797c873e-cf15-4d3c-a3bc-bd2a81a80014] Updated VIF entry in instance network info cache for port 27c72f03-eb45-49ad-b17e-330eecf72cb1. {{(pid=85141) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 10:36:01 user nova-compute[85141]: DEBUG nova.network.neutron [req-6568f0b0-2deb-4bc0-8002-068accd4cd61 req-796c8be5-8cd8-44c5-9577-64769d0f79d1 service nova] [instance: 797c873e-cf15-4d3c-a3bc-bd2a81a80014] Updating instance_info_cache with network_info: [{"id": "27c72f03-eb45-49ad-b17e-330eecf72cb1", "address": "fa:16:3e:0d:32:17", "network": {"id": "b8ada47f-9721-4358-ac4f-0305f06dbbb8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1663922860-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aec3bb9fe5e6446590900b5adf65df0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27c72f03-eb", "ovs_interfaceid": "27c72f03-eb45-49ad-b17e-330eecf72cb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:36:01 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-6568f0b0-2deb-4bc0-8002-068accd4cd61 req-796c8be5-8cd8-44c5-9577-64769d0f79d1 service nova] Releasing lock "refresh_cache-797c873e-cf15-4d3c-a3bc-bd2a81a80014" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:36:02 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:36:04 user nova-compute[85141]: DEBUG nova.compute.manager [None req-4b1bc4bd-5088-4520-ae55-82c1ddecb9e3 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: 797c873e-cf15-4d3c-a3bc-bd2a81a80014] Start spawning the instance on the hypervisor. {{(pid=85141) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 10:36:04 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-4b1bc4bd-5088-4520-ae55-82c1ddecb9e3 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: 797c873e-cf15-4d3c-a3bc-bd2a81a80014] Creating instance directory {{(pid=85141) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 10:36:04 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-4b1bc4bd-5088-4520-ae55-82c1ddecb9e3 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: 797c873e-cf15-4d3c-a3bc-bd2a81a80014] Creating image(s)
Nov 16 10:36:04 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-4b1bc4bd-5088-4520-ae55-82c1ddecb9e3 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: 797c873e-cf15-4d3c-a3bc-bd2a81a80014] Did not create local disks {{(pid=85141) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 16 10:36:04 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-4b1bc4bd-5088-4520-ae55-82c1ddecb9e3 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: 797c873e-cf15-4d3c-a3bc-bd2a81a80014] Ensure instance console log exists: /opt/stack/data/nova/instances/797c873e-cf15-4d3c-a3bc-bd2a81a80014/console.log {{(pid=85141) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 10:36:04 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-4b1bc4bd-5088-4520-ae55-82c1ddecb9e3 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:36:04 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-4b1bc4bd-5088-4520-ae55-82c1ddecb9e3 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:36:04 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-4b1bc4bd-5088-4520-ae55-82c1ddecb9e3 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:36:04 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-4b1bc4bd-5088-4520-ae55-82c1ddecb9e3 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: 797c873e-cf15-4d3c-a3bc-bd2a81a80014] Start _get_guest_xml network_info=[{"id": "27c72f03-eb45-49ad-b17e-330eecf72cb1", "address": "fa:16:3e:0d:32:17", "network": {"id": "b8ada47f-9721-4358-ac4f-0305f06dbbb8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1663922860-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aec3bb9fe5e6446590900b5adf65df0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27c72f03-eb", "ovs_interfaceid": "27c72f03-eb45-49ad-b17e-330eecf72cb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:584dd8df-f6a2-4e35-be7e-8de1e759491b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XoQOTquf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '797c873e-cf15-4d3c-a3bc-bd2a81a80014', 'attached_at': '', 'detached_at': '', 'volume_id': '584dd8df-f6a2-4e35-be7e-8de1e759491b', 'serial': '584dd8df-f6a2-4e35-be7e-8de1e759491b'}, 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'attachment_id': 'f25dc5e4-ca53-4c8c-880d-57c80b7adbe4', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=85141) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 10:36:04 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-4b1bc4bd-5088-4520-ae55-82c1ddecb9e3 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:36:04 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-4b1bc4bd-5088-4520-ae55-82c1ddecb9e3 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:36:04 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-4b1bc4bd-5088-4520-ae55-82c1ddecb9e3 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=85141) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 10:36:04 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-4b1bc4bd-5088-4520-ae55-82c1ddecb9e3 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] CPU controller missing on host. {{(pid=85141) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 10:36:04 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-4b1bc4bd-5088-4520-ae55-82c1ddecb9e3 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=85141) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 10:36:04 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-4b1bc4bd-5088-4520-ae55-82c1ddecb9e3 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] CPU controller found on host. {{(pid=85141) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 10:36:04 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-4b1bc4bd-5088-4520-ae55-82c1ddecb9e3 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=85141) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 10:36:04 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-4b1bc4bd-5088-4520-ae55-82c1ddecb9e3 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T10:06:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 10:36:04 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-4b1bc4bd-5088-4520-ae55-82c1ddecb9e3 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Flavor limits 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 10:36:04 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-4b1bc4bd-5088-4520-ae55-82c1ddecb9e3 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Image limits 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 10:36:04 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-4b1bc4bd-5088-4520-ae55-82c1ddecb9e3 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Flavor pref 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 10:36:04 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-4b1bc4bd-5088-4520-ae55-82c1ddecb9e3 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Image pref 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 10:36:04 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-4b1bc4bd-5088-4520-ae55-82c1ddecb9e3 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 10:36:04 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-4b1bc4bd-5088-4520-ae55-82c1ddecb9e3 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 10:36:04 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-4b1bc4bd-5088-4520-ae55-82c1ddecb9e3 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=85141) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 10:36:04 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-4b1bc4bd-5088-4520-ae55-82c1ddecb9e3 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Got 1 possible topologies {{(pid=85141) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 10:36:04 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-4b1bc4bd-5088-4520-ae55-82c1ddecb9e3 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 10:36:04 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-4b1bc4bd-5088-4520-ae55-82c1ddecb9e3 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 10:36:04 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4b1bc4bd-5088-4520-ae55-82c1ddecb9e3 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: 797c873e-cf15-4d3c-a3bc-bd2a81a80014] Calling os-brick to attach iSCSI Volume {{(pid=85141) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 10:36:04 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b1bc4bd-5088-4520-ae55-82c1ddecb9e3 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51806b6080>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:584dd8df-f6a2-4e35-be7e-8de1e759491b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XoQOTquf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 10:36:04 user nova-compute[85141]: WARNING os_brick.initiator.connectors.base [None req-4b1bc4bd-5088-4520-ae55-82c1ddecb9e3 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 10:36:04 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-4b1bc4bd-5088-4520-ae55-82c1ddecb9e3 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 10:36:04 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-4b1bc4bd-5088-4520-ae55-82c1ddecb9e3 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 10:36:04 user nova-compute[85141]: WARNING os_brick.initiator.connectors.base [None req-4b1bc4bd-5088-4520-ae55-82c1ddecb9e3 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 10:36:04 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-4b1bc4bd-5088-4520-ae55-82c1ddecb9e3 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:584dd8df-f6a2-4e35-be7e-8de1e759491b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 10:36:04 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-4b1bc4bd-5088-4520-ae55-82c1ddecb9e3 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:584dd8df-f6a2-4e35-be7e-8de1e759491b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 10:36:04 user nova-compute[85141]: INFO os_brick.initiator.connectors.iscsi [None req-4b1bc4bd-5088-4520-ae55-82c1ddecb9e3 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 10:36:04 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:584dd8df-f6a2-4e35-be7e-8de1e759491b -p 172.16.0.220:3260 {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:36:04 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:584dd8df-f6a2-4e35-be7e-8de1e759491b -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:36:04 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6ddab4b-e5c7-4f47-a0b7-b84e43e0c897]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:36:04 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b1bc4bd-5088-4520-ae55-82c1ddecb9e3 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 10:36:04 user nova-compute[85141]:  {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:36:04 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:584dd8df-f6a2-4e35-be7e-8de1e759491b -p 172.16.0.220:3260 --interface default --op new {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:36:04 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:584dd8df-f6a2-4e35-be7e-8de1e759491b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:36:04 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2fb1402-5364-4f26-a9ec-6cdd67a2af05]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:584dd8df-f6a2-4e35-be7e-8de1e759491b] added\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:36:04 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b1bc4bd-5088-4520-ae55-82c1ddecb9e3 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:584dd8df-f6a2-4e35-be7e-8de1e759491b] added
Nov 16 10:36:04 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:36:04 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:584dd8df-f6a2-4e35-be7e-8de1e759491b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:36:04 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:584dd8df-f6a2-4e35-be7e-8de1e759491b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:36:04 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[37e630c3-a406-48bb-a80c-da52d0800e65]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:36:04 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b1bc4bd-5088-4520-ae55-82c1ddecb9e3 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:36:04 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:584dd8df-f6a2-4e35-be7e-8de1e759491b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:36:04 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:584dd8df-f6a2-4e35-be7e-8de1e759491b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:36:04 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc624eed-5d13-4d62-b926-1541eb97732f]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:36:04 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b1bc4bd-5088-4520-ae55-82c1ddecb9e3 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:36:04 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:584dd8df-f6a2-4e35-be7e-8de1e759491b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XoQOTquf {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:36:04 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:584dd8df-f6a2-4e35-be7e-8de1e759491b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XoQOTquf" returned: 0 in 0.016s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:36:04 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c3c835a-573f-4847-8060-d27a6551c707]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:36:04 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b1bc4bd-5088-4520-ae55-82c1ddecb9e3 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XoQOTquf'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:36:04 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:584dd8df-f6a2-4e35-be7e-8de1e759491b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:36:04 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:584dd8df-f6a2-4e35-be7e-8de1e759491b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:36:04 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fa6fd59-f719-42f9-a6cb-8324390530ae]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:36:04 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b1bc4bd-5088-4520-ae55-82c1ddecb9e3 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:36:04 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:36:04 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:36:04 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b38af32-dce3-4b8b-aa9e-799ab03193c1]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fd95458-b13d-439d-b30c-6dcfe2fa8419 (non-flash)\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:36:04 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b1bc4bd-5088-4520-ae55-82c1ddecb9e3 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fd95458-b13d-439d-b30c-6dcfe2fa8419 (non-flash)
Nov 16 10:36:04 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:36:04 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b1bc4bd-5088-4520-ae55-82c1ddecb9e3 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fd95458-b13d-439d-b30c-6dcfe2fa8419 (non-flash)
Nov 16 10:36:04 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 10:36:04 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:584dd8df-f6a2-4e35-be7e-8de1e759491b -p 172.16.0.220:3260 --login {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:36:04 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:584dd8df-f6a2-4e35-be7e-8de1e759491b -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:36:04 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[8124558c-e191-42b7-a9dc-93f33fbe22c1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:584dd8df-f6a2-4e35-be7e-8de1e759491b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:584dd8df-f6a2-4e35-be7e-8de1e759491b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:36:04 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b1bc4bd-5088-4520-ae55-82c1ddecb9e3 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:584dd8df-f6a2-4e35-be7e-8de1e759491b, portal: 172.16.0.220,3260]
Nov 16 10:36:04 user nova-compute[85141]: Login to [iface: default, target: iqn.2010-10.org.openstack:584dd8df-f6a2-4e35-be7e-8de1e759491b, portal: 172.16.0.220,3260] successful.
Nov 16 10:36:04 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:36:04 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:584dd8df-f6a2-4e35-be7e-8de1e759491b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:36:04 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:584dd8df-f6a2-4e35-be7e-8de1e759491b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:36:04 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcb9010a-257b-4405-b463-7ae6c156bcc9]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:36:04 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b1bc4bd-5088-4520-ae55-82c1ddecb9e3 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:36:04 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:36:04 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:36:04 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7b7b7f4-e637-4b40-b340-5ce2985cf6eb]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fd95458-b13d-439d-b30c-6dcfe2fa8419 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:584dd8df-f6a2-4e35-be7e-8de1e759491b (non-flash)\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:36:04 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b1bc4bd-5088-4520-ae55-82c1ddecb9e3 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fd95458-b13d-439d-b30c-6dcfe2fa8419 (non-flash)
Nov 16 10:36:04 user nova-compute[85141]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:584dd8df-f6a2-4e35-be7e-8de1e759491b (non-flash)
Nov 16 10:36:04 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:36:04 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b1bc4bd-5088-4520-ae55-82c1ddecb9e3 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fd95458-b13d-439d-b30c-6dcfe2fa8419 (non-flash)
Nov 16 10:36:04 user nova-compute[85141]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:584dd8df-f6a2-4e35-be7e-8de1e759491b (non-flash)
Nov 16 10:36:04 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 10:36:04 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-4b1bc4bd-5088-4520-ae55-82c1ddecb9e3 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:584dd8df-f6a2-4e35-be7e-8de1e759491b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.239s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 10:36:04 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b1bc4bd-5088-4520-ae55-82c1ddecb9e3 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Connected to 172.16.0.220:3260 {{(pid=85141) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 10:36:04 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-4b1bc4bd-5088-4520-ae55-82c1ddecb9e3 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] HCTL ('33', '-', '-', 0) found on session 55 with lun 0 {{(pid=85141) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 10:36:04 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-4b1bc4bd-5088-4520-ae55-82c1ddecb9e3 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=85141) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 10:36:04 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:36:04 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:36:04 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[7df27089-8c57-4efa-b6a8-10f6b9872dd7]: (4, ('- - 0', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:36:04 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-4b1bc4bd-5088-4520-ae55-82c1ddecb9e3 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Searching for a device in session 55 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=85141) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 10:36:04 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b1bc4bd-5088-4520-ae55-82c1ddecb9e3 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:584dd8df-f6a2-4e35-be7e-8de1e759491b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XoQOTquf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=85141) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 10:36:05 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-4b1bc4bd-5088-4520-ae55-82c1ddecb9e3 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.273s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 10:36:05 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b1bc4bd-5088-4520-ae55-82c1ddecb9e3 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] <== connect_volume: return (1275ms) {'type': 'block', 'scsi_wwn': '23335306261396637', 'path': '/dev/sdb'} {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 10:36:05 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4b1bc4bd-5088-4520-ae55-82c1ddecb9e3 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: 797c873e-cf15-4d3c-a3bc-bd2a81a80014] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23335306261396637', 'path': '/dev/sdb'} {{(pid=85141) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 10:36:06 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-4b1bc4bd-5088-4520-ae55-82c1ddecb9e3 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T10:35:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1931039385',display_name='tempest-TestVolumeBootPattern-server-1931039385',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1931039385',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK2tiQ/yBbFjZdjBIR2tKrAVD3soVHRqo5J6ZL2tZkf+/CHlij0TJEEFuVTAcbccfWNw+REn7xM/u4NrsIPLxGXc8EfsNWZLl3/YiEOdS+xhO6c08a6foGqxQYJ8pZUDrQ==',key_name='tempest-TestVolumeBootPattern-1363391981',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aec3bb9fe5e6446590900b5adf65df0f',ramdisk_id='',reservation_id='r-calibs7n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1979039357',owner_user_name='tempest-TestVolumeBootPattern-1979039357-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T10:35:59Z,user_data=None,user_id='7261b57c36904fcda87a9ea32d4b5b31',uuid=797c873e-cf15-4d3c-a3bc-bd2a81a80014,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "27c72f03-eb45-49ad-b17e-330eecf72cb1", "address": "fa:16:3e:0d:32:17", "network": {"id": "b8ada47f-9721-4358-ac4f-0305f06dbbb8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1663922860-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aec3bb9fe5e6446590900b5adf65df0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27c72f03-eb", "ovs_interfaceid": "27c72f03-eb45-49ad-b17e-330eecf72cb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=85141) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 10:36:06 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-4b1bc4bd-5088-4520-ae55-82c1ddecb9e3 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Converting VIF {"id": "27c72f03-eb45-49ad-b17e-330eecf72cb1", "address": "fa:16:3e:0d:32:17", "network": {"id": "b8ada47f-9721-4358-ac4f-0305f06dbbb8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1663922860-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aec3bb9fe5e6446590900b5adf65df0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27c72f03-eb", "ovs_interfaceid": "27c72f03-eb45-49ad-b17e-330eecf72cb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:36:06 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-4b1bc4bd-5088-4520-ae55-82c1ddecb9e3 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0d:32:17,bridge_name='br-int',has_traffic_filtering=True,id=27c72f03-eb45-49ad-b17e-330eecf72cb1,network=Network(b8ada47f-9721-4358-ac4f-0305f06dbbb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27c72f03-eb') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:36:06 user nova-compute[85141]: DEBUG nova.objects.instance [None req-4b1bc4bd-5088-4520-ae55-82c1ddecb9e3 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Lazy-loading 'pci_devices' on Instance uuid 797c873e-cf15-4d3c-a3bc-bd2a81a80014 {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:36:06 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-4b1bc4bd-5088-4520-ae55-82c1ddecb9e3 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: 797c873e-cf15-4d3c-a3bc-bd2a81a80014] End _get_guest_xml xml=<domain type="kvm">
Nov 16 10:36:06 user nova-compute[85141]:   <uuid>797c873e-cf15-4d3c-a3bc-bd2a81a80014</uuid>
Nov 16 10:36:06 user nova-compute[85141]:   <name>instance-00000031</name>
Nov 16 10:36:06 user nova-compute[85141]:   <memory>524288</memory>
Nov 16 10:36:06 user nova-compute[85141]:   <vcpu>1</vcpu>
Nov 16 10:36:06 user nova-compute[85141]:   <metadata>
Nov 16 10:36:06 user nova-compute[85141]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 10:36:06 user nova-compute[85141]:       <nova:package version="0.0.0"/>
Nov 16 10:36:06 user nova-compute[85141]:       <nova:name>tempest-TestVolumeBootPattern-server-1931039385</nova:name>
Nov 16 10:36:06 user nova-compute[85141]:       <nova:creationTime>2023-11-16 10:36:04</nova:creationTime>
Nov 16 10:36:06 user nova-compute[85141]:       <nova:flavor name="m1.tiny">
Nov 16 10:36:06 user nova-compute[85141]:         <nova:memory>512</nova:memory>
Nov 16 10:36:06 user nova-compute[85141]:         <nova:disk>1</nova:disk>
Nov 16 10:36:06 user nova-compute[85141]:         <nova:swap>0</nova:swap>
Nov 16 10:36:06 user nova-compute[85141]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 10:36:06 user nova-compute[85141]:         <nova:vcpus>1</nova:vcpus>
Nov 16 10:36:06 user nova-compute[85141]:       </nova:flavor>
Nov 16 10:36:06 user nova-compute[85141]:       <nova:owner>
Nov 16 10:36:06 user nova-compute[85141]:         <nova:user uuid="7261b57c36904fcda87a9ea32d4b5b31">tempest-TestVolumeBootPattern-1979039357-project-member</nova:user>
Nov 16 10:36:06 user nova-compute[85141]:         <nova:project uuid="aec3bb9fe5e6446590900b5adf65df0f">tempest-TestVolumeBootPattern-1979039357</nova:project>
Nov 16 10:36:06 user nova-compute[85141]:       </nova:owner>
Nov 16 10:36:06 user nova-compute[85141]:       <nova:ports>
Nov 16 10:36:06 user nova-compute[85141]:         <nova:port uuid="27c72f03-eb45-49ad-b17e-330eecf72cb1">
Nov 16 10:36:06 user nova-compute[85141]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 16 10:36:06 user nova-compute[85141]:         </nova:port>
Nov 16 10:36:06 user nova-compute[85141]:       </nova:ports>
Nov 16 10:36:06 user nova-compute[85141]:     </nova:instance>
Nov 16 10:36:06 user nova-compute[85141]:   </metadata>
Nov 16 10:36:06 user nova-compute[85141]:   <sysinfo type="smbios">
Nov 16 10:36:06 user nova-compute[85141]:     <system>
Nov 16 10:36:06 user nova-compute[85141]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 10:36:06 user nova-compute[85141]:       <entry name="product">OpenStack Nova</entry>
Nov 16 10:36:06 user nova-compute[85141]:       <entry name="version">0.0.0</entry>
Nov 16 10:36:06 user nova-compute[85141]:       <entry name="serial">797c873e-cf15-4d3c-a3bc-bd2a81a80014</entry>
Nov 16 10:36:06 user nova-compute[85141]:       <entry name="uuid">797c873e-cf15-4d3c-a3bc-bd2a81a80014</entry>
Nov 16 10:36:06 user nova-compute[85141]:       <entry name="family">Virtual Machine</entry>
Nov 16 10:36:06 user nova-compute[85141]:     </system>
Nov 16 10:36:06 user nova-compute[85141]:   </sysinfo>
Nov 16 10:36:06 user nova-compute[85141]:   <os>
Nov 16 10:36:06 user nova-compute[85141]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 10:36:06 user nova-compute[85141]:     <boot dev="hd"/>
Nov 16 10:36:06 user nova-compute[85141]:     <smbios mode="sysinfo"/>
Nov 16 10:36:06 user nova-compute[85141]:   </os>
Nov 16 10:36:06 user nova-compute[85141]:   <features>
Nov 16 10:36:06 user nova-compute[85141]:     <acpi/>
Nov 16 10:36:06 user nova-compute[85141]:     <apic/>
Nov 16 10:36:06 user nova-compute[85141]:     <vmcoreinfo/>
Nov 16 10:36:06 user nova-compute[85141]:   </features>
Nov 16 10:36:06 user nova-compute[85141]:   <clock offset="utc">
Nov 16 10:36:06 user nova-compute[85141]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 10:36:06 user nova-compute[85141]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 10:36:06 user nova-compute[85141]:     <timer name="hpet" present="no"/>
Nov 16 10:36:06 user nova-compute[85141]:   </clock>
Nov 16 10:36:06 user nova-compute[85141]:   <cpu mode="custom" match="exact">
Nov 16 10:36:06 user nova-compute[85141]:     <model>Nehalem</model>
Nov 16 10:36:06 user nova-compute[85141]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 10:36:06 user nova-compute[85141]:   </cpu>
Nov 16 10:36:06 user nova-compute[85141]:   <devices>
Nov 16 10:36:06 user nova-compute[85141]:     <disk type="block" device="disk">
Nov 16 10:36:06 user nova-compute[85141]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 10:36:06 user nova-compute[85141]:       <source dev="/dev/sdb"/>
Nov 16 10:36:06 user nova-compute[85141]:       <target dev="vda" bus="virtio"/>
Nov 16 10:36:06 user nova-compute[85141]:       <serial>584dd8df-f6a2-4e35-be7e-8de1e759491b</serial>
Nov 16 10:36:06 user nova-compute[85141]:     </disk>
Nov 16 10:36:06 user nova-compute[85141]:     <interface type="ethernet">
Nov 16 10:36:06 user nova-compute[85141]:       <mac address="fa:16:3e:0d:32:17"/>
Nov 16 10:36:06 user nova-compute[85141]:       <model type="virtio"/>
Nov 16 10:36:06 user nova-compute[85141]:       <mtu size="1442"/>
Nov 16 10:36:06 user nova-compute[85141]:       <target dev="tap27c72f03-eb"/>
Nov 16 10:36:06 user nova-compute[85141]:     </interface>
Nov 16 10:36:06 user nova-compute[85141]:     <serial type="pty">
Nov 16 10:36:06 user nova-compute[85141]:       <log file="/opt/stack/data/nova/instances/797c873e-cf15-4d3c-a3bc-bd2a81a80014/console.log" append="off"/>
Nov 16 10:36:06 user nova-compute[85141]:     </serial>
Nov 16 10:36:06 user nova-compute[85141]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 10:36:06 user nova-compute[85141]:     <video>
Nov 16 10:36:06 user nova-compute[85141]:       <model type="virtio"/>
Nov 16 10:36:06 user nova-compute[85141]:     </video>
Nov 16 10:36:06 user nova-compute[85141]:     <rng model="virtio">
Nov 16 10:36:06 user nova-compute[85141]:       <backend model="random">/dev/urandom</backend>
Nov 16 10:36:06 user nova-compute[85141]:     </rng>
Nov 16 10:36:06 user nova-compute[85141]:     <controller type="usb" index="0" model="none"/>
Nov 16 10:36:06 user nova-compute[85141]:     <memballoon model="virtio">
Nov 16 10:36:06 user nova-compute[85141]:       <stats period="10"/>
Nov 16 10:36:06 user nova-compute[85141]:     </memballoon>
Nov 16 10:36:06 user nova-compute[85141]:   </devices>
Nov 16 10:36:06 user nova-compute[85141]: </domain>
Nov 16 10:36:06 user nova-compute[85141]:  {{(pid=85141) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 10:36:06 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-4b1bc4bd-5088-4520-ae55-82c1ddecb9e3 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T10:35:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1931039385',display_name='tempest-TestVolumeBootPattern-server-1931039385',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1931039385',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK2tiQ/yBbFjZdjBIR2tKrAVD3soVHRqo5J6ZL2tZkf+/CHlij0TJEEFuVTAcbccfWNw+REn7xM/u4NrsIPLxGXc8EfsNWZLl3/YiEOdS+xhO6c08a6foGqxQYJ8pZUDrQ==',key_name='tempest-TestVolumeBootPattern-1363391981',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aec3bb9fe5e6446590900b5adf65df0f',ramdisk_id='',reservation_id='r-calibs7n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1979039357',owner_user_name='tempest-TestVolumeBootPattern-1979039357-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T10:35:59Z,user_data=None,user_id='7261b57c36904fcda87a9ea32d4b5b31',uuid=797c873e-cf15-4d3c-a3bc-bd2a81a80014,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "27c72f03-eb45-49ad-b17e-330eecf72cb1", "address": "fa:16:3e:0d:32:17", "network": {"id": "b8ada47f-9721-4358-ac4f-0305f06dbbb8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1663922860-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aec3bb9fe5e6446590900b5adf65df0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27c72f03-eb", "ovs_interfaceid": "27c72f03-eb45-49ad-b17e-330eecf72cb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 10:36:06 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-4b1bc4bd-5088-4520-ae55-82c1ddecb9e3 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Converting VIF {"id": "27c72f03-eb45-49ad-b17e-330eecf72cb1", "address": "fa:16:3e:0d:32:17", "network": {"id": "b8ada47f-9721-4358-ac4f-0305f06dbbb8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1663922860-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aec3bb9fe5e6446590900b5adf65df0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27c72f03-eb", "ovs_interfaceid": "27c72f03-eb45-49ad-b17e-330eecf72cb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:36:06 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-4b1bc4bd-5088-4520-ae55-82c1ddecb9e3 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0d:32:17,bridge_name='br-int',has_traffic_filtering=True,id=27c72f03-eb45-49ad-b17e-330eecf72cb1,network=Network(b8ada47f-9721-4358-ac4f-0305f06dbbb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27c72f03-eb') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:36:06 user nova-compute[85141]: DEBUG os_vif [None req-4b1bc4bd-5088-4520-ae55-82c1ddecb9e3 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:32:17,bridge_name='br-int',has_traffic_filtering=True,id=27c72f03-eb45-49ad-b17e-330eecf72cb1,network=Network(b8ada47f-9721-4358-ac4f-0305f06dbbb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27c72f03-eb') {{(pid=85141) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 10:36:06 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:36:06 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:36:06 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 10:36:06 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:36:06 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd2b3fd96-4e4b-547f-aeb6-81c0c1ab92c5', '_type': 'linux-noop'}}, row=False) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:36:06 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:36:06 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:36:06 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:36:06 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap27c72f03-eb, may_exist=True, interface_attrs={}) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:36:06 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap27c72f03-eb, col_values=(('qos', UUID('b3aaff93-3917-4328-bc13-7fce903c807c')),), if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:36:06 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap27c72f03-eb, col_values=(('external_ids', {'iface-id': '27c72f03-eb45-49ad-b17e-330eecf72cb1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0d:32:17', 'vm-uuid': '797c873e-cf15-4d3c-a3bc-bd2a81a80014'}),), if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:36:06 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:36:06 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:36:06 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:36:06 user nova-compute[85141]: INFO os_vif [None req-4b1bc4bd-5088-4520-ae55-82c1ddecb9e3 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:32:17,bridge_name='br-int',has_traffic_filtering=True,id=27c72f03-eb45-49ad-b17e-330eecf72cb1,network=Network(b8ada47f-9721-4358-ac4f-0305f06dbbb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27c72f03-eb')
Nov 16 10:36:06 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-4b1bc4bd-5088-4520-ae55-82c1ddecb9e3 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] No BDM found with device name vda, not building metadata. {{(pid=85141) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 10:36:06 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-4b1bc4bd-5088-4520-ae55-82c1ddecb9e3 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] No VIF found with MAC fa:16:3e:0d:32:17, not building metadata {{(pid=85141) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 10:36:06 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:36:07 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:36:07 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:36:07 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:36:07 user nova-compute[85141]: DEBUG nova.compute.manager [req-c3830a97-2fbf-4292-8432-ff0694af4b7a req-cd63efb0-6df9-45dd-b354-3a14519a3d4d service nova] [instance: 797c873e-cf15-4d3c-a3bc-bd2a81a80014] Received event network-vif-plugged-27c72f03-eb45-49ad-b17e-330eecf72cb1 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:36:07 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-c3830a97-2fbf-4292-8432-ff0694af4b7a req-cd63efb0-6df9-45dd-b354-3a14519a3d4d service nova] Acquiring lock "797c873e-cf15-4d3c-a3bc-bd2a81a80014-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:36:07 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-c3830a97-2fbf-4292-8432-ff0694af4b7a req-cd63efb0-6df9-45dd-b354-3a14519a3d4d service nova] Lock "797c873e-cf15-4d3c-a3bc-bd2a81a80014-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:36:07 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-c3830a97-2fbf-4292-8432-ff0694af4b7a req-cd63efb0-6df9-45dd-b354-3a14519a3d4d service nova] Lock "797c873e-cf15-4d3c-a3bc-bd2a81a80014-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:36:07 user nova-compute[85141]: DEBUG nova.compute.manager [req-c3830a97-2fbf-4292-8432-ff0694af4b7a req-cd63efb0-6df9-45dd-b354-3a14519a3d4d service nova] [instance: 797c873e-cf15-4d3c-a3bc-bd2a81a80014] No waiting events found dispatching network-vif-plugged-27c72f03-eb45-49ad-b17e-330eecf72cb1 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:36:07 user nova-compute[85141]: WARNING nova.compute.manager [req-c3830a97-2fbf-4292-8432-ff0694af4b7a req-cd63efb0-6df9-45dd-b354-3a14519a3d4d service nova] [instance: 797c873e-cf15-4d3c-a3bc-bd2a81a80014] Received unexpected event network-vif-plugged-27c72f03-eb45-49ad-b17e-330eecf72cb1 for instance with vm_state building and task_state spawning.
Nov 16 10:36:07 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:36:07 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:36:07 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:36:07 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:36:08 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:36:09 user nova-compute[85141]: DEBUG nova.compute.manager [None req-4b1bc4bd-5088-4520-ae55-82c1ddecb9e3 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: 797c873e-cf15-4d3c-a3bc-bd2a81a80014] Instance event wait completed in 0 seconds for  {{(pid=85141) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 10:36:09 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-4b1bc4bd-5088-4520-ae55-82c1ddecb9e3 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: 797c873e-cf15-4d3c-a3bc-bd2a81a80014] Guest created on hypervisor {{(pid=85141) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 10:36:09 user nova-compute[85141]: INFO nova.virt.libvirt.driver [-] [instance: 797c873e-cf15-4d3c-a3bc-bd2a81a80014] Instance spawned successfully.
Nov 16 10:36:09 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-4b1bc4bd-5088-4520-ae55-82c1ddecb9e3 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: 797c873e-cf15-4d3c-a3bc-bd2a81a80014] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 10:36:09 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-4b1bc4bd-5088-4520-ae55-82c1ddecb9e3 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: 797c873e-cf15-4d3c-a3bc-bd2a81a80014] Found default for hw_cdrom_bus of ide {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:36:09 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-4b1bc4bd-5088-4520-ae55-82c1ddecb9e3 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: 797c873e-cf15-4d3c-a3bc-bd2a81a80014] Found default for hw_disk_bus of virtio {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:36:09 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-4b1bc4bd-5088-4520-ae55-82c1ddecb9e3 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: 797c873e-cf15-4d3c-a3bc-bd2a81a80014] Found default for hw_input_bus of None {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:36:09 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-4b1bc4bd-5088-4520-ae55-82c1ddecb9e3 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: 797c873e-cf15-4d3c-a3bc-bd2a81a80014] Found default for hw_pointer_model of None {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:36:09 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-4b1bc4bd-5088-4520-ae55-82c1ddecb9e3 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: 797c873e-cf15-4d3c-a3bc-bd2a81a80014] Found default for hw_video_model of virtio {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:36:09 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-4b1bc4bd-5088-4520-ae55-82c1ddecb9e3 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: 797c873e-cf15-4d3c-a3bc-bd2a81a80014] Found default for hw_vif_model of virtio {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:36:09 user nova-compute[85141]: INFO nova.compute.manager [None req-4b1bc4bd-5088-4520-ae55-82c1ddecb9e3 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: 797c873e-cf15-4d3c-a3bc-bd2a81a80014] Took 4.99 seconds to spawn the instance on the hypervisor.
Nov 16 10:36:09 user nova-compute[85141]: DEBUG nova.compute.manager [None req-4b1bc4bd-5088-4520-ae55-82c1ddecb9e3 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: 797c873e-cf15-4d3c-a3bc-bd2a81a80014] Checking state {{(pid=85141) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 10:36:09 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:36:09 user nova-compute[85141]: INFO nova.compute.manager [None req-4b1bc4bd-5088-4520-ae55-82c1ddecb9e3 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: 797c873e-cf15-4d3c-a3bc-bd2a81a80014] Took 10.90 seconds to build instance.
Nov 16 10:36:09 user nova-compute[85141]: DEBUG nova.compute.manager [req-7ce7e95b-1bb8-4499-ae22-ef7e3daff499 req-c76ac82f-15ed-4c8c-aedf-333f54e3c1de service nova] [instance: 797c873e-cf15-4d3c-a3bc-bd2a81a80014] Received event network-vif-plugged-27c72f03-eb45-49ad-b17e-330eecf72cb1 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:36:09 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-7ce7e95b-1bb8-4499-ae22-ef7e3daff499 req-c76ac82f-15ed-4c8c-aedf-333f54e3c1de service nova] Acquiring lock "797c873e-cf15-4d3c-a3bc-bd2a81a80014-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:36:09 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-7ce7e95b-1bb8-4499-ae22-ef7e3daff499 req-c76ac82f-15ed-4c8c-aedf-333f54e3c1de service nova] Lock "797c873e-cf15-4d3c-a3bc-bd2a81a80014-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:36:09 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-7ce7e95b-1bb8-4499-ae22-ef7e3daff499 req-c76ac82f-15ed-4c8c-aedf-333f54e3c1de service nova] Lock "797c873e-cf15-4d3c-a3bc-bd2a81a80014-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:36:09 user nova-compute[85141]: DEBUG nova.compute.manager [req-7ce7e95b-1bb8-4499-ae22-ef7e3daff499 req-c76ac82f-15ed-4c8c-aedf-333f54e3c1de service nova] [instance: 797c873e-cf15-4d3c-a3bc-bd2a81a80014] No waiting events found dispatching network-vif-plugged-27c72f03-eb45-49ad-b17e-330eecf72cb1 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:36:09 user nova-compute[85141]: WARNING nova.compute.manager [req-7ce7e95b-1bb8-4499-ae22-ef7e3daff499 req-c76ac82f-15ed-4c8c-aedf-333f54e3c1de service nova] [instance: 797c873e-cf15-4d3c-a3bc-bd2a81a80014] Received unexpected event network-vif-plugged-27c72f03-eb45-49ad-b17e-330eecf72cb1 for instance with vm_state active and task_state None.
Nov 16 10:36:09 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-4b1bc4bd-5088-4520-ae55-82c1ddecb9e3 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Lock "797c873e-cf15-4d3c-a3bc-bd2a81a80014" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.016s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:36:11 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:36:13 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:36:16 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:36:21 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:36:21 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:36:21 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=85141) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 10:36:21 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=85141) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 10:36:21 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=85141) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 10:36:21 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:36:23 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:36:26 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:36:28 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:36:31 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:36:33 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:36:36 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:36:37 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:36:38 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:36:40 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:36:40 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Cleaning up deleted instances {{(pid=85141) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 16 10:36:40 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] There are 0 instances to clean {{(pid=85141) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 16 10:36:41 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:36:41 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:36:41 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Cleaning up deleted instances with incomplete migration  {{(pid=85141) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 16 10:36:42 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:36:42 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:36:42 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Starting heal instance info cache {{(pid=85141) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 10:36:42 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Rebuilding the list of instances to heal {{(pid=85141) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 10:36:42 user nova-compute[85141]: DEBUG nova.compute.manager [req-c513c9f3-4a6f-4a97-955a-31ebbca1f7b3 req-3a7daefd-8862-4fb5-98a9-6e2523655085 service nova] [instance: 1e01e0e9-5eef-4af4-8633-814d59860b8d] Received event network-changed-6f4c8e31-7ee9-4257-9441-12fff78fb8d1 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:36:42 user nova-compute[85141]: DEBUG nova.compute.manager [req-c513c9f3-4a6f-4a97-955a-31ebbca1f7b3 req-3a7daefd-8862-4fb5-98a9-6e2523655085 service nova] [instance: 1e01e0e9-5eef-4af4-8633-814d59860b8d] Refreshing instance network info cache due to event network-changed-6f4c8e31-7ee9-4257-9441-12fff78fb8d1. {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 10:36:42 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-c513c9f3-4a6f-4a97-955a-31ebbca1f7b3 req-3a7daefd-8862-4fb5-98a9-6e2523655085 service nova] Acquiring lock "refresh_cache-1e01e0e9-5eef-4af4-8633-814d59860b8d" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:36:42 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-c513c9f3-4a6f-4a97-955a-31ebbca1f7b3 req-3a7daefd-8862-4fb5-98a9-6e2523655085 service nova] Acquired lock "refresh_cache-1e01e0e9-5eef-4af4-8633-814d59860b8d" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:36:42 user nova-compute[85141]: DEBUG nova.network.neutron [req-c513c9f3-4a6f-4a97-955a-31ebbca1f7b3 req-3a7daefd-8862-4fb5-98a9-6e2523655085 service nova] [instance: 1e01e0e9-5eef-4af4-8633-814d59860b8d] Refreshing network info cache for port 6f4c8e31-7ee9-4257-9441-12fff78fb8d1 {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 10:36:42 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Acquiring lock "refresh_cache-2f1b7a62-fdc2-4b8e-b9f8-61105c0fcb5c" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:36:42 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Acquired lock "refresh_cache-2f1b7a62-fdc2-4b8e-b9f8-61105c0fcb5c" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:36:42 user nova-compute[85141]: DEBUG nova.network.neutron [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] [instance: 2f1b7a62-fdc2-4b8e-b9f8-61105c0fcb5c] Forcefully refreshing network info cache for instance {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 10:36:42 user nova-compute[85141]: DEBUG nova.objects.instance [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lazy-loading 'info_cache' on Instance uuid 2f1b7a62-fdc2-4b8e-b9f8-61105c0fcb5c {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:36:43 user nova-compute[85141]: DEBUG nova.network.neutron [req-c513c9f3-4a6f-4a97-955a-31ebbca1f7b3 req-3a7daefd-8862-4fb5-98a9-6e2523655085 service nova] [instance: 1e01e0e9-5eef-4af4-8633-814d59860b8d] Updated VIF entry in instance network info cache for port 6f4c8e31-7ee9-4257-9441-12fff78fb8d1. {{(pid=85141) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 10:36:43 user nova-compute[85141]: DEBUG nova.network.neutron [req-c513c9f3-4a6f-4a97-955a-31ebbca1f7b3 req-3a7daefd-8862-4fb5-98a9-6e2523655085 service nova] [instance: 1e01e0e9-5eef-4af4-8633-814d59860b8d] Updating instance_info_cache with network_info: [{"id": "6f4c8e31-7ee9-4257-9441-12fff78fb8d1", "address": "fa:16:3e:40:7a:69", "network": {"id": "609e6198-811e-4b40-a518-f960e9fc5b91", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1628388169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "647a6ef16a7b496a9568f9d777e38412", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f4c8e31-7e", "ovs_interfaceid": "6f4c8e31-7ee9-4257-9441-12fff78fb8d1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:36:43 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-c513c9f3-4a6f-4a97-955a-31ebbca1f7b3 req-3a7daefd-8862-4fb5-98a9-6e2523655085 service nova] Releasing lock "refresh_cache-1e01e0e9-5eef-4af4-8633-814d59860b8d" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:36:43 user nova-compute[85141]: DEBUG nova.network.neutron [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] [instance: 2f1b7a62-fdc2-4b8e-b9f8-61105c0fcb5c] Updating instance_info_cache with network_info: [{"id": "3c3baa93-b4c3-4cf5-b363-aab7e937312b", "address": "fa:16:3e:d1:c8:21", "network": {"id": "8931cd8f-3c0b-4d49-ae98-48f818e854e7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1902653571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d13c6ff3c30549ca9ab44d9fc1fedc6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c3baa93-b4", "ovs_interfaceid": "3c3baa93-b4c3-4cf5-b363-aab7e937312b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:36:43 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Releasing lock "refresh_cache-2f1b7a62-fdc2-4b8e-b9f8-61105c0fcb5c" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:36:43 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] [instance: 2f1b7a62-fdc2-4b8e-b9f8-61105c0fcb5c] Updated the network info_cache for instance {{(pid=85141) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 10:36:43 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:36:43 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=85141) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 10:36:43 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager.update_available_resource {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:36:43 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:36:43 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:36:43 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:36:43 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Auditing locally available compute resources for user (node: user) {{(pid=85141) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 10:36:43 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=85141) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 10:36:43 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f1b7a62-fdc2-4b8e-b9f8-61105c0fcb5c/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:36:43 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:36:43 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f1b7a62-fdc2-4b8e-b9f8-61105c0fcb5c/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:36:43 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f1b7a62-fdc2-4b8e-b9f8-61105c0fcb5c/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:36:43 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f1b7a62-fdc2-4b8e-b9f8-61105c0fcb5c/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:36:43 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=85141) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 10:36:43 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e01e0e9-5eef-4af4-8633-814d59860b8d/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:36:43 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e01e0e9-5eef-4af4-8633-814d59860b8d/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:36:43 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e01e0e9-5eef-4af4-8633-814d59860b8d/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:36:44 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e01e0e9-5eef-4af4-8633-814d59860b8d/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:36:44 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:36:44 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:36:44 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Hypervisor/Node resource view: name=user free_ram=8671MB free_disk=25.048927307128906GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=85141) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 10:36:44 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:36:44 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:36:44 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance 2f1b7a62-fdc2-4b8e-b9f8-61105c0fcb5c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:36:44 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance 1e01e0e9-5eef-4af4-8633-814d59860b8d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:36:44 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance 797c873e-cf15-4d3c-a3bc-bd2a81a80014 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:36:44 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=85141) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 10:36:44 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=85141) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 10:36:44 user nova-compute[85141]: DEBUG nova.scheduler.client.report [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Refreshing inventories for resource provider bf8e0fa1-16b6-408f-9203-c4cd63916272 {{(pid=85141) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 16 10:36:44 user nova-compute[85141]: DEBUG nova.scheduler.client.report [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Updating ProviderTree inventory for provider bf8e0fa1-16b6-408f-9203-c4cd63916272 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=85141) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 16 10:36:44 user nova-compute[85141]: DEBUG nova.compute.provider_tree [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Updating inventory in ProviderTree for provider bf8e0fa1-16b6-408f-9203-c4cd63916272 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=85141) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 16 10:36:44 user nova-compute[85141]: DEBUG nova.scheduler.client.report [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Refreshing aggregate associations for resource provider bf8e0fa1-16b6-408f-9203-c4cd63916272, aggregates: None {{(pid=85141) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 16 10:36:44 user nova-compute[85141]: DEBUG nova.scheduler.client.report [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Refreshing trait associations for resource provider bf8e0fa1-16b6-408f-9203-c4cd63916272, traits: COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE41,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_ACCELERATORS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_USB,COMPUTE_TRUSTED_CERTS,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_RESCUE_BFV,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VOLUME_ATTACH_WITH_TAG {{(pid=85141) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 16 10:36:45 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-b098e5ea-649b-45a4-8ef0-65b186fd2bed tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Acquiring lock "1e01e0e9-5eef-4af4-8633-814d59860b8d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:36:45 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-b098e5ea-649b-45a4-8ef0-65b186fd2bed tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Lock "1e01e0e9-5eef-4af4-8633-814d59860b8d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:36:45 user nova-compute[85141]: DEBUG nova.objects.instance [None req-b098e5ea-649b-45a4-8ef0-65b186fd2bed tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Lazy-loading 'flavor' on Instance uuid 1e01e0e9-5eef-4af4-8633-814d59860b8d {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:36:45 user nova-compute[85141]: DEBUG nova.compute.provider_tree [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Inventory has not changed in ProviderTree for provider: bf8e0fa1-16b6-408f-9203-c4cd63916272 {{(pid=85141) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 10:36:45 user nova-compute[85141]: DEBUG nova.scheduler.client.report [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Inventory has not changed for provider bf8e0fa1-16b6-408f-9203-c4cd63916272 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=85141) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 10:36:45 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-b098e5ea-649b-45a4-8ef0-65b186fd2bed tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Lock "1e01e0e9-5eef-4af4-8633-814d59860b8d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:36:45 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Compute_service record updated for user:user {{(pid=85141) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 10:36:45 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.535s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:36:45 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-b098e5ea-649b-45a4-8ef0-65b186fd2bed tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Acquiring lock "1e01e0e9-5eef-4af4-8633-814d59860b8d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:36:45 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-b098e5ea-649b-45a4-8ef0-65b186fd2bed tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Lock "1e01e0e9-5eef-4af4-8633-814d59860b8d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:36:45 user nova-compute[85141]: INFO nova.compute.manager [None req-b098e5ea-649b-45a4-8ef0-65b186fd2bed tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] [instance: 1e01e0e9-5eef-4af4-8633-814d59860b8d] Attaching volume bbbec54a-dd3f-44aa-be3d-d3fb1a206b29 to /dev/vdb
Nov 16 10:36:45 user nova-compute[85141]: DEBUG os_brick.utils [None req-b098e5ea-649b-45a4-8ef0-65b186fd2bed tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 10:36:45 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:36:45 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:36:45 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6bf2c40-eb05-453c-b4ea-1f375ba88cb9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c7834de5c295\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:36:45 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:36:45 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:36:45 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c4aa7fb-b2a2-4ca9-aeac-c3d7d9e208fa]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:36:45 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:36:45 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:36:45 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[44907c3f-36cf-4de8-9ceb-5f01e5ce98d5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:36:45 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[6012fcc7-4f0d-4681-ab47-b5576ad7803f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:36:45 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-b098e5ea-649b-45a4-8ef0-65b186fd2bed tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Running cmd (subprocess): nvme version {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:36:45 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-b098e5ea-649b-45a4-8ef0-65b186fd2bed tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] 'nvme version' failed. Not Retrying. {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 10:36:45 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b098e5ea-649b-45a4-8ef0-65b186fd2bed tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] nvme not present on system {{(pid=85141) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 10:36:45 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:36:45 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 10:36:45 user nova-compute[85141]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 10:36:45 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[2560c330-464d-478e-acf7-db2bba17a523]: (4, '') {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:36:45 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.lightos [None req-b098e5ea-649b-45a4-8ef0-65b186fd2bed tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=85141) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 10:36:45 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.lightos [None req-b098e5ea-649b-45a4-8ef0-65b186fd2bed tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=85141) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 10:36:45 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.lightos [None req-b098e5ea-649b-45a4-8ef0-65b186fd2bed tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] LIGHTOS: no hostnqn found. {{(pid=85141) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 10:36:45 user nova-compute[85141]: DEBUG os_brick.utils [None req-b098e5ea-649b-45a4-8ef0-65b186fd2bed tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c7834de5c295', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 10:36:45 user nova-compute[85141]: DEBUG nova.virt.block_device [None req-b098e5ea-649b-45a4-8ef0-65b186fd2bed tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] [instance: 1e01e0e9-5eef-4af4-8633-814d59860b8d] Updating existing volume attachment record: 7ca86c5a-3596-41a4-a5ae-264acafdb583 {{(pid=85141) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 10:36:46 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:36:46 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:36:46 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:36:46 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:36:46 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:36:47 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:36:47 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-e7d88779-9546-461a-9f8a-da063caa50a2 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Acquiring lock "2f1b7a62-fdc2-4b8e-b9f8-61105c0fcb5c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:36:47 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-e7d88779-9546-461a-9f8a-da063caa50a2 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Lock "2f1b7a62-fdc2-4b8e-b9f8-61105c0fcb5c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:36:47 user nova-compute[85141]: INFO nova.compute.manager [None req-e7d88779-9546-461a-9f8a-da063caa50a2 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] [instance: 2f1b7a62-fdc2-4b8e-b9f8-61105c0fcb5c] Detaching volume 1fd95458-b13d-439d-b30c-6dcfe2fa8419
Nov 16 10:36:47 user nova-compute[85141]: INFO nova.virt.block_device [None req-e7d88779-9546-461a-9f8a-da063caa50a2 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] [instance: 2f1b7a62-fdc2-4b8e-b9f8-61105c0fcb5c] Attempting to driver detach volume 1fd95458-b13d-439d-b30c-6dcfe2fa8419 from mountpoint /dev/vdb
Nov 16 10:36:47 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-e7d88779-9546-461a-9f8a-da063caa50a2 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Attempting to detach device vdb from instance 2f1b7a62-fdc2-4b8e-b9f8-61105c0fcb5c from the persistent domain config. {{(pid=85141) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 10:36:47 user nova-compute[85141]: DEBUG nova.virt.libvirt.guest [None req-e7d88779-9546-461a-9f8a-da063caa50a2 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 10:36:47 user nova-compute[85141]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 10:36:47 user nova-compute[85141]:   <source dev="/dev/sdd"/>
Nov 16 10:36:47 user nova-compute[85141]:   <target dev="vdb" bus="virtio"/>
Nov 16 10:36:47 user nova-compute[85141]:   <serial>1fd95458-b13d-439d-b30c-6dcfe2fa8419</serial>
Nov 16 10:36:47 user nova-compute[85141]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 10:36:47 user nova-compute[85141]: </disk>
Nov 16 10:36:47 user nova-compute[85141]:  {{(pid=85141) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 10:36:47 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-e7d88779-9546-461a-9f8a-da063caa50a2 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Successfully detached device vdb from instance 2f1b7a62-fdc2-4b8e-b9f8-61105c0fcb5c from the persistent domain config.
Nov 16 10:36:47 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-e7d88779-9546-461a-9f8a-da063caa50a2 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 2f1b7a62-fdc2-4b8e-b9f8-61105c0fcb5c from the live domain config. {{(pid=85141) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 10:36:47 user nova-compute[85141]: DEBUG nova.virt.libvirt.guest [None req-e7d88779-9546-461a-9f8a-da063caa50a2 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 10:36:47 user nova-compute[85141]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 10:36:47 user nova-compute[85141]:   <source dev="/dev/sdd"/>
Nov 16 10:36:47 user nova-compute[85141]:   <target dev="vdb" bus="virtio"/>
Nov 16 10:36:47 user nova-compute[85141]:   <serial>1fd95458-b13d-439d-b30c-6dcfe2fa8419</serial>
Nov 16 10:36:47 user nova-compute[85141]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 10:36:47 user nova-compute[85141]: </disk>
Nov 16 10:36:47 user nova-compute[85141]:  {{(pid=85141) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 10:36:48 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-e7d88779-9546-461a-9f8a-da063caa50a2 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 2f1b7a62-fdc2-4b8e-b9f8-61105c0fcb5c {{(pid=85141) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 10:36:48 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:36:49 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:36:50 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b098e5ea-649b-45a4-8ef0-65b186fd2bed tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] [instance: 1e01e0e9-5eef-4af4-8633-814d59860b8d] Calling os-brick to attach iSCSI Volume {{(pid=85141) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 10:36:50 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-b098e5ea-649b-45a4-8ef0-65b186fd2bed tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51806b6080>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:bbbec54a-dd3f-44aa-be3d-d3fb1a206b29', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YSibvgKr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 10:36:50 user nova-compute[85141]: WARNING os_brick.initiator.connectors.base [None req-b098e5ea-649b-45a4-8ef0-65b186fd2bed tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 10:36:50 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-b098e5ea-649b-45a4-8ef0-65b186fd2bed tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 10:36:50 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-b098e5ea-649b-45a4-8ef0-65b186fd2bed tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 10:36:50 user nova-compute[85141]: WARNING os_brick.initiator.connectors.base [None req-b098e5ea-649b-45a4-8ef0-65b186fd2bed tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 10:36:50 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-b098e5ea-649b-45a4-8ef0-65b186fd2bed tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bbbec54a-dd3f-44aa-be3d-d3fb1a206b29" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 10:36:50 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-b098e5ea-649b-45a4-8ef0-65b186fd2bed tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bbbec54a-dd3f-44aa-be3d-d3fb1a206b29" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 10:36:50 user nova-compute[85141]: INFO os_brick.initiator.connectors.iscsi [None req-b098e5ea-649b-45a4-8ef0-65b186fd2bed tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 10:36:50 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bbbec54a-dd3f-44aa-be3d-d3fb1a206b29 -p 172.16.0.220:3260 {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:36:50 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bbbec54a-dd3f-44aa-be3d-d3fb1a206b29 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:36:50 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b146b02-17ab-45c5-9d10-507a93b0fc04]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:36:50 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-b098e5ea-649b-45a4-8ef0-65b186fd2bed tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 10:36:50 user nova-compute[85141]:  {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:36:50 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bbbec54a-dd3f-44aa-be3d-d3fb1a206b29 -p 172.16.0.220:3260 --interface default --op new {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:36:50 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bbbec54a-dd3f-44aa-be3d-d3fb1a206b29 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:36:50 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb286ca0-29ae-42a0-af89-5529fd8715e7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bbbec54a-dd3f-44aa-be3d-d3fb1a206b29] added\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:36:50 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-b098e5ea-649b-45a4-8ef0-65b186fd2bed tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bbbec54a-dd3f-44aa-be3d-d3fb1a206b29] added
Nov 16 10:36:50 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:36:50 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bbbec54a-dd3f-44aa-be3d-d3fb1a206b29 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:36:50 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bbbec54a-dd3f-44aa-be3d-d3fb1a206b29 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:36:50 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cca222f-ddfb-43da-818b-7ac6d8ee2f05]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:36:50 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-b098e5ea-649b-45a4-8ef0-65b186fd2bed tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:36:50 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bbbec54a-dd3f-44aa-be3d-d3fb1a206b29 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:36:50 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bbbec54a-dd3f-44aa-be3d-d3fb1a206b29 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.034s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:36:50 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[38fc359e-9aed-411f-8fe8-390133135494]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:36:50 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-b098e5ea-649b-45a4-8ef0-65b186fd2bed tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:36:50 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bbbec54a-dd3f-44aa-be3d-d3fb1a206b29 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YSibvgKr {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:36:50 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bbbec54a-dd3f-44aa-be3d-d3fb1a206b29 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YSibvgKr" returned: 0 in 0.020s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:36:50 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[85dc0f7c-6e6e-4940-96e3-83eade5bc097]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:36:50 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-b098e5ea-649b-45a4-8ef0-65b186fd2bed tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YSibvgKr'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:36:50 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bbbec54a-dd3f-44aa-be3d-d3fb1a206b29 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:36:50 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bbbec54a-dd3f-44aa-be3d-d3fb1a206b29 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:36:50 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3db60d2-58a9-4ea7-8d66-f62250cf1551]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:36:50 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-b098e5ea-649b-45a4-8ef0-65b186fd2bed tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:36:50 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:36:50 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:36:50 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[e926eb22-feff-4500-9425-8077810c0725]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fd95458-b13d-439d-b30c-6dcfe2fa8419 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:584dd8df-f6a2-4e35-be7e-8de1e759491b (non-flash)\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:36:50 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-b098e5ea-649b-45a4-8ef0-65b186fd2bed tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fd95458-b13d-439d-b30c-6dcfe2fa8419 (non-flash)
Nov 16 10:36:50 user nova-compute[85141]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:584dd8df-f6a2-4e35-be7e-8de1e759491b (non-flash)
Nov 16 10:36:50 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:36:50 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-b098e5ea-649b-45a4-8ef0-65b186fd2bed tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fd95458-b13d-439d-b30c-6dcfe2fa8419 (non-flash)
Nov 16 10:36:50 user nova-compute[85141]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:584dd8df-f6a2-4e35-be7e-8de1e759491b (non-flash)
Nov 16 10:36:50 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 10:36:50 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bbbec54a-dd3f-44aa-be3d-d3fb1a206b29 -p 172.16.0.220:3260 --login {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:36:50 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bbbec54a-dd3f-44aa-be3d-d3fb1a206b29 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:36:50 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[86af9589-7f69-40e9-b1fd-d05b080f1e0d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bbbec54a-dd3f-44aa-be3d-d3fb1a206b29, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bbbec54a-dd3f-44aa-be3d-d3fb1a206b29, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:36:50 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-b098e5ea-649b-45a4-8ef0-65b186fd2bed tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bbbec54a-dd3f-44aa-be3d-d3fb1a206b29, portal: 172.16.0.220,3260]
Nov 16 10:36:50 user nova-compute[85141]: Login to [iface: default, target: iqn.2010-10.org.openstack:bbbec54a-dd3f-44aa-be3d-d3fb1a206b29, portal: 172.16.0.220,3260] successful.
Nov 16 10:36:50 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:36:50 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bbbec54a-dd3f-44aa-be3d-d3fb1a206b29 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:36:50 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bbbec54a-dd3f-44aa-be3d-d3fb1a206b29 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:36:50 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[45db4d0d-796b-4070-9c59-c15950b07ddd]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:36:50 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-b098e5ea-649b-45a4-8ef0-65b186fd2bed tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:36:50 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:36:50 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:36:50 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[abe0084c-002a-41ab-8627-1bd260c15347]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fd95458-b13d-439d-b30c-6dcfe2fa8419 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:584dd8df-f6a2-4e35-be7e-8de1e759491b (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbbec54a-dd3f-44aa-be3d-d3fb1a206b29 (non-flash)\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:36:50 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-b098e5ea-649b-45a4-8ef0-65b186fd2bed tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fd95458-b13d-439d-b30c-6dcfe2fa8419 (non-flash)
Nov 16 10:36:50 user nova-compute[85141]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:584dd8df-f6a2-4e35-be7e-8de1e759491b (non-flash)
Nov 16 10:36:50 user nova-compute[85141]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbbec54a-dd3f-44aa-be3d-d3fb1a206b29 (non-flash)
Nov 16 10:36:50 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:36:50 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-b098e5ea-649b-45a4-8ef0-65b186fd2bed tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fd95458-b13d-439d-b30c-6dcfe2fa8419 (non-flash)
Nov 16 10:36:50 user nova-compute[85141]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:584dd8df-f6a2-4e35-be7e-8de1e759491b (non-flash)
Nov 16 10:36:50 user nova-compute[85141]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbbec54a-dd3f-44aa-be3d-d3fb1a206b29 (non-flash)
Nov 16 10:36:50 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 10:36:50 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-b098e5ea-649b-45a4-8ef0-65b186fd2bed tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bbbec54a-dd3f-44aa-be3d-d3fb1a206b29" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.320s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 10:36:50 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-b098e5ea-649b-45a4-8ef0-65b186fd2bed tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Connected to 172.16.0.220:3260 {{(pid=85141) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 10:36:50 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-b098e5ea-649b-45a4-8ef0-65b186fd2bed tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] HCTL ('34', '-', '-', 0) found on session 56 with lun 0 {{(pid=85141) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 10:36:50 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-b098e5ea-649b-45a4-8ef0-65b186fd2bed tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=85141) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 10:36:50 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:36:50 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:36:50 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[86ca1381-aee2-4c19-b4fa-09010c08cafa]: (4, ('- - 0', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:36:50 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-b098e5ea-649b-45a4-8ef0-65b186fd2bed tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Searching for a device in session 56 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=85141) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 10:36:50 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-b098e5ea-649b-45a4-8ef0-65b186fd2bed tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:bbbec54a-dd3f-44aa-be3d-d3fb1a206b29', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YSibvgKr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=85141) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 10:36:51 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:36:51 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:36:51 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-b098e5ea-649b-45a4-8ef0-65b186fd2bed tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.355s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 10:36:51 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-b098e5ea-649b-45a4-8ef0-65b186fd2bed tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] <== connect_volume: return (1357ms) {'type': 'block', 'scsi_wwn': '23235623330613135', 'path': '/dev/sdc'} {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 10:36:51 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b098e5ea-649b-45a4-8ef0-65b186fd2bed tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] [instance: 1e01e0e9-5eef-4af4-8633-814d59860b8d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23235623330613135', 'path': '/dev/sdc'} {{(pid=85141) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 10:36:51 user nova-compute[85141]: DEBUG nova.objects.instance [None req-b098e5ea-649b-45a4-8ef0-65b186fd2bed tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Lazy-loading 'flavor' on Instance uuid 1e01e0e9-5eef-4af4-8633-814d59860b8d {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:36:51 user nova-compute[85141]: DEBUG nova.virt.libvirt.guest [None req-b098e5ea-649b-45a4-8ef0-65b186fd2bed tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 10:36:51 user nova-compute[85141]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 10:36:51 user nova-compute[85141]:   <source dev="/dev/sdc"/>
Nov 16 10:36:51 user nova-compute[85141]:   <target dev="vdb" bus="virtio"/>
Nov 16 10:36:51 user nova-compute[85141]:   <serial>bbbec54a-dd3f-44aa-be3d-d3fb1a206b29</serial>
Nov 16 10:36:51 user nova-compute[85141]: </disk>
Nov 16 10:36:51 user nova-compute[85141]:  {{(pid=85141) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 10:36:52 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-b098e5ea-649b-45a4-8ef0-65b186fd2bed tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] No BDM found with device name vda, not building metadata. {{(pid=85141) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 10:36:52 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-b098e5ea-649b-45a4-8ef0-65b186fd2bed tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] No BDM found with device name vdb, not building metadata. {{(pid=85141) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 10:36:52 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-b098e5ea-649b-45a4-8ef0-65b186fd2bed tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] No VIF found with MAC fa:16:3e:40:7a:69, not building metadata {{(pid=85141) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 10:36:52 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-b098e5ea-649b-45a4-8ef0-65b186fd2bed tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Lock "1e01e0e9-5eef-4af4-8633-814d59860b8d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.956s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:36:53 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:36:55 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:36:56 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:36:58 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:37:01 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:37:02 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-c0139065-accc-436a-abf1-01b6ccd8fd0c tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Acquiring lock "1e01e0e9-5eef-4af4-8633-814d59860b8d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:37:02 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-c0139065-accc-436a-abf1-01b6ccd8fd0c tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Lock "1e01e0e9-5eef-4af4-8633-814d59860b8d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:37:02 user nova-compute[85141]: INFO nova.compute.manager [None req-c0139065-accc-436a-abf1-01b6ccd8fd0c tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] [instance: 1e01e0e9-5eef-4af4-8633-814d59860b8d] Detaching volume bbbec54a-dd3f-44aa-be3d-d3fb1a206b29
Nov 16 10:37:02 user nova-compute[85141]: INFO nova.virt.block_device [None req-c0139065-accc-436a-abf1-01b6ccd8fd0c tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] [instance: 1e01e0e9-5eef-4af4-8633-814d59860b8d] Attempting to driver detach volume bbbec54a-dd3f-44aa-be3d-d3fb1a206b29 from mountpoint /dev/vdb
Nov 16 10:37:03 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-c0139065-accc-436a-abf1-01b6ccd8fd0c tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Attempting to detach device vdb from instance 1e01e0e9-5eef-4af4-8633-814d59860b8d from the persistent domain config. {{(pid=85141) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 10:37:03 user nova-compute[85141]: DEBUG nova.virt.libvirt.guest [None req-c0139065-accc-436a-abf1-01b6ccd8fd0c tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 10:37:03 user nova-compute[85141]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 10:37:03 user nova-compute[85141]:   <source dev="/dev/sdc"/>
Nov 16 10:37:03 user nova-compute[85141]:   <target dev="vdb" bus="virtio"/>
Nov 16 10:37:03 user nova-compute[85141]:   <serial>bbbec54a-dd3f-44aa-be3d-d3fb1a206b29</serial>
Nov 16 10:37:03 user nova-compute[85141]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 10:37:03 user nova-compute[85141]: </disk>
Nov 16 10:37:03 user nova-compute[85141]:  {{(pid=85141) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 10:37:03 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-c0139065-accc-436a-abf1-01b6ccd8fd0c tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Successfully detached device vdb from instance 1e01e0e9-5eef-4af4-8633-814d59860b8d from the persistent domain config.
Nov 16 10:37:03 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-c0139065-accc-436a-abf1-01b6ccd8fd0c tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 1e01e0e9-5eef-4af4-8633-814d59860b8d from the live domain config. {{(pid=85141) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 10:37:03 user nova-compute[85141]: DEBUG nova.virt.libvirt.guest [None req-c0139065-accc-436a-abf1-01b6ccd8fd0c tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 10:37:03 user nova-compute[85141]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 10:37:03 user nova-compute[85141]:   <source dev="/dev/sdc"/>
Nov 16 10:37:03 user nova-compute[85141]:   <target dev="vdb" bus="virtio"/>
Nov 16 10:37:03 user nova-compute[85141]:   <serial>bbbec54a-dd3f-44aa-be3d-d3fb1a206b29</serial>
Nov 16 10:37:03 user nova-compute[85141]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 10:37:03 user nova-compute[85141]: </disk>
Nov 16 10:37:03 user nova-compute[85141]:  {{(pid=85141) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 10:37:03 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-c0139065-accc-436a-abf1-01b6ccd8fd0c tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 1e01e0e9-5eef-4af4-8633-814d59860b8d {{(pid=85141) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 10:37:03 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:37:06 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:37:08 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._sync_power_states {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:37:08 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Triggering sync for uuid 2f1b7a62-fdc2-4b8e-b9f8-61105c0fcb5c {{(pid=85141) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 16 10:37:08 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Triggering sync for uuid 1e01e0e9-5eef-4af4-8633-814d59860b8d {{(pid=85141) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 16 10:37:08 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Triggering sync for uuid 797c873e-cf15-4d3c-a3bc-bd2a81a80014 {{(pid=85141) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 16 10:37:08 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Acquiring lock "2f1b7a62-fdc2-4b8e-b9f8-61105c0fcb5c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:37:08 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Acquiring lock "1e01e0e9-5eef-4af4-8633-814d59860b8d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:37:08 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Acquiring lock "797c873e-cf15-4d3c-a3bc-bd2a81a80014" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:37:08 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "797c873e-cf15-4d3c-a3bc-bd2a81a80014" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:37:08 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "797c873e-cf15-4d3c-a3bc-bd2a81a80014" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.024s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:37:08 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-e7d88779-9546-461a-9f8a-da063caa50a2 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 2f1b7a62-fdc2-4b8e-b9f8-61105c0fcb5c is timed out.
Nov 16 10:37:08 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-e7d88779-9546-461a-9f8a-da063caa50a2 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Successfully detached device vdb from instance 2f1b7a62-fdc2-4b8e-b9f8-61105c0fcb5c from the live domain config.
Nov 16 10:37:08 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e7d88779-9546-461a-9f8a-da063caa50a2 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] [instance: 2f1b7a62-fdc2-4b8e-b9f8-61105c0fcb5c] calling os-brick to detach iSCSI Volume {{(pid=85141) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 10:37:08 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7d88779-9546-461a-9f8a-da063caa50a2 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51806b6080>, {'target_iqn': 'iqn.2010-10.org.openstack:1fd95458-b13d-439d-b30c-6dcfe2fa8419', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GwnfhSHM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 10:37:08 user nova-compute[85141]: WARNING os_brick.initiator.connectors.base [None req-e7d88779-9546-461a-9f8a-da063caa50a2 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 10:37:08 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-e7d88779-9546-461a-9f8a-da063caa50a2 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 10:37:08 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-e7d88779-9546-461a-9f8a-da063caa50a2 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 10:37:08 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:37:08 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:37:08 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad511c1a-f7be-494c-b811-6b0239e632ca]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:584dd8df-f6a2-4e35-be7e-8de1e759491b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bbbec54a-dd3f-44aa-be3d-d3fb1a206b29\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1fd95458-b13d-439d-b30c-6dcfe2fa8419\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:37:08 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7d88779-9546-461a-9f8a-da063caa50a2 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 10:37:08 user nova-compute[85141]: No targets found.
Nov 16 10:37:08 user nova-compute[85141]: iSNS:
Nov 16 10:37:08 user nova-compute[85141]: No targets found.
Nov 16 10:37:08 user nova-compute[85141]: STATIC:
Nov 16 10:37:08 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:584dd8df-f6a2-4e35-be7e-8de1e759491b
Nov 16 10:37:08 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:37:08 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:37:08 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:bbbec54a-dd3f-44aa-be3d-d3fb1a206b29
Nov 16 10:37:08 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:37:08 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:37:08 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:1fd95458-b13d-439d-b30c-6dcfe2fa8419
Nov 16 10:37:08 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:37:08 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:37:08 user nova-compute[85141]: FIRMWARE:
Nov 16 10:37:08 user nova-compute[85141]: No targets found.
Nov 16 10:37:08 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:37:08 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7d88779-9546-461a-9f8a-da063caa50a2 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 10:37:08 user nova-compute[85141]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 10:37:08 user nova-compute[85141]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=85141) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 10:37:08 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7d88779-9546-461a-9f8a-da063caa50a2 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1fd95458-b13d-439d-b30c-6dcfe2fa8419', 0)] {{(pid=85141) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 10:37:08 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:37:08 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:37:08 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7f79569-55b8-439a-9313-981decb1dfaf]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1fd95458-b13d-439d-b30c-6dcfe2fa8419\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:584dd8df-f6a2-4e35-be7e-8de1e759491b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bbbec54a-dd3f-44aa-be3d-d3fb1a206b29\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:37:08 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:37:08 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:37:08 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd3f17c0-4a14-44c1-824a-230f24985dae]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fd95458-b13d-439d-b30c-6dcfe2fa8419 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:584dd8df-f6a2-4e35-be7e-8de1e759491b (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbbec54a-dd3f-44aa-be3d-d3fb1a206b29 (non-flash)\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:37:08 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7d88779-9546-461a-9f8a-da063caa50a2 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fd95458-b13d-439d-b30c-6dcfe2fa8419 (non-flash)
Nov 16 10:37:08 user nova-compute[85141]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:584dd8df-f6a2-4e35-be7e-8de1e759491b (non-flash)
Nov 16 10:37:08 user nova-compute[85141]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbbec54a-dd3f-44aa-be3d-d3fb1a206b29 (non-flash)
Nov 16 10:37:08 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:37:08 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7d88779-9546-461a-9f8a-da063caa50a2 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fd95458-b13d-439d-b30c-6dcfe2fa8419 (non-flash)
Nov 16 10:37:08 user nova-compute[85141]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:584dd8df-f6a2-4e35-be7e-8de1e759491b (non-flash)
Nov 16 10:37:08 user nova-compute[85141]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbbec54a-dd3f-44aa-be3d-d3fb1a206b29 (non-flash)
Nov 16 10:37:08 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 10:37:08 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7d88779-9546-461a-9f8a-da063caa50a2 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f51a0109ea0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1fd95458-b13d-439d-b30c-6dcfe2fa8419'): ({'sdd'}, set())}) {{(pid=85141) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 10:37:08 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-e7d88779-9546-461a-9f8a-da063caa50a2 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Removing single pathed devices sdd {{(pid=85141) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 10:37:08 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:37:08 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:37:08 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[429cbc65-7803-4ea6-9cf5-e45e0b39c82f]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:37:08 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:37:08 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:37:08 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a2d2d0c-7ce6-4b86-ad8a-a58c7b4c7dd0]: (4, ('ok\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:37:08 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-e7d88779-9546-461a-9f8a-da063caa50a2 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Flushing IO for device /dev/sdd {{(pid=85141) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 10:37:08 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:37:08 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:37:08 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[9772f39d-e35b-483f-ba5f-f82b41bae42b]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:37:08 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-e7d88779-9546-461a-9f8a-da063caa50a2 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=85141) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 10:37:08 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:37:08 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.040s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:37:08 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1161ef5-b197-4f57-a075-4fe07a983b0f]: (4, ('1', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:37:08 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-e7d88779-9546-461a-9f8a-da063caa50a2 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=85141) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 10:37:08 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-e7d88779-9546-461a-9f8a-da063caa50a2 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] SCSI volumes sdd have been removed. {{(pid=85141) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 10:37:08 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7d88779-9546-461a-9f8a-da063caa50a2 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1fd95458-b13d-439d-b30c-6dcfe2fa8419')] {{(pid=85141) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 10:37:08 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1fd95458-b13d-439d-b30c-6dcfe2fa8419 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:37:08 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1fd95458-b13d-439d-b30c-6dcfe2fa8419 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.030s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:37:08 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce19ea1f-1484-498e-a017-c646d08385bf]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:37:08 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7d88779-9546-461a-9f8a-da063caa50a2 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:37:08 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1fd95458-b13d-439d-b30c-6dcfe2fa8419 -p 172.16.0.220:3260 --logout {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:37:08 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1fd95458-b13d-439d-b30c-6dcfe2fa8419 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:37:08 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[96bded76-50e9-4385-8864-b8aa51344ac2]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:1fd95458-b13d-439d-b30c-6dcfe2fa8419, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:1fd95458-b13d-439d-b30c-6dcfe2fa8419, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:37:08 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7d88779-9546-461a-9f8a-da063caa50a2 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:1fd95458-b13d-439d-b30c-6dcfe2fa8419, portal: 172.16.0.220,3260]
Nov 16 10:37:08 user nova-compute[85141]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:1fd95458-b13d-439d-b30c-6dcfe2fa8419, portal: 172.16.0.220,3260] successful.
Nov 16 10:37:08 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:37:08 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1fd95458-b13d-439d-b30c-6dcfe2fa8419 -p 172.16.0.220:3260 --op delete {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:37:08 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1fd95458-b13d-439d-b30c-6dcfe2fa8419 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:37:08 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[c97f04a5-add1-4899-b318-fcac852c5731]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:37:08 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7d88779-9546-461a-9f8a-da063caa50a2 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:37:08 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-e7d88779-9546-461a-9f8a-da063caa50a2 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.305s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 10:37:08 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7d88779-9546-461a-9f8a-da063caa50a2 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] <== disconnect_volume: return (307ms) None {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 10:37:08 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e7d88779-9546-461a-9f8a-da063caa50a2 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] [instance: 2f1b7a62-fdc2-4b8e-b9f8-61105c0fcb5c] Disconnected iSCSI Volume {{(pid=85141) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 10:37:09 user nova-compute[85141]: DEBUG nova.objects.instance [None req-e7d88779-9546-461a-9f8a-da063caa50a2 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Lazy-loading 'flavor' on Instance uuid 2f1b7a62-fdc2-4b8e-b9f8-61105c0fcb5c {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:37:09 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-e7d88779-9546-461a-9f8a-da063caa50a2 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Lock "2f1b7a62-fdc2-4b8e-b9f8-61105c0fcb5c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.801s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:37:09 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "2f1b7a62-fdc2-4b8e-b9f8-61105c0fcb5c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 1.270s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:37:09 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "2f1b7a62-fdc2-4b8e-b9f8-61105c0fcb5c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.023s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:37:11 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:37:13 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:37:16 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:37:21 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:37:23 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-c0139065-accc-436a-abf1-01b6ccd8fd0c tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 1e01e0e9-5eef-4af4-8633-814d59860b8d is timed out.
Nov 16 10:37:23 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-c0139065-accc-436a-abf1-01b6ccd8fd0c tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Successfully detached device vdb from instance 1e01e0e9-5eef-4af4-8633-814d59860b8d from the live domain config.
Nov 16 10:37:23 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c0139065-accc-436a-abf1-01b6ccd8fd0c tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] [instance: 1e01e0e9-5eef-4af4-8633-814d59860b8d] calling os-brick to detach iSCSI Volume {{(pid=85141) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 10:37:23 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0139065-accc-436a-abf1-01b6ccd8fd0c tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51806b6080>, {'target_iqn': 'iqn.2010-10.org.openstack:bbbec54a-dd3f-44aa-be3d-d3fb1a206b29', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YSibvgKr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 10:37:23 user nova-compute[85141]: WARNING os_brick.initiator.connectors.base [None req-c0139065-accc-436a-abf1-01b6ccd8fd0c tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 10:37:23 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-c0139065-accc-436a-abf1-01b6ccd8fd0c tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 10:37:23 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-c0139065-accc-436a-abf1-01b6ccd8fd0c tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 10:37:23 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:37:23 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:37:23 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[0593ba53-1fb9-4bb1-8bd0-fdd8bee125ce]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:584dd8df-f6a2-4e35-be7e-8de1e759491b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bbbec54a-dd3f-44aa-be3d-d3fb1a206b29\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:37:23 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0139065-accc-436a-abf1-01b6ccd8fd0c tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 10:37:23 user nova-compute[85141]: No targets found.
Nov 16 10:37:23 user nova-compute[85141]: iSNS:
Nov 16 10:37:23 user nova-compute[85141]: No targets found.
Nov 16 10:37:23 user nova-compute[85141]: STATIC:
Nov 16 10:37:23 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:584dd8df-f6a2-4e35-be7e-8de1e759491b
Nov 16 10:37:23 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:37:23 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:37:23 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:bbbec54a-dd3f-44aa-be3d-d3fb1a206b29
Nov 16 10:37:23 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:37:23 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:37:23 user nova-compute[85141]: FIRMWARE:
Nov 16 10:37:23 user nova-compute[85141]: No targets found.
Nov 16 10:37:23 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:37:23 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0139065-accc-436a-abf1-01b6ccd8fd0c tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 10:37:23 user nova-compute[85141]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 10:37:23 user nova-compute[85141]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=85141) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 10:37:23 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0139065-accc-436a-abf1-01b6ccd8fd0c tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bbbec54a-dd3f-44aa-be3d-d3fb1a206b29', 0)] {{(pid=85141) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 10:37:23 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:37:23 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:37:23 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[83748ad3-af57-4c7b-83c4-4ee1c4b67c24]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:584dd8df-f6a2-4e35-be7e-8de1e759491b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bbbec54a-dd3f-44aa-be3d-d3fb1a206b29\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:37:23 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:37:23 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:37:23 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d5be895-0512-459c-b1e3-710ee413758e]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:584dd8df-f6a2-4e35-be7e-8de1e759491b (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbbec54a-dd3f-44aa-be3d-d3fb1a206b29 (non-flash)\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:37:23 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0139065-accc-436a-abf1-01b6ccd8fd0c tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:584dd8df-f6a2-4e35-be7e-8de1e759491b (non-flash)
Nov 16 10:37:23 user nova-compute[85141]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbbec54a-dd3f-44aa-be3d-d3fb1a206b29 (non-flash)
Nov 16 10:37:23 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:37:23 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0139065-accc-436a-abf1-01b6ccd8fd0c tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:584dd8df-f6a2-4e35-be7e-8de1e759491b (non-flash)
Nov 16 10:37:23 user nova-compute[85141]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbbec54a-dd3f-44aa-be3d-d3fb1a206b29 (non-flash)
Nov 16 10:37:23 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 10:37:23 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0139065-accc-436a-abf1-01b6ccd8fd0c tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f516073e320>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bbbec54a-dd3f-44aa-be3d-d3fb1a206b29'): ({'sdc'}, set())}) {{(pid=85141) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 10:37:23 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-c0139065-accc-436a-abf1-01b6ccd8fd0c tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Removing single pathed devices sdc {{(pid=85141) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 10:37:23 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:37:23 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:37:23 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[99fe4881-3565-4daa-a741-35548d135f8e]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:37:23 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:37:23 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:37:23 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[c178fefe-fd87-45ba-b851-1ce9bea0e0a2]: (4, ('ok\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:37:23 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-c0139065-accc-436a-abf1-01b6ccd8fd0c tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Flushing IO for device /dev/sdc {{(pid=85141) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 10:37:23 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:37:23 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:37:23 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[74e3f88e-0563-4a19-bc84-56cbb08cc59d]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:37:23 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-c0139065-accc-436a-abf1-01b6ccd8fd0c tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=85141) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 10:37:23 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:37:23 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.031s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:37:23 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[82b011e0-2540-40bf-8d17-01aa077909e7]: (4, ('1', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:37:23 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-c0139065-accc-436a-abf1-01b6ccd8fd0c tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=85141) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 10:37:23 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-c0139065-accc-436a-abf1-01b6ccd8fd0c tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] SCSI volumes sdc have been removed. {{(pid=85141) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 10:37:23 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0139065-accc-436a-abf1-01b6ccd8fd0c tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bbbec54a-dd3f-44aa-be3d-d3fb1a206b29')] {{(pid=85141) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 10:37:23 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bbbec54a-dd3f-44aa-be3d-d3fb1a206b29 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:37:23 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bbbec54a-dd3f-44aa-be3d-d3fb1a206b29 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:37:23 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[718fb404-e0a8-4522-9c6f-d21647e7c639]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:37:23 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0139065-accc-436a-abf1-01b6ccd8fd0c tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:37:23 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bbbec54a-dd3f-44aa-be3d-d3fb1a206b29 -p 172.16.0.220:3260 --logout {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:37:23 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bbbec54a-dd3f-44aa-be3d-d3fb1a206b29 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:37:23 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3e32f59-f505-49ed-ae55-cd1672839e7d]: (4, ('Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:bbbec54a-dd3f-44aa-be3d-d3fb1a206b29, portal: 172.16.0.220,3260]\nLogout of [sid: 56, target: iqn.2010-10.org.openstack:bbbec54a-dd3f-44aa-be3d-d3fb1a206b29, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:37:23 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0139065-accc-436a-abf1-01b6ccd8fd0c tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:bbbec54a-dd3f-44aa-be3d-d3fb1a206b29, portal: 172.16.0.220,3260]
Nov 16 10:37:23 user nova-compute[85141]: Logout of [sid: 56, target: iqn.2010-10.org.openstack:bbbec54a-dd3f-44aa-be3d-d3fb1a206b29, portal: 172.16.0.220,3260] successful.
Nov 16 10:37:23 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:37:23 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bbbec54a-dd3f-44aa-be3d-d3fb1a206b29 -p 172.16.0.220:3260 --op delete {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:37:23 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bbbec54a-dd3f-44aa-be3d-d3fb1a206b29 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:37:23 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7153f4c-c023-4a77-b842-52dfaee3ccf0]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:37:23 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0139065-accc-436a-abf1-01b6ccd8fd0c tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:37:23 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-c0139065-accc-436a-abf1-01b6ccd8fd0c tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.285s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 10:37:23 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0139065-accc-436a-abf1-01b6ccd8fd0c tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] <== disconnect_volume: return (286ms) None {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 10:37:23 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c0139065-accc-436a-abf1-01b6ccd8fd0c tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] [instance: 1e01e0e9-5eef-4af4-8633-814d59860b8d] Disconnected iSCSI Volume {{(pid=85141) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 10:37:24 user nova-compute[85141]: DEBUG nova.objects.instance [None req-c0139065-accc-436a-abf1-01b6ccd8fd0c tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Lazy-loading 'flavor' on Instance uuid 1e01e0e9-5eef-4af4-8633-814d59860b8d {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:37:24 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-c0139065-accc-436a-abf1-01b6ccd8fd0c tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Lock "1e01e0e9-5eef-4af4-8633-814d59860b8d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.600s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:37:24 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "1e01e0e9-5eef-4af4-8633-814d59860b8d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 16.148s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:37:24 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "1e01e0e9-5eef-4af4-8633-814d59860b8d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.024s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:37:26 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:37:26 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:37:26 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=85141) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 10:37:26 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=85141) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 10:37:26 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=85141) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 10:37:26 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:37:31 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:37:36 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:37:37 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:37:38 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-546d9e68-11a2-4074-9ac3-75ba140c5f41 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Acquiring lock "2f1b7a62-fdc2-4b8e-b9f8-61105c0fcb5c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:37:38 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-546d9e68-11a2-4074-9ac3-75ba140c5f41 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Lock "2f1b7a62-fdc2-4b8e-b9f8-61105c0fcb5c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:37:38 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-546d9e68-11a2-4074-9ac3-75ba140c5f41 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Acquiring lock "2f1b7a62-fdc2-4b8e-b9f8-61105c0fcb5c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:37:38 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-546d9e68-11a2-4074-9ac3-75ba140c5f41 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Lock "2f1b7a62-fdc2-4b8e-b9f8-61105c0fcb5c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:37:38 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-546d9e68-11a2-4074-9ac3-75ba140c5f41 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Lock "2f1b7a62-fdc2-4b8e-b9f8-61105c0fcb5c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:37:38 user nova-compute[85141]: INFO nova.compute.manager [None req-546d9e68-11a2-4074-9ac3-75ba140c5f41 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] [instance: 2f1b7a62-fdc2-4b8e-b9f8-61105c0fcb5c] Terminating instance
Nov 16 10:37:38 user nova-compute[85141]: DEBUG nova.compute.manager [None req-546d9e68-11a2-4074-9ac3-75ba140c5f41 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] [instance: 2f1b7a62-fdc2-4b8e-b9f8-61105c0fcb5c] Start destroying the instance on the hypervisor. {{(pid=85141) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 10:37:38 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:37:38 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:37:38 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:37:38 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:37:38 user nova-compute[85141]: DEBUG nova.compute.manager [req-d91ee5ad-92e4-4d7a-a65e-9bbfeb375bb9 req-637b432e-5198-4175-9cff-b5f5af097eff service nova] [instance: 2f1b7a62-fdc2-4b8e-b9f8-61105c0fcb5c] Received event network-vif-unplugged-3c3baa93-b4c3-4cf5-b363-aab7e937312b {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:37:38 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-d91ee5ad-92e4-4d7a-a65e-9bbfeb375bb9 req-637b432e-5198-4175-9cff-b5f5af097eff service nova] Acquiring lock "2f1b7a62-fdc2-4b8e-b9f8-61105c0fcb5c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:37:38 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-d91ee5ad-92e4-4d7a-a65e-9bbfeb375bb9 req-637b432e-5198-4175-9cff-b5f5af097eff service nova] Lock "2f1b7a62-fdc2-4b8e-b9f8-61105c0fcb5c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:37:38 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-d91ee5ad-92e4-4d7a-a65e-9bbfeb375bb9 req-637b432e-5198-4175-9cff-b5f5af097eff service nova] Lock "2f1b7a62-fdc2-4b8e-b9f8-61105c0fcb5c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:37:38 user nova-compute[85141]: DEBUG nova.compute.manager [req-d91ee5ad-92e4-4d7a-a65e-9bbfeb375bb9 req-637b432e-5198-4175-9cff-b5f5af097eff service nova] [instance: 2f1b7a62-fdc2-4b8e-b9f8-61105c0fcb5c] No waiting events found dispatching network-vif-unplugged-3c3baa93-b4c3-4cf5-b363-aab7e937312b {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:37:38 user nova-compute[85141]: DEBUG nova.compute.manager [req-d91ee5ad-92e4-4d7a-a65e-9bbfeb375bb9 req-637b432e-5198-4175-9cff-b5f5af097eff service nova] [instance: 2f1b7a62-fdc2-4b8e-b9f8-61105c0fcb5c] Received event network-vif-unplugged-3c3baa93-b4c3-4cf5-b363-aab7e937312b for instance with task_state deleting. {{(pid=85141) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 10:37:38 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:37:38 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:37:38 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:37:38 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:37:38 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:37:38 user nova-compute[85141]: INFO nova.virt.libvirt.driver [-] [instance: 2f1b7a62-fdc2-4b8e-b9f8-61105c0fcb5c] Instance destroyed successfully.
Nov 16 10:37:38 user nova-compute[85141]: DEBUG nova.objects.instance [None req-546d9e68-11a2-4074-9ac3-75ba140c5f41 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Lazy-loading 'resources' on Instance uuid 2f1b7a62-fdc2-4b8e-b9f8-61105c0fcb5c {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:37:38 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-546d9e68-11a2-4074-9ac3-75ba140c5f41 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T10:31:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1378175750',display_name='tempest-AttachVolumeNegativeTest-server-1378175750',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1378175750',id=45,image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHkzme+UavyKmSDzV1as216oEyW9V6Nj6NWY0N5YJN3Zb18eJvmXEPhLTsLoj7DzKUhzrnnUSYSQonwxDZSZplU7nlmMxrnwyKdOV9cd9SsidWTFbneIsLLnPSGl8uqVhg==',key_name='tempest-keypair-1962877264',keypairs=<?>,launch_index=0,launched_at=2023-11-16T10:32:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d13c6ff3c30549ca9ab44d9fc1fedc6f',ramdisk_id='',reservation_id='r-kzfnhyif',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-2108292208',owner_user_name='tempest-AttachVolumeNegativeTest-2108292208-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T10:32:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5aa5beeeca5d4dc89cf5333942da756f',uuid=2f1b7a62-fdc2-4b8e-b9f8-61105c0fcb5c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3c3baa93-b4c3-4cf5-b363-aab7e937312b", "address": "fa:16:3e:d1:c8:21", "network": {"id": "8931cd8f-3c0b-4d49-ae98-48f818e854e7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1902653571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d13c6ff3c30549ca9ab44d9fc1fedc6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c3baa93-b4", "ovs_interfaceid": "3c3baa93-b4c3-4cf5-b363-aab7e937312b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 10:37:38 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-546d9e68-11a2-4074-9ac3-75ba140c5f41 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Converting VIF {"id": "3c3baa93-b4c3-4cf5-b363-aab7e937312b", "address": "fa:16:3e:d1:c8:21", "network": {"id": "8931cd8f-3c0b-4d49-ae98-48f818e854e7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1902653571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d13c6ff3c30549ca9ab44d9fc1fedc6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c3baa93-b4", "ovs_interfaceid": "3c3baa93-b4c3-4cf5-b363-aab7e937312b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:37:38 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-546d9e68-11a2-4074-9ac3-75ba140c5f41 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d1:c8:21,bridge_name='br-int',has_traffic_filtering=True,id=3c3baa93-b4c3-4cf5-b363-aab7e937312b,network=Network(8931cd8f-3c0b-4d49-ae98-48f818e854e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c3baa93-b4') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:37:38 user nova-compute[85141]: DEBUG os_vif [None req-546d9e68-11a2-4074-9ac3-75ba140c5f41 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d1:c8:21,bridge_name='br-int',has_traffic_filtering=True,id=3c3baa93-b4c3-4cf5-b363-aab7e937312b,network=Network(8931cd8f-3c0b-4d49-ae98-48f818e854e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c3baa93-b4') {{(pid=85141) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 10:37:38 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:37:38 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:37:38 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3c3baa93-b4, bridge=br-int, if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:37:38 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:37:38 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:37:38 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:37:38 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=62b4e292-f08b-4359-85e6-8a32ea1ff07c) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:37:38 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:37:38 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:37:38 user nova-compute[85141]: INFO os_vif [None req-546d9e68-11a2-4074-9ac3-75ba140c5f41 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d1:c8:21,bridge_name='br-int',has_traffic_filtering=True,id=3c3baa93-b4c3-4cf5-b363-aab7e937312b,network=Network(8931cd8f-3c0b-4d49-ae98-48f818e854e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c3baa93-b4')
Nov 16 10:37:38 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-546d9e68-11a2-4074-9ac3-75ba140c5f41 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] [instance: 2f1b7a62-fdc2-4b8e-b9f8-61105c0fcb5c] Deleting instance files /opt/stack/data/nova/instances/2f1b7a62-fdc2-4b8e-b9f8-61105c0fcb5c_del
Nov 16 10:37:38 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-546d9e68-11a2-4074-9ac3-75ba140c5f41 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] [instance: 2f1b7a62-fdc2-4b8e-b9f8-61105c0fcb5c] Deletion of /opt/stack/data/nova/instances/2f1b7a62-fdc2-4b8e-b9f8-61105c0fcb5c_del complete
Nov 16 10:37:39 user nova-compute[85141]: INFO nova.compute.manager [None req-546d9e68-11a2-4074-9ac3-75ba140c5f41 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] [instance: 2f1b7a62-fdc2-4b8e-b9f8-61105c0fcb5c] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 16 10:37:39 user nova-compute[85141]: DEBUG oslo.service.loopingcall [None req-546d9e68-11a2-4074-9ac3-75ba140c5f41 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=85141) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 10:37:39 user nova-compute[85141]: DEBUG nova.compute.manager [-] [instance: 2f1b7a62-fdc2-4b8e-b9f8-61105c0fcb5c] Deallocating network for instance {{(pid=85141) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 10:37:39 user nova-compute[85141]: DEBUG nova.network.neutron [-] [instance: 2f1b7a62-fdc2-4b8e-b9f8-61105c0fcb5c] deallocate_for_instance() {{(pid=85141) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 10:37:39 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:37:39 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:37:39 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:37:39 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:37:39 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:37:39 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:37:39 user nova-compute[85141]: DEBUG nova.network.neutron [-] [instance: 2f1b7a62-fdc2-4b8e-b9f8-61105c0fcb5c] Updating instance_info_cache with network_info: [] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:37:39 user nova-compute[85141]: INFO nova.compute.manager [-] [instance: 2f1b7a62-fdc2-4b8e-b9f8-61105c0fcb5c] Took 0.82 seconds to deallocate network for instance.
Nov 16 10:37:39 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-546d9e68-11a2-4074-9ac3-75ba140c5f41 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:37:39 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-546d9e68-11a2-4074-9ac3-75ba140c5f41 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:37:39 user nova-compute[85141]: DEBUG nova.compute.manager [req-36f29de6-e951-4a55-a5b7-fabfd9e870a2 req-dee7b28e-9c4f-4409-bc19-61925598f6c2 service nova] [instance: 2f1b7a62-fdc2-4b8e-b9f8-61105c0fcb5c] Received event network-vif-deleted-3c3baa93-b4c3-4cf5-b363-aab7e937312b {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:37:40 user nova-compute[85141]: DEBUG nova.compute.provider_tree [None req-546d9e68-11a2-4074-9ac3-75ba140c5f41 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Inventory has not changed in ProviderTree for provider: bf8e0fa1-16b6-408f-9203-c4cd63916272 {{(pid=85141) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 10:37:40 user nova-compute[85141]: DEBUG nova.scheduler.client.report [None req-546d9e68-11a2-4074-9ac3-75ba140c5f41 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Inventory has not changed for provider bf8e0fa1-16b6-408f-9203-c4cd63916272 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=85141) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 10:37:40 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-546d9e68-11a2-4074-9ac3-75ba140c5f41 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.176s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:37:40 user nova-compute[85141]: INFO nova.scheduler.client.report [None req-546d9e68-11a2-4074-9ac3-75ba140c5f41 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Deleted allocations for instance 2f1b7a62-fdc2-4b8e-b9f8-61105c0fcb5c
Nov 16 10:37:40 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-546d9e68-11a2-4074-9ac3-75ba140c5f41 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Lock "2f1b7a62-fdc2-4b8e-b9f8-61105c0fcb5c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.048s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:37:40 user nova-compute[85141]: DEBUG nova.compute.manager [req-a376cd7b-c0c5-4f8e-84cd-8985e4402de6 req-28b6f043-d1db-4413-bbbc-e5d8c08ce159 service nova] [instance: 2f1b7a62-fdc2-4b8e-b9f8-61105c0fcb5c] Received event network-vif-plugged-3c3baa93-b4c3-4cf5-b363-aab7e937312b {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:37:40 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-a376cd7b-c0c5-4f8e-84cd-8985e4402de6 req-28b6f043-d1db-4413-bbbc-e5d8c08ce159 service nova] Acquiring lock "2f1b7a62-fdc2-4b8e-b9f8-61105c0fcb5c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:37:40 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-a376cd7b-c0c5-4f8e-84cd-8985e4402de6 req-28b6f043-d1db-4413-bbbc-e5d8c08ce159 service nova] Lock "2f1b7a62-fdc2-4b8e-b9f8-61105c0fcb5c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:37:40 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-a376cd7b-c0c5-4f8e-84cd-8985e4402de6 req-28b6f043-d1db-4413-bbbc-e5d8c08ce159 service nova] Lock "2f1b7a62-fdc2-4b8e-b9f8-61105c0fcb5c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:37:40 user nova-compute[85141]: DEBUG nova.compute.manager [req-a376cd7b-c0c5-4f8e-84cd-8985e4402de6 req-28b6f043-d1db-4413-bbbc-e5d8c08ce159 service nova] [instance: 2f1b7a62-fdc2-4b8e-b9f8-61105c0fcb5c] No waiting events found dispatching network-vif-plugged-3c3baa93-b4c3-4cf5-b363-aab7e937312b {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:37:40 user nova-compute[85141]: WARNING nova.compute.manager [req-a376cd7b-c0c5-4f8e-84cd-8985e4402de6 req-28b6f043-d1db-4413-bbbc-e5d8c08ce159 service nova] [instance: 2f1b7a62-fdc2-4b8e-b9f8-61105c0fcb5c] Received unexpected event network-vif-plugged-3c3baa93-b4c3-4cf5-b363-aab7e937312b for instance with vm_state deleted and task_state None.
Nov 16 10:37:40 user nova-compute[85141]: DEBUG nova.compute.manager [req-a376cd7b-c0c5-4f8e-84cd-8985e4402de6 req-28b6f043-d1db-4413-bbbc-e5d8c08ce159 service nova] [instance: 2f1b7a62-fdc2-4b8e-b9f8-61105c0fcb5c] Received event network-vif-plugged-3c3baa93-b4c3-4cf5-b363-aab7e937312b {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:37:40 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-a376cd7b-c0c5-4f8e-84cd-8985e4402de6 req-28b6f043-d1db-4413-bbbc-e5d8c08ce159 service nova] Acquiring lock "2f1b7a62-fdc2-4b8e-b9f8-61105c0fcb5c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:37:40 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-a376cd7b-c0c5-4f8e-84cd-8985e4402de6 req-28b6f043-d1db-4413-bbbc-e5d8c08ce159 service nova] Lock "2f1b7a62-fdc2-4b8e-b9f8-61105c0fcb5c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:37:40 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-a376cd7b-c0c5-4f8e-84cd-8985e4402de6 req-28b6f043-d1db-4413-bbbc-e5d8c08ce159 service nova] Lock "2f1b7a62-fdc2-4b8e-b9f8-61105c0fcb5c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:37:40 user nova-compute[85141]: DEBUG nova.compute.manager [req-a376cd7b-c0c5-4f8e-84cd-8985e4402de6 req-28b6f043-d1db-4413-bbbc-e5d8c08ce159 service nova] [instance: 2f1b7a62-fdc2-4b8e-b9f8-61105c0fcb5c] No waiting events found dispatching network-vif-plugged-3c3baa93-b4c3-4cf5-b363-aab7e937312b {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:37:40 user nova-compute[85141]: WARNING nova.compute.manager [req-a376cd7b-c0c5-4f8e-84cd-8985e4402de6 req-28b6f043-d1db-4413-bbbc-e5d8c08ce159 service nova] [instance: 2f1b7a62-fdc2-4b8e-b9f8-61105c0fcb5c] Received unexpected event network-vif-plugged-3c3baa93-b4c3-4cf5-b363-aab7e937312b for instance with vm_state deleted and task_state None.
Nov 16 10:37:42 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:37:42 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Starting heal instance info cache {{(pid=85141) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 10:37:42 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Acquiring lock "refresh_cache-1e01e0e9-5eef-4af4-8633-814d59860b8d" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:37:42 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Acquired lock "refresh_cache-1e01e0e9-5eef-4af4-8633-814d59860b8d" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:37:42 user nova-compute[85141]: DEBUG nova.network.neutron [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] [instance: 1e01e0e9-5eef-4af4-8633-814d59860b8d] Forcefully refreshing network info cache for instance {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 10:37:43 user nova-compute[85141]: DEBUG nova.network.neutron [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] [instance: 1e01e0e9-5eef-4af4-8633-814d59860b8d] Updating instance_info_cache with network_info: [{"id": "6f4c8e31-7ee9-4257-9441-12fff78fb8d1", "address": "fa:16:3e:40:7a:69", "network": {"id": "609e6198-811e-4b40-a518-f960e9fc5b91", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1628388169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "647a6ef16a7b496a9568f9d777e38412", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f4c8e31-7e", "ovs_interfaceid": "6f4c8e31-7ee9-4257-9441-12fff78fb8d1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:37:43 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Releasing lock "refresh_cache-1e01e0e9-5eef-4af4-8633-814d59860b8d" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:37:43 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] [instance: 1e01e0e9-5eef-4af4-8633-814d59860b8d] Updated the network info_cache for instance {{(pid=85141) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 10:37:43 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:37:43 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=85141) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 10:37:43 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager.update_available_resource {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:37:43 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:37:43 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:37:43 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:37:43 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Auditing locally available compute resources for user (node: user) {{(pid=85141) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 10:37:43 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=85141) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 10:37:43 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e01e0e9-5eef-4af4-8633-814d59860b8d/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:37:43 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e01e0e9-5eef-4af4-8633-814d59860b8d/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:37:43 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e01e0e9-5eef-4af4-8633-814d59860b8d/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:37:43 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e01e0e9-5eef-4af4-8633-814d59860b8d/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:37:44 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:37:44 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:37:44 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:37:44 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Hypervisor/Node resource view: name=user free_ram=8790MB free_disk=25.067405700683594GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=85141) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 10:37:44 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:37:44 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:37:44 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance 1e01e0e9-5eef-4af4-8633-814d59860b8d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:37:44 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance 797c873e-cf15-4d3c-a3bc-bd2a81a80014 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:37:44 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=85141) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 10:37:44 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=85141) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 10:37:44 user nova-compute[85141]: DEBUG nova.compute.provider_tree [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Inventory has not changed in ProviderTree for provider: bf8e0fa1-16b6-408f-9203-c4cd63916272 {{(pid=85141) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 10:37:44 user nova-compute[85141]: DEBUG nova.scheduler.client.report [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Inventory has not changed for provider bf8e0fa1-16b6-408f-9203-c4cd63916272 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=85141) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 10:37:44 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Compute_service record updated for user:user {{(pid=85141) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 10:37:44 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.219s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:37:46 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:37:46 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:37:48 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:37:48 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:37:49 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:37:50 user nova-compute[85141]: DEBUG nova.compute.manager [req-d60e4c07-5e0f-4445-8235-fd8646e9e02f req-f51e6b22-9c1f-48b6-b02f-91e42c1bfbb4 service nova] [instance: 797c873e-cf15-4d3c-a3bc-bd2a81a80014] Received event network-changed-27c72f03-eb45-49ad-b17e-330eecf72cb1 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:37:50 user nova-compute[85141]: DEBUG nova.compute.manager [req-d60e4c07-5e0f-4445-8235-fd8646e9e02f req-f51e6b22-9c1f-48b6-b02f-91e42c1bfbb4 service nova] [instance: 797c873e-cf15-4d3c-a3bc-bd2a81a80014] Refreshing instance network info cache due to event network-changed-27c72f03-eb45-49ad-b17e-330eecf72cb1. {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 10:37:50 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-d60e4c07-5e0f-4445-8235-fd8646e9e02f req-f51e6b22-9c1f-48b6-b02f-91e42c1bfbb4 service nova] Acquiring lock "refresh_cache-797c873e-cf15-4d3c-a3bc-bd2a81a80014" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:37:50 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-d60e4c07-5e0f-4445-8235-fd8646e9e02f req-f51e6b22-9c1f-48b6-b02f-91e42c1bfbb4 service nova] Acquired lock "refresh_cache-797c873e-cf15-4d3c-a3bc-bd2a81a80014" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:37:50 user nova-compute[85141]: DEBUG nova.network.neutron [req-d60e4c07-5e0f-4445-8235-fd8646e9e02f req-f51e6b22-9c1f-48b6-b02f-91e42c1bfbb4 service nova] [instance: 797c873e-cf15-4d3c-a3bc-bd2a81a80014] Refreshing network info cache for port 27c72f03-eb45-49ad-b17e-330eecf72cb1 {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 10:37:50 user nova-compute[85141]: DEBUG nova.network.neutron [req-d60e4c07-5e0f-4445-8235-fd8646e9e02f req-f51e6b22-9c1f-48b6-b02f-91e42c1bfbb4 service nova] [instance: 797c873e-cf15-4d3c-a3bc-bd2a81a80014] Updated VIF entry in instance network info cache for port 27c72f03-eb45-49ad-b17e-330eecf72cb1. {{(pid=85141) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 10:37:50 user nova-compute[85141]: DEBUG nova.network.neutron [req-d60e4c07-5e0f-4445-8235-fd8646e9e02f req-f51e6b22-9c1f-48b6-b02f-91e42c1bfbb4 service nova] [instance: 797c873e-cf15-4d3c-a3bc-bd2a81a80014] Updating instance_info_cache with network_info: [{"id": "27c72f03-eb45-49ad-b17e-330eecf72cb1", "address": "fa:16:3e:0d:32:17", "network": {"id": "b8ada47f-9721-4358-ac4f-0305f06dbbb8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1663922860-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aec3bb9fe5e6446590900b5adf65df0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27c72f03-eb", "ovs_interfaceid": "27c72f03-eb45-49ad-b17e-330eecf72cb1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:37:50 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-d60e4c07-5e0f-4445-8235-fd8646e9e02f req-f51e6b22-9c1f-48b6-b02f-91e42c1bfbb4 service nova] Releasing lock "refresh_cache-797c873e-cf15-4d3c-a3bc-bd2a81a80014" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:37:52 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:37:53 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:37:54 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:37:55 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-b125fabf-ad3e-46bb-bfae-2d82a33304eb tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Acquiring lock "1e01e0e9-5eef-4af4-8633-814d59860b8d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:37:55 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-b125fabf-ad3e-46bb-bfae-2d82a33304eb tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Lock "1e01e0e9-5eef-4af4-8633-814d59860b8d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:37:55 user nova-compute[85141]: DEBUG nova.objects.instance [None req-b125fabf-ad3e-46bb-bfae-2d82a33304eb tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Lazy-loading 'flavor' on Instance uuid 1e01e0e9-5eef-4af4-8633-814d59860b8d {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:37:55 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-b125fabf-ad3e-46bb-bfae-2d82a33304eb tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Lock "1e01e0e9-5eef-4af4-8633-814d59860b8d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:37:55 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-b125fabf-ad3e-46bb-bfae-2d82a33304eb tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Acquiring lock "1e01e0e9-5eef-4af4-8633-814d59860b8d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:37:55 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-b125fabf-ad3e-46bb-bfae-2d82a33304eb tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Lock "1e01e0e9-5eef-4af4-8633-814d59860b8d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:37:55 user nova-compute[85141]: INFO nova.compute.manager [None req-b125fabf-ad3e-46bb-bfae-2d82a33304eb tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] [instance: 1e01e0e9-5eef-4af4-8633-814d59860b8d] Attaching volume e4a263d9-1e4d-41e1-80f5-f9ab2bf72b99 to /dev/vdb
Nov 16 10:37:55 user nova-compute[85141]: DEBUG os_brick.utils [None req-b125fabf-ad3e-46bb-bfae-2d82a33304eb tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 10:37:55 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:37:55 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:37:55 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf23baf1-b87e-4b16-8ca8-08351854de42]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c7834de5c295\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:37:55 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:37:55 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:37:55 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[f14cfff2-a49c-419e-8314-f19d3fd1c91b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:37:55 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:37:55 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:37:55 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[04fcd396-8e0f-439f-8432-4757e9e9bd14]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:37:55 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[88c905c8-2f5f-4f42-b750-4b8d61443e96]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:37:55 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-b125fabf-ad3e-46bb-bfae-2d82a33304eb tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Running cmd (subprocess): nvme version {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:37:55 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-b125fabf-ad3e-46bb-bfae-2d82a33304eb tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] 'nvme version' failed. Not Retrying. {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 10:37:55 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b125fabf-ad3e-46bb-bfae-2d82a33304eb tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] nvme not present on system {{(pid=85141) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 10:37:55 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:37:55 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 10:37:55 user nova-compute[85141]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 10:37:55 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[12161ce9-b27c-4b1e-8b09-ed374187c304]: (4, '') {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:37:55 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.lightos [None req-b125fabf-ad3e-46bb-bfae-2d82a33304eb tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=85141) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 10:37:55 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.lightos [None req-b125fabf-ad3e-46bb-bfae-2d82a33304eb tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=85141) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 10:37:55 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.lightos [None req-b125fabf-ad3e-46bb-bfae-2d82a33304eb tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] LIGHTOS: no hostnqn found. {{(pid=85141) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 10:37:55 user nova-compute[85141]: DEBUG os_brick.utils [None req-b125fabf-ad3e-46bb-bfae-2d82a33304eb tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c7834de5c295', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 10:37:55 user nova-compute[85141]: DEBUG nova.virt.block_device [None req-b125fabf-ad3e-46bb-bfae-2d82a33304eb tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] [instance: 1e01e0e9-5eef-4af4-8633-814d59860b8d] Updating existing volume attachment record: 31156339-82fa-45c0-97bd-b6e576365b00 {{(pid=85141) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 10:37:55 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-2621efe4-b862-4783-839e-8d0f68e39573 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Acquiring lock "d3d07af8-8d41-4b66-8cca-ab287972b17b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:37:55 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-2621efe4-b862-4783-839e-8d0f68e39573 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Lock "d3d07af8-8d41-4b66-8cca-ab287972b17b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:37:55 user nova-compute[85141]: DEBUG nova.compute.manager [None req-2621efe4-b862-4783-839e-8d0f68e39573 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: d3d07af8-8d41-4b66-8cca-ab287972b17b] Starting instance... {{(pid=85141) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 10:37:55 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-2621efe4-b862-4783-839e-8d0f68e39573 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:37:55 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-2621efe4-b862-4783-839e-8d0f68e39573 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:37:55 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-2621efe4-b862-4783-839e-8d0f68e39573 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=85141) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 10:37:55 user nova-compute[85141]: INFO nova.compute.claims [None req-2621efe4-b862-4783-839e-8d0f68e39573 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: d3d07af8-8d41-4b66-8cca-ab287972b17b] Claim successful on node user
Nov 16 10:37:55 user nova-compute[85141]: DEBUG nova.compute.provider_tree [None req-2621efe4-b862-4783-839e-8d0f68e39573 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Inventory has not changed in ProviderTree for provider: bf8e0fa1-16b6-408f-9203-c4cd63916272 {{(pid=85141) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 10:37:55 user nova-compute[85141]: DEBUG nova.scheduler.client.report [None req-2621efe4-b862-4783-839e-8d0f68e39573 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Inventory has not changed for provider bf8e0fa1-16b6-408f-9203-c4cd63916272 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=85141) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 10:37:55 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-2621efe4-b862-4783-839e-8d0f68e39573 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.237s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:37:55 user nova-compute[85141]: DEBUG nova.compute.manager [None req-2621efe4-b862-4783-839e-8d0f68e39573 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: d3d07af8-8d41-4b66-8cca-ab287972b17b] Start building networks asynchronously for instance. {{(pid=85141) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 10:37:56 user nova-compute[85141]: DEBUG nova.compute.manager [None req-2621efe4-b862-4783-839e-8d0f68e39573 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: d3d07af8-8d41-4b66-8cca-ab287972b17b] Allocating IP information in the background. {{(pid=85141) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 10:37:56 user nova-compute[85141]: DEBUG nova.network.neutron [None req-2621efe4-b862-4783-839e-8d0f68e39573 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: d3d07af8-8d41-4b66-8cca-ab287972b17b] allocate_for_instance() {{(pid=85141) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 10:37:56 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-2621efe4-b862-4783-839e-8d0f68e39573 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: d3d07af8-8d41-4b66-8cca-ab287972b17b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 10:37:56 user nova-compute[85141]: DEBUG nova.compute.manager [None req-2621efe4-b862-4783-839e-8d0f68e39573 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: d3d07af8-8d41-4b66-8cca-ab287972b17b] Start building block device mappings for instance. {{(pid=85141) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 10:37:56 user nova-compute[85141]: DEBUG nova.policy [None req-2621efe4-b862-4783-839e-8d0f68e39573 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7261b57c36904fcda87a9ea32d4b5b31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aec3bb9fe5e6446590900b5adf65df0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85141) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 10:37:56 user nova-compute[85141]: INFO nova.virt.block_device [None req-2621efe4-b862-4783-839e-8d0f68e39573 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: d3d07af8-8d41-4b66-8cca-ab287972b17b] Booting with volume a1f6cb5b-4d5a-4d88-8ef9-e209bbd8891d at /dev/vda
Nov 16 10:37:56 user nova-compute[85141]: DEBUG os_brick.utils [None req-2621efe4-b862-4783-839e-8d0f68e39573 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 10:37:56 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:37:56 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:37:56 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe68edf8-d8e0-452d-9b23-bfa8a9a5b398]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c7834de5c295\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:37:56 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:37:56 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:37:56 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[60015c46-0692-4258-8590-f4eafffbe2c3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:37:56 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:37:56 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.013s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:37:56 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cb457d8-f5e7-4cd5-b612-e8d7404cd1bd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:37:56 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[87c6892e-eefc-44c4-ab2d-2c33c58fc9d2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:37:56 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-2621efe4-b862-4783-839e-8d0f68e39573 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Running cmd (subprocess): nvme version {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:37:56 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-2621efe4-b862-4783-839e-8d0f68e39573 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] 'nvme version' failed. Not Retrying. {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 10:37:56 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2621efe4-b862-4783-839e-8d0f68e39573 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] nvme not present on system {{(pid=85141) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 10:37:56 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:37:56 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 10:37:56 user nova-compute[85141]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 10:37:56 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[d403abfe-5ad4-4607-9121-c0b4f2cb4f95]: (4, '') {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:37:56 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.lightos [None req-2621efe4-b862-4783-839e-8d0f68e39573 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=85141) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 10:37:56 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.lightos [None req-2621efe4-b862-4783-839e-8d0f68e39573 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=85141) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 10:37:56 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.lightos [None req-2621efe4-b862-4783-839e-8d0f68e39573 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] LIGHTOS: no hostnqn found. {{(pid=85141) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 10:37:56 user nova-compute[85141]: DEBUG os_brick.utils [None req-2621efe4-b862-4783-839e-8d0f68e39573 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c7834de5c295', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 10:37:56 user nova-compute[85141]: DEBUG nova.virt.block_device [None req-2621efe4-b862-4783-839e-8d0f68e39573 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: d3d07af8-8d41-4b66-8cca-ab287972b17b] Updating existing volume attachment record: 9cdd91d4-d08d-475f-a1eb-a0ac8e4646cb {{(pid=85141) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 10:37:56 user nova-compute[85141]: DEBUG nova.network.neutron [None req-2621efe4-b862-4783-839e-8d0f68e39573 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: d3d07af8-8d41-4b66-8cca-ab287972b17b] Successfully created port: 676170ef-d4ec-4bd6-95c4-0bde0f2950f9 {{(pid=85141) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 10:37:57 user nova-compute[85141]: DEBUG nova.network.neutron [None req-2621efe4-b862-4783-839e-8d0f68e39573 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: d3d07af8-8d41-4b66-8cca-ab287972b17b] Successfully updated port: 676170ef-d4ec-4bd6-95c4-0bde0f2950f9 {{(pid=85141) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 10:37:57 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-2621efe4-b862-4783-839e-8d0f68e39573 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Acquiring lock "refresh_cache-d3d07af8-8d41-4b66-8cca-ab287972b17b" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:37:57 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-2621efe4-b862-4783-839e-8d0f68e39573 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Acquired lock "refresh_cache-d3d07af8-8d41-4b66-8cca-ab287972b17b" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:37:57 user nova-compute[85141]: DEBUG nova.network.neutron [None req-2621efe4-b862-4783-839e-8d0f68e39573 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: d3d07af8-8d41-4b66-8cca-ab287972b17b] Building network info cache for instance {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 10:37:57 user nova-compute[85141]: DEBUG nova.compute.manager [req-88305da1-bb1b-4944-a861-788af6a99021 req-4088ad4d-f1cc-4664-aa04-ccd8cdfe2ee7 service nova] [instance: d3d07af8-8d41-4b66-8cca-ab287972b17b] Received event network-changed-676170ef-d4ec-4bd6-95c4-0bde0f2950f9 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:37:57 user nova-compute[85141]: DEBUG nova.compute.manager [req-88305da1-bb1b-4944-a861-788af6a99021 req-4088ad4d-f1cc-4664-aa04-ccd8cdfe2ee7 service nova] [instance: d3d07af8-8d41-4b66-8cca-ab287972b17b] Refreshing instance network info cache due to event network-changed-676170ef-d4ec-4bd6-95c4-0bde0f2950f9. {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 10:37:57 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-88305da1-bb1b-4944-a861-788af6a99021 req-4088ad4d-f1cc-4664-aa04-ccd8cdfe2ee7 service nova] Acquiring lock "refresh_cache-d3d07af8-8d41-4b66-8cca-ab287972b17b" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:37:57 user nova-compute[85141]: DEBUG nova.network.neutron [None req-2621efe4-b862-4783-839e-8d0f68e39573 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: d3d07af8-8d41-4b66-8cca-ab287972b17b] Instance cache missing network info. {{(pid=85141) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 10:37:57 user nova-compute[85141]: DEBUG nova.network.neutron [None req-2621efe4-b862-4783-839e-8d0f68e39573 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: d3d07af8-8d41-4b66-8cca-ab287972b17b] Updating instance_info_cache with network_info: [{"id": "676170ef-d4ec-4bd6-95c4-0bde0f2950f9", "address": "fa:16:3e:19:81:9f", "network": {"id": "b8ada47f-9721-4358-ac4f-0305f06dbbb8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1663922860-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aec3bb9fe5e6446590900b5adf65df0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap676170ef-d4", "ovs_interfaceid": "676170ef-d4ec-4bd6-95c4-0bde0f2950f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:37:57 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-2621efe4-b862-4783-839e-8d0f68e39573 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Releasing lock "refresh_cache-d3d07af8-8d41-4b66-8cca-ab287972b17b" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:37:57 user nova-compute[85141]: DEBUG nova.compute.manager [None req-2621efe4-b862-4783-839e-8d0f68e39573 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: d3d07af8-8d41-4b66-8cca-ab287972b17b] Instance network_info: |[{"id": "676170ef-d4ec-4bd6-95c4-0bde0f2950f9", "address": "fa:16:3e:19:81:9f", "network": {"id": "b8ada47f-9721-4358-ac4f-0305f06dbbb8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1663922860-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aec3bb9fe5e6446590900b5adf65df0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap676170ef-d4", "ovs_interfaceid": "676170ef-d4ec-4bd6-95c4-0bde0f2950f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=85141) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 10:37:57 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-88305da1-bb1b-4944-a861-788af6a99021 req-4088ad4d-f1cc-4664-aa04-ccd8cdfe2ee7 service nova] Acquired lock "refresh_cache-d3d07af8-8d41-4b66-8cca-ab287972b17b" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:37:57 user nova-compute[85141]: DEBUG nova.network.neutron [req-88305da1-bb1b-4944-a861-788af6a99021 req-4088ad4d-f1cc-4664-aa04-ccd8cdfe2ee7 service nova] [instance: d3d07af8-8d41-4b66-8cca-ab287972b17b] Refreshing network info cache for port 676170ef-d4ec-4bd6-95c4-0bde0f2950f9 {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 10:37:58 user nova-compute[85141]: DEBUG nova.network.neutron [req-88305da1-bb1b-4944-a861-788af6a99021 req-4088ad4d-f1cc-4664-aa04-ccd8cdfe2ee7 service nova] [instance: d3d07af8-8d41-4b66-8cca-ab287972b17b] Updated VIF entry in instance network info cache for port 676170ef-d4ec-4bd6-95c4-0bde0f2950f9. {{(pid=85141) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 10:37:58 user nova-compute[85141]: DEBUG nova.network.neutron [req-88305da1-bb1b-4944-a861-788af6a99021 req-4088ad4d-f1cc-4664-aa04-ccd8cdfe2ee7 service nova] [instance: d3d07af8-8d41-4b66-8cca-ab287972b17b] Updating instance_info_cache with network_info: [{"id": "676170ef-d4ec-4bd6-95c4-0bde0f2950f9", "address": "fa:16:3e:19:81:9f", "network": {"id": "b8ada47f-9721-4358-ac4f-0305f06dbbb8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1663922860-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aec3bb9fe5e6446590900b5adf65df0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap676170ef-d4", "ovs_interfaceid": "676170ef-d4ec-4bd6-95c4-0bde0f2950f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:37:58 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-88305da1-bb1b-4944-a861-788af6a99021 req-4088ad4d-f1cc-4664-aa04-ccd8cdfe2ee7 service nova] Releasing lock "refresh_cache-d3d07af8-8d41-4b66-8cca-ab287972b17b" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:37:58 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:37:59 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:38:00 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b125fabf-ad3e-46bb-bfae-2d82a33304eb tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] [instance: 1e01e0e9-5eef-4af4-8633-814d59860b8d] Calling os-brick to attach iSCSI Volume {{(pid=85141) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 10:38:00 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-b125fabf-ad3e-46bb-bfae-2d82a33304eb tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51806b6080>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e4a263d9-1e4d-41e1-80f5-f9ab2bf72b99', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zaTfvtiE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 10:38:00 user nova-compute[85141]: WARNING os_brick.initiator.connectors.base [None req-b125fabf-ad3e-46bb-bfae-2d82a33304eb tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 10:38:00 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-b125fabf-ad3e-46bb-bfae-2d82a33304eb tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 10:38:00 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-b125fabf-ad3e-46bb-bfae-2d82a33304eb tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 10:38:00 user nova-compute[85141]: WARNING os_brick.initiator.connectors.base [None req-b125fabf-ad3e-46bb-bfae-2d82a33304eb tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 10:38:00 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-b125fabf-ad3e-46bb-bfae-2d82a33304eb tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e4a263d9-1e4d-41e1-80f5-f9ab2bf72b99" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 10:38:00 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-b125fabf-ad3e-46bb-bfae-2d82a33304eb tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e4a263d9-1e4d-41e1-80f5-f9ab2bf72b99" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 10:38:00 user nova-compute[85141]: INFO os_brick.initiator.connectors.iscsi [None req-b125fabf-ad3e-46bb-bfae-2d82a33304eb tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 10:38:00 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4a263d9-1e4d-41e1-80f5-f9ab2bf72b99 -p 172.16.0.220:3260 {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:38:00 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4a263d9-1e4d-41e1-80f5-f9ab2bf72b99 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:38:00 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[a387b486-f223-4540-9840-ba050e822099]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:38:00 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-b125fabf-ad3e-46bb-bfae-2d82a33304eb tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 10:38:00 user nova-compute[85141]:  {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:38:00 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4a263d9-1e4d-41e1-80f5-f9ab2bf72b99 -p 172.16.0.220:3260 --interface default --op new {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:38:00 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4a263d9-1e4d-41e1-80f5-f9ab2bf72b99 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:38:00 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[603db4e5-80e8-4a2d-937c-faca36622511]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e4a263d9-1e4d-41e1-80f5-f9ab2bf72b99] added\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:38:00 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-b125fabf-ad3e-46bb-bfae-2d82a33304eb tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e4a263d9-1e4d-41e1-80f5-f9ab2bf72b99] added
Nov 16 10:38:00 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:38:00 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4a263d9-1e4d-41e1-80f5-f9ab2bf72b99 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:38:00 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4a263d9-1e4d-41e1-80f5-f9ab2bf72b99 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.034s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:38:00 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef62731a-15fc-4825-9bd1-526f0aff39bb]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:38:00 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-b125fabf-ad3e-46bb-bfae-2d82a33304eb tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:38:00 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4a263d9-1e4d-41e1-80f5-f9ab2bf72b99 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:38:00 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4a263d9-1e4d-41e1-80f5-f9ab2bf72b99 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:38:00 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[39d99084-074b-43e6-a279-05d8d0b05857]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:38:00 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-b125fabf-ad3e-46bb-bfae-2d82a33304eb tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:38:00 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4a263d9-1e4d-41e1-80f5-f9ab2bf72b99 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zaTfvtiE {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:38:00 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4a263d9-1e4d-41e1-80f5-f9ab2bf72b99 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zaTfvtiE" returned: 0 in 0.018s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:38:00 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[b63e34a5-576d-4a18-aced-3df300e258cc]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:38:00 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-b125fabf-ad3e-46bb-bfae-2d82a33304eb tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zaTfvtiE'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:38:00 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4a263d9-1e4d-41e1-80f5-f9ab2bf72b99 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:38:00 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4a263d9-1e4d-41e1-80f5-f9ab2bf72b99 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:38:00 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7d35ac0-70ac-4edb-ad11-a56bbd35475f]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:38:00 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-b125fabf-ad3e-46bb-bfae-2d82a33304eb tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:38:00 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:38:00 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:38:00 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[46615093-3cc2-4873-9b34-8c072419164d]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:584dd8df-f6a2-4e35-be7e-8de1e759491b (non-flash)\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:38:00 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-b125fabf-ad3e-46bb-bfae-2d82a33304eb tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:584dd8df-f6a2-4e35-be7e-8de1e759491b (non-flash)
Nov 16 10:38:00 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:38:00 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-b125fabf-ad3e-46bb-bfae-2d82a33304eb tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:584dd8df-f6a2-4e35-be7e-8de1e759491b (non-flash)
Nov 16 10:38:00 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 10:38:00 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4a263d9-1e4d-41e1-80f5-f9ab2bf72b99 -p 172.16.0.220:3260 --login {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:38:00 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4a263d9-1e4d-41e1-80f5-f9ab2bf72b99 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:38:00 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[3022e109-bb5d-4cca-b1fd-76107d470077]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e4a263d9-1e4d-41e1-80f5-f9ab2bf72b99, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e4a263d9-1e4d-41e1-80f5-f9ab2bf72b99, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:38:00 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-b125fabf-ad3e-46bb-bfae-2d82a33304eb tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e4a263d9-1e4d-41e1-80f5-f9ab2bf72b99, portal: 172.16.0.220,3260]
Nov 16 10:38:00 user nova-compute[85141]: Login to [iface: default, target: iqn.2010-10.org.openstack:e4a263d9-1e4d-41e1-80f5-f9ab2bf72b99, portal: 172.16.0.220,3260] successful.
Nov 16 10:38:00 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:38:00 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4a263d9-1e4d-41e1-80f5-f9ab2bf72b99 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:38:00 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4a263d9-1e4d-41e1-80f5-f9ab2bf72b99 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:38:00 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eb4cbd4-7913-426b-bf4c-b34c42256f3b]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:38:00 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-b125fabf-ad3e-46bb-bfae-2d82a33304eb tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:38:00 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:38:00 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:38:00 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e6f2c59-f5e2-49c4-a354-097072f880d5]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:584dd8df-f6a2-4e35-be7e-8de1e759491b (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4a263d9-1e4d-41e1-80f5-f9ab2bf72b99 (non-flash)\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:38:00 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-b125fabf-ad3e-46bb-bfae-2d82a33304eb tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:584dd8df-f6a2-4e35-be7e-8de1e759491b (non-flash)
Nov 16 10:38:00 user nova-compute[85141]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4a263d9-1e4d-41e1-80f5-f9ab2bf72b99 (non-flash)
Nov 16 10:38:00 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:38:00 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-b125fabf-ad3e-46bb-bfae-2d82a33304eb tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:584dd8df-f6a2-4e35-be7e-8de1e759491b (non-flash)
Nov 16 10:38:00 user nova-compute[85141]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4a263d9-1e4d-41e1-80f5-f9ab2bf72b99 (non-flash)
Nov 16 10:38:00 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 10:38:00 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-b125fabf-ad3e-46bb-bfae-2d82a33304eb tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e4a263d9-1e4d-41e1-80f5-f9ab2bf72b99" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.271s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 10:38:00 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-b125fabf-ad3e-46bb-bfae-2d82a33304eb tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Connected to 172.16.0.220:3260 {{(pid=85141) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 10:38:00 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-b125fabf-ad3e-46bb-bfae-2d82a33304eb tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] HCTL ('34', '-', '-', 0) found on session 57 with lun 0 {{(pid=85141) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 10:38:00 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-b125fabf-ad3e-46bb-bfae-2d82a33304eb tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=85141) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 10:38:00 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:38:00 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.015s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:38:00 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[e92174c1-061d-4237-bd98-501c8c35f6c8]: (4, ('- - 0', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:38:00 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-b125fabf-ad3e-46bb-bfae-2d82a33304eb tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Searching for a device in session 57 and hctl ['34', '*', '*', 0] yield: None {{(pid=85141) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 10:38:01 user nova-compute[85141]: DEBUG nova.compute.manager [None req-2621efe4-b862-4783-839e-8d0f68e39573 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: d3d07af8-8d41-4b66-8cca-ab287972b17b] Start spawning the instance on the hypervisor. {{(pid=85141) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 10:38:01 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-2621efe4-b862-4783-839e-8d0f68e39573 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: d3d07af8-8d41-4b66-8cca-ab287972b17b] Creating instance directory {{(pid=85141) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 10:38:01 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-2621efe4-b862-4783-839e-8d0f68e39573 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: d3d07af8-8d41-4b66-8cca-ab287972b17b] Creating image(s)
Nov 16 10:38:01 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-2621efe4-b862-4783-839e-8d0f68e39573 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: d3d07af8-8d41-4b66-8cca-ab287972b17b] Did not create local disks {{(pid=85141) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 16 10:38:01 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-2621efe4-b862-4783-839e-8d0f68e39573 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: d3d07af8-8d41-4b66-8cca-ab287972b17b] Ensure instance console log exists: /opt/stack/data/nova/instances/d3d07af8-8d41-4b66-8cca-ab287972b17b/console.log {{(pid=85141) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 10:38:01 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-2621efe4-b862-4783-839e-8d0f68e39573 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:38:01 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-2621efe4-b862-4783-839e-8d0f68e39573 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:38:01 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-2621efe4-b862-4783-839e-8d0f68e39573 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:38:01 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-2621efe4-b862-4783-839e-8d0f68e39573 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: d3d07af8-8d41-4b66-8cca-ab287972b17b] Start _get_guest_xml network_info=[{"id": "676170ef-d4ec-4bd6-95c4-0bde0f2950f9", "address": "fa:16:3e:19:81:9f", "network": {"id": "b8ada47f-9721-4358-ac4f-0305f06dbbb8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1663922860-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aec3bb9fe5e6446590900b5adf65df0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap676170ef-d4", "ovs_interfaceid": "676170ef-d4ec-4bd6-95c4-0bde0f2950f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a1f6cb5b-4d5a-4d88-8ef9-e209bbd8891d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AEhiBdfj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd3d07af8-8d41-4b66-8cca-ab287972b17b', 'attached_at': '', 'detached_at': '', 'volume_id': 'a1f6cb5b-4d5a-4d88-8ef9-e209bbd8891d', 'serial': 'a1f6cb5b-4d5a-4d88-8ef9-e209bbd8891d'}, 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'attachment_id': '9cdd91d4-d08d-475f-a1eb-a0ac8e4646cb', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=85141) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 10:38:01 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-2621efe4-b862-4783-839e-8d0f68e39573 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:38:01 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-2621efe4-b862-4783-839e-8d0f68e39573 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:38:01 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-2621efe4-b862-4783-839e-8d0f68e39573 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=85141) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 10:38:01 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-2621efe4-b862-4783-839e-8d0f68e39573 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] CPU controller missing on host. {{(pid=85141) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 10:38:01 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-2621efe4-b862-4783-839e-8d0f68e39573 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=85141) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 10:38:01 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-2621efe4-b862-4783-839e-8d0f68e39573 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] CPU controller found on host. {{(pid=85141) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 10:38:01 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-2621efe4-b862-4783-839e-8d0f68e39573 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=85141) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 10:38:01 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-2621efe4-b862-4783-839e-8d0f68e39573 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T10:06:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 10:38:01 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-2621efe4-b862-4783-839e-8d0f68e39573 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Flavor limits 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 10:38:01 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-2621efe4-b862-4783-839e-8d0f68e39573 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Image limits 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 10:38:01 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-2621efe4-b862-4783-839e-8d0f68e39573 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Flavor pref 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 10:38:01 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-2621efe4-b862-4783-839e-8d0f68e39573 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Image pref 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 10:38:01 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-2621efe4-b862-4783-839e-8d0f68e39573 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 10:38:01 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-2621efe4-b862-4783-839e-8d0f68e39573 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 10:38:01 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-2621efe4-b862-4783-839e-8d0f68e39573 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=85141) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 10:38:01 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-2621efe4-b862-4783-839e-8d0f68e39573 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Got 1 possible topologies {{(pid=85141) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 10:38:01 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-2621efe4-b862-4783-839e-8d0f68e39573 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 10:38:01 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-2621efe4-b862-4783-839e-8d0f68e39573 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 10:38:01 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2621efe4-b862-4783-839e-8d0f68e39573 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: d3d07af8-8d41-4b66-8cca-ab287972b17b] Calling os-brick to attach iSCSI Volume {{(pid=85141) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 10:38:01 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-2621efe4-b862-4783-839e-8d0f68e39573 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51806b6080>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a1f6cb5b-4d5a-4d88-8ef9-e209bbd8891d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AEhiBdfj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 10:38:01 user nova-compute[85141]: WARNING os_brick.initiator.connectors.base [None req-2621efe4-b862-4783-839e-8d0f68e39573 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 10:38:01 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-2621efe4-b862-4783-839e-8d0f68e39573 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 10:38:01 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-b125fabf-ad3e-46bb-bfae-2d82a33304eb tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Searching for a device in session 57 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=85141) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 10:38:01 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-b125fabf-ad3e-46bb-bfae-2d82a33304eb tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:e4a263d9-1e4d-41e1-80f5-f9ab2bf72b99', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zaTfvtiE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=85141) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 10:38:01 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-b125fabf-ad3e-46bb-bfae-2d82a33304eb tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.296s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 10:38:01 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-b125fabf-ad3e-46bb-bfae-2d82a33304eb tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] <== connect_volume: return (1297ms) {'type': 'block', 'scsi_wwn': '26130393535323364', 'path': '/dev/sdc'} {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 10:38:01 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b125fabf-ad3e-46bb-bfae-2d82a33304eb tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] [instance: 1e01e0e9-5eef-4af4-8633-814d59860b8d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26130393535323364', 'path': '/dev/sdc'} {{(pid=85141) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 10:38:01 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-2621efe4-b862-4783-839e-8d0f68e39573 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.207s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 10:38:01 user nova-compute[85141]: WARNING os_brick.initiator.connectors.base [None req-2621efe4-b862-4783-839e-8d0f68e39573 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 10:38:01 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-2621efe4-b862-4783-839e-8d0f68e39573 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a1f6cb5b-4d5a-4d88-8ef9-e209bbd8891d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 10:38:01 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-2621efe4-b862-4783-839e-8d0f68e39573 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a1f6cb5b-4d5a-4d88-8ef9-e209bbd8891d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 10:38:01 user nova-compute[85141]: INFO os_brick.initiator.connectors.iscsi [None req-2621efe4-b862-4783-839e-8d0f68e39573 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 10:38:01 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1f6cb5b-4d5a-4d88-8ef9-e209bbd8891d -p 172.16.0.220:3260 {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:38:01 user nova-compute[85141]: DEBUG nova.objects.instance [None req-b125fabf-ad3e-46bb-bfae-2d82a33304eb tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Lazy-loading 'flavor' on Instance uuid 1e01e0e9-5eef-4af4-8633-814d59860b8d {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:38:01 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1f6cb5b-4d5a-4d88-8ef9-e209bbd8891d -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:38:01 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd7166a8-a38c-425e-9150-dee37bd10265]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:38:01 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-2621efe4-b862-4783-839e-8d0f68e39573 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 10:38:01 user nova-compute[85141]:  {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:38:01 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1f6cb5b-4d5a-4d88-8ef9-e209bbd8891d -p 172.16.0.220:3260 --interface default --op new {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:38:01 user nova-compute[85141]: DEBUG nova.virt.libvirt.guest [None req-b125fabf-ad3e-46bb-bfae-2d82a33304eb tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 10:38:01 user nova-compute[85141]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 10:38:01 user nova-compute[85141]:   <source dev="/dev/sdc"/>
Nov 16 10:38:01 user nova-compute[85141]:   <target dev="vdb" bus="virtio"/>
Nov 16 10:38:01 user nova-compute[85141]:   <serial>e4a263d9-1e4d-41e1-80f5-f9ab2bf72b99</serial>
Nov 16 10:38:01 user nova-compute[85141]: </disk>
Nov 16 10:38:01 user nova-compute[85141]:  {{(pid=85141) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 10:38:01 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1f6cb5b-4d5a-4d88-8ef9-e209bbd8891d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:38:01 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[2960ba99-0cdd-4127-8b48-cb262bb48e8c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a1f6cb5b-4d5a-4d88-8ef9-e209bbd8891d] added\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:38:01 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-2621efe4-b862-4783-839e-8d0f68e39573 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a1f6cb5b-4d5a-4d88-8ef9-e209bbd8891d] added
Nov 16 10:38:01 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:38:01 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1f6cb5b-4d5a-4d88-8ef9-e209bbd8891d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:38:01 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1f6cb5b-4d5a-4d88-8ef9-e209bbd8891d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:38:01 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bdb3525-edc3-4dcf-82bd-c93f6e9d8f0d]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:38:01 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-2621efe4-b862-4783-839e-8d0f68e39573 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:38:01 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1f6cb5b-4d5a-4d88-8ef9-e209bbd8891d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:38:01 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1f6cb5b-4d5a-4d88-8ef9-e209bbd8891d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:38:01 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9e7c432-5202-4c94-9d01-fa048643fd87]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:38:01 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-2621efe4-b862-4783-839e-8d0f68e39573 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:38:01 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1f6cb5b-4d5a-4d88-8ef9-e209bbd8891d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AEhiBdfj {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:38:01 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1f6cb5b-4d5a-4d88-8ef9-e209bbd8891d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AEhiBdfj" returned: 0 in 0.016s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:38:01 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdfb892a-4f04-472a-aba6-9b0ca23ffe8e]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:38:01 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-2621efe4-b862-4783-839e-8d0f68e39573 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AEhiBdfj'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:38:01 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1f6cb5b-4d5a-4d88-8ef9-e209bbd8891d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:38:01 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1f6cb5b-4d5a-4d88-8ef9-e209bbd8891d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:38:01 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb827afd-e2fe-4668-aab6-387275b6da04]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:38:01 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-2621efe4-b862-4783-839e-8d0f68e39573 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:38:01 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:38:01 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:38:01 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c85f24f-3e1b-4cef-85d2-7a7f20d51a76]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:584dd8df-f6a2-4e35-be7e-8de1e759491b (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4a263d9-1e4d-41e1-80f5-f9ab2bf72b99 (non-flash)\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:38:01 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-2621efe4-b862-4783-839e-8d0f68e39573 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:584dd8df-f6a2-4e35-be7e-8de1e759491b (non-flash)
Nov 16 10:38:01 user nova-compute[85141]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4a263d9-1e4d-41e1-80f5-f9ab2bf72b99 (non-flash)
Nov 16 10:38:01 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:38:01 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-2621efe4-b862-4783-839e-8d0f68e39573 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:584dd8df-f6a2-4e35-be7e-8de1e759491b (non-flash)
Nov 16 10:38:01 user nova-compute[85141]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4a263d9-1e4d-41e1-80f5-f9ab2bf72b99 (non-flash)
Nov 16 10:38:01 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 10:38:01 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1f6cb5b-4d5a-4d88-8ef9-e209bbd8891d -p 172.16.0.220:3260 --login {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:38:01 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1f6cb5b-4d5a-4d88-8ef9-e209bbd8891d -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:38:01 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e67ade8-37bd-4dcc-9cb4-94d67a1dd99a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a1f6cb5b-4d5a-4d88-8ef9-e209bbd8891d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a1f6cb5b-4d5a-4d88-8ef9-e209bbd8891d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:38:01 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-2621efe4-b862-4783-839e-8d0f68e39573 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a1f6cb5b-4d5a-4d88-8ef9-e209bbd8891d, portal: 172.16.0.220,3260]
Nov 16 10:38:01 user nova-compute[85141]: Login to [iface: default, target: iqn.2010-10.org.openstack:a1f6cb5b-4d5a-4d88-8ef9-e209bbd8891d, portal: 172.16.0.220,3260] successful.
Nov 16 10:38:01 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:38:01 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1f6cb5b-4d5a-4d88-8ef9-e209bbd8891d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:38:01 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1f6cb5b-4d5a-4d88-8ef9-e209bbd8891d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:38:01 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[d926b8b1-a428-4d9c-8cf3-76fb84ca3fc7]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:38:01 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-2621efe4-b862-4783-839e-8d0f68e39573 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:38:01 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:38:01 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:38:01 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e6d9f28-3dd9-4f80-aa33-104ff33a0212]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:584dd8df-f6a2-4e35-be7e-8de1e759491b (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4a263d9-1e4d-41e1-80f5-f9ab2bf72b99 (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1f6cb5b-4d5a-4d88-8ef9-e209bbd8891d (non-flash)\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:38:01 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-2621efe4-b862-4783-839e-8d0f68e39573 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:584dd8df-f6a2-4e35-be7e-8de1e759491b (non-flash)
Nov 16 10:38:01 user nova-compute[85141]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4a263d9-1e4d-41e1-80f5-f9ab2bf72b99 (non-flash)
Nov 16 10:38:01 user nova-compute[85141]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1f6cb5b-4d5a-4d88-8ef9-e209bbd8891d (non-flash)
Nov 16 10:38:01 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:38:01 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-2621efe4-b862-4783-839e-8d0f68e39573 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:584dd8df-f6a2-4e35-be7e-8de1e759491b (non-flash)
Nov 16 10:38:01 user nova-compute[85141]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4a263d9-1e4d-41e1-80f5-f9ab2bf72b99 (non-flash)
Nov 16 10:38:01 user nova-compute[85141]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1f6cb5b-4d5a-4d88-8ef9-e209bbd8891d (non-flash)
Nov 16 10:38:01 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 10:38:01 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-2621efe4-b862-4783-839e-8d0f68e39573 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a1f6cb5b-4d5a-4d88-8ef9-e209bbd8891d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.254s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 10:38:01 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-2621efe4-b862-4783-839e-8d0f68e39573 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Connected to 172.16.0.220:3260 {{(pid=85141) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 10:38:01 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-2621efe4-b862-4783-839e-8d0f68e39573 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] HCTL ('35', '-', '-', 0) found on session 58 with lun 0 {{(pid=85141) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 10:38:01 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-2621efe4-b862-4783-839e-8d0f68e39573 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=85141) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 10:38:01 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:38:01 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.015s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:38:01 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[173be67c-4bc8-49d1-a840-9f51810dabda]: (4, ('- - 0', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:38:01 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-2621efe4-b862-4783-839e-8d0f68e39573 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Searching for a device in session 58 and hctl ['35', '*', '*', 0] yield: None {{(pid=85141) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 10:38:02 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-b125fabf-ad3e-46bb-bfae-2d82a33304eb tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] No BDM found with device name vda, not building metadata. {{(pid=85141) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 10:38:02 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-b125fabf-ad3e-46bb-bfae-2d82a33304eb tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] No BDM found with device name vdb, not building metadata. {{(pid=85141) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 10:38:02 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-b125fabf-ad3e-46bb-bfae-2d82a33304eb tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] No VIF found with MAC fa:16:3e:40:7a:69, not building metadata {{(pid=85141) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 10:38:02 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-b125fabf-ad3e-46bb-bfae-2d82a33304eb tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Lock "1e01e0e9-5eef-4af4-8633-814d59860b8d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.899s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:38:02 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-2621efe4-b862-4783-839e-8d0f68e39573 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Searching for a device in session 58 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=85141) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 10:38:02 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-2621efe4-b862-4783-839e-8d0f68e39573 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:a1f6cb5b-4d5a-4d88-8ef9-e209bbd8891d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AEhiBdfj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=85141) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 10:38:02 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-2621efe4-b862-4783-839e-8d0f68e39573 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.282s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 10:38:02 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-2621efe4-b862-4783-839e-8d0f68e39573 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] <== connect_volume: return (1489ms) {'type': 'block', 'scsi_wwn': '23164643166323138', 'path': '/dev/sdd'} {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 10:38:02 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2621efe4-b862-4783-839e-8d0f68e39573 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: d3d07af8-8d41-4b66-8cca-ab287972b17b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23164643166323138', 'path': '/dev/sdd'} {{(pid=85141) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 10:38:02 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-2621efe4-b862-4783-839e-8d0f68e39573 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T10:37:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1713825540',display_name='tempest-TestVolumeBootPattern-server-1713825540',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1713825540',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK2tiQ/yBbFjZdjBIR2tKrAVD3soVHRqo5J6ZL2tZkf+/CHlij0TJEEFuVTAcbccfWNw+REn7xM/u4NrsIPLxGXc8EfsNWZLl3/YiEOdS+xhO6c08a6foGqxQYJ8pZUDrQ==',key_name='tempest-TestVolumeBootPattern-1363391981',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aec3bb9fe5e6446590900b5adf65df0f',ramdisk_id='',reservation_id='r-5ajvf2hq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1979039357',owner_user_name='tempest-TestVolumeBootPattern-1979039357-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T10:37:56Z,user_data=None,user_id='7261b57c36904fcda87a9ea32d4b5b31',uuid=d3d07af8-8d41-4b66-8cca-ab287972b17b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "676170ef-d4ec-4bd6-95c4-0bde0f2950f9", "address": "fa:16:3e:19:81:9f", "network": {"id": "b8ada47f-9721-4358-ac4f-0305f06dbbb8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1663922860-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aec3bb9fe5e6446590900b5adf65df0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap676170ef-d4", "ovs_interfaceid": "676170ef-d4ec-4bd6-95c4-0bde0f2950f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=85141) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 10:38:02 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-2621efe4-b862-4783-839e-8d0f68e39573 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Converting VIF {"id": "676170ef-d4ec-4bd6-95c4-0bde0f2950f9", "address": "fa:16:3e:19:81:9f", "network": {"id": "b8ada47f-9721-4358-ac4f-0305f06dbbb8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1663922860-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aec3bb9fe5e6446590900b5adf65df0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap676170ef-d4", "ovs_interfaceid": "676170ef-d4ec-4bd6-95c4-0bde0f2950f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:38:02 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-2621efe4-b862-4783-839e-8d0f68e39573 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:19:81:9f,bridge_name='br-int',has_traffic_filtering=True,id=676170ef-d4ec-4bd6-95c4-0bde0f2950f9,network=Network(b8ada47f-9721-4358-ac4f-0305f06dbbb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap676170ef-d4') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:38:02 user nova-compute[85141]: DEBUG nova.objects.instance [None req-2621efe4-b862-4783-839e-8d0f68e39573 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Lazy-loading 'pci_devices' on Instance uuid d3d07af8-8d41-4b66-8cca-ab287972b17b {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:38:02 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-2621efe4-b862-4783-839e-8d0f68e39573 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: d3d07af8-8d41-4b66-8cca-ab287972b17b] End _get_guest_xml xml=<domain type="kvm">
Nov 16 10:38:02 user nova-compute[85141]:   <uuid>d3d07af8-8d41-4b66-8cca-ab287972b17b</uuid>
Nov 16 10:38:02 user nova-compute[85141]:   <name>instance-00000032</name>
Nov 16 10:38:02 user nova-compute[85141]:   <memory>524288</memory>
Nov 16 10:38:02 user nova-compute[85141]:   <vcpu>1</vcpu>
Nov 16 10:38:02 user nova-compute[85141]:   <metadata>
Nov 16 10:38:02 user nova-compute[85141]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 10:38:02 user nova-compute[85141]:       <nova:package version="0.0.0"/>
Nov 16 10:38:02 user nova-compute[85141]:       <nova:name>tempest-TestVolumeBootPattern-server-1713825540</nova:name>
Nov 16 10:38:02 user nova-compute[85141]:       <nova:creationTime>2023-11-16 10:38:01</nova:creationTime>
Nov 16 10:38:02 user nova-compute[85141]:       <nova:flavor name="m1.tiny">
Nov 16 10:38:02 user nova-compute[85141]:         <nova:memory>512</nova:memory>
Nov 16 10:38:02 user nova-compute[85141]:         <nova:disk>1</nova:disk>
Nov 16 10:38:02 user nova-compute[85141]:         <nova:swap>0</nova:swap>
Nov 16 10:38:02 user nova-compute[85141]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 10:38:02 user nova-compute[85141]:         <nova:vcpus>1</nova:vcpus>
Nov 16 10:38:02 user nova-compute[85141]:       </nova:flavor>
Nov 16 10:38:02 user nova-compute[85141]:       <nova:owner>
Nov 16 10:38:02 user nova-compute[85141]:         <nova:user uuid="7261b57c36904fcda87a9ea32d4b5b31">tempest-TestVolumeBootPattern-1979039357-project-member</nova:user>
Nov 16 10:38:02 user nova-compute[85141]:         <nova:project uuid="aec3bb9fe5e6446590900b5adf65df0f">tempest-TestVolumeBootPattern-1979039357</nova:project>
Nov 16 10:38:02 user nova-compute[85141]:       </nova:owner>
Nov 16 10:38:02 user nova-compute[85141]:       <nova:ports>
Nov 16 10:38:02 user nova-compute[85141]:         <nova:port uuid="676170ef-d4ec-4bd6-95c4-0bde0f2950f9">
Nov 16 10:38:02 user nova-compute[85141]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 16 10:38:02 user nova-compute[85141]:         </nova:port>
Nov 16 10:38:02 user nova-compute[85141]:       </nova:ports>
Nov 16 10:38:02 user nova-compute[85141]:     </nova:instance>
Nov 16 10:38:02 user nova-compute[85141]:   </metadata>
Nov 16 10:38:02 user nova-compute[85141]:   <sysinfo type="smbios">
Nov 16 10:38:02 user nova-compute[85141]:     <system>
Nov 16 10:38:02 user nova-compute[85141]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 10:38:02 user nova-compute[85141]:       <entry name="product">OpenStack Nova</entry>
Nov 16 10:38:02 user nova-compute[85141]:       <entry name="version">0.0.0</entry>
Nov 16 10:38:02 user nova-compute[85141]:       <entry name="serial">d3d07af8-8d41-4b66-8cca-ab287972b17b</entry>
Nov 16 10:38:02 user nova-compute[85141]:       <entry name="uuid">d3d07af8-8d41-4b66-8cca-ab287972b17b</entry>
Nov 16 10:38:02 user nova-compute[85141]:       <entry name="family">Virtual Machine</entry>
Nov 16 10:38:02 user nova-compute[85141]:     </system>
Nov 16 10:38:02 user nova-compute[85141]:   </sysinfo>
Nov 16 10:38:02 user nova-compute[85141]:   <os>
Nov 16 10:38:02 user nova-compute[85141]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 10:38:02 user nova-compute[85141]:     <boot dev="hd"/>
Nov 16 10:38:02 user nova-compute[85141]:     <smbios mode="sysinfo"/>
Nov 16 10:38:02 user nova-compute[85141]:   </os>
Nov 16 10:38:02 user nova-compute[85141]:   <features>
Nov 16 10:38:02 user nova-compute[85141]:     <acpi/>
Nov 16 10:38:02 user nova-compute[85141]:     <apic/>
Nov 16 10:38:02 user nova-compute[85141]:     <vmcoreinfo/>
Nov 16 10:38:02 user nova-compute[85141]:   </features>
Nov 16 10:38:02 user nova-compute[85141]:   <clock offset="utc">
Nov 16 10:38:02 user nova-compute[85141]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 10:38:02 user nova-compute[85141]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 10:38:02 user nova-compute[85141]:     <timer name="hpet" present="no"/>
Nov 16 10:38:02 user nova-compute[85141]:   </clock>
Nov 16 10:38:02 user nova-compute[85141]:   <cpu mode="custom" match="exact">
Nov 16 10:38:02 user nova-compute[85141]:     <model>Nehalem</model>
Nov 16 10:38:02 user nova-compute[85141]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 10:38:02 user nova-compute[85141]:   </cpu>
Nov 16 10:38:02 user nova-compute[85141]:   <devices>
Nov 16 10:38:02 user nova-compute[85141]:     <disk type="block" device="disk">
Nov 16 10:38:02 user nova-compute[85141]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 10:38:02 user nova-compute[85141]:       <source dev="/dev/sdd"/>
Nov 16 10:38:02 user nova-compute[85141]:       <target dev="vda" bus="virtio"/>
Nov 16 10:38:02 user nova-compute[85141]:       <serial>a1f6cb5b-4d5a-4d88-8ef9-e209bbd8891d</serial>
Nov 16 10:38:02 user nova-compute[85141]:     </disk>
Nov 16 10:38:02 user nova-compute[85141]:     <interface type="ethernet">
Nov 16 10:38:02 user nova-compute[85141]:       <mac address="fa:16:3e:19:81:9f"/>
Nov 16 10:38:02 user nova-compute[85141]:       <model type="virtio"/>
Nov 16 10:38:02 user nova-compute[85141]:       <mtu size="1442"/>
Nov 16 10:38:02 user nova-compute[85141]:       <target dev="tap676170ef-d4"/>
Nov 16 10:38:02 user nova-compute[85141]:     </interface>
Nov 16 10:38:02 user nova-compute[85141]:     <serial type="pty">
Nov 16 10:38:02 user nova-compute[85141]:       <log file="/opt/stack/data/nova/instances/d3d07af8-8d41-4b66-8cca-ab287972b17b/console.log" append="off"/>
Nov 16 10:38:02 user nova-compute[85141]:     </serial>
Nov 16 10:38:02 user nova-compute[85141]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 10:38:02 user nova-compute[85141]:     <video>
Nov 16 10:38:02 user nova-compute[85141]:       <model type="virtio"/>
Nov 16 10:38:02 user nova-compute[85141]:     </video>
Nov 16 10:38:02 user nova-compute[85141]:     <rng model="virtio">
Nov 16 10:38:02 user nova-compute[85141]:       <backend model="random">/dev/urandom</backend>
Nov 16 10:38:02 user nova-compute[85141]:     </rng>
Nov 16 10:38:02 user nova-compute[85141]:     <controller type="usb" index="0" model="none"/>
Nov 16 10:38:02 user nova-compute[85141]:     <memballoon model="virtio">
Nov 16 10:38:02 user nova-compute[85141]:       <stats period="10"/>
Nov 16 10:38:02 user nova-compute[85141]:     </memballoon>
Nov 16 10:38:02 user nova-compute[85141]:   </devices>
Nov 16 10:38:02 user nova-compute[85141]: </domain>
Nov 16 10:38:02 user nova-compute[85141]:  {{(pid=85141) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 10:38:02 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-2621efe4-b862-4783-839e-8d0f68e39573 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T10:37:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1713825540',display_name='tempest-TestVolumeBootPattern-server-1713825540',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1713825540',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK2tiQ/yBbFjZdjBIR2tKrAVD3soVHRqo5J6ZL2tZkf+/CHlij0TJEEFuVTAcbccfWNw+REn7xM/u4NrsIPLxGXc8EfsNWZLl3/YiEOdS+xhO6c08a6foGqxQYJ8pZUDrQ==',key_name='tempest-TestVolumeBootPattern-1363391981',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aec3bb9fe5e6446590900b5adf65df0f',ramdisk_id='',reservation_id='r-5ajvf2hq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1979039357',owner_user_name='tempest-TestVolumeBootPattern-1979039357-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T10:37:56Z,user_data=None,user_id='7261b57c36904fcda87a9ea32d4b5b31',uuid=d3d07af8-8d41-4b66-8cca-ab287972b17b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "676170ef-d4ec-4bd6-95c4-0bde0f2950f9", "address": "fa:16:3e:19:81:9f", "network": {"id": "b8ada47f-9721-4358-ac4f-0305f06dbbb8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1663922860-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aec3bb9fe5e6446590900b5adf65df0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap676170ef-d4", "ovs_interfaceid": "676170ef-d4ec-4bd6-95c4-0bde0f2950f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 10:38:02 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-2621efe4-b862-4783-839e-8d0f68e39573 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Converting VIF {"id": "676170ef-d4ec-4bd6-95c4-0bde0f2950f9", "address": "fa:16:3e:19:81:9f", "network": {"id": "b8ada47f-9721-4358-ac4f-0305f06dbbb8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1663922860-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aec3bb9fe5e6446590900b5adf65df0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap676170ef-d4", "ovs_interfaceid": "676170ef-d4ec-4bd6-95c4-0bde0f2950f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:38:02 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-2621efe4-b862-4783-839e-8d0f68e39573 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:19:81:9f,bridge_name='br-int',has_traffic_filtering=True,id=676170ef-d4ec-4bd6-95c4-0bde0f2950f9,network=Network(b8ada47f-9721-4358-ac4f-0305f06dbbb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap676170ef-d4') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:38:02 user nova-compute[85141]: DEBUG os_vif [None req-2621efe4-b862-4783-839e-8d0f68e39573 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:19:81:9f,bridge_name='br-int',has_traffic_filtering=True,id=676170ef-d4ec-4bd6-95c4-0bde0f2950f9,network=Network(b8ada47f-9721-4358-ac4f-0305f06dbbb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap676170ef-d4') {{(pid=85141) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 10:38:02 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:38:02 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:38:02 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 10:38:02 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:38:02 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1c32a2e0-4b02-5d69-949c-c5192698b03b', '_type': 'linux-noop'}}, row=False) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:38:02 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:38:02 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:38:02 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:38:02 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap676170ef-d4, may_exist=True, interface_attrs={}) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:38:02 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap676170ef-d4, col_values=(('qos', UUID('121a53ff-2619-4dee-bc21-b594e857bf1b')),), if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:38:02 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap676170ef-d4, col_values=(('external_ids', {'iface-id': '676170ef-d4ec-4bd6-95c4-0bde0f2950f9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:19:81:9f', 'vm-uuid': 'd3d07af8-8d41-4b66-8cca-ab287972b17b'}),), if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:38:02 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:38:02 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:38:02 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:38:03 user nova-compute[85141]: INFO os_vif [None req-2621efe4-b862-4783-839e-8d0f68e39573 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:19:81:9f,bridge_name='br-int',has_traffic_filtering=True,id=676170ef-d4ec-4bd6-95c4-0bde0f2950f9,network=Network(b8ada47f-9721-4358-ac4f-0305f06dbbb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap676170ef-d4')
Nov 16 10:38:03 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-2621efe4-b862-4783-839e-8d0f68e39573 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] No BDM found with device name vda, not building metadata. {{(pid=85141) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 10:38:03 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-2621efe4-b862-4783-839e-8d0f68e39573 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] No VIF found with MAC fa:16:3e:19:81:9f, not building metadata {{(pid=85141) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 10:38:03 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:38:04 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:38:04 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:38:04 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:38:04 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-2a36870d-115b-4a0a-ad41-79fea09a0d01 tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Acquiring lock "1e01e0e9-5eef-4af4-8633-814d59860b8d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:38:04 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-2a36870d-115b-4a0a-ad41-79fea09a0d01 tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Lock "1e01e0e9-5eef-4af4-8633-814d59860b8d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:38:04 user nova-compute[85141]: INFO nova.compute.manager [None req-2a36870d-115b-4a0a-ad41-79fea09a0d01 tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] [instance: 1e01e0e9-5eef-4af4-8633-814d59860b8d] Detaching volume e4a263d9-1e4d-41e1-80f5-f9ab2bf72b99
Nov 16 10:38:04 user nova-compute[85141]: DEBUG nova.compute.manager [req-257a3021-b5ec-4383-aabb-3dd463ac28b6 req-d8ef0628-3270-414b-9063-f96fd793d3c3 service nova] [instance: d3d07af8-8d41-4b66-8cca-ab287972b17b] Received event network-vif-plugged-676170ef-d4ec-4bd6-95c4-0bde0f2950f9 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:38:04 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-257a3021-b5ec-4383-aabb-3dd463ac28b6 req-d8ef0628-3270-414b-9063-f96fd793d3c3 service nova] Acquiring lock "d3d07af8-8d41-4b66-8cca-ab287972b17b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:38:04 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-257a3021-b5ec-4383-aabb-3dd463ac28b6 req-d8ef0628-3270-414b-9063-f96fd793d3c3 service nova] Lock "d3d07af8-8d41-4b66-8cca-ab287972b17b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:38:04 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-257a3021-b5ec-4383-aabb-3dd463ac28b6 req-d8ef0628-3270-414b-9063-f96fd793d3c3 service nova] Lock "d3d07af8-8d41-4b66-8cca-ab287972b17b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:38:04 user nova-compute[85141]: DEBUG nova.compute.manager [req-257a3021-b5ec-4383-aabb-3dd463ac28b6 req-d8ef0628-3270-414b-9063-f96fd793d3c3 service nova] [instance: d3d07af8-8d41-4b66-8cca-ab287972b17b] No waiting events found dispatching network-vif-plugged-676170ef-d4ec-4bd6-95c4-0bde0f2950f9 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:38:04 user nova-compute[85141]: WARNING nova.compute.manager [req-257a3021-b5ec-4383-aabb-3dd463ac28b6 req-d8ef0628-3270-414b-9063-f96fd793d3c3 service nova] [instance: d3d07af8-8d41-4b66-8cca-ab287972b17b] Received unexpected event network-vif-plugged-676170ef-d4ec-4bd6-95c4-0bde0f2950f9 for instance with vm_state building and task_state spawning.
Nov 16 10:38:04 user nova-compute[85141]: INFO nova.virt.block_device [None req-2a36870d-115b-4a0a-ad41-79fea09a0d01 tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] [instance: 1e01e0e9-5eef-4af4-8633-814d59860b8d] Attempting to driver detach volume e4a263d9-1e4d-41e1-80f5-f9ab2bf72b99 from mountpoint /dev/vdb
Nov 16 10:38:04 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-2a36870d-115b-4a0a-ad41-79fea09a0d01 tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Attempting to detach device vdb from instance 1e01e0e9-5eef-4af4-8633-814d59860b8d from the persistent domain config. {{(pid=85141) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 10:38:04 user nova-compute[85141]: DEBUG nova.virt.libvirt.guest [None req-2a36870d-115b-4a0a-ad41-79fea09a0d01 tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 10:38:04 user nova-compute[85141]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 10:38:04 user nova-compute[85141]:   <source dev="/dev/sdc"/>
Nov 16 10:38:04 user nova-compute[85141]:   <target dev="vdb" bus="virtio"/>
Nov 16 10:38:04 user nova-compute[85141]:   <serial>e4a263d9-1e4d-41e1-80f5-f9ab2bf72b99</serial>
Nov 16 10:38:04 user nova-compute[85141]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 10:38:04 user nova-compute[85141]: </disk>
Nov 16 10:38:04 user nova-compute[85141]:  {{(pid=85141) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 10:38:04 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-2a36870d-115b-4a0a-ad41-79fea09a0d01 tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Successfully detached device vdb from instance 1e01e0e9-5eef-4af4-8633-814d59860b8d from the persistent domain config.
Nov 16 10:38:04 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-2a36870d-115b-4a0a-ad41-79fea09a0d01 tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 1e01e0e9-5eef-4af4-8633-814d59860b8d from the live domain config. {{(pid=85141) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 10:38:04 user nova-compute[85141]: DEBUG nova.virt.libvirt.guest [None req-2a36870d-115b-4a0a-ad41-79fea09a0d01 tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 10:38:04 user nova-compute[85141]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 10:38:04 user nova-compute[85141]:   <source dev="/dev/sdc"/>
Nov 16 10:38:04 user nova-compute[85141]:   <target dev="vdb" bus="virtio"/>
Nov 16 10:38:04 user nova-compute[85141]:   <serial>e4a263d9-1e4d-41e1-80f5-f9ab2bf72b99</serial>
Nov 16 10:38:04 user nova-compute[85141]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 10:38:04 user nova-compute[85141]: </disk>
Nov 16 10:38:04 user nova-compute[85141]:  {{(pid=85141) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 10:38:04 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:38:04 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-2a36870d-115b-4a0a-ad41-79fea09a0d01 tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 1e01e0e9-5eef-4af4-8633-814d59860b8d {{(pid=85141) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 10:38:06 user nova-compute[85141]: DEBUG nova.compute.manager [req-5db2c894-a632-47e3-a1ff-5f73432fb507 req-ae13d92f-e9a4-4154-914e-e4053c0f6ed3 service nova] [instance: d3d07af8-8d41-4b66-8cca-ab287972b17b] Received event network-vif-plugged-676170ef-d4ec-4bd6-95c4-0bde0f2950f9 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:38:06 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-5db2c894-a632-47e3-a1ff-5f73432fb507 req-ae13d92f-e9a4-4154-914e-e4053c0f6ed3 service nova] Acquiring lock "d3d07af8-8d41-4b66-8cca-ab287972b17b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:38:06 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-5db2c894-a632-47e3-a1ff-5f73432fb507 req-ae13d92f-e9a4-4154-914e-e4053c0f6ed3 service nova] Lock "d3d07af8-8d41-4b66-8cca-ab287972b17b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:38:06 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-5db2c894-a632-47e3-a1ff-5f73432fb507 req-ae13d92f-e9a4-4154-914e-e4053c0f6ed3 service nova] Lock "d3d07af8-8d41-4b66-8cca-ab287972b17b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:38:06 user nova-compute[85141]: DEBUG nova.compute.manager [req-5db2c894-a632-47e3-a1ff-5f73432fb507 req-ae13d92f-e9a4-4154-914e-e4053c0f6ed3 service nova] [instance: d3d07af8-8d41-4b66-8cca-ab287972b17b] No waiting events found dispatching network-vif-plugged-676170ef-d4ec-4bd6-95c4-0bde0f2950f9 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:38:06 user nova-compute[85141]: WARNING nova.compute.manager [req-5db2c894-a632-47e3-a1ff-5f73432fb507 req-ae13d92f-e9a4-4154-914e-e4053c0f6ed3 service nova] [instance: d3d07af8-8d41-4b66-8cca-ab287972b17b] Received unexpected event network-vif-plugged-676170ef-d4ec-4bd6-95c4-0bde0f2950f9 for instance with vm_state building and task_state spawning.
Nov 16 10:38:06 user nova-compute[85141]: DEBUG nova.compute.manager [None req-2621efe4-b862-4783-839e-8d0f68e39573 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: d3d07af8-8d41-4b66-8cca-ab287972b17b] Instance event wait completed in 0 seconds for  {{(pid=85141) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 10:38:06 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-2621efe4-b862-4783-839e-8d0f68e39573 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: d3d07af8-8d41-4b66-8cca-ab287972b17b] Guest created on hypervisor {{(pid=85141) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 10:38:06 user nova-compute[85141]: INFO nova.virt.libvirt.driver [-] [instance: d3d07af8-8d41-4b66-8cca-ab287972b17b] Instance spawned successfully.
Nov 16 10:38:06 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-2621efe4-b862-4783-839e-8d0f68e39573 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: d3d07af8-8d41-4b66-8cca-ab287972b17b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 10:38:06 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-2621efe4-b862-4783-839e-8d0f68e39573 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: d3d07af8-8d41-4b66-8cca-ab287972b17b] Found default for hw_cdrom_bus of ide {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:38:06 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-2621efe4-b862-4783-839e-8d0f68e39573 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: d3d07af8-8d41-4b66-8cca-ab287972b17b] Found default for hw_disk_bus of virtio {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:38:06 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-2621efe4-b862-4783-839e-8d0f68e39573 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: d3d07af8-8d41-4b66-8cca-ab287972b17b] Found default for hw_input_bus of None {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:38:06 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-2621efe4-b862-4783-839e-8d0f68e39573 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: d3d07af8-8d41-4b66-8cca-ab287972b17b] Found default for hw_pointer_model of None {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:38:06 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-2621efe4-b862-4783-839e-8d0f68e39573 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: d3d07af8-8d41-4b66-8cca-ab287972b17b] Found default for hw_video_model of virtio {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:38:06 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-2621efe4-b862-4783-839e-8d0f68e39573 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: d3d07af8-8d41-4b66-8cca-ab287972b17b] Found default for hw_vif_model of virtio {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:38:06 user nova-compute[85141]: INFO nova.compute.manager [None req-2621efe4-b862-4783-839e-8d0f68e39573 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: d3d07af8-8d41-4b66-8cca-ab287972b17b] Took 5.23 seconds to spawn the instance on the hypervisor.
Nov 16 10:38:06 user nova-compute[85141]: DEBUG nova.compute.manager [None req-2621efe4-b862-4783-839e-8d0f68e39573 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: d3d07af8-8d41-4b66-8cca-ab287972b17b] Checking state {{(pid=85141) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 10:38:06 user nova-compute[85141]: INFO nova.compute.manager [None req-2621efe4-b862-4783-839e-8d0f68e39573 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: d3d07af8-8d41-4b66-8cca-ab287972b17b] Took 10.99 seconds to build instance.
Nov 16 10:38:06 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-2621efe4-b862-4783-839e-8d0f68e39573 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Lock "d3d07af8-8d41-4b66-8cca-ab287972b17b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.092s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:38:07 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:38:08 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:38:12 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:38:17 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:38:17 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:38:18 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=85141) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 10:38:18 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=85141) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 10:38:18 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=85141) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 10:38:18 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:38:23 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:38:23 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:38:24 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-2a36870d-115b-4a0a-ad41-79fea09a0d01 tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 1e01e0e9-5eef-4af4-8633-814d59860b8d is timed out.
Nov 16 10:38:24 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-2a36870d-115b-4a0a-ad41-79fea09a0d01 tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Successfully detached device vdb from instance 1e01e0e9-5eef-4af4-8633-814d59860b8d from the live domain config.
Nov 16 10:38:24 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2a36870d-115b-4a0a-ad41-79fea09a0d01 tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] [instance: 1e01e0e9-5eef-4af4-8633-814d59860b8d] calling os-brick to detach iSCSI Volume {{(pid=85141) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 10:38:24 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a36870d-115b-4a0a-ad41-79fea09a0d01 tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51806b6080>, {'target_iqn': 'iqn.2010-10.org.openstack:e4a263d9-1e4d-41e1-80f5-f9ab2bf72b99', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zaTfvtiE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 10:38:24 user nova-compute[85141]: WARNING os_brick.initiator.connectors.base [None req-2a36870d-115b-4a0a-ad41-79fea09a0d01 tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 10:38:24 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-2a36870d-115b-4a0a-ad41-79fea09a0d01 tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 10:38:24 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-2a36870d-115b-4a0a-ad41-79fea09a0d01 tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 10:38:24 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:38:24 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:38:24 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2dd4dbb-616b-454b-b70b-569b8df268c3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:584dd8df-f6a2-4e35-be7e-8de1e759491b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e4a263d9-1e4d-41e1-80f5-f9ab2bf72b99\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a1f6cb5b-4d5a-4d88-8ef9-e209bbd8891d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:38:24 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a36870d-115b-4a0a-ad41-79fea09a0d01 tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 10:38:24 user nova-compute[85141]: No targets found.
Nov 16 10:38:24 user nova-compute[85141]: iSNS:
Nov 16 10:38:24 user nova-compute[85141]: No targets found.
Nov 16 10:38:24 user nova-compute[85141]: STATIC:
Nov 16 10:38:24 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:584dd8df-f6a2-4e35-be7e-8de1e759491b
Nov 16 10:38:24 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:38:24 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:38:24 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:e4a263d9-1e4d-41e1-80f5-f9ab2bf72b99
Nov 16 10:38:24 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:38:24 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:38:24 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:a1f6cb5b-4d5a-4d88-8ef9-e209bbd8891d
Nov 16 10:38:24 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:38:24 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:38:24 user nova-compute[85141]: FIRMWARE:
Nov 16 10:38:24 user nova-compute[85141]: No targets found.
Nov 16 10:38:24 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:38:24 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a36870d-115b-4a0a-ad41-79fea09a0d01 tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 10:38:24 user nova-compute[85141]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 10:38:24 user nova-compute[85141]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=85141) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 10:38:24 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a36870d-115b-4a0a-ad41-79fea09a0d01 tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e4a263d9-1e4d-41e1-80f5-f9ab2bf72b99', 0)] {{(pid=85141) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 10:38:24 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:38:24 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:38:24 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a4cada3-a63a-4084-a91e-8ec4d293f9b5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:584dd8df-f6a2-4e35-be7e-8de1e759491b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a1f6cb5b-4d5a-4d88-8ef9-e209bbd8891d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e4a263d9-1e4d-41e1-80f5-f9ab2bf72b99\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:38:24 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:38:25 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:38:25 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[fab0cc2e-fdfb-471a-a1ca-c67c5a9e3d13]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:584dd8df-f6a2-4e35-be7e-8de1e759491b (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4a263d9-1e4d-41e1-80f5-f9ab2bf72b99 (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1f6cb5b-4d5a-4d88-8ef9-e209bbd8891d (non-flash)\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:38:25 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a36870d-115b-4a0a-ad41-79fea09a0d01 tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:584dd8df-f6a2-4e35-be7e-8de1e759491b (non-flash)
Nov 16 10:38:25 user nova-compute[85141]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4a263d9-1e4d-41e1-80f5-f9ab2bf72b99 (non-flash)
Nov 16 10:38:25 user nova-compute[85141]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1f6cb5b-4d5a-4d88-8ef9-e209bbd8891d (non-flash)
Nov 16 10:38:25 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:38:25 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a36870d-115b-4a0a-ad41-79fea09a0d01 tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:584dd8df-f6a2-4e35-be7e-8de1e759491b (non-flash)
Nov 16 10:38:25 user nova-compute[85141]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4a263d9-1e4d-41e1-80f5-f9ab2bf72b99 (non-flash)
Nov 16 10:38:25 user nova-compute[85141]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1f6cb5b-4d5a-4d88-8ef9-e209bbd8891d (non-flash)
Nov 16 10:38:25 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 10:38:25 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a36870d-115b-4a0a-ad41-79fea09a0d01 tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f516073d7e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e4a263d9-1e4d-41e1-80f5-f9ab2bf72b99'): ({'sdc'}, set())}) {{(pid=85141) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 10:38:25 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-2a36870d-115b-4a0a-ad41-79fea09a0d01 tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Removing single pathed devices sdc {{(pid=85141) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 10:38:25 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:38:25 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:38:25 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[e151dbd6-1bdb-4e1a-a1f4-a9cc6de639d5]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:38:25 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:38:25 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.017s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:38:25 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c36d938-ebf6-424b-a532-f7757d1358bf]: (4, ('ok\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:38:25 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-2a36870d-115b-4a0a-ad41-79fea09a0d01 tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Flushing IO for device /dev/sdc {{(pid=85141) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 10:38:25 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:38:25 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:38:25 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee46e854-2d82-4c4b-98a7-7fcba24f9cc7]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:38:25 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-2a36870d-115b-4a0a-ad41-79fea09a0d01 tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=85141) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 10:38:25 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:38:25 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.042s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:38:25 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ce86781-ac9c-4845-9f6c-7b214a34591f]: (4, ('1', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:38:25 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-2a36870d-115b-4a0a-ad41-79fea09a0d01 tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=85141) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 10:38:25 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-2a36870d-115b-4a0a-ad41-79fea09a0d01 tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] SCSI volumes sdc have been removed. {{(pid=85141) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 10:38:25 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a36870d-115b-4a0a-ad41-79fea09a0d01 tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e4a263d9-1e4d-41e1-80f5-f9ab2bf72b99')] {{(pid=85141) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 10:38:25 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4a263d9-1e4d-41e1-80f5-f9ab2bf72b99 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:38:25 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4a263d9-1e4d-41e1-80f5-f9ab2bf72b99 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:38:25 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcc229d2-a8c9-46f2-bc3c-ba30e3fdb6a7]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:38:25 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a36870d-115b-4a0a-ad41-79fea09a0d01 tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:38:25 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4a263d9-1e4d-41e1-80f5-f9ab2bf72b99 -p 172.16.0.220:3260 --logout {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:38:25 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4a263d9-1e4d-41e1-80f5-f9ab2bf72b99 -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:38:25 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[38484b46-d68b-46bb-913f-218c733420b2]: (4, ('Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:e4a263d9-1e4d-41e1-80f5-f9ab2bf72b99, portal: 172.16.0.220,3260]\nLogout of [sid: 57, target: iqn.2010-10.org.openstack:e4a263d9-1e4d-41e1-80f5-f9ab2bf72b99, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:38:25 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a36870d-115b-4a0a-ad41-79fea09a0d01 tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:e4a263d9-1e4d-41e1-80f5-f9ab2bf72b99, portal: 172.16.0.220,3260]
Nov 16 10:38:25 user nova-compute[85141]: Logout of [sid: 57, target: iqn.2010-10.org.openstack:e4a263d9-1e4d-41e1-80f5-f9ab2bf72b99, portal: 172.16.0.220,3260] successful.
Nov 16 10:38:25 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:38:25 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4a263d9-1e4d-41e1-80f5-f9ab2bf72b99 -p 172.16.0.220:3260 --op delete {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:38:25 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4a263d9-1e4d-41e1-80f5-f9ab2bf72b99 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:38:25 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[20005e89-ffaf-43e2-96b5-0d1319576e5f]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:38:25 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a36870d-115b-4a0a-ad41-79fea09a0d01 tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:38:25 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-2a36870d-115b-4a0a-ad41-79fea09a0d01 tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.316s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 10:38:25 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a36870d-115b-4a0a-ad41-79fea09a0d01 tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] <== disconnect_volume: return (317ms) None {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 10:38:25 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2a36870d-115b-4a0a-ad41-79fea09a0d01 tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] [instance: 1e01e0e9-5eef-4af4-8633-814d59860b8d] Disconnected iSCSI Volume {{(pid=85141) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 10:38:26 user nova-compute[85141]: DEBUG nova.objects.instance [None req-2a36870d-115b-4a0a-ad41-79fea09a0d01 tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Lazy-loading 'flavor' on Instance uuid 1e01e0e9-5eef-4af4-8633-814d59860b8d {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:38:26 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-2a36870d-115b-4a0a-ad41-79fea09a0d01 tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Lock "1e01e0e9-5eef-4af4-8633-814d59860b8d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.742s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:38:28 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:38:28 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:38:28 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:38:31 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-1158df30-fc9b-4c75-ba3d-fc6a29101b3f tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Acquiring lock "3cafaf59-3cc9-4612-8da5-b2b60f8223e6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:38:31 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-1158df30-fc9b-4c75-ba3d-fc6a29101b3f tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Lock "3cafaf59-3cc9-4612-8da5-b2b60f8223e6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:38:31 user nova-compute[85141]: DEBUG nova.compute.manager [None req-1158df30-fc9b-4c75-ba3d-fc6a29101b3f tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] [instance: 3cafaf59-3cc9-4612-8da5-b2b60f8223e6] Starting instance... {{(pid=85141) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 10:38:31 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-1158df30-fc9b-4c75-ba3d-fc6a29101b3f tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:38:31 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-1158df30-fc9b-4c75-ba3d-fc6a29101b3f tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:38:31 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-1158df30-fc9b-4c75-ba3d-fc6a29101b3f tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=85141) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 10:38:31 user nova-compute[85141]: INFO nova.compute.claims [None req-1158df30-fc9b-4c75-ba3d-fc6a29101b3f tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] [instance: 3cafaf59-3cc9-4612-8da5-b2b60f8223e6] Claim successful on node user
Nov 16 10:38:31 user nova-compute[85141]: DEBUG nova.compute.provider_tree [None req-1158df30-fc9b-4c75-ba3d-fc6a29101b3f tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Inventory has not changed in ProviderTree for provider: bf8e0fa1-16b6-408f-9203-c4cd63916272 {{(pid=85141) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 10:38:31 user nova-compute[85141]: DEBUG nova.scheduler.client.report [None req-1158df30-fc9b-4c75-ba3d-fc6a29101b3f tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Inventory has not changed for provider bf8e0fa1-16b6-408f-9203-c4cd63916272 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=85141) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 10:38:31 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-1158df30-fc9b-4c75-ba3d-fc6a29101b3f tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.285s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:38:31 user nova-compute[85141]: DEBUG nova.compute.manager [None req-1158df30-fc9b-4c75-ba3d-fc6a29101b3f tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] [instance: 3cafaf59-3cc9-4612-8da5-b2b60f8223e6] Start building networks asynchronously for instance. {{(pid=85141) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 10:38:31 user nova-compute[85141]: DEBUG nova.compute.manager [None req-1158df30-fc9b-4c75-ba3d-fc6a29101b3f tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] [instance: 3cafaf59-3cc9-4612-8da5-b2b60f8223e6] Allocating IP information in the background. {{(pid=85141) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 10:38:31 user nova-compute[85141]: DEBUG nova.network.neutron [None req-1158df30-fc9b-4c75-ba3d-fc6a29101b3f tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] [instance: 3cafaf59-3cc9-4612-8da5-b2b60f8223e6] allocate_for_instance() {{(pid=85141) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 10:38:31 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-1158df30-fc9b-4c75-ba3d-fc6a29101b3f tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] [instance: 3cafaf59-3cc9-4612-8da5-b2b60f8223e6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 10:38:31 user nova-compute[85141]: DEBUG nova.compute.manager [None req-1158df30-fc9b-4c75-ba3d-fc6a29101b3f tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] [instance: 3cafaf59-3cc9-4612-8da5-b2b60f8223e6] Start building block device mappings for instance. {{(pid=85141) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 10:38:31 user nova-compute[85141]: DEBUG nova.policy [None req-1158df30-fc9b-4c75-ba3d-fc6a29101b3f tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5aa5beeeca5d4dc89cf5333942da756f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd13c6ff3c30549ca9ab44d9fc1fedc6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85141) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 10:38:31 user nova-compute[85141]: DEBUG nova.compute.manager [None req-1158df30-fc9b-4c75-ba3d-fc6a29101b3f tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] [instance: 3cafaf59-3cc9-4612-8da5-b2b60f8223e6] Start spawning the instance on the hypervisor. {{(pid=85141) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 10:38:31 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-1158df30-fc9b-4c75-ba3d-fc6a29101b3f tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] [instance: 3cafaf59-3cc9-4612-8da5-b2b60f8223e6] Creating instance directory {{(pid=85141) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 10:38:31 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-1158df30-fc9b-4c75-ba3d-fc6a29101b3f tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] [instance: 3cafaf59-3cc9-4612-8da5-b2b60f8223e6] Creating image(s)
Nov 16 10:38:31 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-1158df30-fc9b-4c75-ba3d-fc6a29101b3f tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Acquiring lock "/opt/stack/data/nova/instances/3cafaf59-3cc9-4612-8da5-b2b60f8223e6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:38:31 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-1158df30-fc9b-4c75-ba3d-fc6a29101b3f tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Lock "/opt/stack/data/nova/instances/3cafaf59-3cc9-4612-8da5-b2b60f8223e6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:38:31 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-1158df30-fc9b-4c75-ba3d-fc6a29101b3f tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Lock "/opt/stack/data/nova/instances/3cafaf59-3cc9-4612-8da5-b2b60f8223e6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:38:31 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-1158df30-fc9b-4c75-ba3d-fc6a29101b3f tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:38:32 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-1158df30-fc9b-4c75-ba3d-fc6a29101b3f tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json" returned: 0 in 0.185s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:38:32 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-1158df30-fc9b-4c75-ba3d-fc6a29101b3f tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Acquiring lock "60a78556fb399ed4a41bc3ca4bccf77c96d8e811" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:38:32 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-1158df30-fc9b-4c75-ba3d-fc6a29101b3f tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Lock "60a78556fb399ed4a41bc3ca4bccf77c96d8e811" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:38:32 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-1158df30-fc9b-4c75-ba3d-fc6a29101b3f tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:38:32 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-1158df30-fc9b-4c75-ba3d-fc6a29101b3f tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json" returned: 0 in 0.200s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:38:32 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-1158df30-fc9b-4c75-ba3d-fc6a29101b3f tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811,backing_fmt=raw /opt/stack/data/nova/instances/3cafaf59-3cc9-4612-8da5-b2b60f8223e6/disk 1073741824 {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:38:32 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-1158df30-fc9b-4c75-ba3d-fc6a29101b3f tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811,backing_fmt=raw /opt/stack/data/nova/instances/3cafaf59-3cc9-4612-8da5-b2b60f8223e6/disk 1073741824" returned: 0 in 0.066s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:38:32 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-1158df30-fc9b-4c75-ba3d-fc6a29101b3f tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Lock "60a78556fb399ed4a41bc3ca4bccf77c96d8e811" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.277s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:38:32 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-1158df30-fc9b-4c75-ba3d-fc6a29101b3f tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:38:32 user nova-compute[85141]: DEBUG nova.network.neutron [None req-1158df30-fc9b-4c75-ba3d-fc6a29101b3f tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] [instance: 3cafaf59-3cc9-4612-8da5-b2b60f8223e6] Successfully created port: e30a03ca-bc02-4f7b-a94f-bda128aa7c39 {{(pid=85141) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 10:38:32 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-1158df30-fc9b-4c75-ba3d-fc6a29101b3f tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json" returned: 0 in 0.216s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:38:32 user nova-compute[85141]: DEBUG nova.virt.disk.api [None req-1158df30-fc9b-4c75-ba3d-fc6a29101b3f tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3cafaf59-3cc9-4612-8da5-b2b60f8223e6/disk. size=1073741824 {{(pid=85141) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 10:38:32 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-1158df30-fc9b-4c75-ba3d-fc6a29101b3f tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cafaf59-3cc9-4612-8da5-b2b60f8223e6/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:38:32 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-1158df30-fc9b-4c75-ba3d-fc6a29101b3f tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cafaf59-3cc9-4612-8da5-b2b60f8223e6/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:38:32 user nova-compute[85141]: DEBUG nova.virt.disk.api [None req-1158df30-fc9b-4c75-ba3d-fc6a29101b3f tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Cannot resize image /opt/stack/data/nova/instances/3cafaf59-3cc9-4612-8da5-b2b60f8223e6/disk to a smaller size. {{(pid=85141) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 10:38:32 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-1158df30-fc9b-4c75-ba3d-fc6a29101b3f tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] [instance: 3cafaf59-3cc9-4612-8da5-b2b60f8223e6] Created local disks {{(pid=85141) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 10:38:32 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-1158df30-fc9b-4c75-ba3d-fc6a29101b3f tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] [instance: 3cafaf59-3cc9-4612-8da5-b2b60f8223e6] Ensure instance console log exists: /opt/stack/data/nova/instances/3cafaf59-3cc9-4612-8da5-b2b60f8223e6/console.log {{(pid=85141) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 10:38:32 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-1158df30-fc9b-4c75-ba3d-fc6a29101b3f tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:38:32 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-1158df30-fc9b-4c75-ba3d-fc6a29101b3f tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:38:32 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-1158df30-fc9b-4c75-ba3d-fc6a29101b3f tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:38:33 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:38:33 user nova-compute[85141]: DEBUG nova.network.neutron [None req-1158df30-fc9b-4c75-ba3d-fc6a29101b3f tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] [instance: 3cafaf59-3cc9-4612-8da5-b2b60f8223e6] Successfully updated port: e30a03ca-bc02-4f7b-a94f-bda128aa7c39 {{(pid=85141) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 10:38:33 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-1158df30-fc9b-4c75-ba3d-fc6a29101b3f tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Acquiring lock "refresh_cache-3cafaf59-3cc9-4612-8da5-b2b60f8223e6" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:38:33 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-1158df30-fc9b-4c75-ba3d-fc6a29101b3f tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Acquired lock "refresh_cache-3cafaf59-3cc9-4612-8da5-b2b60f8223e6" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:38:33 user nova-compute[85141]: DEBUG nova.network.neutron [None req-1158df30-fc9b-4c75-ba3d-fc6a29101b3f tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] [instance: 3cafaf59-3cc9-4612-8da5-b2b60f8223e6] Building network info cache for instance {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 10:38:33 user nova-compute[85141]: DEBUG nova.compute.manager [req-2a4c22e0-c9c9-4f91-bcc6-8ea956362efa req-ed43a2ac-7304-4c6a-8e9c-7a63bb4df0f1 service nova] [instance: 3cafaf59-3cc9-4612-8da5-b2b60f8223e6] Received event network-changed-e30a03ca-bc02-4f7b-a94f-bda128aa7c39 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:38:33 user nova-compute[85141]: DEBUG nova.compute.manager [req-2a4c22e0-c9c9-4f91-bcc6-8ea956362efa req-ed43a2ac-7304-4c6a-8e9c-7a63bb4df0f1 service nova] [instance: 3cafaf59-3cc9-4612-8da5-b2b60f8223e6] Refreshing instance network info cache due to event network-changed-e30a03ca-bc02-4f7b-a94f-bda128aa7c39. {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 10:38:33 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-2a4c22e0-c9c9-4f91-bcc6-8ea956362efa req-ed43a2ac-7304-4c6a-8e9c-7a63bb4df0f1 service nova] Acquiring lock "refresh_cache-3cafaf59-3cc9-4612-8da5-b2b60f8223e6" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:38:33 user nova-compute[85141]: DEBUG nova.network.neutron [None req-1158df30-fc9b-4c75-ba3d-fc6a29101b3f tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] [instance: 3cafaf59-3cc9-4612-8da5-b2b60f8223e6] Instance cache missing network info. {{(pid=85141) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 10:38:33 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:38:33 user nova-compute[85141]: DEBUG nova.network.neutron [None req-1158df30-fc9b-4c75-ba3d-fc6a29101b3f tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] [instance: 3cafaf59-3cc9-4612-8da5-b2b60f8223e6] Updating instance_info_cache with network_info: [{"id": "e30a03ca-bc02-4f7b-a94f-bda128aa7c39", "address": "fa:16:3e:3d:15:cb", "network": {"id": "8931cd8f-3c0b-4d49-ae98-48f818e854e7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1902653571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d13c6ff3c30549ca9ab44d9fc1fedc6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape30a03ca-bc", "ovs_interfaceid": "e30a03ca-bc02-4f7b-a94f-bda128aa7c39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:38:33 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-1158df30-fc9b-4c75-ba3d-fc6a29101b3f tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Releasing lock "refresh_cache-3cafaf59-3cc9-4612-8da5-b2b60f8223e6" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:38:33 user nova-compute[85141]: DEBUG nova.compute.manager [None req-1158df30-fc9b-4c75-ba3d-fc6a29101b3f tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] [instance: 3cafaf59-3cc9-4612-8da5-b2b60f8223e6] Instance network_info: |[{"id": "e30a03ca-bc02-4f7b-a94f-bda128aa7c39", "address": "fa:16:3e:3d:15:cb", "network": {"id": "8931cd8f-3c0b-4d49-ae98-48f818e854e7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1902653571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d13c6ff3c30549ca9ab44d9fc1fedc6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape30a03ca-bc", "ovs_interfaceid": "e30a03ca-bc02-4f7b-a94f-bda128aa7c39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=85141) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 10:38:33 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-2a4c22e0-c9c9-4f91-bcc6-8ea956362efa req-ed43a2ac-7304-4c6a-8e9c-7a63bb4df0f1 service nova] Acquired lock "refresh_cache-3cafaf59-3cc9-4612-8da5-b2b60f8223e6" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:38:33 user nova-compute[85141]: DEBUG nova.network.neutron [req-2a4c22e0-c9c9-4f91-bcc6-8ea956362efa req-ed43a2ac-7304-4c6a-8e9c-7a63bb4df0f1 service nova] [instance: 3cafaf59-3cc9-4612-8da5-b2b60f8223e6] Refreshing network info cache for port e30a03ca-bc02-4f7b-a94f-bda128aa7c39 {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 10:38:33 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-1158df30-fc9b-4c75-ba3d-fc6a29101b3f tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] [instance: 3cafaf59-3cc9-4612-8da5-b2b60f8223e6] Start _get_guest_xml network_info=[{"id": "e30a03ca-bc02-4f7b-a94f-bda128aa7c39", "address": "fa:16:3e:3d:15:cb", "network": {"id": "8931cd8f-3c0b-4d49-ae98-48f818e854e7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1902653571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d13c6ff3c30549ca9ab44d9fc1fedc6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape30a03ca-bc", "ovs_interfaceid": "e30a03ca-bc02-4f7b-a94f-bda128aa7c39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T10:06:42Z,direct_url=<?>,disk_format='qcow2',id=bc4ca70f-a459-4d5c-a9e6-80f1948eb48b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1044631a5fe84ce8904864a7024049fa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T10:06:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_options': None, 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'image_id': 'bc4ca70f-a459-4d5c-a9e6-80f1948eb48b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=85141) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 10:38:33 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-1158df30-fc9b-4c75-ba3d-fc6a29101b3f tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:38:33 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-1158df30-fc9b-4c75-ba3d-fc6a29101b3f tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:38:33 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-1158df30-fc9b-4c75-ba3d-fc6a29101b3f tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=85141) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 10:38:33 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-1158df30-fc9b-4c75-ba3d-fc6a29101b3f tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] CPU controller missing on host. {{(pid=85141) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 10:38:33 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-1158df30-fc9b-4c75-ba3d-fc6a29101b3f tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=85141) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 10:38:33 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-1158df30-fc9b-4c75-ba3d-fc6a29101b3f tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] CPU controller found on host. {{(pid=85141) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 10:38:33 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-1158df30-fc9b-4c75-ba3d-fc6a29101b3f tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=85141) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 10:38:33 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-1158df30-fc9b-4c75-ba3d-fc6a29101b3f tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T10:06:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T10:06:42Z,direct_url=<?>,disk_format='qcow2',id=bc4ca70f-a459-4d5c-a9e6-80f1948eb48b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1044631a5fe84ce8904864a7024049fa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T10:06:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 10:38:33 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-1158df30-fc9b-4c75-ba3d-fc6a29101b3f tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Flavor limits 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 10:38:33 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-1158df30-fc9b-4c75-ba3d-fc6a29101b3f tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Image limits 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 10:38:33 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-1158df30-fc9b-4c75-ba3d-fc6a29101b3f tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Flavor pref 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 10:38:33 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-1158df30-fc9b-4c75-ba3d-fc6a29101b3f tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Image pref 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 10:38:33 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-1158df30-fc9b-4c75-ba3d-fc6a29101b3f tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 10:38:33 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-1158df30-fc9b-4c75-ba3d-fc6a29101b3f tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 10:38:33 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-1158df30-fc9b-4c75-ba3d-fc6a29101b3f tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=85141) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 10:38:33 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-1158df30-fc9b-4c75-ba3d-fc6a29101b3f tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Got 1 possible topologies {{(pid=85141) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 10:38:33 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-1158df30-fc9b-4c75-ba3d-fc6a29101b3f tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 10:38:33 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-1158df30-fc9b-4c75-ba3d-fc6a29101b3f tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 10:38:33 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-1158df30-fc9b-4c75-ba3d-fc6a29101b3f tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T10:38:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-560000982',display_name='tempest-AttachVolumeNegativeTest-server-560000982',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-560000982',id=51,image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPPiDvvTvL+VKZHpXyXa3Y1yIO243lYnUUjMQE7HKYaZZ+uHe90gPcBqBIhvjHxhWKje9tGlEpv/Jbpj8s0N8oqcW/nOfelSjQP/yYrNscRFJiY6E4Dpxx4Scb+nd+zQuw==',key_name='tempest-keypair-2023218890',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d13c6ff3c30549ca9ab44d9fc1fedc6f',ramdisk_id='',reservation_id='r-40l1zo0p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-2108292208',owner_user_name='tempest-AttachVolumeNegativeTest-2108292208-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T10:38:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5aa5beeeca5d4dc89cf5333942da756f',uuid=3cafaf59-3cc9-4612-8da5-b2b60f8223e6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e30a03ca-bc02-4f7b-a94f-bda128aa7c39", "address": "fa:16:3e:3d:15:cb", "network": {"id": "8931cd8f-3c0b-4d49-ae98-48f818e854e7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1902653571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d13c6ff3c30549ca9ab44d9fc1fedc6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape30a03ca-bc", "ovs_interfaceid": "e30a03ca-bc02-4f7b-a94f-bda128aa7c39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=85141) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 10:38:33 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-1158df30-fc9b-4c75-ba3d-fc6a29101b3f tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Converting VIF {"id": "e30a03ca-bc02-4f7b-a94f-bda128aa7c39", "address": "fa:16:3e:3d:15:cb", "network": {"id": "8931cd8f-3c0b-4d49-ae98-48f818e854e7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1902653571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d13c6ff3c30549ca9ab44d9fc1fedc6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape30a03ca-bc", "ovs_interfaceid": "e30a03ca-bc02-4f7b-a94f-bda128aa7c39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:38:33 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-1158df30-fc9b-4c75-ba3d-fc6a29101b3f tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3d:15:cb,bridge_name='br-int',has_traffic_filtering=True,id=e30a03ca-bc02-4f7b-a94f-bda128aa7c39,network=Network(8931cd8f-3c0b-4d49-ae98-48f818e854e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape30a03ca-bc') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:38:33 user nova-compute[85141]: DEBUG nova.objects.instance [None req-1158df30-fc9b-4c75-ba3d-fc6a29101b3f tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Lazy-loading 'pci_devices' on Instance uuid 3cafaf59-3cc9-4612-8da5-b2b60f8223e6 {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:38:33 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-1158df30-fc9b-4c75-ba3d-fc6a29101b3f tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] [instance: 3cafaf59-3cc9-4612-8da5-b2b60f8223e6] End _get_guest_xml xml=<domain type="kvm">
Nov 16 10:38:33 user nova-compute[85141]:   <uuid>3cafaf59-3cc9-4612-8da5-b2b60f8223e6</uuid>
Nov 16 10:38:33 user nova-compute[85141]:   <name>instance-00000033</name>
Nov 16 10:38:33 user nova-compute[85141]:   <memory>524288</memory>
Nov 16 10:38:33 user nova-compute[85141]:   <vcpu>1</vcpu>
Nov 16 10:38:33 user nova-compute[85141]:   <metadata>
Nov 16 10:38:33 user nova-compute[85141]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 10:38:33 user nova-compute[85141]:       <nova:package version="0.0.0"/>
Nov 16 10:38:33 user nova-compute[85141]:       <nova:name>tempest-AttachVolumeNegativeTest-server-560000982</nova:name>
Nov 16 10:38:33 user nova-compute[85141]:       <nova:creationTime>2023-11-16 10:38:33</nova:creationTime>
Nov 16 10:38:33 user nova-compute[85141]:       <nova:flavor name="m1.tiny">
Nov 16 10:38:33 user nova-compute[85141]:         <nova:memory>512</nova:memory>
Nov 16 10:38:33 user nova-compute[85141]:         <nova:disk>1</nova:disk>
Nov 16 10:38:33 user nova-compute[85141]:         <nova:swap>0</nova:swap>
Nov 16 10:38:33 user nova-compute[85141]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 10:38:33 user nova-compute[85141]:         <nova:vcpus>1</nova:vcpus>
Nov 16 10:38:33 user nova-compute[85141]:       </nova:flavor>
Nov 16 10:38:33 user nova-compute[85141]:       <nova:owner>
Nov 16 10:38:33 user nova-compute[85141]:         <nova:user uuid="5aa5beeeca5d4dc89cf5333942da756f">tempest-AttachVolumeNegativeTest-2108292208-project-member</nova:user>
Nov 16 10:38:33 user nova-compute[85141]:         <nova:project uuid="d13c6ff3c30549ca9ab44d9fc1fedc6f">tempest-AttachVolumeNegativeTest-2108292208</nova:project>
Nov 16 10:38:33 user nova-compute[85141]:       </nova:owner>
Nov 16 10:38:33 user nova-compute[85141]:       <nova:root type="image" uuid="bc4ca70f-a459-4d5c-a9e6-80f1948eb48b"/>
Nov 16 10:38:33 user nova-compute[85141]:       <nova:ports>
Nov 16 10:38:33 user nova-compute[85141]:         <nova:port uuid="e30a03ca-bc02-4f7b-a94f-bda128aa7c39">
Nov 16 10:38:33 user nova-compute[85141]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 16 10:38:33 user nova-compute[85141]:         </nova:port>
Nov 16 10:38:33 user nova-compute[85141]:       </nova:ports>
Nov 16 10:38:33 user nova-compute[85141]:     </nova:instance>
Nov 16 10:38:33 user nova-compute[85141]:   </metadata>
Nov 16 10:38:33 user nova-compute[85141]:   <sysinfo type="smbios">
Nov 16 10:38:33 user nova-compute[85141]:     <system>
Nov 16 10:38:33 user nova-compute[85141]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 10:38:33 user nova-compute[85141]:       <entry name="product">OpenStack Nova</entry>
Nov 16 10:38:33 user nova-compute[85141]:       <entry name="version">0.0.0</entry>
Nov 16 10:38:33 user nova-compute[85141]:       <entry name="serial">3cafaf59-3cc9-4612-8da5-b2b60f8223e6</entry>
Nov 16 10:38:33 user nova-compute[85141]:       <entry name="uuid">3cafaf59-3cc9-4612-8da5-b2b60f8223e6</entry>
Nov 16 10:38:33 user nova-compute[85141]:       <entry name="family">Virtual Machine</entry>
Nov 16 10:38:33 user nova-compute[85141]:     </system>
Nov 16 10:38:33 user nova-compute[85141]:   </sysinfo>
Nov 16 10:38:33 user nova-compute[85141]:   <os>
Nov 16 10:38:33 user nova-compute[85141]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 10:38:33 user nova-compute[85141]:     <boot dev="hd"/>
Nov 16 10:38:33 user nova-compute[85141]:     <smbios mode="sysinfo"/>
Nov 16 10:38:33 user nova-compute[85141]:   </os>
Nov 16 10:38:33 user nova-compute[85141]:   <features>
Nov 16 10:38:33 user nova-compute[85141]:     <acpi/>
Nov 16 10:38:33 user nova-compute[85141]:     <apic/>
Nov 16 10:38:33 user nova-compute[85141]:     <vmcoreinfo/>
Nov 16 10:38:33 user nova-compute[85141]:   </features>
Nov 16 10:38:33 user nova-compute[85141]:   <clock offset="utc">
Nov 16 10:38:33 user nova-compute[85141]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 10:38:33 user nova-compute[85141]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 10:38:33 user nova-compute[85141]:     <timer name="hpet" present="no"/>
Nov 16 10:38:33 user nova-compute[85141]:   </clock>
Nov 16 10:38:33 user nova-compute[85141]:   <cpu mode="custom" match="exact">
Nov 16 10:38:33 user nova-compute[85141]:     <model>Nehalem</model>
Nov 16 10:38:33 user nova-compute[85141]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 10:38:33 user nova-compute[85141]:   </cpu>
Nov 16 10:38:33 user nova-compute[85141]:   <devices>
Nov 16 10:38:33 user nova-compute[85141]:     <disk type="file" device="disk">
Nov 16 10:38:33 user nova-compute[85141]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 10:38:33 user nova-compute[85141]:       <source file="/opt/stack/data/nova/instances/3cafaf59-3cc9-4612-8da5-b2b60f8223e6/disk"/>
Nov 16 10:38:33 user nova-compute[85141]:       <target dev="vda" bus="virtio"/>
Nov 16 10:38:33 user nova-compute[85141]:     </disk>
Nov 16 10:38:33 user nova-compute[85141]:     <interface type="ethernet">
Nov 16 10:38:33 user nova-compute[85141]:       <mac address="fa:16:3e:3d:15:cb"/>
Nov 16 10:38:33 user nova-compute[85141]:       <model type="virtio"/>
Nov 16 10:38:33 user nova-compute[85141]:       <mtu size="1442"/>
Nov 16 10:38:33 user nova-compute[85141]:       <target dev="tape30a03ca-bc"/>
Nov 16 10:38:33 user nova-compute[85141]:     </interface>
Nov 16 10:38:33 user nova-compute[85141]:     <serial type="pty">
Nov 16 10:38:33 user nova-compute[85141]:       <log file="/opt/stack/data/nova/instances/3cafaf59-3cc9-4612-8da5-b2b60f8223e6/console.log" append="off"/>
Nov 16 10:38:33 user nova-compute[85141]:     </serial>
Nov 16 10:38:33 user nova-compute[85141]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 10:38:33 user nova-compute[85141]:     <video>
Nov 16 10:38:33 user nova-compute[85141]:       <model type="virtio"/>
Nov 16 10:38:33 user nova-compute[85141]:     </video>
Nov 16 10:38:33 user nova-compute[85141]:     <rng model="virtio">
Nov 16 10:38:33 user nova-compute[85141]:       <backend model="random">/dev/urandom</backend>
Nov 16 10:38:33 user nova-compute[85141]:     </rng>
Nov 16 10:38:33 user nova-compute[85141]:     <controller type="usb" index="0" model="none"/>
Nov 16 10:38:33 user nova-compute[85141]:     <memballoon model="virtio">
Nov 16 10:38:33 user nova-compute[85141]:       <stats period="10"/>
Nov 16 10:38:33 user nova-compute[85141]:     </memballoon>
Nov 16 10:38:33 user nova-compute[85141]:   </devices>
Nov 16 10:38:33 user nova-compute[85141]: </domain>
Nov 16 10:38:33 user nova-compute[85141]:  {{(pid=85141) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 10:38:33 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-1158df30-fc9b-4c75-ba3d-fc6a29101b3f tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T10:38:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-560000982',display_name='tempest-AttachVolumeNegativeTest-server-560000982',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-560000982',id=51,image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPPiDvvTvL+VKZHpXyXa3Y1yIO243lYnUUjMQE7HKYaZZ+uHe90gPcBqBIhvjHxhWKje9tGlEpv/Jbpj8s0N8oqcW/nOfelSjQP/yYrNscRFJiY6E4Dpxx4Scb+nd+zQuw==',key_name='tempest-keypair-2023218890',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d13c6ff3c30549ca9ab44d9fc1fedc6f',ramdisk_id='',reservation_id='r-40l1zo0p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-2108292208',owner_user_name='tempest-AttachVolumeNegativeTest-2108292208-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T10:38:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5aa5beeeca5d4dc89cf5333942da756f',uuid=3cafaf59-3cc9-4612-8da5-b2b60f8223e6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e30a03ca-bc02-4f7b-a94f-bda128aa7c39", "address": "fa:16:3e:3d:15:cb", "network": {"id": "8931cd8f-3c0b-4d49-ae98-48f818e854e7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1902653571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d13c6ff3c30549ca9ab44d9fc1fedc6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape30a03ca-bc", "ovs_interfaceid": "e30a03ca-bc02-4f7b-a94f-bda128aa7c39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 10:38:33 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-1158df30-fc9b-4c75-ba3d-fc6a29101b3f tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Converting VIF {"id": "e30a03ca-bc02-4f7b-a94f-bda128aa7c39", "address": "fa:16:3e:3d:15:cb", "network": {"id": "8931cd8f-3c0b-4d49-ae98-48f818e854e7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1902653571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d13c6ff3c30549ca9ab44d9fc1fedc6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape30a03ca-bc", "ovs_interfaceid": "e30a03ca-bc02-4f7b-a94f-bda128aa7c39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:38:33 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-1158df30-fc9b-4c75-ba3d-fc6a29101b3f tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3d:15:cb,bridge_name='br-int',has_traffic_filtering=True,id=e30a03ca-bc02-4f7b-a94f-bda128aa7c39,network=Network(8931cd8f-3c0b-4d49-ae98-48f818e854e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape30a03ca-bc') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:38:33 user nova-compute[85141]: DEBUG os_vif [None req-1158df30-fc9b-4c75-ba3d-fc6a29101b3f tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:15:cb,bridge_name='br-int',has_traffic_filtering=True,id=e30a03ca-bc02-4f7b-a94f-bda128aa7c39,network=Network(8931cd8f-3c0b-4d49-ae98-48f818e854e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape30a03ca-bc') {{(pid=85141) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 10:38:33 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:38:33 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:38:33 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 10:38:33 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:38:33 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7720a145-993e-563a-a1c3-baf266fcb56b', '_type': 'linux-noop'}}, row=False) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:38:33 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:38:33 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:38:33 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:38:33 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape30a03ca-bc, may_exist=True, interface_attrs={}) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:38:33 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape30a03ca-bc, col_values=(('qos', UUID('1099c7f7-d89f-44d3-a3bf-12ddcb749df3')),), if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:38:33 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape30a03ca-bc, col_values=(('external_ids', {'iface-id': 'e30a03ca-bc02-4f7b-a94f-bda128aa7c39', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3d:15:cb', 'vm-uuid': '3cafaf59-3cc9-4612-8da5-b2b60f8223e6'}),), if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:38:33 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:38:33 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:38:33 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:38:33 user nova-compute[85141]: INFO os_vif [None req-1158df30-fc9b-4c75-ba3d-fc6a29101b3f tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:15:cb,bridge_name='br-int',has_traffic_filtering=True,id=e30a03ca-bc02-4f7b-a94f-bda128aa7c39,network=Network(8931cd8f-3c0b-4d49-ae98-48f818e854e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape30a03ca-bc')
Nov 16 10:38:33 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-1158df30-fc9b-4c75-ba3d-fc6a29101b3f tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] No BDM found with device name vda, not building metadata. {{(pid=85141) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 10:38:33 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-1158df30-fc9b-4c75-ba3d-fc6a29101b3f tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] No VIF found with MAC fa:16:3e:3d:15:cb, not building metadata {{(pid=85141) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 10:38:34 user nova-compute[85141]: DEBUG nova.network.neutron [req-2a4c22e0-c9c9-4f91-bcc6-8ea956362efa req-ed43a2ac-7304-4c6a-8e9c-7a63bb4df0f1 service nova] [instance: 3cafaf59-3cc9-4612-8da5-b2b60f8223e6] Updated VIF entry in instance network info cache for port e30a03ca-bc02-4f7b-a94f-bda128aa7c39. {{(pid=85141) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 10:38:34 user nova-compute[85141]: DEBUG nova.network.neutron [req-2a4c22e0-c9c9-4f91-bcc6-8ea956362efa req-ed43a2ac-7304-4c6a-8e9c-7a63bb4df0f1 service nova] [instance: 3cafaf59-3cc9-4612-8da5-b2b60f8223e6] Updating instance_info_cache with network_info: [{"id": "e30a03ca-bc02-4f7b-a94f-bda128aa7c39", "address": "fa:16:3e:3d:15:cb", "network": {"id": "8931cd8f-3c0b-4d49-ae98-48f818e854e7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1902653571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d13c6ff3c30549ca9ab44d9fc1fedc6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape30a03ca-bc", "ovs_interfaceid": "e30a03ca-bc02-4f7b-a94f-bda128aa7c39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:38:34 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-2a4c22e0-c9c9-4f91-bcc6-8ea956362efa req-ed43a2ac-7304-4c6a-8e9c-7a63bb4df0f1 service nova] Releasing lock "refresh_cache-3cafaf59-3cc9-4612-8da5-b2b60f8223e6" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:38:35 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:38:35 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:38:35 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:38:35 user nova-compute[85141]: DEBUG nova.compute.manager [req-ed7a35ad-d295-40c5-8514-c2c043ad03d6 req-3465792f-7164-44c3-bd0f-89c829c23576 service nova] [instance: 3cafaf59-3cc9-4612-8da5-b2b60f8223e6] Received event network-vif-plugged-e30a03ca-bc02-4f7b-a94f-bda128aa7c39 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:38:35 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-ed7a35ad-d295-40c5-8514-c2c043ad03d6 req-3465792f-7164-44c3-bd0f-89c829c23576 service nova] Acquiring lock "3cafaf59-3cc9-4612-8da5-b2b60f8223e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:38:35 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-ed7a35ad-d295-40c5-8514-c2c043ad03d6 req-3465792f-7164-44c3-bd0f-89c829c23576 service nova] Lock "3cafaf59-3cc9-4612-8da5-b2b60f8223e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:38:35 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-ed7a35ad-d295-40c5-8514-c2c043ad03d6 req-3465792f-7164-44c3-bd0f-89c829c23576 service nova] Lock "3cafaf59-3cc9-4612-8da5-b2b60f8223e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:38:35 user nova-compute[85141]: DEBUG nova.compute.manager [req-ed7a35ad-d295-40c5-8514-c2c043ad03d6 req-3465792f-7164-44c3-bd0f-89c829c23576 service nova] [instance: 3cafaf59-3cc9-4612-8da5-b2b60f8223e6] No waiting events found dispatching network-vif-plugged-e30a03ca-bc02-4f7b-a94f-bda128aa7c39 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:38:35 user nova-compute[85141]: WARNING nova.compute.manager [req-ed7a35ad-d295-40c5-8514-c2c043ad03d6 req-3465792f-7164-44c3-bd0f-89c829c23576 service nova] [instance: 3cafaf59-3cc9-4612-8da5-b2b60f8223e6] Received unexpected event network-vif-plugged-e30a03ca-bc02-4f7b-a94f-bda128aa7c39 for instance with vm_state building and task_state spawning.
Nov 16 10:38:35 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:38:35 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:38:35 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:38:35 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:38:37 user nova-compute[85141]: DEBUG nova.compute.manager [None req-1158df30-fc9b-4c75-ba3d-fc6a29101b3f tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] [instance: 3cafaf59-3cc9-4612-8da5-b2b60f8223e6] Instance event wait completed in 0 seconds for  {{(pid=85141) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 10:38:37 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-1158df30-fc9b-4c75-ba3d-fc6a29101b3f tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] [instance: 3cafaf59-3cc9-4612-8da5-b2b60f8223e6] Guest created on hypervisor {{(pid=85141) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 10:38:37 user nova-compute[85141]: INFO nova.virt.libvirt.driver [-] [instance: 3cafaf59-3cc9-4612-8da5-b2b60f8223e6] Instance spawned successfully.
Nov 16 10:38:37 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-1158df30-fc9b-4c75-ba3d-fc6a29101b3f tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] [instance: 3cafaf59-3cc9-4612-8da5-b2b60f8223e6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 10:38:37 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-1158df30-fc9b-4c75-ba3d-fc6a29101b3f tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] [instance: 3cafaf59-3cc9-4612-8da5-b2b60f8223e6] Found default for hw_cdrom_bus of ide {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:38:37 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-1158df30-fc9b-4c75-ba3d-fc6a29101b3f tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] [instance: 3cafaf59-3cc9-4612-8da5-b2b60f8223e6] Found default for hw_disk_bus of virtio {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:38:37 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-1158df30-fc9b-4c75-ba3d-fc6a29101b3f tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] [instance: 3cafaf59-3cc9-4612-8da5-b2b60f8223e6] Found default for hw_input_bus of None {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:38:37 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-1158df30-fc9b-4c75-ba3d-fc6a29101b3f tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] [instance: 3cafaf59-3cc9-4612-8da5-b2b60f8223e6] Found default for hw_pointer_model of None {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:38:37 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-1158df30-fc9b-4c75-ba3d-fc6a29101b3f tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] [instance: 3cafaf59-3cc9-4612-8da5-b2b60f8223e6] Found default for hw_video_model of virtio {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:38:37 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-1158df30-fc9b-4c75-ba3d-fc6a29101b3f tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] [instance: 3cafaf59-3cc9-4612-8da5-b2b60f8223e6] Found default for hw_vif_model of virtio {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:38:37 user nova-compute[85141]: INFO nova.compute.manager [None req-1158df30-fc9b-4c75-ba3d-fc6a29101b3f tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] [instance: 3cafaf59-3cc9-4612-8da5-b2b60f8223e6] Took 5.45 seconds to spawn the instance on the hypervisor.
Nov 16 10:38:37 user nova-compute[85141]: DEBUG nova.compute.manager [None req-1158df30-fc9b-4c75-ba3d-fc6a29101b3f tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] [instance: 3cafaf59-3cc9-4612-8da5-b2b60f8223e6] Checking state {{(pid=85141) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 10:38:37 user nova-compute[85141]: DEBUG nova.compute.manager [req-cc5085f2-9cad-4d42-bf41-bba384e5173a req-7d687d0d-9e74-4e94-b755-19bafd4c0ba3 service nova] [instance: 3cafaf59-3cc9-4612-8da5-b2b60f8223e6] Received event network-vif-plugged-e30a03ca-bc02-4f7b-a94f-bda128aa7c39 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:38:37 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-cc5085f2-9cad-4d42-bf41-bba384e5173a req-7d687d0d-9e74-4e94-b755-19bafd4c0ba3 service nova] Acquiring lock "3cafaf59-3cc9-4612-8da5-b2b60f8223e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:38:37 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-cc5085f2-9cad-4d42-bf41-bba384e5173a req-7d687d0d-9e74-4e94-b755-19bafd4c0ba3 service nova] Lock "3cafaf59-3cc9-4612-8da5-b2b60f8223e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:38:37 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-cc5085f2-9cad-4d42-bf41-bba384e5173a req-7d687d0d-9e74-4e94-b755-19bafd4c0ba3 service nova] Lock "3cafaf59-3cc9-4612-8da5-b2b60f8223e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:38:37 user nova-compute[85141]: DEBUG nova.compute.manager [req-cc5085f2-9cad-4d42-bf41-bba384e5173a req-7d687d0d-9e74-4e94-b755-19bafd4c0ba3 service nova] [instance: 3cafaf59-3cc9-4612-8da5-b2b60f8223e6] No waiting events found dispatching network-vif-plugged-e30a03ca-bc02-4f7b-a94f-bda128aa7c39 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:38:37 user nova-compute[85141]: WARNING nova.compute.manager [req-cc5085f2-9cad-4d42-bf41-bba384e5173a req-7d687d0d-9e74-4e94-b755-19bafd4c0ba3 service nova] [instance: 3cafaf59-3cc9-4612-8da5-b2b60f8223e6] Received unexpected event network-vif-plugged-e30a03ca-bc02-4f7b-a94f-bda128aa7c39 for instance with vm_state building and task_state spawning.
Nov 16 10:38:37 user nova-compute[85141]: INFO nova.compute.manager [None req-1158df30-fc9b-4c75-ba3d-fc6a29101b3f tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] [instance: 3cafaf59-3cc9-4612-8da5-b2b60f8223e6] Took 6.04 seconds to build instance.
Nov 16 10:38:37 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-1158df30-fc9b-4c75-ba3d-fc6a29101b3f tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Lock "3cafaf59-3cc9-4612-8da5-b2b60f8223e6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.133s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:38:38 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:38:38 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:38:38 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:38:43 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:38:43 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=85141) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 10:38:43 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:38:43 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:38:43 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=85141) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 10:38:43 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=85141) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 10:38:43 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=85141) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 10:38:43 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:38:44 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:38:44 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Starting heal instance info cache {{(pid=85141) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 10:38:44 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Acquiring lock "refresh_cache-797c873e-cf15-4d3c-a3bc-bd2a81a80014" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:38:44 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Acquired lock "refresh_cache-797c873e-cf15-4d3c-a3bc-bd2a81a80014" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:38:44 user nova-compute[85141]: DEBUG nova.network.neutron [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] [instance: 797c873e-cf15-4d3c-a3bc-bd2a81a80014] Forcefully refreshing network info cache for instance {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 10:38:44 user nova-compute[85141]: DEBUG nova.network.neutron [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] [instance: 797c873e-cf15-4d3c-a3bc-bd2a81a80014] Updating instance_info_cache with network_info: [{"id": "27c72f03-eb45-49ad-b17e-330eecf72cb1", "address": "fa:16:3e:0d:32:17", "network": {"id": "b8ada47f-9721-4358-ac4f-0305f06dbbb8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1663922860-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aec3bb9fe5e6446590900b5adf65df0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27c72f03-eb", "ovs_interfaceid": "27c72f03-eb45-49ad-b17e-330eecf72cb1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:38:44 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Releasing lock "refresh_cache-797c873e-cf15-4d3c-a3bc-bd2a81a80014" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:38:44 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] [instance: 797c873e-cf15-4d3c-a3bc-bd2a81a80014] Updated the network info_cache for instance {{(pid=85141) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 10:38:44 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager.update_available_resource {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:38:44 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:38:44 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:38:44 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:38:44 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Auditing locally available compute resources for user (node: user) {{(pid=85141) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 10:38:44 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cafaf59-3cc9-4612-8da5-b2b60f8223e6/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:38:45 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cafaf59-3cc9-4612-8da5-b2b60f8223e6/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:38:45 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cafaf59-3cc9-4612-8da5-b2b60f8223e6/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:38:45 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cafaf59-3cc9-4612-8da5-b2b60f8223e6/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:38:45 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=85141) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 10:38:45 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=85141) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 10:38:45 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e01e0e9-5eef-4af4-8633-814d59860b8d/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:38:45 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e01e0e9-5eef-4af4-8633-814d59860b8d/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:38:45 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e01e0e9-5eef-4af4-8633-814d59860b8d/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:38:45 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e01e0e9-5eef-4af4-8633-814d59860b8d/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:38:46 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:38:46 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:38:46 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Hypervisor/Node resource view: name=user free_ram=8504MB free_disk=25.063758850097656GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=85141) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 10:38:46 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:38:46 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:38:46 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance 1e01e0e9-5eef-4af4-8633-814d59860b8d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:38:46 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance 797c873e-cf15-4d3c-a3bc-bd2a81a80014 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:38:46 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance d3d07af8-8d41-4b66-8cca-ab287972b17b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:38:46 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance 3cafaf59-3cc9-4612-8da5-b2b60f8223e6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:38:46 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=85141) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 10:38:46 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=85141) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 10:38:46 user nova-compute[85141]: DEBUG nova.compute.provider_tree [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Inventory has not changed in ProviderTree for provider: bf8e0fa1-16b6-408f-9203-c4cd63916272 {{(pid=85141) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 10:38:46 user nova-compute[85141]: DEBUG nova.scheduler.client.report [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Inventory has not changed for provider bf8e0fa1-16b6-408f-9203-c4cd63916272 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=85141) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 10:38:46 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Compute_service record updated for user:user {{(pid=85141) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 10:38:46 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.273s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:38:46 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:38:46 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:38:47 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:38:48 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:38:50 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:38:50 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:38:53 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:38:53 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:38:54 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:38:56 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-3fef5646-70e4-4669-bd88-88a88a9d703e tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Acquiring lock "1e01e0e9-5eef-4af4-8633-814d59860b8d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:38:56 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-3fef5646-70e4-4669-bd88-88a88a9d703e tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Lock "1e01e0e9-5eef-4af4-8633-814d59860b8d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:38:56 user nova-compute[85141]: DEBUG nova.objects.instance [None req-3fef5646-70e4-4669-bd88-88a88a9d703e tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Lazy-loading 'flavor' on Instance uuid 1e01e0e9-5eef-4af4-8633-814d59860b8d {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:38:56 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-3fef5646-70e4-4669-bd88-88a88a9d703e tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Lock "1e01e0e9-5eef-4af4-8633-814d59860b8d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:38:56 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-3fef5646-70e4-4669-bd88-88a88a9d703e tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Acquiring lock "1e01e0e9-5eef-4af4-8633-814d59860b8d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:38:56 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-3fef5646-70e4-4669-bd88-88a88a9d703e tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Lock "1e01e0e9-5eef-4af4-8633-814d59860b8d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:38:56 user nova-compute[85141]: INFO nova.compute.manager [None req-3fef5646-70e4-4669-bd88-88a88a9d703e tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] [instance: 1e01e0e9-5eef-4af4-8633-814d59860b8d] Attaching volume cf16006b-6529-45e8-8d9f-5414057f1769 to /dev/vdb
Nov 16 10:38:56 user nova-compute[85141]: DEBUG os_brick.utils [None req-3fef5646-70e4-4669-bd88-88a88a9d703e tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 10:38:56 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:38:56 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:38:56 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b41c688-f2a0-4a0c-8171-0f956e596728]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c7834de5c295\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:38:56 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:38:56 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:38:56 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[8258a6f6-b3ae-48ec-a2e4-32c977812ab7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:38:56 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:38:56 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:38:56 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[281acc25-e07d-4537-9474-15102a6c5855]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:38:56 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed019212-a055-4b93-84ff-50af99b8c305]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:38:56 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-3fef5646-70e4-4669-bd88-88a88a9d703e tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Running cmd (subprocess): nvme version {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:38:56 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-3fef5646-70e4-4669-bd88-88a88a9d703e tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] 'nvme version' failed. Not Retrying. {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 10:38:56 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3fef5646-70e4-4669-bd88-88a88a9d703e tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] nvme not present on system {{(pid=85141) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 10:38:56 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:38:56 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 10:38:56 user nova-compute[85141]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 10:38:56 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[91052f2b-9ff7-4840-985d-801d28be1442]: (4, '') {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:38:56 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.lightos [None req-3fef5646-70e4-4669-bd88-88a88a9d703e tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=85141) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 10:38:56 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.lightos [None req-3fef5646-70e4-4669-bd88-88a88a9d703e tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=85141) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 10:38:56 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.lightos [None req-3fef5646-70e4-4669-bd88-88a88a9d703e tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] LIGHTOS: no hostnqn found. {{(pid=85141) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 10:38:56 user nova-compute[85141]: DEBUG os_brick.utils [None req-3fef5646-70e4-4669-bd88-88a88a9d703e tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c7834de5c295', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 10:38:56 user nova-compute[85141]: DEBUG nova.virt.block_device [None req-3fef5646-70e4-4669-bd88-88a88a9d703e tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] [instance: 1e01e0e9-5eef-4af4-8633-814d59860b8d] Updating existing volume attachment record: 52f61723-3f1b-4bd1-a764-fff8287de1da {{(pid=85141) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 10:38:58 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:38:58 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:39:01 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3fef5646-70e4-4669-bd88-88a88a9d703e tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] [instance: 1e01e0e9-5eef-4af4-8633-814d59860b8d] Calling os-brick to attach iSCSI Volume {{(pid=85141) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 10:39:01 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fef5646-70e4-4669-bd88-88a88a9d703e tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51806b6080>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:cf16006b-6529-45e8-8d9f-5414057f1769', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VBtRoQlO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 10:39:01 user nova-compute[85141]: WARNING os_brick.initiator.connectors.base [None req-3fef5646-70e4-4669-bd88-88a88a9d703e tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 10:39:01 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-3fef5646-70e4-4669-bd88-88a88a9d703e tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 10:39:01 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-3fef5646-70e4-4669-bd88-88a88a9d703e tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 10:39:01 user nova-compute[85141]: WARNING os_brick.initiator.connectors.base [None req-3fef5646-70e4-4669-bd88-88a88a9d703e tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 10:39:01 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-3fef5646-70e4-4669-bd88-88a88a9d703e tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cf16006b-6529-45e8-8d9f-5414057f1769" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 10:39:01 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-3fef5646-70e4-4669-bd88-88a88a9d703e tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cf16006b-6529-45e8-8d9f-5414057f1769" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 10:39:01 user nova-compute[85141]: INFO os_brick.initiator.connectors.iscsi [None req-3fef5646-70e4-4669-bd88-88a88a9d703e tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 10:39:01 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf16006b-6529-45e8-8d9f-5414057f1769 -p 172.16.0.220:3260 {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:39:01 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf16006b-6529-45e8-8d9f-5414057f1769 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:39:01 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e19efc8-19f7-4de6-a5d0-81504a92f53d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:39:01 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fef5646-70e4-4669-bd88-88a88a9d703e tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 10:39:01 user nova-compute[85141]:  {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:39:01 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf16006b-6529-45e8-8d9f-5414057f1769 -p 172.16.0.220:3260 --interface default --op new {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:39:01 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf16006b-6529-45e8-8d9f-5414057f1769 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:39:01 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1e72c8f-2302-4b37-aa1b-3a912d79bb8e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cf16006b-6529-45e8-8d9f-5414057f1769] added\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:39:01 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fef5646-70e4-4669-bd88-88a88a9d703e tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cf16006b-6529-45e8-8d9f-5414057f1769] added
Nov 16 10:39:01 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:39:01 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf16006b-6529-45e8-8d9f-5414057f1769 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:39:01 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf16006b-6529-45e8-8d9f-5414057f1769 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:39:01 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc1f83f7-e27e-4a8d-bdf3-4b4816d87def]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:39:01 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fef5646-70e4-4669-bd88-88a88a9d703e tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:39:01 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf16006b-6529-45e8-8d9f-5414057f1769 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:39:01 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf16006b-6529-45e8-8d9f-5414057f1769 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:39:01 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[22dbae15-1d64-4f29-b737-2d42ffc3b6da]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:39:01 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fef5646-70e4-4669-bd88-88a88a9d703e tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:39:01 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf16006b-6529-45e8-8d9f-5414057f1769 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VBtRoQlO {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:39:01 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf16006b-6529-45e8-8d9f-5414057f1769 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VBtRoQlO" returned: 0 in 0.017s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:39:01 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[66685998-e3df-454c-8818-3bc1e0f03fe9]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:39:01 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fef5646-70e4-4669-bd88-88a88a9d703e tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VBtRoQlO'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:39:01 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf16006b-6529-45e8-8d9f-5414057f1769 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:39:01 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf16006b-6529-45e8-8d9f-5414057f1769 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:39:01 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[54c22f27-86ce-4d68-bce8-b261f8914c02]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:39:01 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fef5646-70e4-4669-bd88-88a88a9d703e tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:39:01 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:39:01 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:39:01 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[c10d84b8-5d1d-49ac-8a0f-2d540e1f6e77]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:584dd8df-f6a2-4e35-be7e-8de1e759491b (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1f6cb5b-4d5a-4d88-8ef9-e209bbd8891d (non-flash)\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:39:01 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fef5646-70e4-4669-bd88-88a88a9d703e tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:584dd8df-f6a2-4e35-be7e-8de1e759491b (non-flash)
Nov 16 10:39:01 user nova-compute[85141]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1f6cb5b-4d5a-4d88-8ef9-e209bbd8891d (non-flash)
Nov 16 10:39:01 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:39:01 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fef5646-70e4-4669-bd88-88a88a9d703e tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:584dd8df-f6a2-4e35-be7e-8de1e759491b (non-flash)
Nov 16 10:39:01 user nova-compute[85141]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1f6cb5b-4d5a-4d88-8ef9-e209bbd8891d (non-flash)
Nov 16 10:39:01 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 10:39:01 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf16006b-6529-45e8-8d9f-5414057f1769 -p 172.16.0.220:3260 --login {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:39:02 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf16006b-6529-45e8-8d9f-5414057f1769 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:39:02 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[43c66db2-b11c-404a-9598-5b9520399dc9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cf16006b-6529-45e8-8d9f-5414057f1769, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cf16006b-6529-45e8-8d9f-5414057f1769, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:39:02 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fef5646-70e4-4669-bd88-88a88a9d703e tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cf16006b-6529-45e8-8d9f-5414057f1769, portal: 172.16.0.220,3260]
Nov 16 10:39:02 user nova-compute[85141]: Login to [iface: default, target: iqn.2010-10.org.openstack:cf16006b-6529-45e8-8d9f-5414057f1769, portal: 172.16.0.220,3260] successful.
Nov 16 10:39:02 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:39:02 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf16006b-6529-45e8-8d9f-5414057f1769 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:39:02 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf16006b-6529-45e8-8d9f-5414057f1769 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:39:02 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a5d34e1-d87c-42e5-b0d6-82a283ea08fb]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:39:02 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fef5646-70e4-4669-bd88-88a88a9d703e tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:39:02 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:39:02 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:39:02 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[63c6592d-60ac-4fb4-b70d-be54a21c2e3a]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:584dd8df-f6a2-4e35-be7e-8de1e759491b (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1f6cb5b-4d5a-4d88-8ef9-e209bbd8891d (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf16006b-6529-45e8-8d9f-5414057f1769 (non-flash)\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:39:02 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fef5646-70e4-4669-bd88-88a88a9d703e tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:584dd8df-f6a2-4e35-be7e-8de1e759491b (non-flash)
Nov 16 10:39:02 user nova-compute[85141]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1f6cb5b-4d5a-4d88-8ef9-e209bbd8891d (non-flash)
Nov 16 10:39:02 user nova-compute[85141]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf16006b-6529-45e8-8d9f-5414057f1769 (non-flash)
Nov 16 10:39:02 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:39:02 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fef5646-70e4-4669-bd88-88a88a9d703e tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:584dd8df-f6a2-4e35-be7e-8de1e759491b (non-flash)
Nov 16 10:39:02 user nova-compute[85141]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1f6cb5b-4d5a-4d88-8ef9-e209bbd8891d (non-flash)
Nov 16 10:39:02 user nova-compute[85141]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf16006b-6529-45e8-8d9f-5414057f1769 (non-flash)
Nov 16 10:39:02 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 10:39:02 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-3fef5646-70e4-4669-bd88-88a88a9d703e tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cf16006b-6529-45e8-8d9f-5414057f1769" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.276s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 10:39:02 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fef5646-70e4-4669-bd88-88a88a9d703e tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Connected to 172.16.0.220:3260 {{(pid=85141) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 10:39:02 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-3fef5646-70e4-4669-bd88-88a88a9d703e tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] HCTL ('34', '-', '-', 0) found on session 59 with lun 0 {{(pid=85141) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 10:39:02 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-3fef5646-70e4-4669-bd88-88a88a9d703e tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=85141) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 10:39:02 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:39:02 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:39:02 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdcb21c3-bbed-491f-bd81-1dc2d50b2370]: (4, ('- - 0', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:39:02 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-3fef5646-70e4-4669-bd88-88a88a9d703e tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Searching for a device in session 59 and hctl ['34', '*', '*', 0] yield: None {{(pid=85141) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 10:39:03 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-3fef5646-70e4-4669-bd88-88a88a9d703e tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Searching for a device in session 59 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=85141) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 10:39:03 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fef5646-70e4-4669-bd88-88a88a9d703e tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:cf16006b-6529-45e8-8d9f-5414057f1769', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VBtRoQlO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=85141) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 10:39:03 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-3fef5646-70e4-4669-bd88-88a88a9d703e tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.305s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 10:39:03 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fef5646-70e4-4669-bd88-88a88a9d703e tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] <== connect_volume: return (1306ms) {'type': 'block', 'scsi_wwn': '23330353161333734', 'path': '/dev/sdc'} {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 10:39:03 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3fef5646-70e4-4669-bd88-88a88a9d703e tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] [instance: 1e01e0e9-5eef-4af4-8633-814d59860b8d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23330353161333734', 'path': '/dev/sdc'} {{(pid=85141) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 10:39:03 user nova-compute[85141]: DEBUG nova.objects.instance [None req-3fef5646-70e4-4669-bd88-88a88a9d703e tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Lazy-loading 'flavor' on Instance uuid 1e01e0e9-5eef-4af4-8633-814d59860b8d {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:39:03 user nova-compute[85141]: DEBUG nova.virt.libvirt.guest [None req-3fef5646-70e4-4669-bd88-88a88a9d703e tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 10:39:03 user nova-compute[85141]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 10:39:03 user nova-compute[85141]:   <source dev="/dev/sdc"/>
Nov 16 10:39:03 user nova-compute[85141]:   <target dev="vdb" bus="virtio"/>
Nov 16 10:39:03 user nova-compute[85141]:   <serial>cf16006b-6529-45e8-8d9f-5414057f1769</serial>
Nov 16 10:39:03 user nova-compute[85141]: </disk>
Nov 16 10:39:03 user nova-compute[85141]:  {{(pid=85141) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 10:39:03 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-3fef5646-70e4-4669-bd88-88a88a9d703e tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] No BDM found with device name vda, not building metadata. {{(pid=85141) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 10:39:03 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-3fef5646-70e4-4669-bd88-88a88a9d703e tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] No BDM found with device name vdb, not building metadata. {{(pid=85141) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 10:39:03 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-3fef5646-70e4-4669-bd88-88a88a9d703e tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] No VIF found with MAC fa:16:3e:40:7a:69, not building metadata {{(pid=85141) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 10:39:03 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:39:03 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-3fef5646-70e4-4669-bd88-88a88a9d703e tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Lock "1e01e0e9-5eef-4af4-8633-814d59860b8d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.107s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:39:03 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:39:05 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-d9460f2d-44c3-4e2f-9817-a0dad205a22b tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Acquiring lock "1e01e0e9-5eef-4af4-8633-814d59860b8d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:39:05 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-d9460f2d-44c3-4e2f-9817-a0dad205a22b tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Lock "1e01e0e9-5eef-4af4-8633-814d59860b8d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:39:05 user nova-compute[85141]: INFO nova.compute.manager [None req-d9460f2d-44c3-4e2f-9817-a0dad205a22b tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] [instance: 1e01e0e9-5eef-4af4-8633-814d59860b8d] Detaching volume cf16006b-6529-45e8-8d9f-5414057f1769
Nov 16 10:39:05 user nova-compute[85141]: INFO nova.virt.block_device [None req-d9460f2d-44c3-4e2f-9817-a0dad205a22b tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] [instance: 1e01e0e9-5eef-4af4-8633-814d59860b8d] Attempting to driver detach volume cf16006b-6529-45e8-8d9f-5414057f1769 from mountpoint /dev/vdb
Nov 16 10:39:05 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-d9460f2d-44c3-4e2f-9817-a0dad205a22b tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Attempting to detach device vdb from instance 1e01e0e9-5eef-4af4-8633-814d59860b8d from the persistent domain config. {{(pid=85141) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 10:39:05 user nova-compute[85141]: DEBUG nova.virt.libvirt.guest [None req-d9460f2d-44c3-4e2f-9817-a0dad205a22b tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 10:39:05 user nova-compute[85141]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 10:39:05 user nova-compute[85141]:   <source dev="/dev/sdc"/>
Nov 16 10:39:05 user nova-compute[85141]:   <target dev="vdb" bus="virtio"/>
Nov 16 10:39:05 user nova-compute[85141]:   <serial>cf16006b-6529-45e8-8d9f-5414057f1769</serial>
Nov 16 10:39:05 user nova-compute[85141]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 10:39:05 user nova-compute[85141]: </disk>
Nov 16 10:39:05 user nova-compute[85141]:  {{(pid=85141) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 10:39:05 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-d9460f2d-44c3-4e2f-9817-a0dad205a22b tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Successfully detached device vdb from instance 1e01e0e9-5eef-4af4-8633-814d59860b8d from the persistent domain config.
Nov 16 10:39:05 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-d9460f2d-44c3-4e2f-9817-a0dad205a22b tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 1e01e0e9-5eef-4af4-8633-814d59860b8d from the live domain config. {{(pid=85141) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 10:39:05 user nova-compute[85141]: DEBUG nova.virt.libvirt.guest [None req-d9460f2d-44c3-4e2f-9817-a0dad205a22b tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 10:39:05 user nova-compute[85141]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 10:39:05 user nova-compute[85141]:   <source dev="/dev/sdc"/>
Nov 16 10:39:05 user nova-compute[85141]:   <target dev="vdb" bus="virtio"/>
Nov 16 10:39:05 user nova-compute[85141]:   <serial>cf16006b-6529-45e8-8d9f-5414057f1769</serial>
Nov 16 10:39:05 user nova-compute[85141]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 10:39:05 user nova-compute[85141]: </disk>
Nov 16 10:39:05 user nova-compute[85141]:  {{(pid=85141) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 10:39:06 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-d9460f2d-44c3-4e2f-9817-a0dad205a22b tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 1e01e0e9-5eef-4af4-8633-814d59860b8d {{(pid=85141) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 10:39:08 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:39:08 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:39:13 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:39:13 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:39:13 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=85141) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 10:39:13 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=85141) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 10:39:13 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=85141) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 10:39:13 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:39:18 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:39:23 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:39:26 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-d9460f2d-44c3-4e2f-9817-a0dad205a22b tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 1e01e0e9-5eef-4af4-8633-814d59860b8d is timed out.
Nov 16 10:39:26 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-d9460f2d-44c3-4e2f-9817-a0dad205a22b tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Successfully detached device vdb from instance 1e01e0e9-5eef-4af4-8633-814d59860b8d from the live domain config.
Nov 16 10:39:26 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d9460f2d-44c3-4e2f-9817-a0dad205a22b tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] [instance: 1e01e0e9-5eef-4af4-8633-814d59860b8d] calling os-brick to detach iSCSI Volume {{(pid=85141) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 10:39:26 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9460f2d-44c3-4e2f-9817-a0dad205a22b tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51806b6080>, {'target_iqn': 'iqn.2010-10.org.openstack:cf16006b-6529-45e8-8d9f-5414057f1769', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VBtRoQlO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 10:39:26 user nova-compute[85141]: WARNING os_brick.initiator.connectors.base [None req-d9460f2d-44c3-4e2f-9817-a0dad205a22b tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 10:39:26 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-d9460f2d-44c3-4e2f-9817-a0dad205a22b tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 10:39:26 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-d9460f2d-44c3-4e2f-9817-a0dad205a22b tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 10:39:26 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:39:26 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:39:26 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[643fd100-0143-4add-a3cb-6d87436ab6b9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:584dd8df-f6a2-4e35-be7e-8de1e759491b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cf16006b-6529-45e8-8d9f-5414057f1769\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a1f6cb5b-4d5a-4d88-8ef9-e209bbd8891d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:39:26 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9460f2d-44c3-4e2f-9817-a0dad205a22b tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 10:39:26 user nova-compute[85141]: No targets found.
Nov 16 10:39:26 user nova-compute[85141]: iSNS:
Nov 16 10:39:26 user nova-compute[85141]: No targets found.
Nov 16 10:39:26 user nova-compute[85141]: STATIC:
Nov 16 10:39:26 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:584dd8df-f6a2-4e35-be7e-8de1e759491b
Nov 16 10:39:26 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:39:26 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:39:26 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:cf16006b-6529-45e8-8d9f-5414057f1769
Nov 16 10:39:26 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:39:26 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:39:26 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:a1f6cb5b-4d5a-4d88-8ef9-e209bbd8891d
Nov 16 10:39:26 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:39:26 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:39:26 user nova-compute[85141]: FIRMWARE:
Nov 16 10:39:26 user nova-compute[85141]: No targets found.
Nov 16 10:39:26 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:39:26 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9460f2d-44c3-4e2f-9817-a0dad205a22b tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 10:39:26 user nova-compute[85141]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 10:39:26 user nova-compute[85141]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=85141) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 10:39:26 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9460f2d-44c3-4e2f-9817-a0dad205a22b tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cf16006b-6529-45e8-8d9f-5414057f1769', 0)] {{(pid=85141) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 10:39:26 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:39:26 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:39:26 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f7fc552-3bd0-4e3d-988c-87981ba694de]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:584dd8df-f6a2-4e35-be7e-8de1e759491b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a1f6cb5b-4d5a-4d88-8ef9-e209bbd8891d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cf16006b-6529-45e8-8d9f-5414057f1769\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:39:26 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:39:26 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:39:26 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b0a7884-3a08-46a6-a35c-189e068eeea2]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:584dd8df-f6a2-4e35-be7e-8de1e759491b (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1f6cb5b-4d5a-4d88-8ef9-e209bbd8891d (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf16006b-6529-45e8-8d9f-5414057f1769 (non-flash)\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:39:26 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9460f2d-44c3-4e2f-9817-a0dad205a22b tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:584dd8df-f6a2-4e35-be7e-8de1e759491b (non-flash)
Nov 16 10:39:26 user nova-compute[85141]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1f6cb5b-4d5a-4d88-8ef9-e209bbd8891d (non-flash)
Nov 16 10:39:26 user nova-compute[85141]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf16006b-6529-45e8-8d9f-5414057f1769 (non-flash)
Nov 16 10:39:26 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:39:26 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9460f2d-44c3-4e2f-9817-a0dad205a22b tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:584dd8df-f6a2-4e35-be7e-8de1e759491b (non-flash)
Nov 16 10:39:26 user nova-compute[85141]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1f6cb5b-4d5a-4d88-8ef9-e209bbd8891d (non-flash)
Nov 16 10:39:26 user nova-compute[85141]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf16006b-6529-45e8-8d9f-5414057f1769 (non-flash)
Nov 16 10:39:26 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 10:39:26 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9460f2d-44c3-4e2f-9817-a0dad205a22b tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f516075e710>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cf16006b-6529-45e8-8d9f-5414057f1769'): ({'sdc'}, set())}) {{(pid=85141) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 10:39:26 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-d9460f2d-44c3-4e2f-9817-a0dad205a22b tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Removing single pathed devices sdc {{(pid=85141) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 10:39:26 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:39:26 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:39:26 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0365b04-2a9d-4214-93a0-59708bd7b5f3]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:39:26 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:39:26 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.017s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:39:26 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[5773f737-2c2d-4242-a73f-701e87e547fa]: (4, ('ok\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:39:26 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-d9460f2d-44c3-4e2f-9817-a0dad205a22b tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Flushing IO for device /dev/sdc {{(pid=85141) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 10:39:26 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:39:26 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:39:26 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4347e34-5541-464b-82b0-1a06207b99ac]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:39:26 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-d9460f2d-44c3-4e2f-9817-a0dad205a22b tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=85141) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 10:39:26 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:39:26 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.042s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:39:26 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[d09ff4ed-25d3-407e-9927-37e69a456fc6]: (4, ('1', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:39:26 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-d9460f2d-44c3-4e2f-9817-a0dad205a22b tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=85141) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 10:39:26 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-d9460f2d-44c3-4e2f-9817-a0dad205a22b tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] SCSI volumes sdc have been removed. {{(pid=85141) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 10:39:26 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9460f2d-44c3-4e2f-9817-a0dad205a22b tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cf16006b-6529-45e8-8d9f-5414057f1769')] {{(pid=85141) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 10:39:26 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf16006b-6529-45e8-8d9f-5414057f1769 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:39:26 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf16006b-6529-45e8-8d9f-5414057f1769 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:39:26 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[079ad713-88fa-42f7-ad13-35e9f67cb594]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:39:26 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9460f2d-44c3-4e2f-9817-a0dad205a22b tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:39:26 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf16006b-6529-45e8-8d9f-5414057f1769 -p 172.16.0.220:3260 --logout {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:39:26 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf16006b-6529-45e8-8d9f-5414057f1769 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:39:26 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[f53c3dc4-4487-40e8-aee2-87eeea498fd1]: (4, ('Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:cf16006b-6529-45e8-8d9f-5414057f1769, portal: 172.16.0.220,3260]\nLogout of [sid: 59, target: iqn.2010-10.org.openstack:cf16006b-6529-45e8-8d9f-5414057f1769, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:39:26 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9460f2d-44c3-4e2f-9817-a0dad205a22b tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:cf16006b-6529-45e8-8d9f-5414057f1769, portal: 172.16.0.220,3260]
Nov 16 10:39:26 user nova-compute[85141]: Logout of [sid: 59, target: iqn.2010-10.org.openstack:cf16006b-6529-45e8-8d9f-5414057f1769, portal: 172.16.0.220,3260] successful.
Nov 16 10:39:26 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:39:26 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf16006b-6529-45e8-8d9f-5414057f1769 -p 172.16.0.220:3260 --op delete {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:39:26 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf16006b-6529-45e8-8d9f-5414057f1769 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:39:26 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5bcd8f4-bf2d-4754-8aa0-27b5bc26d965]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:39:26 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9460f2d-44c3-4e2f-9817-a0dad205a22b tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:39:26 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-d9460f2d-44c3-4e2f-9817-a0dad205a22b tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.297s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 10:39:26 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9460f2d-44c3-4e2f-9817-a0dad205a22b tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] <== disconnect_volume: return (298ms) None {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 10:39:26 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d9460f2d-44c3-4e2f-9817-a0dad205a22b tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] [instance: 1e01e0e9-5eef-4af4-8633-814d59860b8d] Disconnected iSCSI Volume {{(pid=85141) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 10:39:27 user nova-compute[85141]: DEBUG nova.objects.instance [None req-d9460f2d-44c3-4e2f-9817-a0dad205a22b tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Lazy-loading 'flavor' on Instance uuid 1e01e0e9-5eef-4af4-8633-814d59860b8d {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:39:27 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-d9460f2d-44c3-4e2f-9817-a0dad205a22b tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Lock "1e01e0e9-5eef-4af4-8633-814d59860b8d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.605s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:39:28 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:39:28 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:39:28 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=85141) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 10:39:28 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=85141) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 10:39:28 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=85141) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 10:39:28 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:39:33 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:39:33 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:39:33 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=85141) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 10:39:33 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=85141) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 10:39:33 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=85141) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 10:39:33 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:39:38 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:39:38 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:39:43 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:39:44 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:39:44 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Starting heal instance info cache {{(pid=85141) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 10:39:44 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Rebuilding the list of instances to heal {{(pid=85141) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 10:39:44 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Acquiring lock "refresh_cache-1e01e0e9-5eef-4af4-8633-814d59860b8d" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:39:44 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Acquired lock "refresh_cache-1e01e0e9-5eef-4af4-8633-814d59860b8d" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:39:44 user nova-compute[85141]: DEBUG nova.network.neutron [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] [instance: 1e01e0e9-5eef-4af4-8633-814d59860b8d] Forcefully refreshing network info cache for instance {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 10:39:44 user nova-compute[85141]: DEBUG nova.objects.instance [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lazy-loading 'info_cache' on Instance uuid 1e01e0e9-5eef-4af4-8633-814d59860b8d {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:39:44 user nova-compute[85141]: DEBUG nova.network.neutron [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] [instance: 1e01e0e9-5eef-4af4-8633-814d59860b8d] Updating instance_info_cache with network_info: [{"id": "6f4c8e31-7ee9-4257-9441-12fff78fb8d1", "address": "fa:16:3e:40:7a:69", "network": {"id": "609e6198-811e-4b40-a518-f960e9fc5b91", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1628388169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "647a6ef16a7b496a9568f9d777e38412", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f4c8e31-7e", "ovs_interfaceid": "6f4c8e31-7ee9-4257-9441-12fff78fb8d1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:39:44 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Releasing lock "refresh_cache-1e01e0e9-5eef-4af4-8633-814d59860b8d" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:39:44 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] [instance: 1e01e0e9-5eef-4af4-8633-814d59860b8d] Updated the network info_cache for instance {{(pid=85141) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 10:39:44 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:39:44 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=85141) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 10:39:45 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:39:45 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager.update_available_resource {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:39:45 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:39:45 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:39:45 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:39:45 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Auditing locally available compute resources for user (node: user) {{(pid=85141) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 10:39:45 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cafaf59-3cc9-4612-8da5-b2b60f8223e6/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:39:45 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cafaf59-3cc9-4612-8da5-b2b60f8223e6/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:39:45 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cafaf59-3cc9-4612-8da5-b2b60f8223e6/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:39:45 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cafaf59-3cc9-4612-8da5-b2b60f8223e6/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:39:45 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=85141) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 10:39:45 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=85141) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 10:39:45 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e01e0e9-5eef-4af4-8633-814d59860b8d/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:39:46 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e01e0e9-5eef-4af4-8633-814d59860b8d/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:39:46 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e01e0e9-5eef-4af4-8633-814d59860b8d/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:39:46 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e01e0e9-5eef-4af4-8633-814d59860b8d/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:39:46 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:39:46 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:39:46 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:39:46 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Hypervisor/Node resource view: name=user free_ram=8576MB free_disk=25.034927368164062GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=85141) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 10:39:46 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:39:46 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:39:46 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance 1e01e0e9-5eef-4af4-8633-814d59860b8d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:39:46 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance 797c873e-cf15-4d3c-a3bc-bd2a81a80014 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:39:46 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance d3d07af8-8d41-4b66-8cca-ab287972b17b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:39:46 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance 3cafaf59-3cc9-4612-8da5-b2b60f8223e6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:39:46 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=85141) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 10:39:46 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=85141) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 10:39:46 user nova-compute[85141]: DEBUG nova.compute.provider_tree [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Inventory has not changed in ProviderTree for provider: bf8e0fa1-16b6-408f-9203-c4cd63916272 {{(pid=85141) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 10:39:46 user nova-compute[85141]: DEBUG nova.scheduler.client.report [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Inventory has not changed for provider bf8e0fa1-16b6-408f-9203-c4cd63916272 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=85141) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 10:39:46 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Compute_service record updated for user:user {{(pid=85141) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 10:39:46 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.282s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:39:47 user nova-compute[85141]: DEBUG nova.compute.manager [req-fe00f819-8853-4994-98d5-3cf28a300de5 req-1f84de2b-6bac-4f34-b614-0f2144e43f11 service nova] [instance: d3d07af8-8d41-4b66-8cca-ab287972b17b] Received event network-changed-676170ef-d4ec-4bd6-95c4-0bde0f2950f9 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:39:47 user nova-compute[85141]: DEBUG nova.compute.manager [req-fe00f819-8853-4994-98d5-3cf28a300de5 req-1f84de2b-6bac-4f34-b614-0f2144e43f11 service nova] [instance: d3d07af8-8d41-4b66-8cca-ab287972b17b] Refreshing instance network info cache due to event network-changed-676170ef-d4ec-4bd6-95c4-0bde0f2950f9. {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 10:39:47 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-fe00f819-8853-4994-98d5-3cf28a300de5 req-1f84de2b-6bac-4f34-b614-0f2144e43f11 service nova] Acquiring lock "refresh_cache-d3d07af8-8d41-4b66-8cca-ab287972b17b" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:39:47 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-fe00f819-8853-4994-98d5-3cf28a300de5 req-1f84de2b-6bac-4f34-b614-0f2144e43f11 service nova] Acquired lock "refresh_cache-d3d07af8-8d41-4b66-8cca-ab287972b17b" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:39:47 user nova-compute[85141]: DEBUG nova.network.neutron [req-fe00f819-8853-4994-98d5-3cf28a300de5 req-1f84de2b-6bac-4f34-b614-0f2144e43f11 service nova] [instance: d3d07af8-8d41-4b66-8cca-ab287972b17b] Refreshing network info cache for port 676170ef-d4ec-4bd6-95c4-0bde0f2950f9 {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 10:39:47 user nova-compute[85141]: DEBUG nova.network.neutron [req-fe00f819-8853-4994-98d5-3cf28a300de5 req-1f84de2b-6bac-4f34-b614-0f2144e43f11 service nova] [instance: d3d07af8-8d41-4b66-8cca-ab287972b17b] Updated VIF entry in instance network info cache for port 676170ef-d4ec-4bd6-95c4-0bde0f2950f9. {{(pid=85141) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 10:39:47 user nova-compute[85141]: DEBUG nova.network.neutron [req-fe00f819-8853-4994-98d5-3cf28a300de5 req-1f84de2b-6bac-4f34-b614-0f2144e43f11 service nova] [instance: d3d07af8-8d41-4b66-8cca-ab287972b17b] Updating instance_info_cache with network_info: [{"id": "676170ef-d4ec-4bd6-95c4-0bde0f2950f9", "address": "fa:16:3e:19:81:9f", "network": {"id": "b8ada47f-9721-4358-ac4f-0305f06dbbb8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1663922860-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aec3bb9fe5e6446590900b5adf65df0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap676170ef-d4", "ovs_interfaceid": "676170ef-d4ec-4bd6-95c4-0bde0f2950f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:39:47 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-fe00f819-8853-4994-98d5-3cf28a300de5 req-1f84de2b-6bac-4f34-b614-0f2144e43f11 service nova] Releasing lock "refresh_cache-d3d07af8-8d41-4b66-8cca-ab287972b17b" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:39:47 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:39:48 user nova-compute[85141]: DEBUG nova.compute.manager [req-7fd1599c-9c69-435a-a30e-542b11cd3280 req-c0522bb3-2ddd-4b9e-a4e8-c4c9e6660f2f service nova] [instance: d3d07af8-8d41-4b66-8cca-ab287972b17b] Received event network-changed-676170ef-d4ec-4bd6-95c4-0bde0f2950f9 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:39:48 user nova-compute[85141]: DEBUG nova.compute.manager [req-7fd1599c-9c69-435a-a30e-542b11cd3280 req-c0522bb3-2ddd-4b9e-a4e8-c4c9e6660f2f service nova] [instance: d3d07af8-8d41-4b66-8cca-ab287972b17b] Refreshing instance network info cache due to event network-changed-676170ef-d4ec-4bd6-95c4-0bde0f2950f9. {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 10:39:48 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-7fd1599c-9c69-435a-a30e-542b11cd3280 req-c0522bb3-2ddd-4b9e-a4e8-c4c9e6660f2f service nova] Acquiring lock "refresh_cache-d3d07af8-8d41-4b66-8cca-ab287972b17b" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:39:48 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-7fd1599c-9c69-435a-a30e-542b11cd3280 req-c0522bb3-2ddd-4b9e-a4e8-c4c9e6660f2f service nova] Acquired lock "refresh_cache-d3d07af8-8d41-4b66-8cca-ab287972b17b" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:39:48 user nova-compute[85141]: DEBUG nova.network.neutron [req-7fd1599c-9c69-435a-a30e-542b11cd3280 req-c0522bb3-2ddd-4b9e-a4e8-c4c9e6660f2f service nova] [instance: d3d07af8-8d41-4b66-8cca-ab287972b17b] Refreshing network info cache for port 676170ef-d4ec-4bd6-95c4-0bde0f2950f9 {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 10:39:48 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-97efb166-dcc1-4c3b-be3e-3a4a1d37dc72 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Acquiring lock "d3d07af8-8d41-4b66-8cca-ab287972b17b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:39:48 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-97efb166-dcc1-4c3b-be3e-3a4a1d37dc72 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Lock "d3d07af8-8d41-4b66-8cca-ab287972b17b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:39:48 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-97efb166-dcc1-4c3b-be3e-3a4a1d37dc72 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Acquiring lock "d3d07af8-8d41-4b66-8cca-ab287972b17b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:39:48 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-97efb166-dcc1-4c3b-be3e-3a4a1d37dc72 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Lock "d3d07af8-8d41-4b66-8cca-ab287972b17b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:39:48 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-97efb166-dcc1-4c3b-be3e-3a4a1d37dc72 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Lock "d3d07af8-8d41-4b66-8cca-ab287972b17b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:39:48 user nova-compute[85141]: INFO nova.compute.manager [None req-97efb166-dcc1-4c3b-be3e-3a4a1d37dc72 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: d3d07af8-8d41-4b66-8cca-ab287972b17b] Terminating instance
Nov 16 10:39:48 user nova-compute[85141]: DEBUG nova.compute.manager [None req-97efb166-dcc1-4c3b-be3e-3a4a1d37dc72 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: d3d07af8-8d41-4b66-8cca-ab287972b17b] Start destroying the instance on the hypervisor. {{(pid=85141) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 10:39:48 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:39:48 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:39:48 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:39:48 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:39:48 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:39:48 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:39:48 user nova-compute[85141]: INFO nova.virt.libvirt.driver [-] [instance: d3d07af8-8d41-4b66-8cca-ab287972b17b] Instance destroyed successfully.
Nov 16 10:39:48 user nova-compute[85141]: DEBUG nova.objects.instance [None req-97efb166-dcc1-4c3b-be3e-3a4a1d37dc72 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Lazy-loading 'resources' on Instance uuid d3d07af8-8d41-4b66-8cca-ab287972b17b {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:39:48 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-97efb166-dcc1-4c3b-be3e-3a4a1d37dc72 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T10:37:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1713825540',display_name='tempest-TestVolumeBootPattern-server-1713825540',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1713825540',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK2tiQ/yBbFjZdjBIR2tKrAVD3soVHRqo5J6ZL2tZkf+/CHlij0TJEEFuVTAcbccfWNw+REn7xM/u4NrsIPLxGXc8EfsNWZLl3/YiEOdS+xhO6c08a6foGqxQYJ8pZUDrQ==',key_name='tempest-TestVolumeBootPattern-1363391981',keypairs=<?>,launch_index=0,launched_at=2023-11-16T10:38:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='aec3bb9fe5e6446590900b5adf65df0f',ramdisk_id='',reservation_id='r-5ajvf2hq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1979039357',owner_user_name='tempest-TestVolumeBootPattern-1979039357-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T10:38:07Z,user_data=None,user_id='7261b57c36904fcda87a9ea32d4b5b31',uuid=d3d07af8-8d41-4b66-8cca-ab287972b17b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "676170ef-d4ec-4bd6-95c4-0bde0f2950f9", "address": "fa:16:3e:19:81:9f", "network": {"id": "b8ada47f-9721-4358-ac4f-0305f06dbbb8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1663922860-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aec3bb9fe5e6446590900b5adf65df0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap676170ef-d4", "ovs_interfaceid": "676170ef-d4ec-4bd6-95c4-0bde0f2950f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 10:39:48 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-97efb166-dcc1-4c3b-be3e-3a4a1d37dc72 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Converting VIF {"id": "676170ef-d4ec-4bd6-95c4-0bde0f2950f9", "address": "fa:16:3e:19:81:9f", "network": {"id": "b8ada47f-9721-4358-ac4f-0305f06dbbb8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1663922860-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aec3bb9fe5e6446590900b5adf65df0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap676170ef-d4", "ovs_interfaceid": "676170ef-d4ec-4bd6-95c4-0bde0f2950f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:39:48 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-97efb166-dcc1-4c3b-be3e-3a4a1d37dc72 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:19:81:9f,bridge_name='br-int',has_traffic_filtering=True,id=676170ef-d4ec-4bd6-95c4-0bde0f2950f9,network=Network(b8ada47f-9721-4358-ac4f-0305f06dbbb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap676170ef-d4') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:39:48 user nova-compute[85141]: DEBUG os_vif [None req-97efb166-dcc1-4c3b-be3e-3a4a1d37dc72 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:19:81:9f,bridge_name='br-int',has_traffic_filtering=True,id=676170ef-d4ec-4bd6-95c4-0bde0f2950f9,network=Network(b8ada47f-9721-4358-ac4f-0305f06dbbb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap676170ef-d4') {{(pid=85141) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 10:39:48 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:39:48 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap676170ef-d4, bridge=br-int, if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:39:48 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:39:48 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:39:48 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=121a53ff-2619-4dee-bc21-b594e857bf1b) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:39:48 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:39:48 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:39:48 user nova-compute[85141]: DEBUG nova.network.neutron [req-7fd1599c-9c69-435a-a30e-542b11cd3280 req-c0522bb3-2ddd-4b9e-a4e8-c4c9e6660f2f service nova] [instance: d3d07af8-8d41-4b66-8cca-ab287972b17b] Updated VIF entry in instance network info cache for port 676170ef-d4ec-4bd6-95c4-0bde0f2950f9. {{(pid=85141) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 10:39:48 user nova-compute[85141]: DEBUG nova.network.neutron [req-7fd1599c-9c69-435a-a30e-542b11cd3280 req-c0522bb3-2ddd-4b9e-a4e8-c4c9e6660f2f service nova] [instance: d3d07af8-8d41-4b66-8cca-ab287972b17b] Updating instance_info_cache with network_info: [{"id": "676170ef-d4ec-4bd6-95c4-0bde0f2950f9", "address": "fa:16:3e:19:81:9f", "network": {"id": "b8ada47f-9721-4358-ac4f-0305f06dbbb8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1663922860-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aec3bb9fe5e6446590900b5adf65df0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap676170ef-d4", "ovs_interfaceid": "676170ef-d4ec-4bd6-95c4-0bde0f2950f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:39:48 user nova-compute[85141]: INFO os_vif [None req-97efb166-dcc1-4c3b-be3e-3a4a1d37dc72 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:19:81:9f,bridge_name='br-int',has_traffic_filtering=True,id=676170ef-d4ec-4bd6-95c4-0bde0f2950f9,network=Network(b8ada47f-9721-4358-ac4f-0305f06dbbb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap676170ef-d4')
Nov 16 10:39:48 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-97efb166-dcc1-4c3b-be3e-3a4a1d37dc72 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: d3d07af8-8d41-4b66-8cca-ab287972b17b] calling os-brick to detach iSCSI Volume {{(pid=85141) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 10:39:48 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-97efb166-dcc1-4c3b-be3e-3a4a1d37dc72 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51806b6080>, {'target_iqn': 'iqn.2010-10.org.openstack:a1f6cb5b-4d5a-4d88-8ef9-e209bbd8891d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AEhiBdfj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 10:39:48 user nova-compute[85141]: WARNING os_brick.initiator.connectors.base [None req-97efb166-dcc1-4c3b-be3e-3a4a1d37dc72 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 10:39:48 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-97efb166-dcc1-4c3b-be3e-3a4a1d37dc72 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 10:39:48 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-97efb166-dcc1-4c3b-be3e-3a4a1d37dc72 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 10:39:48 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:39:48 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-7fd1599c-9c69-435a-a30e-542b11cd3280 req-c0522bb3-2ddd-4b9e-a4e8-c4c9e6660f2f service nova] Releasing lock "refresh_cache-d3d07af8-8d41-4b66-8cca-ab287972b17b" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:39:48 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:39:48 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[8450e726-acce-4a03-aca1-412fd451d41a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:584dd8df-f6a2-4e35-be7e-8de1e759491b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a1f6cb5b-4d5a-4d88-8ef9-e209bbd8891d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:39:48 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-97efb166-dcc1-4c3b-be3e-3a4a1d37dc72 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 10:39:48 user nova-compute[85141]: No targets found.
Nov 16 10:39:48 user nova-compute[85141]: iSNS:
Nov 16 10:39:48 user nova-compute[85141]: No targets found.
Nov 16 10:39:48 user nova-compute[85141]: STATIC:
Nov 16 10:39:48 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:584dd8df-f6a2-4e35-be7e-8de1e759491b
Nov 16 10:39:48 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:39:48 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:39:48 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:a1f6cb5b-4d5a-4d88-8ef9-e209bbd8891d
Nov 16 10:39:48 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:39:48 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:39:48 user nova-compute[85141]: FIRMWARE:
Nov 16 10:39:48 user nova-compute[85141]: No targets found.
Nov 16 10:39:48 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:39:48 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-97efb166-dcc1-4c3b-be3e-3a4a1d37dc72 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 10:39:48 user nova-compute[85141]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 10:39:48 user nova-compute[85141]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=85141) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 10:39:48 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-97efb166-dcc1-4c3b-be3e-3a4a1d37dc72 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a1f6cb5b-4d5a-4d88-8ef9-e209bbd8891d', 0)] {{(pid=85141) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 10:39:48 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:39:48 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:39:48 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[245ee3d8-089c-4c51-97e9-1d2c82784cd5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:584dd8df-f6a2-4e35-be7e-8de1e759491b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a1f6cb5b-4d5a-4d88-8ef9-e209bbd8891d\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:39:48 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:39:48 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:39:48 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccb130f3-8734-4df1-9bf8-588b68a50b47]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:584dd8df-f6a2-4e35-be7e-8de1e759491b (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1f6cb5b-4d5a-4d88-8ef9-e209bbd8891d (non-flash)\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:39:48 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-97efb166-dcc1-4c3b-be3e-3a4a1d37dc72 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:584dd8df-f6a2-4e35-be7e-8de1e759491b (non-flash)
Nov 16 10:39:48 user nova-compute[85141]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1f6cb5b-4d5a-4d88-8ef9-e209bbd8891d (non-flash)
Nov 16 10:39:48 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:39:48 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-97efb166-dcc1-4c3b-be3e-3a4a1d37dc72 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:584dd8df-f6a2-4e35-be7e-8de1e759491b (non-flash)
Nov 16 10:39:48 user nova-compute[85141]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1f6cb5b-4d5a-4d88-8ef9-e209bbd8891d (non-flash)
Nov 16 10:39:48 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 10:39:48 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-97efb166-dcc1-4c3b-be3e-3a4a1d37dc72 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f516056caf0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a1f6cb5b-4d5a-4d88-8ef9-e209bbd8891d'): ({'sdd'}, set())}) {{(pid=85141) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 10:39:48 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-97efb166-dcc1-4c3b-be3e-3a4a1d37dc72 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Removing single pathed devices sdd {{(pid=85141) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 10:39:48 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:39:49 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:39:49 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[44fb2ad8-f81d-47a4-b2a5-52b74df89a6c]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:39:49 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:39:49 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.022s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:39:49 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[07f69d67-fa18-493e-8adb-05c411dcf9f0]: (4, ('ok\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:39:49 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-97efb166-dcc1-4c3b-be3e-3a4a1d37dc72 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Flushing IO for device /dev/sdd {{(pid=85141) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 10:39:49 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:39:49 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:39:49 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5535dfb-1a4c-4a3a-a16d-eeb983a37b17]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:39:49 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-97efb166-dcc1-4c3b-be3e-3a4a1d37dc72 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=85141) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 10:39:49 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:39:49 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.042s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:39:49 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[04dc8027-bff0-4b35-aa15-5b7247fd875c]: (4, ('1', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:39:49 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-97efb166-dcc1-4c3b-be3e-3a4a1d37dc72 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=85141) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 10:39:49 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-97efb166-dcc1-4c3b-be3e-3a4a1d37dc72 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] SCSI volumes sdd have been removed. {{(pid=85141) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 10:39:49 user nova-compute[85141]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_d0680903', '/dev/disk/by-id/scsi-1SCST_BIOd0680903-1dd1f2182e7ec803', '/dev/disk/by-id/scsi-23164643166323138') {{(pid=95342) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 16 10:39:49 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[da048cac-6c44-4047-a21b-630f5a012b7e]: (4, None) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:39:49 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-97efb166-dcc1-4c3b-be3e-3a4a1d37dc72 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a1f6cb5b-4d5a-4d88-8ef9-e209bbd8891d')] {{(pid=85141) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 10:39:49 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1f6cb5b-4d5a-4d88-8ef9-e209bbd8891d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:39:49 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1f6cb5b-4d5a-4d88-8ef9-e209bbd8891d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:39:49 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[d88fa432-09b4-4c13-b775-7c2fcdee3b40]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:39:49 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-97efb166-dcc1-4c3b-be3e-3a4a1d37dc72 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:39:49 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1f6cb5b-4d5a-4d88-8ef9-e209bbd8891d -p 172.16.0.220:3260 --logout {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:39:49 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1f6cb5b-4d5a-4d88-8ef9-e209bbd8891d -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:39:49 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[644811fc-94ad-4f07-ae95-96ecb5c23f29]: (4, ('Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:a1f6cb5b-4d5a-4d88-8ef9-e209bbd8891d, portal: 172.16.0.220,3260]\nLogout of [sid: 58, target: iqn.2010-10.org.openstack:a1f6cb5b-4d5a-4d88-8ef9-e209bbd8891d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:39:49 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-97efb166-dcc1-4c3b-be3e-3a4a1d37dc72 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:a1f6cb5b-4d5a-4d88-8ef9-e209bbd8891d, portal: 172.16.0.220,3260]
Nov 16 10:39:49 user nova-compute[85141]: Logout of [sid: 58, target: iqn.2010-10.org.openstack:a1f6cb5b-4d5a-4d88-8ef9-e209bbd8891d, portal: 172.16.0.220,3260] successful.
Nov 16 10:39:49 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:39:49 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1f6cb5b-4d5a-4d88-8ef9-e209bbd8891d -p 172.16.0.220:3260 --op delete {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:39:49 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1f6cb5b-4d5a-4d88-8ef9-e209bbd8891d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:39:49 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d1e8655-2980-4701-90d8-29ad0f17f5c2]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:39:49 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-97efb166-dcc1-4c3b-be3e-3a4a1d37dc72 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:39:49 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-97efb166-dcc1-4c3b-be3e-3a4a1d37dc72 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.297s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 10:39:49 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-97efb166-dcc1-4c3b-be3e-3a4a1d37dc72 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] <== disconnect_volume: return (299ms) None {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 10:39:49 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-97efb166-dcc1-4c3b-be3e-3a4a1d37dc72 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: d3d07af8-8d41-4b66-8cca-ab287972b17b] Disconnected iSCSI Volume {{(pid=85141) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 10:39:49 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-97efb166-dcc1-4c3b-be3e-3a4a1d37dc72 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: d3d07af8-8d41-4b66-8cca-ab287972b17b] Deleting instance files /opt/stack/data/nova/instances/d3d07af8-8d41-4b66-8cca-ab287972b17b_del
Nov 16 10:39:49 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-97efb166-dcc1-4c3b-be3e-3a4a1d37dc72 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: d3d07af8-8d41-4b66-8cca-ab287972b17b] Deletion of /opt/stack/data/nova/instances/d3d07af8-8d41-4b66-8cca-ab287972b17b_del complete
Nov 16 10:39:49 user nova-compute[85141]: INFO nova.compute.manager [None req-97efb166-dcc1-4c3b-be3e-3a4a1d37dc72 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: d3d07af8-8d41-4b66-8cca-ab287972b17b] Took 1.16 seconds to destroy the instance on the hypervisor.
Nov 16 10:39:49 user nova-compute[85141]: DEBUG oslo.service.loopingcall [None req-97efb166-dcc1-4c3b-be3e-3a4a1d37dc72 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=85141) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 10:39:49 user nova-compute[85141]: DEBUG nova.compute.manager [-] [instance: d3d07af8-8d41-4b66-8cca-ab287972b17b] Deallocating network for instance {{(pid=85141) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 10:39:49 user nova-compute[85141]: DEBUG nova.network.neutron [-] [instance: d3d07af8-8d41-4b66-8cca-ab287972b17b] deallocate_for_instance() {{(pid=85141) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 10:39:49 user nova-compute[85141]: DEBUG nova.network.neutron [-] [instance: d3d07af8-8d41-4b66-8cca-ab287972b17b] Updating instance_info_cache with network_info: [] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:39:49 user nova-compute[85141]: INFO nova.compute.manager [-] [instance: d3d07af8-8d41-4b66-8cca-ab287972b17b] Took 0.41 seconds to deallocate network for instance.
Nov 16 10:39:49 user nova-compute[85141]: DEBUG nova.compute.manager [req-78617790-0bbd-4776-8dcd-7387ccd4de40 req-1b533410-0fed-4fdd-87bf-9de1c35f998a service nova] [instance: d3d07af8-8d41-4b66-8cca-ab287972b17b] Received event network-vif-deleted-676170ef-d4ec-4bd6-95c4-0bde0f2950f9 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:39:49 user nova-compute[85141]: INFO nova.compute.manager [req-78617790-0bbd-4776-8dcd-7387ccd4de40 req-1b533410-0fed-4fdd-87bf-9de1c35f998a service nova] [instance: d3d07af8-8d41-4b66-8cca-ab287972b17b] Neutron deleted interface 676170ef-d4ec-4bd6-95c4-0bde0f2950f9; detaching it from the instance and deleting it from the info cache
Nov 16 10:39:49 user nova-compute[85141]: DEBUG nova.network.neutron [req-78617790-0bbd-4776-8dcd-7387ccd4de40 req-1b533410-0fed-4fdd-87bf-9de1c35f998a service nova] [instance: d3d07af8-8d41-4b66-8cca-ab287972b17b] Updating instance_info_cache with network_info: [] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:39:49 user nova-compute[85141]: DEBUG nova.compute.manager [req-78617790-0bbd-4776-8dcd-7387ccd4de40 req-1b533410-0fed-4fdd-87bf-9de1c35f998a service nova] [instance: d3d07af8-8d41-4b66-8cca-ab287972b17b] Detach interface failed, port_id=676170ef-d4ec-4bd6-95c4-0bde0f2950f9, reason: Instance d3d07af8-8d41-4b66-8cca-ab287972b17b could not be found. {{(pid=85141) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 16 10:39:50 user nova-compute[85141]: DEBUG nova.compute.manager [req-52ad23d4-c5ca-4989-8bc6-d432cbf9640e req-8042fc78-b557-4f8b-b5b9-391dc20d2d01 service nova] [instance: d3d07af8-8d41-4b66-8cca-ab287972b17b] Received event network-vif-unplugged-676170ef-d4ec-4bd6-95c4-0bde0f2950f9 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:39:50 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-52ad23d4-c5ca-4989-8bc6-d432cbf9640e req-8042fc78-b557-4f8b-b5b9-391dc20d2d01 service nova] Acquiring lock "d3d07af8-8d41-4b66-8cca-ab287972b17b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:39:50 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-52ad23d4-c5ca-4989-8bc6-d432cbf9640e req-8042fc78-b557-4f8b-b5b9-391dc20d2d01 service nova] Lock "d3d07af8-8d41-4b66-8cca-ab287972b17b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:39:50 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-52ad23d4-c5ca-4989-8bc6-d432cbf9640e req-8042fc78-b557-4f8b-b5b9-391dc20d2d01 service nova] Lock "d3d07af8-8d41-4b66-8cca-ab287972b17b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:39:50 user nova-compute[85141]: DEBUG nova.compute.manager [req-52ad23d4-c5ca-4989-8bc6-d432cbf9640e req-8042fc78-b557-4f8b-b5b9-391dc20d2d01 service nova] [instance: d3d07af8-8d41-4b66-8cca-ab287972b17b] No waiting events found dispatching network-vif-unplugged-676170ef-d4ec-4bd6-95c4-0bde0f2950f9 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:39:50 user nova-compute[85141]: DEBUG nova.compute.manager [req-52ad23d4-c5ca-4989-8bc6-d432cbf9640e req-8042fc78-b557-4f8b-b5b9-391dc20d2d01 service nova] [instance: d3d07af8-8d41-4b66-8cca-ab287972b17b] Received event network-vif-unplugged-676170ef-d4ec-4bd6-95c4-0bde0f2950f9 for instance with task_state deleting. {{(pid=85141) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 10:39:50 user nova-compute[85141]: DEBUG nova.compute.manager [req-52ad23d4-c5ca-4989-8bc6-d432cbf9640e req-8042fc78-b557-4f8b-b5b9-391dc20d2d01 service nova] [instance: d3d07af8-8d41-4b66-8cca-ab287972b17b] Received event network-vif-plugged-676170ef-d4ec-4bd6-95c4-0bde0f2950f9 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:39:50 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-52ad23d4-c5ca-4989-8bc6-d432cbf9640e req-8042fc78-b557-4f8b-b5b9-391dc20d2d01 service nova] Acquiring lock "d3d07af8-8d41-4b66-8cca-ab287972b17b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:39:50 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-52ad23d4-c5ca-4989-8bc6-d432cbf9640e req-8042fc78-b557-4f8b-b5b9-391dc20d2d01 service nova] Lock "d3d07af8-8d41-4b66-8cca-ab287972b17b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:39:50 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-52ad23d4-c5ca-4989-8bc6-d432cbf9640e req-8042fc78-b557-4f8b-b5b9-391dc20d2d01 service nova] Lock "d3d07af8-8d41-4b66-8cca-ab287972b17b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:39:50 user nova-compute[85141]: DEBUG nova.compute.manager [req-52ad23d4-c5ca-4989-8bc6-d432cbf9640e req-8042fc78-b557-4f8b-b5b9-391dc20d2d01 service nova] [instance: d3d07af8-8d41-4b66-8cca-ab287972b17b] No waiting events found dispatching network-vif-plugged-676170ef-d4ec-4bd6-95c4-0bde0f2950f9 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:39:50 user nova-compute[85141]: WARNING nova.compute.manager [req-52ad23d4-c5ca-4989-8bc6-d432cbf9640e req-8042fc78-b557-4f8b-b5b9-391dc20d2d01 service nova] [instance: d3d07af8-8d41-4b66-8cca-ab287972b17b] Received unexpected event network-vif-plugged-676170ef-d4ec-4bd6-95c4-0bde0f2950f9 for instance with vm_state active and task_state deleting.
Nov 16 10:39:50 user nova-compute[85141]: INFO nova.compute.manager [None req-97efb166-dcc1-4c3b-be3e-3a4a1d37dc72 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: d3d07af8-8d41-4b66-8cca-ab287972b17b] Took 0.77 seconds to detach 1 volumes for instance.
Nov 16 10:39:50 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-97efb166-dcc1-4c3b-be3e-3a4a1d37dc72 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:39:50 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-97efb166-dcc1-4c3b-be3e-3a4a1d37dc72 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:39:50 user nova-compute[85141]: DEBUG nova.compute.provider_tree [None req-97efb166-dcc1-4c3b-be3e-3a4a1d37dc72 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Inventory has not changed in ProviderTree for provider: bf8e0fa1-16b6-408f-9203-c4cd63916272 {{(pid=85141) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 10:39:50 user nova-compute[85141]: DEBUG nova.scheduler.client.report [None req-97efb166-dcc1-4c3b-be3e-3a4a1d37dc72 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Inventory has not changed for provider bf8e0fa1-16b6-408f-9203-c4cd63916272 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=85141) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 10:39:50 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-97efb166-dcc1-4c3b-be3e-3a4a1d37dc72 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.174s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:39:50 user nova-compute[85141]: INFO nova.scheduler.client.report [None req-97efb166-dcc1-4c3b-be3e-3a4a1d37dc72 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Deleted allocations for instance d3d07af8-8d41-4b66-8cca-ab287972b17b
Nov 16 10:39:50 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-97efb166-dcc1-4c3b-be3e-3a4a1d37dc72 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Lock "d3d07af8-8d41-4b66-8cca-ab287972b17b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.691s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:39:52 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:39:52 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:39:53 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:39:55 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:39:57 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-6ed7587b-57af-4a53-9c54-9342b6063c90 tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Acquiring lock "1e01e0e9-5eef-4af4-8633-814d59860b8d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:39:57 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-6ed7587b-57af-4a53-9c54-9342b6063c90 tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Lock "1e01e0e9-5eef-4af4-8633-814d59860b8d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:39:57 user nova-compute[85141]: DEBUG nova.objects.instance [None req-6ed7587b-57af-4a53-9c54-9342b6063c90 tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Lazy-loading 'flavor' on Instance uuid 1e01e0e9-5eef-4af4-8633-814d59860b8d {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:39:57 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-6ed7587b-57af-4a53-9c54-9342b6063c90 tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Lock "1e01e0e9-5eef-4af4-8633-814d59860b8d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:39:58 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-6ed7587b-57af-4a53-9c54-9342b6063c90 tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Acquiring lock "1e01e0e9-5eef-4af4-8633-814d59860b8d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:39:58 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-6ed7587b-57af-4a53-9c54-9342b6063c90 tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Lock "1e01e0e9-5eef-4af4-8633-814d59860b8d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:39:58 user nova-compute[85141]: INFO nova.compute.manager [None req-6ed7587b-57af-4a53-9c54-9342b6063c90 tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] [instance: 1e01e0e9-5eef-4af4-8633-814d59860b8d] Attaching volume 71606958-b9e5-4da7-bbd0-a81343120655 to /dev/vdb
Nov 16 10:39:58 user nova-compute[85141]: DEBUG os_brick.utils [None req-6ed7587b-57af-4a53-9c54-9342b6063c90 tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 10:39:58 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:39:58 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:39:58 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e94dcd4-3ae0-4c04-bd79-f67e1956d942]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c7834de5c295\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:39:58 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:39:58 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:39:58 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[db01de05-4599-4375-91da-132cb980dd1e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:39:58 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:39:58 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:39:58 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fbf640a-76c0-46e8-bfb1-d8a47b3f01ed]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:39:58 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a9a53ff-d48e-4b43-9d7d-c0970f6c726b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:39:58 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-6ed7587b-57af-4a53-9c54-9342b6063c90 tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Running cmd (subprocess): nvme version {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:39:58 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-6ed7587b-57af-4a53-9c54-9342b6063c90 tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] 'nvme version' failed. Not Retrying. {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 10:39:58 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6ed7587b-57af-4a53-9c54-9342b6063c90 tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] nvme not present on system {{(pid=85141) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 10:39:58 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:39:58 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 10:39:58 user nova-compute[85141]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 10:39:58 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e98c8ea-35d0-47ec-b9da-b2c210ebc815]: (4, '') {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:39:58 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.lightos [None req-6ed7587b-57af-4a53-9c54-9342b6063c90 tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=85141) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 10:39:58 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.lightos [None req-6ed7587b-57af-4a53-9c54-9342b6063c90 tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=85141) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 10:39:58 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.lightos [None req-6ed7587b-57af-4a53-9c54-9342b6063c90 tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] LIGHTOS: no hostnqn found. {{(pid=85141) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 10:39:58 user nova-compute[85141]: DEBUG os_brick.utils [None req-6ed7587b-57af-4a53-9c54-9342b6063c90 tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c7834de5c295', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 10:39:58 user nova-compute[85141]: DEBUG nova.virt.block_device [None req-6ed7587b-57af-4a53-9c54-9342b6063c90 tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] [instance: 1e01e0e9-5eef-4af4-8633-814d59860b8d] Updating existing volume attachment record: cd4a2b86-5999-4080-8a23-22346d45d1ff {{(pid=85141) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 10:39:58 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:39:58 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:40:02 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6ed7587b-57af-4a53-9c54-9342b6063c90 tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] [instance: 1e01e0e9-5eef-4af4-8633-814d59860b8d] Calling os-brick to attach iSCSI Volume {{(pid=85141) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 10:40:02 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ed7587b-57af-4a53-9c54-9342b6063c90 tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51806b6080>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:71606958-b9e5-4da7-bbd0-a81343120655', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EIwlGxVQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 10:40:02 user nova-compute[85141]: WARNING os_brick.initiator.connectors.base [None req-6ed7587b-57af-4a53-9c54-9342b6063c90 tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 10:40:02 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-6ed7587b-57af-4a53-9c54-9342b6063c90 tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 10:40:02 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-6ed7587b-57af-4a53-9c54-9342b6063c90 tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 10:40:02 user nova-compute[85141]: WARNING os_brick.initiator.connectors.base [None req-6ed7587b-57af-4a53-9c54-9342b6063c90 tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 10:40:02 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-6ed7587b-57af-4a53-9c54-9342b6063c90 tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:71606958-b9e5-4da7-bbd0-a81343120655" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 10:40:02 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-6ed7587b-57af-4a53-9c54-9342b6063c90 tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:71606958-b9e5-4da7-bbd0-a81343120655" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 10:40:02 user nova-compute[85141]: INFO os_brick.initiator.connectors.iscsi [None req-6ed7587b-57af-4a53-9c54-9342b6063c90 tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 10:40:02 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71606958-b9e5-4da7-bbd0-a81343120655 -p 172.16.0.220:3260 {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:40:02 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71606958-b9e5-4da7-bbd0-a81343120655 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:40:02 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[d488f75a-b25f-409a-8303-231104b56b86]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:40:02 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ed7587b-57af-4a53-9c54-9342b6063c90 tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 10:40:02 user nova-compute[85141]:  {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:40:02 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71606958-b9e5-4da7-bbd0-a81343120655 -p 172.16.0.220:3260 --interface default --op new {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:40:02 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71606958-b9e5-4da7-bbd0-a81343120655 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:40:02 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[79a80aac-d71f-413a-a355-708b0d562c56]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:71606958-b9e5-4da7-bbd0-a81343120655] added\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:40:02 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ed7587b-57af-4a53-9c54-9342b6063c90 tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:71606958-b9e5-4da7-bbd0-a81343120655] added
Nov 16 10:40:02 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:40:02 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71606958-b9e5-4da7-bbd0-a81343120655 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:40:02 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71606958-b9e5-4da7-bbd0-a81343120655 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:40:02 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[8742cf49-11ab-4f54-ab39-aeea46ba808e]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:40:02 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ed7587b-57af-4a53-9c54-9342b6063c90 tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:40:02 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71606958-b9e5-4da7-bbd0-a81343120655 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:40:02 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71606958-b9e5-4da7-bbd0-a81343120655 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:40:02 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[1600207d-1a52-4bc0-90dc-105ce8acd1c6]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:40:02 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ed7587b-57af-4a53-9c54-9342b6063c90 tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:40:02 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71606958-b9e5-4da7-bbd0-a81343120655 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EIwlGxVQ {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:40:03 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71606958-b9e5-4da7-bbd0-a81343120655 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EIwlGxVQ" returned: 0 in 0.017s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:40:03 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7197d1e-e1ad-4964-8ecd-6c82727307c5]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:40:03 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ed7587b-57af-4a53-9c54-9342b6063c90 tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EIwlGxVQ'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:40:03 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71606958-b9e5-4da7-bbd0-a81343120655 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:40:03 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71606958-b9e5-4da7-bbd0-a81343120655 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:40:03 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb8f3863-ad75-4302-a750-756f615c99d8]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:40:03 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ed7587b-57af-4a53-9c54-9342b6063c90 tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:40:03 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:40:03 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:40:03 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d27a179-f17f-4d80-a9de-fb5b411a8da5]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:584dd8df-f6a2-4e35-be7e-8de1e759491b (non-flash)\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:40:03 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ed7587b-57af-4a53-9c54-9342b6063c90 tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:584dd8df-f6a2-4e35-be7e-8de1e759491b (non-flash)
Nov 16 10:40:03 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:40:03 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ed7587b-57af-4a53-9c54-9342b6063c90 tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:584dd8df-f6a2-4e35-be7e-8de1e759491b (non-flash)
Nov 16 10:40:03 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 10:40:03 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71606958-b9e5-4da7-bbd0-a81343120655 -p 172.16.0.220:3260 --login {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:40:03 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71606958-b9e5-4da7-bbd0-a81343120655 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:40:03 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ca7e1f7-61ba-4508-b429-763c1a41c981]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:71606958-b9e5-4da7-bbd0-a81343120655, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:71606958-b9e5-4da7-bbd0-a81343120655, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:40:03 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ed7587b-57af-4a53-9c54-9342b6063c90 tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:71606958-b9e5-4da7-bbd0-a81343120655, portal: 172.16.0.220,3260]
Nov 16 10:40:03 user nova-compute[85141]: Login to [iface: default, target: iqn.2010-10.org.openstack:71606958-b9e5-4da7-bbd0-a81343120655, portal: 172.16.0.220,3260] successful.
Nov 16 10:40:03 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:40:03 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71606958-b9e5-4da7-bbd0-a81343120655 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:40:03 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71606958-b9e5-4da7-bbd0-a81343120655 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:40:03 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb9cef34-17a1-42e7-a80c-dc6e1f2cd2bd]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:40:03 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ed7587b-57af-4a53-9c54-9342b6063c90 tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:40:03 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:40:03 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:40:03 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c6a0a7a-10cd-4752-9874-5d3305c0ab20]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:584dd8df-f6a2-4e35-be7e-8de1e759491b (non-flash)\ntcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71606958-b9e5-4da7-bbd0-a81343120655 (non-flash)\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:40:03 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ed7587b-57af-4a53-9c54-9342b6063c90 tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:584dd8df-f6a2-4e35-be7e-8de1e759491b (non-flash)
Nov 16 10:40:03 user nova-compute[85141]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71606958-b9e5-4da7-bbd0-a81343120655 (non-flash)
Nov 16 10:40:03 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:40:03 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ed7587b-57af-4a53-9c54-9342b6063c90 tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:584dd8df-f6a2-4e35-be7e-8de1e759491b (non-flash)
Nov 16 10:40:03 user nova-compute[85141]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71606958-b9e5-4da7-bbd0-a81343120655 (non-flash)
Nov 16 10:40:03 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 10:40:03 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-6ed7587b-57af-4a53-9c54-9342b6063c90 tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:71606958-b9e5-4da7-bbd0-a81343120655" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.268s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 10:40:03 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ed7587b-57af-4a53-9c54-9342b6063c90 tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Connected to 172.16.0.220:3260 {{(pid=85141) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 10:40:03 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-6ed7587b-57af-4a53-9c54-9342b6063c90 tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] HCTL ('34', '-', '-', 0) found on session 60 with lun 0 {{(pid=85141) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 10:40:03 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-6ed7587b-57af-4a53-9c54-9342b6063c90 tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=85141) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 10:40:03 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:40:03 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.024s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:40:03 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fe33c8f-6ade-4fb4-9b15-5d0ad7f488fe]: (4, ('- - 0', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:40:03 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-6ed7587b-57af-4a53-9c54-9342b6063c90 tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Searching for a device in session 60 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=85141) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 10:40:03 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ed7587b-57af-4a53-9c54-9342b6063c90 tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:71606958-b9e5-4da7-bbd0-a81343120655', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EIwlGxVQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=85141) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 10:40:03 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:40:04 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-6ed7587b-57af-4a53-9c54-9342b6063c90 tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.307s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 10:40:04 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ed7587b-57af-4a53-9c54-9342b6063c90 tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] <== connect_volume: return (1309ms) {'type': 'block', 'scsi_wwn': '23433303937373039', 'path': '/dev/sdc'} {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 10:40:04 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6ed7587b-57af-4a53-9c54-9342b6063c90 tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] [instance: 1e01e0e9-5eef-4af4-8633-814d59860b8d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23433303937373039', 'path': '/dev/sdc'} {{(pid=85141) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 10:40:04 user nova-compute[85141]: DEBUG nova.objects.instance [None req-6ed7587b-57af-4a53-9c54-9342b6063c90 tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Lazy-loading 'flavor' on Instance uuid 1e01e0e9-5eef-4af4-8633-814d59860b8d {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:40:04 user nova-compute[85141]: DEBUG nova.virt.libvirt.guest [None req-6ed7587b-57af-4a53-9c54-9342b6063c90 tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 10:40:04 user nova-compute[85141]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 10:40:04 user nova-compute[85141]:   <source dev="/dev/sdc"/>
Nov 16 10:40:04 user nova-compute[85141]:   <target dev="vdb" bus="virtio"/>
Nov 16 10:40:04 user nova-compute[85141]:   <serial>71606958-b9e5-4da7-bbd0-a81343120655</serial>
Nov 16 10:40:04 user nova-compute[85141]: </disk>
Nov 16 10:40:04 user nova-compute[85141]:  {{(pid=85141) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 10:40:04 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-6ed7587b-57af-4a53-9c54-9342b6063c90 tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] No BDM found with device name vda, not building metadata. {{(pid=85141) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 10:40:04 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-6ed7587b-57af-4a53-9c54-9342b6063c90 tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] No BDM found with device name vdb, not building metadata. {{(pid=85141) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 10:40:04 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-6ed7587b-57af-4a53-9c54-9342b6063c90 tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] No VIF found with MAC fa:16:3e:40:7a:69, not building metadata {{(pid=85141) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 10:40:04 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-6ed7587b-57af-4a53-9c54-9342b6063c90 tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Lock "1e01e0e9-5eef-4af4-8633-814d59860b8d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.751s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:40:07 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-3b8777ef-9ecc-4fca-99d5-5c13902726d5 tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Acquiring lock "1e01e0e9-5eef-4af4-8633-814d59860b8d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:40:07 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-3b8777ef-9ecc-4fca-99d5-5c13902726d5 tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Lock "1e01e0e9-5eef-4af4-8633-814d59860b8d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:40:07 user nova-compute[85141]: INFO nova.compute.manager [None req-3b8777ef-9ecc-4fca-99d5-5c13902726d5 tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] [instance: 1e01e0e9-5eef-4af4-8633-814d59860b8d] Detaching volume 71606958-b9e5-4da7-bbd0-a81343120655
Nov 16 10:40:07 user nova-compute[85141]: INFO nova.virt.block_device [None req-3b8777ef-9ecc-4fca-99d5-5c13902726d5 tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] [instance: 1e01e0e9-5eef-4af4-8633-814d59860b8d] Attempting to driver detach volume 71606958-b9e5-4da7-bbd0-a81343120655 from mountpoint /dev/vdb
Nov 16 10:40:07 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-3b8777ef-9ecc-4fca-99d5-5c13902726d5 tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Attempting to detach device vdb from instance 1e01e0e9-5eef-4af4-8633-814d59860b8d from the persistent domain config. {{(pid=85141) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 10:40:07 user nova-compute[85141]: DEBUG nova.virt.libvirt.guest [None req-3b8777ef-9ecc-4fca-99d5-5c13902726d5 tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 10:40:07 user nova-compute[85141]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 10:40:07 user nova-compute[85141]:   <source dev="/dev/sdc"/>
Nov 16 10:40:07 user nova-compute[85141]:   <target dev="vdb" bus="virtio"/>
Nov 16 10:40:07 user nova-compute[85141]:   <serial>71606958-b9e5-4da7-bbd0-a81343120655</serial>
Nov 16 10:40:07 user nova-compute[85141]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 10:40:07 user nova-compute[85141]: </disk>
Nov 16 10:40:07 user nova-compute[85141]:  {{(pid=85141) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 10:40:07 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-3b8777ef-9ecc-4fca-99d5-5c13902726d5 tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Successfully detached device vdb from instance 1e01e0e9-5eef-4af4-8633-814d59860b8d from the persistent domain config.
Nov 16 10:40:07 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-3b8777ef-9ecc-4fca-99d5-5c13902726d5 tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 1e01e0e9-5eef-4af4-8633-814d59860b8d from the live domain config. {{(pid=85141) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 10:40:07 user nova-compute[85141]: DEBUG nova.virt.libvirt.guest [None req-3b8777ef-9ecc-4fca-99d5-5c13902726d5 tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 10:40:07 user nova-compute[85141]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 10:40:07 user nova-compute[85141]:   <source dev="/dev/sdc"/>
Nov 16 10:40:07 user nova-compute[85141]:   <target dev="vdb" bus="virtio"/>
Nov 16 10:40:07 user nova-compute[85141]:   <serial>71606958-b9e5-4da7-bbd0-a81343120655</serial>
Nov 16 10:40:07 user nova-compute[85141]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 10:40:07 user nova-compute[85141]: </disk>
Nov 16 10:40:07 user nova-compute[85141]:  {{(pid=85141) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 10:40:07 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-3b8777ef-9ecc-4fca-99d5-5c13902726d5 tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 1e01e0e9-5eef-4af4-8633-814d59860b8d {{(pid=85141) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 10:40:08 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:40:08 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:40:13 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:40:18 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:40:22 user nova-compute[85141]: DEBUG nova.compute.manager [req-d99d9f9d-22d4-4ba2-878e-c393035ac356 req-3a344142-3cb1-4304-af84-b1109abc8f11 service nova] [instance: 3cafaf59-3cc9-4612-8da5-b2b60f8223e6] Received event network-changed-e30a03ca-bc02-4f7b-a94f-bda128aa7c39 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:40:22 user nova-compute[85141]: DEBUG nova.compute.manager [req-d99d9f9d-22d4-4ba2-878e-c393035ac356 req-3a344142-3cb1-4304-af84-b1109abc8f11 service nova] [instance: 3cafaf59-3cc9-4612-8da5-b2b60f8223e6] Refreshing instance network info cache due to event network-changed-e30a03ca-bc02-4f7b-a94f-bda128aa7c39. {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 10:40:22 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-d99d9f9d-22d4-4ba2-878e-c393035ac356 req-3a344142-3cb1-4304-af84-b1109abc8f11 service nova] Acquiring lock "refresh_cache-3cafaf59-3cc9-4612-8da5-b2b60f8223e6" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:40:22 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-d99d9f9d-22d4-4ba2-878e-c393035ac356 req-3a344142-3cb1-4304-af84-b1109abc8f11 service nova] Acquired lock "refresh_cache-3cafaf59-3cc9-4612-8da5-b2b60f8223e6" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:40:22 user nova-compute[85141]: DEBUG nova.network.neutron [req-d99d9f9d-22d4-4ba2-878e-c393035ac356 req-3a344142-3cb1-4304-af84-b1109abc8f11 service nova] [instance: 3cafaf59-3cc9-4612-8da5-b2b60f8223e6] Refreshing network info cache for port e30a03ca-bc02-4f7b-a94f-bda128aa7c39 {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 10:40:22 user nova-compute[85141]: DEBUG nova.network.neutron [req-d99d9f9d-22d4-4ba2-878e-c393035ac356 req-3a344142-3cb1-4304-af84-b1109abc8f11 service nova] [instance: 3cafaf59-3cc9-4612-8da5-b2b60f8223e6] Updated VIF entry in instance network info cache for port e30a03ca-bc02-4f7b-a94f-bda128aa7c39. {{(pid=85141) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 10:40:22 user nova-compute[85141]: DEBUG nova.network.neutron [req-d99d9f9d-22d4-4ba2-878e-c393035ac356 req-3a344142-3cb1-4304-af84-b1109abc8f11 service nova] [instance: 3cafaf59-3cc9-4612-8da5-b2b60f8223e6] Updating instance_info_cache with network_info: [{"id": "e30a03ca-bc02-4f7b-a94f-bda128aa7c39", "address": "fa:16:3e:3d:15:cb", "network": {"id": "8931cd8f-3c0b-4d49-ae98-48f818e854e7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1902653571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d13c6ff3c30549ca9ab44d9fc1fedc6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape30a03ca-bc", "ovs_interfaceid": "e30a03ca-bc02-4f7b-a94f-bda128aa7c39", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:40:22 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-d99d9f9d-22d4-4ba2-878e-c393035ac356 req-3a344142-3cb1-4304-af84-b1109abc8f11 service nova] Releasing lock "refresh_cache-3cafaf59-3cc9-4612-8da5-b2b60f8223e6" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:40:23 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:40:23 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:40:24 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-cd8fef7c-c016-47e6-b108-fb248e3299b3 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Acquiring lock "3cafaf59-3cc9-4612-8da5-b2b60f8223e6" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:40:24 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-cd8fef7c-c016-47e6-b108-fb248e3299b3 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Lock "3cafaf59-3cc9-4612-8da5-b2b60f8223e6" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:40:24 user nova-compute[85141]: DEBUG nova.objects.instance [None req-cd8fef7c-c016-47e6-b108-fb248e3299b3 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Lazy-loading 'flavor' on Instance uuid 3cafaf59-3cc9-4612-8da5-b2b60f8223e6 {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:40:24 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-cd8fef7c-c016-47e6-b108-fb248e3299b3 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Lock "3cafaf59-3cc9-4612-8da5-b2b60f8223e6" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:40:25 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-cd8fef7c-c016-47e6-b108-fb248e3299b3 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Acquiring lock "3cafaf59-3cc9-4612-8da5-b2b60f8223e6" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:40:25 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-cd8fef7c-c016-47e6-b108-fb248e3299b3 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Lock "3cafaf59-3cc9-4612-8da5-b2b60f8223e6" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:40:25 user nova-compute[85141]: INFO nova.compute.manager [None req-cd8fef7c-c016-47e6-b108-fb248e3299b3 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] [instance: 3cafaf59-3cc9-4612-8da5-b2b60f8223e6] Attaching volume 56f96a41-3843-45f8-8bb3-d9ca58f63119 to /dev/vdb
Nov 16 10:40:25 user nova-compute[85141]: DEBUG os_brick.utils [None req-cd8fef7c-c016-47e6-b108-fb248e3299b3 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 10:40:25 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:40:25 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:40:25 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[0094d03b-619c-4e52-ba10-a02dc9b56b28]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c7834de5c295\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:40:25 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:40:25 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:40:25 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb6bc3f7-3267-49f7-b401-f0a554789995]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:40:25 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:40:25 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:40:25 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[d94aa192-6170-451c-a53d-8b39faf5fc5f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:40:25 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f144eec-9e24-4bb0-a500-9ab7f56a90b7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:40:25 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-cd8fef7c-c016-47e6-b108-fb248e3299b3 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Running cmd (subprocess): nvme version {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:40:25 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-cd8fef7c-c016-47e6-b108-fb248e3299b3 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] 'nvme version' failed. Not Retrying. {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 10:40:25 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cd8fef7c-c016-47e6-b108-fb248e3299b3 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] nvme not present on system {{(pid=85141) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 10:40:25 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:40:25 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 10:40:25 user nova-compute[85141]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 10:40:25 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[f22bec0b-87a3-4924-8503-85d93b39891f]: (4, '') {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:40:25 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.lightos [None req-cd8fef7c-c016-47e6-b108-fb248e3299b3 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=85141) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 10:40:25 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.lightos [None req-cd8fef7c-c016-47e6-b108-fb248e3299b3 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=85141) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 10:40:25 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.lightos [None req-cd8fef7c-c016-47e6-b108-fb248e3299b3 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] LIGHTOS: no hostnqn found. {{(pid=85141) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 10:40:25 user nova-compute[85141]: DEBUG os_brick.utils [None req-cd8fef7c-c016-47e6-b108-fb248e3299b3 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c7834de5c295', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 10:40:25 user nova-compute[85141]: DEBUG nova.virt.block_device [None req-cd8fef7c-c016-47e6-b108-fb248e3299b3 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] [instance: 3cafaf59-3cc9-4612-8da5-b2b60f8223e6] Updating existing volume attachment record: b2f0d255-85a6-430a-99fd-9452c2932092 {{(pid=85141) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 10:40:27 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-3b8777ef-9ecc-4fca-99d5-5c13902726d5 tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 1e01e0e9-5eef-4af4-8633-814d59860b8d is timed out.
Nov 16 10:40:27 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-3b8777ef-9ecc-4fca-99d5-5c13902726d5 tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Successfully detached device vdb from instance 1e01e0e9-5eef-4af4-8633-814d59860b8d from the live domain config.
Nov 16 10:40:27 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3b8777ef-9ecc-4fca-99d5-5c13902726d5 tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] [instance: 1e01e0e9-5eef-4af4-8633-814d59860b8d] calling os-brick to detach iSCSI Volume {{(pid=85141) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 10:40:27 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b8777ef-9ecc-4fca-99d5-5c13902726d5 tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51806b6080>, {'target_iqn': 'iqn.2010-10.org.openstack:71606958-b9e5-4da7-bbd0-a81343120655', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EIwlGxVQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 10:40:27 user nova-compute[85141]: WARNING os_brick.initiator.connectors.base [None req-3b8777ef-9ecc-4fca-99d5-5c13902726d5 tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 10:40:27 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-3b8777ef-9ecc-4fca-99d5-5c13902726d5 tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 10:40:27 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-3b8777ef-9ecc-4fca-99d5-5c13902726d5 tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 10:40:27 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:40:27 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:40:27 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[68216a03-84e4-47fb-8c8a-0567d755a933]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:584dd8df-f6a2-4e35-be7e-8de1e759491b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:71606958-b9e5-4da7-bbd0-a81343120655\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:40:27 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b8777ef-9ecc-4fca-99d5-5c13902726d5 tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 10:40:27 user nova-compute[85141]: No targets found.
Nov 16 10:40:27 user nova-compute[85141]: iSNS:
Nov 16 10:40:27 user nova-compute[85141]: No targets found.
Nov 16 10:40:27 user nova-compute[85141]: STATIC:
Nov 16 10:40:27 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:584dd8df-f6a2-4e35-be7e-8de1e759491b
Nov 16 10:40:27 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:40:27 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:40:27 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:71606958-b9e5-4da7-bbd0-a81343120655
Nov 16 10:40:27 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:40:27 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:40:27 user nova-compute[85141]: FIRMWARE:
Nov 16 10:40:27 user nova-compute[85141]: No targets found.
Nov 16 10:40:27 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:40:27 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b8777ef-9ecc-4fca-99d5-5c13902726d5 tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 10:40:27 user nova-compute[85141]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 10:40:27 user nova-compute[85141]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=85141) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 10:40:27 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b8777ef-9ecc-4fca-99d5-5c13902726d5 tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:71606958-b9e5-4da7-bbd0-a81343120655', 0)] {{(pid=85141) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 10:40:27 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:40:27 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:40:27 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[72f98961-08ef-464f-acbd-a011f385babe]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:584dd8df-f6a2-4e35-be7e-8de1e759491b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:71606958-b9e5-4da7-bbd0-a81343120655\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:40:27 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:40:27 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:40:27 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[e403a5d4-c303-468a-be1e-190bab79b575]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:584dd8df-f6a2-4e35-be7e-8de1e759491b (non-flash)\ntcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71606958-b9e5-4da7-bbd0-a81343120655 (non-flash)\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:40:27 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b8777ef-9ecc-4fca-99d5-5c13902726d5 tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:584dd8df-f6a2-4e35-be7e-8de1e759491b (non-flash)
Nov 16 10:40:27 user nova-compute[85141]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71606958-b9e5-4da7-bbd0-a81343120655 (non-flash)
Nov 16 10:40:27 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:40:27 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b8777ef-9ecc-4fca-99d5-5c13902726d5 tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:584dd8df-f6a2-4e35-be7e-8de1e759491b (non-flash)
Nov 16 10:40:27 user nova-compute[85141]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71606958-b9e5-4da7-bbd0-a81343120655 (non-flash)
Nov 16 10:40:27 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 10:40:27 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b8777ef-9ecc-4fca-99d5-5c13902726d5 tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f516075c1f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:71606958-b9e5-4da7-bbd0-a81343120655'): ({'sdc'}, set())}) {{(pid=85141) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 10:40:27 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-3b8777ef-9ecc-4fca-99d5-5c13902726d5 tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Removing single pathed devices sdc {{(pid=85141) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 10:40:27 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:40:27 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:40:27 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[08201ffe-2f08-4bfa-b047-990686d799bd]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:40:27 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:40:27 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.017s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:40:27 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[f284bab3-f467-405c-9e55-be725bb7e72d]: (4, ('ok\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:40:27 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-3b8777ef-9ecc-4fca-99d5-5c13902726d5 tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Flushing IO for device /dev/sdc {{(pid=85141) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 10:40:27 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:40:27 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:40:27 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[194a359e-cc76-4f2a-ac3c-24ae8b633081]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:40:27 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-3b8777ef-9ecc-4fca-99d5-5c13902726d5 tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=85141) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 10:40:27 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:40:27 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.048s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:40:27 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[30f96466-3aef-4c7b-b2f3-23e30932aa15]: (4, ('1', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:40:27 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-3b8777ef-9ecc-4fca-99d5-5c13902726d5 tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=85141) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 10:40:27 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-3b8777ef-9ecc-4fca-99d5-5c13902726d5 tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] SCSI volumes sdc have been removed. {{(pid=85141) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 10:40:27 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b8777ef-9ecc-4fca-99d5-5c13902726d5 tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:71606958-b9e5-4da7-bbd0-a81343120655')] {{(pid=85141) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 10:40:27 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71606958-b9e5-4da7-bbd0-a81343120655 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:40:27 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71606958-b9e5-4da7-bbd0-a81343120655 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:40:27 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[e77a2670-b59b-476f-9453-deedc2388205]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:40:27 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b8777ef-9ecc-4fca-99d5-5c13902726d5 tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:40:27 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71606958-b9e5-4da7-bbd0-a81343120655 -p 172.16.0.220:3260 --logout {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:40:28 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71606958-b9e5-4da7-bbd0-a81343120655 -p 172.16.0.220:3260 --logout" returned: 0 in 0.045s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:40:28 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcb286da-28cd-4e97-a618-2ae6332d1cda]: (4, ('Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:71606958-b9e5-4da7-bbd0-a81343120655, portal: 172.16.0.220,3260]\nLogout of [sid: 60, target: iqn.2010-10.org.openstack:71606958-b9e5-4da7-bbd0-a81343120655, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:40:28 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b8777ef-9ecc-4fca-99d5-5c13902726d5 tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:71606958-b9e5-4da7-bbd0-a81343120655, portal: 172.16.0.220,3260]
Nov 16 10:40:28 user nova-compute[85141]: Logout of [sid: 60, target: iqn.2010-10.org.openstack:71606958-b9e5-4da7-bbd0-a81343120655, portal: 172.16.0.220,3260] successful.
Nov 16 10:40:28 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:40:28 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71606958-b9e5-4da7-bbd0-a81343120655 -p 172.16.0.220:3260 --op delete {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:40:28 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71606958-b9e5-4da7-bbd0-a81343120655 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:40:28 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[df35182b-6b08-4dc8-8f80-00f1981a2fb4]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:40:28 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b8777ef-9ecc-4fca-99d5-5c13902726d5 tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:40:28 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-3b8777ef-9ecc-4fca-99d5-5c13902726d5 tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.276s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 10:40:28 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b8777ef-9ecc-4fca-99d5-5c13902726d5 tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] <== disconnect_volume: return (277ms) None {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 10:40:28 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3b8777ef-9ecc-4fca-99d5-5c13902726d5 tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] [instance: 1e01e0e9-5eef-4af4-8633-814d59860b8d] Disconnected iSCSI Volume {{(pid=85141) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 10:40:28 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:40:28 user nova-compute[85141]: DEBUG nova.objects.instance [None req-3b8777ef-9ecc-4fca-99d5-5c13902726d5 tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Lazy-loading 'flavor' on Instance uuid 1e01e0e9-5eef-4af4-8633-814d59860b8d {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:40:28 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-3b8777ef-9ecc-4fca-99d5-5c13902726d5 tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Lock "1e01e0e9-5eef-4af4-8633-814d59860b8d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.570s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:40:28 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:40:31 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd8fef7c-c016-47e6-b108-fb248e3299b3 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] [instance: 3cafaf59-3cc9-4612-8da5-b2b60f8223e6] Calling os-brick to attach iSCSI Volume {{(pid=85141) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 10:40:31 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd8fef7c-c016-47e6-b108-fb248e3299b3 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51806b6080>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:56f96a41-3843-45f8-8bb3-d9ca58f63119', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tIGoFCLy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 10:40:31 user nova-compute[85141]: WARNING os_brick.initiator.connectors.base [None req-cd8fef7c-c016-47e6-b108-fb248e3299b3 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 10:40:31 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-cd8fef7c-c016-47e6-b108-fb248e3299b3 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 10:40:31 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-cd8fef7c-c016-47e6-b108-fb248e3299b3 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 10:40:31 user nova-compute[85141]: WARNING os_brick.initiator.connectors.base [None req-cd8fef7c-c016-47e6-b108-fb248e3299b3 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 10:40:31 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-cd8fef7c-c016-47e6-b108-fb248e3299b3 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:56f96a41-3843-45f8-8bb3-d9ca58f63119" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 10:40:31 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-cd8fef7c-c016-47e6-b108-fb248e3299b3 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:56f96a41-3843-45f8-8bb3-d9ca58f63119" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 10:40:31 user nova-compute[85141]: INFO os_brick.initiator.connectors.iscsi [None req-cd8fef7c-c016-47e6-b108-fb248e3299b3 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 10:40:31 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56f96a41-3843-45f8-8bb3-d9ca58f63119 -p 172.16.0.220:3260 {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:40:31 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56f96a41-3843-45f8-8bb3-d9ca58f63119 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:40:31 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[1783893d-4acb-41e4-a550-6fd8db523904]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:40:31 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd8fef7c-c016-47e6-b108-fb248e3299b3 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 10:40:31 user nova-compute[85141]:  {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:40:31 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56f96a41-3843-45f8-8bb3-d9ca58f63119 -p 172.16.0.220:3260 --interface default --op new {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:40:31 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56f96a41-3843-45f8-8bb3-d9ca58f63119 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:40:31 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[1766922d-8b2f-4e08-a6d5-9caeab982ac7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:56f96a41-3843-45f8-8bb3-d9ca58f63119] added\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:40:31 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd8fef7c-c016-47e6-b108-fb248e3299b3 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:56f96a41-3843-45f8-8bb3-d9ca58f63119] added
Nov 16 10:40:31 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:40:31 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56f96a41-3843-45f8-8bb3-d9ca58f63119 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:40:31 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56f96a41-3843-45f8-8bb3-d9ca58f63119 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:40:31 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[7181c82f-5133-4be1-b77a-b9280e94cc7c]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:40:31 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd8fef7c-c016-47e6-b108-fb248e3299b3 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:40:31 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56f96a41-3843-45f8-8bb3-d9ca58f63119 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:40:31 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56f96a41-3843-45f8-8bb3-d9ca58f63119 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:40:31 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[3996918d-b3c4-462d-850a-7bf437a01fcc]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:40:31 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd8fef7c-c016-47e6-b108-fb248e3299b3 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:40:31 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56f96a41-3843-45f8-8bb3-d9ca58f63119 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tIGoFCLy {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:40:31 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56f96a41-3843-45f8-8bb3-d9ca58f63119 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tIGoFCLy" returned: 0 in 0.023s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:40:31 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[75be47ab-e274-448f-8b3c-15b0294dd26a]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:40:31 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd8fef7c-c016-47e6-b108-fb248e3299b3 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tIGoFCLy'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:40:31 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56f96a41-3843-45f8-8bb3-d9ca58f63119 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:40:31 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56f96a41-3843-45f8-8bb3-d9ca58f63119 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:40:31 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[49fd2f76-b0df-44d6-98b9-3ba4430835eb]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:40:31 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd8fef7c-c016-47e6-b108-fb248e3299b3 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:40:31 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:40:31 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:40:31 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cc12909-0f5e-4646-b769-756b3b198814]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:584dd8df-f6a2-4e35-be7e-8de1e759491b (non-flash)\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:40:31 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd8fef7c-c016-47e6-b108-fb248e3299b3 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:584dd8df-f6a2-4e35-be7e-8de1e759491b (non-flash)
Nov 16 10:40:31 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:40:31 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd8fef7c-c016-47e6-b108-fb248e3299b3 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:584dd8df-f6a2-4e35-be7e-8de1e759491b (non-flash)
Nov 16 10:40:31 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 10:40:31 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56f96a41-3843-45f8-8bb3-d9ca58f63119 -p 172.16.0.220:3260 --login {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:40:31 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56f96a41-3843-45f8-8bb3-d9ca58f63119 -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:40:31 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[6be165dd-d250-4bdd-961d-caebb004565b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:56f96a41-3843-45f8-8bb3-d9ca58f63119, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:56f96a41-3843-45f8-8bb3-d9ca58f63119, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:40:31 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd8fef7c-c016-47e6-b108-fb248e3299b3 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:56f96a41-3843-45f8-8bb3-d9ca58f63119, portal: 172.16.0.220,3260]
Nov 16 10:40:31 user nova-compute[85141]: Login to [iface: default, target: iqn.2010-10.org.openstack:56f96a41-3843-45f8-8bb3-d9ca58f63119, portal: 172.16.0.220,3260] successful.
Nov 16 10:40:31 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:40:31 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56f96a41-3843-45f8-8bb3-d9ca58f63119 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:40:31 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56f96a41-3843-45f8-8bb3-d9ca58f63119 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:40:31 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[e60e8ec6-653e-4903-ad5a-75c306e74aa3]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:40:31 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd8fef7c-c016-47e6-b108-fb248e3299b3 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:40:31 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:40:31 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:40:31 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0e55e1a-6b4b-40d3-9c0f-b2424bba8cd1]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:584dd8df-f6a2-4e35-be7e-8de1e759491b (non-flash)\ntcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56f96a41-3843-45f8-8bb3-d9ca58f63119 (non-flash)\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:40:31 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd8fef7c-c016-47e6-b108-fb248e3299b3 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:584dd8df-f6a2-4e35-be7e-8de1e759491b (non-flash)
Nov 16 10:40:31 user nova-compute[85141]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56f96a41-3843-45f8-8bb3-d9ca58f63119 (non-flash)
Nov 16 10:40:31 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:40:31 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd8fef7c-c016-47e6-b108-fb248e3299b3 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:584dd8df-f6a2-4e35-be7e-8de1e759491b (non-flash)
Nov 16 10:40:31 user nova-compute[85141]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56f96a41-3843-45f8-8bb3-d9ca58f63119 (non-flash)
Nov 16 10:40:31 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 10:40:31 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-cd8fef7c-c016-47e6-b108-fb248e3299b3 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:56f96a41-3843-45f8-8bb3-d9ca58f63119" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.285s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 10:40:31 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd8fef7c-c016-47e6-b108-fb248e3299b3 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Connected to 172.16.0.220:3260 {{(pid=85141) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 10:40:31 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-cd8fef7c-c016-47e6-b108-fb248e3299b3 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] HCTL ('34', '-', '-', 0) found on session 61 with lun 0 {{(pid=85141) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 10:40:31 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-cd8fef7c-c016-47e6-b108-fb248e3299b3 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=85141) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 10:40:31 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:40:31 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:40:31 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[b21481fb-b627-40bd-855c-07886460522d]: (4, ('- - 0', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:40:31 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-cd8fef7c-c016-47e6-b108-fb248e3299b3 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Searching for a device in session 61 and hctl ['34', '*', '*', 0] yield: None {{(pid=85141) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 10:40:32 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-cd8fef7c-c016-47e6-b108-fb248e3299b3 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Searching for a device in session 61 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=85141) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 10:40:32 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd8fef7c-c016-47e6-b108-fb248e3299b3 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:56f96a41-3843-45f8-8bb3-d9ca58f63119', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tIGoFCLy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=85141) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 10:40:32 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-cd8fef7c-c016-47e6-b108-fb248e3299b3 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.317s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 10:40:32 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd8fef7c-c016-47e6-b108-fb248e3299b3 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] <== connect_volume: return (1318ms) {'type': 'block', 'scsi_wwn': '26335393634333439', 'path': '/dev/sdc'} {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 10:40:32 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd8fef7c-c016-47e6-b108-fb248e3299b3 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] [instance: 3cafaf59-3cc9-4612-8da5-b2b60f8223e6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26335393634333439', 'path': '/dev/sdc'} {{(pid=85141) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 10:40:32 user nova-compute[85141]: DEBUG nova.objects.instance [None req-cd8fef7c-c016-47e6-b108-fb248e3299b3 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Lazy-loading 'flavor' on Instance uuid 3cafaf59-3cc9-4612-8da5-b2b60f8223e6 {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:40:32 user nova-compute[85141]: DEBUG nova.virt.libvirt.guest [None req-cd8fef7c-c016-47e6-b108-fb248e3299b3 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 10:40:32 user nova-compute[85141]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 10:40:32 user nova-compute[85141]:   <source dev="/dev/sdc"/>
Nov 16 10:40:32 user nova-compute[85141]:   <target dev="vdb" bus="virtio"/>
Nov 16 10:40:32 user nova-compute[85141]:   <serial>56f96a41-3843-45f8-8bb3-d9ca58f63119</serial>
Nov 16 10:40:32 user nova-compute[85141]: </disk>
Nov 16 10:40:32 user nova-compute[85141]:  {{(pid=85141) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 10:40:33 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-cd8fef7c-c016-47e6-b108-fb248e3299b3 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] No BDM found with device name vda, not building metadata. {{(pid=85141) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 10:40:33 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-cd8fef7c-c016-47e6-b108-fb248e3299b3 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] No BDM found with device name vdb, not building metadata. {{(pid=85141) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 10:40:33 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-cd8fef7c-c016-47e6-b108-fb248e3299b3 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] No VIF found with MAC fa:16:3e:3d:15:cb, not building metadata {{(pid=85141) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 10:40:33 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-cd8fef7c-c016-47e6-b108-fb248e3299b3 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Lock "3cafaf59-3cc9-4612-8da5-b2b60f8223e6" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.449s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:40:33 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:40:33 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:40:34 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5ed463c3-1081-40df-baa5-9cd76dbd1eec tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Acquiring lock "3cafaf59-3cc9-4612-8da5-b2b60f8223e6" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:40:34 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5ed463c3-1081-40df-baa5-9cd76dbd1eec tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Lock "3cafaf59-3cc9-4612-8da5-b2b60f8223e6" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:40:34 user nova-compute[85141]: INFO nova.compute.manager [None req-5ed463c3-1081-40df-baa5-9cd76dbd1eec tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] [instance: 3cafaf59-3cc9-4612-8da5-b2b60f8223e6] Detaching volume 56f96a41-3843-45f8-8bb3-d9ca58f63119
Nov 16 10:40:34 user nova-compute[85141]: INFO nova.virt.block_device [None req-5ed463c3-1081-40df-baa5-9cd76dbd1eec tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] [instance: 3cafaf59-3cc9-4612-8da5-b2b60f8223e6] Attempting to driver detach volume 56f96a41-3843-45f8-8bb3-d9ca58f63119 from mountpoint /dev/vdb
Nov 16 10:40:34 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-5ed463c3-1081-40df-baa5-9cd76dbd1eec tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Attempting to detach device vdb from instance 3cafaf59-3cc9-4612-8da5-b2b60f8223e6 from the persistent domain config. {{(pid=85141) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 10:40:34 user nova-compute[85141]: DEBUG nova.virt.libvirt.guest [None req-5ed463c3-1081-40df-baa5-9cd76dbd1eec tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 10:40:34 user nova-compute[85141]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 10:40:34 user nova-compute[85141]:   <source dev="/dev/sdc"/>
Nov 16 10:40:34 user nova-compute[85141]:   <target dev="vdb" bus="virtio"/>
Nov 16 10:40:34 user nova-compute[85141]:   <serial>56f96a41-3843-45f8-8bb3-d9ca58f63119</serial>
Nov 16 10:40:34 user nova-compute[85141]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 10:40:34 user nova-compute[85141]: </disk>
Nov 16 10:40:34 user nova-compute[85141]:  {{(pid=85141) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 10:40:34 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-5ed463c3-1081-40df-baa5-9cd76dbd1eec tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Successfully detached device vdb from instance 3cafaf59-3cc9-4612-8da5-b2b60f8223e6 from the persistent domain config.
Nov 16 10:40:34 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-5ed463c3-1081-40df-baa5-9cd76dbd1eec tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 3cafaf59-3cc9-4612-8da5-b2b60f8223e6 from the live domain config. {{(pid=85141) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 10:40:34 user nova-compute[85141]: DEBUG nova.virt.libvirt.guest [None req-5ed463c3-1081-40df-baa5-9cd76dbd1eec tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 10:40:34 user nova-compute[85141]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 10:40:34 user nova-compute[85141]:   <source dev="/dev/sdc"/>
Nov 16 10:40:34 user nova-compute[85141]:   <target dev="vdb" bus="virtio"/>
Nov 16 10:40:34 user nova-compute[85141]:   <serial>56f96a41-3843-45f8-8bb3-d9ca58f63119</serial>
Nov 16 10:40:34 user nova-compute[85141]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 10:40:34 user nova-compute[85141]: </disk>
Nov 16 10:40:34 user nova-compute[85141]:  {{(pid=85141) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 10:40:34 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-5ed463c3-1081-40df-baa5-9cd76dbd1eec tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 3cafaf59-3cc9-4612-8da5-b2b60f8223e6 {{(pid=85141) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 10:40:38 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:40:38 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:40:38 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:40:43 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:40:43 user nova-compute[85141]: DEBUG nova.compute.manager [req-2f0e9d74-15fc-4101-897c-5309b1c42cea req-a2021786-6c96-4c84-b739-a362d87074d3 service nova] [instance: 797c873e-cf15-4d3c-a3bc-bd2a81a80014] Received event network-changed-27c72f03-eb45-49ad-b17e-330eecf72cb1 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:40:43 user nova-compute[85141]: DEBUG nova.compute.manager [req-2f0e9d74-15fc-4101-897c-5309b1c42cea req-a2021786-6c96-4c84-b739-a362d87074d3 service nova] [instance: 797c873e-cf15-4d3c-a3bc-bd2a81a80014] Refreshing instance network info cache due to event network-changed-27c72f03-eb45-49ad-b17e-330eecf72cb1. {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 10:40:43 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-2f0e9d74-15fc-4101-897c-5309b1c42cea req-a2021786-6c96-4c84-b739-a362d87074d3 service nova] Acquiring lock "refresh_cache-797c873e-cf15-4d3c-a3bc-bd2a81a80014" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:40:43 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-2f0e9d74-15fc-4101-897c-5309b1c42cea req-a2021786-6c96-4c84-b739-a362d87074d3 service nova] Acquired lock "refresh_cache-797c873e-cf15-4d3c-a3bc-bd2a81a80014" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:40:43 user nova-compute[85141]: DEBUG nova.network.neutron [req-2f0e9d74-15fc-4101-897c-5309b1c42cea req-a2021786-6c96-4c84-b739-a362d87074d3 service nova] [instance: 797c873e-cf15-4d3c-a3bc-bd2a81a80014] Refreshing network info cache for port 27c72f03-eb45-49ad-b17e-330eecf72cb1 {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 10:40:43 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-d5fadc4f-60d6-4d53-81ba-32a65fd493c4 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Acquiring lock "797c873e-cf15-4d3c-a3bc-bd2a81a80014" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:40:43 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-d5fadc4f-60d6-4d53-81ba-32a65fd493c4 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Lock "797c873e-cf15-4d3c-a3bc-bd2a81a80014" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:40:43 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-d5fadc4f-60d6-4d53-81ba-32a65fd493c4 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Acquiring lock "797c873e-cf15-4d3c-a3bc-bd2a81a80014-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:40:43 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-d5fadc4f-60d6-4d53-81ba-32a65fd493c4 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Lock "797c873e-cf15-4d3c-a3bc-bd2a81a80014-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:40:43 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-d5fadc4f-60d6-4d53-81ba-32a65fd493c4 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Lock "797c873e-cf15-4d3c-a3bc-bd2a81a80014-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:40:44 user nova-compute[85141]: INFO nova.compute.manager [None req-d5fadc4f-60d6-4d53-81ba-32a65fd493c4 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: 797c873e-cf15-4d3c-a3bc-bd2a81a80014] Terminating instance
Nov 16 10:40:44 user nova-compute[85141]: DEBUG nova.compute.manager [None req-d5fadc4f-60d6-4d53-81ba-32a65fd493c4 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: 797c873e-cf15-4d3c-a3bc-bd2a81a80014] Start destroying the instance on the hypervisor. {{(pid=85141) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 10:40:44 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:40:44 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:40:44 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:40:44 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:40:44 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:40:44 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=85141) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 10:40:44 user nova-compute[85141]: DEBUG nova.network.neutron [req-2f0e9d74-15fc-4101-897c-5309b1c42cea req-a2021786-6c96-4c84-b739-a362d87074d3 service nova] [instance: 797c873e-cf15-4d3c-a3bc-bd2a81a80014] Updated VIF entry in instance network info cache for port 27c72f03-eb45-49ad-b17e-330eecf72cb1. {{(pid=85141) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 10:40:44 user nova-compute[85141]: DEBUG nova.network.neutron [req-2f0e9d74-15fc-4101-897c-5309b1c42cea req-a2021786-6c96-4c84-b739-a362d87074d3 service nova] [instance: 797c873e-cf15-4d3c-a3bc-bd2a81a80014] Updating instance_info_cache with network_info: [{"id": "27c72f03-eb45-49ad-b17e-330eecf72cb1", "address": "fa:16:3e:0d:32:17", "network": {"id": "b8ada47f-9721-4358-ac4f-0305f06dbbb8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1663922860-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aec3bb9fe5e6446590900b5adf65df0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27c72f03-eb", "ovs_interfaceid": "27c72f03-eb45-49ad-b17e-330eecf72cb1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:40:44 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-2f0e9d74-15fc-4101-897c-5309b1c42cea req-a2021786-6c96-4c84-b739-a362d87074d3 service nova] Releasing lock "refresh_cache-797c873e-cf15-4d3c-a3bc-bd2a81a80014" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:40:44 user nova-compute[85141]: INFO nova.virt.libvirt.driver [-] [instance: 797c873e-cf15-4d3c-a3bc-bd2a81a80014] Instance destroyed successfully.
Nov 16 10:40:44 user nova-compute[85141]: DEBUG nova.objects.instance [None req-d5fadc4f-60d6-4d53-81ba-32a65fd493c4 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Lazy-loading 'resources' on Instance uuid 797c873e-cf15-4d3c-a3bc-bd2a81a80014 {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:40:44 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-d5fadc4f-60d6-4d53-81ba-32a65fd493c4 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T10:35:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1931039385',display_name='tempest-TestVolumeBootPattern-server-1931039385',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1931039385',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK2tiQ/yBbFjZdjBIR2tKrAVD3soVHRqo5J6ZL2tZkf+/CHlij0TJEEFuVTAcbccfWNw+REn7xM/u4NrsIPLxGXc8EfsNWZLl3/YiEOdS+xhO6c08a6foGqxQYJ8pZUDrQ==',key_name='tempest-TestVolumeBootPattern-1363391981',keypairs=<?>,launch_index=0,launched_at=2023-11-16T10:36:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='aec3bb9fe5e6446590900b5adf65df0f',ramdisk_id='',reservation_id='r-calibs7n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1979039357',owner_user_name='tempest-TestVolumeBootPattern-1979039357-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T10:36:10Z,user_data=None,user_id='7261b57c36904fcda87a9ea32d4b5b31',uuid=797c873e-cf15-4d3c-a3bc-bd2a81a80014,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "27c72f03-eb45-49ad-b17e-330eecf72cb1", "address": "fa:16:3e:0d:32:17", "network": {"id": "b8ada47f-9721-4358-ac4f-0305f06dbbb8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1663922860-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aec3bb9fe5e6446590900b5adf65df0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27c72f03-eb", "ovs_interfaceid": "27c72f03-eb45-49ad-b17e-330eecf72cb1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 10:40:44 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-d5fadc4f-60d6-4d53-81ba-32a65fd493c4 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Converting VIF {"id": "27c72f03-eb45-49ad-b17e-330eecf72cb1", "address": "fa:16:3e:0d:32:17", "network": {"id": "b8ada47f-9721-4358-ac4f-0305f06dbbb8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1663922860-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aec3bb9fe5e6446590900b5adf65df0f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27c72f03-eb", "ovs_interfaceid": "27c72f03-eb45-49ad-b17e-330eecf72cb1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:40:44 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-d5fadc4f-60d6-4d53-81ba-32a65fd493c4 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0d:32:17,bridge_name='br-int',has_traffic_filtering=True,id=27c72f03-eb45-49ad-b17e-330eecf72cb1,network=Network(b8ada47f-9721-4358-ac4f-0305f06dbbb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27c72f03-eb') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:40:44 user nova-compute[85141]: DEBUG os_vif [None req-d5fadc4f-60d6-4d53-81ba-32a65fd493c4 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0d:32:17,bridge_name='br-int',has_traffic_filtering=True,id=27c72f03-eb45-49ad-b17e-330eecf72cb1,network=Network(b8ada47f-9721-4358-ac4f-0305f06dbbb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27c72f03-eb') {{(pid=85141) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 10:40:44 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:40:44 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap27c72f03-eb, bridge=br-int, if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:40:44 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:40:44 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:40:44 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:40:44 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b3aaff93-3917-4328-bc13-7fce903c807c) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:40:44 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:40:44 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:40:44 user nova-compute[85141]: INFO os_vif [None req-d5fadc4f-60d6-4d53-81ba-32a65fd493c4 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0d:32:17,bridge_name='br-int',has_traffic_filtering=True,id=27c72f03-eb45-49ad-b17e-330eecf72cb1,network=Network(b8ada47f-9721-4358-ac4f-0305f06dbbb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27c72f03-eb')
Nov 16 10:40:44 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d5fadc4f-60d6-4d53-81ba-32a65fd493c4 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: 797c873e-cf15-4d3c-a3bc-bd2a81a80014] calling os-brick to detach iSCSI Volume {{(pid=85141) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 10:40:44 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5fadc4f-60d6-4d53-81ba-32a65fd493c4 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51806b6080>, {'target_iqn': 'iqn.2010-10.org.openstack:584dd8df-f6a2-4e35-be7e-8de1e759491b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XoQOTquf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 10:40:44 user nova-compute[85141]: WARNING os_brick.initiator.connectors.base [None req-d5fadc4f-60d6-4d53-81ba-32a65fd493c4 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 10:40:44 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-d5fadc4f-60d6-4d53-81ba-32a65fd493c4 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 10:40:44 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-d5fadc4f-60d6-4d53-81ba-32a65fd493c4 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 10:40:44 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:40:44 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:40:44 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[908959fd-2630-454d-ab7e-6e4b426bb703]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:584dd8df-f6a2-4e35-be7e-8de1e759491b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:56f96a41-3843-45f8-8bb3-d9ca58f63119\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:40:44 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5fadc4f-60d6-4d53-81ba-32a65fd493c4 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 10:40:44 user nova-compute[85141]: No targets found.
Nov 16 10:40:44 user nova-compute[85141]: iSNS:
Nov 16 10:40:44 user nova-compute[85141]: No targets found.
Nov 16 10:40:44 user nova-compute[85141]: STATIC:
Nov 16 10:40:44 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:584dd8df-f6a2-4e35-be7e-8de1e759491b
Nov 16 10:40:44 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:40:44 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:40:44 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:56f96a41-3843-45f8-8bb3-d9ca58f63119
Nov 16 10:40:44 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:40:44 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:40:44 user nova-compute[85141]: FIRMWARE:
Nov 16 10:40:44 user nova-compute[85141]: No targets found.
Nov 16 10:40:44 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:40:44 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5fadc4f-60d6-4d53-81ba-32a65fd493c4 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 10:40:44 user nova-compute[85141]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 10:40:44 user nova-compute[85141]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=85141) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 10:40:44 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5fadc4f-60d6-4d53-81ba-32a65fd493c4 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:584dd8df-f6a2-4e35-be7e-8de1e759491b', 0)] {{(pid=85141) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 10:40:44 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:40:44 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:40:44 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[9967dfd8-2534-4a4e-b5ca-7e2fdc6c7a4b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:56f96a41-3843-45f8-8bb3-d9ca58f63119\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:584dd8df-f6a2-4e35-be7e-8de1e759491b\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:40:44 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:40:44 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:40:44 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7b9c9c8-9578-445f-bc34-edb0ae04e8a2]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:584dd8df-f6a2-4e35-be7e-8de1e759491b (non-flash)\ntcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56f96a41-3843-45f8-8bb3-d9ca58f63119 (non-flash)\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:40:44 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5fadc4f-60d6-4d53-81ba-32a65fd493c4 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:584dd8df-f6a2-4e35-be7e-8de1e759491b (non-flash)
Nov 16 10:40:44 user nova-compute[85141]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56f96a41-3843-45f8-8bb3-d9ca58f63119 (non-flash)
Nov 16 10:40:44 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:40:44 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5fadc4f-60d6-4d53-81ba-32a65fd493c4 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:584dd8df-f6a2-4e35-be7e-8de1e759491b (non-flash)
Nov 16 10:40:44 user nova-compute[85141]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56f96a41-3843-45f8-8bb3-d9ca58f63119 (non-flash)
Nov 16 10:40:44 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 10:40:44 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5fadc4f-60d6-4d53-81ba-32a65fd493c4 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f516056cc10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:584dd8df-f6a2-4e35-be7e-8de1e759491b'): ({'sdb'}, set())}) {{(pid=85141) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 10:40:44 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-d5fadc4f-60d6-4d53-81ba-32a65fd493c4 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Removing single pathed devices sdb {{(pid=85141) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 10:40:44 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:40:44 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:40:44 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[b201b54b-8042-4c54-bb43-9593ceaf390f]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:40:44 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:40:44 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:40:44 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[b53a83ca-ff77-4324-9420-4effd125e6c1]: (4, ('ok\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:40:44 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-d5fadc4f-60d6-4d53-81ba-32a65fd493c4 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Flushing IO for device /dev/sdb {{(pid=85141) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 10:40:44 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:40:44 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:40:44 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec1c7ec0-5fd9-45a0-8f61-c9332d458cd3]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:40:44 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-d5fadc4f-60d6-4d53-81ba-32a65fd493c4 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=85141) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 10:40:44 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:40:44 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.050s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:40:44 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef333bfd-1e4f-4af8-ade9-bc61fd520688]: (4, ('1', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:40:44 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-d5fadc4f-60d6-4d53-81ba-32a65fd493c4 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=85141) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 10:40:44 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-d5fadc4f-60d6-4d53-81ba-32a65fd493c4 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] SCSI volumes sdb have been removed. {{(pid=85141) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 10:40:44 user nova-compute[85141]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_f3fe7dc2', '/dev/disk/by-id/scsi-1SCST_BIOf3fe7dc2-350ba9f7361e0ef6', '/dev/disk/by-id/scsi-23335306261396637') {{(pid=95342) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 16 10:40:44 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[386f3df1-2a15-45d2-a707-759e649a0e69]: (4, None) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:40:44 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5fadc4f-60d6-4d53-81ba-32a65fd493c4 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:584dd8df-f6a2-4e35-be7e-8de1e759491b')] {{(pid=85141) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 10:40:44 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:584dd8df-f6a2-4e35-be7e-8de1e759491b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:40:45 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:584dd8df-f6a2-4e35-be7e-8de1e759491b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:40:45 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[54995c11-44a3-4282-8774-680bbaa47d86]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:40:45 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5fadc4f-60d6-4d53-81ba-32a65fd493c4 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:40:45 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:584dd8df-f6a2-4e35-be7e-8de1e759491b -p 172.16.0.220:3260 --logout {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:40:45 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:584dd8df-f6a2-4e35-be7e-8de1e759491b -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:40:45 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[874abad0-f95e-4e0d-8a09-8c75e1f6258e]: (4, ('Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:584dd8df-f6a2-4e35-be7e-8de1e759491b, portal: 172.16.0.220,3260]\nLogout of [sid: 55, target: iqn.2010-10.org.openstack:584dd8df-f6a2-4e35-be7e-8de1e759491b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:40:45 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5fadc4f-60d6-4d53-81ba-32a65fd493c4 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:584dd8df-f6a2-4e35-be7e-8de1e759491b, portal: 172.16.0.220,3260]
Nov 16 10:40:45 user nova-compute[85141]: Logout of [sid: 55, target: iqn.2010-10.org.openstack:584dd8df-f6a2-4e35-be7e-8de1e759491b, portal: 172.16.0.220,3260] successful.
Nov 16 10:40:45 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:40:45 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:584dd8df-f6a2-4e35-be7e-8de1e759491b -p 172.16.0.220:3260 --op delete {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:40:45 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:584dd8df-f6a2-4e35-be7e-8de1e759491b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:40:45 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[be56b5f9-9a56-424f-a500-936b47385604]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:40:45 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5fadc4f-60d6-4d53-81ba-32a65fd493c4 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:40:45 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-d5fadc4f-60d6-4d53-81ba-32a65fd493c4 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.294s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 10:40:45 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5fadc4f-60d6-4d53-81ba-32a65fd493c4 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] <== disconnect_volume: return (294ms) None {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 10:40:45 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d5fadc4f-60d6-4d53-81ba-32a65fd493c4 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: 797c873e-cf15-4d3c-a3bc-bd2a81a80014] Disconnected iSCSI Volume {{(pid=85141) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 10:40:45 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-d5fadc4f-60d6-4d53-81ba-32a65fd493c4 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: 797c873e-cf15-4d3c-a3bc-bd2a81a80014] Deleting instance files /opt/stack/data/nova/instances/797c873e-cf15-4d3c-a3bc-bd2a81a80014_del
Nov 16 10:40:45 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-d5fadc4f-60d6-4d53-81ba-32a65fd493c4 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: 797c873e-cf15-4d3c-a3bc-bd2a81a80014] Deletion of /opt/stack/data/nova/instances/797c873e-cf15-4d3c-a3bc-bd2a81a80014_del complete
Nov 16 10:40:45 user nova-compute[85141]: INFO nova.compute.manager [None req-d5fadc4f-60d6-4d53-81ba-32a65fd493c4 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: 797c873e-cf15-4d3c-a3bc-bd2a81a80014] Took 1.15 seconds to destroy the instance on the hypervisor.
Nov 16 10:40:45 user nova-compute[85141]: DEBUG oslo.service.loopingcall [None req-d5fadc4f-60d6-4d53-81ba-32a65fd493c4 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=85141) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 10:40:45 user nova-compute[85141]: DEBUG nova.compute.manager [-] [instance: 797c873e-cf15-4d3c-a3bc-bd2a81a80014] Deallocating network for instance {{(pid=85141) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 10:40:45 user nova-compute[85141]: DEBUG nova.network.neutron [-] [instance: 797c873e-cf15-4d3c-a3bc-bd2a81a80014] deallocate_for_instance() {{(pid=85141) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 10:40:45 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager.update_available_resource {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:40:45 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:40:45 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:40:45 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:40:45 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Auditing locally available compute resources for user (node: user) {{(pid=85141) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 10:40:45 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cafaf59-3cc9-4612-8da5-b2b60f8223e6/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:40:45 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cafaf59-3cc9-4612-8da5-b2b60f8223e6/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:40:45 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cafaf59-3cc9-4612-8da5-b2b60f8223e6/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:40:45 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cafaf59-3cc9-4612-8da5-b2b60f8223e6/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:40:45 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e01e0e9-5eef-4af4-8633-814d59860b8d/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:40:45 user nova-compute[85141]: DEBUG nova.network.neutron [-] [instance: 797c873e-cf15-4d3c-a3bc-bd2a81a80014] Updating instance_info_cache with network_info: [] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:40:45 user nova-compute[85141]: DEBUG nova.compute.manager [req-b5e0826a-ccba-4bbc-9512-54c8d2ef2123 req-93ccc574-9962-4ea0-854d-06e2cfba3fac service nova] [instance: 797c873e-cf15-4d3c-a3bc-bd2a81a80014] Received event network-vif-deleted-27c72f03-eb45-49ad-b17e-330eecf72cb1 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:40:45 user nova-compute[85141]: INFO nova.compute.manager [req-b5e0826a-ccba-4bbc-9512-54c8d2ef2123 req-93ccc574-9962-4ea0-854d-06e2cfba3fac service nova] [instance: 797c873e-cf15-4d3c-a3bc-bd2a81a80014] Neutron deleted interface 27c72f03-eb45-49ad-b17e-330eecf72cb1; detaching it from the instance and deleting it from the info cache
Nov 16 10:40:45 user nova-compute[85141]: DEBUG nova.network.neutron [req-b5e0826a-ccba-4bbc-9512-54c8d2ef2123 req-93ccc574-9962-4ea0-854d-06e2cfba3fac service nova] [instance: 797c873e-cf15-4d3c-a3bc-bd2a81a80014] Updating instance_info_cache with network_info: [] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:40:45 user nova-compute[85141]: INFO nova.compute.manager [-] [instance: 797c873e-cf15-4d3c-a3bc-bd2a81a80014] Took 0.75 seconds to deallocate network for instance.
Nov 16 10:40:45 user nova-compute[85141]: DEBUG nova.compute.manager [req-b5e0826a-ccba-4bbc-9512-54c8d2ef2123 req-93ccc574-9962-4ea0-854d-06e2cfba3fac service nova] [instance: 797c873e-cf15-4d3c-a3bc-bd2a81a80014] Detach interface failed, port_id=27c72f03-eb45-49ad-b17e-330eecf72cb1, reason: Instance 797c873e-cf15-4d3c-a3bc-bd2a81a80014 could not be found. {{(pid=85141) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 16 10:40:45 user nova-compute[85141]: DEBUG nova.compute.manager [req-f84793ed-3558-4458-8b4d-75b79817bb7c req-e2b1a5b4-b632-40da-aaee-3c162edc9543 service nova] [instance: 797c873e-cf15-4d3c-a3bc-bd2a81a80014] Received event network-vif-unplugged-27c72f03-eb45-49ad-b17e-330eecf72cb1 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:40:45 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-f84793ed-3558-4458-8b4d-75b79817bb7c req-e2b1a5b4-b632-40da-aaee-3c162edc9543 service nova] Acquiring lock "797c873e-cf15-4d3c-a3bc-bd2a81a80014-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:40:45 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-f84793ed-3558-4458-8b4d-75b79817bb7c req-e2b1a5b4-b632-40da-aaee-3c162edc9543 service nova] Lock "797c873e-cf15-4d3c-a3bc-bd2a81a80014-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:40:45 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-f84793ed-3558-4458-8b4d-75b79817bb7c req-e2b1a5b4-b632-40da-aaee-3c162edc9543 service nova] Lock "797c873e-cf15-4d3c-a3bc-bd2a81a80014-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:40:45 user nova-compute[85141]: DEBUG nova.compute.manager [req-f84793ed-3558-4458-8b4d-75b79817bb7c req-e2b1a5b4-b632-40da-aaee-3c162edc9543 service nova] [instance: 797c873e-cf15-4d3c-a3bc-bd2a81a80014] No waiting events found dispatching network-vif-unplugged-27c72f03-eb45-49ad-b17e-330eecf72cb1 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:40:45 user nova-compute[85141]: DEBUG nova.compute.manager [req-f84793ed-3558-4458-8b4d-75b79817bb7c req-e2b1a5b4-b632-40da-aaee-3c162edc9543 service nova] [instance: 797c873e-cf15-4d3c-a3bc-bd2a81a80014] Received event network-vif-unplugged-27c72f03-eb45-49ad-b17e-330eecf72cb1 for instance with task_state deleting. {{(pid=85141) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 10:40:45 user nova-compute[85141]: DEBUG nova.compute.manager [req-f84793ed-3558-4458-8b4d-75b79817bb7c req-e2b1a5b4-b632-40da-aaee-3c162edc9543 service nova] [instance: 797c873e-cf15-4d3c-a3bc-bd2a81a80014] Received event network-vif-plugged-27c72f03-eb45-49ad-b17e-330eecf72cb1 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:40:45 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-f84793ed-3558-4458-8b4d-75b79817bb7c req-e2b1a5b4-b632-40da-aaee-3c162edc9543 service nova] Acquiring lock "797c873e-cf15-4d3c-a3bc-bd2a81a80014-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:40:45 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-f84793ed-3558-4458-8b4d-75b79817bb7c req-e2b1a5b4-b632-40da-aaee-3c162edc9543 service nova] Lock "797c873e-cf15-4d3c-a3bc-bd2a81a80014-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:40:45 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-f84793ed-3558-4458-8b4d-75b79817bb7c req-e2b1a5b4-b632-40da-aaee-3c162edc9543 service nova] Lock "797c873e-cf15-4d3c-a3bc-bd2a81a80014-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:40:45 user nova-compute[85141]: DEBUG nova.compute.manager [req-f84793ed-3558-4458-8b4d-75b79817bb7c req-e2b1a5b4-b632-40da-aaee-3c162edc9543 service nova] [instance: 797c873e-cf15-4d3c-a3bc-bd2a81a80014] No waiting events found dispatching network-vif-plugged-27c72f03-eb45-49ad-b17e-330eecf72cb1 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:40:45 user nova-compute[85141]: WARNING nova.compute.manager [req-f84793ed-3558-4458-8b4d-75b79817bb7c req-e2b1a5b4-b632-40da-aaee-3c162edc9543 service nova] [instance: 797c873e-cf15-4d3c-a3bc-bd2a81a80014] Received unexpected event network-vif-plugged-27c72f03-eb45-49ad-b17e-330eecf72cb1 for instance with vm_state active and task_state deleting.
Nov 16 10:40:46 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e01e0e9-5eef-4af4-8633-814d59860b8d/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:40:46 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e01e0e9-5eef-4af4-8633-814d59860b8d/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:40:46 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e01e0e9-5eef-4af4-8633-814d59860b8d/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:40:46 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:40:46 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:40:46 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Hypervisor/Node resource view: name=user free_ram=8778MB free_disk=25.025070190429688GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=85141) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 10:40:46 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:40:46 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:40:46 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance 1e01e0e9-5eef-4af4-8633-814d59860b8d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:40:46 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance 797c873e-cf15-4d3c-a3bc-bd2a81a80014 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:40:46 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance 3cafaf59-3cc9-4612-8da5-b2b60f8223e6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:40:46 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=85141) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 10:40:46 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=85141) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 10:40:46 user nova-compute[85141]: INFO nova.compute.manager [None req-d5fadc4f-60d6-4d53-81ba-32a65fd493c4 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] [instance: 797c873e-cf15-4d3c-a3bc-bd2a81a80014] Took 0.75 seconds to detach 1 volumes for instance.
Nov 16 10:40:46 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-d5fadc4f-60d6-4d53-81ba-32a65fd493c4 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:40:46 user nova-compute[85141]: DEBUG nova.compute.provider_tree [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Inventory has not changed in ProviderTree for provider: bf8e0fa1-16b6-408f-9203-c4cd63916272 {{(pid=85141) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 10:40:46 user nova-compute[85141]: DEBUG nova.scheduler.client.report [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Inventory has not changed for provider bf8e0fa1-16b6-408f-9203-c4cd63916272 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=85141) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 10:40:46 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Compute_service record updated for user:user {{(pid=85141) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 10:40:46 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.257s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:40:46 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-d5fadc4f-60d6-4d53-81ba-32a65fd493c4 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.096s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:40:46 user nova-compute[85141]: DEBUG nova.compute.provider_tree [None req-d5fadc4f-60d6-4d53-81ba-32a65fd493c4 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Inventory has not changed in ProviderTree for provider: bf8e0fa1-16b6-408f-9203-c4cd63916272 {{(pid=85141) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 10:40:46 user nova-compute[85141]: DEBUG nova.scheduler.client.report [None req-d5fadc4f-60d6-4d53-81ba-32a65fd493c4 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Inventory has not changed for provider bf8e0fa1-16b6-408f-9203-c4cd63916272 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=85141) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 10:40:46 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-d5fadc4f-60d6-4d53-81ba-32a65fd493c4 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.147s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:40:47 user nova-compute[85141]: INFO nova.scheduler.client.report [None req-d5fadc4f-60d6-4d53-81ba-32a65fd493c4 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Deleted allocations for instance 797c873e-cf15-4d3c-a3bc-bd2a81a80014
Nov 16 10:40:47 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-d5fadc4f-60d6-4d53-81ba-32a65fd493c4 tempest-TestVolumeBootPattern-1979039357 tempest-TestVolumeBootPattern-1979039357-project-member] Lock "797c873e-cf15-4d3c-a3bc-bd2a81a80014" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.106s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:40:47 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:40:47 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Starting heal instance info cache {{(pid=85141) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 10:40:47 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Acquiring lock "refresh_cache-3cafaf59-3cc9-4612-8da5-b2b60f8223e6" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:40:47 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Acquired lock "refresh_cache-3cafaf59-3cc9-4612-8da5-b2b60f8223e6" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:40:47 user nova-compute[85141]: DEBUG nova.network.neutron [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] [instance: 3cafaf59-3cc9-4612-8da5-b2b60f8223e6] Forcefully refreshing network info cache for instance {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 10:40:48 user nova-compute[85141]: DEBUG nova.network.neutron [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] [instance: 3cafaf59-3cc9-4612-8da5-b2b60f8223e6] Updating instance_info_cache with network_info: [{"id": "e30a03ca-bc02-4f7b-a94f-bda128aa7c39", "address": "fa:16:3e:3d:15:cb", "network": {"id": "8931cd8f-3c0b-4d49-ae98-48f818e854e7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1902653571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d13c6ff3c30549ca9ab44d9fc1fedc6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape30a03ca-bc", "ovs_interfaceid": "e30a03ca-bc02-4f7b-a94f-bda128aa7c39", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:40:48 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Releasing lock "refresh_cache-3cafaf59-3cc9-4612-8da5-b2b60f8223e6" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:40:48 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] [instance: 3cafaf59-3cc9-4612-8da5-b2b60f8223e6] Updated the network info_cache for instance {{(pid=85141) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 10:40:48 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:40:48 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:40:49 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:40:50 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:40:52 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:40:53 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:40:53 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:40:54 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-5ed463c3-1081-40df-baa5-9cd76dbd1eec tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 3cafaf59-3cc9-4612-8da5-b2b60f8223e6 is timed out.
Nov 16 10:40:54 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-5ed463c3-1081-40df-baa5-9cd76dbd1eec tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Successfully detached device vdb from instance 3cafaf59-3cc9-4612-8da5-b2b60f8223e6 from the live domain config.
Nov 16 10:40:54 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5ed463c3-1081-40df-baa5-9cd76dbd1eec tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] [instance: 3cafaf59-3cc9-4612-8da5-b2b60f8223e6] calling os-brick to detach iSCSI Volume {{(pid=85141) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 10:40:54 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ed463c3-1081-40df-baa5-9cd76dbd1eec tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51806b6080>, {'target_iqn': 'iqn.2010-10.org.openstack:56f96a41-3843-45f8-8bb3-d9ca58f63119', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tIGoFCLy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 10:40:54 user nova-compute[85141]: WARNING os_brick.initiator.connectors.base [None req-5ed463c3-1081-40df-baa5-9cd76dbd1eec tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 10:40:54 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-5ed463c3-1081-40df-baa5-9cd76dbd1eec tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 10:40:54 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-5ed463c3-1081-40df-baa5-9cd76dbd1eec tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 10:40:54 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:40:54 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:40:54 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed6b0eaf-314f-41c2-92b0-3663c5b73b19]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:56f96a41-3843-45f8-8bb3-d9ca58f63119\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:40:54 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ed463c3-1081-40df-baa5-9cd76dbd1eec tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 10:40:54 user nova-compute[85141]: No targets found.
Nov 16 10:40:54 user nova-compute[85141]: iSNS:
Nov 16 10:40:54 user nova-compute[85141]: No targets found.
Nov 16 10:40:54 user nova-compute[85141]: STATIC:
Nov 16 10:40:54 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:56f96a41-3843-45f8-8bb3-d9ca58f63119
Nov 16 10:40:54 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:40:54 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:40:54 user nova-compute[85141]: FIRMWARE:
Nov 16 10:40:54 user nova-compute[85141]: No targets found.
Nov 16 10:40:54 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:40:54 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ed463c3-1081-40df-baa5-9cd76dbd1eec tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 10:40:54 user nova-compute[85141]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 10:40:54 user nova-compute[85141]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=85141) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 10:40:54 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ed463c3-1081-40df-baa5-9cd76dbd1eec tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:56f96a41-3843-45f8-8bb3-d9ca58f63119', 0)] {{(pid=85141) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 10:40:54 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:40:54 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:40:54 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[8796be4e-e373-42ef-953e-a44ad1a60d0d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:56f96a41-3843-45f8-8bb3-d9ca58f63119\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:40:54 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:40:54 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:40:54 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f033924-13cd-4822-8ef3-72b91f43a7d2]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56f96a41-3843-45f8-8bb3-d9ca58f63119 (non-flash)\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:40:54 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ed463c3-1081-40df-baa5-9cd76dbd1eec tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56f96a41-3843-45f8-8bb3-d9ca58f63119 (non-flash)
Nov 16 10:40:54 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:40:54 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ed463c3-1081-40df-baa5-9cd76dbd1eec tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56f96a41-3843-45f8-8bb3-d9ca58f63119 (non-flash)
Nov 16 10:40:54 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 10:40:54 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ed463c3-1081-40df-baa5-9cd76dbd1eec tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f516056e0e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:56f96a41-3843-45f8-8bb3-d9ca58f63119'): ({'sdc'}, set())}) {{(pid=85141) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 10:40:54 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-5ed463c3-1081-40df-baa5-9cd76dbd1eec tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Removing single pathed devices sdc {{(pid=85141) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 10:40:54 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:40:54 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:40:54 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[46ead068-2686-43a5-84e1-34ea155c45a2]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:40:54 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:40:54 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:40:54 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dfbd6e7-f8a8-4446-980f-8d9b93ecc448]: (4, ('ok\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:40:54 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-5ed463c3-1081-40df-baa5-9cd76dbd1eec tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Flushing IO for device /dev/sdc {{(pid=85141) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 10:40:54 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:40:54 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:40:54 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d0a18a1-d0cd-4c89-a5ae-cd524f90ee21]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:40:54 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-5ed463c3-1081-40df-baa5-9cd76dbd1eec tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=85141) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 10:40:54 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:40:54 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:40:54 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.055s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:40:54 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb7ce7a0-84d4-4b53-8ad1-562eb5427885]: (4, ('1', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:40:54 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-5ed463c3-1081-40df-baa5-9cd76dbd1eec tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=85141) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 10:40:54 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-5ed463c3-1081-40df-baa5-9cd76dbd1eec tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] SCSI volumes sdc have been removed. {{(pid=85141) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 10:40:54 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ed463c3-1081-40df-baa5-9cd76dbd1eec tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:56f96a41-3843-45f8-8bb3-d9ca58f63119')] {{(pid=85141) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 10:40:54 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56f96a41-3843-45f8-8bb3-d9ca58f63119 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:40:54 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56f96a41-3843-45f8-8bb3-d9ca58f63119 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:40:54 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fdb67a8-03ea-46c6-b0ba-8481ba4cf3c8]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:40:54 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ed463c3-1081-40df-baa5-9cd76dbd1eec tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:40:54 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56f96a41-3843-45f8-8bb3-d9ca58f63119 -p 172.16.0.220:3260 --logout {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:40:54 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56f96a41-3843-45f8-8bb3-d9ca58f63119 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:40:54 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[e34dc55b-56b5-4157-8c1c-6869c3578c82]: (4, ('Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:56f96a41-3843-45f8-8bb3-d9ca58f63119, portal: 172.16.0.220,3260]\nLogout of [sid: 61, target: iqn.2010-10.org.openstack:56f96a41-3843-45f8-8bb3-d9ca58f63119, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:40:54 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ed463c3-1081-40df-baa5-9cd76dbd1eec tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:56f96a41-3843-45f8-8bb3-d9ca58f63119, portal: 172.16.0.220,3260]
Nov 16 10:40:54 user nova-compute[85141]: Logout of [sid: 61, target: iqn.2010-10.org.openstack:56f96a41-3843-45f8-8bb3-d9ca58f63119, portal: 172.16.0.220,3260] successful.
Nov 16 10:40:54 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:40:54 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56f96a41-3843-45f8-8bb3-d9ca58f63119 -p 172.16.0.220:3260 --op delete {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:40:54 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56f96a41-3843-45f8-8bb3-d9ca58f63119 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:40:54 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[508e7d82-506a-4b6f-b863-660eb2632269]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:40:54 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ed463c3-1081-40df-baa5-9cd76dbd1eec tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:40:54 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-5ed463c3-1081-40df-baa5-9cd76dbd1eec tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.285s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 10:40:54 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ed463c3-1081-40df-baa5-9cd76dbd1eec tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] <== disconnect_volume: return (286ms) None {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 10:40:54 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5ed463c3-1081-40df-baa5-9cd76dbd1eec tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] [instance: 3cafaf59-3cc9-4612-8da5-b2b60f8223e6] Disconnected iSCSI Volume {{(pid=85141) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 10:40:55 user nova-compute[85141]: DEBUG nova.objects.instance [None req-5ed463c3-1081-40df-baa5-9cd76dbd1eec tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Lazy-loading 'flavor' on Instance uuid 3cafaf59-3cc9-4612-8da5-b2b60f8223e6 {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:40:55 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5ed463c3-1081-40df-baa5-9cd76dbd1eec tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Lock "3cafaf59-3cc9-4612-8da5-b2b60f8223e6" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.766s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:40:56 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:40:59 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:41:04 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:41:04 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:41:04 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=85141) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 10:41:04 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=85141) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 10:41:04 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=85141) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 10:41:04 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:41:09 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:41:13 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-016a6fbd-b572-4f7b-a4d6-522f90772ddd tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Acquiring lock "1e01e0e9-5eef-4af4-8633-814d59860b8d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:41:13 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-016a6fbd-b572-4f7b-a4d6-522f90772ddd tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Lock "1e01e0e9-5eef-4af4-8633-814d59860b8d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:41:13 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-016a6fbd-b572-4f7b-a4d6-522f90772ddd tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Acquiring lock "1e01e0e9-5eef-4af4-8633-814d59860b8d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:41:13 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-016a6fbd-b572-4f7b-a4d6-522f90772ddd tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Lock "1e01e0e9-5eef-4af4-8633-814d59860b8d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:41:13 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-016a6fbd-b572-4f7b-a4d6-522f90772ddd tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Lock "1e01e0e9-5eef-4af4-8633-814d59860b8d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:41:13 user nova-compute[85141]: INFO nova.compute.manager [None req-016a6fbd-b572-4f7b-a4d6-522f90772ddd tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] [instance: 1e01e0e9-5eef-4af4-8633-814d59860b8d] Terminating instance
Nov 16 10:41:13 user nova-compute[85141]: DEBUG nova.compute.manager [None req-016a6fbd-b572-4f7b-a4d6-522f90772ddd tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] [instance: 1e01e0e9-5eef-4af4-8633-814d59860b8d] Start destroying the instance on the hypervisor. {{(pid=85141) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 10:41:13 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:41:13 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:41:13 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:41:13 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:41:13 user nova-compute[85141]: DEBUG nova.compute.manager [req-1796b56e-6386-4705-be35-b51c34234ee8 req-4e273e7d-d34b-4d64-9a0c-7e9e74d430e0 service nova] [instance: 1e01e0e9-5eef-4af4-8633-814d59860b8d] Received event network-vif-unplugged-6f4c8e31-7ee9-4257-9441-12fff78fb8d1 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:41:13 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-1796b56e-6386-4705-be35-b51c34234ee8 req-4e273e7d-d34b-4d64-9a0c-7e9e74d430e0 service nova] Acquiring lock "1e01e0e9-5eef-4af4-8633-814d59860b8d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:41:13 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-1796b56e-6386-4705-be35-b51c34234ee8 req-4e273e7d-d34b-4d64-9a0c-7e9e74d430e0 service nova] Lock "1e01e0e9-5eef-4af4-8633-814d59860b8d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:41:13 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-1796b56e-6386-4705-be35-b51c34234ee8 req-4e273e7d-d34b-4d64-9a0c-7e9e74d430e0 service nova] Lock "1e01e0e9-5eef-4af4-8633-814d59860b8d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:41:13 user nova-compute[85141]: DEBUG nova.compute.manager [req-1796b56e-6386-4705-be35-b51c34234ee8 req-4e273e7d-d34b-4d64-9a0c-7e9e74d430e0 service nova] [instance: 1e01e0e9-5eef-4af4-8633-814d59860b8d] No waiting events found dispatching network-vif-unplugged-6f4c8e31-7ee9-4257-9441-12fff78fb8d1 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:41:13 user nova-compute[85141]: DEBUG nova.compute.manager [req-1796b56e-6386-4705-be35-b51c34234ee8 req-4e273e7d-d34b-4d64-9a0c-7e9e74d430e0 service nova] [instance: 1e01e0e9-5eef-4af4-8633-814d59860b8d] Received event network-vif-unplugged-6f4c8e31-7ee9-4257-9441-12fff78fb8d1 for instance with task_state deleting. {{(pid=85141) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 10:41:13 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:41:14 user nova-compute[85141]: INFO nova.virt.libvirt.driver [-] [instance: 1e01e0e9-5eef-4af4-8633-814d59860b8d] Instance destroyed successfully.
Nov 16 10:41:14 user nova-compute[85141]: DEBUG nova.objects.instance [None req-016a6fbd-b572-4f7b-a4d6-522f90772ddd tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Lazy-loading 'resources' on Instance uuid 1e01e0e9-5eef-4af4-8633-814d59860b8d {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:41:14 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-016a6fbd-b572-4f7b-a4d6-522f90772ddd tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T10:34:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-571407805',display_name='tempest-SnapshotDataIntegrityTests-server-571407805',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-571407805',id=48,image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJAIjQAU3XGtvIoCMPWRPlLywfyklBRcbuTI4zNVM6Vys6PqP2eeNdXzYKUlSt5eu1ShpmoUNG9dnOTirwdkIIDNCAcRDlJunZZo63ChrJWo0eiovmZYl5WVEuaOjeQH2w==',key_name='tempest-keypair-320551232',keypairs=<?>,launch_index=0,launched_at=2023-11-16T10:34:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='647a6ef16a7b496a9568f9d777e38412',ramdisk_id='',reservation_id='r-6b6nyvtq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-254660638',owner_user_name='tempest-SnapshotDataIntegrityTests-254660638-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T10:34:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f111c3a73e2845eaa5d2238680805018',uuid=1e01e0e9-5eef-4af4-8633-814d59860b8d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6f4c8e31-7ee9-4257-9441-12fff78fb8d1", "address": "fa:16:3e:40:7a:69", "network": {"id": "609e6198-811e-4b40-a518-f960e9fc5b91", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1628388169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "647a6ef16a7b496a9568f9d777e38412", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f4c8e31-7e", "ovs_interfaceid": "6f4c8e31-7ee9-4257-9441-12fff78fb8d1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 10:41:14 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-016a6fbd-b572-4f7b-a4d6-522f90772ddd tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Converting VIF {"id": "6f4c8e31-7ee9-4257-9441-12fff78fb8d1", "address": "fa:16:3e:40:7a:69", "network": {"id": "609e6198-811e-4b40-a518-f960e9fc5b91", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1628388169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "647a6ef16a7b496a9568f9d777e38412", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f4c8e31-7e", "ovs_interfaceid": "6f4c8e31-7ee9-4257-9441-12fff78fb8d1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:41:14 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-016a6fbd-b572-4f7b-a4d6-522f90772ddd tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:40:7a:69,bridge_name='br-int',has_traffic_filtering=True,id=6f4c8e31-7ee9-4257-9441-12fff78fb8d1,network=Network(609e6198-811e-4b40-a518-f960e9fc5b91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f4c8e31-7e') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:41:14 user nova-compute[85141]: DEBUG os_vif [None req-016a6fbd-b572-4f7b-a4d6-522f90772ddd tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:40:7a:69,bridge_name='br-int',has_traffic_filtering=True,id=6f4c8e31-7ee9-4257-9441-12fff78fb8d1,network=Network(609e6198-811e-4b40-a518-f960e9fc5b91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f4c8e31-7e') {{(pid=85141) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 10:41:14 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:41:14 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6f4c8e31-7e, bridge=br-int, if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:41:14 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:41:14 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:41:14 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:41:14 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c3f9a956-f382-4e25-8bbe-693c42c8100a) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:41:14 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:41:14 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:41:14 user nova-compute[85141]: INFO os_vif [None req-016a6fbd-b572-4f7b-a4d6-522f90772ddd tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:40:7a:69,bridge_name='br-int',has_traffic_filtering=True,id=6f4c8e31-7ee9-4257-9441-12fff78fb8d1,network=Network(609e6198-811e-4b40-a518-f960e9fc5b91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f4c8e31-7e')
Nov 16 10:41:14 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-016a6fbd-b572-4f7b-a4d6-522f90772ddd tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] [instance: 1e01e0e9-5eef-4af4-8633-814d59860b8d] Deleting instance files /opt/stack/data/nova/instances/1e01e0e9-5eef-4af4-8633-814d59860b8d_del
Nov 16 10:41:14 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-016a6fbd-b572-4f7b-a4d6-522f90772ddd tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] [instance: 1e01e0e9-5eef-4af4-8633-814d59860b8d] Deletion of /opt/stack/data/nova/instances/1e01e0e9-5eef-4af4-8633-814d59860b8d_del complete
Nov 16 10:41:14 user nova-compute[85141]: INFO nova.compute.manager [None req-016a6fbd-b572-4f7b-a4d6-522f90772ddd tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] [instance: 1e01e0e9-5eef-4af4-8633-814d59860b8d] Took 0.83 seconds to destroy the instance on the hypervisor.
Nov 16 10:41:14 user nova-compute[85141]: DEBUG oslo.service.loopingcall [None req-016a6fbd-b572-4f7b-a4d6-522f90772ddd tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=85141) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 10:41:14 user nova-compute[85141]: DEBUG nova.compute.manager [-] [instance: 1e01e0e9-5eef-4af4-8633-814d59860b8d] Deallocating network for instance {{(pid=85141) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 10:41:14 user nova-compute[85141]: DEBUG nova.network.neutron [-] [instance: 1e01e0e9-5eef-4af4-8633-814d59860b8d] deallocate_for_instance() {{(pid=85141) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 10:41:14 user nova-compute[85141]: DEBUG nova.network.neutron [-] [instance: 1e01e0e9-5eef-4af4-8633-814d59860b8d] Updating instance_info_cache with network_info: [] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:41:14 user nova-compute[85141]: INFO nova.compute.manager [-] [instance: 1e01e0e9-5eef-4af4-8633-814d59860b8d] Took 0.81 seconds to deallocate network for instance.
Nov 16 10:41:15 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-016a6fbd-b572-4f7b-a4d6-522f90772ddd tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:41:15 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-016a6fbd-b572-4f7b-a4d6-522f90772ddd tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:41:15 user nova-compute[85141]: DEBUG nova.compute.manager [req-39d51fc0-c59a-4cb3-b624-c28c9ed8ffba req-2f554d04-248c-4ddd-8275-29ad6f25f2e0 service nova] [instance: 1e01e0e9-5eef-4af4-8633-814d59860b8d] Received event network-vif-deleted-6f4c8e31-7ee9-4257-9441-12fff78fb8d1 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:41:15 user nova-compute[85141]: DEBUG nova.compute.provider_tree [None req-016a6fbd-b572-4f7b-a4d6-522f90772ddd tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Inventory has not changed in ProviderTree for provider: bf8e0fa1-16b6-408f-9203-c4cd63916272 {{(pid=85141) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 10:41:15 user nova-compute[85141]: DEBUG nova.scheduler.client.report [None req-016a6fbd-b572-4f7b-a4d6-522f90772ddd tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Inventory has not changed for provider bf8e0fa1-16b6-408f-9203-c4cd63916272 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=85141) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 10:41:15 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-016a6fbd-b572-4f7b-a4d6-522f90772ddd tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.132s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:41:15 user nova-compute[85141]: INFO nova.scheduler.client.report [None req-016a6fbd-b572-4f7b-a4d6-522f90772ddd tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Deleted allocations for instance 1e01e0e9-5eef-4af4-8633-814d59860b8d
Nov 16 10:41:15 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-016a6fbd-b572-4f7b-a4d6-522f90772ddd tempest-SnapshotDataIntegrityTests-254660638 tempest-SnapshotDataIntegrityTests-254660638-project-member] Lock "1e01e0e9-5eef-4af4-8633-814d59860b8d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.940s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:41:15 user nova-compute[85141]: DEBUG nova.compute.manager [req-21d22d8d-e891-49aa-99e3-ee6003e9361e req-6347fccd-4ab8-4910-aadf-14bb9127e0c4 service nova] [instance: 1e01e0e9-5eef-4af4-8633-814d59860b8d] Received event network-vif-plugged-6f4c8e31-7ee9-4257-9441-12fff78fb8d1 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:41:15 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-21d22d8d-e891-49aa-99e3-ee6003e9361e req-6347fccd-4ab8-4910-aadf-14bb9127e0c4 service nova] Acquiring lock "1e01e0e9-5eef-4af4-8633-814d59860b8d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:41:15 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-21d22d8d-e891-49aa-99e3-ee6003e9361e req-6347fccd-4ab8-4910-aadf-14bb9127e0c4 service nova] Lock "1e01e0e9-5eef-4af4-8633-814d59860b8d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:41:15 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-21d22d8d-e891-49aa-99e3-ee6003e9361e req-6347fccd-4ab8-4910-aadf-14bb9127e0c4 service nova] Lock "1e01e0e9-5eef-4af4-8633-814d59860b8d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:41:15 user nova-compute[85141]: DEBUG nova.compute.manager [req-21d22d8d-e891-49aa-99e3-ee6003e9361e req-6347fccd-4ab8-4910-aadf-14bb9127e0c4 service nova] [instance: 1e01e0e9-5eef-4af4-8633-814d59860b8d] No waiting events found dispatching network-vif-plugged-6f4c8e31-7ee9-4257-9441-12fff78fb8d1 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:41:15 user nova-compute[85141]: WARNING nova.compute.manager [req-21d22d8d-e891-49aa-99e3-ee6003e9361e req-6347fccd-4ab8-4910-aadf-14bb9127e0c4 service nova] [instance: 1e01e0e9-5eef-4af4-8633-814d59860b8d] Received unexpected event network-vif-plugged-6f4c8e31-7ee9-4257-9441-12fff78fb8d1 for instance with vm_state deleted and task_state None.
Nov 16 10:41:19 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:41:24 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:41:24 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5d9dc56c-bc9c-4acd-aec5-7acc3daeb58e tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Acquiring lock "3cafaf59-3cc9-4612-8da5-b2b60f8223e6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:41:24 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5d9dc56c-bc9c-4acd-aec5-7acc3daeb58e tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Lock "3cafaf59-3cc9-4612-8da5-b2b60f8223e6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:41:24 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5d9dc56c-bc9c-4acd-aec5-7acc3daeb58e tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Acquiring lock "3cafaf59-3cc9-4612-8da5-b2b60f8223e6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:41:24 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5d9dc56c-bc9c-4acd-aec5-7acc3daeb58e tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Lock "3cafaf59-3cc9-4612-8da5-b2b60f8223e6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:41:24 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5d9dc56c-bc9c-4acd-aec5-7acc3daeb58e tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Lock "3cafaf59-3cc9-4612-8da5-b2b60f8223e6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:41:24 user nova-compute[85141]: INFO nova.compute.manager [None req-5d9dc56c-bc9c-4acd-aec5-7acc3daeb58e tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] [instance: 3cafaf59-3cc9-4612-8da5-b2b60f8223e6] Terminating instance
Nov 16 10:41:24 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5d9dc56c-bc9c-4acd-aec5-7acc3daeb58e tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] [instance: 3cafaf59-3cc9-4612-8da5-b2b60f8223e6] Start destroying the instance on the hypervisor. {{(pid=85141) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 10:41:24 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:41:24 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:41:24 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:41:24 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:41:24 user nova-compute[85141]: DEBUG nova.compute.manager [req-99a8ed8e-6831-4a56-a245-d770dbca3b3c req-3813aa1f-6382-43eb-a5e0-41fb01e5f179 service nova] [instance: 3cafaf59-3cc9-4612-8da5-b2b60f8223e6] Received event network-vif-unplugged-e30a03ca-bc02-4f7b-a94f-bda128aa7c39 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:41:24 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-99a8ed8e-6831-4a56-a245-d770dbca3b3c req-3813aa1f-6382-43eb-a5e0-41fb01e5f179 service nova] Acquiring lock "3cafaf59-3cc9-4612-8da5-b2b60f8223e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:41:24 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-99a8ed8e-6831-4a56-a245-d770dbca3b3c req-3813aa1f-6382-43eb-a5e0-41fb01e5f179 service nova] Lock "3cafaf59-3cc9-4612-8da5-b2b60f8223e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:41:24 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-99a8ed8e-6831-4a56-a245-d770dbca3b3c req-3813aa1f-6382-43eb-a5e0-41fb01e5f179 service nova] Lock "3cafaf59-3cc9-4612-8da5-b2b60f8223e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:41:24 user nova-compute[85141]: DEBUG nova.compute.manager [req-99a8ed8e-6831-4a56-a245-d770dbca3b3c req-3813aa1f-6382-43eb-a5e0-41fb01e5f179 service nova] [instance: 3cafaf59-3cc9-4612-8da5-b2b60f8223e6] No waiting events found dispatching network-vif-unplugged-e30a03ca-bc02-4f7b-a94f-bda128aa7c39 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:41:24 user nova-compute[85141]: DEBUG nova.compute.manager [req-99a8ed8e-6831-4a56-a245-d770dbca3b3c req-3813aa1f-6382-43eb-a5e0-41fb01e5f179 service nova] [instance: 3cafaf59-3cc9-4612-8da5-b2b60f8223e6] Received event network-vif-unplugged-e30a03ca-bc02-4f7b-a94f-bda128aa7c39 for instance with task_state deleting. {{(pid=85141) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 10:41:25 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:41:25 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:41:25 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:41:25 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:41:25 user nova-compute[85141]: INFO nova.virt.libvirt.driver [-] [instance: 3cafaf59-3cc9-4612-8da5-b2b60f8223e6] Instance destroyed successfully.
Nov 16 10:41:25 user nova-compute[85141]: DEBUG nova.objects.instance [None req-5d9dc56c-bc9c-4acd-aec5-7acc3daeb58e tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Lazy-loading 'resources' on Instance uuid 3cafaf59-3cc9-4612-8da5-b2b60f8223e6 {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:41:25 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-5d9dc56c-bc9c-4acd-aec5-7acc3daeb58e tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T10:38:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-560000982',display_name='tempest-AttachVolumeNegativeTest-server-560000982',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-560000982',id=51,image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPPiDvvTvL+VKZHpXyXa3Y1yIO243lYnUUjMQE7HKYaZZ+uHe90gPcBqBIhvjHxhWKje9tGlEpv/Jbpj8s0N8oqcW/nOfelSjQP/yYrNscRFJiY6E4Dpxx4Scb+nd+zQuw==',key_name='tempest-keypair-2023218890',keypairs=<?>,launch_index=0,launched_at=2023-11-16T10:38:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d13c6ff3c30549ca9ab44d9fc1fedc6f',ramdisk_id='',reservation_id='r-40l1zo0p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-2108292208',owner_user_name='tempest-AttachVolumeNegativeTest-2108292208-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T10:38:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5aa5beeeca5d4dc89cf5333942da756f',uuid=3cafaf59-3cc9-4612-8da5-b2b60f8223e6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e30a03ca-bc02-4f7b-a94f-bda128aa7c39", "address": "fa:16:3e:3d:15:cb", "network": {"id": "8931cd8f-3c0b-4d49-ae98-48f818e854e7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1902653571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d13c6ff3c30549ca9ab44d9fc1fedc6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape30a03ca-bc", "ovs_interfaceid": "e30a03ca-bc02-4f7b-a94f-bda128aa7c39", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 10:41:25 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-5d9dc56c-bc9c-4acd-aec5-7acc3daeb58e tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Converting VIF {"id": "e30a03ca-bc02-4f7b-a94f-bda128aa7c39", "address": "fa:16:3e:3d:15:cb", "network": {"id": "8931cd8f-3c0b-4d49-ae98-48f818e854e7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1902653571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d13c6ff3c30549ca9ab44d9fc1fedc6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape30a03ca-bc", "ovs_interfaceid": "e30a03ca-bc02-4f7b-a94f-bda128aa7c39", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:41:25 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-5d9dc56c-bc9c-4acd-aec5-7acc3daeb58e tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3d:15:cb,bridge_name='br-int',has_traffic_filtering=True,id=e30a03ca-bc02-4f7b-a94f-bda128aa7c39,network=Network(8931cd8f-3c0b-4d49-ae98-48f818e854e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape30a03ca-bc') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:41:25 user nova-compute[85141]: DEBUG os_vif [None req-5d9dc56c-bc9c-4acd-aec5-7acc3daeb58e tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3d:15:cb,bridge_name='br-int',has_traffic_filtering=True,id=e30a03ca-bc02-4f7b-a94f-bda128aa7c39,network=Network(8931cd8f-3c0b-4d49-ae98-48f818e854e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape30a03ca-bc') {{(pid=85141) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 10:41:25 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:41:25 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape30a03ca-bc, bridge=br-int, if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:41:25 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:41:25 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:41:25 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1099c7f7-d89f-44d3-a3bf-12ddcb749df3) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:41:25 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:41:25 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:41:25 user nova-compute[85141]: INFO os_vif [None req-5d9dc56c-bc9c-4acd-aec5-7acc3daeb58e tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3d:15:cb,bridge_name='br-int',has_traffic_filtering=True,id=e30a03ca-bc02-4f7b-a94f-bda128aa7c39,network=Network(8931cd8f-3c0b-4d49-ae98-48f818e854e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape30a03ca-bc')
Nov 16 10:41:25 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-5d9dc56c-bc9c-4acd-aec5-7acc3daeb58e tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] [instance: 3cafaf59-3cc9-4612-8da5-b2b60f8223e6] Deleting instance files /opt/stack/data/nova/instances/3cafaf59-3cc9-4612-8da5-b2b60f8223e6_del
Nov 16 10:41:25 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-5d9dc56c-bc9c-4acd-aec5-7acc3daeb58e tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] [instance: 3cafaf59-3cc9-4612-8da5-b2b60f8223e6] Deletion of /opt/stack/data/nova/instances/3cafaf59-3cc9-4612-8da5-b2b60f8223e6_del complete
Nov 16 10:41:25 user nova-compute[85141]: INFO nova.compute.manager [None req-5d9dc56c-bc9c-4acd-aec5-7acc3daeb58e tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] [instance: 3cafaf59-3cc9-4612-8da5-b2b60f8223e6] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 16 10:41:25 user nova-compute[85141]: DEBUG oslo.service.loopingcall [None req-5d9dc56c-bc9c-4acd-aec5-7acc3daeb58e tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=85141) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 10:41:25 user nova-compute[85141]: DEBUG nova.compute.manager [-] [instance: 3cafaf59-3cc9-4612-8da5-b2b60f8223e6] Deallocating network for instance {{(pid=85141) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 10:41:25 user nova-compute[85141]: DEBUG nova.network.neutron [-] [instance: 3cafaf59-3cc9-4612-8da5-b2b60f8223e6] deallocate_for_instance() {{(pid=85141) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 10:41:25 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:41:25 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:41:25 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:41:25 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:41:25 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:41:25 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:41:26 user nova-compute[85141]: DEBUG nova.network.neutron [-] [instance: 3cafaf59-3cc9-4612-8da5-b2b60f8223e6] Updating instance_info_cache with network_info: [] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:41:26 user nova-compute[85141]: INFO nova.compute.manager [-] [instance: 3cafaf59-3cc9-4612-8da5-b2b60f8223e6] Took 0.87 seconds to deallocate network for instance.
Nov 16 10:41:26 user nova-compute[85141]: DEBUG nova.compute.manager [req-bd588044-f44d-4932-8f94-aaab53726afd req-6c47fa18-3080-492c-82f4-ad35ee0e3dc8 service nova] [instance: 3cafaf59-3cc9-4612-8da5-b2b60f8223e6] Received event network-vif-deleted-e30a03ca-bc02-4f7b-a94f-bda128aa7c39 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:41:26 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5d9dc56c-bc9c-4acd-aec5-7acc3daeb58e tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:41:26 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5d9dc56c-bc9c-4acd-aec5-7acc3daeb58e tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:41:26 user nova-compute[85141]: DEBUG nova.compute.provider_tree [None req-5d9dc56c-bc9c-4acd-aec5-7acc3daeb58e tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Inventory has not changed in ProviderTree for provider: bf8e0fa1-16b6-408f-9203-c4cd63916272 {{(pid=85141) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 10:41:26 user nova-compute[85141]: DEBUG nova.scheduler.client.report [None req-5d9dc56c-bc9c-4acd-aec5-7acc3daeb58e tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Inventory has not changed for provider bf8e0fa1-16b6-408f-9203-c4cd63916272 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=85141) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 10:41:26 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5d9dc56c-bc9c-4acd-aec5-7acc3daeb58e tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.111s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:41:26 user nova-compute[85141]: INFO nova.scheduler.client.report [None req-5d9dc56c-bc9c-4acd-aec5-7acc3daeb58e tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Deleted allocations for instance 3cafaf59-3cc9-4612-8da5-b2b60f8223e6
Nov 16 10:41:26 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5d9dc56c-bc9c-4acd-aec5-7acc3daeb58e tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Lock "3cafaf59-3cc9-4612-8da5-b2b60f8223e6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.180s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:41:26 user nova-compute[85141]: DEBUG nova.compute.manager [req-cefef1dd-2add-4a71-b730-9317efb51800 req-7eb8aefd-32c4-4db7-b858-3b38d90a5232 service nova] [instance: 3cafaf59-3cc9-4612-8da5-b2b60f8223e6] Received event network-vif-plugged-e30a03ca-bc02-4f7b-a94f-bda128aa7c39 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:41:26 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-cefef1dd-2add-4a71-b730-9317efb51800 req-7eb8aefd-32c4-4db7-b858-3b38d90a5232 service nova] Acquiring lock "3cafaf59-3cc9-4612-8da5-b2b60f8223e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:41:26 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-cefef1dd-2add-4a71-b730-9317efb51800 req-7eb8aefd-32c4-4db7-b858-3b38d90a5232 service nova] Lock "3cafaf59-3cc9-4612-8da5-b2b60f8223e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:41:26 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-cefef1dd-2add-4a71-b730-9317efb51800 req-7eb8aefd-32c4-4db7-b858-3b38d90a5232 service nova] Lock "3cafaf59-3cc9-4612-8da5-b2b60f8223e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:41:26 user nova-compute[85141]: DEBUG nova.compute.manager [req-cefef1dd-2add-4a71-b730-9317efb51800 req-7eb8aefd-32c4-4db7-b858-3b38d90a5232 service nova] [instance: 3cafaf59-3cc9-4612-8da5-b2b60f8223e6] No waiting events found dispatching network-vif-plugged-e30a03ca-bc02-4f7b-a94f-bda128aa7c39 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:41:26 user nova-compute[85141]: WARNING nova.compute.manager [req-cefef1dd-2add-4a71-b730-9317efb51800 req-7eb8aefd-32c4-4db7-b858-3b38d90a5232 service nova] [instance: 3cafaf59-3cc9-4612-8da5-b2b60f8223e6] Received unexpected event network-vif-plugged-e30a03ca-bc02-4f7b-a94f-bda128aa7c39 for instance with vm_state deleted and task_state None.
Nov 16 10:41:26 user nova-compute[85141]: DEBUG nova.compute.manager [req-cefef1dd-2add-4a71-b730-9317efb51800 req-7eb8aefd-32c4-4db7-b858-3b38d90a5232 service nova] [instance: 3cafaf59-3cc9-4612-8da5-b2b60f8223e6] Received event network-vif-plugged-e30a03ca-bc02-4f7b-a94f-bda128aa7c39 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:41:26 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-cefef1dd-2add-4a71-b730-9317efb51800 req-7eb8aefd-32c4-4db7-b858-3b38d90a5232 service nova] Acquiring lock "3cafaf59-3cc9-4612-8da5-b2b60f8223e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:41:26 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-cefef1dd-2add-4a71-b730-9317efb51800 req-7eb8aefd-32c4-4db7-b858-3b38d90a5232 service nova] Lock "3cafaf59-3cc9-4612-8da5-b2b60f8223e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:41:26 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-cefef1dd-2add-4a71-b730-9317efb51800 req-7eb8aefd-32c4-4db7-b858-3b38d90a5232 service nova] Lock "3cafaf59-3cc9-4612-8da5-b2b60f8223e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:41:26 user nova-compute[85141]: DEBUG nova.compute.manager [req-cefef1dd-2add-4a71-b730-9317efb51800 req-7eb8aefd-32c4-4db7-b858-3b38d90a5232 service nova] [instance: 3cafaf59-3cc9-4612-8da5-b2b60f8223e6] No waiting events found dispatching network-vif-plugged-e30a03ca-bc02-4f7b-a94f-bda128aa7c39 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:41:26 user nova-compute[85141]: WARNING nova.compute.manager [req-cefef1dd-2add-4a71-b730-9317efb51800 req-7eb8aefd-32c4-4db7-b858-3b38d90a5232 service nova] [instance: 3cafaf59-3cc9-4612-8da5-b2b60f8223e6] Received unexpected event network-vif-plugged-e30a03ca-bc02-4f7b-a94f-bda128aa7c39 for instance with vm_state deleted and task_state None.
Nov 16 10:41:26 user nova-compute[85141]: DEBUG nova.compute.manager [req-cefef1dd-2add-4a71-b730-9317efb51800 req-7eb8aefd-32c4-4db7-b858-3b38d90a5232 service nova] [instance: 3cafaf59-3cc9-4612-8da5-b2b60f8223e6] Received event network-vif-plugged-e30a03ca-bc02-4f7b-a94f-bda128aa7c39 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:41:26 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-cefef1dd-2add-4a71-b730-9317efb51800 req-7eb8aefd-32c4-4db7-b858-3b38d90a5232 service nova] Acquiring lock "3cafaf59-3cc9-4612-8da5-b2b60f8223e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:41:26 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-cefef1dd-2add-4a71-b730-9317efb51800 req-7eb8aefd-32c4-4db7-b858-3b38d90a5232 service nova] Lock "3cafaf59-3cc9-4612-8da5-b2b60f8223e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:41:26 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-cefef1dd-2add-4a71-b730-9317efb51800 req-7eb8aefd-32c4-4db7-b858-3b38d90a5232 service nova] Lock "3cafaf59-3cc9-4612-8da5-b2b60f8223e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:41:26 user nova-compute[85141]: DEBUG nova.compute.manager [req-cefef1dd-2add-4a71-b730-9317efb51800 req-7eb8aefd-32c4-4db7-b858-3b38d90a5232 service nova] [instance: 3cafaf59-3cc9-4612-8da5-b2b60f8223e6] No waiting events found dispatching network-vif-plugged-e30a03ca-bc02-4f7b-a94f-bda128aa7c39 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:41:26 user nova-compute[85141]: WARNING nova.compute.manager [req-cefef1dd-2add-4a71-b730-9317efb51800 req-7eb8aefd-32c4-4db7-b858-3b38d90a5232 service nova] [instance: 3cafaf59-3cc9-4612-8da5-b2b60f8223e6] Received unexpected event network-vif-plugged-e30a03ca-bc02-4f7b-a94f-bda128aa7c39 for instance with vm_state deleted and task_state None.
Nov 16 10:41:26 user nova-compute[85141]: DEBUG nova.compute.manager [req-cefef1dd-2add-4a71-b730-9317efb51800 req-7eb8aefd-32c4-4db7-b858-3b38d90a5232 service nova] [instance: 3cafaf59-3cc9-4612-8da5-b2b60f8223e6] Received event network-vif-unplugged-e30a03ca-bc02-4f7b-a94f-bda128aa7c39 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:41:26 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-cefef1dd-2add-4a71-b730-9317efb51800 req-7eb8aefd-32c4-4db7-b858-3b38d90a5232 service nova] Acquiring lock "3cafaf59-3cc9-4612-8da5-b2b60f8223e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:41:26 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-cefef1dd-2add-4a71-b730-9317efb51800 req-7eb8aefd-32c4-4db7-b858-3b38d90a5232 service nova] Lock "3cafaf59-3cc9-4612-8da5-b2b60f8223e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:41:26 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-cefef1dd-2add-4a71-b730-9317efb51800 req-7eb8aefd-32c4-4db7-b858-3b38d90a5232 service nova] Lock "3cafaf59-3cc9-4612-8da5-b2b60f8223e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:41:26 user nova-compute[85141]: DEBUG nova.compute.manager [req-cefef1dd-2add-4a71-b730-9317efb51800 req-7eb8aefd-32c4-4db7-b858-3b38d90a5232 service nova] [instance: 3cafaf59-3cc9-4612-8da5-b2b60f8223e6] No waiting events found dispatching network-vif-unplugged-e30a03ca-bc02-4f7b-a94f-bda128aa7c39 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:41:26 user nova-compute[85141]: WARNING nova.compute.manager [req-cefef1dd-2add-4a71-b730-9317efb51800 req-7eb8aefd-32c4-4db7-b858-3b38d90a5232 service nova] [instance: 3cafaf59-3cc9-4612-8da5-b2b60f8223e6] Received unexpected event network-vif-unplugged-e30a03ca-bc02-4f7b-a94f-bda128aa7c39 for instance with vm_state deleted and task_state None.
Nov 16 10:41:26 user nova-compute[85141]: DEBUG nova.compute.manager [req-cefef1dd-2add-4a71-b730-9317efb51800 req-7eb8aefd-32c4-4db7-b858-3b38d90a5232 service nova] [instance: 3cafaf59-3cc9-4612-8da5-b2b60f8223e6] Received event network-vif-plugged-e30a03ca-bc02-4f7b-a94f-bda128aa7c39 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:41:26 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-cefef1dd-2add-4a71-b730-9317efb51800 req-7eb8aefd-32c4-4db7-b858-3b38d90a5232 service nova] Acquiring lock "3cafaf59-3cc9-4612-8da5-b2b60f8223e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:41:26 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-cefef1dd-2add-4a71-b730-9317efb51800 req-7eb8aefd-32c4-4db7-b858-3b38d90a5232 service nova] Lock "3cafaf59-3cc9-4612-8da5-b2b60f8223e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:41:26 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-cefef1dd-2add-4a71-b730-9317efb51800 req-7eb8aefd-32c4-4db7-b858-3b38d90a5232 service nova] Lock "3cafaf59-3cc9-4612-8da5-b2b60f8223e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:41:26 user nova-compute[85141]: DEBUG nova.compute.manager [req-cefef1dd-2add-4a71-b730-9317efb51800 req-7eb8aefd-32c4-4db7-b858-3b38d90a5232 service nova] [instance: 3cafaf59-3cc9-4612-8da5-b2b60f8223e6] No waiting events found dispatching network-vif-plugged-e30a03ca-bc02-4f7b-a94f-bda128aa7c39 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:41:26 user nova-compute[85141]: WARNING nova.compute.manager [req-cefef1dd-2add-4a71-b730-9317efb51800 req-7eb8aefd-32c4-4db7-b858-3b38d90a5232 service nova] [instance: 3cafaf59-3cc9-4612-8da5-b2b60f8223e6] Received unexpected event network-vif-plugged-e30a03ca-bc02-4f7b-a94f-bda128aa7c39 for instance with vm_state deleted and task_state None.
Nov 16 10:41:30 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:41:35 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:41:35 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:41:35 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=85141) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 10:41:35 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=85141) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 10:41:35 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=85141) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 10:41:35 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:41:39 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:41:40 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:41:40 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:41:42 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:41:44 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:41:44 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=85141) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 10:41:45 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:41:46 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager.update_available_resource {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:41:46 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:41:46 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:41:46 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:41:46 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Auditing locally available compute resources for user (node: user) {{(pid=85141) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 10:41:46 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:41:46 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:41:46 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Hypervisor/Node resource view: name=user free_ram=9029MB free_disk=25.078998565673828GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=85141) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 10:41:46 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:41:46 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:41:46 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=85141) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 10:41:46 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=85141) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 10:41:46 user nova-compute[85141]: DEBUG nova.scheduler.client.report [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Refreshing inventories for resource provider bf8e0fa1-16b6-408f-9203-c4cd63916272 {{(pid=85141) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 16 10:41:46 user nova-compute[85141]: DEBUG nova.scheduler.client.report [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Updating ProviderTree inventory for provider bf8e0fa1-16b6-408f-9203-c4cd63916272 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=85141) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 16 10:41:46 user nova-compute[85141]: DEBUG nova.compute.provider_tree [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Updating inventory in ProviderTree for provider bf8e0fa1-16b6-408f-9203-c4cd63916272 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=85141) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 16 10:41:47 user nova-compute[85141]: DEBUG nova.scheduler.client.report [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Refreshing aggregate associations for resource provider bf8e0fa1-16b6-408f-9203-c4cd63916272, aggregates: None {{(pid=85141) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 16 10:41:47 user nova-compute[85141]: DEBUG nova.scheduler.client.report [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Refreshing trait associations for resource provider bf8e0fa1-16b6-408f-9203-c4cd63916272, traits: COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE41,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_ACCELERATORS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_USB,COMPUTE_TRUSTED_CERTS,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_RESCUE_BFV,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VOLUME_ATTACH_WITH_TAG {{(pid=85141) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 16 10:41:47 user nova-compute[85141]: DEBUG nova.compute.provider_tree [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Inventory has not changed in ProviderTree for provider: bf8e0fa1-16b6-408f-9203-c4cd63916272 {{(pid=85141) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 10:41:47 user nova-compute[85141]: DEBUG nova.scheduler.client.report [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Inventory has not changed for provider bf8e0fa1-16b6-408f-9203-c4cd63916272 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=85141) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 10:41:47 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Compute_service record updated for user:user {{(pid=85141) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 10:41:47 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.391s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:41:48 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:41:48 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Starting heal instance info cache {{(pid=85141) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 10:41:48 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Rebuilding the list of instances to heal {{(pid=85141) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 10:41:48 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Didn't find any instances for network info cache update. {{(pid=85141) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 16 10:41:48 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:41:48 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:41:49 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:41:49 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Cleaning up deleted instances {{(pid=85141) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 16 10:41:49 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] There are 0 instances to clean {{(pid=85141) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 16 10:41:50 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:41:50 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:41:50 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Cleaning up deleted instances with incomplete migration  {{(pid=85141) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 16 10:41:52 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:41:55 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:41:55 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:41:55 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=85141) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 10:41:55 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=85141) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 10:41:55 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=85141) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 10:41:55 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:41:55 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:41:56 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:41:57 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:42:00 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:42:05 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:42:07 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:42:10 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:42:10 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:42:15 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:42:15 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:42:18 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-fbe51f8f-0331-4006-8492-1f57a138d68b tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Acquiring lock "550c62a9-18b5-41bd-a129-322f6c297383" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:42:18 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-fbe51f8f-0331-4006-8492-1f57a138d68b tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Lock "550c62a9-18b5-41bd-a129-322f6c297383" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:42:18 user nova-compute[85141]: DEBUG nova.compute.manager [None req-fbe51f8f-0331-4006-8492-1f57a138d68b tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] [instance: 550c62a9-18b5-41bd-a129-322f6c297383] Starting instance... {{(pid=85141) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 10:42:18 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-fbe51f8f-0331-4006-8492-1f57a138d68b tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:42:18 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-fbe51f8f-0331-4006-8492-1f57a138d68b tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:42:18 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-fbe51f8f-0331-4006-8492-1f57a138d68b tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=85141) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 10:42:18 user nova-compute[85141]: INFO nova.compute.claims [None req-fbe51f8f-0331-4006-8492-1f57a138d68b tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] [instance: 550c62a9-18b5-41bd-a129-322f6c297383] Claim successful on node user
Nov 16 10:42:18 user nova-compute[85141]: DEBUG nova.compute.provider_tree [None req-fbe51f8f-0331-4006-8492-1f57a138d68b tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Inventory has not changed in ProviderTree for provider: bf8e0fa1-16b6-408f-9203-c4cd63916272 {{(pid=85141) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 10:42:18 user nova-compute[85141]: DEBUG nova.scheduler.client.report [None req-fbe51f8f-0331-4006-8492-1f57a138d68b tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Inventory has not changed for provider bf8e0fa1-16b6-408f-9203-c4cd63916272 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=85141) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 10:42:18 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-fbe51f8f-0331-4006-8492-1f57a138d68b tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.186s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:42:18 user nova-compute[85141]: DEBUG nova.compute.manager [None req-fbe51f8f-0331-4006-8492-1f57a138d68b tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] [instance: 550c62a9-18b5-41bd-a129-322f6c297383] Start building networks asynchronously for instance. {{(pid=85141) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 10:42:18 user nova-compute[85141]: DEBUG nova.compute.manager [None req-fbe51f8f-0331-4006-8492-1f57a138d68b tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] [instance: 550c62a9-18b5-41bd-a129-322f6c297383] Allocating IP information in the background. {{(pid=85141) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 10:42:18 user nova-compute[85141]: DEBUG nova.network.neutron [None req-fbe51f8f-0331-4006-8492-1f57a138d68b tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] [instance: 550c62a9-18b5-41bd-a129-322f6c297383] allocate_for_instance() {{(pid=85141) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 10:42:18 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-fbe51f8f-0331-4006-8492-1f57a138d68b tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] [instance: 550c62a9-18b5-41bd-a129-322f6c297383] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 10:42:18 user nova-compute[85141]: DEBUG nova.compute.manager [None req-fbe51f8f-0331-4006-8492-1f57a138d68b tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] [instance: 550c62a9-18b5-41bd-a129-322f6c297383] Start building block device mappings for instance. {{(pid=85141) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 10:42:18 user nova-compute[85141]: DEBUG nova.policy [None req-fbe51f8f-0331-4006-8492-1f57a138d68b tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5aa5beeeca5d4dc89cf5333942da756f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd13c6ff3c30549ca9ab44d9fc1fedc6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85141) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 10:42:19 user nova-compute[85141]: DEBUG nova.compute.manager [None req-fbe51f8f-0331-4006-8492-1f57a138d68b tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] [instance: 550c62a9-18b5-41bd-a129-322f6c297383] Start spawning the instance on the hypervisor. {{(pid=85141) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 10:42:19 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-fbe51f8f-0331-4006-8492-1f57a138d68b tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] [instance: 550c62a9-18b5-41bd-a129-322f6c297383] Creating instance directory {{(pid=85141) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 10:42:19 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-fbe51f8f-0331-4006-8492-1f57a138d68b tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] [instance: 550c62a9-18b5-41bd-a129-322f6c297383] Creating image(s)
Nov 16 10:42:19 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-fbe51f8f-0331-4006-8492-1f57a138d68b tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Acquiring lock "/opt/stack/data/nova/instances/550c62a9-18b5-41bd-a129-322f6c297383/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:42:19 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-fbe51f8f-0331-4006-8492-1f57a138d68b tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Lock "/opt/stack/data/nova/instances/550c62a9-18b5-41bd-a129-322f6c297383/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:42:19 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-fbe51f8f-0331-4006-8492-1f57a138d68b tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Lock "/opt/stack/data/nova/instances/550c62a9-18b5-41bd-a129-322f6c297383/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:42:19 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-fbe51f8f-0331-4006-8492-1f57a138d68b tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:42:19 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-fbe51f8f-0331-4006-8492-1f57a138d68b tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json" returned: 0 in 0.175s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:42:19 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-fbe51f8f-0331-4006-8492-1f57a138d68b tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Acquiring lock "60a78556fb399ed4a41bc3ca4bccf77c96d8e811" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:42:19 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-fbe51f8f-0331-4006-8492-1f57a138d68b tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Lock "60a78556fb399ed4a41bc3ca4bccf77c96d8e811" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:42:19 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-fbe51f8f-0331-4006-8492-1f57a138d68b tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:42:19 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-fbe51f8f-0331-4006-8492-1f57a138d68b tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json" returned: 0 in 0.183s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:42:19 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-fbe51f8f-0331-4006-8492-1f57a138d68b tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811,backing_fmt=raw /opt/stack/data/nova/instances/550c62a9-18b5-41bd-a129-322f6c297383/disk 1073741824 {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:42:19 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-fbe51f8f-0331-4006-8492-1f57a138d68b tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811,backing_fmt=raw /opt/stack/data/nova/instances/550c62a9-18b5-41bd-a129-322f6c297383/disk 1073741824" returned: 0 in 0.060s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:42:19 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-fbe51f8f-0331-4006-8492-1f57a138d68b tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Lock "60a78556fb399ed4a41bc3ca4bccf77c96d8e811" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.252s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:42:19 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-fbe51f8f-0331-4006-8492-1f57a138d68b tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:42:19 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-fbe51f8f-0331-4006-8492-1f57a138d68b tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json" returned: 0 in 0.173s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:42:19 user nova-compute[85141]: DEBUG nova.virt.disk.api [None req-fbe51f8f-0331-4006-8492-1f57a138d68b tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Checking if we can resize image /opt/stack/data/nova/instances/550c62a9-18b5-41bd-a129-322f6c297383/disk. size=1073741824 {{(pid=85141) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 10:42:19 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-fbe51f8f-0331-4006-8492-1f57a138d68b tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/550c62a9-18b5-41bd-a129-322f6c297383/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:42:19 user nova-compute[85141]: DEBUG nova.network.neutron [None req-fbe51f8f-0331-4006-8492-1f57a138d68b tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] [instance: 550c62a9-18b5-41bd-a129-322f6c297383] Successfully created port: 867abc80-2539-48b6-9fe1-dae79e683a16 {{(pid=85141) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 10:42:19 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-fbe51f8f-0331-4006-8492-1f57a138d68b tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/550c62a9-18b5-41bd-a129-322f6c297383/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:42:19 user nova-compute[85141]: DEBUG nova.virt.disk.api [None req-fbe51f8f-0331-4006-8492-1f57a138d68b tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Cannot resize image /opt/stack/data/nova/instances/550c62a9-18b5-41bd-a129-322f6c297383/disk to a smaller size. {{(pid=85141) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 10:42:19 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-fbe51f8f-0331-4006-8492-1f57a138d68b tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] [instance: 550c62a9-18b5-41bd-a129-322f6c297383] Created local disks {{(pid=85141) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 10:42:19 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-fbe51f8f-0331-4006-8492-1f57a138d68b tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] [instance: 550c62a9-18b5-41bd-a129-322f6c297383] Ensure instance console log exists: /opt/stack/data/nova/instances/550c62a9-18b5-41bd-a129-322f6c297383/console.log {{(pid=85141) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 10:42:19 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-fbe51f8f-0331-4006-8492-1f57a138d68b tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:42:19 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-fbe51f8f-0331-4006-8492-1f57a138d68b tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:42:19 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-fbe51f8f-0331-4006-8492-1f57a138d68b tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:42:20 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:42:20 user nova-compute[85141]: DEBUG nova.network.neutron [None req-fbe51f8f-0331-4006-8492-1f57a138d68b tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] [instance: 550c62a9-18b5-41bd-a129-322f6c297383] Successfully updated port: 867abc80-2539-48b6-9fe1-dae79e683a16 {{(pid=85141) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 10:42:20 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-fbe51f8f-0331-4006-8492-1f57a138d68b tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Acquiring lock "refresh_cache-550c62a9-18b5-41bd-a129-322f6c297383" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:42:20 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-fbe51f8f-0331-4006-8492-1f57a138d68b tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Acquired lock "refresh_cache-550c62a9-18b5-41bd-a129-322f6c297383" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:42:20 user nova-compute[85141]: DEBUG nova.network.neutron [None req-fbe51f8f-0331-4006-8492-1f57a138d68b tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] [instance: 550c62a9-18b5-41bd-a129-322f6c297383] Building network info cache for instance {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 10:42:20 user nova-compute[85141]: DEBUG nova.compute.manager [req-b2f811f2-08cb-4e56-acc8-a4d4a7cdd283 req-11ebf9d5-9225-409e-b593-ee5b73e3dccd service nova] [instance: 550c62a9-18b5-41bd-a129-322f6c297383] Received event network-changed-867abc80-2539-48b6-9fe1-dae79e683a16 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:42:20 user nova-compute[85141]: DEBUG nova.compute.manager [req-b2f811f2-08cb-4e56-acc8-a4d4a7cdd283 req-11ebf9d5-9225-409e-b593-ee5b73e3dccd service nova] [instance: 550c62a9-18b5-41bd-a129-322f6c297383] Refreshing instance network info cache due to event network-changed-867abc80-2539-48b6-9fe1-dae79e683a16. {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 10:42:20 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-b2f811f2-08cb-4e56-acc8-a4d4a7cdd283 req-11ebf9d5-9225-409e-b593-ee5b73e3dccd service nova] Acquiring lock "refresh_cache-550c62a9-18b5-41bd-a129-322f6c297383" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:42:20 user nova-compute[85141]: DEBUG nova.network.neutron [None req-fbe51f8f-0331-4006-8492-1f57a138d68b tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] [instance: 550c62a9-18b5-41bd-a129-322f6c297383] Instance cache missing network info. {{(pid=85141) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 10:42:20 user nova-compute[85141]: DEBUG nova.network.neutron [None req-fbe51f8f-0331-4006-8492-1f57a138d68b tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] [instance: 550c62a9-18b5-41bd-a129-322f6c297383] Updating instance_info_cache with network_info: [{"id": "867abc80-2539-48b6-9fe1-dae79e683a16", "address": "fa:16:3e:a8:5b:e5", "network": {"id": "8931cd8f-3c0b-4d49-ae98-48f818e854e7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1902653571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d13c6ff3c30549ca9ab44d9fc1fedc6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap867abc80-25", "ovs_interfaceid": "867abc80-2539-48b6-9fe1-dae79e683a16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:42:20 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-fbe51f8f-0331-4006-8492-1f57a138d68b tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Releasing lock "refresh_cache-550c62a9-18b5-41bd-a129-322f6c297383" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:42:20 user nova-compute[85141]: DEBUG nova.compute.manager [None req-fbe51f8f-0331-4006-8492-1f57a138d68b tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] [instance: 550c62a9-18b5-41bd-a129-322f6c297383] Instance network_info: |[{"id": "867abc80-2539-48b6-9fe1-dae79e683a16", "address": "fa:16:3e:a8:5b:e5", "network": {"id": "8931cd8f-3c0b-4d49-ae98-48f818e854e7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1902653571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d13c6ff3c30549ca9ab44d9fc1fedc6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap867abc80-25", "ovs_interfaceid": "867abc80-2539-48b6-9fe1-dae79e683a16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=85141) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 10:42:20 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-b2f811f2-08cb-4e56-acc8-a4d4a7cdd283 req-11ebf9d5-9225-409e-b593-ee5b73e3dccd service nova] Acquired lock "refresh_cache-550c62a9-18b5-41bd-a129-322f6c297383" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:42:20 user nova-compute[85141]: DEBUG nova.network.neutron [req-b2f811f2-08cb-4e56-acc8-a4d4a7cdd283 req-11ebf9d5-9225-409e-b593-ee5b73e3dccd service nova] [instance: 550c62a9-18b5-41bd-a129-322f6c297383] Refreshing network info cache for port 867abc80-2539-48b6-9fe1-dae79e683a16 {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 10:42:20 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-fbe51f8f-0331-4006-8492-1f57a138d68b tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] [instance: 550c62a9-18b5-41bd-a129-322f6c297383] Start _get_guest_xml network_info=[{"id": "867abc80-2539-48b6-9fe1-dae79e683a16", "address": "fa:16:3e:a8:5b:e5", "network": {"id": "8931cd8f-3c0b-4d49-ae98-48f818e854e7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1902653571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d13c6ff3c30549ca9ab44d9fc1fedc6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap867abc80-25", "ovs_interfaceid": "867abc80-2539-48b6-9fe1-dae79e683a16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T10:06:42Z,direct_url=<?>,disk_format='qcow2',id=bc4ca70f-a459-4d5c-a9e6-80f1948eb48b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1044631a5fe84ce8904864a7024049fa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T10:06:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_options': None, 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'image_id': 'bc4ca70f-a459-4d5c-a9e6-80f1948eb48b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=85141) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 10:42:20 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-fbe51f8f-0331-4006-8492-1f57a138d68b tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:42:20 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-fbe51f8f-0331-4006-8492-1f57a138d68b tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:42:20 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-fbe51f8f-0331-4006-8492-1f57a138d68b tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=85141) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 10:42:20 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-fbe51f8f-0331-4006-8492-1f57a138d68b tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] CPU controller missing on host. {{(pid=85141) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 10:42:20 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-fbe51f8f-0331-4006-8492-1f57a138d68b tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=85141) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 10:42:20 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-fbe51f8f-0331-4006-8492-1f57a138d68b tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] CPU controller found on host. {{(pid=85141) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 10:42:20 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-fbe51f8f-0331-4006-8492-1f57a138d68b tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=85141) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 10:42:20 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-fbe51f8f-0331-4006-8492-1f57a138d68b tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T10:06:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T10:06:42Z,direct_url=<?>,disk_format='qcow2',id=bc4ca70f-a459-4d5c-a9e6-80f1948eb48b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1044631a5fe84ce8904864a7024049fa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T10:06:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 10:42:20 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-fbe51f8f-0331-4006-8492-1f57a138d68b tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Flavor limits 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 10:42:20 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-fbe51f8f-0331-4006-8492-1f57a138d68b tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Image limits 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 10:42:20 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-fbe51f8f-0331-4006-8492-1f57a138d68b tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Flavor pref 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 10:42:20 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-fbe51f8f-0331-4006-8492-1f57a138d68b tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Image pref 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 10:42:20 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-fbe51f8f-0331-4006-8492-1f57a138d68b tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 10:42:20 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-fbe51f8f-0331-4006-8492-1f57a138d68b tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 10:42:20 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-fbe51f8f-0331-4006-8492-1f57a138d68b tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=85141) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 10:42:20 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-fbe51f8f-0331-4006-8492-1f57a138d68b tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Got 1 possible topologies {{(pid=85141) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 10:42:20 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-fbe51f8f-0331-4006-8492-1f57a138d68b tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 10:42:20 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-fbe51f8f-0331-4006-8492-1f57a138d68b tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 10:42:20 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-fbe51f8f-0331-4006-8492-1f57a138d68b tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T10:42:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-681414414',display_name='tempest-AttachVolumeNegativeTest-server-681414414',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-681414414',id=52,image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE0qwoDR6lD4pLJu+OBQPOnuwWR1q51FfoLGspSFKaDrOTIIUqT0NeJFfFJ57aaLPUFM4aBmTeqq0r4XpPnWMwgV434azb6awq3qQolWU87zGfZZ+Btw3wAV89zxwxRxgg==',key_name='tempest-keypair-85269288',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d13c6ff3c30549ca9ab44d9fc1fedc6f',ramdisk_id='',reservation_id='r-h1wn9c2k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-2108292208',owner_user_name='tempest-AttachVolumeNegativeTest-2108292208-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T10:42:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5aa5beeeca5d4dc89cf5333942da756f',uuid=550c62a9-18b5-41bd-a129-322f6c297383,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "867abc80-2539-48b6-9fe1-dae79e683a16", "address": "fa:16:3e:a8:5b:e5", "network": {"id": "8931cd8f-3c0b-4d49-ae98-48f818e854e7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1902653571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d13c6ff3c30549ca9ab44d9fc1fedc6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap867abc80-25", "ovs_interfaceid": "867abc80-2539-48b6-9fe1-dae79e683a16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=85141) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 10:42:20 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-fbe51f8f-0331-4006-8492-1f57a138d68b tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Converting VIF {"id": "867abc80-2539-48b6-9fe1-dae79e683a16", "address": "fa:16:3e:a8:5b:e5", "network": {"id": "8931cd8f-3c0b-4d49-ae98-48f818e854e7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1902653571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d13c6ff3c30549ca9ab44d9fc1fedc6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap867abc80-25", "ovs_interfaceid": "867abc80-2539-48b6-9fe1-dae79e683a16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:42:20 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-fbe51f8f-0331-4006-8492-1f57a138d68b tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a8:5b:e5,bridge_name='br-int',has_traffic_filtering=True,id=867abc80-2539-48b6-9fe1-dae79e683a16,network=Network(8931cd8f-3c0b-4d49-ae98-48f818e854e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap867abc80-25') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:42:20 user nova-compute[85141]: DEBUG nova.objects.instance [None req-fbe51f8f-0331-4006-8492-1f57a138d68b tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Lazy-loading 'pci_devices' on Instance uuid 550c62a9-18b5-41bd-a129-322f6c297383 {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:42:20 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-fbe51f8f-0331-4006-8492-1f57a138d68b tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] [instance: 550c62a9-18b5-41bd-a129-322f6c297383] End _get_guest_xml xml=<domain type="kvm">
Nov 16 10:42:20 user nova-compute[85141]:   <uuid>550c62a9-18b5-41bd-a129-322f6c297383</uuid>
Nov 16 10:42:20 user nova-compute[85141]:   <name>instance-00000034</name>
Nov 16 10:42:20 user nova-compute[85141]:   <memory>524288</memory>
Nov 16 10:42:20 user nova-compute[85141]:   <vcpu>1</vcpu>
Nov 16 10:42:20 user nova-compute[85141]:   <metadata>
Nov 16 10:42:20 user nova-compute[85141]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 10:42:20 user nova-compute[85141]:       <nova:package version="0.0.0"/>
Nov 16 10:42:20 user nova-compute[85141]:       <nova:name>tempest-AttachVolumeNegativeTest-server-681414414</nova:name>
Nov 16 10:42:20 user nova-compute[85141]:       <nova:creationTime>2023-11-16 10:42:20</nova:creationTime>
Nov 16 10:42:20 user nova-compute[85141]:       <nova:flavor name="m1.tiny">
Nov 16 10:42:20 user nova-compute[85141]:         <nova:memory>512</nova:memory>
Nov 16 10:42:20 user nova-compute[85141]:         <nova:disk>1</nova:disk>
Nov 16 10:42:20 user nova-compute[85141]:         <nova:swap>0</nova:swap>
Nov 16 10:42:20 user nova-compute[85141]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 10:42:20 user nova-compute[85141]:         <nova:vcpus>1</nova:vcpus>
Nov 16 10:42:20 user nova-compute[85141]:       </nova:flavor>
Nov 16 10:42:20 user nova-compute[85141]:       <nova:owner>
Nov 16 10:42:20 user nova-compute[85141]:         <nova:user uuid="5aa5beeeca5d4dc89cf5333942da756f">tempest-AttachVolumeNegativeTest-2108292208-project-member</nova:user>
Nov 16 10:42:20 user nova-compute[85141]:         <nova:project uuid="d13c6ff3c30549ca9ab44d9fc1fedc6f">tempest-AttachVolumeNegativeTest-2108292208</nova:project>
Nov 16 10:42:20 user nova-compute[85141]:       </nova:owner>
Nov 16 10:42:20 user nova-compute[85141]:       <nova:root type="image" uuid="bc4ca70f-a459-4d5c-a9e6-80f1948eb48b"/>
Nov 16 10:42:20 user nova-compute[85141]:       <nova:ports>
Nov 16 10:42:20 user nova-compute[85141]:         <nova:port uuid="867abc80-2539-48b6-9fe1-dae79e683a16">
Nov 16 10:42:20 user nova-compute[85141]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 16 10:42:20 user nova-compute[85141]:         </nova:port>
Nov 16 10:42:20 user nova-compute[85141]:       </nova:ports>
Nov 16 10:42:20 user nova-compute[85141]:     </nova:instance>
Nov 16 10:42:20 user nova-compute[85141]:   </metadata>
Nov 16 10:42:20 user nova-compute[85141]:   <sysinfo type="smbios">
Nov 16 10:42:20 user nova-compute[85141]:     <system>
Nov 16 10:42:20 user nova-compute[85141]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 10:42:20 user nova-compute[85141]:       <entry name="product">OpenStack Nova</entry>
Nov 16 10:42:20 user nova-compute[85141]:       <entry name="version">0.0.0</entry>
Nov 16 10:42:20 user nova-compute[85141]:       <entry name="serial">550c62a9-18b5-41bd-a129-322f6c297383</entry>
Nov 16 10:42:20 user nova-compute[85141]:       <entry name="uuid">550c62a9-18b5-41bd-a129-322f6c297383</entry>
Nov 16 10:42:20 user nova-compute[85141]:       <entry name="family">Virtual Machine</entry>
Nov 16 10:42:20 user nova-compute[85141]:     </system>
Nov 16 10:42:20 user nova-compute[85141]:   </sysinfo>
Nov 16 10:42:20 user nova-compute[85141]:   <os>
Nov 16 10:42:20 user nova-compute[85141]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 10:42:20 user nova-compute[85141]:     <boot dev="hd"/>
Nov 16 10:42:20 user nova-compute[85141]:     <smbios mode="sysinfo"/>
Nov 16 10:42:20 user nova-compute[85141]:   </os>
Nov 16 10:42:20 user nova-compute[85141]:   <features>
Nov 16 10:42:20 user nova-compute[85141]:     <acpi/>
Nov 16 10:42:20 user nova-compute[85141]:     <apic/>
Nov 16 10:42:20 user nova-compute[85141]:     <vmcoreinfo/>
Nov 16 10:42:20 user nova-compute[85141]:   </features>
Nov 16 10:42:20 user nova-compute[85141]:   <clock offset="utc">
Nov 16 10:42:20 user nova-compute[85141]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 10:42:20 user nova-compute[85141]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 10:42:20 user nova-compute[85141]:     <timer name="hpet" present="no"/>
Nov 16 10:42:20 user nova-compute[85141]:   </clock>
Nov 16 10:42:20 user nova-compute[85141]:   <cpu mode="custom" match="exact">
Nov 16 10:42:20 user nova-compute[85141]:     <model>Nehalem</model>
Nov 16 10:42:20 user nova-compute[85141]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 10:42:20 user nova-compute[85141]:   </cpu>
Nov 16 10:42:20 user nova-compute[85141]:   <devices>
Nov 16 10:42:20 user nova-compute[85141]:     <disk type="file" device="disk">
Nov 16 10:42:20 user nova-compute[85141]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 10:42:20 user nova-compute[85141]:       <source file="/opt/stack/data/nova/instances/550c62a9-18b5-41bd-a129-322f6c297383/disk"/>
Nov 16 10:42:20 user nova-compute[85141]:       <target dev="vda" bus="virtio"/>
Nov 16 10:42:20 user nova-compute[85141]:     </disk>
Nov 16 10:42:20 user nova-compute[85141]:     <interface type="ethernet">
Nov 16 10:42:20 user nova-compute[85141]:       <mac address="fa:16:3e:a8:5b:e5"/>
Nov 16 10:42:20 user nova-compute[85141]:       <model type="virtio"/>
Nov 16 10:42:20 user nova-compute[85141]:       <mtu size="1442"/>
Nov 16 10:42:20 user nova-compute[85141]:       <target dev="tap867abc80-25"/>
Nov 16 10:42:20 user nova-compute[85141]:     </interface>
Nov 16 10:42:20 user nova-compute[85141]:     <serial type="pty">
Nov 16 10:42:20 user nova-compute[85141]:       <log file="/opt/stack/data/nova/instances/550c62a9-18b5-41bd-a129-322f6c297383/console.log" append="off"/>
Nov 16 10:42:20 user nova-compute[85141]:     </serial>
Nov 16 10:42:20 user nova-compute[85141]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 10:42:20 user nova-compute[85141]:     <video>
Nov 16 10:42:20 user nova-compute[85141]:       <model type="virtio"/>
Nov 16 10:42:20 user nova-compute[85141]:     </video>
Nov 16 10:42:20 user nova-compute[85141]:     <rng model="virtio">
Nov 16 10:42:20 user nova-compute[85141]:       <backend model="random">/dev/urandom</backend>
Nov 16 10:42:20 user nova-compute[85141]:     </rng>
Nov 16 10:42:20 user nova-compute[85141]:     <controller type="usb" index="0" model="none"/>
Nov 16 10:42:20 user nova-compute[85141]:     <memballoon model="virtio">
Nov 16 10:42:20 user nova-compute[85141]:       <stats period="10"/>
Nov 16 10:42:20 user nova-compute[85141]:     </memballoon>
Nov 16 10:42:20 user nova-compute[85141]:   </devices>
Nov 16 10:42:20 user nova-compute[85141]: </domain>
Nov 16 10:42:20 user nova-compute[85141]:  {{(pid=85141) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 10:42:20 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-fbe51f8f-0331-4006-8492-1f57a138d68b tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T10:42:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-681414414',display_name='tempest-AttachVolumeNegativeTest-server-681414414',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-681414414',id=52,image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE0qwoDR6lD4pLJu+OBQPOnuwWR1q51FfoLGspSFKaDrOTIIUqT0NeJFfFJ57aaLPUFM4aBmTeqq0r4XpPnWMwgV434azb6awq3qQolWU87zGfZZ+Btw3wAV89zxwxRxgg==',key_name='tempest-keypair-85269288',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d13c6ff3c30549ca9ab44d9fc1fedc6f',ramdisk_id='',reservation_id='r-h1wn9c2k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-2108292208',owner_user_name='tempest-AttachVolumeNegativeTest-2108292208-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T10:42:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5aa5beeeca5d4dc89cf5333942da756f',uuid=550c62a9-18b5-41bd-a129-322f6c297383,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "867abc80-2539-48b6-9fe1-dae79e683a16", "address": "fa:16:3e:a8:5b:e5", "network": {"id": "8931cd8f-3c0b-4d49-ae98-48f818e854e7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1902653571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d13c6ff3c30549ca9ab44d9fc1fedc6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap867abc80-25", "ovs_interfaceid": "867abc80-2539-48b6-9fe1-dae79e683a16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 10:42:20 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-fbe51f8f-0331-4006-8492-1f57a138d68b tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Converting VIF {"id": "867abc80-2539-48b6-9fe1-dae79e683a16", "address": "fa:16:3e:a8:5b:e5", "network": {"id": "8931cd8f-3c0b-4d49-ae98-48f818e854e7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1902653571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d13c6ff3c30549ca9ab44d9fc1fedc6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap867abc80-25", "ovs_interfaceid": "867abc80-2539-48b6-9fe1-dae79e683a16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:42:20 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-fbe51f8f-0331-4006-8492-1f57a138d68b tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a8:5b:e5,bridge_name='br-int',has_traffic_filtering=True,id=867abc80-2539-48b6-9fe1-dae79e683a16,network=Network(8931cd8f-3c0b-4d49-ae98-48f818e854e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap867abc80-25') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:42:20 user nova-compute[85141]: DEBUG os_vif [None req-fbe51f8f-0331-4006-8492-1f57a138d68b tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:5b:e5,bridge_name='br-int',has_traffic_filtering=True,id=867abc80-2539-48b6-9fe1-dae79e683a16,network=Network(8931cd8f-3c0b-4d49-ae98-48f818e854e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap867abc80-25') {{(pid=85141) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 10:42:20 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:42:20 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:42:20 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 10:42:20 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:42:20 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9a9d92b1-9871-57d9-8a1e-5d022053ccb3', '_type': 'linux-noop'}}, row=False) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:42:20 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:42:20 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:42:20 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:42:20 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap867abc80-25, may_exist=True, interface_attrs={}) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:42:20 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap867abc80-25, col_values=(('qos', UUID('0c0ef08f-015f-484d-b622-e37e6afc8c6e')),), if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:42:20 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap867abc80-25, col_values=(('external_ids', {'iface-id': '867abc80-2539-48b6-9fe1-dae79e683a16', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a8:5b:e5', 'vm-uuid': '550c62a9-18b5-41bd-a129-322f6c297383'}),), if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:42:20 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:42:20 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:42:20 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:42:20 user nova-compute[85141]: INFO os_vif [None req-fbe51f8f-0331-4006-8492-1f57a138d68b tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:5b:e5,bridge_name='br-int',has_traffic_filtering=True,id=867abc80-2539-48b6-9fe1-dae79e683a16,network=Network(8931cd8f-3c0b-4d49-ae98-48f818e854e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap867abc80-25')
Nov 16 10:42:20 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-fbe51f8f-0331-4006-8492-1f57a138d68b tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] No BDM found with device name vda, not building metadata. {{(pid=85141) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 10:42:20 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-fbe51f8f-0331-4006-8492-1f57a138d68b tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] No VIF found with MAC fa:16:3e:a8:5b:e5, not building metadata {{(pid=85141) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 10:42:21 user nova-compute[85141]: DEBUG nova.network.neutron [req-b2f811f2-08cb-4e56-acc8-a4d4a7cdd283 req-11ebf9d5-9225-409e-b593-ee5b73e3dccd service nova] [instance: 550c62a9-18b5-41bd-a129-322f6c297383] Updated VIF entry in instance network info cache for port 867abc80-2539-48b6-9fe1-dae79e683a16. {{(pid=85141) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 10:42:21 user nova-compute[85141]: DEBUG nova.network.neutron [req-b2f811f2-08cb-4e56-acc8-a4d4a7cdd283 req-11ebf9d5-9225-409e-b593-ee5b73e3dccd service nova] [instance: 550c62a9-18b5-41bd-a129-322f6c297383] Updating instance_info_cache with network_info: [{"id": "867abc80-2539-48b6-9fe1-dae79e683a16", "address": "fa:16:3e:a8:5b:e5", "network": {"id": "8931cd8f-3c0b-4d49-ae98-48f818e854e7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1902653571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d13c6ff3c30549ca9ab44d9fc1fedc6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap867abc80-25", "ovs_interfaceid": "867abc80-2539-48b6-9fe1-dae79e683a16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:42:21 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-b2f811f2-08cb-4e56-acc8-a4d4a7cdd283 req-11ebf9d5-9225-409e-b593-ee5b73e3dccd service nova] Releasing lock "refresh_cache-550c62a9-18b5-41bd-a129-322f6c297383" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:42:22 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:42:22 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:42:22 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:42:22 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:42:22 user nova-compute[85141]: DEBUG nova.compute.manager [req-721faca0-f6b4-4b60-b8be-41ce492fbdfe req-b8f86013-1076-4de1-90d7-40c347abd013 service nova] [instance: 550c62a9-18b5-41bd-a129-322f6c297383] Received event network-vif-plugged-867abc80-2539-48b6-9fe1-dae79e683a16 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:42:22 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-721faca0-f6b4-4b60-b8be-41ce492fbdfe req-b8f86013-1076-4de1-90d7-40c347abd013 service nova] Acquiring lock "550c62a9-18b5-41bd-a129-322f6c297383-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:42:22 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-721faca0-f6b4-4b60-b8be-41ce492fbdfe req-b8f86013-1076-4de1-90d7-40c347abd013 service nova] Lock "550c62a9-18b5-41bd-a129-322f6c297383-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:42:22 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-721faca0-f6b4-4b60-b8be-41ce492fbdfe req-b8f86013-1076-4de1-90d7-40c347abd013 service nova] Lock "550c62a9-18b5-41bd-a129-322f6c297383-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:42:22 user nova-compute[85141]: DEBUG nova.compute.manager [req-721faca0-f6b4-4b60-b8be-41ce492fbdfe req-b8f86013-1076-4de1-90d7-40c347abd013 service nova] [instance: 550c62a9-18b5-41bd-a129-322f6c297383] No waiting events found dispatching network-vif-plugged-867abc80-2539-48b6-9fe1-dae79e683a16 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:42:22 user nova-compute[85141]: WARNING nova.compute.manager [req-721faca0-f6b4-4b60-b8be-41ce492fbdfe req-b8f86013-1076-4de1-90d7-40c347abd013 service nova] [instance: 550c62a9-18b5-41bd-a129-322f6c297383] Received unexpected event network-vif-plugged-867abc80-2539-48b6-9fe1-dae79e683a16 for instance with vm_state building and task_state spawning.
Nov 16 10:42:22 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:42:22 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:42:22 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:42:22 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:42:23 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:42:24 user nova-compute[85141]: DEBUG nova.compute.manager [None req-fbe51f8f-0331-4006-8492-1f57a138d68b tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] [instance: 550c62a9-18b5-41bd-a129-322f6c297383] Instance event wait completed in 0 seconds for  {{(pid=85141) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 10:42:24 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-fbe51f8f-0331-4006-8492-1f57a138d68b tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] [instance: 550c62a9-18b5-41bd-a129-322f6c297383] Guest created on hypervisor {{(pid=85141) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 10:42:24 user nova-compute[85141]: INFO nova.virt.libvirt.driver [-] [instance: 550c62a9-18b5-41bd-a129-322f6c297383] Instance spawned successfully.
Nov 16 10:42:24 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-fbe51f8f-0331-4006-8492-1f57a138d68b tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] [instance: 550c62a9-18b5-41bd-a129-322f6c297383] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 10:42:24 user nova-compute[85141]: DEBUG nova.compute.manager [req-72f4c0bb-d0bf-4682-851f-c138a53b5fc4 req-857fa01c-2abf-488e-9b2c-95eb53550645 service nova] [instance: 550c62a9-18b5-41bd-a129-322f6c297383] Received event network-vif-plugged-867abc80-2539-48b6-9fe1-dae79e683a16 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:42:24 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-72f4c0bb-d0bf-4682-851f-c138a53b5fc4 req-857fa01c-2abf-488e-9b2c-95eb53550645 service nova] Acquiring lock "550c62a9-18b5-41bd-a129-322f6c297383-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:42:24 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-72f4c0bb-d0bf-4682-851f-c138a53b5fc4 req-857fa01c-2abf-488e-9b2c-95eb53550645 service nova] Lock "550c62a9-18b5-41bd-a129-322f6c297383-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:42:24 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-72f4c0bb-d0bf-4682-851f-c138a53b5fc4 req-857fa01c-2abf-488e-9b2c-95eb53550645 service nova] Lock "550c62a9-18b5-41bd-a129-322f6c297383-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:42:24 user nova-compute[85141]: DEBUG nova.compute.manager [req-72f4c0bb-d0bf-4682-851f-c138a53b5fc4 req-857fa01c-2abf-488e-9b2c-95eb53550645 service nova] [instance: 550c62a9-18b5-41bd-a129-322f6c297383] No waiting events found dispatching network-vif-plugged-867abc80-2539-48b6-9fe1-dae79e683a16 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:42:24 user nova-compute[85141]: WARNING nova.compute.manager [req-72f4c0bb-d0bf-4682-851f-c138a53b5fc4 req-857fa01c-2abf-488e-9b2c-95eb53550645 service nova] [instance: 550c62a9-18b5-41bd-a129-322f6c297383] Received unexpected event network-vif-plugged-867abc80-2539-48b6-9fe1-dae79e683a16 for instance with vm_state building and task_state spawning.
Nov 16 10:42:24 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-fbe51f8f-0331-4006-8492-1f57a138d68b tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] [instance: 550c62a9-18b5-41bd-a129-322f6c297383] Found default for hw_cdrom_bus of ide {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:42:24 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-fbe51f8f-0331-4006-8492-1f57a138d68b tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] [instance: 550c62a9-18b5-41bd-a129-322f6c297383] Found default for hw_disk_bus of virtio {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:42:24 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-fbe51f8f-0331-4006-8492-1f57a138d68b tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] [instance: 550c62a9-18b5-41bd-a129-322f6c297383] Found default for hw_input_bus of None {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:42:24 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-fbe51f8f-0331-4006-8492-1f57a138d68b tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] [instance: 550c62a9-18b5-41bd-a129-322f6c297383] Found default for hw_pointer_model of None {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:42:24 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-fbe51f8f-0331-4006-8492-1f57a138d68b tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] [instance: 550c62a9-18b5-41bd-a129-322f6c297383] Found default for hw_video_model of virtio {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:42:24 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-fbe51f8f-0331-4006-8492-1f57a138d68b tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] [instance: 550c62a9-18b5-41bd-a129-322f6c297383] Found default for hw_vif_model of virtio {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:42:24 user nova-compute[85141]: INFO nova.compute.manager [None req-fbe51f8f-0331-4006-8492-1f57a138d68b tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] [instance: 550c62a9-18b5-41bd-a129-322f6c297383] Took 5.53 seconds to spawn the instance on the hypervisor.
Nov 16 10:42:24 user nova-compute[85141]: DEBUG nova.compute.manager [None req-fbe51f8f-0331-4006-8492-1f57a138d68b tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] [instance: 550c62a9-18b5-41bd-a129-322f6c297383] Checking state {{(pid=85141) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 10:42:24 user nova-compute[85141]: INFO nova.compute.manager [None req-fbe51f8f-0331-4006-8492-1f57a138d68b tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] [instance: 550c62a9-18b5-41bd-a129-322f6c297383] Took 6.35 seconds to build instance.
Nov 16 10:42:24 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-fbe51f8f-0331-4006-8492-1f57a138d68b tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Lock "550c62a9-18b5-41bd-a129-322f6c297383" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.463s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:42:25 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:42:28 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:42:30 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:42:35 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:42:40 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:42:42 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:42:43 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:42:45 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:42:46 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:42:46 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=85141) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 10:42:47 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager.update_available_resource {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:42:47 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:42:47 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:42:47 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:42:47 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Auditing locally available compute resources for user (node: user) {{(pid=85141) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 10:42:47 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/550c62a9-18b5-41bd-a129-322f6c297383/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:42:47 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/550c62a9-18b5-41bd-a129-322f6c297383/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:42:47 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/550c62a9-18b5-41bd-a129-322f6c297383/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:42:47 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/550c62a9-18b5-41bd-a129-322f6c297383/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:42:48 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:42:48 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:42:48 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Hypervisor/Node resource view: name=user free_ram=8940MB free_disk=25.04068374633789GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=85141) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 10:42:48 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:42:48 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:42:48 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance 550c62a9-18b5-41bd-a129-322f6c297383 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:42:48 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=85141) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 10:42:48 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=85141) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 10:42:48 user nova-compute[85141]: DEBUG nova.compute.provider_tree [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Inventory has not changed in ProviderTree for provider: bf8e0fa1-16b6-408f-9203-c4cd63916272 {{(pid=85141) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 10:42:48 user nova-compute[85141]: DEBUG nova.scheduler.client.report [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Inventory has not changed for provider bf8e0fa1-16b6-408f-9203-c4cd63916272 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=85141) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 10:42:48 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Compute_service record updated for user:user {{(pid=85141) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 10:42:48 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.188s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:42:48 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:42:49 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:42:49 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Starting heal instance info cache {{(pid=85141) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 10:42:49 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Rebuilding the list of instances to heal {{(pid=85141) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 10:42:49 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Acquiring lock "refresh_cache-550c62a9-18b5-41bd-a129-322f6c297383" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:42:49 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Acquired lock "refresh_cache-550c62a9-18b5-41bd-a129-322f6c297383" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:42:49 user nova-compute[85141]: DEBUG nova.network.neutron [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] [instance: 550c62a9-18b5-41bd-a129-322f6c297383] Forcefully refreshing network info cache for instance {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 10:42:49 user nova-compute[85141]: DEBUG nova.objects.instance [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lazy-loading 'info_cache' on Instance uuid 550c62a9-18b5-41bd-a129-322f6c297383 {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:42:49 user nova-compute[85141]: DEBUG nova.network.neutron [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] [instance: 550c62a9-18b5-41bd-a129-322f6c297383] Updating instance_info_cache with network_info: [{"id": "867abc80-2539-48b6-9fe1-dae79e683a16", "address": "fa:16:3e:a8:5b:e5", "network": {"id": "8931cd8f-3c0b-4d49-ae98-48f818e854e7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1902653571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d13c6ff3c30549ca9ab44d9fc1fedc6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap867abc80-25", "ovs_interfaceid": "867abc80-2539-48b6-9fe1-dae79e683a16", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:42:49 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Releasing lock "refresh_cache-550c62a9-18b5-41bd-a129-322f6c297383" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:42:49 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] [instance: 550c62a9-18b5-41bd-a129-322f6c297383] Updated the network info_cache for instance {{(pid=85141) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 10:42:50 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:42:50 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:42:50 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:42:50 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:42:52 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:42:53 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:42:55 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:42:57 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:42:58 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:43:00 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:43:05 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:43:05 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:43:05 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=85141) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 10:43:05 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=85141) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 10:43:05 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=85141) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 10:43:05 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:43:10 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:43:15 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:43:20 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:43:20 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:43:20 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=85141) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 10:43:20 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=85141) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 10:43:20 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=85141) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 10:43:20 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:43:25 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:43:30 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:43:35 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:43:40 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:43:42 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:43:45 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:43:48 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:43:48 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=85141) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 10:43:49 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager.update_available_resource {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:43:49 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:43:49 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:43:49 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:43:49 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Auditing locally available compute resources for user (node: user) {{(pid=85141) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 10:43:49 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/550c62a9-18b5-41bd-a129-322f6c297383/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:43:49 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/550c62a9-18b5-41bd-a129-322f6c297383/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:43:49 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/550c62a9-18b5-41bd-a129-322f6c297383/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:43:49 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/550c62a9-18b5-41bd-a129-322f6c297383/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:43:50 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:43:50 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:43:50 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Hypervisor/Node resource view: name=user free_ram=8999MB free_disk=25.038711547851562GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=85141) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 10:43:50 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:43:50 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:43:50 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance 550c62a9-18b5-41bd-a129-322f6c297383 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:43:50 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=85141) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 10:43:50 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=85141) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 10:43:50 user nova-compute[85141]: DEBUG nova.compute.provider_tree [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Inventory has not changed in ProviderTree for provider: bf8e0fa1-16b6-408f-9203-c4cd63916272 {{(pid=85141) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 10:43:50 user nova-compute[85141]: DEBUG nova.scheduler.client.report [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Inventory has not changed for provider bf8e0fa1-16b6-408f-9203-c4cd63916272 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=85141) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 10:43:50 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Compute_service record updated for user:user {{(pid=85141) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 10:43:50 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.168s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:43:50 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:43:51 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:43:51 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Starting heal instance info cache {{(pid=85141) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 10:43:51 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Rebuilding the list of instances to heal {{(pid=85141) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 10:43:51 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Acquiring lock "refresh_cache-550c62a9-18b5-41bd-a129-322f6c297383" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:43:51 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Acquired lock "refresh_cache-550c62a9-18b5-41bd-a129-322f6c297383" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:43:51 user nova-compute[85141]: DEBUG nova.network.neutron [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] [instance: 550c62a9-18b5-41bd-a129-322f6c297383] Forcefully refreshing network info cache for instance {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 10:43:51 user nova-compute[85141]: DEBUG nova.objects.instance [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lazy-loading 'info_cache' on Instance uuid 550c62a9-18b5-41bd-a129-322f6c297383 {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:43:51 user nova-compute[85141]: DEBUG nova.network.neutron [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] [instance: 550c62a9-18b5-41bd-a129-322f6c297383] Updating instance_info_cache with network_info: [{"id": "867abc80-2539-48b6-9fe1-dae79e683a16", "address": "fa:16:3e:a8:5b:e5", "network": {"id": "8931cd8f-3c0b-4d49-ae98-48f818e854e7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1902653571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d13c6ff3c30549ca9ab44d9fc1fedc6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap867abc80-25", "ovs_interfaceid": "867abc80-2539-48b6-9fe1-dae79e683a16", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:43:51 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Releasing lock "refresh_cache-550c62a9-18b5-41bd-a129-322f6c297383" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:43:51 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] [instance: 550c62a9-18b5-41bd-a129-322f6c297383] Updated the network info_cache for instance {{(pid=85141) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 10:43:51 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:43:51 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:43:52 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:43:55 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:43:57 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:44:00 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:44:00 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:44:00 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:44:00 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=85141) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 10:44:00 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=85141) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 10:44:00 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=85141) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 10:44:00 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:44:05 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:44:09 user nova-compute[85141]: DEBUG nova.compute.manager [req-567681cf-aade-4701-b8a0-c1ffca0a129e req-ed26f059-63be-4a40-8400-2ddedcac94d0 service nova] [instance: 550c62a9-18b5-41bd-a129-322f6c297383] Received event network-changed-867abc80-2539-48b6-9fe1-dae79e683a16 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:44:09 user nova-compute[85141]: DEBUG nova.compute.manager [req-567681cf-aade-4701-b8a0-c1ffca0a129e req-ed26f059-63be-4a40-8400-2ddedcac94d0 service nova] [instance: 550c62a9-18b5-41bd-a129-322f6c297383] Refreshing instance network info cache due to event network-changed-867abc80-2539-48b6-9fe1-dae79e683a16. {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 10:44:09 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-567681cf-aade-4701-b8a0-c1ffca0a129e req-ed26f059-63be-4a40-8400-2ddedcac94d0 service nova] Acquiring lock "refresh_cache-550c62a9-18b5-41bd-a129-322f6c297383" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:44:09 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-567681cf-aade-4701-b8a0-c1ffca0a129e req-ed26f059-63be-4a40-8400-2ddedcac94d0 service nova] Acquired lock "refresh_cache-550c62a9-18b5-41bd-a129-322f6c297383" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:44:09 user nova-compute[85141]: DEBUG nova.network.neutron [req-567681cf-aade-4701-b8a0-c1ffca0a129e req-ed26f059-63be-4a40-8400-2ddedcac94d0 service nova] [instance: 550c62a9-18b5-41bd-a129-322f6c297383] Refreshing network info cache for port 867abc80-2539-48b6-9fe1-dae79e683a16 {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 10:44:10 user nova-compute[85141]: DEBUG nova.network.neutron [req-567681cf-aade-4701-b8a0-c1ffca0a129e req-ed26f059-63be-4a40-8400-2ddedcac94d0 service nova] [instance: 550c62a9-18b5-41bd-a129-322f6c297383] Updated VIF entry in instance network info cache for port 867abc80-2539-48b6-9fe1-dae79e683a16. {{(pid=85141) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 10:44:10 user nova-compute[85141]: DEBUG nova.network.neutron [req-567681cf-aade-4701-b8a0-c1ffca0a129e req-ed26f059-63be-4a40-8400-2ddedcac94d0 service nova] [instance: 550c62a9-18b5-41bd-a129-322f6c297383] Updating instance_info_cache with network_info: [{"id": "867abc80-2539-48b6-9fe1-dae79e683a16", "address": "fa:16:3e:a8:5b:e5", "network": {"id": "8931cd8f-3c0b-4d49-ae98-48f818e854e7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1902653571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d13c6ff3c30549ca9ab44d9fc1fedc6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap867abc80-25", "ovs_interfaceid": "867abc80-2539-48b6-9fe1-dae79e683a16", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:44:10 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-567681cf-aade-4701-b8a0-c1ffca0a129e req-ed26f059-63be-4a40-8400-2ddedcac94d0 service nova] Releasing lock "refresh_cache-550c62a9-18b5-41bd-a129-322f6c297383" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:44:10 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:44:10 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:44:10 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=85141) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 10:44:10 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=85141) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 10:44:10 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=85141) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 10:44:10 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:44:11 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-b1531c23-f218-4aae-9bc2-63f486a8a639 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Acquiring lock "550c62a9-18b5-41bd-a129-322f6c297383" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:44:11 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-b1531c23-f218-4aae-9bc2-63f486a8a639 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Lock "550c62a9-18b5-41bd-a129-322f6c297383" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:44:11 user nova-compute[85141]: DEBUG nova.objects.instance [None req-b1531c23-f218-4aae-9bc2-63f486a8a639 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Lazy-loading 'flavor' on Instance uuid 550c62a9-18b5-41bd-a129-322f6c297383 {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:44:11 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-b1531c23-f218-4aae-9bc2-63f486a8a639 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Lock "550c62a9-18b5-41bd-a129-322f6c297383" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.064s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:44:11 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-b1531c23-f218-4aae-9bc2-63f486a8a639 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Acquiring lock "550c62a9-18b5-41bd-a129-322f6c297383" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:44:11 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-b1531c23-f218-4aae-9bc2-63f486a8a639 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Lock "550c62a9-18b5-41bd-a129-322f6c297383" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:44:11 user nova-compute[85141]: INFO nova.compute.manager [None req-b1531c23-f218-4aae-9bc2-63f486a8a639 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] [instance: 550c62a9-18b5-41bd-a129-322f6c297383] Attaching volume 00326056-390f-4b45-b3c6-c378bc03107a to /dev/vdb
Nov 16 10:44:11 user nova-compute[85141]: DEBUG os_brick.utils [None req-b1531c23-f218-4aae-9bc2-63f486a8a639 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 10:44:11 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:44:11 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:44:11 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b9ff59d-c6bb-4a30-8256-3cab847e0d54]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c7834de5c295\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:44:11 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:44:11 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:44:11 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f018a73-5722-439f-b778-d21fd908b571]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:44:11 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:44:11 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:44:11 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[60f765f7-098b-446f-90d1-911bdd04e98b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:44:11 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[55503aa4-4253-42c0-abf8-dd6fe667a277]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:44:11 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-b1531c23-f218-4aae-9bc2-63f486a8a639 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Running cmd (subprocess): nvme version {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:44:11 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-b1531c23-f218-4aae-9bc2-63f486a8a639 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] 'nvme version' failed. Not Retrying. {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 10:44:11 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b1531c23-f218-4aae-9bc2-63f486a8a639 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] nvme not present on system {{(pid=85141) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 10:44:11 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:44:11 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 10:44:11 user nova-compute[85141]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 10:44:11 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d2a702b-16d3-4120-bc03-b038b317a48e]: (4, '') {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:44:11 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.lightos [None req-b1531c23-f218-4aae-9bc2-63f486a8a639 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=85141) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 10:44:11 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.lightos [None req-b1531c23-f218-4aae-9bc2-63f486a8a639 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=85141) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 10:44:11 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.lightos [None req-b1531c23-f218-4aae-9bc2-63f486a8a639 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] LIGHTOS: no hostnqn found. {{(pid=85141) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 10:44:11 user nova-compute[85141]: DEBUG os_brick.utils [None req-b1531c23-f218-4aae-9bc2-63f486a8a639 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c7834de5c295', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 10:44:11 user nova-compute[85141]: DEBUG nova.virt.block_device [None req-b1531c23-f218-4aae-9bc2-63f486a8a639 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] [instance: 550c62a9-18b5-41bd-a129-322f6c297383] Updating existing volume attachment record: ca5001d6-e719-4f34-86f7-8718438be325 {{(pid=85141) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 10:44:13 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:44:15 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:44:16 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b1531c23-f218-4aae-9bc2-63f486a8a639 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] [instance: 550c62a9-18b5-41bd-a129-322f6c297383] Calling os-brick to attach iSCSI Volume {{(pid=85141) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 10:44:16 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1531c23-f218-4aae-9bc2-63f486a8a639 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51806b6080>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:00326056-390f-4b45-b3c6-c378bc03107a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KsQUSGNp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 10:44:16 user nova-compute[85141]: WARNING os_brick.initiator.connectors.base [None req-b1531c23-f218-4aae-9bc2-63f486a8a639 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 10:44:16 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-b1531c23-f218-4aae-9bc2-63f486a8a639 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 10:44:16 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-b1531c23-f218-4aae-9bc2-63f486a8a639 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 10:44:16 user nova-compute[85141]: WARNING os_brick.initiator.connectors.base [None req-b1531c23-f218-4aae-9bc2-63f486a8a639 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 10:44:16 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-b1531c23-f218-4aae-9bc2-63f486a8a639 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:00326056-390f-4b45-b3c6-c378bc03107a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 10:44:16 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-b1531c23-f218-4aae-9bc2-63f486a8a639 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:00326056-390f-4b45-b3c6-c378bc03107a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 10:44:16 user nova-compute[85141]: INFO os_brick.initiator.connectors.iscsi [None req-b1531c23-f218-4aae-9bc2-63f486a8a639 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 10:44:16 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00326056-390f-4b45-b3c6-c378bc03107a -p 172.16.0.220:3260 {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:44:16 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00326056-390f-4b45-b3c6-c378bc03107a -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:44:16 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[94cfb312-b313-4a6d-abb1-7413f0c4077c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:44:16 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1531c23-f218-4aae-9bc2-63f486a8a639 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 10:44:16 user nova-compute[85141]:  {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:44:16 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00326056-390f-4b45-b3c6-c378bc03107a -p 172.16.0.220:3260 --interface default --op new {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:44:16 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00326056-390f-4b45-b3c6-c378bc03107a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:44:16 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[da1caa56-3c15-4844-a169-139ac760eb71]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:00326056-390f-4b45-b3c6-c378bc03107a] added\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:44:16 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1531c23-f218-4aae-9bc2-63f486a8a639 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:00326056-390f-4b45-b3c6-c378bc03107a] added
Nov 16 10:44:16 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:44:16 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00326056-390f-4b45-b3c6-c378bc03107a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:44:16 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00326056-390f-4b45-b3c6-c378bc03107a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:44:16 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c3c9d44-1366-4e08-b7a7-59b83c9eacf8]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:44:16 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1531c23-f218-4aae-9bc2-63f486a8a639 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:44:16 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00326056-390f-4b45-b3c6-c378bc03107a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:44:16 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00326056-390f-4b45-b3c6-c378bc03107a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:44:16 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[c20e6fee-bc30-4b62-a15e-6c52877036fe]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:44:16 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1531c23-f218-4aae-9bc2-63f486a8a639 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:44:16 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00326056-390f-4b45-b3c6-c378bc03107a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KsQUSGNp {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:44:16 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00326056-390f-4b45-b3c6-c378bc03107a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KsQUSGNp" returned: 0 in 0.033s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:44:16 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[40970ad1-998e-42c2-ac77-d22f3537561c]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:44:16 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1531c23-f218-4aae-9bc2-63f486a8a639 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KsQUSGNp'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:44:16 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00326056-390f-4b45-b3c6-c378bc03107a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:44:16 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00326056-390f-4b45-b3c6-c378bc03107a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:44:16 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1c1e393-f919-4243-8cf9-f77707a3392a]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:44:16 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1531c23-f218-4aae-9bc2-63f486a8a639 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:44:16 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:44:16 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:44:16 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2bdc088-3c67-491b-8d78-59b7120f7534]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:44:16 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1531c23-f218-4aae-9bc2-63f486a8a639 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 16 10:44:16 user nova-compute[85141]:  {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:44:16 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1531c23-f218-4aae-9bc2-63f486a8a639 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 16 10:44:16 user nova-compute[85141]:  {{(pid=85141) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 10:44:16 user nova-compute[85141]: WARNING os_brick.initiator.connectors.iscsi [None req-b1531c23-f218-4aae-9bc2-63f486a8a639 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 16 10:44:16 user nova-compute[85141]: 
Nov 16 10:44:16 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00326056-390f-4b45-b3c6-c378bc03107a -p 172.16.0.220:3260 --login {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:44:16 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00326056-390f-4b45-b3c6-c378bc03107a -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:44:16 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4e21cae-d29b-4269-9671-ba3970764f69]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:00326056-390f-4b45-b3c6-c378bc03107a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:00326056-390f-4b45-b3c6-c378bc03107a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:44:16 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1531c23-f218-4aae-9bc2-63f486a8a639 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:00326056-390f-4b45-b3c6-c378bc03107a, portal: 172.16.0.220,3260]
Nov 16 10:44:16 user nova-compute[85141]: Login to [iface: default, target: iqn.2010-10.org.openstack:00326056-390f-4b45-b3c6-c378bc03107a, portal: 172.16.0.220,3260] successful.
Nov 16 10:44:16 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:44:16 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00326056-390f-4b45-b3c6-c378bc03107a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:44:16 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00326056-390f-4b45-b3c6-c378bc03107a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:44:16 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[30f63ad3-afd7-4eba-92ed-2b701cd9ed3b]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:44:16 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1531c23-f218-4aae-9bc2-63f486a8a639 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:44:16 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:44:16 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:44:16 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[f383ca61-a617-4bbc-b00d-4b878e254035]: (4, ('tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00326056-390f-4b45-b3c6-c378bc03107a (non-flash)\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:44:16 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1531c23-f218-4aae-9bc2-63f486a8a639 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00326056-390f-4b45-b3c6-c378bc03107a (non-flash)
Nov 16 10:44:16 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:44:16 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1531c23-f218-4aae-9bc2-63f486a8a639 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] iscsi session list stdout=tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00326056-390f-4b45-b3c6-c378bc03107a (non-flash)
Nov 16 10:44:16 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 10:44:16 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-b1531c23-f218-4aae-9bc2-63f486a8a639 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:00326056-390f-4b45-b3c6-c378bc03107a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.278s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 10:44:16 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1531c23-f218-4aae-9bc2-63f486a8a639 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Connected to 172.16.0.220:3260 {{(pid=85141) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 10:44:16 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-b1531c23-f218-4aae-9bc2-63f486a8a639 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] HCTL ('33', '-', '-', 0) found on session 63 with lun 0 {{(pid=85141) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 10:44:16 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-b1531c23-f218-4aae-9bc2-63f486a8a639 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=85141) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 10:44:16 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:44:16 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:44:16 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f4d0f8a-0e69-43d6-a457-8d5922df019a]: (4, ('- - 0', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:44:16 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-b1531c23-f218-4aae-9bc2-63f486a8a639 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Searching for a device in session 63 and hctl ['33', '*', '*', 0] yield: None {{(pid=85141) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 10:44:17 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-b1531c23-f218-4aae-9bc2-63f486a8a639 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Searching for a device in session 63 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=85141) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 10:44:17 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1531c23-f218-4aae-9bc2-63f486a8a639 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:00326056-390f-4b45-b3c6-c378bc03107a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KsQUSGNp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=85141) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 10:44:17 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-b1531c23-f218-4aae-9bc2-63f486a8a639 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.309s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 10:44:17 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1531c23-f218-4aae-9bc2-63f486a8a639 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] <== connect_volume: return (1311ms) {'type': 'block', 'scsi_wwn': '23232363864343861', 'path': '/dev/sdb'} {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 10:44:17 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b1531c23-f218-4aae-9bc2-63f486a8a639 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] [instance: 550c62a9-18b5-41bd-a129-322f6c297383] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23232363864343861', 'path': '/dev/sdb'} {{(pid=85141) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 10:44:17 user nova-compute[85141]: DEBUG nova.objects.instance [None req-b1531c23-f218-4aae-9bc2-63f486a8a639 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Lazy-loading 'flavor' on Instance uuid 550c62a9-18b5-41bd-a129-322f6c297383 {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:44:18 user nova-compute[85141]: DEBUG nova.virt.libvirt.guest [None req-b1531c23-f218-4aae-9bc2-63f486a8a639 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 10:44:18 user nova-compute[85141]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 10:44:18 user nova-compute[85141]:   <source dev="/dev/sdb"/>
Nov 16 10:44:18 user nova-compute[85141]:   <target dev="vdb" bus="virtio"/>
Nov 16 10:44:18 user nova-compute[85141]:   <serial>00326056-390f-4b45-b3c6-c378bc03107a</serial>
Nov 16 10:44:18 user nova-compute[85141]: </disk>
Nov 16 10:44:18 user nova-compute[85141]:  {{(pid=85141) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 10:44:18 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-b1531c23-f218-4aae-9bc2-63f486a8a639 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] No BDM found with device name vda, not building metadata. {{(pid=85141) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 10:44:18 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-b1531c23-f218-4aae-9bc2-63f486a8a639 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] No BDM found with device name vdb, not building metadata. {{(pid=85141) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 10:44:18 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-b1531c23-f218-4aae-9bc2-63f486a8a639 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] No VIF found with MAC fa:16:3e:a8:5b:e5, not building metadata {{(pid=85141) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 10:44:18 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-b1531c23-f218-4aae-9bc2-63f486a8a639 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Lock "550c62a9-18b5-41bd-a129-322f6c297383" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.834s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:44:18 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:44:19 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-3f78d8a5-9096-48a4-ba57-a81a353af104 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Acquiring lock "550c62a9-18b5-41bd-a129-322f6c297383" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:44:19 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-3f78d8a5-9096-48a4-ba57-a81a353af104 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Lock "550c62a9-18b5-41bd-a129-322f6c297383" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:44:19 user nova-compute[85141]: INFO nova.compute.manager [None req-3f78d8a5-9096-48a4-ba57-a81a353af104 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] [instance: 550c62a9-18b5-41bd-a129-322f6c297383] Detaching volume 00326056-390f-4b45-b3c6-c378bc03107a
Nov 16 10:44:19 user nova-compute[85141]: INFO nova.virt.block_device [None req-3f78d8a5-9096-48a4-ba57-a81a353af104 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] [instance: 550c62a9-18b5-41bd-a129-322f6c297383] Attempting to driver detach volume 00326056-390f-4b45-b3c6-c378bc03107a from mountpoint /dev/vdb
Nov 16 10:44:19 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-3f78d8a5-9096-48a4-ba57-a81a353af104 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Attempting to detach device vdb from instance 550c62a9-18b5-41bd-a129-322f6c297383 from the persistent domain config. {{(pid=85141) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 10:44:19 user nova-compute[85141]: DEBUG nova.virt.libvirt.guest [None req-3f78d8a5-9096-48a4-ba57-a81a353af104 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 10:44:19 user nova-compute[85141]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 10:44:19 user nova-compute[85141]:   <source dev="/dev/sdb"/>
Nov 16 10:44:19 user nova-compute[85141]:   <target dev="vdb" bus="virtio"/>
Nov 16 10:44:19 user nova-compute[85141]:   <serial>00326056-390f-4b45-b3c6-c378bc03107a</serial>
Nov 16 10:44:19 user nova-compute[85141]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 10:44:19 user nova-compute[85141]: </disk>
Nov 16 10:44:19 user nova-compute[85141]:  {{(pid=85141) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 10:44:19 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-3f78d8a5-9096-48a4-ba57-a81a353af104 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Successfully detached device vdb from instance 550c62a9-18b5-41bd-a129-322f6c297383 from the persistent domain config.
Nov 16 10:44:19 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-3f78d8a5-9096-48a4-ba57-a81a353af104 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 550c62a9-18b5-41bd-a129-322f6c297383 from the live domain config. {{(pid=85141) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 10:44:19 user nova-compute[85141]: DEBUG nova.virt.libvirt.guest [None req-3f78d8a5-9096-48a4-ba57-a81a353af104 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 10:44:19 user nova-compute[85141]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 10:44:19 user nova-compute[85141]:   <source dev="/dev/sdb"/>
Nov 16 10:44:19 user nova-compute[85141]:   <target dev="vdb" bus="virtio"/>
Nov 16 10:44:19 user nova-compute[85141]:   <serial>00326056-390f-4b45-b3c6-c378bc03107a</serial>
Nov 16 10:44:19 user nova-compute[85141]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 10:44:19 user nova-compute[85141]: </disk>
Nov 16 10:44:19 user nova-compute[85141]:  {{(pid=85141) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 10:44:20 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-3f78d8a5-9096-48a4-ba57-a81a353af104 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 550c62a9-18b5-41bd-a129-322f6c297383 {{(pid=85141) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 10:44:20 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:44:25 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:44:28 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:44:30 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:44:35 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:44:35 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:44:35 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=85141) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 10:44:35 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=85141) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 10:44:35 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=85141) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 10:44:35 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:44:40 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-3f78d8a5-9096-48a4-ba57-a81a353af104 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 550c62a9-18b5-41bd-a129-322f6c297383 is timed out.
Nov 16 10:44:40 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-3f78d8a5-9096-48a4-ba57-a81a353af104 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Successfully detached device vdb from instance 550c62a9-18b5-41bd-a129-322f6c297383 from the live domain config.
Nov 16 10:44:40 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3f78d8a5-9096-48a4-ba57-a81a353af104 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] [instance: 550c62a9-18b5-41bd-a129-322f6c297383] calling os-brick to detach iSCSI Volume {{(pid=85141) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 10:44:40 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f78d8a5-9096-48a4-ba57-a81a353af104 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51806b6080>, {'target_iqn': 'iqn.2010-10.org.openstack:00326056-390f-4b45-b3c6-c378bc03107a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KsQUSGNp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 10:44:40 user nova-compute[85141]: WARNING os_brick.initiator.connectors.base [None req-3f78d8a5-9096-48a4-ba57-a81a353af104 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 10:44:40 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-3f78d8a5-9096-48a4-ba57-a81a353af104 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 10:44:40 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-3f78d8a5-9096-48a4-ba57-a81a353af104 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 10:44:40 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:44:40 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:44:40 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c742f60-015b-4e04-b1cf-3207f089cdd1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:00326056-390f-4b45-b3c6-c378bc03107a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:44:40 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f78d8a5-9096-48a4-ba57-a81a353af104 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 10:44:40 user nova-compute[85141]: No targets found.
Nov 16 10:44:40 user nova-compute[85141]: iSNS:
Nov 16 10:44:40 user nova-compute[85141]: No targets found.
Nov 16 10:44:40 user nova-compute[85141]: STATIC:
Nov 16 10:44:40 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:00326056-390f-4b45-b3c6-c378bc03107a
Nov 16 10:44:40 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:44:40 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:44:40 user nova-compute[85141]: FIRMWARE:
Nov 16 10:44:40 user nova-compute[85141]: No targets found.
Nov 16 10:44:40 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:44:40 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f78d8a5-9096-48a4-ba57-a81a353af104 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 10:44:40 user nova-compute[85141]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 10:44:40 user nova-compute[85141]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=85141) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 10:44:40 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f78d8a5-9096-48a4-ba57-a81a353af104 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:00326056-390f-4b45-b3c6-c378bc03107a', 0)] {{(pid=85141) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 10:44:40 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:44:40 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:44:40 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5368f2a-6c05-4d21-93c7-ab7de88f041e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:00326056-390f-4b45-b3c6-c378bc03107a\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:44:40 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:44:40 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:44:40 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[c45b4e5b-39ae-4a9b-a444-951d21cca555]: (4, ('tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00326056-390f-4b45-b3c6-c378bc03107a (non-flash)\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:44:40 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f78d8a5-9096-48a4-ba57-a81a353af104 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00326056-390f-4b45-b3c6-c378bc03107a (non-flash)
Nov 16 10:44:40 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:44:40 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f78d8a5-9096-48a4-ba57-a81a353af104 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] iscsi session list stdout=tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00326056-390f-4b45-b3c6-c378bc03107a (non-flash)
Nov 16 10:44:40 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 10:44:40 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f78d8a5-9096-48a4-ba57-a81a353af104 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f51981403a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:00326056-390f-4b45-b3c6-c378bc03107a'): ({'sdb'}, set())}) {{(pid=85141) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 10:44:40 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-3f78d8a5-9096-48a4-ba57-a81a353af104 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Removing single pathed devices sdb {{(pid=85141) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 10:44:40 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:44:40 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:44:40 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbffb3c5-dfcf-43c5-a9f6-1a552e81b638]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:44:40 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:44:40 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:44:40 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[d60680bf-a14c-4f7a-a6d9-3463353086ed]: (4, ('ok\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:44:40 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-3f78d8a5-9096-48a4-ba57-a81a353af104 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Flushing IO for device /dev/sdb {{(pid=85141) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 10:44:40 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:44:40 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:44:40 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc59d926-7fb1-4bec-af10-2bb69f04eb19]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:44:40 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-3f78d8a5-9096-48a4-ba57-a81a353af104 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=85141) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 10:44:40 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:44:40 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.058s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:44:40 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b2061eb-dbd7-4f30-a2b7-f108f948aeec]: (4, ('1', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:44:40 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-3f78d8a5-9096-48a4-ba57-a81a353af104 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=85141) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 10:44:40 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-3f78d8a5-9096-48a4-ba57-a81a353af104 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] SCSI volumes sdb have been removed. {{(pid=85141) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 10:44:40 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f78d8a5-9096-48a4-ba57-a81a353af104 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:00326056-390f-4b45-b3c6-c378bc03107a')] {{(pid=85141) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 10:44:40 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00326056-390f-4b45-b3c6-c378bc03107a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:44:40 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00326056-390f-4b45-b3c6-c378bc03107a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:44:40 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[80b91920-99e3-4362-9e97-18536edf44ac]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:44:40 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f78d8a5-9096-48a4-ba57-a81a353af104 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:44:40 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00326056-390f-4b45-b3c6-c378bc03107a -p 172.16.0.220:3260 --logout {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:44:40 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00326056-390f-4b45-b3c6-c378bc03107a -p 172.16.0.220:3260 --logout" returned: 0 in 0.044s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:44:40 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[75430672-9bb9-4211-bddd-847eec594377]: (4, ('Logging out of session [sid: 63, target: iqn.2010-10.org.openstack:00326056-390f-4b45-b3c6-c378bc03107a, portal: 172.16.0.220,3260]\nLogout of [sid: 63, target: iqn.2010-10.org.openstack:00326056-390f-4b45-b3c6-c378bc03107a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:44:40 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f78d8a5-9096-48a4-ba57-a81a353af104 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 63, target: iqn.2010-10.org.openstack:00326056-390f-4b45-b3c6-c378bc03107a, portal: 172.16.0.220,3260]
Nov 16 10:44:40 user nova-compute[85141]: Logout of [sid: 63, target: iqn.2010-10.org.openstack:00326056-390f-4b45-b3c6-c378bc03107a, portal: 172.16.0.220,3260] successful.
Nov 16 10:44:40 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:44:40 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00326056-390f-4b45-b3c6-c378bc03107a -p 172.16.0.220:3260 --op delete {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:44:40 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00326056-390f-4b45-b3c6-c378bc03107a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:44:40 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8f4e423-f6b6-407e-bf2c-98e191c33784]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:44:40 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f78d8a5-9096-48a4-ba57-a81a353af104 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:44:40 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-3f78d8a5-9096-48a4-ba57-a81a353af104 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.274s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 10:44:40 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f78d8a5-9096-48a4-ba57-a81a353af104 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] <== disconnect_volume: return (274ms) None {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 10:44:40 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3f78d8a5-9096-48a4-ba57-a81a353af104 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] [instance: 550c62a9-18b5-41bd-a129-322f6c297383] Disconnected iSCSI Volume {{(pid=85141) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 10:44:40 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:44:40 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:44:40 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=85141) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 10:44:40 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=85141) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 10:44:40 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=85141) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 10:44:40 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:44:41 user nova-compute[85141]: DEBUG nova.objects.instance [None req-3f78d8a5-9096-48a4-ba57-a81a353af104 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Lazy-loading 'flavor' on Instance uuid 550c62a9-18b5-41bd-a129-322f6c297383 {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:44:41 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-3f78d8a5-9096-48a4-ba57-a81a353af104 tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Lock "550c62a9-18b5-41bd-a129-322f6c297383" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.649s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:44:43 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:44:43 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:44:45 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:44:48 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:44:48 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=85141) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 10:44:49 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager.update_available_resource {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:44:49 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:44:49 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:44:49 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:44:49 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Auditing locally available compute resources for user (node: user) {{(pid=85141) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 10:44:49 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/550c62a9-18b5-41bd-a129-322f6c297383/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:44:49 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/550c62a9-18b5-41bd-a129-322f6c297383/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:44:49 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/550c62a9-18b5-41bd-a129-322f6c297383/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:44:49 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/550c62a9-18b5-41bd-a129-322f6c297383/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:44:50 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:44:50 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:44:50 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Hypervisor/Node resource view: name=user free_ram=8997MB free_disk=25.03766632080078GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=85141) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 10:44:50 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:44:50 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:44:50 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance 550c62a9-18b5-41bd-a129-322f6c297383 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:44:50 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=85141) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 10:44:50 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=85141) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 10:44:50 user nova-compute[85141]: DEBUG nova.compute.provider_tree [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Inventory has not changed in ProviderTree for provider: bf8e0fa1-16b6-408f-9203-c4cd63916272 {{(pid=85141) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 10:44:50 user nova-compute[85141]: DEBUG nova.scheduler.client.report [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Inventory has not changed for provider bf8e0fa1-16b6-408f-9203-c4cd63916272 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=85141) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 10:44:50 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Compute_service record updated for user:user {{(pid=85141) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 10:44:50 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.183s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:44:50 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:44:51 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:44:51 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:44:52 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:44:52 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Starting heal instance info cache {{(pid=85141) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 10:44:52 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Rebuilding the list of instances to heal {{(pid=85141) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 10:44:52 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Acquiring lock "refresh_cache-550c62a9-18b5-41bd-a129-322f6c297383" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:44:52 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Acquired lock "refresh_cache-550c62a9-18b5-41bd-a129-322f6c297383" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:44:52 user nova-compute[85141]: DEBUG nova.network.neutron [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] [instance: 550c62a9-18b5-41bd-a129-322f6c297383] Forcefully refreshing network info cache for instance {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 10:44:52 user nova-compute[85141]: DEBUG nova.objects.instance [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lazy-loading 'info_cache' on Instance uuid 550c62a9-18b5-41bd-a129-322f6c297383 {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:44:52 user nova-compute[85141]: DEBUG nova.network.neutron [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] [instance: 550c62a9-18b5-41bd-a129-322f6c297383] Updating instance_info_cache with network_info: [{"id": "867abc80-2539-48b6-9fe1-dae79e683a16", "address": "fa:16:3e:a8:5b:e5", "network": {"id": "8931cd8f-3c0b-4d49-ae98-48f818e854e7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1902653571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d13c6ff3c30549ca9ab44d9fc1fedc6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap867abc80-25", "ovs_interfaceid": "867abc80-2539-48b6-9fe1-dae79e683a16", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:44:52 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Releasing lock "refresh_cache-550c62a9-18b5-41bd-a129-322f6c297383" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:44:52 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] [instance: 550c62a9-18b5-41bd-a129-322f6c297383] Updated the network info_cache for instance {{(pid=85141) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 10:44:53 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:44:54 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:44:55 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:44:58 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:45:00 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:45:01 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:45:05 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:45:05 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:45:05 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=85141) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 10:45:05 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=85141) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 10:45:05 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=85141) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 10:45:05 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:45:09 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-d181f85b-a093-488f-88f4-8ba40c29657a tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Acquiring lock "550c62a9-18b5-41bd-a129-322f6c297383" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:45:09 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-d181f85b-a093-488f-88f4-8ba40c29657a tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Lock "550c62a9-18b5-41bd-a129-322f6c297383" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:45:09 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-d181f85b-a093-488f-88f4-8ba40c29657a tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Acquiring lock "550c62a9-18b5-41bd-a129-322f6c297383-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:45:09 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-d181f85b-a093-488f-88f4-8ba40c29657a tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Lock "550c62a9-18b5-41bd-a129-322f6c297383-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:45:09 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-d181f85b-a093-488f-88f4-8ba40c29657a tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Lock "550c62a9-18b5-41bd-a129-322f6c297383-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:45:09 user nova-compute[85141]: INFO nova.compute.manager [None req-d181f85b-a093-488f-88f4-8ba40c29657a tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] [instance: 550c62a9-18b5-41bd-a129-322f6c297383] Terminating instance
Nov 16 10:45:09 user nova-compute[85141]: DEBUG nova.compute.manager [None req-d181f85b-a093-488f-88f4-8ba40c29657a tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] [instance: 550c62a9-18b5-41bd-a129-322f6c297383] Start destroying the instance on the hypervisor. {{(pid=85141) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 10:45:09 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:45:10 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:45:10 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:45:10 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:45:10 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:45:10 user nova-compute[85141]: DEBUG nova.compute.manager [req-df853729-a391-45cd-92c2-9e1cf7ded740 req-18ec9625-d7d4-4ed3-9986-edc5789b5a79 service nova] [instance: 550c62a9-18b5-41bd-a129-322f6c297383] Received event network-vif-unplugged-867abc80-2539-48b6-9fe1-dae79e683a16 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:45:10 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-df853729-a391-45cd-92c2-9e1cf7ded740 req-18ec9625-d7d4-4ed3-9986-edc5789b5a79 service nova] Acquiring lock "550c62a9-18b5-41bd-a129-322f6c297383-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:45:10 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-df853729-a391-45cd-92c2-9e1cf7ded740 req-18ec9625-d7d4-4ed3-9986-edc5789b5a79 service nova] Lock "550c62a9-18b5-41bd-a129-322f6c297383-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:45:10 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-df853729-a391-45cd-92c2-9e1cf7ded740 req-18ec9625-d7d4-4ed3-9986-edc5789b5a79 service nova] Lock "550c62a9-18b5-41bd-a129-322f6c297383-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:45:10 user nova-compute[85141]: DEBUG nova.compute.manager [req-df853729-a391-45cd-92c2-9e1cf7ded740 req-18ec9625-d7d4-4ed3-9986-edc5789b5a79 service nova] [instance: 550c62a9-18b5-41bd-a129-322f6c297383] No waiting events found dispatching network-vif-unplugged-867abc80-2539-48b6-9fe1-dae79e683a16 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:45:10 user nova-compute[85141]: DEBUG nova.compute.manager [req-df853729-a391-45cd-92c2-9e1cf7ded740 req-18ec9625-d7d4-4ed3-9986-edc5789b5a79 service nova] [instance: 550c62a9-18b5-41bd-a129-322f6c297383] Received event network-vif-unplugged-867abc80-2539-48b6-9fe1-dae79e683a16 for instance with task_state deleting. {{(pid=85141) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 10:45:10 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:45:10 user nova-compute[85141]: INFO nova.virt.libvirt.driver [-] [instance: 550c62a9-18b5-41bd-a129-322f6c297383] Instance destroyed successfully.
Nov 16 10:45:10 user nova-compute[85141]: DEBUG nova.objects.instance [None req-d181f85b-a093-488f-88f4-8ba40c29657a tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Lazy-loading 'resources' on Instance uuid 550c62a9-18b5-41bd-a129-322f6c297383 {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:45:10 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-d181f85b-a093-488f-88f4-8ba40c29657a tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T10:42:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-681414414',display_name='tempest-AttachVolumeNegativeTest-server-681414414',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-681414414',id=52,image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE0qwoDR6lD4pLJu+OBQPOnuwWR1q51FfoLGspSFKaDrOTIIUqT0NeJFfFJ57aaLPUFM4aBmTeqq0r4XpPnWMwgV434azb6awq3qQolWU87zGfZZ+Btw3wAV89zxwxRxgg==',key_name='tempest-keypair-85269288',keypairs=<?>,launch_index=0,launched_at=2023-11-16T10:42:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d13c6ff3c30549ca9ab44d9fc1fedc6f',ramdisk_id='',reservation_id='r-h1wn9c2k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-2108292208',owner_user_name='tempest-AttachVolumeNegativeTest-2108292208-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T10:42:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5aa5beeeca5d4dc89cf5333942da756f',uuid=550c62a9-18b5-41bd-a129-322f6c297383,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "867abc80-2539-48b6-9fe1-dae79e683a16", "address": "fa:16:3e:a8:5b:e5", "network": {"id": "8931cd8f-3c0b-4d49-ae98-48f818e854e7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1902653571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d13c6ff3c30549ca9ab44d9fc1fedc6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap867abc80-25", "ovs_interfaceid": "867abc80-2539-48b6-9fe1-dae79e683a16", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 10:45:10 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-d181f85b-a093-488f-88f4-8ba40c29657a tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Converting VIF {"id": "867abc80-2539-48b6-9fe1-dae79e683a16", "address": "fa:16:3e:a8:5b:e5", "network": {"id": "8931cd8f-3c0b-4d49-ae98-48f818e854e7", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1902653571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d13c6ff3c30549ca9ab44d9fc1fedc6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap867abc80-25", "ovs_interfaceid": "867abc80-2539-48b6-9fe1-dae79e683a16", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:45:10 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-d181f85b-a093-488f-88f4-8ba40c29657a tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a8:5b:e5,bridge_name='br-int',has_traffic_filtering=True,id=867abc80-2539-48b6-9fe1-dae79e683a16,network=Network(8931cd8f-3c0b-4d49-ae98-48f818e854e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap867abc80-25') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:45:10 user nova-compute[85141]: DEBUG os_vif [None req-d181f85b-a093-488f-88f4-8ba40c29657a tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a8:5b:e5,bridge_name='br-int',has_traffic_filtering=True,id=867abc80-2539-48b6-9fe1-dae79e683a16,network=Network(8931cd8f-3c0b-4d49-ae98-48f818e854e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap867abc80-25') {{(pid=85141) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 10:45:10 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:45:10 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap867abc80-25, bridge=br-int, if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:45:10 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:45:10 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:45:10 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:45:10 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0c0ef08f-015f-484d-b622-e37e6afc8c6e) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:45:10 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:45:10 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:45:10 user nova-compute[85141]: INFO os_vif [None req-d181f85b-a093-488f-88f4-8ba40c29657a tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a8:5b:e5,bridge_name='br-int',has_traffic_filtering=True,id=867abc80-2539-48b6-9fe1-dae79e683a16,network=Network(8931cd8f-3c0b-4d49-ae98-48f818e854e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap867abc80-25')
Nov 16 10:45:10 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-d181f85b-a093-488f-88f4-8ba40c29657a tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] [instance: 550c62a9-18b5-41bd-a129-322f6c297383] Deleting instance files /opt/stack/data/nova/instances/550c62a9-18b5-41bd-a129-322f6c297383_del
Nov 16 10:45:10 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-d181f85b-a093-488f-88f4-8ba40c29657a tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] [instance: 550c62a9-18b5-41bd-a129-322f6c297383] Deletion of /opt/stack/data/nova/instances/550c62a9-18b5-41bd-a129-322f6c297383_del complete
Nov 16 10:45:10 user nova-compute[85141]: INFO nova.compute.manager [None req-d181f85b-a093-488f-88f4-8ba40c29657a tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] [instance: 550c62a9-18b5-41bd-a129-322f6c297383] Took 0.85 seconds to destroy the instance on the hypervisor.
Nov 16 10:45:10 user nova-compute[85141]: DEBUG oslo.service.loopingcall [None req-d181f85b-a093-488f-88f4-8ba40c29657a tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=85141) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 10:45:10 user nova-compute[85141]: DEBUG nova.compute.manager [-] [instance: 550c62a9-18b5-41bd-a129-322f6c297383] Deallocating network for instance {{(pid=85141) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 10:45:10 user nova-compute[85141]: DEBUG nova.network.neutron [-] [instance: 550c62a9-18b5-41bd-a129-322f6c297383] deallocate_for_instance() {{(pid=85141) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 10:45:11 user nova-compute[85141]: DEBUG nova.network.neutron [-] [instance: 550c62a9-18b5-41bd-a129-322f6c297383] Updating instance_info_cache with network_info: [] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:45:11 user nova-compute[85141]: INFO nova.compute.manager [-] [instance: 550c62a9-18b5-41bd-a129-322f6c297383] Took 0.67 seconds to deallocate network for instance.
Nov 16 10:45:11 user nova-compute[85141]: DEBUG nova.compute.manager [req-4a278548-9363-49db-bb10-31a6f6c9da9d req-551b7fad-4494-44b1-a683-93f4fdde5f19 service nova] [instance: 550c62a9-18b5-41bd-a129-322f6c297383] Received event network-vif-deleted-867abc80-2539-48b6-9fe1-dae79e683a16 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:45:11 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-d181f85b-a093-488f-88f4-8ba40c29657a tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:45:11 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-d181f85b-a093-488f-88f4-8ba40c29657a tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:45:11 user nova-compute[85141]: DEBUG nova.compute.provider_tree [None req-d181f85b-a093-488f-88f4-8ba40c29657a tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Inventory has not changed in ProviderTree for provider: bf8e0fa1-16b6-408f-9203-c4cd63916272 {{(pid=85141) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 10:45:11 user nova-compute[85141]: DEBUG nova.scheduler.client.report [None req-d181f85b-a093-488f-88f4-8ba40c29657a tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Inventory has not changed for provider bf8e0fa1-16b6-408f-9203-c4cd63916272 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=85141) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 10:45:11 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-d181f85b-a093-488f-88f4-8ba40c29657a tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.105s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:45:11 user nova-compute[85141]: INFO nova.scheduler.client.report [None req-d181f85b-a093-488f-88f4-8ba40c29657a tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Deleted allocations for instance 550c62a9-18b5-41bd-a129-322f6c297383
Nov 16 10:45:11 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-d181f85b-a093-488f-88f4-8ba40c29657a tempest-AttachVolumeNegativeTest-2108292208 tempest-AttachVolumeNegativeTest-2108292208-project-member] Lock "550c62a9-18b5-41bd-a129-322f6c297383" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.797s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:45:12 user nova-compute[85141]: DEBUG nova.compute.manager [req-0ffe27b8-44ba-4a2b-8aad-a0435a9369fa req-184c7943-6c1c-47e4-ad8c-a2580a61ec6b service nova] [instance: 550c62a9-18b5-41bd-a129-322f6c297383] Received event network-vif-plugged-867abc80-2539-48b6-9fe1-dae79e683a16 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:45:12 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-0ffe27b8-44ba-4a2b-8aad-a0435a9369fa req-184c7943-6c1c-47e4-ad8c-a2580a61ec6b service nova] Acquiring lock "550c62a9-18b5-41bd-a129-322f6c297383-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:45:12 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-0ffe27b8-44ba-4a2b-8aad-a0435a9369fa req-184c7943-6c1c-47e4-ad8c-a2580a61ec6b service nova] Lock "550c62a9-18b5-41bd-a129-322f6c297383-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:45:12 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-0ffe27b8-44ba-4a2b-8aad-a0435a9369fa req-184c7943-6c1c-47e4-ad8c-a2580a61ec6b service nova] Lock "550c62a9-18b5-41bd-a129-322f6c297383-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:45:12 user nova-compute[85141]: DEBUG nova.compute.manager [req-0ffe27b8-44ba-4a2b-8aad-a0435a9369fa req-184c7943-6c1c-47e4-ad8c-a2580a61ec6b service nova] [instance: 550c62a9-18b5-41bd-a129-322f6c297383] No waiting events found dispatching network-vif-plugged-867abc80-2539-48b6-9fe1-dae79e683a16 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:45:12 user nova-compute[85141]: WARNING nova.compute.manager [req-0ffe27b8-44ba-4a2b-8aad-a0435a9369fa req-184c7943-6c1c-47e4-ad8c-a2580a61ec6b service nova] [instance: 550c62a9-18b5-41bd-a129-322f6c297383] Received unexpected event network-vif-plugged-867abc80-2539-48b6-9fe1-dae79e683a16 for instance with vm_state deleted and task_state None.
Nov 16 10:45:15 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:45:20 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:45:25 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:45:30 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:45:35 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:45:40 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:45:43 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:45:45 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:45:48 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:45:48 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=85141) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 10:45:50 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:45:50 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:45:50 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=85141) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 10:45:50 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=85141) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 10:45:50 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=85141) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 10:45:50 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:45:51 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:45:51 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager.update_available_resource {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:45:51 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:45:51 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:45:51 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:45:51 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Auditing locally available compute resources for user (node: user) {{(pid=85141) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 10:45:51 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:45:51 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:45:51 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Hypervisor/Node resource view: name=user free_ram=9135MB free_disk=25.064891815185547GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=85141) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 10:45:51 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:45:51 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:45:51 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=85141) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 10:45:51 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=85141) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 10:45:51 user nova-compute[85141]: DEBUG nova.compute.provider_tree [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Inventory has not changed in ProviderTree for provider: bf8e0fa1-16b6-408f-9203-c4cd63916272 {{(pid=85141) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 10:45:51 user nova-compute[85141]: DEBUG nova.scheduler.client.report [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Inventory has not changed for provider bf8e0fa1-16b6-408f-9203-c4cd63916272 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=85141) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 10:45:51 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Compute_service record updated for user:user {{(pid=85141) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 10:45:51 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.133s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:45:52 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:45:53 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:45:53 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Starting heal instance info cache {{(pid=85141) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 10:45:53 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Rebuilding the list of instances to heal {{(pid=85141) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 10:45:53 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Didn't find any instances for network info cache update. {{(pid=85141) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 16 10:45:53 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:45:55 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:45:59 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:46:00 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:46:01 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:46:02 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:46:05 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:46:10 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:46:10 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:46:13 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:46:13 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:46:13 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:46:13 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:46:13 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:46:13 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:46:13 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:46:13 user nova-compute[85141]: DEBUG nova.virt.libvirt.imagecache [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Verify base images {{(pid=85141) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Nov 16 10:46:13 user nova-compute[85141]: WARNING nova.virt.libvirt.imagecache [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Unknown base file: /opt/stack/data/nova/instances/_base/ec12e90ba9ae825f62708439675163a77f1f8d61
Nov 16 10:46:13 user nova-compute[85141]: WARNING nova.virt.libvirt.imagecache [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Unknown base file: /opt/stack/data/nova/instances/_base/7e3d9019f7dd8ef3fdb6ca41a43cba4d9ba989b4
Nov 16 10:46:13 user nova-compute[85141]: WARNING nova.virt.libvirt.imagecache [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Unknown base file: /opt/stack/data/nova/instances/_base/406cc5a202afc266bb11ff5fcb0c435bca757503
Nov 16 10:46:13 user nova-compute[85141]: WARNING nova.virt.libvirt.imagecache [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Unknown base file: /opt/stack/data/nova/instances/_base/a1f7888919bcf90b1a285400ac888d0a386989df
Nov 16 10:46:13 user nova-compute[85141]: WARNING nova.virt.libvirt.imagecache [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Unknown base file: /opt/stack/data/nova/instances/_base/279e5d84701f1534a3df2996953f72e24e38b198
Nov 16 10:46:13 user nova-compute[85141]: WARNING nova.virt.libvirt.imagecache [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Unknown base file: /opt/stack/data/nova/instances/_base/cb4033c0fb0aba32891cc069d8e652296ef669a3
Nov 16 10:46:13 user nova-compute[85141]: WARNING nova.virt.libvirt.imagecache [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Unknown base file: /opt/stack/data/nova/instances/_base/ce98b520d29727ceaf7abcf900132a6167127ac5
Nov 16 10:46:13 user nova-compute[85141]: WARNING nova.virt.libvirt.imagecache [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Unknown base file: /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811
Nov 16 10:46:13 user nova-compute[85141]: WARNING nova.virt.libvirt.imagecache [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Unknown base file: /opt/stack/data/nova/instances/_base/dc77d73b0ba3d56bbe713f554d19b4dc21dd2abc
Nov 16 10:46:13 user nova-compute[85141]: WARNING nova.virt.libvirt.imagecache [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Unknown base file: /opt/stack/data/nova/instances/_base/55d6d40b0102aca79b96233adbd68dbdebe68921
Nov 16 10:46:13 user nova-compute[85141]: INFO nova.virt.libvirt.imagecache [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Removable base files: /opt/stack/data/nova/instances/_base/ec12e90ba9ae825f62708439675163a77f1f8d61 /opt/stack/data/nova/instances/_base/7e3d9019f7dd8ef3fdb6ca41a43cba4d9ba989b4 /opt/stack/data/nova/instances/_base/406cc5a202afc266bb11ff5fcb0c435bca757503 /opt/stack/data/nova/instances/_base/a1f7888919bcf90b1a285400ac888d0a386989df /opt/stack/data/nova/instances/_base/279e5d84701f1534a3df2996953f72e24e38b198 /opt/stack/data/nova/instances/_base/cb4033c0fb0aba32891cc069d8e652296ef669a3 /opt/stack/data/nova/instances/_base/ce98b520d29727ceaf7abcf900132a6167127ac5 /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 /opt/stack/data/nova/instances/_base/dc77d73b0ba3d56bbe713f554d19b4dc21dd2abc /opt/stack/data/nova/instances/_base/55d6d40b0102aca79b96233adbd68dbdebe68921
Nov 16 10:46:13 user nova-compute[85141]: INFO nova.virt.libvirt.imagecache [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/ec12e90ba9ae825f62708439675163a77f1f8d61
Nov 16 10:46:13 user nova-compute[85141]: INFO nova.virt.libvirt.imagecache [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/7e3d9019f7dd8ef3fdb6ca41a43cba4d9ba989b4
Nov 16 10:46:13 user nova-compute[85141]: INFO nova.virt.libvirt.imagecache [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/406cc5a202afc266bb11ff5fcb0c435bca757503
Nov 16 10:46:13 user nova-compute[85141]: INFO nova.virt.libvirt.imagecache [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/a1f7888919bcf90b1a285400ac888d0a386989df
Nov 16 10:46:13 user nova-compute[85141]: INFO nova.virt.libvirt.imagecache [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/279e5d84701f1534a3df2996953f72e24e38b198
Nov 16 10:46:13 user nova-compute[85141]: INFO nova.virt.libvirt.imagecache [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/cb4033c0fb0aba32891cc069d8e652296ef669a3
Nov 16 10:46:13 user nova-compute[85141]: INFO nova.virt.libvirt.imagecache [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/ce98b520d29727ceaf7abcf900132a6167127ac5
Nov 16 10:46:13 user nova-compute[85141]: INFO nova.virt.libvirt.imagecache [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811
Nov 16 10:46:13 user nova-compute[85141]: INFO nova.virt.libvirt.imagecache [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/dc77d73b0ba3d56bbe713f554d19b4dc21dd2abc
Nov 16 10:46:13 user nova-compute[85141]: INFO nova.virt.libvirt.imagecache [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/55d6d40b0102aca79b96233adbd68dbdebe68921
Nov 16 10:46:13 user nova-compute[85141]: DEBUG nova.virt.libvirt.imagecache [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Verification complete {{(pid=85141) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Nov 16 10:46:13 user nova-compute[85141]: DEBUG nova.virt.libvirt.imagecache [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Verify swap images {{(pid=85141) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Nov 16 10:46:13 user nova-compute[85141]: DEBUG nova.virt.libvirt.imagecache [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Verify ephemeral images {{(pid=85141) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Nov 16 10:46:15 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:46:20 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:46:25 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:46:30 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:46:35 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:46:40 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:46:40 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:46:40 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=85141) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 10:46:40 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=85141) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 10:46:40 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=85141) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 10:46:40 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:46:44 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:46:45 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:46:45 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:46:45 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=85141) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 10:46:45 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=85141) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 10:46:45 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=85141) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 10:46:45 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:46:50 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:46:50 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=85141) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 10:46:50 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:46:51 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:46:53 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager.update_available_resource {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:46:53 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:46:53 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:46:53 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:46:53 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Auditing locally available compute resources for user (node: user) {{(pid=85141) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 10:46:53 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:46:53 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:46:53 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Hypervisor/Node resource view: name=user free_ram=9146MB free_disk=25.062183380126953GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=85141) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 10:46:53 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:46:53 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:46:53 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=85141) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 10:46:53 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=85141) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 10:46:53 user nova-compute[85141]: DEBUG nova.scheduler.client.report [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Refreshing inventories for resource provider bf8e0fa1-16b6-408f-9203-c4cd63916272 {{(pid=85141) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 16 10:46:54 user nova-compute[85141]: DEBUG nova.scheduler.client.report [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Updating ProviderTree inventory for provider bf8e0fa1-16b6-408f-9203-c4cd63916272 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=85141) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 16 10:46:54 user nova-compute[85141]: DEBUG nova.compute.provider_tree [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Updating inventory in ProviderTree for provider bf8e0fa1-16b6-408f-9203-c4cd63916272 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=85141) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 16 10:46:54 user nova-compute[85141]: DEBUG nova.scheduler.client.report [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Refreshing aggregate associations for resource provider bf8e0fa1-16b6-408f-9203-c4cd63916272, aggregates: None {{(pid=85141) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 16 10:46:54 user nova-compute[85141]: DEBUG nova.scheduler.client.report [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Refreshing trait associations for resource provider bf8e0fa1-16b6-408f-9203-c4cd63916272, traits: COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE41,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_ACCELERATORS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_USB,COMPUTE_TRUSTED_CERTS,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_RESCUE_BFV,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VOLUME_ATTACH_WITH_TAG {{(pid=85141) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 16 10:46:54 user nova-compute[85141]: DEBUG nova.compute.provider_tree [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Inventory has not changed in ProviderTree for provider: bf8e0fa1-16b6-408f-9203-c4cd63916272 {{(pid=85141) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 10:46:54 user nova-compute[85141]: DEBUG nova.scheduler.client.report [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Inventory has not changed for provider bf8e0fa1-16b6-408f-9203-c4cd63916272 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=85141) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 10:46:54 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Compute_service record updated for user:user {{(pid=85141) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 10:46:54 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.423s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:46:54 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:46:54 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:46:54 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:46:54 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Cleaning up deleted instances with incomplete migration  {{(pid=85141) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 16 10:46:55 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:46:55 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Starting heal instance info cache {{(pid=85141) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 10:46:55 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Rebuilding the list of instances to heal {{(pid=85141) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 10:46:55 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Didn't find any instances for network info cache update. {{(pid=85141) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 16 10:46:55 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:46:55 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:46:57 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:46:57 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Cleaning up deleted instances {{(pid=85141) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 16 10:46:57 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] There are 0 instances to clean {{(pid=85141) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 16 10:46:57 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:47:00 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:47:01 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:47:03 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:47:05 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:47:10 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:47:10 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:47:10 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=85141) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 10:47:10 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=85141) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 10:47:10 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=85141) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 10:47:10 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:47:15 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:47:15 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:47:15 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=85141) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 10:47:15 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=85141) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 10:47:15 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=85141) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 10:47:15 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:47:18 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._sync_power_states {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:47:20 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:47:25 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:47:30 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:47:34 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:47:35 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:47:40 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:47:45 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:47:45 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:47:45 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:47:45 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=85141) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 10:47:45 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=85141) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 10:47:45 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=85141) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 10:47:45 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:47:50 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:47:50 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=85141) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 10:47:50 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:47:51 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:47:53 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager.update_available_resource {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:47:53 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:47:53 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:47:53 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:47:53 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Auditing locally available compute resources for user (node: user) {{(pid=85141) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 10:47:53 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:47:53 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:47:53 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Hypervisor/Node resource view: name=user free_ram=8776MB free_disk=25.051918029785156GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=85141) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 10:47:53 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:47:53 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:47:53 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=85141) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 10:47:53 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=85141) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 10:47:53 user nova-compute[85141]: DEBUG nova.compute.provider_tree [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Inventory has not changed in ProviderTree for provider: bf8e0fa1-16b6-408f-9203-c4cd63916272 {{(pid=85141) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 10:47:53 user nova-compute[85141]: DEBUG nova.scheduler.client.report [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Inventory has not changed for provider bf8e0fa1-16b6-408f-9203-c4cd63916272 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=85141) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 10:47:53 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Compute_service record updated for user:user {{(pid=85141) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 10:47:53 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.154s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:47:55 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:47:55 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:47:55 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Starting heal instance info cache {{(pid=85141) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 10:47:55 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Rebuilding the list of instances to heal {{(pid=85141) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 10:47:55 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Didn't find any instances for network info cache update. {{(pid=85141) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 16 10:47:55 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:47:57 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:47:59 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:48:00 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:48:01 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:48:02 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:48:03 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:48:04 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:48:05 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:48:06 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:48:08 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:48:09 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:48:10 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:48:13 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:48:15 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:48:15 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-84e93477-c804-49ea-94e6-792c7bd52853 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Acquiring lock "6c885751-2ce7-4071-9c9a-6149e2257400" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:48:15 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-84e93477-c804-49ea-94e6-792c7bd52853 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Lock "6c885751-2ce7-4071-9c9a-6149e2257400" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:48:15 user nova-compute[85141]: DEBUG nova.compute.manager [None req-84e93477-c804-49ea-94e6-792c7bd52853 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] [instance: 6c885751-2ce7-4071-9c9a-6149e2257400] Starting instance... {{(pid=85141) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 10:48:16 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-84e93477-c804-49ea-94e6-792c7bd52853 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:48:16 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-84e93477-c804-49ea-94e6-792c7bd52853 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:48:16 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-84e93477-c804-49ea-94e6-792c7bd52853 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=85141) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 10:48:16 user nova-compute[85141]: INFO nova.compute.claims [None req-84e93477-c804-49ea-94e6-792c7bd52853 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] [instance: 6c885751-2ce7-4071-9c9a-6149e2257400] Claim successful on node user
Nov 16 10:48:16 user nova-compute[85141]: DEBUG nova.compute.provider_tree [None req-84e93477-c804-49ea-94e6-792c7bd52853 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Inventory has not changed in ProviderTree for provider: bf8e0fa1-16b6-408f-9203-c4cd63916272 {{(pid=85141) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 10:48:16 user nova-compute[85141]: DEBUG nova.scheduler.client.report [None req-84e93477-c804-49ea-94e6-792c7bd52853 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Inventory has not changed for provider bf8e0fa1-16b6-408f-9203-c4cd63916272 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=85141) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 10:48:16 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-84e93477-c804-49ea-94e6-792c7bd52853 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.254s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:48:16 user nova-compute[85141]: DEBUG nova.compute.manager [None req-84e93477-c804-49ea-94e6-792c7bd52853 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] [instance: 6c885751-2ce7-4071-9c9a-6149e2257400] Start building networks asynchronously for instance. {{(pid=85141) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 10:48:16 user nova-compute[85141]: DEBUG nova.compute.manager [None req-84e93477-c804-49ea-94e6-792c7bd52853 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] [instance: 6c885751-2ce7-4071-9c9a-6149e2257400] Allocating IP information in the background. {{(pid=85141) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 10:48:16 user nova-compute[85141]: DEBUG nova.network.neutron [None req-84e93477-c804-49ea-94e6-792c7bd52853 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] [instance: 6c885751-2ce7-4071-9c9a-6149e2257400] allocate_for_instance() {{(pid=85141) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 10:48:16 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-84e93477-c804-49ea-94e6-792c7bd52853 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] [instance: 6c885751-2ce7-4071-9c9a-6149e2257400] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 10:48:16 user nova-compute[85141]: DEBUG nova.compute.manager [None req-84e93477-c804-49ea-94e6-792c7bd52853 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] [instance: 6c885751-2ce7-4071-9c9a-6149e2257400] Start building block device mappings for instance. {{(pid=85141) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 10:48:16 user nova-compute[85141]: DEBUG nova.compute.manager [None req-84e93477-c804-49ea-94e6-792c7bd52853 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] [instance: 6c885751-2ce7-4071-9c9a-6149e2257400] Start spawning the instance on the hypervisor. {{(pid=85141) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 10:48:16 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-84e93477-c804-49ea-94e6-792c7bd52853 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] [instance: 6c885751-2ce7-4071-9c9a-6149e2257400] Creating instance directory {{(pid=85141) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 10:48:16 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-84e93477-c804-49ea-94e6-792c7bd52853 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] [instance: 6c885751-2ce7-4071-9c9a-6149e2257400] Creating image(s)
Nov 16 10:48:16 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-84e93477-c804-49ea-94e6-792c7bd52853 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Acquiring lock "/opt/stack/data/nova/instances/6c885751-2ce7-4071-9c9a-6149e2257400/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:48:16 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-84e93477-c804-49ea-94e6-792c7bd52853 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Lock "/opt/stack/data/nova/instances/6c885751-2ce7-4071-9c9a-6149e2257400/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:48:16 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-84e93477-c804-49ea-94e6-792c7bd52853 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Lock "/opt/stack/data/nova/instances/6c885751-2ce7-4071-9c9a-6149e2257400/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:48:16 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-84e93477-c804-49ea-94e6-792c7bd52853 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:48:16 user nova-compute[85141]: DEBUG nova.policy [None req-84e93477-c804-49ea-94e6-792c7bd52853 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b657faf92df249b18eab4b1c7e4ca8d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df4af3f598d04f9a91f54796780cf8ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85141) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 10:48:16 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-84e93477-c804-49ea-94e6-792c7bd52853 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json" returned: 0 in 0.182s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:48:16 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-84e93477-c804-49ea-94e6-792c7bd52853 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Acquiring lock "60a78556fb399ed4a41bc3ca4bccf77c96d8e811" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:48:16 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-84e93477-c804-49ea-94e6-792c7bd52853 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Lock "60a78556fb399ed4a41bc3ca4bccf77c96d8e811" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:48:16 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-84e93477-c804-49ea-94e6-792c7bd52853 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:48:17 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-84e93477-c804-49ea-94e6-792c7bd52853 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json" returned: 0 in 0.198s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:48:17 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-84e93477-c804-49ea-94e6-792c7bd52853 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811,backing_fmt=raw /opt/stack/data/nova/instances/6c885751-2ce7-4071-9c9a-6149e2257400/disk 1073741824 {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:48:17 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-84e93477-c804-49ea-94e6-792c7bd52853 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811,backing_fmt=raw /opt/stack/data/nova/instances/6c885751-2ce7-4071-9c9a-6149e2257400/disk 1073741824" returned: 0 in 0.052s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:48:17 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-84e93477-c804-49ea-94e6-792c7bd52853 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Lock "60a78556fb399ed4a41bc3ca4bccf77c96d8e811" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.257s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:48:17 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-84e93477-c804-49ea-94e6-792c7bd52853 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:48:17 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-84e93477-c804-49ea-94e6-792c7bd52853 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60a78556fb399ed4a41bc3ca4bccf77c96d8e811 --force-share --output=json" returned: 0 in 0.193s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:48:17 user nova-compute[85141]: DEBUG nova.virt.disk.api [None req-84e93477-c804-49ea-94e6-792c7bd52853 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6c885751-2ce7-4071-9c9a-6149e2257400/disk. size=1073741824 {{(pid=85141) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 10:48:17 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-84e93477-c804-49ea-94e6-792c7bd52853 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c885751-2ce7-4071-9c9a-6149e2257400/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:48:17 user nova-compute[85141]: DEBUG nova.network.neutron [None req-84e93477-c804-49ea-94e6-792c7bd52853 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] [instance: 6c885751-2ce7-4071-9c9a-6149e2257400] Successfully created port: cffa62e2-3832-4bee-bb7c-f206e6cabf91 {{(pid=85141) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 10:48:17 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-84e93477-c804-49ea-94e6-792c7bd52853 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c885751-2ce7-4071-9c9a-6149e2257400/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:48:17 user nova-compute[85141]: DEBUG nova.virt.disk.api [None req-84e93477-c804-49ea-94e6-792c7bd52853 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Cannot resize image /opt/stack/data/nova/instances/6c885751-2ce7-4071-9c9a-6149e2257400/disk to a smaller size. {{(pid=85141) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 10:48:17 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-84e93477-c804-49ea-94e6-792c7bd52853 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] [instance: 6c885751-2ce7-4071-9c9a-6149e2257400] Created local disks {{(pid=85141) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 10:48:17 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-84e93477-c804-49ea-94e6-792c7bd52853 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] [instance: 6c885751-2ce7-4071-9c9a-6149e2257400] Ensure instance console log exists: /opt/stack/data/nova/instances/6c885751-2ce7-4071-9c9a-6149e2257400/console.log {{(pid=85141) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 10:48:17 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-84e93477-c804-49ea-94e6-792c7bd52853 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:48:17 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-84e93477-c804-49ea-94e6-792c7bd52853 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:48:17 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-84e93477-c804-49ea-94e6-792c7bd52853 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:48:18 user nova-compute[85141]: DEBUG nova.network.neutron [None req-84e93477-c804-49ea-94e6-792c7bd52853 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] [instance: 6c885751-2ce7-4071-9c9a-6149e2257400] Successfully updated port: cffa62e2-3832-4bee-bb7c-f206e6cabf91 {{(pid=85141) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 10:48:18 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-84e93477-c804-49ea-94e6-792c7bd52853 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Acquiring lock "refresh_cache-6c885751-2ce7-4071-9c9a-6149e2257400" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:48:18 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-84e93477-c804-49ea-94e6-792c7bd52853 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Acquired lock "refresh_cache-6c885751-2ce7-4071-9c9a-6149e2257400" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:48:18 user nova-compute[85141]: DEBUG nova.network.neutron [None req-84e93477-c804-49ea-94e6-792c7bd52853 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] [instance: 6c885751-2ce7-4071-9c9a-6149e2257400] Building network info cache for instance {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 10:48:18 user nova-compute[85141]: DEBUG nova.compute.manager [req-bb6aa4fe-bf77-4919-bcc6-453f5a06bf14 req-b87e0e1f-c075-4d68-acc0-47381398c9ea service nova] [instance: 6c885751-2ce7-4071-9c9a-6149e2257400] Received event network-changed-cffa62e2-3832-4bee-bb7c-f206e6cabf91 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:48:18 user nova-compute[85141]: DEBUG nova.compute.manager [req-bb6aa4fe-bf77-4919-bcc6-453f5a06bf14 req-b87e0e1f-c075-4d68-acc0-47381398c9ea service nova] [instance: 6c885751-2ce7-4071-9c9a-6149e2257400] Refreshing instance network info cache due to event network-changed-cffa62e2-3832-4bee-bb7c-f206e6cabf91. {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 10:48:18 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-bb6aa4fe-bf77-4919-bcc6-453f5a06bf14 req-b87e0e1f-c075-4d68-acc0-47381398c9ea service nova] Acquiring lock "refresh_cache-6c885751-2ce7-4071-9c9a-6149e2257400" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:48:18 user nova-compute[85141]: DEBUG nova.network.neutron [None req-84e93477-c804-49ea-94e6-792c7bd52853 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] [instance: 6c885751-2ce7-4071-9c9a-6149e2257400] Instance cache missing network info. {{(pid=85141) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 10:48:18 user nova-compute[85141]: DEBUG nova.network.neutron [None req-84e93477-c804-49ea-94e6-792c7bd52853 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] [instance: 6c885751-2ce7-4071-9c9a-6149e2257400] Updating instance_info_cache with network_info: [{"id": "cffa62e2-3832-4bee-bb7c-f206e6cabf91", "address": "fa:16:3e:f6:ac:89", "network": {"id": "fd841f36-a23e-4993-8eab-ddc78f99e358", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1240531518-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df4af3f598d04f9a91f54796780cf8ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcffa62e2-38", "ovs_interfaceid": "cffa62e2-3832-4bee-bb7c-f206e6cabf91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:48:18 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-84e93477-c804-49ea-94e6-792c7bd52853 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Releasing lock "refresh_cache-6c885751-2ce7-4071-9c9a-6149e2257400" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:48:18 user nova-compute[85141]: DEBUG nova.compute.manager [None req-84e93477-c804-49ea-94e6-792c7bd52853 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] [instance: 6c885751-2ce7-4071-9c9a-6149e2257400] Instance network_info: |[{"id": "cffa62e2-3832-4bee-bb7c-f206e6cabf91", "address": "fa:16:3e:f6:ac:89", "network": {"id": "fd841f36-a23e-4993-8eab-ddc78f99e358", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1240531518-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df4af3f598d04f9a91f54796780cf8ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcffa62e2-38", "ovs_interfaceid": "cffa62e2-3832-4bee-bb7c-f206e6cabf91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=85141) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 10:48:18 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-bb6aa4fe-bf77-4919-bcc6-453f5a06bf14 req-b87e0e1f-c075-4d68-acc0-47381398c9ea service nova] Acquired lock "refresh_cache-6c885751-2ce7-4071-9c9a-6149e2257400" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:48:18 user nova-compute[85141]: DEBUG nova.network.neutron [req-bb6aa4fe-bf77-4919-bcc6-453f5a06bf14 req-b87e0e1f-c075-4d68-acc0-47381398c9ea service nova] [instance: 6c885751-2ce7-4071-9c9a-6149e2257400] Refreshing network info cache for port cffa62e2-3832-4bee-bb7c-f206e6cabf91 {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 10:48:18 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-84e93477-c804-49ea-94e6-792c7bd52853 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] [instance: 6c885751-2ce7-4071-9c9a-6149e2257400] Start _get_guest_xml network_info=[{"id": "cffa62e2-3832-4bee-bb7c-f206e6cabf91", "address": "fa:16:3e:f6:ac:89", "network": {"id": "fd841f36-a23e-4993-8eab-ddc78f99e358", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1240531518-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df4af3f598d04f9a91f54796780cf8ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcffa62e2-38", "ovs_interfaceid": "cffa62e2-3832-4bee-bb7c-f206e6cabf91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T10:06:42Z,direct_url=<?>,disk_format='qcow2',id=bc4ca70f-a459-4d5c-a9e6-80f1948eb48b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1044631a5fe84ce8904864a7024049fa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T10:06:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'encrypted': False, 'encryption_options': None, 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'image_id': 'bc4ca70f-a459-4d5c-a9e6-80f1948eb48b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=85141) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 10:48:18 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-84e93477-c804-49ea-94e6-792c7bd52853 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:48:18 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-84e93477-c804-49ea-94e6-792c7bd52853 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:48:18 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-84e93477-c804-49ea-94e6-792c7bd52853 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=85141) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 10:48:18 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-84e93477-c804-49ea-94e6-792c7bd52853 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] CPU controller missing on host. {{(pid=85141) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 10:48:18 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-84e93477-c804-49ea-94e6-792c7bd52853 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=85141) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 10:48:18 user nova-compute[85141]: DEBUG nova.virt.libvirt.host [None req-84e93477-c804-49ea-94e6-792c7bd52853 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] CPU controller found on host. {{(pid=85141) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 10:48:18 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-84e93477-c804-49ea-94e6-792c7bd52853 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=85141) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 10:48:18 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-84e93477-c804-49ea-94e6-792c7bd52853 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T10:06:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T10:06:42Z,direct_url=<?>,disk_format='qcow2',id=bc4ca70f-a459-4d5c-a9e6-80f1948eb48b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='1044631a5fe84ce8904864a7024049fa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T10:06:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 10:48:18 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-84e93477-c804-49ea-94e6-792c7bd52853 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Flavor limits 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 10:48:18 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-84e93477-c804-49ea-94e6-792c7bd52853 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Image limits 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 10:48:18 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-84e93477-c804-49ea-94e6-792c7bd52853 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Flavor pref 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 10:48:18 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-84e93477-c804-49ea-94e6-792c7bd52853 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Image pref 0:0:0 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 10:48:18 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-84e93477-c804-49ea-94e6-792c7bd52853 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=85141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 10:48:18 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-84e93477-c804-49ea-94e6-792c7bd52853 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 10:48:18 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-84e93477-c804-49ea-94e6-792c7bd52853 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=85141) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 10:48:18 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-84e93477-c804-49ea-94e6-792c7bd52853 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Got 1 possible topologies {{(pid=85141) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 10:48:18 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-84e93477-c804-49ea-94e6-792c7bd52853 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 10:48:18 user nova-compute[85141]: DEBUG nova.virt.hardware [None req-84e93477-c804-49ea-94e6-792c7bd52853 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=85141) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 10:48:18 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-84e93477-c804-49ea-94e6-792c7bd52853 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T10:48:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1555667287',display_name='tempest-SnapshotDataIntegrityTests-server-1555667287',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1555667287',id=53,image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIYkWl9dnYD6Uyjw7myivQgiP0hW+BMObrpLM6mM0upEloDRTQzy96cA+Nch7WI8/cCOFHs1oMqxRQ9QRtEO2FUiHDC7DdRWEB9/umVXebdciojkbfx0duo4irCvtxMqtw==',key_name='tempest-keypair-1682224209',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='df4af3f598d04f9a91f54796780cf8ce',ramdisk_id='',reservation_id='r-d3w8bwjo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1055132496',owner_user_name='tempest-SnapshotDataIntegrityTests-1055132496-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T10:48:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b657faf92df249b18eab4b1c7e4ca8d4',uuid=6c885751-2ce7-4071-9c9a-6149e2257400,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cffa62e2-3832-4bee-bb7c-f206e6cabf91", "address": "fa:16:3e:f6:ac:89", "network": {"id": "fd841f36-a23e-4993-8eab-ddc78f99e358", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1240531518-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df4af3f598d04f9a91f54796780cf8ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcffa62e2-38", "ovs_interfaceid": "cffa62e2-3832-4bee-bb7c-f206e6cabf91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=85141) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 10:48:18 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-84e93477-c804-49ea-94e6-792c7bd52853 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Converting VIF {"id": "cffa62e2-3832-4bee-bb7c-f206e6cabf91", "address": "fa:16:3e:f6:ac:89", "network": {"id": "fd841f36-a23e-4993-8eab-ddc78f99e358", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1240531518-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df4af3f598d04f9a91f54796780cf8ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcffa62e2-38", "ovs_interfaceid": "cffa62e2-3832-4bee-bb7c-f206e6cabf91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:48:18 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-84e93477-c804-49ea-94e6-792c7bd52853 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:ac:89,bridge_name='br-int',has_traffic_filtering=True,id=cffa62e2-3832-4bee-bb7c-f206e6cabf91,network=Network(fd841f36-a23e-4993-8eab-ddc78f99e358),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcffa62e2-38') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:48:18 user nova-compute[85141]: DEBUG nova.objects.instance [None req-84e93477-c804-49ea-94e6-792c7bd52853 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Lazy-loading 'pci_devices' on Instance uuid 6c885751-2ce7-4071-9c9a-6149e2257400 {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:48:18 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-84e93477-c804-49ea-94e6-792c7bd52853 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] [instance: 6c885751-2ce7-4071-9c9a-6149e2257400] End _get_guest_xml xml=<domain type="kvm">
Nov 16 10:48:18 user nova-compute[85141]:   <uuid>6c885751-2ce7-4071-9c9a-6149e2257400</uuid>
Nov 16 10:48:18 user nova-compute[85141]:   <name>instance-00000035</name>
Nov 16 10:48:18 user nova-compute[85141]:   <memory>524288</memory>
Nov 16 10:48:18 user nova-compute[85141]:   <vcpu>1</vcpu>
Nov 16 10:48:18 user nova-compute[85141]:   <metadata>
Nov 16 10:48:18 user nova-compute[85141]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 10:48:18 user nova-compute[85141]:       <nova:package version="0.0.0"/>
Nov 16 10:48:18 user nova-compute[85141]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-1555667287</nova:name>
Nov 16 10:48:18 user nova-compute[85141]:       <nova:creationTime>2023-11-16 10:48:18</nova:creationTime>
Nov 16 10:48:18 user nova-compute[85141]:       <nova:flavor name="m1.tiny">
Nov 16 10:48:18 user nova-compute[85141]:         <nova:memory>512</nova:memory>
Nov 16 10:48:18 user nova-compute[85141]:         <nova:disk>1</nova:disk>
Nov 16 10:48:18 user nova-compute[85141]:         <nova:swap>0</nova:swap>
Nov 16 10:48:18 user nova-compute[85141]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 10:48:18 user nova-compute[85141]:         <nova:vcpus>1</nova:vcpus>
Nov 16 10:48:18 user nova-compute[85141]:       </nova:flavor>
Nov 16 10:48:18 user nova-compute[85141]:       <nova:owner>
Nov 16 10:48:18 user nova-compute[85141]:         <nova:user uuid="b657faf92df249b18eab4b1c7e4ca8d4">tempest-SnapshotDataIntegrityTests-1055132496-project-member</nova:user>
Nov 16 10:48:18 user nova-compute[85141]:         <nova:project uuid="df4af3f598d04f9a91f54796780cf8ce">tempest-SnapshotDataIntegrityTests-1055132496</nova:project>
Nov 16 10:48:18 user nova-compute[85141]:       </nova:owner>
Nov 16 10:48:18 user nova-compute[85141]:       <nova:root type="image" uuid="bc4ca70f-a459-4d5c-a9e6-80f1948eb48b"/>
Nov 16 10:48:18 user nova-compute[85141]:       <nova:ports>
Nov 16 10:48:18 user nova-compute[85141]:         <nova:port uuid="cffa62e2-3832-4bee-bb7c-f206e6cabf91">
Nov 16 10:48:18 user nova-compute[85141]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 16 10:48:18 user nova-compute[85141]:         </nova:port>
Nov 16 10:48:18 user nova-compute[85141]:       </nova:ports>
Nov 16 10:48:18 user nova-compute[85141]:     </nova:instance>
Nov 16 10:48:18 user nova-compute[85141]:   </metadata>
Nov 16 10:48:18 user nova-compute[85141]:   <sysinfo type="smbios">
Nov 16 10:48:18 user nova-compute[85141]:     <system>
Nov 16 10:48:18 user nova-compute[85141]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 10:48:18 user nova-compute[85141]:       <entry name="product">OpenStack Nova</entry>
Nov 16 10:48:18 user nova-compute[85141]:       <entry name="version">0.0.0</entry>
Nov 16 10:48:18 user nova-compute[85141]:       <entry name="serial">6c885751-2ce7-4071-9c9a-6149e2257400</entry>
Nov 16 10:48:18 user nova-compute[85141]:       <entry name="uuid">6c885751-2ce7-4071-9c9a-6149e2257400</entry>
Nov 16 10:48:18 user nova-compute[85141]:       <entry name="family">Virtual Machine</entry>
Nov 16 10:48:18 user nova-compute[85141]:     </system>
Nov 16 10:48:18 user nova-compute[85141]:   </sysinfo>
Nov 16 10:48:18 user nova-compute[85141]:   <os>
Nov 16 10:48:18 user nova-compute[85141]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 10:48:18 user nova-compute[85141]:     <boot dev="hd"/>
Nov 16 10:48:18 user nova-compute[85141]:     <smbios mode="sysinfo"/>
Nov 16 10:48:18 user nova-compute[85141]:   </os>
Nov 16 10:48:18 user nova-compute[85141]:   <features>
Nov 16 10:48:18 user nova-compute[85141]:     <acpi/>
Nov 16 10:48:18 user nova-compute[85141]:     <apic/>
Nov 16 10:48:18 user nova-compute[85141]:     <vmcoreinfo/>
Nov 16 10:48:18 user nova-compute[85141]:   </features>
Nov 16 10:48:18 user nova-compute[85141]:   <clock offset="utc">
Nov 16 10:48:18 user nova-compute[85141]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 10:48:18 user nova-compute[85141]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 10:48:18 user nova-compute[85141]:     <timer name="hpet" present="no"/>
Nov 16 10:48:18 user nova-compute[85141]:   </clock>
Nov 16 10:48:18 user nova-compute[85141]:   <cpu mode="custom" match="exact">
Nov 16 10:48:18 user nova-compute[85141]:     <model>Nehalem</model>
Nov 16 10:48:18 user nova-compute[85141]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 10:48:18 user nova-compute[85141]:   </cpu>
Nov 16 10:48:18 user nova-compute[85141]:   <devices>
Nov 16 10:48:18 user nova-compute[85141]:     <disk type="file" device="disk">
Nov 16 10:48:18 user nova-compute[85141]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 10:48:18 user nova-compute[85141]:       <source file="/opt/stack/data/nova/instances/6c885751-2ce7-4071-9c9a-6149e2257400/disk"/>
Nov 16 10:48:18 user nova-compute[85141]:       <target dev="vda" bus="virtio"/>
Nov 16 10:48:18 user nova-compute[85141]:     </disk>
Nov 16 10:48:18 user nova-compute[85141]:     <interface type="ethernet">
Nov 16 10:48:18 user nova-compute[85141]:       <mac address="fa:16:3e:f6:ac:89"/>
Nov 16 10:48:18 user nova-compute[85141]:       <model type="virtio"/>
Nov 16 10:48:18 user nova-compute[85141]:       <mtu size="1442"/>
Nov 16 10:48:18 user nova-compute[85141]:       <target dev="tapcffa62e2-38"/>
Nov 16 10:48:18 user nova-compute[85141]:     </interface>
Nov 16 10:48:18 user nova-compute[85141]:     <serial type="pty">
Nov 16 10:48:18 user nova-compute[85141]:       <log file="/opt/stack/data/nova/instances/6c885751-2ce7-4071-9c9a-6149e2257400/console.log" append="off"/>
Nov 16 10:48:18 user nova-compute[85141]:     </serial>
Nov 16 10:48:18 user nova-compute[85141]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 10:48:18 user nova-compute[85141]:     <video>
Nov 16 10:48:18 user nova-compute[85141]:       <model type="virtio"/>
Nov 16 10:48:18 user nova-compute[85141]:     </video>
Nov 16 10:48:18 user nova-compute[85141]:     <rng model="virtio">
Nov 16 10:48:18 user nova-compute[85141]:       <backend model="random">/dev/urandom</backend>
Nov 16 10:48:18 user nova-compute[85141]:     </rng>
Nov 16 10:48:18 user nova-compute[85141]:     <controller type="usb" index="0" model="none"/>
Nov 16 10:48:18 user nova-compute[85141]:     <memballoon model="virtio">
Nov 16 10:48:18 user nova-compute[85141]:       <stats period="10"/>
Nov 16 10:48:18 user nova-compute[85141]:     </memballoon>
Nov 16 10:48:18 user nova-compute[85141]:   </devices>
Nov 16 10:48:18 user nova-compute[85141]: </domain>
Nov 16 10:48:18 user nova-compute[85141]:  {{(pid=85141) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 10:48:18 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-84e93477-c804-49ea-94e6-792c7bd52853 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T10:48:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1555667287',display_name='tempest-SnapshotDataIntegrityTests-server-1555667287',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1555667287',id=53,image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIYkWl9dnYD6Uyjw7myivQgiP0hW+BMObrpLM6mM0upEloDRTQzy96cA+Nch7WI8/cCOFHs1oMqxRQ9QRtEO2FUiHDC7DdRWEB9/umVXebdciojkbfx0duo4irCvtxMqtw==',key_name='tempest-keypair-1682224209',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='df4af3f598d04f9a91f54796780cf8ce',ramdisk_id='',reservation_id='r-d3w8bwjo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1055132496',owner_user_name='tempest-SnapshotDataIntegrityTests-1055132496-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T10:48:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b657faf92df249b18eab4b1c7e4ca8d4',uuid=6c885751-2ce7-4071-9c9a-6149e2257400,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cffa62e2-3832-4bee-bb7c-f206e6cabf91", "address": "fa:16:3e:f6:ac:89", "network": {"id": "fd841f36-a23e-4993-8eab-ddc78f99e358", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1240531518-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df4af3f598d04f9a91f54796780cf8ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcffa62e2-38", "ovs_interfaceid": "cffa62e2-3832-4bee-bb7c-f206e6cabf91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 10:48:18 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-84e93477-c804-49ea-94e6-792c7bd52853 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Converting VIF {"id": "cffa62e2-3832-4bee-bb7c-f206e6cabf91", "address": "fa:16:3e:f6:ac:89", "network": {"id": "fd841f36-a23e-4993-8eab-ddc78f99e358", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1240531518-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df4af3f598d04f9a91f54796780cf8ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcffa62e2-38", "ovs_interfaceid": "cffa62e2-3832-4bee-bb7c-f206e6cabf91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:48:18 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-84e93477-c804-49ea-94e6-792c7bd52853 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:ac:89,bridge_name='br-int',has_traffic_filtering=True,id=cffa62e2-3832-4bee-bb7c-f206e6cabf91,network=Network(fd841f36-a23e-4993-8eab-ddc78f99e358),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcffa62e2-38') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:48:18 user nova-compute[85141]: DEBUG os_vif [None req-84e93477-c804-49ea-94e6-792c7bd52853 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:ac:89,bridge_name='br-int',has_traffic_filtering=True,id=cffa62e2-3832-4bee-bb7c-f206e6cabf91,network=Network(fd841f36-a23e-4993-8eab-ddc78f99e358),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcffa62e2-38') {{(pid=85141) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 10:48:18 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:48:18 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:48:18 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 10:48:18 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:48:18 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6d2154df-5179-5a42-a5bd-5e2f7e2e91cc', '_type': 'linux-noop'}}, row=False) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:48:18 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:48:18 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:48:18 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:48:18 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcffa62e2-38, may_exist=True, interface_attrs={}) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:48:18 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcffa62e2-38, col_values=(('qos', UUID('96954ed8-a921-4d3d-98c8-38e4bc0a72e8')),), if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:48:18 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcffa62e2-38, col_values=(('external_ids', {'iface-id': 'cffa62e2-3832-4bee-bb7c-f206e6cabf91', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f6:ac:89', 'vm-uuid': '6c885751-2ce7-4071-9c9a-6149e2257400'}),), if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:48:18 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:48:18 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:48:18 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:48:18 user nova-compute[85141]: INFO os_vif [None req-84e93477-c804-49ea-94e6-792c7bd52853 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:ac:89,bridge_name='br-int',has_traffic_filtering=True,id=cffa62e2-3832-4bee-bb7c-f206e6cabf91,network=Network(fd841f36-a23e-4993-8eab-ddc78f99e358),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcffa62e2-38')
Nov 16 10:48:18 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-84e93477-c804-49ea-94e6-792c7bd52853 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] No BDM found with device name vda, not building metadata. {{(pid=85141) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 10:48:18 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-84e93477-c804-49ea-94e6-792c7bd52853 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] No VIF found with MAC fa:16:3e:f6:ac:89, not building metadata {{(pid=85141) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 10:48:18 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:48:18 user nova-compute[85141]: DEBUG nova.network.neutron [req-bb6aa4fe-bf77-4919-bcc6-453f5a06bf14 req-b87e0e1f-c075-4d68-acc0-47381398c9ea service nova] [instance: 6c885751-2ce7-4071-9c9a-6149e2257400] Updated VIF entry in instance network info cache for port cffa62e2-3832-4bee-bb7c-f206e6cabf91. {{(pid=85141) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 10:48:18 user nova-compute[85141]: DEBUG nova.network.neutron [req-bb6aa4fe-bf77-4919-bcc6-453f5a06bf14 req-b87e0e1f-c075-4d68-acc0-47381398c9ea service nova] [instance: 6c885751-2ce7-4071-9c9a-6149e2257400] Updating instance_info_cache with network_info: [{"id": "cffa62e2-3832-4bee-bb7c-f206e6cabf91", "address": "fa:16:3e:f6:ac:89", "network": {"id": "fd841f36-a23e-4993-8eab-ddc78f99e358", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1240531518-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df4af3f598d04f9a91f54796780cf8ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcffa62e2-38", "ovs_interfaceid": "cffa62e2-3832-4bee-bb7c-f206e6cabf91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:48:18 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-bb6aa4fe-bf77-4919-bcc6-453f5a06bf14 req-b87e0e1f-c075-4d68-acc0-47381398c9ea service nova] Releasing lock "refresh_cache-6c885751-2ce7-4071-9c9a-6149e2257400" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:48:20 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:48:20 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:48:20 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:48:20 user nova-compute[85141]: DEBUG nova.compute.manager [req-c0e133b8-0809-4db4-b611-6d6fb483b44c req-cafc832f-b05f-4a1f-9975-7888e9ad7265 service nova] [instance: 6c885751-2ce7-4071-9c9a-6149e2257400] Received event network-vif-plugged-cffa62e2-3832-4bee-bb7c-f206e6cabf91 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:48:20 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-c0e133b8-0809-4db4-b611-6d6fb483b44c req-cafc832f-b05f-4a1f-9975-7888e9ad7265 service nova] Acquiring lock "6c885751-2ce7-4071-9c9a-6149e2257400-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:48:20 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-c0e133b8-0809-4db4-b611-6d6fb483b44c req-cafc832f-b05f-4a1f-9975-7888e9ad7265 service nova] Lock "6c885751-2ce7-4071-9c9a-6149e2257400-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:48:20 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-c0e133b8-0809-4db4-b611-6d6fb483b44c req-cafc832f-b05f-4a1f-9975-7888e9ad7265 service nova] Lock "6c885751-2ce7-4071-9c9a-6149e2257400-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:48:20 user nova-compute[85141]: DEBUG nova.compute.manager [req-c0e133b8-0809-4db4-b611-6d6fb483b44c req-cafc832f-b05f-4a1f-9975-7888e9ad7265 service nova] [instance: 6c885751-2ce7-4071-9c9a-6149e2257400] No waiting events found dispatching network-vif-plugged-cffa62e2-3832-4bee-bb7c-f206e6cabf91 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:48:20 user nova-compute[85141]: WARNING nova.compute.manager [req-c0e133b8-0809-4db4-b611-6d6fb483b44c req-cafc832f-b05f-4a1f-9975-7888e9ad7265 service nova] [instance: 6c885751-2ce7-4071-9c9a-6149e2257400] Received unexpected event network-vif-plugged-cffa62e2-3832-4bee-bb7c-f206e6cabf91 for instance with vm_state building and task_state spawning.
Nov 16 10:48:20 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:48:20 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:48:20 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:48:22 user nova-compute[85141]: DEBUG nova.compute.manager [None req-84e93477-c804-49ea-94e6-792c7bd52853 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] [instance: 6c885751-2ce7-4071-9c9a-6149e2257400] Instance event wait completed in 0 seconds for  {{(pid=85141) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 10:48:22 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-84e93477-c804-49ea-94e6-792c7bd52853 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] [instance: 6c885751-2ce7-4071-9c9a-6149e2257400] Guest created on hypervisor {{(pid=85141) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 10:48:22 user nova-compute[85141]: INFO nova.virt.libvirt.driver [-] [instance: 6c885751-2ce7-4071-9c9a-6149e2257400] Instance spawned successfully.
Nov 16 10:48:22 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-84e93477-c804-49ea-94e6-792c7bd52853 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] [instance: 6c885751-2ce7-4071-9c9a-6149e2257400] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 10:48:22 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-84e93477-c804-49ea-94e6-792c7bd52853 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] [instance: 6c885751-2ce7-4071-9c9a-6149e2257400] Found default for hw_cdrom_bus of ide {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:48:22 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-84e93477-c804-49ea-94e6-792c7bd52853 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] [instance: 6c885751-2ce7-4071-9c9a-6149e2257400] Found default for hw_disk_bus of virtio {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:48:22 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-84e93477-c804-49ea-94e6-792c7bd52853 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] [instance: 6c885751-2ce7-4071-9c9a-6149e2257400] Found default for hw_input_bus of None {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:48:22 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-84e93477-c804-49ea-94e6-792c7bd52853 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] [instance: 6c885751-2ce7-4071-9c9a-6149e2257400] Found default for hw_pointer_model of None {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:48:22 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-84e93477-c804-49ea-94e6-792c7bd52853 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] [instance: 6c885751-2ce7-4071-9c9a-6149e2257400] Found default for hw_video_model of virtio {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:48:22 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-84e93477-c804-49ea-94e6-792c7bd52853 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] [instance: 6c885751-2ce7-4071-9c9a-6149e2257400] Found default for hw_vif_model of virtio {{(pid=85141) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 10:48:22 user nova-compute[85141]: DEBUG nova.compute.manager [req-d903a938-5e3e-413e-97ef-f212f8a3ceb0 req-c5d06459-786e-490d-a461-7f59bf5d5d41 service nova] [instance: 6c885751-2ce7-4071-9c9a-6149e2257400] Received event network-vif-plugged-cffa62e2-3832-4bee-bb7c-f206e6cabf91 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:48:22 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-d903a938-5e3e-413e-97ef-f212f8a3ceb0 req-c5d06459-786e-490d-a461-7f59bf5d5d41 service nova] Acquiring lock "6c885751-2ce7-4071-9c9a-6149e2257400-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:48:22 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-d903a938-5e3e-413e-97ef-f212f8a3ceb0 req-c5d06459-786e-490d-a461-7f59bf5d5d41 service nova] Lock "6c885751-2ce7-4071-9c9a-6149e2257400-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:48:22 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-d903a938-5e3e-413e-97ef-f212f8a3ceb0 req-c5d06459-786e-490d-a461-7f59bf5d5d41 service nova] Lock "6c885751-2ce7-4071-9c9a-6149e2257400-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:48:22 user nova-compute[85141]: DEBUG nova.compute.manager [req-d903a938-5e3e-413e-97ef-f212f8a3ceb0 req-c5d06459-786e-490d-a461-7f59bf5d5d41 service nova] [instance: 6c885751-2ce7-4071-9c9a-6149e2257400] No waiting events found dispatching network-vif-plugged-cffa62e2-3832-4bee-bb7c-f206e6cabf91 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:48:22 user nova-compute[85141]: WARNING nova.compute.manager [req-d903a938-5e3e-413e-97ef-f212f8a3ceb0 req-c5d06459-786e-490d-a461-7f59bf5d5d41 service nova] [instance: 6c885751-2ce7-4071-9c9a-6149e2257400] Received unexpected event network-vif-plugged-cffa62e2-3832-4bee-bb7c-f206e6cabf91 for instance with vm_state building and task_state spawning.
Nov 16 10:48:22 user nova-compute[85141]: INFO nova.compute.manager [None req-84e93477-c804-49ea-94e6-792c7bd52853 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] [instance: 6c885751-2ce7-4071-9c9a-6149e2257400] Took 5.85 seconds to spawn the instance on the hypervisor.
Nov 16 10:48:22 user nova-compute[85141]: DEBUG nova.compute.manager [None req-84e93477-c804-49ea-94e6-792c7bd52853 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] [instance: 6c885751-2ce7-4071-9c9a-6149e2257400] Checking state {{(pid=85141) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 10:48:22 user nova-compute[85141]: INFO nova.compute.manager [None req-84e93477-c804-49ea-94e6-792c7bd52853 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] [instance: 6c885751-2ce7-4071-9c9a-6149e2257400] Took 6.62 seconds to build instance.
Nov 16 10:48:22 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-84e93477-c804-49ea-94e6-792c7bd52853 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Lock "6c885751-2ce7-4071-9c9a-6149e2257400" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.748s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:48:23 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:48:23 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:48:28 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:48:33 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:48:33 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:48:35 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:48:38 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:48:38 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:48:43 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:48:43 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:48:47 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:48:48 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:48:48 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:48:51 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:48:51 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=85141) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 10:48:53 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:48:53 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:48:53 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:48:55 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:48:55 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:48:55 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager.update_available_resource {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:48:55 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:48:55 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:48:55 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:48:55 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Auditing locally available compute resources for user (node: user) {{(pid=85141) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 10:48:55 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c885751-2ce7-4071-9c9a-6149e2257400/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:48:55 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c885751-2ce7-4071-9c9a-6149e2257400/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:48:55 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c885751-2ce7-4071-9c9a-6149e2257400/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:48:55 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c885751-2ce7-4071-9c9a-6149e2257400/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:48:56 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:48:56 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:48:56 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Hypervisor/Node resource view: name=user free_ram=8885MB free_disk=25.00811004638672GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=85141) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 10:48:56 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:48:56 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:48:56 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance 6c885751-2ce7-4071-9c9a-6149e2257400 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:48:56 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=85141) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 10:48:56 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=85141) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 10:48:56 user nova-compute[85141]: DEBUG nova.compute.provider_tree [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Inventory has not changed in ProviderTree for provider: bf8e0fa1-16b6-408f-9203-c4cd63916272 {{(pid=85141) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 10:48:56 user nova-compute[85141]: DEBUG nova.scheduler.client.report [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Inventory has not changed for provider bf8e0fa1-16b6-408f-9203-c4cd63916272 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=85141) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 10:48:56 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Compute_service record updated for user:user {{(pid=85141) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 10:48:56 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.199s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:48:57 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:48:57 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Starting heal instance info cache {{(pid=85141) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 10:48:57 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Rebuilding the list of instances to heal {{(pid=85141) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 10:48:57 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Acquiring lock "refresh_cache-6c885751-2ce7-4071-9c9a-6149e2257400" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:48:57 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Acquired lock "refresh_cache-6c885751-2ce7-4071-9c9a-6149e2257400" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:48:57 user nova-compute[85141]: DEBUG nova.network.neutron [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] [instance: 6c885751-2ce7-4071-9c9a-6149e2257400] Forcefully refreshing network info cache for instance {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 10:48:57 user nova-compute[85141]: DEBUG nova.objects.instance [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lazy-loading 'info_cache' on Instance uuid 6c885751-2ce7-4071-9c9a-6149e2257400 {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:48:57 user nova-compute[85141]: DEBUG nova.network.neutron [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] [instance: 6c885751-2ce7-4071-9c9a-6149e2257400] Updating instance_info_cache with network_info: [{"id": "cffa62e2-3832-4bee-bb7c-f206e6cabf91", "address": "fa:16:3e:f6:ac:89", "network": {"id": "fd841f36-a23e-4993-8eab-ddc78f99e358", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1240531518-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df4af3f598d04f9a91f54796780cf8ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcffa62e2-38", "ovs_interfaceid": "cffa62e2-3832-4bee-bb7c-f206e6cabf91", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:48:57 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Releasing lock "refresh_cache-6c885751-2ce7-4071-9c9a-6149e2257400" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:48:57 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] [instance: 6c885751-2ce7-4071-9c9a-6149e2257400] Updated the network info_cache for instance {{(pid=85141) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 10:48:58 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:48:59 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:49:03 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:49:04 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:49:06 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:49:08 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:49:08 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:49:08 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=85141) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 10:49:08 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=85141) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 10:49:08 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=85141) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 10:49:08 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:49:13 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:49:13 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:49:13 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=85141) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 10:49:13 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=85141) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 10:49:13 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=85141) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 10:49:13 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:49:18 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:49:23 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:49:28 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:49:33 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:49:38 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:49:38 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:49:38 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=85141) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 10:49:38 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=85141) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 10:49:38 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=85141) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 10:49:38 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:49:43 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:49:43 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:49:43 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=85141) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 10:49:43 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=85141) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 10:49:43 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=85141) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 10:49:43 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:49:48 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:49:49 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:49:53 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:49:53 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=85141) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 10:49:53 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:49:55 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:49:56 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:49:56 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager.update_available_resource {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:49:56 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:49:56 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:49:56 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:49:56 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Auditing locally available compute resources for user (node: user) {{(pid=85141) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 10:49:56 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c885751-2ce7-4071-9c9a-6149e2257400/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:49:56 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c885751-2ce7-4071-9c9a-6149e2257400/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:49:56 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c885751-2ce7-4071-9c9a-6149e2257400/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:49:56 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c885751-2ce7-4071-9c9a-6149e2257400/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:49:57 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:49:57 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:49:57 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Hypervisor/Node resource view: name=user free_ram=8977MB free_disk=25.0074462890625GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=85141) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 10:49:57 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:49:57 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:49:57 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance 6c885751-2ce7-4071-9c9a-6149e2257400 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:49:57 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=85141) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 10:49:57 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=85141) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 10:49:57 user nova-compute[85141]: DEBUG nova.compute.provider_tree [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Inventory has not changed in ProviderTree for provider: bf8e0fa1-16b6-408f-9203-c4cd63916272 {{(pid=85141) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 10:49:57 user nova-compute[85141]: DEBUG nova.scheduler.client.report [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Inventory has not changed for provider bf8e0fa1-16b6-408f-9203-c4cd63916272 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=85141) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 10:49:57 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Compute_service record updated for user:user {{(pid=85141) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 10:49:57 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.155s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:49:58 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:49:58 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:49:58 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=85141) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 10:49:58 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=85141) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 10:49:58 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=85141) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 10:49:58 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:49:59 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:49:59 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Starting heal instance info cache {{(pid=85141) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 10:49:59 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Rebuilding the list of instances to heal {{(pid=85141) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 10:49:59 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Acquiring lock "refresh_cache-6c885751-2ce7-4071-9c9a-6149e2257400" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:49:59 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Acquired lock "refresh_cache-6c885751-2ce7-4071-9c9a-6149e2257400" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:49:59 user nova-compute[85141]: DEBUG nova.network.neutron [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] [instance: 6c885751-2ce7-4071-9c9a-6149e2257400] Forcefully refreshing network info cache for instance {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 10:49:59 user nova-compute[85141]: DEBUG nova.objects.instance [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lazy-loading 'info_cache' on Instance uuid 6c885751-2ce7-4071-9c9a-6149e2257400 {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:49:59 user nova-compute[85141]: DEBUG nova.network.neutron [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] [instance: 6c885751-2ce7-4071-9c9a-6149e2257400] Updating instance_info_cache with network_info: [{"id": "cffa62e2-3832-4bee-bb7c-f206e6cabf91", "address": "fa:16:3e:f6:ac:89", "network": {"id": "fd841f36-a23e-4993-8eab-ddc78f99e358", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1240531518-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df4af3f598d04f9a91f54796780cf8ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcffa62e2-38", "ovs_interfaceid": "cffa62e2-3832-4bee-bb7c-f206e6cabf91", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:49:59 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Releasing lock "refresh_cache-6c885751-2ce7-4071-9c9a-6149e2257400" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:49:59 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] [instance: 6c885751-2ce7-4071-9c9a-6149e2257400] Updated the network info_cache for instance {{(pid=85141) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 10:49:59 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:50:03 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:50:03 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:50:03 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=85141) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 10:50:03 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=85141) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 10:50:03 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=85141) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 10:50:03 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:50:05 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:50:07 user nova-compute[85141]: DEBUG nova.compute.manager [req-caa61ace-ad52-4091-98ce-ff914666b2e8 req-7262f893-8d22-43a6-aa25-2375272c393b service nova] [instance: 6c885751-2ce7-4071-9c9a-6149e2257400] Received event network-changed-cffa62e2-3832-4bee-bb7c-f206e6cabf91 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:50:07 user nova-compute[85141]: DEBUG nova.compute.manager [req-caa61ace-ad52-4091-98ce-ff914666b2e8 req-7262f893-8d22-43a6-aa25-2375272c393b service nova] [instance: 6c885751-2ce7-4071-9c9a-6149e2257400] Refreshing instance network info cache due to event network-changed-cffa62e2-3832-4bee-bb7c-f206e6cabf91. {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 10:50:07 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-caa61ace-ad52-4091-98ce-ff914666b2e8 req-7262f893-8d22-43a6-aa25-2375272c393b service nova] Acquiring lock "refresh_cache-6c885751-2ce7-4071-9c9a-6149e2257400" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:50:07 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-caa61ace-ad52-4091-98ce-ff914666b2e8 req-7262f893-8d22-43a6-aa25-2375272c393b service nova] Acquired lock "refresh_cache-6c885751-2ce7-4071-9c9a-6149e2257400" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:50:07 user nova-compute[85141]: DEBUG nova.network.neutron [req-caa61ace-ad52-4091-98ce-ff914666b2e8 req-7262f893-8d22-43a6-aa25-2375272c393b service nova] [instance: 6c885751-2ce7-4071-9c9a-6149e2257400] Refreshing network info cache for port cffa62e2-3832-4bee-bb7c-f206e6cabf91 {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 10:50:07 user nova-compute[85141]: DEBUG nova.network.neutron [req-caa61ace-ad52-4091-98ce-ff914666b2e8 req-7262f893-8d22-43a6-aa25-2375272c393b service nova] [instance: 6c885751-2ce7-4071-9c9a-6149e2257400] Updated VIF entry in instance network info cache for port cffa62e2-3832-4bee-bb7c-f206e6cabf91. {{(pid=85141) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 10:50:07 user nova-compute[85141]: DEBUG nova.network.neutron [req-caa61ace-ad52-4091-98ce-ff914666b2e8 req-7262f893-8d22-43a6-aa25-2375272c393b service nova] [instance: 6c885751-2ce7-4071-9c9a-6149e2257400] Updating instance_info_cache with network_info: [{"id": "cffa62e2-3832-4bee-bb7c-f206e6cabf91", "address": "fa:16:3e:f6:ac:89", "network": {"id": "fd841f36-a23e-4993-8eab-ddc78f99e358", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1240531518-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.109", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df4af3f598d04f9a91f54796780cf8ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcffa62e2-38", "ovs_interfaceid": "cffa62e2-3832-4bee-bb7c-f206e6cabf91", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:50:07 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-caa61ace-ad52-4091-98ce-ff914666b2e8 req-7262f893-8d22-43a6-aa25-2375272c393b service nova] Releasing lock "refresh_cache-6c885751-2ce7-4071-9c9a-6149e2257400" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:50:08 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:50:08 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:50:08 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:50:09 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-aa03b42a-b8c6-4169-8765-dd16ff285f2e tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Acquiring lock "6c885751-2ce7-4071-9c9a-6149e2257400" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:50:09 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-aa03b42a-b8c6-4169-8765-dd16ff285f2e tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Lock "6c885751-2ce7-4071-9c9a-6149e2257400" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:50:09 user nova-compute[85141]: DEBUG nova.objects.instance [None req-aa03b42a-b8c6-4169-8765-dd16ff285f2e tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Lazy-loading 'flavor' on Instance uuid 6c885751-2ce7-4071-9c9a-6149e2257400 {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:50:09 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-aa03b42a-b8c6-4169-8765-dd16ff285f2e tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Lock "6c885751-2ce7-4071-9c9a-6149e2257400" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:50:09 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-aa03b42a-b8c6-4169-8765-dd16ff285f2e tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Acquiring lock "6c885751-2ce7-4071-9c9a-6149e2257400" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:50:09 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-aa03b42a-b8c6-4169-8765-dd16ff285f2e tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Lock "6c885751-2ce7-4071-9c9a-6149e2257400" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:50:09 user nova-compute[85141]: INFO nova.compute.manager [None req-aa03b42a-b8c6-4169-8765-dd16ff285f2e tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] [instance: 6c885751-2ce7-4071-9c9a-6149e2257400] Attaching volume abbb8e5d-9a24-422d-a1d4-af17c44c46ea to /dev/vdb
Nov 16 10:50:09 user nova-compute[85141]: DEBUG os_brick.utils [None req-aa03b42a-b8c6-4169-8765-dd16ff285f2e tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 10:50:09 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:50:09 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:50:09 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceef4005-290c-49cf-abcb-ade890fda8ab]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c7834de5c295\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:50:09 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:50:09 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:50:09 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f07b069-0954-47e1-ba6b-4aafa8300c09]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:50:09 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:50:09 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:50:09 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3133cdb-c702-4c84-895b-bcddd08defe0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:50:09 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[774cbc6b-f235-45e8-96f5-dab0bda8b41e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:50:09 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-aa03b42a-b8c6-4169-8765-dd16ff285f2e tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Running cmd (subprocess): nvme version {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:50:09 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-aa03b42a-b8c6-4169-8765-dd16ff285f2e tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] 'nvme version' failed. Not Retrying. {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 10:50:09 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.nvmeof [None req-aa03b42a-b8c6-4169-8765-dd16ff285f2e tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] nvme not present on system {{(pid=85141) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 10:50:09 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:50:09 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 10:50:09 user nova-compute[85141]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 10:50:09 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[4226695b-5515-4702-96f6-852aa9743c7e]: (4, '') {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:50:09 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.lightos [None req-aa03b42a-b8c6-4169-8765-dd16ff285f2e tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=85141) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 10:50:09 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.lightos [None req-aa03b42a-b8c6-4169-8765-dd16ff285f2e tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=85141) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 10:50:09 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.lightos [None req-aa03b42a-b8c6-4169-8765-dd16ff285f2e tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] LIGHTOS: no hostnqn found. {{(pid=85141) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 10:50:09 user nova-compute[85141]: DEBUG os_brick.utils [None req-aa03b42a-b8c6-4169-8765-dd16ff285f2e tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c7834de5c295', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 10:50:09 user nova-compute[85141]: DEBUG nova.virt.block_device [None req-aa03b42a-b8c6-4169-8765-dd16ff285f2e tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] [instance: 6c885751-2ce7-4071-9c9a-6149e2257400] Updating existing volume attachment record: 9527b7dc-4b52-4e51-a49f-fffcf202c21b {{(pid=85141) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 10:50:13 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:50:13 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:50:14 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aa03b42a-b8c6-4169-8765-dd16ff285f2e tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] [instance: 6c885751-2ce7-4071-9c9a-6149e2257400] Calling os-brick to attach iSCSI Volume {{(pid=85141) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 10:50:14 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa03b42a-b8c6-4169-8765-dd16ff285f2e tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51806b6080>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:abbb8e5d-9a24-422d-a1d4-af17c44c46ea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UwJfrDsb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 10:50:14 user nova-compute[85141]: WARNING os_brick.initiator.connectors.base [None req-aa03b42a-b8c6-4169-8765-dd16ff285f2e tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 10:50:14 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-aa03b42a-b8c6-4169-8765-dd16ff285f2e tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 10:50:14 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-aa03b42a-b8c6-4169-8765-dd16ff285f2e tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 10:50:14 user nova-compute[85141]: WARNING os_brick.initiator.connectors.base [None req-aa03b42a-b8c6-4169-8765-dd16ff285f2e tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 10:50:14 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-aa03b42a-b8c6-4169-8765-dd16ff285f2e tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:abbb8e5d-9a24-422d-a1d4-af17c44c46ea" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 10:50:14 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-aa03b42a-b8c6-4169-8765-dd16ff285f2e tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:abbb8e5d-9a24-422d-a1d4-af17c44c46ea" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 10:50:14 user nova-compute[85141]: INFO os_brick.initiator.connectors.iscsi [None req-aa03b42a-b8c6-4169-8765-dd16ff285f2e tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 10:50:14 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abbb8e5d-9a24-422d-a1d4-af17c44c46ea -p 172.16.0.220:3260 {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:50:14 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abbb8e5d-9a24-422d-a1d4-af17c44c46ea -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:50:14 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2ad9fab-51b7-47a6-b1ca-2ed1c6ca9593]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:50:14 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa03b42a-b8c6-4169-8765-dd16ff285f2e tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 10:50:14 user nova-compute[85141]:  {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:50:14 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abbb8e5d-9a24-422d-a1d4-af17c44c46ea -p 172.16.0.220:3260 --interface default --op new {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:50:14 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abbb8e5d-9a24-422d-a1d4-af17c44c46ea -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:50:14 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[999dca4d-3c59-4b59-9856-fecad31b0c66]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:abbb8e5d-9a24-422d-a1d4-af17c44c46ea] added\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:50:14 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa03b42a-b8c6-4169-8765-dd16ff285f2e tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:abbb8e5d-9a24-422d-a1d4-af17c44c46ea] added
Nov 16 10:50:14 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:50:14 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abbb8e5d-9a24-422d-a1d4-af17c44c46ea -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:50:14 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abbb8e5d-9a24-422d-a1d4-af17c44c46ea -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:50:14 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7025392-2241-4437-9842-df4d0526f442]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:50:14 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa03b42a-b8c6-4169-8765-dd16ff285f2e tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:50:14 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abbb8e5d-9a24-422d-a1d4-af17c44c46ea -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:50:14 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abbb8e5d-9a24-422d-a1d4-af17c44c46ea -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:50:14 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5291568-fb0d-4f77-a457-cea7b1881916]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:50:14 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa03b42a-b8c6-4169-8765-dd16ff285f2e tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:50:14 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abbb8e5d-9a24-422d-a1d4-af17c44c46ea -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UwJfrDsb {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:50:14 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abbb8e5d-9a24-422d-a1d4-af17c44c46ea -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UwJfrDsb" returned: 0 in 0.018s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:50:14 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[72f546be-e8f5-48c2-a027-4abb79d60451]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:50:14 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa03b42a-b8c6-4169-8765-dd16ff285f2e tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UwJfrDsb'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:50:14 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abbb8e5d-9a24-422d-a1d4-af17c44c46ea -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:50:14 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abbb8e5d-9a24-422d-a1d4-af17c44c46ea -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:50:14 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d4def86-cd01-45ab-84a2-2338c5e4ea1c]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:50:14 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa03b42a-b8c6-4169-8765-dd16ff285f2e tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:50:14 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:50:14 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:50:14 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d29e3bf-89d7-4521-bfc5-f98bd2c8174b]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:50:14 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa03b42a-b8c6-4169-8765-dd16ff285f2e tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 16 10:50:14 user nova-compute[85141]:  {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:50:14 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa03b42a-b8c6-4169-8765-dd16ff285f2e tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 16 10:50:14 user nova-compute[85141]:  {{(pid=85141) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 10:50:14 user nova-compute[85141]: WARNING os_brick.initiator.connectors.iscsi [None req-aa03b42a-b8c6-4169-8765-dd16ff285f2e tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 16 10:50:14 user nova-compute[85141]: 
Nov 16 10:50:14 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abbb8e5d-9a24-422d-a1d4-af17c44c46ea -p 172.16.0.220:3260 --login {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:50:14 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abbb8e5d-9a24-422d-a1d4-af17c44c46ea -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:50:14 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeda948c-56f1-46e1-9c7c-d947a510e1aa]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:abbb8e5d-9a24-422d-a1d4-af17c44c46ea, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:abbb8e5d-9a24-422d-a1d4-af17c44c46ea, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:50:14 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa03b42a-b8c6-4169-8765-dd16ff285f2e tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:abbb8e5d-9a24-422d-a1d4-af17c44c46ea, portal: 172.16.0.220,3260]
Nov 16 10:50:14 user nova-compute[85141]: Login to [iface: default, target: iqn.2010-10.org.openstack:abbb8e5d-9a24-422d-a1d4-af17c44c46ea, portal: 172.16.0.220,3260] successful.
Nov 16 10:50:14 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:50:14 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abbb8e5d-9a24-422d-a1d4-af17c44c46ea -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:50:14 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abbb8e5d-9a24-422d-a1d4-af17c44c46ea -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:50:14 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7c6332f-b532-4557-a709-b035f86bef79]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:50:14 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa03b42a-b8c6-4169-8765-dd16ff285f2e tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:50:14 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:50:14 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:50:14 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[98fa75a1-390a-4108-bf7e-fc1ee753e5cb]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abbb8e5d-9a24-422d-a1d4-af17c44c46ea (non-flash)\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:50:14 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa03b42a-b8c6-4169-8765-dd16ff285f2e tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abbb8e5d-9a24-422d-a1d4-af17c44c46ea (non-flash)
Nov 16 10:50:14 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:50:14 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa03b42a-b8c6-4169-8765-dd16ff285f2e tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abbb8e5d-9a24-422d-a1d4-af17c44c46ea (non-flash)
Nov 16 10:50:14 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 10:50:14 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-aa03b42a-b8c6-4169-8765-dd16ff285f2e tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:abbb8e5d-9a24-422d-a1d4-af17c44c46ea" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.258s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 10:50:14 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa03b42a-b8c6-4169-8765-dd16ff285f2e tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Connected to 172.16.0.220:3260 {{(pid=85141) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 10:50:14 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-aa03b42a-b8c6-4169-8765-dd16ff285f2e tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] HCTL ('33', '-', '-', 0) found on session 67 with lun 0 {{(pid=85141) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 10:50:14 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-aa03b42a-b8c6-4169-8765-dd16ff285f2e tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=85141) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 10:50:14 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:50:14 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:50:14 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[be7bb819-eedf-4b5f-9af0-92f33810f857]: (4, ('- - 0', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:50:14 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-aa03b42a-b8c6-4169-8765-dd16ff285f2e tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Searching for a device in session 67 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=85141) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 10:50:14 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa03b42a-b8c6-4169-8765-dd16ff285f2e tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:abbb8e5d-9a24-422d-a1d4-af17c44c46ea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UwJfrDsb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=85141) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 10:50:15 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-aa03b42a-b8c6-4169-8765-dd16ff285f2e tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.288s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 10:50:15 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa03b42a-b8c6-4169-8765-dd16ff285f2e tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] <== connect_volume: return (1291ms) {'type': 'block', 'scsi_wwn': '26234376634636130', 'path': '/dev/sdb'} {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 10:50:15 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aa03b42a-b8c6-4169-8765-dd16ff285f2e tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] [instance: 6c885751-2ce7-4071-9c9a-6149e2257400] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26234376634636130', 'path': '/dev/sdb'} {{(pid=85141) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 10:50:15 user nova-compute[85141]: DEBUG nova.objects.instance [None req-aa03b42a-b8c6-4169-8765-dd16ff285f2e tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Lazy-loading 'flavor' on Instance uuid 6c885751-2ce7-4071-9c9a-6149e2257400 {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:50:15 user nova-compute[85141]: DEBUG nova.virt.libvirt.guest [None req-aa03b42a-b8c6-4169-8765-dd16ff285f2e tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 10:50:15 user nova-compute[85141]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 10:50:15 user nova-compute[85141]:   <source dev="/dev/sdb"/>
Nov 16 10:50:15 user nova-compute[85141]:   <target dev="vdb" bus="virtio"/>
Nov 16 10:50:15 user nova-compute[85141]:   <serial>abbb8e5d-9a24-422d-a1d4-af17c44c46ea</serial>
Nov 16 10:50:15 user nova-compute[85141]: </disk>
Nov 16 10:50:15 user nova-compute[85141]:  {{(pid=85141) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 10:50:16 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-aa03b42a-b8c6-4169-8765-dd16ff285f2e tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] No BDM found with device name vda, not building metadata. {{(pid=85141) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 10:50:16 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-aa03b42a-b8c6-4169-8765-dd16ff285f2e tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] No BDM found with device name vdb, not building metadata. {{(pid=85141) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 10:50:16 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-aa03b42a-b8c6-4169-8765-dd16ff285f2e tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] No VIF found with MAC fa:16:3e:f6:ac:89, not building metadata {{(pid=85141) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 10:50:16 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-aa03b42a-b8c6-4169-8765-dd16ff285f2e tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Lock "6c885751-2ce7-4071-9c9a-6149e2257400" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.699s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:50:18 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:50:18 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:50:23 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:50:23 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:50:27 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-95412823-cde8-4450-87d3-a3ed9006eed4 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Acquiring lock "6c885751-2ce7-4071-9c9a-6149e2257400" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:50:27 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-95412823-cde8-4450-87d3-a3ed9006eed4 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Lock "6c885751-2ce7-4071-9c9a-6149e2257400" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:50:27 user nova-compute[85141]: INFO nova.compute.manager [None req-95412823-cde8-4450-87d3-a3ed9006eed4 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] [instance: 6c885751-2ce7-4071-9c9a-6149e2257400] Detaching volume abbb8e5d-9a24-422d-a1d4-af17c44c46ea
Nov 16 10:50:27 user nova-compute[85141]: INFO nova.virt.block_device [None req-95412823-cde8-4450-87d3-a3ed9006eed4 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] [instance: 6c885751-2ce7-4071-9c9a-6149e2257400] Attempting to driver detach volume abbb8e5d-9a24-422d-a1d4-af17c44c46ea from mountpoint /dev/vdb
Nov 16 10:50:27 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-95412823-cde8-4450-87d3-a3ed9006eed4 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Attempting to detach device vdb from instance 6c885751-2ce7-4071-9c9a-6149e2257400 from the persistent domain config. {{(pid=85141) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 10:50:27 user nova-compute[85141]: DEBUG nova.virt.libvirt.guest [None req-95412823-cde8-4450-87d3-a3ed9006eed4 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 10:50:27 user nova-compute[85141]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 10:50:27 user nova-compute[85141]:   <source dev="/dev/sdb"/>
Nov 16 10:50:27 user nova-compute[85141]:   <target dev="vdb" bus="virtio"/>
Nov 16 10:50:27 user nova-compute[85141]:   <serial>abbb8e5d-9a24-422d-a1d4-af17c44c46ea</serial>
Nov 16 10:50:27 user nova-compute[85141]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 10:50:27 user nova-compute[85141]: </disk>
Nov 16 10:50:27 user nova-compute[85141]:  {{(pid=85141) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 10:50:27 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-95412823-cde8-4450-87d3-a3ed9006eed4 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Successfully detached device vdb from instance 6c885751-2ce7-4071-9c9a-6149e2257400 from the persistent domain config.
Nov 16 10:50:27 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-95412823-cde8-4450-87d3-a3ed9006eed4 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 6c885751-2ce7-4071-9c9a-6149e2257400 from the live domain config. {{(pid=85141) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 10:50:27 user nova-compute[85141]: DEBUG nova.virt.libvirt.guest [None req-95412823-cde8-4450-87d3-a3ed9006eed4 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 10:50:27 user nova-compute[85141]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 10:50:27 user nova-compute[85141]:   <source dev="/dev/sdb"/>
Nov 16 10:50:27 user nova-compute[85141]:   <target dev="vdb" bus="virtio"/>
Nov 16 10:50:27 user nova-compute[85141]:   <serial>abbb8e5d-9a24-422d-a1d4-af17c44c46ea</serial>
Nov 16 10:50:27 user nova-compute[85141]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 10:50:27 user nova-compute[85141]: </disk>
Nov 16 10:50:27 user nova-compute[85141]:  {{(pid=85141) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 10:50:27 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-95412823-cde8-4450-87d3-a3ed9006eed4 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 6c885751-2ce7-4071-9c9a-6149e2257400 {{(pid=85141) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 10:50:28 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:50:28 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:50:33 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:50:38 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:50:38 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:50:38 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=85141) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 10:50:38 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=85141) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 10:50:38 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=85141) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 10:50:38 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:50:38 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:50:43 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:50:47 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-95412823-cde8-4450-87d3-a3ed9006eed4 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 6c885751-2ce7-4071-9c9a-6149e2257400 is timed out.
Nov 16 10:50:47 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-95412823-cde8-4450-87d3-a3ed9006eed4 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Successfully detached device vdb from instance 6c885751-2ce7-4071-9c9a-6149e2257400 from the live domain config.
Nov 16 10:50:47 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-95412823-cde8-4450-87d3-a3ed9006eed4 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] [instance: 6c885751-2ce7-4071-9c9a-6149e2257400] calling os-brick to detach iSCSI Volume {{(pid=85141) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 10:50:47 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-95412823-cde8-4450-87d3-a3ed9006eed4 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51806b6080>, {'target_iqn': 'iqn.2010-10.org.openstack:abbb8e5d-9a24-422d-a1d4-af17c44c46ea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UwJfrDsb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 10:50:47 user nova-compute[85141]: WARNING os_brick.initiator.connectors.base [None req-95412823-cde8-4450-87d3-a3ed9006eed4 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 10:50:47 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-95412823-cde8-4450-87d3-a3ed9006eed4 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 10:50:47 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-95412823-cde8-4450-87d3-a3ed9006eed4 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 10:50:47 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:50:47 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:50:47 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[96f0a553-d947-41dc-9e99-ba7d0ba747f6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:abbb8e5d-9a24-422d-a1d4-af17c44c46ea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:50:47 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-95412823-cde8-4450-87d3-a3ed9006eed4 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 10:50:47 user nova-compute[85141]: No targets found.
Nov 16 10:50:47 user nova-compute[85141]: iSNS:
Nov 16 10:50:47 user nova-compute[85141]: No targets found.
Nov 16 10:50:47 user nova-compute[85141]: STATIC:
Nov 16 10:50:47 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:abbb8e5d-9a24-422d-a1d4-af17c44c46ea
Nov 16 10:50:47 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:50:47 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:50:47 user nova-compute[85141]: FIRMWARE:
Nov 16 10:50:47 user nova-compute[85141]: No targets found.
Nov 16 10:50:47 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:50:47 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-95412823-cde8-4450-87d3-a3ed9006eed4 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 10:50:47 user nova-compute[85141]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 10:50:47 user nova-compute[85141]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=85141) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 10:50:47 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-95412823-cde8-4450-87d3-a3ed9006eed4 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:abbb8e5d-9a24-422d-a1d4-af17c44c46ea', 0)] {{(pid=85141) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 10:50:47 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:50:47 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:50:47 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[b410fcdc-727f-41b8-a382-c6be9cac2be9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:abbb8e5d-9a24-422d-a1d4-af17c44c46ea\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:50:47 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:50:47 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:50:47 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e4b4fee-c423-4ab5-a25c-83bfcc68e540]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abbb8e5d-9a24-422d-a1d4-af17c44c46ea (non-flash)\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:50:47 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-95412823-cde8-4450-87d3-a3ed9006eed4 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abbb8e5d-9a24-422d-a1d4-af17c44c46ea (non-flash)
Nov 16 10:50:47 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:50:47 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-95412823-cde8-4450-87d3-a3ed9006eed4 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abbb8e5d-9a24-422d-a1d4-af17c44c46ea (non-flash)
Nov 16 10:50:47 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 10:50:47 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-95412823-cde8-4450-87d3-a3ed9006eed4 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f51806920e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:abbb8e5d-9a24-422d-a1d4-af17c44c46ea'): ({'sdb'}, set())}) {{(pid=85141) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 10:50:47 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-95412823-cde8-4450-87d3-a3ed9006eed4 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Removing single pathed devices sdb {{(pid=85141) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 10:50:47 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:50:47 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:50:47 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe29d213-533b-4434-93aa-730a0b16190c]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:50:47 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:50:47 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:50:47 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[a22b3fec-cdb3-42d6-870f-8d21462c4d3f]: (4, ('ok\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:50:47 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-95412823-cde8-4450-87d3-a3ed9006eed4 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Flushing IO for device /dev/sdb {{(pid=85141) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 10:50:47 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:50:47 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:50:47 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[49325967-c0fe-4733-ae0b-9b141ddce1d9]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:50:47 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-95412823-cde8-4450-87d3-a3ed9006eed4 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=85141) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 10:50:47 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:50:47 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:50:47 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[a18acd9a-c639-41b0-aa3b-b0447dfc088c]: (4, ('1', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:50:47 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-95412823-cde8-4450-87d3-a3ed9006eed4 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=85141) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 10:50:47 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-95412823-cde8-4450-87d3-a3ed9006eed4 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] SCSI volumes sdb have been removed. {{(pid=85141) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 10:50:47 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-95412823-cde8-4450-87d3-a3ed9006eed4 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:abbb8e5d-9a24-422d-a1d4-af17c44c46ea')] {{(pid=85141) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 10:50:47 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abbb8e5d-9a24-422d-a1d4-af17c44c46ea -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:50:47 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abbb8e5d-9a24-422d-a1d4-af17c44c46ea -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:50:47 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a08d6d5-a2ca-4c4a-85b3-04c3136a881b]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:50:47 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-95412823-cde8-4450-87d3-a3ed9006eed4 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:50:47 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abbb8e5d-9a24-422d-a1d4-af17c44c46ea -p 172.16.0.220:3260 --logout {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:50:48 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abbb8e5d-9a24-422d-a1d4-af17c44c46ea -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:50:48 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[53cc956e-cd36-4475-9fa4-ca8a932a55f3]: (4, ('Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:abbb8e5d-9a24-422d-a1d4-af17c44c46ea, portal: 172.16.0.220,3260]\nLogout of [sid: 67, target: iqn.2010-10.org.openstack:abbb8e5d-9a24-422d-a1d4-af17c44c46ea, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:50:48 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-95412823-cde8-4450-87d3-a3ed9006eed4 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:abbb8e5d-9a24-422d-a1d4-af17c44c46ea, portal: 172.16.0.220,3260]
Nov 16 10:50:48 user nova-compute[85141]: Logout of [sid: 67, target: iqn.2010-10.org.openstack:abbb8e5d-9a24-422d-a1d4-af17c44c46ea, portal: 172.16.0.220,3260] successful.
Nov 16 10:50:48 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:50:48 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abbb8e5d-9a24-422d-a1d4-af17c44c46ea -p 172.16.0.220:3260 --op delete {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:50:48 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abbb8e5d-9a24-422d-a1d4-af17c44c46ea -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:50:48 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd096791-1509-48bb-b593-e52e9b2739af]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:50:48 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-95412823-cde8-4450-87d3-a3ed9006eed4 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:50:48 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-95412823-cde8-4450-87d3-a3ed9006eed4 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.276s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 10:50:48 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-95412823-cde8-4450-87d3-a3ed9006eed4 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] <== disconnect_volume: return (277ms) None {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 10:50:48 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-95412823-cde8-4450-87d3-a3ed9006eed4 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] [instance: 6c885751-2ce7-4071-9c9a-6149e2257400] Disconnected iSCSI Volume {{(pid=85141) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 10:50:48 user nova-compute[85141]: DEBUG nova.objects.instance [None req-95412823-cde8-4450-87d3-a3ed9006eed4 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Lazy-loading 'flavor' on Instance uuid 6c885751-2ce7-4071-9c9a-6149e2257400 {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:50:48 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-95412823-cde8-4450-87d3-a3ed9006eed4 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Lock "6c885751-2ce7-4071-9c9a-6149e2257400" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.558s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:50:48 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:50:48 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:50:48 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=85141) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 10:50:48 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=85141) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 10:50:48 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=85141) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 10:50:48 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:50:51 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:50:53 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:50:53 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=85141) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 10:50:53 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:50:53 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:50:53 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=85141) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 10:50:53 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=85141) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 10:50:53 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=85141) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 10:50:53 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:50:56 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager.update_available_resource {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:50:56 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:50:56 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:50:56 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:50:56 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Auditing locally available compute resources for user (node: user) {{(pid=85141) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 10:50:56 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c885751-2ce7-4071-9c9a-6149e2257400/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:50:56 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c885751-2ce7-4071-9c9a-6149e2257400/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:50:56 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c885751-2ce7-4071-9c9a-6149e2257400/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:50:56 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c885751-2ce7-4071-9c9a-6149e2257400/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:50:57 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:50:57 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:50:57 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Hypervisor/Node resource view: name=user free_ram=8981MB free_disk=25.006103515625GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=85141) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 10:50:57 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:50:57 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:50:57 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance 6c885751-2ce7-4071-9c9a-6149e2257400 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:50:57 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=85141) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 10:50:57 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=85141) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 10:50:57 user nova-compute[85141]: DEBUG nova.compute.provider_tree [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Inventory has not changed in ProviderTree for provider: bf8e0fa1-16b6-408f-9203-c4cd63916272 {{(pid=85141) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 10:50:57 user nova-compute[85141]: DEBUG nova.scheduler.client.report [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Inventory has not changed for provider bf8e0fa1-16b6-408f-9203-c4cd63916272 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=85141) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 10:50:57 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Compute_service record updated for user:user {{(pid=85141) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 10:50:57 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.174s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:50:58 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:50:58 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:50:58 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:50:58 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:51:00 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:51:00 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Starting heal instance info cache {{(pid=85141) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 10:51:00 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Rebuilding the list of instances to heal {{(pid=85141) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 10:51:00 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Acquiring lock "refresh_cache-6c885751-2ce7-4071-9c9a-6149e2257400" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:51:00 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Acquired lock "refresh_cache-6c885751-2ce7-4071-9c9a-6149e2257400" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:51:00 user nova-compute[85141]: DEBUG nova.network.neutron [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] [instance: 6c885751-2ce7-4071-9c9a-6149e2257400] Forcefully refreshing network info cache for instance {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 10:51:00 user nova-compute[85141]: DEBUG nova.objects.instance [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lazy-loading 'info_cache' on Instance uuid 6c885751-2ce7-4071-9c9a-6149e2257400 {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:51:00 user nova-compute[85141]: DEBUG nova.network.neutron [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] [instance: 6c885751-2ce7-4071-9c9a-6149e2257400] Updating instance_info_cache with network_info: [{"id": "cffa62e2-3832-4bee-bb7c-f206e6cabf91", "address": "fa:16:3e:f6:ac:89", "network": {"id": "fd841f36-a23e-4993-8eab-ddc78f99e358", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1240531518-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.109", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df4af3f598d04f9a91f54796780cf8ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcffa62e2-38", "ovs_interfaceid": "cffa62e2-3832-4bee-bb7c-f206e6cabf91", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:51:00 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Releasing lock "refresh_cache-6c885751-2ce7-4071-9c9a-6149e2257400" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:51:00 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] [instance: 6c885751-2ce7-4071-9c9a-6149e2257400] Updated the network info_cache for instance {{(pid=85141) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 10:51:00 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:51:03 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:51:03 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:51:03 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=85141) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 10:51:03 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=85141) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 10:51:03 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=85141) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 10:51:03 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:51:05 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:51:08 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:51:10 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:51:13 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:51:18 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:51:18 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:51:18 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=85141) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 10:51:18 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=85141) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 10:51:18 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=85141) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 10:51:18 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:51:19 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-47cd6358-c0e4-4095-b103-2c99e76ca4f3 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Acquiring lock "6c885751-2ce7-4071-9c9a-6149e2257400" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:51:19 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-47cd6358-c0e4-4095-b103-2c99e76ca4f3 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Lock "6c885751-2ce7-4071-9c9a-6149e2257400" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:51:19 user nova-compute[85141]: DEBUG nova.objects.instance [None req-47cd6358-c0e4-4095-b103-2c99e76ca4f3 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Lazy-loading 'flavor' on Instance uuid 6c885751-2ce7-4071-9c9a-6149e2257400 {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:51:19 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-47cd6358-c0e4-4095-b103-2c99e76ca4f3 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Lock "6c885751-2ce7-4071-9c9a-6149e2257400" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.065s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:51:20 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-47cd6358-c0e4-4095-b103-2c99e76ca4f3 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Acquiring lock "6c885751-2ce7-4071-9c9a-6149e2257400" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:51:20 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-47cd6358-c0e4-4095-b103-2c99e76ca4f3 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Lock "6c885751-2ce7-4071-9c9a-6149e2257400" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:51:20 user nova-compute[85141]: INFO nova.compute.manager [None req-47cd6358-c0e4-4095-b103-2c99e76ca4f3 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] [instance: 6c885751-2ce7-4071-9c9a-6149e2257400] Attaching volume b7dd164f-2094-499a-9596-204e9b1f23a5 to /dev/vdb
Nov 16 10:51:20 user nova-compute[85141]: DEBUG os_brick.utils [None req-47cd6358-c0e4-4095-b103-2c99e76ca4f3 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 10:51:20 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:51:20 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:51:20 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbb6a142-725b-4ac1-ab2f-1f7ef5c24935]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c7834de5c295\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:51:20 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:51:20 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:51:20 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[80d850b1-83ba-49b3-91b5-876d2ccab54f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:51:20 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:51:20 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:51:20 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa0d929e-290a-4586-8e65-85c27c53f99f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:51:20 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc2e1207-79aa-40ef-b845-891d3317db21]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:51:20 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-47cd6358-c0e4-4095-b103-2c99e76ca4f3 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Running cmd (subprocess): nvme version {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:51:20 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-47cd6358-c0e4-4095-b103-2c99e76ca4f3 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] 'nvme version' failed. Not Retrying. {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 10:51:20 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.nvmeof [None req-47cd6358-c0e4-4095-b103-2c99e76ca4f3 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] nvme not present on system {{(pid=85141) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 10:51:20 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:51:20 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 10:51:20 user nova-compute[85141]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 10:51:20 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[441fab74-6f99-4092-800f-de70d9e08d62]: (4, '') {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:51:20 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.lightos [None req-47cd6358-c0e4-4095-b103-2c99e76ca4f3 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=85141) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 10:51:20 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.lightos [None req-47cd6358-c0e4-4095-b103-2c99e76ca4f3 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=85141) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 10:51:20 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.lightos [None req-47cd6358-c0e4-4095-b103-2c99e76ca4f3 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] LIGHTOS: no hostnqn found. {{(pid=85141) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 10:51:20 user nova-compute[85141]: DEBUG os_brick.utils [None req-47cd6358-c0e4-4095-b103-2c99e76ca4f3 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c7834de5c295', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 10:51:20 user nova-compute[85141]: DEBUG nova.virt.block_device [None req-47cd6358-c0e4-4095-b103-2c99e76ca4f3 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] [instance: 6c885751-2ce7-4071-9c9a-6149e2257400] Updating existing volume attachment record: 06630608-c92a-4895-a726-0264165dd865 {{(pid=85141) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 10:51:23 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:51:23 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:51:25 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-47cd6358-c0e4-4095-b103-2c99e76ca4f3 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] [instance: 6c885751-2ce7-4071-9c9a-6149e2257400] Calling os-brick to attach iSCSI Volume {{(pid=85141) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 10:51:25 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-47cd6358-c0e4-4095-b103-2c99e76ca4f3 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51806b6080>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b7dd164f-2094-499a-9596-204e9b1f23a5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HpMTJxum', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 10:51:25 user nova-compute[85141]: WARNING os_brick.initiator.connectors.base [None req-47cd6358-c0e4-4095-b103-2c99e76ca4f3 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 10:51:25 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-47cd6358-c0e4-4095-b103-2c99e76ca4f3 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 10:51:25 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-47cd6358-c0e4-4095-b103-2c99e76ca4f3 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 10:51:25 user nova-compute[85141]: WARNING os_brick.initiator.connectors.base [None req-47cd6358-c0e4-4095-b103-2c99e76ca4f3 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 10:51:25 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-47cd6358-c0e4-4095-b103-2c99e76ca4f3 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b7dd164f-2094-499a-9596-204e9b1f23a5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 10:51:25 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-47cd6358-c0e4-4095-b103-2c99e76ca4f3 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b7dd164f-2094-499a-9596-204e9b1f23a5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 10:51:25 user nova-compute[85141]: INFO os_brick.initiator.connectors.iscsi [None req-47cd6358-c0e4-4095-b103-2c99e76ca4f3 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 10:51:25 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7dd164f-2094-499a-9596-204e9b1f23a5 -p 172.16.0.220:3260 {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:51:25 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7dd164f-2094-499a-9596-204e9b1f23a5 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:51:25 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf298f64-f628-47b8-9d1f-70cc99370c0e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:51:25 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-47cd6358-c0e4-4095-b103-2c99e76ca4f3 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 10:51:25 user nova-compute[85141]:  {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:51:25 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7dd164f-2094-499a-9596-204e9b1f23a5 -p 172.16.0.220:3260 --interface default --op new {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:51:25 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7dd164f-2094-499a-9596-204e9b1f23a5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:51:25 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ba22f3b-f51b-4ce0-850c-d1a3274f1736]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b7dd164f-2094-499a-9596-204e9b1f23a5] added\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:51:25 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-47cd6358-c0e4-4095-b103-2c99e76ca4f3 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b7dd164f-2094-499a-9596-204e9b1f23a5] added
Nov 16 10:51:25 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:51:25 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7dd164f-2094-499a-9596-204e9b1f23a5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:51:25 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7dd164f-2094-499a-9596-204e9b1f23a5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:51:25 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ddfe291-2993-4ef7-be27-edb6034102ca]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:51:25 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-47cd6358-c0e4-4095-b103-2c99e76ca4f3 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:51:25 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7dd164f-2094-499a-9596-204e9b1f23a5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:51:25 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7dd164f-2094-499a-9596-204e9b1f23a5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:51:25 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b581ab2-ebdc-46e4-9e6c-559acfde8969]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:51:25 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-47cd6358-c0e4-4095-b103-2c99e76ca4f3 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:51:25 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7dd164f-2094-499a-9596-204e9b1f23a5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HpMTJxum {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:51:25 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7dd164f-2094-499a-9596-204e9b1f23a5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HpMTJxum" returned: 0 in 0.022s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:51:25 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[6826c602-425c-48f4-8605-7dd82929273c]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:51:25 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-47cd6358-c0e4-4095-b103-2c99e76ca4f3 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HpMTJxum'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:51:25 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7dd164f-2094-499a-9596-204e9b1f23a5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:51:25 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7dd164f-2094-499a-9596-204e9b1f23a5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:51:25 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[23b047ce-ee0e-4e83-823a-cfdfde6c8915]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:51:25 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-47cd6358-c0e4-4095-b103-2c99e76ca4f3 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:51:25 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:51:25 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:51:25 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[a30e047b-b280-4427-9751-b63a5e0eede2]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:51:25 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-47cd6358-c0e4-4095-b103-2c99e76ca4f3 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 16 10:51:25 user nova-compute[85141]:  {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:51:25 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-47cd6358-c0e4-4095-b103-2c99e76ca4f3 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 16 10:51:25 user nova-compute[85141]:  {{(pid=85141) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 10:51:25 user nova-compute[85141]: WARNING os_brick.initiator.connectors.iscsi [None req-47cd6358-c0e4-4095-b103-2c99e76ca4f3 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 16 10:51:25 user nova-compute[85141]: 
Nov 16 10:51:25 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7dd164f-2094-499a-9596-204e9b1f23a5 -p 172.16.0.220:3260 --login {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:51:25 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7dd164f-2094-499a-9596-204e9b1f23a5 -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:51:25 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c1bf896-c717-4cbc-b2ab-8b522f8176f9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b7dd164f-2094-499a-9596-204e9b1f23a5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b7dd164f-2094-499a-9596-204e9b1f23a5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:51:25 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-47cd6358-c0e4-4095-b103-2c99e76ca4f3 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b7dd164f-2094-499a-9596-204e9b1f23a5, portal: 172.16.0.220,3260]
Nov 16 10:51:25 user nova-compute[85141]: Login to [iface: default, target: iqn.2010-10.org.openstack:b7dd164f-2094-499a-9596-204e9b1f23a5, portal: 172.16.0.220,3260] successful.
Nov 16 10:51:25 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:51:25 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7dd164f-2094-499a-9596-204e9b1f23a5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:51:25 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7dd164f-2094-499a-9596-204e9b1f23a5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:51:25 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aa7931e-8433-4c15-94a5-9bf78c989a3e]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:51:25 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-47cd6358-c0e4-4095-b103-2c99e76ca4f3 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:51:25 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:51:25 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:51:25 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[1913ed37-04a2-413d-ba3e-475bd40d3f70]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7dd164f-2094-499a-9596-204e9b1f23a5 (non-flash)\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:51:25 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-47cd6358-c0e4-4095-b103-2c99e76ca4f3 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7dd164f-2094-499a-9596-204e9b1f23a5 (non-flash)
Nov 16 10:51:25 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:51:25 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-47cd6358-c0e4-4095-b103-2c99e76ca4f3 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7dd164f-2094-499a-9596-204e9b1f23a5 (non-flash)
Nov 16 10:51:25 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 10:51:25 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-47cd6358-c0e4-4095-b103-2c99e76ca4f3 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b7dd164f-2094-499a-9596-204e9b1f23a5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.274s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 10:51:25 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-47cd6358-c0e4-4095-b103-2c99e76ca4f3 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Connected to 172.16.0.220:3260 {{(pid=85141) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 10:51:25 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-47cd6358-c0e4-4095-b103-2c99e76ca4f3 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] HCTL ('33', '-', '-', 0) found on session 68 with lun 0 {{(pid=85141) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 10:51:25 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-47cd6358-c0e4-4095-b103-2c99e76ca4f3 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=85141) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 10:51:25 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:51:25 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.024s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:51:25 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[5180d92c-23d7-49d7-9de5-36d49f991aef]: (4, ('- - 0', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:51:25 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-47cd6358-c0e4-4095-b103-2c99e76ca4f3 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Searching for a device in session 68 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=85141) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 10:51:25 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-47cd6358-c0e4-4095-b103-2c99e76ca4f3 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:b7dd164f-2094-499a-9596-204e9b1f23a5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HpMTJxum', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=85141) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 10:51:26 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-47cd6358-c0e4-4095-b103-2c99e76ca4f3 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.311s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 10:51:26 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-47cd6358-c0e4-4095-b103-2c99e76ca4f3 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] <== connect_volume: return (1313ms) {'type': 'block', 'scsi_wwn': '23638653866323563', 'path': '/dev/sdb'} {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 10:51:26 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-47cd6358-c0e4-4095-b103-2c99e76ca4f3 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] [instance: 6c885751-2ce7-4071-9c9a-6149e2257400] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23638653866323563', 'path': '/dev/sdb'} {{(pid=85141) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 10:51:26 user nova-compute[85141]: DEBUG nova.objects.instance [None req-47cd6358-c0e4-4095-b103-2c99e76ca4f3 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Lazy-loading 'flavor' on Instance uuid 6c885751-2ce7-4071-9c9a-6149e2257400 {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:51:26 user nova-compute[85141]: DEBUG nova.virt.libvirt.guest [None req-47cd6358-c0e4-4095-b103-2c99e76ca4f3 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 10:51:26 user nova-compute[85141]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 10:51:26 user nova-compute[85141]:   <source dev="/dev/sdb"/>
Nov 16 10:51:26 user nova-compute[85141]:   <target dev="vdb" bus="virtio"/>
Nov 16 10:51:26 user nova-compute[85141]:   <serial>b7dd164f-2094-499a-9596-204e9b1f23a5</serial>
Nov 16 10:51:26 user nova-compute[85141]: </disk>
Nov 16 10:51:26 user nova-compute[85141]:  {{(pid=85141) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 10:51:26 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-47cd6358-c0e4-4095-b103-2c99e76ca4f3 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] No BDM found with device name vda, not building metadata. {{(pid=85141) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 10:51:26 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-47cd6358-c0e4-4095-b103-2c99e76ca4f3 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] No BDM found with device name vdb, not building metadata. {{(pid=85141) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 10:51:26 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-47cd6358-c0e4-4095-b103-2c99e76ca4f3 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] No VIF found with MAC fa:16:3e:f6:ac:89, not building metadata {{(pid=85141) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 10:51:27 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-47cd6358-c0e4-4095-b103-2c99e76ca4f3 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Lock "6c885751-2ce7-4071-9c9a-6149e2257400" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.791s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:51:28 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:51:28 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:51:29 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-9641f3bd-954b-4f83-8033-bac72e698024 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Acquiring lock "6c885751-2ce7-4071-9c9a-6149e2257400" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:51:29 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-9641f3bd-954b-4f83-8033-bac72e698024 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Lock "6c885751-2ce7-4071-9c9a-6149e2257400" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:51:29 user nova-compute[85141]: INFO nova.compute.manager [None req-9641f3bd-954b-4f83-8033-bac72e698024 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] [instance: 6c885751-2ce7-4071-9c9a-6149e2257400] Detaching volume b7dd164f-2094-499a-9596-204e9b1f23a5
Nov 16 10:51:29 user nova-compute[85141]: INFO nova.virt.block_device [None req-9641f3bd-954b-4f83-8033-bac72e698024 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] [instance: 6c885751-2ce7-4071-9c9a-6149e2257400] Attempting to driver detach volume b7dd164f-2094-499a-9596-204e9b1f23a5 from mountpoint /dev/vdb
Nov 16 10:51:29 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-9641f3bd-954b-4f83-8033-bac72e698024 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Attempting to detach device vdb from instance 6c885751-2ce7-4071-9c9a-6149e2257400 from the persistent domain config. {{(pid=85141) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 10:51:29 user nova-compute[85141]: DEBUG nova.virt.libvirt.guest [None req-9641f3bd-954b-4f83-8033-bac72e698024 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 10:51:29 user nova-compute[85141]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 10:51:29 user nova-compute[85141]:   <source dev="/dev/sdb"/>
Nov 16 10:51:29 user nova-compute[85141]:   <target dev="vdb" bus="virtio"/>
Nov 16 10:51:29 user nova-compute[85141]:   <serial>b7dd164f-2094-499a-9596-204e9b1f23a5</serial>
Nov 16 10:51:29 user nova-compute[85141]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 10:51:29 user nova-compute[85141]: </disk>
Nov 16 10:51:29 user nova-compute[85141]:  {{(pid=85141) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 10:51:29 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-9641f3bd-954b-4f83-8033-bac72e698024 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Successfully detached device vdb from instance 6c885751-2ce7-4071-9c9a-6149e2257400 from the persistent domain config.
Nov 16 10:51:29 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-9641f3bd-954b-4f83-8033-bac72e698024 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 6c885751-2ce7-4071-9c9a-6149e2257400 from the live domain config. {{(pid=85141) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 10:51:29 user nova-compute[85141]: DEBUG nova.virt.libvirt.guest [None req-9641f3bd-954b-4f83-8033-bac72e698024 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 10:51:29 user nova-compute[85141]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 10:51:29 user nova-compute[85141]:   <source dev="/dev/sdb"/>
Nov 16 10:51:29 user nova-compute[85141]:   <target dev="vdb" bus="virtio"/>
Nov 16 10:51:29 user nova-compute[85141]:   <serial>b7dd164f-2094-499a-9596-204e9b1f23a5</serial>
Nov 16 10:51:29 user nova-compute[85141]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 10:51:29 user nova-compute[85141]: </disk>
Nov 16 10:51:29 user nova-compute[85141]:  {{(pid=85141) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 10:51:29 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-9641f3bd-954b-4f83-8033-bac72e698024 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 6c885751-2ce7-4071-9c9a-6149e2257400 {{(pid=85141) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 10:51:33 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:51:33 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:51:38 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:51:43 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:51:43 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:51:43 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=85141) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 10:51:43 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=85141) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 10:51:43 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=85141) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 10:51:43 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:51:48 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:51:48 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:51:48 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=85141) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 10:51:48 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=85141) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 10:51:48 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=85141) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 10:51:48 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:51:49 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-9641f3bd-954b-4f83-8033-bac72e698024 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 6c885751-2ce7-4071-9c9a-6149e2257400 is timed out.
Nov 16 10:51:49 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-9641f3bd-954b-4f83-8033-bac72e698024 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Successfully detached device vdb from instance 6c885751-2ce7-4071-9c9a-6149e2257400 from the live domain config.
Nov 16 10:51:49 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9641f3bd-954b-4f83-8033-bac72e698024 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] [instance: 6c885751-2ce7-4071-9c9a-6149e2257400] calling os-brick to detach iSCSI Volume {{(pid=85141) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 10:51:49 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-9641f3bd-954b-4f83-8033-bac72e698024 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51806b6080>, {'target_iqn': 'iqn.2010-10.org.openstack:b7dd164f-2094-499a-9596-204e9b1f23a5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HpMTJxum', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 10:51:49 user nova-compute[85141]: WARNING os_brick.initiator.connectors.base [None req-9641f3bd-954b-4f83-8033-bac72e698024 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 10:51:49 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-9641f3bd-954b-4f83-8033-bac72e698024 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 10:51:49 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-9641f3bd-954b-4f83-8033-bac72e698024 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 10:51:49 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:51:49 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:51:49 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdd6f212-028e-4cf7-bf02-954d7433259c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b7dd164f-2094-499a-9596-204e9b1f23a5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:51:49 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-9641f3bd-954b-4f83-8033-bac72e698024 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 10:51:49 user nova-compute[85141]: No targets found.
Nov 16 10:51:49 user nova-compute[85141]: iSNS:
Nov 16 10:51:49 user nova-compute[85141]: No targets found.
Nov 16 10:51:49 user nova-compute[85141]: STATIC:
Nov 16 10:51:49 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:b7dd164f-2094-499a-9596-204e9b1f23a5
Nov 16 10:51:49 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:51:49 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:51:49 user nova-compute[85141]: FIRMWARE:
Nov 16 10:51:49 user nova-compute[85141]: No targets found.
Nov 16 10:51:49 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:51:49 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-9641f3bd-954b-4f83-8033-bac72e698024 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 10:51:49 user nova-compute[85141]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 10:51:49 user nova-compute[85141]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=85141) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 10:51:49 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-9641f3bd-954b-4f83-8033-bac72e698024 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b7dd164f-2094-499a-9596-204e9b1f23a5', 0)] {{(pid=85141) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 10:51:49 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:51:49 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:51:49 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e9619c9-78df-46be-a611-ef80f5e898eb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b7dd164f-2094-499a-9596-204e9b1f23a5\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:51:49 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:51:49 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:51:49 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[61134ebe-64a7-4a85-9438-a4c78735e3d3]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7dd164f-2094-499a-9596-204e9b1f23a5 (non-flash)\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:51:49 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-9641f3bd-954b-4f83-8033-bac72e698024 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7dd164f-2094-499a-9596-204e9b1f23a5 (non-flash)
Nov 16 10:51:49 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:51:49 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-9641f3bd-954b-4f83-8033-bac72e698024 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7dd164f-2094-499a-9596-204e9b1f23a5 (non-flash)
Nov 16 10:51:49 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 10:51:49 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-9641f3bd-954b-4f83-8033-bac72e698024 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5198187880>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b7dd164f-2094-499a-9596-204e9b1f23a5'): ({'sdb'}, set())}) {{(pid=85141) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 10:51:49 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-9641f3bd-954b-4f83-8033-bac72e698024 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Removing single pathed devices sdb {{(pid=85141) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 10:51:49 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:51:49 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:51:49 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3fd9717-06b6-4acd-b2f5-f2d549b2e8b3]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:51:49 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:51:50 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:51:50 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[9be2704a-c271-4bfd-9b80-0a8b271f83b0]: (4, ('ok\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:51:50 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-9641f3bd-954b-4f83-8033-bac72e698024 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Flushing IO for device /dev/sdb {{(pid=85141) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 10:51:50 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:51:50 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:51:50 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[a57984be-2af9-4c58-9dd1-8367c8d859d2]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:51:50 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-9641f3bd-954b-4f83-8033-bac72e698024 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=85141) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 10:51:50 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:51:50 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:51:50 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbae6244-e127-415c-a0da-91e95c940912]: (4, ('1', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:51:50 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-9641f3bd-954b-4f83-8033-bac72e698024 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=85141) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 10:51:50 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-9641f3bd-954b-4f83-8033-bac72e698024 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] SCSI volumes sdb have been removed. {{(pid=85141) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 10:51:50 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-9641f3bd-954b-4f83-8033-bac72e698024 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b7dd164f-2094-499a-9596-204e9b1f23a5')] {{(pid=85141) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 10:51:50 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7dd164f-2094-499a-9596-204e9b1f23a5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:51:50 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7dd164f-2094-499a-9596-204e9b1f23a5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:51:50 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[02e5d828-8189-4640-883f-d0d1e621199f]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:51:50 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-9641f3bd-954b-4f83-8033-bac72e698024 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:51:50 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7dd164f-2094-499a-9596-204e9b1f23a5 -p 172.16.0.220:3260 --logout {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:51:50 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7dd164f-2094-499a-9596-204e9b1f23a5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:51:50 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[836c602e-d838-4bc4-87f6-16af1f3b1208]: (4, ('Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:b7dd164f-2094-499a-9596-204e9b1f23a5, portal: 172.16.0.220,3260]\nLogout of [sid: 68, target: iqn.2010-10.org.openstack:b7dd164f-2094-499a-9596-204e9b1f23a5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:51:50 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-9641f3bd-954b-4f83-8033-bac72e698024 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:b7dd164f-2094-499a-9596-204e9b1f23a5, portal: 172.16.0.220,3260]
Nov 16 10:51:50 user nova-compute[85141]: Logout of [sid: 68, target: iqn.2010-10.org.openstack:b7dd164f-2094-499a-9596-204e9b1f23a5, portal: 172.16.0.220,3260] successful.
Nov 16 10:51:50 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:51:50 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7dd164f-2094-499a-9596-204e9b1f23a5 -p 172.16.0.220:3260 --op delete {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:51:50 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7dd164f-2094-499a-9596-204e9b1f23a5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:51:50 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e0a23f6-cc5f-4060-a13b-db59460c217a]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:51:50 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-9641f3bd-954b-4f83-8033-bac72e698024 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:51:50 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-9641f3bd-954b-4f83-8033-bac72e698024 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.281s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 10:51:50 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-9641f3bd-954b-4f83-8033-bac72e698024 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] <== disconnect_volume: return (281ms) None {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 10:51:50 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9641f3bd-954b-4f83-8033-bac72e698024 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] [instance: 6c885751-2ce7-4071-9c9a-6149e2257400] Disconnected iSCSI Volume {{(pid=85141) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 10:51:50 user nova-compute[85141]: DEBUG nova.objects.instance [None req-9641f3bd-954b-4f83-8033-bac72e698024 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Lazy-loading 'flavor' on Instance uuid 6c885751-2ce7-4071-9c9a-6149e2257400 {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:51:50 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-9641f3bd-954b-4f83-8033-bac72e698024 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Lock "6c885751-2ce7-4071-9c9a-6149e2257400" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.562s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:51:52 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:51:53 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:51:53 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:51:53 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=85141) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 10:51:53 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=85141) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 10:51:53 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=85141) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 10:51:53 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:51:55 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:51:55 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=85141) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 10:51:58 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:51:58 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:51:58 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager.update_available_resource {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:51:58 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:51:58 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:51:58 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:51:58 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Auditing locally available compute resources for user (node: user) {{(pid=85141) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 10:51:58 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c885751-2ce7-4071-9c9a-6149e2257400/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:51:58 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c885751-2ce7-4071-9c9a-6149e2257400/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:51:58 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c885751-2ce7-4071-9c9a-6149e2257400/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:51:58 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c885751-2ce7-4071-9c9a-6149e2257400/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:51:59 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:51:59 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:51:59 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:51:59 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Hypervisor/Node resource view: name=user free_ram=8967MB free_disk=25.005184173583984GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=85141) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 10:51:59 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:51:59 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:51:59 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance 6c885751-2ce7-4071-9c9a-6149e2257400 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:51:59 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=85141) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 10:51:59 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=85141) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 10:51:59 user nova-compute[85141]: DEBUG nova.scheduler.client.report [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Refreshing inventories for resource provider bf8e0fa1-16b6-408f-9203-c4cd63916272 {{(pid=85141) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 16 10:51:59 user nova-compute[85141]: DEBUG nova.scheduler.client.report [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Updating ProviderTree inventory for provider bf8e0fa1-16b6-408f-9203-c4cd63916272 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=85141) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 16 10:51:59 user nova-compute[85141]: DEBUG nova.compute.provider_tree [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Updating inventory in ProviderTree for provider bf8e0fa1-16b6-408f-9203-c4cd63916272 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=85141) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 16 10:51:59 user nova-compute[85141]: DEBUG nova.scheduler.client.report [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Refreshing aggregate associations for resource provider bf8e0fa1-16b6-408f-9203-c4cd63916272, aggregates: None {{(pid=85141) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 16 10:51:59 user nova-compute[85141]: DEBUG nova.scheduler.client.report [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Refreshing trait associations for resource provider bf8e0fa1-16b6-408f-9203-c4cd63916272, traits: COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE41,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_ACCELERATORS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_USB,COMPUTE_TRUSTED_CERTS,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_RESCUE_BFV,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VOLUME_ATTACH_WITH_TAG {{(pid=85141) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 16 10:51:59 user nova-compute[85141]: DEBUG nova.compute.provider_tree [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Inventory has not changed in ProviderTree for provider: bf8e0fa1-16b6-408f-9203-c4cd63916272 {{(pid=85141) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 10:51:59 user nova-compute[85141]: DEBUG nova.scheduler.client.report [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Inventory has not changed for provider bf8e0fa1-16b6-408f-9203-c4cd63916272 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=85141) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 10:51:59 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Compute_service record updated for user:user {{(pid=85141) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 10:51:59 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.446s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:51:59 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:51:59 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Cleaning up deleted instances {{(pid=85141) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 16 10:51:59 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] There are 0 instances to clean {{(pid=85141) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 16 10:52:01 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:52:01 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Starting heal instance info cache {{(pid=85141) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 10:52:01 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Rebuilding the list of instances to heal {{(pid=85141) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 10:52:01 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Acquiring lock "refresh_cache-6c885751-2ce7-4071-9c9a-6149e2257400" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:52:01 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Acquired lock "refresh_cache-6c885751-2ce7-4071-9c9a-6149e2257400" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:52:01 user nova-compute[85141]: DEBUG nova.network.neutron [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] [instance: 6c885751-2ce7-4071-9c9a-6149e2257400] Forcefully refreshing network info cache for instance {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 10:52:01 user nova-compute[85141]: DEBUG nova.objects.instance [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lazy-loading 'info_cache' on Instance uuid 6c885751-2ce7-4071-9c9a-6149e2257400 {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:52:01 user nova-compute[85141]: DEBUG nova.network.neutron [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] [instance: 6c885751-2ce7-4071-9c9a-6149e2257400] Updating instance_info_cache with network_info: [{"id": "cffa62e2-3832-4bee-bb7c-f206e6cabf91", "address": "fa:16:3e:f6:ac:89", "network": {"id": "fd841f36-a23e-4993-8eab-ddc78f99e358", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1240531518-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.109", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df4af3f598d04f9a91f54796780cf8ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcffa62e2-38", "ovs_interfaceid": "cffa62e2-3832-4bee-bb7c-f206e6cabf91", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:52:01 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Releasing lock "refresh_cache-6c885751-2ce7-4071-9c9a-6149e2257400" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:52:01 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] [instance: 6c885751-2ce7-4071-9c9a-6149e2257400] Updated the network info_cache for instance {{(pid=85141) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 10:52:01 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:52:01 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:52:02 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:52:02 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Cleaning up deleted instances with incomplete migration  {{(pid=85141) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 16 10:52:04 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:52:05 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:52:09 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:52:12 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:52:14 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:52:19 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:52:21 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-0a14afe0-32da-4184-93a4-70a156c92c22 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Acquiring lock "6c885751-2ce7-4071-9c9a-6149e2257400" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:52:21 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-0a14afe0-32da-4184-93a4-70a156c92c22 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Lock "6c885751-2ce7-4071-9c9a-6149e2257400" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:52:21 user nova-compute[85141]: DEBUG nova.objects.instance [None req-0a14afe0-32da-4184-93a4-70a156c92c22 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Lazy-loading 'flavor' on Instance uuid 6c885751-2ce7-4071-9c9a-6149e2257400 {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:52:21 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-0a14afe0-32da-4184-93a4-70a156c92c22 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Lock "6c885751-2ce7-4071-9c9a-6149e2257400" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:52:21 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-0a14afe0-32da-4184-93a4-70a156c92c22 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Acquiring lock "6c885751-2ce7-4071-9c9a-6149e2257400" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:52:21 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-0a14afe0-32da-4184-93a4-70a156c92c22 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Lock "6c885751-2ce7-4071-9c9a-6149e2257400" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:52:21 user nova-compute[85141]: INFO nova.compute.manager [None req-0a14afe0-32da-4184-93a4-70a156c92c22 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] [instance: 6c885751-2ce7-4071-9c9a-6149e2257400] Attaching volume bc32af38-45df-4ff1-916a-db46be7bcf1b to /dev/vdb
Nov 16 10:52:21 user nova-compute[85141]: DEBUG os_brick.utils [None req-0a14afe0-32da-4184-93a4-70a156c92c22 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 10:52:21 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:52:21 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:52:21 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8e5326f-b20a-4af7-8f32-556a6a9dcb92]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c7834de5c295\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:52:21 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:52:21 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:52:21 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea2bfd7d-a28f-4b9f-8150-7b1d5b790c8a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:52:21 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:52:21 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:52:21 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[10487288-646c-4e99-9926-31136beb2159]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:52:21 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fab5f2d-7368-41a3-a126-89deb5f08b5e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:52:21 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-0a14afe0-32da-4184-93a4-70a156c92c22 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Running cmd (subprocess): nvme version {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:52:21 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-0a14afe0-32da-4184-93a4-70a156c92c22 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] 'nvme version' failed. Not Retrying. {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 10:52:21 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0a14afe0-32da-4184-93a4-70a156c92c22 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] nvme not present on system {{(pid=85141) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 10:52:21 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:52:21 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 10:52:21 user nova-compute[85141]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 10:52:21 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ebc40ea-7662-4fa9-8735-6828d453668f]: (4, '') {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:52:21 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.lightos [None req-0a14afe0-32da-4184-93a4-70a156c92c22 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=85141) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 10:52:21 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.lightos [None req-0a14afe0-32da-4184-93a4-70a156c92c22 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=85141) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 10:52:21 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.lightos [None req-0a14afe0-32da-4184-93a4-70a156c92c22 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] LIGHTOS: no hostnqn found. {{(pid=85141) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 10:52:21 user nova-compute[85141]: DEBUG os_brick.utils [None req-0a14afe0-32da-4184-93a4-70a156c92c22 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c7834de5c295', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 10:52:21 user nova-compute[85141]: DEBUG nova.virt.block_device [None req-0a14afe0-32da-4184-93a4-70a156c92c22 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] [instance: 6c885751-2ce7-4071-9c9a-6149e2257400] Updating existing volume attachment record: cd8a4d08-183c-41d3-8d42-927c30161f48 {{(pid=85141) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 10:52:23 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:52:24 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:52:26 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0a14afe0-32da-4184-93a4-70a156c92c22 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] [instance: 6c885751-2ce7-4071-9c9a-6149e2257400] Calling os-brick to attach iSCSI Volume {{(pid=85141) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 10:52:26 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a14afe0-32da-4184-93a4-70a156c92c22 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51806b6080>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:bc32af38-45df-4ff1-916a-db46be7bcf1b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WcjPuQOa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 10:52:26 user nova-compute[85141]: WARNING os_brick.initiator.connectors.base [None req-0a14afe0-32da-4184-93a4-70a156c92c22 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 10:52:26 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-0a14afe0-32da-4184-93a4-70a156c92c22 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 10:52:26 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-0a14afe0-32da-4184-93a4-70a156c92c22 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 10:52:26 user nova-compute[85141]: WARNING os_brick.initiator.connectors.base [None req-0a14afe0-32da-4184-93a4-70a156c92c22 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 10:52:26 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-0a14afe0-32da-4184-93a4-70a156c92c22 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bc32af38-45df-4ff1-916a-db46be7bcf1b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 10:52:26 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-0a14afe0-32da-4184-93a4-70a156c92c22 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bc32af38-45df-4ff1-916a-db46be7bcf1b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 10:52:26 user nova-compute[85141]: INFO os_brick.initiator.connectors.iscsi [None req-0a14afe0-32da-4184-93a4-70a156c92c22 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 10:52:26 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc32af38-45df-4ff1-916a-db46be7bcf1b -p 172.16.0.220:3260 {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:52:26 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc32af38-45df-4ff1-916a-db46be7bcf1b -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:52:26 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[020725c9-9617-4f40-942b-787adab34966]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:52:26 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a14afe0-32da-4184-93a4-70a156c92c22 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 10:52:26 user nova-compute[85141]:  {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:52:26 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc32af38-45df-4ff1-916a-db46be7bcf1b -p 172.16.0.220:3260 --interface default --op new {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:52:26 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc32af38-45df-4ff1-916a-db46be7bcf1b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:52:26 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c9be6be-d03e-49b9-b4d3-8d8c2c362411]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bc32af38-45df-4ff1-916a-db46be7bcf1b] added\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:52:26 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a14afe0-32da-4184-93a4-70a156c92c22 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bc32af38-45df-4ff1-916a-db46be7bcf1b] added
Nov 16 10:52:26 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:52:26 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc32af38-45df-4ff1-916a-db46be7bcf1b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:52:26 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc32af38-45df-4ff1-916a-db46be7bcf1b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:52:26 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b773c22-1e00-4ad1-b584-541a1de600d8]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:52:26 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a14afe0-32da-4184-93a4-70a156c92c22 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:52:26 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc32af38-45df-4ff1-916a-db46be7bcf1b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:52:26 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc32af38-45df-4ff1-916a-db46be7bcf1b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:52:26 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea9c5639-bb0a-4605-b610-ed404241823e]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:52:26 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a14afe0-32da-4184-93a4-70a156c92c22 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:52:26 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc32af38-45df-4ff1-916a-db46be7bcf1b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WcjPuQOa {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:52:26 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc32af38-45df-4ff1-916a-db46be7bcf1b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WcjPuQOa" returned: 0 in 0.017s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:52:26 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[4315f2e7-d7ba-4edc-8993-5136c7436ef1]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:52:26 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a14afe0-32da-4184-93a4-70a156c92c22 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WcjPuQOa'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:52:26 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc32af38-45df-4ff1-916a-db46be7bcf1b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:52:26 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc32af38-45df-4ff1-916a-db46be7bcf1b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:52:26 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[74170f29-7921-4063-845c-d3ac83b2fc09]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:52:26 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a14afe0-32da-4184-93a4-70a156c92c22 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:52:26 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:52:26 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:52:26 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2942fa5-cfa4-4291-828c-94af3aa5d67e]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:52:26 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a14afe0-32da-4184-93a4-70a156c92c22 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 16 10:52:26 user nova-compute[85141]:  {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:52:26 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a14afe0-32da-4184-93a4-70a156c92c22 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 16 10:52:26 user nova-compute[85141]:  {{(pid=85141) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 10:52:26 user nova-compute[85141]: WARNING os_brick.initiator.connectors.iscsi [None req-0a14afe0-32da-4184-93a4-70a156c92c22 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 16 10:52:26 user nova-compute[85141]: 
Nov 16 10:52:26 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc32af38-45df-4ff1-916a-db46be7bcf1b -p 172.16.0.220:3260 --login {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:52:26 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc32af38-45df-4ff1-916a-db46be7bcf1b -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:52:26 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba012a1e-1965-4c93-a16b-e469659861ae]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bc32af38-45df-4ff1-916a-db46be7bcf1b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bc32af38-45df-4ff1-916a-db46be7bcf1b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:52:26 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a14afe0-32da-4184-93a4-70a156c92c22 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bc32af38-45df-4ff1-916a-db46be7bcf1b, portal: 172.16.0.220,3260]
Nov 16 10:52:26 user nova-compute[85141]: Login to [iface: default, target: iqn.2010-10.org.openstack:bc32af38-45df-4ff1-916a-db46be7bcf1b, portal: 172.16.0.220,3260] successful.
Nov 16 10:52:26 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:52:26 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc32af38-45df-4ff1-916a-db46be7bcf1b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:52:26 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc32af38-45df-4ff1-916a-db46be7bcf1b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:52:26 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[cad07f8a-afee-45c3-9acb-afd06d4c1da6]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:52:26 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a14afe0-32da-4184-93a4-70a156c92c22 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:52:26 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:52:26 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:52:26 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[68864807-e6b5-4db2-8a5c-d8da4a18f433]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc32af38-45df-4ff1-916a-db46be7bcf1b (non-flash)\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:52:26 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a14afe0-32da-4184-93a4-70a156c92c22 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc32af38-45df-4ff1-916a-db46be7bcf1b (non-flash)
Nov 16 10:52:26 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:52:26 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a14afe0-32da-4184-93a4-70a156c92c22 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc32af38-45df-4ff1-916a-db46be7bcf1b (non-flash)
Nov 16 10:52:26 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 10:52:26 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-0a14afe0-32da-4184-93a4-70a156c92c22 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bc32af38-45df-4ff1-916a-db46be7bcf1b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.265s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 10:52:26 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a14afe0-32da-4184-93a4-70a156c92c22 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Connected to 172.16.0.220:3260 {{(pid=85141) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 10:52:26 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-0a14afe0-32da-4184-93a4-70a156c92c22 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] HCTL ('33', '-', '-', 0) found on session 69 with lun 0 {{(pid=85141) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 10:52:26 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-0a14afe0-32da-4184-93a4-70a156c92c22 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=85141) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 10:52:26 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:52:26 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:52:26 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[21cfb4d7-35c3-4646-8134-e660a6a2b1c1]: (4, ('- - 0', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:52:26 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-0a14afe0-32da-4184-93a4-70a156c92c22 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Searching for a device in session 69 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=85141) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 10:52:26 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a14afe0-32da-4184-93a4-70a156c92c22 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:bc32af38-45df-4ff1-916a-db46be7bcf1b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WcjPuQOa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=85141) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 10:52:27 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-0a14afe0-32da-4184-93a4-70a156c92c22 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.298s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 10:52:27 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a14afe0-32da-4184-93a4-70a156c92c22 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] <== connect_volume: return (1300ms) {'type': 'block', 'scsi_wwn': '23637623835376361', 'path': '/dev/sdb'} {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 10:52:27 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0a14afe0-32da-4184-93a4-70a156c92c22 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] [instance: 6c885751-2ce7-4071-9c9a-6149e2257400] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23637623835376361', 'path': '/dev/sdb'} {{(pid=85141) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 10:52:27 user nova-compute[85141]: DEBUG nova.objects.instance [None req-0a14afe0-32da-4184-93a4-70a156c92c22 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Lazy-loading 'flavor' on Instance uuid 6c885751-2ce7-4071-9c9a-6149e2257400 {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:52:27 user nova-compute[85141]: DEBUG nova.virt.libvirt.guest [None req-0a14afe0-32da-4184-93a4-70a156c92c22 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 10:52:27 user nova-compute[85141]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 10:52:27 user nova-compute[85141]:   <source dev="/dev/sdb"/>
Nov 16 10:52:27 user nova-compute[85141]:   <target dev="vdb" bus="virtio"/>
Nov 16 10:52:27 user nova-compute[85141]:   <serial>bc32af38-45df-4ff1-916a-db46be7bcf1b</serial>
Nov 16 10:52:27 user nova-compute[85141]: </disk>
Nov 16 10:52:27 user nova-compute[85141]:  {{(pid=85141) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 10:52:28 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-0a14afe0-32da-4184-93a4-70a156c92c22 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] No BDM found with device name vda, not building metadata. {{(pid=85141) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 10:52:28 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-0a14afe0-32da-4184-93a4-70a156c92c22 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] No BDM found with device name vdb, not building metadata. {{(pid=85141) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 10:52:28 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-0a14afe0-32da-4184-93a4-70a156c92c22 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] No VIF found with MAC fa:16:3e:f6:ac:89, not building metadata {{(pid=85141) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 10:52:28 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-0a14afe0-32da-4184-93a4-70a156c92c22 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Lock "6c885751-2ce7-4071-9c9a-6149e2257400" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.818s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:52:29 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:52:30 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-7f75ba26-3a94-4c44-9403-8093dee9ff03 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Acquiring lock "6c885751-2ce7-4071-9c9a-6149e2257400" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:52:30 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-7f75ba26-3a94-4c44-9403-8093dee9ff03 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Lock "6c885751-2ce7-4071-9c9a-6149e2257400" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:52:30 user nova-compute[85141]: INFO nova.compute.manager [None req-7f75ba26-3a94-4c44-9403-8093dee9ff03 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] [instance: 6c885751-2ce7-4071-9c9a-6149e2257400] Detaching volume bc32af38-45df-4ff1-916a-db46be7bcf1b
Nov 16 10:52:30 user nova-compute[85141]: INFO nova.virt.block_device [None req-7f75ba26-3a94-4c44-9403-8093dee9ff03 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] [instance: 6c885751-2ce7-4071-9c9a-6149e2257400] Attempting to driver detach volume bc32af38-45df-4ff1-916a-db46be7bcf1b from mountpoint /dev/vdb
Nov 16 10:52:30 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-7f75ba26-3a94-4c44-9403-8093dee9ff03 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Attempting to detach device vdb from instance 6c885751-2ce7-4071-9c9a-6149e2257400 from the persistent domain config. {{(pid=85141) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 10:52:30 user nova-compute[85141]: DEBUG nova.virt.libvirt.guest [None req-7f75ba26-3a94-4c44-9403-8093dee9ff03 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 10:52:30 user nova-compute[85141]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 10:52:30 user nova-compute[85141]:   <source dev="/dev/sdb"/>
Nov 16 10:52:30 user nova-compute[85141]:   <target dev="vdb" bus="virtio"/>
Nov 16 10:52:30 user nova-compute[85141]:   <serial>bc32af38-45df-4ff1-916a-db46be7bcf1b</serial>
Nov 16 10:52:30 user nova-compute[85141]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 10:52:30 user nova-compute[85141]: </disk>
Nov 16 10:52:30 user nova-compute[85141]:  {{(pid=85141) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 10:52:30 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-7f75ba26-3a94-4c44-9403-8093dee9ff03 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Successfully detached device vdb from instance 6c885751-2ce7-4071-9c9a-6149e2257400 from the persistent domain config.
Nov 16 10:52:30 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-7f75ba26-3a94-4c44-9403-8093dee9ff03 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 6c885751-2ce7-4071-9c9a-6149e2257400 from the live domain config. {{(pid=85141) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 10:52:30 user nova-compute[85141]: DEBUG nova.virt.libvirt.guest [None req-7f75ba26-3a94-4c44-9403-8093dee9ff03 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 10:52:30 user nova-compute[85141]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 10:52:30 user nova-compute[85141]:   <source dev="/dev/sdb"/>
Nov 16 10:52:30 user nova-compute[85141]:   <target dev="vdb" bus="virtio"/>
Nov 16 10:52:30 user nova-compute[85141]:   <serial>bc32af38-45df-4ff1-916a-db46be7bcf1b</serial>
Nov 16 10:52:30 user nova-compute[85141]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 10:52:30 user nova-compute[85141]: </disk>
Nov 16 10:52:30 user nova-compute[85141]:  {{(pid=85141) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 10:52:31 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-7f75ba26-3a94-4c44-9403-8093dee9ff03 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 6c885751-2ce7-4071-9c9a-6149e2257400 {{(pid=85141) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 10:52:33 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:52:34 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:52:39 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:52:39 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:52:39 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=85141) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 10:52:39 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=85141) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 10:52:39 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=85141) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 10:52:39 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:52:44 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:52:44 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:52:44 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=85141) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 10:52:44 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=85141) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 10:52:44 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=85141) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 10:52:44 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:52:49 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:52:49 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:52:49 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=85141) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 10:52:49 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=85141) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 10:52:49 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=85141) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 10:52:49 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:52:51 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-7f75ba26-3a94-4c44-9403-8093dee9ff03 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 6c885751-2ce7-4071-9c9a-6149e2257400 is timed out.
Nov 16 10:52:51 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-7f75ba26-3a94-4c44-9403-8093dee9ff03 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Successfully detached device vdb from instance 6c885751-2ce7-4071-9c9a-6149e2257400 from the live domain config.
Nov 16 10:52:51 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7f75ba26-3a94-4c44-9403-8093dee9ff03 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] [instance: 6c885751-2ce7-4071-9c9a-6149e2257400] calling os-brick to detach iSCSI Volume {{(pid=85141) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 10:52:51 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f75ba26-3a94-4c44-9403-8093dee9ff03 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51806b6080>, {'target_iqn': 'iqn.2010-10.org.openstack:bc32af38-45df-4ff1-916a-db46be7bcf1b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WcjPuQOa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 10:52:51 user nova-compute[85141]: WARNING os_brick.initiator.connectors.base [None req-7f75ba26-3a94-4c44-9403-8093dee9ff03 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 10:52:51 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-7f75ba26-3a94-4c44-9403-8093dee9ff03 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 10:52:51 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-7f75ba26-3a94-4c44-9403-8093dee9ff03 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 10:52:51 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:52:51 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:52:51 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[d921d2c7-fb3e-41f6-b92d-cd83aaaf1324]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:bc32af38-45df-4ff1-916a-db46be7bcf1b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:52:51 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f75ba26-3a94-4c44-9403-8093dee9ff03 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 10:52:51 user nova-compute[85141]: No targets found.
Nov 16 10:52:51 user nova-compute[85141]: iSNS:
Nov 16 10:52:51 user nova-compute[85141]: No targets found.
Nov 16 10:52:51 user nova-compute[85141]: STATIC:
Nov 16 10:52:51 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:bc32af38-45df-4ff1-916a-db46be7bcf1b
Nov 16 10:52:51 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:52:51 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:52:51 user nova-compute[85141]: FIRMWARE:
Nov 16 10:52:51 user nova-compute[85141]: No targets found.
Nov 16 10:52:51 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:52:51 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f75ba26-3a94-4c44-9403-8093dee9ff03 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 10:52:51 user nova-compute[85141]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 10:52:51 user nova-compute[85141]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=85141) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 10:52:51 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f75ba26-3a94-4c44-9403-8093dee9ff03 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bc32af38-45df-4ff1-916a-db46be7bcf1b', 0)] {{(pid=85141) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 10:52:51 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:52:51 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:52:51 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[14488cd3-ab6b-4fbf-8441-e011b393b3d8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bc32af38-45df-4ff1-916a-db46be7bcf1b\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:52:51 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:52:51 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:52:51 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[760a8596-2896-4cfc-8952-441fd067f448]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc32af38-45df-4ff1-916a-db46be7bcf1b (non-flash)\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:52:51 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f75ba26-3a94-4c44-9403-8093dee9ff03 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc32af38-45df-4ff1-916a-db46be7bcf1b (non-flash)
Nov 16 10:52:51 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:52:51 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f75ba26-3a94-4c44-9403-8093dee9ff03 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc32af38-45df-4ff1-916a-db46be7bcf1b (non-flash)
Nov 16 10:52:51 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 10:52:51 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f75ba26-3a94-4c44-9403-8093dee9ff03 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5180502710>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bc32af38-45df-4ff1-916a-db46be7bcf1b'): ({'sdb'}, set())}) {{(pid=85141) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 10:52:51 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-7f75ba26-3a94-4c44-9403-8093dee9ff03 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Removing single pathed devices sdb {{(pid=85141) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 10:52:51 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:52:51 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:52:51 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[fde70192-c992-48a0-b5e8-947f3b988c2a]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:52:51 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:52:51 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:52:51 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a1699d5-fbac-4493-bb3f-5428dff476a9]: (4, ('ok\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:52:51 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-7f75ba26-3a94-4c44-9403-8093dee9ff03 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Flushing IO for device /dev/sdb {{(pid=85141) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 10:52:51 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:52:51 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:52:51 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[202f1564-d843-4a79-ad2c-1598390f2245]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:52:51 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-7f75ba26-3a94-4c44-9403-8093dee9ff03 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=85141) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 10:52:51 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:52:51 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:52:51 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[4940911c-576e-42c2-ae14-f2a1708441e5]: (4, ('1', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:52:51 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-7f75ba26-3a94-4c44-9403-8093dee9ff03 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=85141) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 10:52:51 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-7f75ba26-3a94-4c44-9403-8093dee9ff03 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] SCSI volumes sdb have been removed. {{(pid=85141) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 10:52:51 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f75ba26-3a94-4c44-9403-8093dee9ff03 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bc32af38-45df-4ff1-916a-db46be7bcf1b')] {{(pid=85141) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 10:52:51 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc32af38-45df-4ff1-916a-db46be7bcf1b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:52:51 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc32af38-45df-4ff1-916a-db46be7bcf1b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:52:51 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[094ae573-4a05-4598-a930-f7b50b0843b1]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:52:51 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f75ba26-3a94-4c44-9403-8093dee9ff03 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:52:51 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc32af38-45df-4ff1-916a-db46be7bcf1b -p 172.16.0.220:3260 --logout {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:52:51 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc32af38-45df-4ff1-916a-db46be7bcf1b -p 172.16.0.220:3260 --logout" returned: 0 in 0.042s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:52:51 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f02e008-421d-49bd-b7ad-7ffc4794409a]: (4, ('Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:bc32af38-45df-4ff1-916a-db46be7bcf1b, portal: 172.16.0.220,3260]\nLogout of [sid: 69, target: iqn.2010-10.org.openstack:bc32af38-45df-4ff1-916a-db46be7bcf1b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:52:51 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f75ba26-3a94-4c44-9403-8093dee9ff03 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:bc32af38-45df-4ff1-916a-db46be7bcf1b, portal: 172.16.0.220,3260]
Nov 16 10:52:51 user nova-compute[85141]: Logout of [sid: 69, target: iqn.2010-10.org.openstack:bc32af38-45df-4ff1-916a-db46be7bcf1b, portal: 172.16.0.220,3260] successful.
Nov 16 10:52:51 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:52:51 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc32af38-45df-4ff1-916a-db46be7bcf1b -p 172.16.0.220:3260 --op delete {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:52:51 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc32af38-45df-4ff1-916a-db46be7bcf1b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:52:51 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[026df037-0880-49c2-bb08-033ab757b6d5]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:52:51 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f75ba26-3a94-4c44-9403-8093dee9ff03 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:52:51 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-7f75ba26-3a94-4c44-9403-8093dee9ff03 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.260s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 10:52:51 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f75ba26-3a94-4c44-9403-8093dee9ff03 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] <== disconnect_volume: return (261ms) None {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 10:52:51 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7f75ba26-3a94-4c44-9403-8093dee9ff03 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] [instance: 6c885751-2ce7-4071-9c9a-6149e2257400] Disconnected iSCSI Volume {{(pid=85141) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 10:52:52 user nova-compute[85141]: DEBUG nova.objects.instance [None req-7f75ba26-3a94-4c44-9403-8093dee9ff03 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Lazy-loading 'flavor' on Instance uuid 6c885751-2ce7-4071-9c9a-6149e2257400 {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:52:52 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-7f75ba26-3a94-4c44-9403-8093dee9ff03 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Lock "6c885751-2ce7-4071-9c9a-6149e2257400" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.520s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:52:52 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:52:54 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:52:54 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:52:54 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=85141) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 10:52:54 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=85141) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 10:52:54 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=85141) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 10:52:54 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:52:57 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:52:57 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:52:57 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=85141) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 10:52:58 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:52:59 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:52:59 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:52:59 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=85141) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 10:52:59 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=85141) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 10:52:59 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=85141) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 10:52:59 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:53:00 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:53:00 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Starting heal instance info cache {{(pid=85141) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 10:53:00 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Rebuilding the list of instances to heal {{(pid=85141) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 10:53:00 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Acquiring lock "refresh_cache-6c885751-2ce7-4071-9c9a-6149e2257400" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:53:00 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Acquired lock "refresh_cache-6c885751-2ce7-4071-9c9a-6149e2257400" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:53:00 user nova-compute[85141]: DEBUG nova.network.neutron [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] [instance: 6c885751-2ce7-4071-9c9a-6149e2257400] Forcefully refreshing network info cache for instance {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 10:53:00 user nova-compute[85141]: DEBUG nova.objects.instance [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lazy-loading 'info_cache' on Instance uuid 6c885751-2ce7-4071-9c9a-6149e2257400 {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:53:00 user nova-compute[85141]: DEBUG nova.network.neutron [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] [instance: 6c885751-2ce7-4071-9c9a-6149e2257400] Updating instance_info_cache with network_info: [{"id": "cffa62e2-3832-4bee-bb7c-f206e6cabf91", "address": "fa:16:3e:f6:ac:89", "network": {"id": "fd841f36-a23e-4993-8eab-ddc78f99e358", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1240531518-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.109", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df4af3f598d04f9a91f54796780cf8ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcffa62e2-38", "ovs_interfaceid": "cffa62e2-3832-4bee-bb7c-f206e6cabf91", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:53:00 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Releasing lock "refresh_cache-6c885751-2ce7-4071-9c9a-6149e2257400" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:53:00 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] [instance: 6c885751-2ce7-4071-9c9a-6149e2257400] Updated the network info_cache for instance {{(pid=85141) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 10:53:00 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:53:00 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager.update_available_resource {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:53:00 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:53:00 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:53:00 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:53:00 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Auditing locally available compute resources for user (node: user) {{(pid=85141) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 10:53:00 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c885751-2ce7-4071-9c9a-6149e2257400/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:53:01 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c885751-2ce7-4071-9c9a-6149e2257400/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:53:01 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c885751-2ce7-4071-9c9a-6149e2257400/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:53:01 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c885751-2ce7-4071-9c9a-6149e2257400/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:53:01 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:53:01 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:53:01 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Hypervisor/Node resource view: name=user free_ram=9006MB free_disk=25.004180908203125GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=85141) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 10:53:01 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:53:01 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:53:01 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance 6c885751-2ce7-4071-9c9a-6149e2257400 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:53:01 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=85141) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 10:53:01 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=85141) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 10:53:01 user nova-compute[85141]: DEBUG nova.compute.provider_tree [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Inventory has not changed in ProviderTree for provider: bf8e0fa1-16b6-408f-9203-c4cd63916272 {{(pid=85141) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 10:53:01 user nova-compute[85141]: DEBUG nova.scheduler.client.report [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Inventory has not changed for provider bf8e0fa1-16b6-408f-9203-c4cd63916272 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=85141) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 10:53:01 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Compute_service record updated for user:user {{(pid=85141) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 10:53:01 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.182s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:53:04 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:53:04 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:53:06 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:53:09 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:53:09 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:53:09 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=85141) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 10:53:09 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=85141) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 10:53:09 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=85141) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 10:53:09 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:53:14 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:53:14 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:53:14 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=85141) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 10:53:14 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=85141) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 10:53:14 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=85141) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 10:53:14 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:53:14 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:53:19 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:53:22 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-ae1b1c3f-3cb7-4dd8-832a-efc94b2155b9 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Acquiring lock "6c885751-2ce7-4071-9c9a-6149e2257400" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:53:22 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-ae1b1c3f-3cb7-4dd8-832a-efc94b2155b9 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Lock "6c885751-2ce7-4071-9c9a-6149e2257400" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:53:22 user nova-compute[85141]: DEBUG nova.objects.instance [None req-ae1b1c3f-3cb7-4dd8-832a-efc94b2155b9 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Lazy-loading 'flavor' on Instance uuid 6c885751-2ce7-4071-9c9a-6149e2257400 {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:53:22 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-ae1b1c3f-3cb7-4dd8-832a-efc94b2155b9 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Lock "6c885751-2ce7-4071-9c9a-6149e2257400" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:53:23 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-ae1b1c3f-3cb7-4dd8-832a-efc94b2155b9 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Acquiring lock "6c885751-2ce7-4071-9c9a-6149e2257400" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:53:23 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-ae1b1c3f-3cb7-4dd8-832a-efc94b2155b9 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Lock "6c885751-2ce7-4071-9c9a-6149e2257400" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:53:23 user nova-compute[85141]: INFO nova.compute.manager [None req-ae1b1c3f-3cb7-4dd8-832a-efc94b2155b9 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] [instance: 6c885751-2ce7-4071-9c9a-6149e2257400] Attaching volume 3a4a2146-bd2f-479a-9ae4-229cab65bb7d to /dev/vdb
Nov 16 10:53:23 user nova-compute[85141]: DEBUG os_brick.utils [None req-ae1b1c3f-3cb7-4dd8-832a-efc94b2155b9 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 10:53:23 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:53:23 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:53:23 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[bae1d4cd-b8a8-4248-8b9e-67a315cd41db]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c7834de5c295\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:53:23 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:53:23 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:53:23 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[904167a2-eee6-4f86-9e00-c306271a7a8b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:53:23 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:53:23 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:53:23 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e231b61-5884-4c60-8204-ce436bfd94fb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:53:23 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[8758b38e-0fbc-472f-a520-602c5d0f7fc9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:53:23 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-ae1b1c3f-3cb7-4dd8-832a-efc94b2155b9 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Running cmd (subprocess): nvme version {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:53:23 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-ae1b1c3f-3cb7-4dd8-832a-efc94b2155b9 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] 'nvme version' failed. Not Retrying. {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 10:53:23 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ae1b1c3f-3cb7-4dd8-832a-efc94b2155b9 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] nvme not present on system {{(pid=85141) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 10:53:23 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:53:23 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 10:53:23 user nova-compute[85141]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 10:53:23 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[f58178e2-5200-4c94-a7e7-2651336aa05a]: (4, '') {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:53:23 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.lightos [None req-ae1b1c3f-3cb7-4dd8-832a-efc94b2155b9 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=85141) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 10:53:23 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.lightos [None req-ae1b1c3f-3cb7-4dd8-832a-efc94b2155b9 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=85141) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 10:53:23 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.lightos [None req-ae1b1c3f-3cb7-4dd8-832a-efc94b2155b9 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] LIGHTOS: no hostnqn found. {{(pid=85141) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 10:53:23 user nova-compute[85141]: DEBUG os_brick.utils [None req-ae1b1c3f-3cb7-4dd8-832a-efc94b2155b9 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c7834de5c295', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 10:53:23 user nova-compute[85141]: DEBUG nova.virt.block_device [None req-ae1b1c3f-3cb7-4dd8-832a-efc94b2155b9 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] [instance: 6c885751-2ce7-4071-9c9a-6149e2257400] Updating existing volume attachment record: 3051041c-d770-458e-92e0-a1dab5fa4653 {{(pid=85141) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 10:53:23 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:53:24 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:53:28 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ae1b1c3f-3cb7-4dd8-832a-efc94b2155b9 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] [instance: 6c885751-2ce7-4071-9c9a-6149e2257400] Calling os-brick to attach iSCSI Volume {{(pid=85141) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 10:53:28 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae1b1c3f-3cb7-4dd8-832a-efc94b2155b9 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51806b6080>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3a4a2146-bd2f-479a-9ae4-229cab65bb7d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yJZIhYsn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 10:53:28 user nova-compute[85141]: WARNING os_brick.initiator.connectors.base [None req-ae1b1c3f-3cb7-4dd8-832a-efc94b2155b9 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 10:53:28 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-ae1b1c3f-3cb7-4dd8-832a-efc94b2155b9 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 10:53:28 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-ae1b1c3f-3cb7-4dd8-832a-efc94b2155b9 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 10:53:28 user nova-compute[85141]: WARNING os_brick.initiator.connectors.base [None req-ae1b1c3f-3cb7-4dd8-832a-efc94b2155b9 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 10:53:28 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-ae1b1c3f-3cb7-4dd8-832a-efc94b2155b9 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3a4a2146-bd2f-479a-9ae4-229cab65bb7d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 10:53:28 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-ae1b1c3f-3cb7-4dd8-832a-efc94b2155b9 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3a4a2146-bd2f-479a-9ae4-229cab65bb7d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 10:53:28 user nova-compute[85141]: INFO os_brick.initiator.connectors.iscsi [None req-ae1b1c3f-3cb7-4dd8-832a-efc94b2155b9 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 10:53:28 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a4a2146-bd2f-479a-9ae4-229cab65bb7d -p 172.16.0.220:3260 {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:53:28 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a4a2146-bd2f-479a-9ae4-229cab65bb7d -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:53:28 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[da41afc5-1373-4c0b-8061-09e9b96a7e93]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:53:28 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae1b1c3f-3cb7-4dd8-832a-efc94b2155b9 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 10:53:28 user nova-compute[85141]:  {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:53:28 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a4a2146-bd2f-479a-9ae4-229cab65bb7d -p 172.16.0.220:3260 --interface default --op new {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:53:28 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a4a2146-bd2f-479a-9ae4-229cab65bb7d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:53:28 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd12f9a0-be99-4ca6-9b4a-de80b1c9d4fc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3a4a2146-bd2f-479a-9ae4-229cab65bb7d] added\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:53:28 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae1b1c3f-3cb7-4dd8-832a-efc94b2155b9 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3a4a2146-bd2f-479a-9ae4-229cab65bb7d] added
Nov 16 10:53:28 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:53:28 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a4a2146-bd2f-479a-9ae4-229cab65bb7d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:53:28 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a4a2146-bd2f-479a-9ae4-229cab65bb7d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:53:28 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[14d736ef-33fe-4cac-8c88-9a120b0b8008]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:53:28 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae1b1c3f-3cb7-4dd8-832a-efc94b2155b9 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:53:28 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a4a2146-bd2f-479a-9ae4-229cab65bb7d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:53:28 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a4a2146-bd2f-479a-9ae4-229cab65bb7d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:53:28 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[73f6d688-0e2e-46f3-94e0-076ea8db3ba0]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:53:28 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae1b1c3f-3cb7-4dd8-832a-efc94b2155b9 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:53:28 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a4a2146-bd2f-479a-9ae4-229cab65bb7d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yJZIhYsn {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:53:28 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a4a2146-bd2f-479a-9ae4-229cab65bb7d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yJZIhYsn" returned: 0 in 0.017s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:53:28 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[1025096f-61c3-46c7-b92f-95f5f3d5b733]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:53:28 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae1b1c3f-3cb7-4dd8-832a-efc94b2155b9 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yJZIhYsn'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:53:28 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a4a2146-bd2f-479a-9ae4-229cab65bb7d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:53:28 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a4a2146-bd2f-479a-9ae4-229cab65bb7d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:53:28 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5b95ee2-f44b-4cf6-9ee4-5fae140dbc54]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:53:28 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae1b1c3f-3cb7-4dd8-832a-efc94b2155b9 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:53:28 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:53:28 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:53:28 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe45d6c7-bcc7-4c06-a282-9ee81c0830ac]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:53:28 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae1b1c3f-3cb7-4dd8-832a-efc94b2155b9 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 16 10:53:28 user nova-compute[85141]:  {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:53:28 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae1b1c3f-3cb7-4dd8-832a-efc94b2155b9 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 16 10:53:28 user nova-compute[85141]:  {{(pid=85141) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 10:53:28 user nova-compute[85141]: WARNING os_brick.initiator.connectors.iscsi [None req-ae1b1c3f-3cb7-4dd8-832a-efc94b2155b9 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 16 10:53:28 user nova-compute[85141]: 
Nov 16 10:53:28 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a4a2146-bd2f-479a-9ae4-229cab65bb7d -p 172.16.0.220:3260 --login {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:53:28 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a4a2146-bd2f-479a-9ae4-229cab65bb7d -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:53:28 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[816106bb-fbca-4a53-966b-d0f9adc05d20]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3a4a2146-bd2f-479a-9ae4-229cab65bb7d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3a4a2146-bd2f-479a-9ae4-229cab65bb7d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:53:28 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae1b1c3f-3cb7-4dd8-832a-efc94b2155b9 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3a4a2146-bd2f-479a-9ae4-229cab65bb7d, portal: 172.16.0.220,3260]
Nov 16 10:53:28 user nova-compute[85141]: Login to [iface: default, target: iqn.2010-10.org.openstack:3a4a2146-bd2f-479a-9ae4-229cab65bb7d, portal: 172.16.0.220,3260] successful.
Nov 16 10:53:28 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:53:28 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a4a2146-bd2f-479a-9ae4-229cab65bb7d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:53:28 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a4a2146-bd2f-479a-9ae4-229cab65bb7d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:53:28 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff54297b-506b-4d35-821f-6d222236198d]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:53:28 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae1b1c3f-3cb7-4dd8-832a-efc94b2155b9 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:53:28 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:53:28 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:53:28 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e2885f5-9eea-45df-b3f3-582396262739]: (4, ('tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a4a2146-bd2f-479a-9ae4-229cab65bb7d (non-flash)\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:53:28 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae1b1c3f-3cb7-4dd8-832a-efc94b2155b9 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a4a2146-bd2f-479a-9ae4-229cab65bb7d (non-flash)
Nov 16 10:53:28 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:53:28 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae1b1c3f-3cb7-4dd8-832a-efc94b2155b9 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] iscsi session list stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a4a2146-bd2f-479a-9ae4-229cab65bb7d (non-flash)
Nov 16 10:53:28 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 10:53:28 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-ae1b1c3f-3cb7-4dd8-832a-efc94b2155b9 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3a4a2146-bd2f-479a-9ae4-229cab65bb7d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.260s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 10:53:28 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae1b1c3f-3cb7-4dd8-832a-efc94b2155b9 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Connected to 172.16.0.220:3260 {{(pid=85141) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 10:53:28 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-ae1b1c3f-3cb7-4dd8-832a-efc94b2155b9 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] HCTL ('33', '-', '-', 0) found on session 70 with lun 0 {{(pid=85141) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 10:53:28 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-ae1b1c3f-3cb7-4dd8-832a-efc94b2155b9 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=85141) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 10:53:28 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:53:28 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:53:28 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[1af38eeb-52ea-4f9c-94ce-0a749d50e810]: (4, ('- - 0', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:53:28 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-ae1b1c3f-3cb7-4dd8-832a-efc94b2155b9 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Searching for a device in session 70 and hctl ['33', '*', '*', 0] yield: None {{(pid=85141) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 10:53:29 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:53:29 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:53:29 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=85141) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 10:53:29 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=85141) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 10:53:29 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=85141) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 10:53:29 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:53:29 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-ae1b1c3f-3cb7-4dd8-832a-efc94b2155b9 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Searching for a device in session 70 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=85141) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 10:53:29 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae1b1c3f-3cb7-4dd8-832a-efc94b2155b9 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:3a4a2146-bd2f-479a-9ae4-229cab65bb7d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yJZIhYsn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=85141) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 10:53:29 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-ae1b1c3f-3cb7-4dd8-832a-efc94b2155b9 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.289s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 10:53:29 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae1b1c3f-3cb7-4dd8-832a-efc94b2155b9 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] <== connect_volume: return (1290ms) {'type': 'block', 'scsi_wwn': '23331316261306230', 'path': '/dev/sdb'} {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 10:53:29 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ae1b1c3f-3cb7-4dd8-832a-efc94b2155b9 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] [instance: 6c885751-2ce7-4071-9c9a-6149e2257400] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23331316261306230', 'path': '/dev/sdb'} {{(pid=85141) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 10:53:29 user nova-compute[85141]: DEBUG nova.objects.instance [None req-ae1b1c3f-3cb7-4dd8-832a-efc94b2155b9 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Lazy-loading 'flavor' on Instance uuid 6c885751-2ce7-4071-9c9a-6149e2257400 {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:53:29 user nova-compute[85141]: DEBUG nova.virt.libvirt.guest [None req-ae1b1c3f-3cb7-4dd8-832a-efc94b2155b9 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 10:53:29 user nova-compute[85141]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 10:53:29 user nova-compute[85141]:   <source dev="/dev/sdb"/>
Nov 16 10:53:29 user nova-compute[85141]:   <target dev="vdb" bus="virtio"/>
Nov 16 10:53:29 user nova-compute[85141]:   <serial>3a4a2146-bd2f-479a-9ae4-229cab65bb7d</serial>
Nov 16 10:53:29 user nova-compute[85141]: </disk>
Nov 16 10:53:29 user nova-compute[85141]:  {{(pid=85141) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 10:53:29 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-ae1b1c3f-3cb7-4dd8-832a-efc94b2155b9 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] No BDM found with device name vda, not building metadata. {{(pid=85141) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 10:53:29 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-ae1b1c3f-3cb7-4dd8-832a-efc94b2155b9 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] No BDM found with device name vdb, not building metadata. {{(pid=85141) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 10:53:29 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-ae1b1c3f-3cb7-4dd8-832a-efc94b2155b9 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] No VIF found with MAC fa:16:3e:f6:ac:89, not building metadata {{(pid=85141) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 10:53:29 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-ae1b1c3f-3cb7-4dd8-832a-efc94b2155b9 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Lock "6c885751-2ce7-4071-9c9a-6149e2257400" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.800s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:53:32 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-47db86a0-c04a-4331-860e-cfc8cb58c830 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Acquiring lock "6c885751-2ce7-4071-9c9a-6149e2257400" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:53:32 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-47db86a0-c04a-4331-860e-cfc8cb58c830 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Lock "6c885751-2ce7-4071-9c9a-6149e2257400" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:53:32 user nova-compute[85141]: INFO nova.compute.manager [None req-47db86a0-c04a-4331-860e-cfc8cb58c830 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] [instance: 6c885751-2ce7-4071-9c9a-6149e2257400] Detaching volume 3a4a2146-bd2f-479a-9ae4-229cab65bb7d
Nov 16 10:53:32 user nova-compute[85141]: INFO nova.virt.block_device [None req-47db86a0-c04a-4331-860e-cfc8cb58c830 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] [instance: 6c885751-2ce7-4071-9c9a-6149e2257400] Attempting to driver detach volume 3a4a2146-bd2f-479a-9ae4-229cab65bb7d from mountpoint /dev/vdb
Nov 16 10:53:32 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-47db86a0-c04a-4331-860e-cfc8cb58c830 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Attempting to detach device vdb from instance 6c885751-2ce7-4071-9c9a-6149e2257400 from the persistent domain config. {{(pid=85141) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 10:53:32 user nova-compute[85141]: DEBUG nova.virt.libvirt.guest [None req-47db86a0-c04a-4331-860e-cfc8cb58c830 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 10:53:32 user nova-compute[85141]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 10:53:32 user nova-compute[85141]:   <source dev="/dev/sdb"/>
Nov 16 10:53:32 user nova-compute[85141]:   <target dev="vdb" bus="virtio"/>
Nov 16 10:53:32 user nova-compute[85141]:   <serial>3a4a2146-bd2f-479a-9ae4-229cab65bb7d</serial>
Nov 16 10:53:32 user nova-compute[85141]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 10:53:32 user nova-compute[85141]: </disk>
Nov 16 10:53:32 user nova-compute[85141]:  {{(pid=85141) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 10:53:32 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-47db86a0-c04a-4331-860e-cfc8cb58c830 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Successfully detached device vdb from instance 6c885751-2ce7-4071-9c9a-6149e2257400 from the persistent domain config.
Nov 16 10:53:32 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-47db86a0-c04a-4331-860e-cfc8cb58c830 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 6c885751-2ce7-4071-9c9a-6149e2257400 from the live domain config. {{(pid=85141) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 10:53:32 user nova-compute[85141]: DEBUG nova.virt.libvirt.guest [None req-47db86a0-c04a-4331-860e-cfc8cb58c830 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 10:53:32 user nova-compute[85141]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 10:53:32 user nova-compute[85141]:   <source dev="/dev/sdb"/>
Nov 16 10:53:32 user nova-compute[85141]:   <target dev="vdb" bus="virtio"/>
Nov 16 10:53:32 user nova-compute[85141]:   <serial>3a4a2146-bd2f-479a-9ae4-229cab65bb7d</serial>
Nov 16 10:53:32 user nova-compute[85141]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 10:53:32 user nova-compute[85141]: </disk>
Nov 16 10:53:32 user nova-compute[85141]:  {{(pid=85141) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 10:53:32 user nova-compute[85141]: DEBUG nova.virt.libvirt.driver [None req-47db86a0-c04a-4331-860e-cfc8cb58c830 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 6c885751-2ce7-4071-9c9a-6149e2257400 {{(pid=85141) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 10:53:33 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:53:34 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:53:39 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:53:44 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:53:49 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:53:52 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-47db86a0-c04a-4331-860e-cfc8cb58c830 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 6c885751-2ce7-4071-9c9a-6149e2257400 is timed out.
Nov 16 10:53:52 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-47db86a0-c04a-4331-860e-cfc8cb58c830 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Successfully detached device vdb from instance 6c885751-2ce7-4071-9c9a-6149e2257400 from the live domain config.
Nov 16 10:53:52 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-47db86a0-c04a-4331-860e-cfc8cb58c830 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] [instance: 6c885751-2ce7-4071-9c9a-6149e2257400] calling os-brick to detach iSCSI Volume {{(pid=85141) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 10:53:52 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-47db86a0-c04a-4331-860e-cfc8cb58c830 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f51806b6080>, {'target_iqn': 'iqn.2010-10.org.openstack:3a4a2146-bd2f-479a-9ae4-229cab65bb7d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yJZIhYsn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 10:53:52 user nova-compute[85141]: WARNING os_brick.initiator.connectors.base [None req-47db86a0-c04a-4331-860e-cfc8cb58c830 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 10:53:52 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-47db86a0-c04a-4331-860e-cfc8cb58c830 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 10:53:52 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-47db86a0-c04a-4331-860e-cfc8cb58c830 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 10:53:53 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:53:53 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:53:53 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[efc9e378-96ab-4dc6-b97c-4b5528dea09a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3a4a2146-bd2f-479a-9ae4-229cab65bb7d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:53:53 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-47db86a0-c04a-4331-860e-cfc8cb58c830 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 10:53:53 user nova-compute[85141]: No targets found.
Nov 16 10:53:53 user nova-compute[85141]: iSNS:
Nov 16 10:53:53 user nova-compute[85141]: No targets found.
Nov 16 10:53:53 user nova-compute[85141]: STATIC:
Nov 16 10:53:53 user nova-compute[85141]: Target: iqn.2010-10.org.openstack:3a4a2146-bd2f-479a-9ae4-229cab65bb7d
Nov 16 10:53:53 user nova-compute[85141]:         Portal: 172.16.0.220:3260,-1
Nov 16 10:53:53 user nova-compute[85141]:                 Iface Name: default
Nov 16 10:53:53 user nova-compute[85141]: FIRMWARE:
Nov 16 10:53:53 user nova-compute[85141]: No targets found.
Nov 16 10:53:53 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:53:53 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-47db86a0-c04a-4331-860e-cfc8cb58c830 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 10:53:53 user nova-compute[85141]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 10:53:53 user nova-compute[85141]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=85141) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 10:53:53 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-47db86a0-c04a-4331-860e-cfc8cb58c830 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3a4a2146-bd2f-479a-9ae4-229cab65bb7d', 0)] {{(pid=85141) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 10:53:53 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:53:53 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:53:53 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d7baa37-2dba-49b5-87de-326c6049fb85]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3a4a2146-bd2f-479a-9ae4-229cab65bb7d\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:53:53 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:53:53 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:53:53 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[5523a175-d288-4a1d-b09c-0e85c9692e11]: (4, ('tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a4a2146-bd2f-479a-9ae4-229cab65bb7d (non-flash)\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:53:53 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-47db86a0-c04a-4331-860e-cfc8cb58c830 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a4a2146-bd2f-479a-9ae4-229cab65bb7d (non-flash)
Nov 16 10:53:53 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 10:53:53 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-47db86a0-c04a-4331-860e-cfc8cb58c830 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] iscsi session list stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a4a2146-bd2f-479a-9ae4-229cab65bb7d (non-flash)
Nov 16 10:53:53 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 10:53:53 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-47db86a0-c04a-4331-860e-cfc8cb58c830 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f51606e5750>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3a4a2146-bd2f-479a-9ae4-229cab65bb7d'): ({'sdb'}, set())}) {{(pid=85141) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 10:53:53 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-47db86a0-c04a-4331-860e-cfc8cb58c830 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Removing single pathed devices sdb {{(pid=85141) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 10:53:53 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:53:53 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:53:53 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4811779-91f9-49a7-8934-7f66398c3f82]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:53:53 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:53:53 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:53:53 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[7665a5bc-b4d2-4320-aac1-08392e9ec34b]: (4, ('ok\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:53:53 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-47db86a0-c04a-4331-860e-cfc8cb58c830 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Flushing IO for device /dev/sdb {{(pid=85141) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 10:53:53 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:53:53 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:53:53 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[99824c3d-ab62-4dee-9be8-ee8263ad282f]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:53:53 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-47db86a0-c04a-4331-860e-cfc8cb58c830 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=85141) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 10:53:53 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:53:53 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:53:53 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[05f2f4b6-98cf-49e5-82ad-3712d18331f4]: (4, ('1', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:53:53 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-47db86a0-c04a-4331-860e-cfc8cb58c830 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=85141) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 10:53:53 user nova-compute[85141]: DEBUG os_brick.initiator.linuxscsi [None req-47db86a0-c04a-4331-860e-cfc8cb58c830 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] SCSI volumes sdb have been removed. {{(pid=85141) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 10:53:53 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-47db86a0-c04a-4331-860e-cfc8cb58c830 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3a4a2146-bd2f-479a-9ae4-229cab65bb7d')] {{(pid=85141) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 10:53:53 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a4a2146-bd2f-479a-9ae4-229cab65bb7d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:53:53 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a4a2146-bd2f-479a-9ae4-229cab65bb7d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:53:53 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4ef2a3b-8cfa-4379-92c9-1dc717ae8937]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:53:53 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-47db86a0-c04a-4331-860e-cfc8cb58c830 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:53:53 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a4a2146-bd2f-479a-9ae4-229cab65bb7d -p 172.16.0.220:3260 --logout {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:53:53 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a4a2146-bd2f-479a-9ae4-229cab65bb7d -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:53:53 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[d74377fd-68dd-4b80-b79f-af95ddf1f709]: (4, ('Logging out of session [sid: 70, target: iqn.2010-10.org.openstack:3a4a2146-bd2f-479a-9ae4-229cab65bb7d, portal: 172.16.0.220,3260]\nLogout of [sid: 70, target: iqn.2010-10.org.openstack:3a4a2146-bd2f-479a-9ae4-229cab65bb7d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:53:53 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-47db86a0-c04a-4331-860e-cfc8cb58c830 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 70, target: iqn.2010-10.org.openstack:3a4a2146-bd2f-479a-9ae4-229cab65bb7d, portal: 172.16.0.220,3260]
Nov 16 10:53:53 user nova-compute[85141]: Logout of [sid: 70, target: iqn.2010-10.org.openstack:3a4a2146-bd2f-479a-9ae4-229cab65bb7d, portal: 172.16.0.220,3260] successful.
Nov 16 10:53:53 user nova-compute[85141]:  stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:53:53 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a4a2146-bd2f-479a-9ae4-229cab65bb7d -p 172.16.0.220:3260 --op delete {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:53:53 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a4a2146-bd2f-479a-9ae4-229cab65bb7d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.016s {{(pid=95342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:53:53 user nova-compute[85141]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eb257ef-3ce0-4727-949e-b3fa30dc5334]: (4, ('', '')) {{(pid=95342) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 10:53:53 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-47db86a0-c04a-4331-860e-cfc8cb58c830 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=85141) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 10:53:53 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.base [None req-47db86a0-c04a-4331-860e-cfc8cb58c830 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.268s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 10:53:53 user nova-compute[85141]: DEBUG os_brick.initiator.connectors.iscsi [None req-47db86a0-c04a-4331-860e-cfc8cb58c830 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] <== disconnect_volume: return (269ms) None {{(pid=85141) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 10:53:53 user nova-compute[85141]: DEBUG nova.virt.libvirt.volume.iscsi [None req-47db86a0-c04a-4331-860e-cfc8cb58c830 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] [instance: 6c885751-2ce7-4071-9c9a-6149e2257400] Disconnected iSCSI Volume {{(pid=85141) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 10:53:53 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:53:53 user nova-compute[85141]: DEBUG nova.objects.instance [None req-47db86a0-c04a-4331-860e-cfc8cb58c830 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Lazy-loading 'flavor' on Instance uuid 6c885751-2ce7-4071-9c9a-6149e2257400 {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:53:54 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-47db86a0-c04a-4331-860e-cfc8cb58c830 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Lock "6c885751-2ce7-4071-9c9a-6149e2257400" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.707s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:53:54 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:53:54 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:53:54 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=85141) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 10:53:54 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=85141) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 10:53:54 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:53:54 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=85141) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 10:53:59 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:53:59 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:53:59 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=85141) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 10:54:00 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:54:00 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:54:01 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:54:01 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Starting heal instance info cache {{(pid=85141) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 10:54:01 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Rebuilding the list of instances to heal {{(pid=85141) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 10:54:01 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Acquiring lock "refresh_cache-6c885751-2ce7-4071-9c9a-6149e2257400" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 10:54:01 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Acquired lock "refresh_cache-6c885751-2ce7-4071-9c9a-6149e2257400" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 10:54:01 user nova-compute[85141]: DEBUG nova.network.neutron [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] [instance: 6c885751-2ce7-4071-9c9a-6149e2257400] Forcefully refreshing network info cache for instance {{(pid=85141) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 10:54:01 user nova-compute[85141]: DEBUG nova.objects.instance [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lazy-loading 'info_cache' on Instance uuid 6c885751-2ce7-4071-9c9a-6149e2257400 {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:54:01 user nova-compute[85141]: DEBUG nova.network.neutron [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] [instance: 6c885751-2ce7-4071-9c9a-6149e2257400] Updating instance_info_cache with network_info: [{"id": "cffa62e2-3832-4bee-bb7c-f206e6cabf91", "address": "fa:16:3e:f6:ac:89", "network": {"id": "fd841f36-a23e-4993-8eab-ddc78f99e358", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1240531518-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.109", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df4af3f598d04f9a91f54796780cf8ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcffa62e2-38", "ovs_interfaceid": "cffa62e2-3832-4bee-bb7c-f206e6cabf91", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:54:02 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Releasing lock "refresh_cache-6c885751-2ce7-4071-9c9a-6149e2257400" {{(pid=85141) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 10:54:02 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] [instance: 6c885751-2ce7-4071-9c9a-6149e2257400] Updated the network info_cache for instance {{(pid=85141) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 10:54:02 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager.update_available_resource {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:54:02 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:54:02 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:54:02 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:54:02 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Auditing locally available compute resources for user (node: user) {{(pid=85141) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 10:54:02 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c885751-2ce7-4071-9c9a-6149e2257400/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:54:02 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c885751-2ce7-4071-9c9a-6149e2257400/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:54:02 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c885751-2ce7-4071-9c9a-6149e2257400/disk --force-share --output=json {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 10:54:02 user nova-compute[85141]: DEBUG oslo_concurrency.processutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c885751-2ce7-4071-9c9a-6149e2257400/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=85141) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 10:54:02 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:54:02 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:54:02 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Hypervisor/Node resource view: name=user free_ram=8989MB free_disk=25.003253936767578GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=85141) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 10:54:02 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:54:02 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:54:02 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Instance 6c885751-2ce7-4071-9c9a-6149e2257400 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=85141) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 10:54:02 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=85141) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 10:54:02 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=85141) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 10:54:03 user nova-compute[85141]: DEBUG nova.compute.provider_tree [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Inventory has not changed in ProviderTree for provider: bf8e0fa1-16b6-408f-9203-c4cd63916272 {{(pid=85141) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 10:54:03 user nova-compute[85141]: DEBUG nova.scheduler.client.report [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Inventory has not changed for provider bf8e0fa1-16b6-408f-9203-c4cd63916272 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=85141) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 10:54:03 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Compute_service record updated for user:user {{(pid=85141) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 10:54:03 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.186s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:54:04 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:54:04 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:54:04 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=85141) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 10:54:04 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=85141) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 10:54:04 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=85141) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 10:54:04 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:54:04 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:54:06 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:54:09 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:54:09 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:54:09 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=85141) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 10:54:09 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=85141) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 10:54:09 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=85141) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 10:54:09 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:54:14 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:54:16 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:54:19 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:54:24 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:54:29 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:54:34 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:54:38 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5e58ace2-f865-42e6-a4ac-11163138c8a0 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Acquiring lock "6c885751-2ce7-4071-9c9a-6149e2257400" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:54:38 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5e58ace2-f865-42e6-a4ac-11163138c8a0 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Lock "6c885751-2ce7-4071-9c9a-6149e2257400" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:54:38 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5e58ace2-f865-42e6-a4ac-11163138c8a0 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Acquiring lock "6c885751-2ce7-4071-9c9a-6149e2257400-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:54:38 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5e58ace2-f865-42e6-a4ac-11163138c8a0 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Lock "6c885751-2ce7-4071-9c9a-6149e2257400-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:54:38 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5e58ace2-f865-42e6-a4ac-11163138c8a0 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Lock "6c885751-2ce7-4071-9c9a-6149e2257400-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:54:38 user nova-compute[85141]: INFO nova.compute.manager [None req-5e58ace2-f865-42e6-a4ac-11163138c8a0 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] [instance: 6c885751-2ce7-4071-9c9a-6149e2257400] Terminating instance
Nov 16 10:54:38 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5e58ace2-f865-42e6-a4ac-11163138c8a0 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] [instance: 6c885751-2ce7-4071-9c9a-6149e2257400] Start destroying the instance on the hypervisor. {{(pid=85141) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 10:54:38 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:54:38 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:54:38 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:54:38 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:54:38 user nova-compute[85141]: DEBUG nova.compute.manager [req-9d50bd59-14e8-48db-9755-3a38f36cd975 req-a6792614-f1ef-4119-8ecb-da8168a9384a service nova] [instance: 6c885751-2ce7-4071-9c9a-6149e2257400] Received event network-vif-unplugged-cffa62e2-3832-4bee-bb7c-f206e6cabf91 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:54:38 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-9d50bd59-14e8-48db-9755-3a38f36cd975 req-a6792614-f1ef-4119-8ecb-da8168a9384a service nova] Acquiring lock "6c885751-2ce7-4071-9c9a-6149e2257400-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:54:38 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-9d50bd59-14e8-48db-9755-3a38f36cd975 req-a6792614-f1ef-4119-8ecb-da8168a9384a service nova] Lock "6c885751-2ce7-4071-9c9a-6149e2257400-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:54:38 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-9d50bd59-14e8-48db-9755-3a38f36cd975 req-a6792614-f1ef-4119-8ecb-da8168a9384a service nova] Lock "6c885751-2ce7-4071-9c9a-6149e2257400-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:54:38 user nova-compute[85141]: DEBUG nova.compute.manager [req-9d50bd59-14e8-48db-9755-3a38f36cd975 req-a6792614-f1ef-4119-8ecb-da8168a9384a service nova] [instance: 6c885751-2ce7-4071-9c9a-6149e2257400] No waiting events found dispatching network-vif-unplugged-cffa62e2-3832-4bee-bb7c-f206e6cabf91 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:54:38 user nova-compute[85141]: DEBUG nova.compute.manager [req-9d50bd59-14e8-48db-9755-3a38f36cd975 req-a6792614-f1ef-4119-8ecb-da8168a9384a service nova] [instance: 6c885751-2ce7-4071-9c9a-6149e2257400] Received event network-vif-unplugged-cffa62e2-3832-4bee-bb7c-f206e6cabf91 for instance with task_state deleting. {{(pid=85141) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 10:54:39 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:54:39 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:54:39 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:54:39 user nova-compute[85141]: INFO nova.virt.libvirt.driver [-] [instance: 6c885751-2ce7-4071-9c9a-6149e2257400] Instance destroyed successfully.
Nov 16 10:54:39 user nova-compute[85141]: DEBUG nova.objects.instance [None req-5e58ace2-f865-42e6-a4ac-11163138c8a0 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Lazy-loading 'resources' on Instance uuid 6c885751-2ce7-4071-9c9a-6149e2257400 {{(pid=85141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 10:54:39 user nova-compute[85141]: DEBUG nova.virt.libvirt.vif [None req-5e58ace2-f865-42e6-a4ac-11163138c8a0 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T10:48:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1555667287',display_name='tempest-SnapshotDataIntegrityTests-server-1555667287',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1555667287',id=53,image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIYkWl9dnYD6Uyjw7myivQgiP0hW+BMObrpLM6mM0upEloDRTQzy96cA+Nch7WI8/cCOFHs1oMqxRQ9QRtEO2FUiHDC7DdRWEB9/umVXebdciojkbfx0duo4irCvtxMqtw==',key_name='tempest-keypair-1682224209',keypairs=<?>,launch_index=0,launched_at=2023-11-16T10:48:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='df4af3f598d04f9a91f54796780cf8ce',ramdisk_id='',reservation_id='r-d3w8bwjo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bc4ca70f-a459-4d5c-a9e6-80f1948eb48b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-1055132496',owner_user_name='tempest-SnapshotDataIntegrityTests-1055132496-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T10:48:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b657faf92df249b18eab4b1c7e4ca8d4',uuid=6c885751-2ce7-4071-9c9a-6149e2257400,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cffa62e2-3832-4bee-bb7c-f206e6cabf91", "address": "fa:16:3e:f6:ac:89", "network": {"id": "fd841f36-a23e-4993-8eab-ddc78f99e358", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1240531518-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.109", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df4af3f598d04f9a91f54796780cf8ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcffa62e2-38", "ovs_interfaceid": "cffa62e2-3832-4bee-bb7c-f206e6cabf91", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 10:54:39 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-5e58ace2-f865-42e6-a4ac-11163138c8a0 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Converting VIF {"id": "cffa62e2-3832-4bee-bb7c-f206e6cabf91", "address": "fa:16:3e:f6:ac:89", "network": {"id": "fd841f36-a23e-4993-8eab-ddc78f99e358", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1240531518-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.109", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df4af3f598d04f9a91f54796780cf8ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcffa62e2-38", "ovs_interfaceid": "cffa62e2-3832-4bee-bb7c-f206e6cabf91", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 10:54:39 user nova-compute[85141]: DEBUG nova.network.os_vif_util [None req-5e58ace2-f865-42e6-a4ac-11163138c8a0 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f6:ac:89,bridge_name='br-int',has_traffic_filtering=True,id=cffa62e2-3832-4bee-bb7c-f206e6cabf91,network=Network(fd841f36-a23e-4993-8eab-ddc78f99e358),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcffa62e2-38') {{(pid=85141) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 10:54:39 user nova-compute[85141]: DEBUG os_vif [None req-5e58ace2-f865-42e6-a4ac-11163138c8a0 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f6:ac:89,bridge_name='br-int',has_traffic_filtering=True,id=cffa62e2-3832-4bee-bb7c-f206e6cabf91,network=Network(fd841f36-a23e-4993-8eab-ddc78f99e358),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcffa62e2-38') {{(pid=85141) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 10:54:39 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:54:39 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcffa62e2-38, bridge=br-int, if_exists=True) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:54:39 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:54:39 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:54:39 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:54:39 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=96954ed8-a921-4d3d-98c8-38e4bc0a72e8) {{(pid=85141) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 10:54:39 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:54:39 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:54:39 user nova-compute[85141]: INFO os_vif [None req-5e58ace2-f865-42e6-a4ac-11163138c8a0 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f6:ac:89,bridge_name='br-int',has_traffic_filtering=True,id=cffa62e2-3832-4bee-bb7c-f206e6cabf91,network=Network(fd841f36-a23e-4993-8eab-ddc78f99e358),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcffa62e2-38')
Nov 16 10:54:39 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-5e58ace2-f865-42e6-a4ac-11163138c8a0 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] [instance: 6c885751-2ce7-4071-9c9a-6149e2257400] Deleting instance files /opt/stack/data/nova/instances/6c885751-2ce7-4071-9c9a-6149e2257400_del
Nov 16 10:54:39 user nova-compute[85141]: INFO nova.virt.libvirt.driver [None req-5e58ace2-f865-42e6-a4ac-11163138c8a0 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] [instance: 6c885751-2ce7-4071-9c9a-6149e2257400] Deletion of /opt/stack/data/nova/instances/6c885751-2ce7-4071-9c9a-6149e2257400_del complete
Nov 16 10:54:39 user nova-compute[85141]: INFO nova.compute.manager [None req-5e58ace2-f865-42e6-a4ac-11163138c8a0 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] [instance: 6c885751-2ce7-4071-9c9a-6149e2257400] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 16 10:54:39 user nova-compute[85141]: DEBUG oslo.service.loopingcall [None req-5e58ace2-f865-42e6-a4ac-11163138c8a0 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=85141) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 10:54:39 user nova-compute[85141]: DEBUG nova.compute.manager [-] [instance: 6c885751-2ce7-4071-9c9a-6149e2257400] Deallocating network for instance {{(pid=85141) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 10:54:39 user nova-compute[85141]: DEBUG nova.network.neutron [-] [instance: 6c885751-2ce7-4071-9c9a-6149e2257400] deallocate_for_instance() {{(pid=85141) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 10:54:40 user nova-compute[85141]: DEBUG nova.network.neutron [-] [instance: 6c885751-2ce7-4071-9c9a-6149e2257400] Updating instance_info_cache with network_info: [] {{(pid=85141) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 10:54:40 user nova-compute[85141]: INFO nova.compute.manager [-] [instance: 6c885751-2ce7-4071-9c9a-6149e2257400] Took 0.75 seconds to deallocate network for instance.
Nov 16 10:54:40 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5e58ace2-f865-42e6-a4ac-11163138c8a0 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:54:40 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5e58ace2-f865-42e6-a4ac-11163138c8a0 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:54:40 user nova-compute[85141]: DEBUG nova.compute.provider_tree [None req-5e58ace2-f865-42e6-a4ac-11163138c8a0 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Inventory has not changed in ProviderTree for provider: bf8e0fa1-16b6-408f-9203-c4cd63916272 {{(pid=85141) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 10:54:40 user nova-compute[85141]: DEBUG nova.scheduler.client.report [None req-5e58ace2-f865-42e6-a4ac-11163138c8a0 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Inventory has not changed for provider bf8e0fa1-16b6-408f-9203-c4cd63916272 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=85141) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 10:54:40 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5e58ace2-f865-42e6-a4ac-11163138c8a0 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.127s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:54:40 user nova-compute[85141]: INFO nova.scheduler.client.report [None req-5e58ace2-f865-42e6-a4ac-11163138c8a0 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Deleted allocations for instance 6c885751-2ce7-4071-9c9a-6149e2257400
Nov 16 10:54:40 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5e58ace2-f865-42e6-a4ac-11163138c8a0 tempest-SnapshotDataIntegrityTests-1055132496 tempest-SnapshotDataIntegrityTests-1055132496-project-member] Lock "6c885751-2ce7-4071-9c9a-6149e2257400" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.958s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:54:40 user nova-compute[85141]: DEBUG nova.compute.manager [req-80598327-dd89-4797-b80e-55ed7fe4210c req-3d7ab307-2f86-4610-8ebc-127504db3b2f service nova] [instance: 6c885751-2ce7-4071-9c9a-6149e2257400] Received event network-vif-plugged-cffa62e2-3832-4bee-bb7c-f206e6cabf91 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:54:40 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-80598327-dd89-4797-b80e-55ed7fe4210c req-3d7ab307-2f86-4610-8ebc-127504db3b2f service nova] Acquiring lock "6c885751-2ce7-4071-9c9a-6149e2257400-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:54:40 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-80598327-dd89-4797-b80e-55ed7fe4210c req-3d7ab307-2f86-4610-8ebc-127504db3b2f service nova] Lock "6c885751-2ce7-4071-9c9a-6149e2257400-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:54:40 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [req-80598327-dd89-4797-b80e-55ed7fe4210c req-3d7ab307-2f86-4610-8ebc-127504db3b2f service nova] Lock "6c885751-2ce7-4071-9c9a-6149e2257400-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:54:40 user nova-compute[85141]: DEBUG nova.compute.manager [req-80598327-dd89-4797-b80e-55ed7fe4210c req-3d7ab307-2f86-4610-8ebc-127504db3b2f service nova] [instance: 6c885751-2ce7-4071-9c9a-6149e2257400] No waiting events found dispatching network-vif-plugged-cffa62e2-3832-4bee-bb7c-f206e6cabf91 {{(pid=85141) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 10:54:40 user nova-compute[85141]: WARNING nova.compute.manager [req-80598327-dd89-4797-b80e-55ed7fe4210c req-3d7ab307-2f86-4610-8ebc-127504db3b2f service nova] [instance: 6c885751-2ce7-4071-9c9a-6149e2257400] Received unexpected event network-vif-plugged-cffa62e2-3832-4bee-bb7c-f206e6cabf91 for instance with vm_state deleted and task_state None.
Nov 16 10:54:40 user nova-compute[85141]: DEBUG nova.compute.manager [req-80598327-dd89-4797-b80e-55ed7fe4210c req-3d7ab307-2f86-4610-8ebc-127504db3b2f service nova] [instance: 6c885751-2ce7-4071-9c9a-6149e2257400] Received event network-vif-deleted-cffa62e2-3832-4bee-bb7c-f206e6cabf91 {{(pid=85141) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 10:54:44 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:54:49 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:54:49 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:54:49 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=85141) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 10:54:49 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=85141) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 10:54:49 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=85141) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 10:54:49 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:54:53 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:54:54 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:54:59 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:55:01 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:55:01 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:55:01 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Starting heal instance info cache {{(pid=85141) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 10:55:01 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Rebuilding the list of instances to heal {{(pid=85141) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 10:55:01 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Didn't find any instances for network info cache update. {{(pid=85141) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 16 10:55:01 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:55:01 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:55:01 user nova-compute[85141]: DEBUG nova.compute.manager [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=85141) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 10:55:02 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:55:03 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:55:03 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager.update_available_resource {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:55:03 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:55:03 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:55:03 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:55:03 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Auditing locally available compute resources for user (node: user) {{(pid=85141) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 10:55:03 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:55:03 user nova-compute[85141]: WARNING nova.virt.libvirt.driver [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 10:55:03 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Hypervisor/Node resource view: name=user free_ram=9126MB free_disk=25.03038787841797GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=85141) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 10:55:03 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 10:55:03 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 10:55:03 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=85141) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 10:55:03 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=85141) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 10:55:03 user nova-compute[85141]: DEBUG nova.compute.provider_tree [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Inventory has not changed in ProviderTree for provider: bf8e0fa1-16b6-408f-9203-c4cd63916272 {{(pid=85141) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 10:55:03 user nova-compute[85141]: DEBUG nova.scheduler.client.report [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Inventory has not changed for provider bf8e0fa1-16b6-408f-9203-c4cd63916272 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=85141) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 10:55:03 user nova-compute[85141]: DEBUG nova.compute.resource_tracker [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Compute_service record updated for user:user {{(pid=85141) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 10:55:03 user nova-compute[85141]: DEBUG oslo_concurrency.lockutils [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.145s {{(pid=85141) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 10:55:04 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:55:04 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:55:04 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=85141) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 10:55:04 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=85141) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 10:55:04 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=85141) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 10:55:04 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:55:08 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:55:09 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:55:09 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:55:09 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=85141) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 10:55:09 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=85141) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 10:55:09 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=85141) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 10:55:09 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:55:14 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:55:17 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:55:19 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:55:24 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 10:55:29 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:55:29 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:55:32 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:55:34 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:55:36 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:55:39 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:55:44 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:55:49 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 10:55:53 user nova-compute[85141]: DEBUG oslo_service.periodic_task [None req-5fbf37e8-40b8-492a-bd9c-b027620d9c6b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=85141) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 10:55:54 user nova-compute[85141]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=85141) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}